Skip to main navigation Skip to search Skip to main content

Perceptual Quality Assessment of Virtual Reality Videos in the Wild

  • Wen Wen
  • , Mu Li*
  • , Yiru Yao
  • , Xiangjie Sui
  • , Yabin Zhang
  • , Long Lan
  • , Yuming Fang
  • , Kede Ma
  • *Corresponding author for this work

Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review

53 Downloads (CityUHK Scholars)

Abstract

Investigating how people perceive virtual reality (VR) videos in the wild (i.e., those captured by everyday users) is a crucial and challenging task in VR-related applications due to complex authentic distortions localized in space and time. Existing panoramic video databases only consider synthetic distortions, assume fixed viewing conditions, and are limited in size. To overcome these shortcomings, we construct the VR Video Quality in the Wild (VRVQW) database, containing 502 user-generated videos with diverse content and distortion characteristics. Based on VRVQW, we conduct a formal psychophysical experiment to record the scanpaths and perceived quality scores from 139 participants under two different viewing conditions. We provide a thorough statistical analysis of the recorded data, observing significant impact of viewing conditions on both human scanpaths and perceived quality. Moreover, we develop an objective quality assessment model for VR videos based on pseudocylindrical representation and convolution. Results on the proposed VRVQW show that our method is superior to existing video quality assessment models. We have made the database and code available at https://github.com/limuhit/VR-Video-Quality-in-the-Wild. © 2024 IEEE.
Original languageEnglish
Pages (from-to)8368-8381
Number of pages14
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume34
Issue number9
Online published19 Mar 2024
DOIs
Publication statusPublished - Sept 2024

Bibliographical note

Research Unit(s) information for this publication is provided by the author(s) concerned.

Funding

This work was supported in part by National Natural Science Foundation of China (NSFC) under Grants 62102339 and 62132006, Shenzhen Science and Technology Program, PR China under Grant RCBS20221008093121052 and GXWD20220811170130002, and the Hong Kong RGC Early Career Scheme (9048212).

Research Keywords

  • Circuits and systems
  • Databases
  • Distortion
  • panoramic videos
  • psychophysics
  • Quality assessment
  • Spatial resolution
  • Streaming media
  • video quality assessment
  • Video recording
  • Virtual reality

Publisher's Copyright Statement

  • COPYRIGHT TERMS OF DEPOSITED POSTPRINT FILE: © 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Wen, W., Li, M., Yao, Y., & Sui, X. et al. (2024). Perceptual Quality Assessment of Virtual Reality Videos in the Wild. IEEE Transactions on Circuits and Systems for Video Technology. Advance online publication. https://doi.org/10.1109/TCSVT.2024.3378352

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'Perceptual Quality Assessment of Virtual Reality Videos in the Wild'. Together they form a unique fingerprint.

Cite this