Projects per year
Abstract
Investigating how people perceive virtual reality (VR) videos in the wild (i.e., those captured by everyday users) is a crucial and challenging task in VR-related applications due to complex authentic distortions localized in space and time. Existing panoramic video databases only consider synthetic distortions, assume fixed viewing conditions, and are limited in size. To overcome these shortcomings, we construct the VR Video Quality in the Wild (VRVQW) database, containing 502 user-generated videos with diverse content and distortion characteristics. Based on VRVQW, we conduct a formal psychophysical experiment to record the scanpaths and perceived quality scores from 139 participants under two different viewing conditions. We provide a thorough statistical analysis of the recorded data, observing significant impact of viewing conditions on both human scanpaths and perceived quality. Moreover, we develop an objective quality assessment model for VR videos based on pseudocylindrical representation and convolution. Results on the proposed VRVQW show that our method is superior to existing video quality assessment models. We have made the database and code available at https://github.com/limuhit/VR-Video-Quality-in-the-Wild. © 2024 IEEE.
| Original language | English |
|---|---|
| Pages (from-to) | 8368-8381 |
| Number of pages | 14 |
| Journal | IEEE Transactions on Circuits and Systems for Video Technology |
| Volume | 34 |
| Issue number | 9 |
| Online published | 19 Mar 2024 |
| DOIs | |
| Publication status | Published - Sept 2024 |
Bibliographical note
Research Unit(s) information for this publication is provided by the author(s) concerned.Funding
This work was supported in part by National Natural Science Foundation of China (NSFC) under Grants 62102339 and 62132006, Shenzhen Science and Technology Program, PR China under Grant RCBS20221008093121052 and GXWD20220811170130002, and the Hong Kong RGC Early Career Scheme (9048212).
Research Keywords
- Circuits and systems
- Databases
- Distortion
- panoramic videos
- psychophysics
- Quality assessment
- Spatial resolution
- Streaming media
- video quality assessment
- Video recording
- Virtual reality
Publisher's Copyright Statement
- COPYRIGHT TERMS OF DEPOSITED POSTPRINT FILE: © 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Wen, W., Li, M., Yao, Y., & Sui, X. et al. (2024). Perceptual Quality Assessment of Virtual Reality Videos in the Wild. IEEE Transactions on Circuits and Systems for Video Technology. Advance online publication. https://doi.org/10.1109/TCSVT.2024.3378352
RGC Funding Information
- RGC-funded
Fingerprint
Dive into the research topics of 'Perceptual Quality Assessment of Virtual Reality Videos in the Wild'. Together they form a unique fingerprint.Projects
- 1 Finished
-
ECS: Efficient Assessment and Perception-driven Optimization of Practical Image Rendering
MA, K. (Principal Investigator / Project Coordinator)
1/01/22 → 9/12/25
Project: Research
Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver