Sparse Representation-Based Video Quality Assessment for Synthesized 3D Videos

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal

2 Scopus Citations
View graph of relations

Author(s)

Detail(s)

Original languageEnglish
Article number8779585
Pages (from-to)509-524
Journal / PublicationIEEE Transactions on Image Processing
Volume29
Online published29 Jul 2019
Publication statusPublished - 2020

Abstract

The temporal flicker distortion is one of the most annoying noises in synthesized virtual view videos when they are rendered by compressed multi-view video plus depth in Three Dimensional (3D) video system. To assess the synthesized view video quality and further optimize the compression techniques in 3D video system, objective video quality assessment which can accurately measure the flicker distortion is highly needed. In this paper, we propose a full reference sparse representation-based video quality assessment method toward synthesized 3D videos. First, a synthesized video, treated as a 3D volume data with spatial (X-Y) and temporal (T) domains, is reformed and decomposed as a number of spatially neighboring temporal layers, i.e., X-T or Y-T planes. Gradient features in temporal layers of the synthesized video and strong edges of depth maps are used as key features in detecting the location of flicker distortions. Second, the dictionary learning and sparse representation for the temporal layers are then derived and applied to effectively represent the temporal flicker distortion. Third, a rank pooling method is used to pool all the temporal layer scores and obtain the score for the flicker distortion. Finally, the temporal flicker distortion measurement is combined with the conventional spatial distortion measurement to assess the quality of synthesized 3D videos. Experimental results on synthesized video quality database demonstrate our proposed method is significantly superior to the other state-of-the-art methods, especially on the view synthesis distortions induced from depth videos.

Research Area(s)

  • flicker distortion, sparse representation, synthesized view, temporal layer, Video quality assessment

Citation Format(s)

Sparse Representation-Based Video Quality Assessment for Synthesized 3D Videos. / Zhang, Yun; Zhang, Huan; Yu, Mei; Kwong, Sam; Ho, Yo-Sung.

In: IEEE Transactions on Image Processing, Vol. 29, 8779585, 2020, p. 509-524.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal