An End-to-End No-Reference Video Quality Assessment Method With Hierarchical Spatiotemporal Feature Representation

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

19 Scopus Citations
View graph of relations

Author(s)

  • Wenhao Shen
  • Mingliang Zhou
  • Weijia Jia
  • Tao Xiang
  • Bin Fang
  • Zhaowei Shang

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)651-660
Journal / PublicationIEEE Transactions on Broadcasting
Volume68
Issue number3
Online published11 Apr 2022
Publication statusPublished - Sept 2022

Abstract

In this paper, we propose a deep neural network-based no-reference (NR) video quality assessment (VQA) method with spatiotemporal feature fusion and hierarchical information integration to evaluate the perceptual quality of videos. First, a feature extraction model is proposed by using 2D and 3D convolutional layers to gradually extract spatiotemporal features from raw video clips. Second, we design a hierarchical branching network to fuse multiframe features, and the feature vectors at each hierarchical level are comprehensively considered during the process of network optimization. Finally, these two modules and quality regression are synthesized into an end-to-end architecture. Experimental results obtained on benchmark VQA databases demonstrate the superiority of our method over other state-of-the-art algorithms. The source code is available online.1

Research Area(s)

  • deep neural network, Feature extraction, Neural networks, Quality assessment, spatiotemporal information, Spatiotemporal phenomena, Streaming media, Video quality assessment, Video recording, Visualization

Citation Format(s)

An End-to-End No-Reference Video Quality Assessment Method With Hierarchical Spatiotemporal Feature Representation. / Shen, Wenhao; Zhou, Mingliang; Liao, Xingran et al.
In: IEEE Transactions on Broadcasting, Vol. 68, No. 3, 09.2022, p. 651-660.

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review