Attentional Feature Fusion for End-to-End Blind Image Quality Assessment

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

13 Scopus Citations
View graph of relations

Author(s)

  • Mingliang Zhou
  • Shujun Lang
  • Taiping Zhang
  • Zhaowei Shang
  • Tao Xiang
  • Bin Fang

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)144-152
Number of pages9
Journal / PublicationIEEE Transactions on Broadcasting
Volume69
Issue number1
Online published16 Sept 2022
Publication statusPublished - Mar 2023

Abstract

In this paper, an end-to-end blind image quality assessment (BIQA) model based on feature fusion with an attention mechanism is proposed. We extracted the multilayer features of the image and fused them based on the attention mechanism; the fused features are then mapped into score, and the image quality assessment without reference is realized. First, because the human visual perception system hierarchically approaches the input information from local to global, we used three different neural networks to extract physically meaningful image features, and we use modified VGG19 and modified VGG16 to extract the substrate texture information and the local information of the edges, respectively. Meanwhile, we use the resNet50 to extract high-level global semantic information. Second, to take full advantage of multilevel features and avoid monotonic addition in hierarchical feature fusion, we adopt an attention-based feature fusion mechanism that combines the global and local contexts of the features and assigns different weights to the features to be fused, so that the model can perceive richer types of distortion. Experimental findings on six standard databases show that our approach yields improved performance.

Research Area(s)

  • attentional feature fusion, blind image quality assessment, Data mining, Distortion, end-to-end, Feature extraction, Hierarchical feature extraction, Image quality, Neural networks, Quality assessment, Semantics

Citation Format(s)

Attentional Feature Fusion for End-to-End Blind Image Quality Assessment. / Zhou, Mingliang; Lang, Shujun; Zhang, Taiping et al.
In: IEEE Transactions on Broadcasting, Vol. 69, No. 1, 03.2023, p. 144-152.

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review