An End-to-End Blind Image Quality Assessment Method Using a Recurrent Network and Self-Attention

Mingliang Zhou, Xuting Lan, Xuekai Wei*, Xingran Liao, Qin Mao*, Yutong Li, Chao Wu, Tao Xiang, Bin Fang

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

48 Citations (Scopus)

Abstract

In this paper, we propose a blind image quality assessment (BIQA) method using self-attention and a recurrent neural network (RNN); this approach can effectively capture both local and global information from an input image. The implementation of our constructed deep no-reference (NR) assessment framework does not rely on any convolutional operations. First, the capture step for obtaining locally significant information is performed by a self-attention operation inside a divided window. Second, we design a serialized feature input memory subnetwork to fuse the global features of the image. Finally, all the integrated features are uniformly mapped to the target score. The experimental results obtained on publicly available benchmark IQA databases show that our approach outperforms other state-of-the-art algorithms.
Original languageEnglish
Pages (from-to)369-377
Number of pages9
JournalIEEE Transactions on Broadcasting
Volume69
Issue number2
Online published28 Oct 2022
DOIs
Publication statusPublished - Jun 2023

Research Keywords

  • Blind image quality assessment
  • Deep learning
  • Distortion
  • Feature extraction
  • Image quality
  • recurrent neural network
  • self-attention
  • Task analysis
  • Transformers
  • Visualization

Fingerprint

Dive into the research topics of 'An End-to-End Blind Image Quality Assessment Method Using a Recurrent Network and Self-Attention'. Together they form a unique fingerprint.

Cite this