TY - JOUR
T1 - An End-to-End Blind Image Quality Assessment Method Using a Recurrent Network and Self-Attention
AU - Zhou, Mingliang
AU - Lan, Xuting
AU - Wei, Xuekai
AU - Liao, Xingran
AU - Mao, Qin
AU - Li, Yutong
AU - Wu, Chao
AU - Xiang, Tao
AU - Fang, Bin
PY - 2023/6
Y1 - 2023/6
N2 - In this paper, we propose a blind image quality assessment (BIQA) method using self-attention and a recurrent neural network (RNN); this approach can effectively capture both local and global information from an input image. The implementation of our constructed deep no-reference (NR) assessment framework does not rely on any convolutional operations. First, the capture step for obtaining locally significant information is performed by a self-attention operation inside a divided window. Second, we design a serialized feature input memory subnetwork to fuse the global features of the image. Finally, all the integrated features are uniformly mapped to the target score. The experimental results obtained on publicly available benchmark IQA databases show that our approach outperforms other state-of-the-art algorithms.
AB - In this paper, we propose a blind image quality assessment (BIQA) method using self-attention and a recurrent neural network (RNN); this approach can effectively capture both local and global information from an input image. The implementation of our constructed deep no-reference (NR) assessment framework does not rely on any convolutional operations. First, the capture step for obtaining locally significant information is performed by a self-attention operation inside a divided window. Second, we design a serialized feature input memory subnetwork to fuse the global features of the image. Finally, all the integrated features are uniformly mapped to the target score. The experimental results obtained on publicly available benchmark IQA databases show that our approach outperforms other state-of-the-art algorithms.
KW - Blind image quality assessment
KW - Deep learning
KW - Distortion
KW - Feature extraction
KW - Image quality
KW - recurrent neural network
KW - self-attention
KW - Task analysis
KW - Transformers
KW - Visualization
UR - http://www.scopus.com/inward/record.url?scp=85141447496&partnerID=8YFLogxK
UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85141447496&origin=recordpage
U2 - 10.1109/TBC.2022.3215249
DO - 10.1109/TBC.2022.3215249
M3 - RGC 21 - Publication in refereed journal
SN - 0018-9316
VL - 69
SP - 369
EP - 377
JO - IEEE Transactions on Broadcasting
JF - IEEE Transactions on Broadcasting
IS - 2
ER -