TY - JOUR
T1 - DACNN
T2 - Blind Image Quality Assessment via A Distortion-Aware Convolutional Neural Network
AU - Pan, Zhaoqing
AU - Zhang, Hao
AU - Lei, Jianjun
AU - Fang, Yuming
AU - Shao, Xiao
AU - Ling, Nam
AU - Kwong, Sam
PY - 2022/11
Y1 - 2022/11
N2 - Deep neural networks have achieved great performance on blind Image Quality Assessment (IQA), but it is still challenging for using one network to accurately predict the quality of images with different distortions. In this paper, a Distortion-Aware Convolutional Neural Network (DACNN) is proposed for blind IQA, which works effectively for not only synthetically distorted images but also authentically distorted images. The proposed DACNN consists of a distortion aware module, a distortion fusion module, and a quality prediction module. In the distortion aware module, a Siamese network-based pretraining strategy is proposed to design a synthetic distortion-aware network for full learning the synthetic distortions, and an authentic distortion-aware network is used for extracting the authentic distortions. To efficiently fuse the learned distortion features, and make the network pay more attention to the essential features, a weight-adaptive fusion network is proposed to adaptively adjust the weight of each distortion. Finally, the quality prediction module is adopted to map the fused features to a quality score. Extensive experiments on four authentic IQA databases and four synthetic IQA databases have proved the effectiveness of the proposed DACNN.
AB - Deep neural networks have achieved great performance on blind Image Quality Assessment (IQA), but it is still challenging for using one network to accurately predict the quality of images with different distortions. In this paper, a Distortion-Aware Convolutional Neural Network (DACNN) is proposed for blind IQA, which works effectively for not only synthetically distorted images but also authentically distorted images. The proposed DACNN consists of a distortion aware module, a distortion fusion module, and a quality prediction module. In the distortion aware module, a Siamese network-based pretraining strategy is proposed to design a synthetic distortion-aware network for full learning the synthetic distortions, and an authentic distortion-aware network is used for extracting the authentic distortions. To efficiently fuse the learned distortion features, and make the network pay more attention to the essential features, a weight-adaptive fusion network is proposed to adaptively adjust the weight of each distortion. Finally, the quality prediction module is adopted to map the fused features to a quality score. Extensive experiments on four authentic IQA databases and four synthetic IQA databases have proved the effectiveness of the proposed DACNN.
KW - Blind image quality assessment
KW - Databases
KW - Distortion
KW - distortion-aware network
KW - Feature extraction
KW - Fuses
KW - fusion network
KW - Image quality
KW - Knowledge engineering
KW - Semantics
KW - Siamese network
UR - http://www.scopus.com/inward/record.url?scp=85134239074&partnerID=8YFLogxK
UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85134239074&origin=recordpage
U2 - 10.1109/TCSVT.2022.3188991
DO - 10.1109/TCSVT.2022.3188991
M3 - RGC 21 - Publication in refereed journal
SN - 1051-8215
VL - 32
SP - 7518
EP - 7531
JO - IEEE Transactions on Circuits and Systems for Video Technology
JF - IEEE Transactions on Circuits and Systems for Video Technology
IS - 11
ER -