A Novel Patch Variance Biased Convolutional Neural Network for No-Reference Image Quality Assessment
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Pages (from-to) | 1223-1229 |
Journal / Publication | IEEE Transactions on Circuits and Systems for Video Technology |
Volume | 29 |
Issue number | 4 |
Online published | 7 Jan 2019 |
Publication status | Published - Apr 2019 |
Link(s)
Abstract
Deep Convolutional Neural Networks (CNNs) have been successfully applied on no-reference image quality assessment (NR-IQA) with respect to human perception. Most of these methods deal with small image patches and use the average score of the test patches for predicting the whole image quality. We discovered that image patches from homogenous regions are unreliable for both neural network training and final image quality score estimation. In addition, image patches with complex structures have much higher chances to achieve better image quality prediction. Based on these findings, we enhanced the conventional CNN-based NR-IQA algorithm to avoid homogenous patches for the network training and quality score estimation. Moreover, we also use a variance-based weighting average to bias the final image quality score to the patches with complex structure. Experimental results show that this simple approach can achieve state-of-the-art performance as compared with well-known NR-IQA algorithms.
Research Area(s)
- Convolution, convolution neural network, Convolutional neural networks, deep learning, Estimation, Image color analysis, Image quality, no-reference image quality assessment, Training
Citation Format(s)
A Novel Patch Variance Biased Convolutional Neural Network for No-Reference Image Quality Assessment. / Po, Lai-Man; Liu, Mengyang; Yuen, Wilson Y. F. et al.
In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 29, No. 4, 04.2019, p. 1223-1229.
In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 29, No. 4, 04.2019, p. 1223-1229.
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review