A Novel Rank Learning Based No-Reference Image Quality Assessment Method

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

View graph of relations

Author(s)

  • Fu-Zhao Ou
  • Yuan-Gen Wang
  • Jin Li
  • Guopu Zhu
  • Sam Kwong

Related Research Unit(s)

Detail(s)

Original languageEnglish
Number of pages15
Journal / PublicationIEEE Transactions on Multimedia
Online published27 Sep 2021
Publication statusOnline published - 27 Sep 2021

Abstract

Recently, applying deep learning to no-reference image quality assessment (NR-IQA) has received significant attention. Especially in the last five years, an increasing interest has been drawn to the studies of rank learning since it can help mitigate the problem of small IQA datasets. However, on one hand, existing rank learning is not suitable for the authentically distorted images due to the lack of generated rank samples. On the other hand, the output of existing rank loss functions is uncontrollable, resulting in reduced performance. Motivated by these two limitations, we propose a novel rank learning based NR-IQA method, termed controllable list-wise ranking IQA (CLRIQA) in this paper. To be specific, we first present an imaging-heuristic approach, in which the over- and under-exposure is formulated as an inverse of the Weber-Fechner law, and fusion strategy and compression are adopted, to simulate the authentic distortion and generate the rank image samples. These samples are label-free yet associated with quality ranking information. Then we design a controllable list-wise ranking (CLR) loss function by setting an upper and lower bound of rank range and introducing an adaptive margin to tune rank interval. Finally, both the generated rank samples and proposed CLR are used to pre-train a convolutional neural network. Moreover, to obtain a more accurate prediction model, we take advantage of the IQA datasets to fine-tune the pre-trained network further. Various experiments are conducted on the IQA benchmark datasets, and experimental results demonstrate the effectiveness of the proposed CLRIQA method. The source code and network model can be downloaded at the following web address: https://github.com/GZHU-Image-Lab/CLRIQA.

Research Area(s)

  • authentic distortion, con-volutional neural network, Convolutional neural networks, Distortion, Feature extraction, Image quality, No-reference image quality assessment, Predictive models, rank learning, synthetic distortion, Training, Transform coding