No-reference Image Quality Assessment via Non-local Dependency Modeling

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

7 Scopus Citations
View graph of relations

Author(s)

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publication2022 IEEE 24th International Workshop on Multimedia Signal Processing (MMSP)
PublisherInstitute of Electrical and Electronics Engineers, Inc.
Number of pages6
ISBN (electronic)978-1-6654-7189-3
ISBN (print)978-1-6654-7190-9
Publication statusPublished - 2022

Publication series

Name
ISSN (Print)2163-3517
ISSN (electronic)2473-3628

Conference

TitleIEEE 24th International Workshop on Multimedia Signal Processing (MMSP 2022)
PlaceChina
CityShanghai
Period26 - 28 September 2022

Abstract

In this paper, we propose a no-reference image quality assessment method based on non-local features learned by a graph neural network (GNN). The proposed quality assessment framework is rooted in the view that the human visual system perceives image quality with long-dependency constructed among different regions, inspiring us to explore the non-local interactions in quality prediction. Instead of relying on convolutional neural network (CNN) based quality assessment methods that primarily focus on local field features, the GNN aiming for non-local quality perception facilitates modeling such long-dependency. In particular, we first adopt superpixel segmentation for the graph nodes construction. Subsequently, a spatial attention module is proposed to integrate the long- and short-range dependencies among the nodes of the whole image. The learned non-local features are finally combined with the local features extracted by the pre-trained CNN, achieving superior performance to the features utilized individually. Experimental results on intra-dataset and cross-dataset settings verify our proposed method's effectiveness and advanced generalization capability. Source codes are publicly accessible at https://github.com/SuperBruceJia/NLNet-IQA for scientific reproducible research.

Research Area(s)

  • No-reference image quality assessment, human visual system, non-local modeling, superpixel, graph neural network

Citation Format(s)

No-reference Image Quality Assessment via Non-local Dependency Modeling. / Jia, Shuyue; Chen, Baoliang; Li, Dingquan et al.
2022 IEEE 24th International Workshop on Multimedia Signal Processing (MMSP). Institute of Electrical and Electronics Engineers, Inc., 2022.

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review