Skip to main navigation Skip to search Skip to main content

No-reference Image Quality Assessment via Non-local Dependency Modeling

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

In this paper, we propose a no-reference image quality assessment method based on non-local features learned by a graph neural network (GNN). The proposed quality assessment framework is rooted in the view that the human visual system perceives image quality with long-dependency constructed among different regions, inspiring us to explore the non-local interactions in quality prediction. Instead of relying on convolutional neural network (CNN) based quality assessment methods that primarily focus on local field features, the GNN aiming for non-local quality perception facilitates modeling such long-dependency. In particular, we first adopt superpixel segmentation for the graph nodes construction. Subsequently, a spatial attention module is proposed to integrate the long- and short-range dependencies among the nodes of the whole image. The learned non-local features are finally combined with the local features extracted by the pre-trained CNN, achieving superior performance to the features utilized individually. Experimental results on intra-dataset and cross-dataset settings verify our proposed method's effectiveness and advanced generalization capability. Source codes are publicly accessible at https://github.com/SuperBruceJia/NLNet-IQA for scientific reproducible research.
Original languageEnglish
Title of host publication2022 IEEE 24th International Workshop on Multimedia Signal Processing (MMSP)
PublisherIEEE
Number of pages6
ISBN (Electronic)978-1-6654-7189-3
ISBN (Print)978-1-6654-7190-9
DOIs
Publication statusPublished - 2022
EventIEEE 24th International Workshop on Multimedia Signal Processing (MMSP 2022): MMSP'22 - Shanghai, China
Duration: 26 Sept 202228 Sept 2022
https://attend.ieee.org/mmsp-2022/
https://ieeexplore.ieee.org/xpl/conhome/9948698/proceeding

Publication series

Name
ISSN (Print)2163-3517
ISSN (Electronic)2473-3628

Conference

ConferenceIEEE 24th International Workshop on Multimedia Signal Processing (MMSP 2022)
PlaceChina
CityShanghai
Period26/09/2228/09/22
Internet address

Research Keywords

  • No-reference image quality assessment
  • human visual system
  • non-local modeling
  • superpixel
  • graph neural network

Fingerprint

Dive into the research topics of 'No-reference Image Quality Assessment via Non-local Dependency Modeling'. Together they form a unique fingerprint.

Cite this