No-reference Image Quality Assessment via Non-local Dependency Modeling
Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Title of host publication | 2022 IEEE 24th International Workshop on Multimedia Signal Processing (MMSP) |
Publisher | Institute of Electrical and Electronics Engineers, Inc. |
Number of pages | 6 |
ISBN (electronic) | 978-1-6654-7189-3 |
ISBN (print) | 978-1-6654-7190-9 |
Publication status | Published - 2022 |
Publication series
Name | |
---|---|
ISSN (Print) | 2163-3517 |
ISSN (electronic) | 2473-3628 |
Conference
Title | IEEE 24th International Workshop on Multimedia Signal Processing (MMSP 2022) |
---|---|
Place | China |
City | Shanghai |
Period | 26 - 28 September 2022 |
Link(s)
Abstract
In this paper, we propose a no-reference image quality assessment method based on non-local features learned by a graph neural network (GNN). The proposed quality assessment framework is rooted in the view that the human visual system perceives image quality with long-dependency constructed among different regions, inspiring us to explore the non-local interactions in quality prediction. Instead of relying on convolutional neural network (CNN) based quality assessment methods that primarily focus on local field features, the GNN aiming for non-local quality perception facilitates modeling such long-dependency. In particular, we first adopt superpixel segmentation for the graph nodes construction. Subsequently, a spatial attention module is proposed to integrate the long- and short-range dependencies among the nodes of the whole image. The learned non-local features are finally combined with the local features extracted by the pre-trained CNN, achieving superior performance to the features utilized individually. Experimental results on intra-dataset and cross-dataset settings verify our proposed method's effectiveness and advanced generalization capability. Source codes are publicly accessible at https://github.com/SuperBruceJia/NLNet-IQA for scientific reproducible research.
Research Area(s)
- No-reference image quality assessment, human visual system, non-local modeling, superpixel, graph neural network
Citation Format(s)
No-reference Image Quality Assessment via Non-local Dependency Modeling. / Jia, Shuyue; Chen, Baoliang; Li, Dingquan et al.
2022 IEEE 24th International Workshop on Multimedia Signal Processing (MMSP). Institute of Electrical and Electronics Engineers, Inc., 2022.
2022 IEEE 24th International Workshop on Multimedia Signal Processing (MMSP). Institute of Electrical and Electronics Engineers, Inc., 2022.
Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review