Abstract
In this paper, we propose a no-reference image quality assessment method based on non-local features learned by a graph neural network (GNN). The proposed quality assessment framework is rooted in the view that the human visual system perceives image quality with long-dependency constructed among different regions, inspiring us to explore the non-local interactions in quality prediction. Instead of relying on convolutional neural network (CNN) based quality assessment methods that primarily focus on local field features, the GNN aiming for non-local quality perception facilitates modeling such long-dependency. In particular, we first adopt superpixel segmentation for the graph nodes construction. Subsequently, a spatial attention module is proposed to integrate the long- and short-range dependencies among the nodes of the whole image. The learned non-local features are finally combined with the local features extracted by the pre-trained CNN, achieving superior performance to the features utilized individually. Experimental results on intra-dataset and cross-dataset settings verify our proposed method's effectiveness and advanced generalization capability. Source codes are publicly accessible at https://github.com/SuperBruceJia/NLNet-IQA for scientific reproducible research.
| Original language | English |
|---|---|
| Title of host publication | 2022 IEEE 24th International Workshop on Multimedia Signal Processing (MMSP) |
| Publisher | IEEE |
| Number of pages | 6 |
| ISBN (Electronic) | 978-1-6654-7189-3 |
| ISBN (Print) | 978-1-6654-7190-9 |
| DOIs | |
| Publication status | Published - 2022 |
| Event | IEEE 24th International Workshop on Multimedia Signal Processing (MMSP 2022): MMSP'22 - Shanghai, China Duration: 26 Sept 2022 → 28 Sept 2022 https://attend.ieee.org/mmsp-2022/ https://ieeexplore.ieee.org/xpl/conhome/9948698/proceeding |
Publication series
| Name | |
|---|---|
| ISSN (Print) | 2163-3517 |
| ISSN (Electronic) | 2473-3628 |
Conference
| Conference | IEEE 24th International Workshop on Multimedia Signal Processing (MMSP 2022) |
|---|---|
| Place | China |
| City | Shanghai |
| Period | 26/09/22 → 28/09/22 |
| Internet address |
Research Keywords
- No-reference image quality assessment
- human visual system
- non-local modeling
- superpixel
- graph neural network
Fingerprint
Dive into the research topics of 'No-reference Image Quality Assessment via Non-local Dependency Modeling'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver