Skip to main navigation Skip to search Skip to main content

Toward Generalized Image Quality Assessment: Relaxing the Perfect Reference Quality Assumption

Du Chen (Co-first Author), Tianhe Wu (Co-first Author), Kede Ma*, Lei Zhang*

*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

Full-Reference image quality assessment (FR-IQA) generally assumes that reference images are of perfect quality. However, this assumption is flawed due to the sensor and optical limitations of modern imaging systems. Moreover, recent generative enhancement methods are capable of producing images of higher quality than their original. All of these challenge the effectiveness and applicability of current FR-IQA models. To relax the assumption of perfect reference image quality, we build a large-scale IQA database, namely DiffIQA, containing approximately 180,000 images generated by a diffusion-based image enhancer with adjustable hyper-parameters. Each image is annotated by human subjects as either worse, similar, or better quality compared to its reference. Building on this, we present a generalized FR-IQA model, namely Adaptive Fidelity-Naturalness Evaluator (A-FINE), to accurately assess and adaptively combine the fidelity and naturalness of a test image. A-FINE aligns well with standard FR-IQA when the reference image is much more natural than the test image. We demonstrate by extensive experiments that A-FINE surpasses standard FR-IQA models on well-established IQA datasets and our newly created DiffIQA. To further validate A-FINE, we additionally construct a super-resolution IQA benchmark (SRIQA-Bench), encompassing test images derived from ten state-of-the-art SR methods with reliable human quality annotations. Tests on SRIQA-Bench re-affirm the advantages of A-FINE. The code and dataset are available at https://tianhewu.github.io/A-FINEpage.github.io/. © 2025 IEEE.
Original languageEnglish
Title of host publication2025 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2025 - Proceedings
Place of PublicationLos Alamitos, Calif.
PublisherIEEE
Pages12742-12752
Number of pages11
ISBN (Electronic)979-8-3315-4364-8
ISBN (Print)979-8-3315-4365-5
DOIs
Publication statusPublished - 2025
Event2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2025) - Music City Center, Nashville, United States
Duration: 11 Jun 202515 Jun 2025
https://cvpr.thecvf.com/Conferences/2025
https://cvpr.thecvf.com/

Publication series

Name
ISSN (Print)1063-6919
ISSN (Electronic)2575-7075

Conference

Conference2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2025)
Abbreviated titleCVPR2025
PlaceUnited States
CityNashville
Period11/06/2515/06/25
Internet address

Funding

This work was partly supported by the Hong Kong ITC Innovation and Technology Fund (9440379 and 9440390), and fully supported by the PolyU-OPPO Joint Innovative Research Center.

Fingerprint

Dive into the research topics of 'Toward Generalized Image Quality Assessment: Relaxing the Perfect Reference Quality Assumption'. Together they form a unique fingerprint.

Cite this