Skip to main navigation Skip to search Skip to main content

SageIQ: Scene-Graph-Guided Blind Image Quality Assessment

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

Conventional Blind Image Quality Assessment (BIQA) methods typically assess the entire image quality, which is suboptimal for tasks like autonomous driving that concern specific Task-Aligned Region (TAR). Moreover, we observe that advanced Multimodal Large Language Model (MLLM)-based BIQA models exhibit bias when evaluating small regions, leading to inaccurate perceptual judgments. To address these issues, we propose SageIQ (Scene-graph-guided Evaluation for Image Quality), a pipeline SageIQ-P for TAR localization, an approach consisting of an MLLM-based BIQA model SageIQ-M, and a dataset SageIQ-D. SageIQ-P is designed to automatically identify and evaluate TARs, with the advantages of being training-free and allowing plug-in integration of off-the-shelf BIQA models without retraining. It operates in three stages: scenegraphbased triplet construction, LLMdriven triplet analysis, and integration of weighted BIQA scores into a final assessment. Since SageIQ-P can produce small-sized TAR crops that may encounter small-region scoring bias in existing BIQA models, we propose SageIQ-M to alleviate this bias by injecting scale information through scale-aware images and size-prompted cues, achieving size awareness across both visual and textual modalities. In addition, we develop a fully automated approach to construct a region-level test set SageIQ-D, significantly reducing the human effort needed. Experimental results demonstrate that our methods achieve superior BIQA performance. © 2017 IEEE.
Original languageEnglish
JournalIEEE Transactions on Emerging Topics in Computational Intelligence
Online published15 May 2026
DOIs
Publication statusOnline published - 15 May 2026

Funding

This work was supported in part by Hong Kong Research Grants Council (RGC) under Grant 11205424 and in part by Hong Kong Innovation and Technology Commission (ITC) under Grant MHP/061/23.

Research Keywords

  • Image quality assessment
  • large language model
  • multimodal

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'SageIQ: Scene-Graph-Guided Blind Image Quality Assessment'. Together they form a unique fingerprint.

Cite this