Skip to main navigation Skip to search Skip to main content

Token-Wise Attention-Guided Semantic Quality Assessment for Compressed Visual Features

  • Shien Ke
  • , Changsheng Gao*
  • , Hadi Amirpour
  • , Zhihua Wang
  • , Xiaoyan Sun
  • *Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

Abstract

In collaborative and distributed intelligent systems, compressed intermediate features are routinely transmitted and reused, making semantic quality assessment (SQA) crucial for reliable deployment. Recent compressed feature quality assessment (CFQA) benchmarks, however, show that conventional similarity measures often correlate poorly with downstream semantic utility and lack robustness across diverse feature codecs. In this paper, we propose a token-wise, attention-guided method for assessing the semantic quality of compressed features. First, motivated by the observation that many downstream heads normalize and process tokens largely independently, we assess quality at the token level. This token-wise formulation exploits the intrinsic correspondence between the original and reconstructed tokens while reducing cross-token interference. Second, since tokens contribute unequally to downstream task performance, we adopt an attention-guided aggregation scheme: we derive task-adaptive importance weights from DINOv2 self-attention and use them to pool token-wise quality predictions into a global semantic quality score. Third, to accommodate heterogeneous supervision across tasks, we cast CFQA as a regression problem and rescale classification-based rank targets to mitigate label imbalance. Experiments on the CFQA benchmark demonstrate that our method consistently improves PLCC and SROCC across three tasks and four codecs, yielding a practical, codec-agnostic quality interface for next-generation intelligent systems. © 2026 IEEE.
Original languageEnglish
Title of host publication2026 18th International Conference on Quality of Multimedia Experience (QoMEX)
PublisherIEEE
Number of pages7
ISBN (Electronic)9798319500328
ISBN (Print)9798319500335
DOIs
Publication statusPublished - 2026
Event18th International Conference on Quality of Multimedia Experience (QoMEX 2026): Quality of Multimedia Experience Meets Machine Intelligence - Cardiff, United Kingdom
Duration: 29 Jun 2026 → 3 Jul 2026
https://qomex2026.itec.aau.at/

Publication series

NameInternational Conference on Quality of Multimedia Experience, QoMEX
ISSN (Print)2372-7179
ISSN (Electronic)2472-7814

Conference

Conference18th International Conference on Quality of Multimedia Experience (QoMEX 2026)
Abbreviated titleQoMEX’26
PlaceUnited Kingdom
CityCardiff
Period29/06/26 → 3/07/26
Internet address

Funding

This work was in part supported by the National Natural Science Foundation of China under grants 62472399 and Open Fund of APKL of BIIP, IAI, Hefei Comprehensive National Science Center under grants 24YGXT003.

Research Keywords

  • Compressed feature quality assessment (CFQA)
  • semantic quality assessment (SQA)

Fingerprint

Dive into the research topics of 'Token-Wise Attention-Guided Semantic Quality Assessment for Compressed Visual Features'. Together they form a unique fingerprint.

Cite this