Projects per year
Abstract
This letter aims to develop advanced full-reference image quality assessment (FR-IQA) models to evaluate content-misaligned image pairs, which are commonly encountered in image reconstruction tasks and texture synthesis tasks. Traditional FR-IQA models tend to be overly sensitive to content shifting and misalignment, thus deviating from subjective evaluations. Herein, we propose a deep order statistical similarity (DOSS) FR-IQA model that compares the order statistics of deep features to address this issue. In DOSS, the reference and distorted images are projected into the deep feature space, and the sorted deep network features are compared with the cosine similarity index to output the final perceptual quality scores. With such a simple design baseline, DOSS offers several advantages. First, it mimics the behavior of the human visual system (HVS) in terms of evaluating content-misaligned image pairs, thereby tolerating slight image shifts and deformations. Second, DOSS possesses an advanced texture perception capability, producing superior quality assessment results on images generated by various texture synthesis algorithms; this indicates that DOSS can be used to select visually appealing texture synthesis results. Finally, experimental results demonstrate that DOSS can also obtain competitive quality assessment results on standard IQA datasets, suggesting that deep feature order statistics can serve as generic features for both content-aligned and content-misaligned IQA. The code for this method is publicly available at https://github.com/Buka-Xing/DOSS. © 2023 IEEE.
Original language | English |
---|---|
Pages (from-to) | 305-315 |
Number of pages | 11 |
Journal | IEEE Transactions on Broadcasting |
Volume | 70 |
Issue number | 1 |
Online published | 28 Jul 2023 |
DOIs | |
Publication status | Published - Mar 2024 |
Research Keywords
- content misalignment
- cosine similarity
- deep neural network
- Feature extraction
- full-reference image quality assessment
- Image coding
- Image quality
- Image quality assessment
- Indexes
- order statistics
- Quality assessment
- Standards
- Task analysis
Fingerprint
Dive into the research topics of 'Full-Reference Image Quality Assessment: Addressing Content Misalignment Issue by Comparing Order Statistics of Deep Features'. Together they form a unique fingerprint.Projects
- 2 Finished
-
GRF: Intelligent Ultra High Definition Video Encoder Optimization for Future Versatile Video Coding
KWONG, T. W. S. (Principal Investigator / Project Coordinator), KUO, J. (Co-Investigator), WANG, S. (Co-Investigator) & ZHOU, M. (Co-Investigator)
1/01/20 → 5/09/23
Project: Research
-
GRF: The Impact of Social Media Use on Mass Polarization in Hong Kong: Putting Multiple Identities into Perspective
KOBAYASHI, T. (Principal Investigator / Project Coordinator) & WONG, S. H. W. (Co-Investigator)
1/01/18 → 18/11/20
Project: Research