Deep Feature Statistics Mapping for Generalized Screen Content Image Quality Assessment

Baoliang Chen, Hanwei Zhu, Lingyu Zhu, Shiqi Wang*, Sam Kwong

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

5 Citations (Scopus)

Abstract

The statistical regularities of natural images, referred to as natural scene statistics, play an important role in no-reference image quality assessment. However, it has been widely acknowledged that screen content images (SCIs), which are typically computer generated, do not hold such statistics. Here we make the first attempt to learn the statistics of SCIs, based upon which the quality of SCIs can be effectively determined. The underlying mechanism of the proposed approach is based upon the mild assumption that the SCIs, which are not physically acquired, still obey certain statistics that could be understood in a learning fashion. We empirically show that the statistics deviation could be effectively leveraged in quality assessment, and the proposed method is superior when evaluated in different settings. Extensive experimental results demonstrate the Deep Feature Statistics based SCI Quality Assessment (DFSS-IQA) model delivers promising performance compared with existing NR-IQA models and shows a high generalization capability in the cross-dataset settings. The implementation of our method is publicly available at https://github.com/Baoliang93/DFSS-IQA. © 2024 IEEE.
Original languageEnglish
Pages (from-to)3227-3241
JournalIEEE Transactions on Image Processing
Volume33
Online published1 May 2024
DOIs
Publication statusPublished - 2024

Bibliographical note

Research Unit(s) information for this publication is provided by the author(s) concerned.

Funding

This work was supported in part by Shenzhen Science and Technology Program under Project JCYJ20220530140816037, in part by Hong Kong Innovation and Technology Commission [InnoHK Project Centre for Intelligent Multidimensional Data Analysis (CIMDA)], in part by Hong Kong Research Grants Council (RGC) of the General Research Fund (GRF) under Grant 11203220 (CityU 9042957), and in part by the Innovation and Technology Fund (ITF) under Grant GHP/044/21SZ.

Research Keywords

  • distribution deviation
  • Image quality assessment
  • no-reference
  • scene statistics
  • screen content image

Fingerprint

Dive into the research topics of 'Deep Feature Statistics Mapping for Generalized Screen Content Image Quality Assessment'. Together they form a unique fingerprint.

Cite this