ColorAssist: Perception-Based Recoloring for Color Vision Deficiency Compensation

Liqun Lin, Shangxi Xie, Yanting Wang, Bolin Chen, Ying Xue*, Xiahai Zhuang, Tiesong Zhao*

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

Image enhancement methods have been widely studied to improve the visual quality of diverse images, implicitly assuming that all human observers have normal vision. However, a large population around the world suffers from Color Vision Deficiency (CVD). Enhancing images to compensate for their perceptions remains a challenging issue. Existing CVD compensation methods have two drawbacks: first, the available datasets and validations have not been rigorously tested by CVD individuals; second, these methods struggle to strike an optimal balance between contrast enhancement and naturalness preservation, which often results in suboptimal outcomes for individuals with CVD. To address these issues, we develop the first large-scale, CVD-individual-labeled dataset called FZU-CVDSet and a CVD-friendly recoloring algorithm called ColorAssist. In particular, we design a perception-guided feature extraction module and a perception-guided diffusion transformer module that jointly achieve efficient image recoloring for individuals with CVD. Comprehensive experiments on both FZU-CVDSet and subjective tests in hospitals demonstrate that the proposed ColorAssist closely aligns with the visual perceptions of individuals with CVD, achieving superior performance compared with the state-of-the-arts. The source code is available at https://github.com/xsx-fzu/ColorAssist. © 2025 IEEE.
Original languageEnglish
Pages (from-to)5658-5671
JournalIEEE Transactions on Image Processing
Volume34
Online published1 Sept 2025
DOIs
Publication statusPublished - 2025

Funding

This work was supported in part by the National Natural Science Foundation of China under Grant 62171134; and in part by the Natural Science Foundation and Technology Innovation Joint Fund Project of Fujian Province, China, under Grant 2023J01395 and Grant 2023Y9346.

Research Keywords

  • Image enhancement
  • recoloring
  • color vision deficiency (CVD)
  • visual perception

Fingerprint

Dive into the research topics of 'ColorAssist: Perception-Based Recoloring for Color Vision Deficiency Compensation'. Together they form a unique fingerprint.

Cite this