Towards Extensible Detection of AI-generated Images via Content-Agnostic Adapter-based Category-Aware Incremental Learning

Shuai Tang, Peisong He*, Haoliang Li, Wei Wang, Xinghao Jiang, Yao Zhao

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

The rapid evolution of image generation techniques has benefited several fields, but it has also given rise to security concerns. As countermeasures, a series of AI-generated image detection methods have been developed successfully. However, existing methods exhibit an inefficiency in handling the continual emergence of new generative models. To address this issue, we formulate the detection of AI-generated images in an extensible manner using an adapter-based domain incremental learning framework. Specifically, we first investigate the global consistency property of generation artifacts and design a content-agnostic adapter equipped on a vision transformer to extract common forensic features, where a token-level shuffling strategy is constructed for the dual-stream comparison to mitigate the fitting to specific image content. Then, motivated by the compactness of real images and the diversity of fake images due to their inherent generation processes, an asymmetric category-aware domain alignment method is designed to reduce the domain shift arisen from different generators. Finally, a multi-view knowledge distillation module, considering both point-to-point and structure-to-structure forensic knowledge, is devised to alleviate catastrophic forgetting. Experiments are conducted on several protocols using various image generators, and experimental results verify the superiority of our method compared to state-of-the-art methods for extensible detection. © 2025 IEEE.
Original languageEnglish
Pages (from-to)2883-2898
JournalIEEE Transactions on Information Forensics and Security
Volume20
Online published28 Feb 2025
DOIs
Publication statusPublished - 2025

Research Keywords

  • AI-generated image detection
  • domain alignment
  • Image forensics
  • incremental learning

Fingerprint

Dive into the research topics of 'Towards Extensible Detection of AI-generated Images via Content-Agnostic Adapter-based Category-Aware Incremental Learning'. Together they form a unique fingerprint.

Cite this