Detection of GAN-Generated Images by Estimating Artifact Similarity

Weichuang Li, Peisong He*, Haoliang Li, Hongxia Wang, Ruimei Zhang

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

12 Citations (Scopus)

Abstract

Recently, researchers have been dedicated to discovering Generative Adversarial Network (GAN) artifacts and using them to identify generated images. However, current approaches exhibit restricted performance when testing against unseen GAN models, which is also known as the cross-domain scenario. To overcome this limitation, we propose a novel GAN-generated image detection framework by estimating artifact similarity, which is inspired by relation network. The proposed method consists of two stages, including representation learning and representation comparison. For representation learning, ResNet-50 equipped with Instance Normalization in the Shallow layers (ResNet-INS) is constructed as the embedding network to extract generalized features. For representation comparison, Category and Domain-Aware loss function (CDA loss) is designed by leveraging both category and domain information efficiently, which can enlarge inter-class discrepancy of different categories (GAN-generated or pristine images) and improve intra-class compactness from different domains (source attributions) in the same category. Extensive experiments are conducted which consider various cross-domain scenarios to verify the generalization of the proposed method. Besides, our method exhibits satisfying robustness against common post-processings, even when data augmentation is not considered during the training stage.
Original languageEnglish
Pages (from-to)862-866
JournalIEEE Signal Processing Letters
Volume29
Online published24 Nov 2021
DOIs
Publication statusPublished - 2022

Research Keywords

  • Prototypes
  • Generative adversarial networks
  • Training
  • Feature extraction
  • Testing
  • Optimization
  • Task analysis
  • Image forensics
  • GAN-generated image detection
  • relation network
  • artifact similarity estimation

Fingerprint

Dive into the research topics of 'Detection of GAN-Generated Images by Estimating Artifact Similarity'. Together they form a unique fingerprint.

Cite this