Detection of GAN-Generated Images by Estimating Artifact Similarity

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

10 Scopus Citations
View graph of relations

Author(s)

  • Weichuang Li
  • Peisong He
  • Haoliang Li
  • Hongxia Wang
  • Ruimei Zhang

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)862-866
Journal / PublicationIEEE Signal Processing Letters
Volume29
Online published24 Nov 2021
Publication statusPublished - 2022

Abstract

Recently, researchers have been dedicated to discovering Generative Adversarial Network (GAN) artifacts and using them to identify generated images. However, current approaches exhibit restricted performance when testing against unseen GAN models, which is also known as the cross-domain scenario. To overcome this limitation, we propose a novel GAN-generated image detection framework by estimating artifact similarity, which is inspired by relation network. The proposed method consists of two stages, including representation learning and representation comparison. For representation learning, ResNet-50 equipped with Instance Normalization in the Shallow layers (ResNet-INS) is constructed as the embedding network to extract generalized features. For representation comparison, Category and Domain-Aware loss function (CDA loss) is designed by leveraging both category and domain information efficiently, which can enlarge inter-class discrepancy of different categories (GAN-generated or pristine images) and improve intra-class compactness from different domains (source attributions) in the same category. Extensive experiments are conducted which consider various cross-domain scenarios to verify the generalization of the proposed method. Besides, our method exhibits satisfying robustness against common post-processings, even when data augmentation is not considered during the training stage.

Research Area(s)

  • Prototypes, Generative adversarial networks, Training, Feature extraction, Testing, Optimization, Task analysis, Image forensics, GAN-generated image detection, relation network, artifact similarity estimation

Citation Format(s)

Detection of GAN-Generated Images by Estimating Artifact Similarity. / Li, Weichuang; He, Peisong; Li, Haoliang et al.
In: IEEE Signal Processing Letters, Vol. 29, 2022, p. 862-866.

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review