Detection of GAN-Generated Images by Estimating Artifact Similarity
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Pages (from-to) | 862-866 |
Journal / Publication | IEEE Signal Processing Letters |
Volume | 29 |
Online published | 24 Nov 2021 |
Publication status | Published - 2022 |
Link(s)
Abstract
Recently, researchers have been dedicated to discovering Generative Adversarial Network (GAN) artifacts and using them to identify generated images. However, current approaches exhibit restricted performance when testing against unseen GAN models, which is also known as the cross-domain scenario. To overcome this limitation, we propose a novel GAN-generated image detection framework by estimating artifact similarity, which is inspired by relation network. The proposed method consists of two stages, including representation learning and representation comparison. For representation learning, ResNet-50 equipped with Instance Normalization in the Shallow layers (ResNet-INS) is constructed as the embedding network to extract generalized features. For representation comparison, Category and Domain-Aware loss function (CDA loss) is designed by leveraging both category and domain information efficiently, which can enlarge inter-class discrepancy of different categories (GAN-generated or pristine images) and improve intra-class compactness from different domains (source attributions) in the same category. Extensive experiments are conducted which consider various cross-domain scenarios to verify the generalization of the proposed method. Besides, our method exhibits satisfying robustness against common post-processings, even when data augmentation is not considered during the training stage.
Research Area(s)
- Prototypes, Generative adversarial networks, Training, Feature extraction, Testing, Optimization, Task analysis, Image forensics, GAN-generated image detection, relation network, artifact similarity estimation
Citation Format(s)
Detection of GAN-Generated Images by Estimating Artifact Similarity. / Li, Weichuang; He, Peisong; Li, Haoliang et al.
In: IEEE Signal Processing Letters, Vol. 29, 2022, p. 862-866.
In: IEEE Signal Processing Letters, Vol. 29, 2022, p. 862-866.
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review