TY - JOUR
T1 - Detection of GAN-Generated Images by Estimating Artifact Similarity
AU - Li, Weichuang
AU - He, Peisong
AU - Li, Haoliang
AU - Wang, Hongxia
AU - Zhang, Ruimei
PY - 2022
Y1 - 2022
N2 - Recently, researchers have been dedicated to discovering Generative Adversarial Network (GAN) artifacts and using them to identify generated images. However, current approaches exhibit restricted performance when testing against unseen GAN models, which is also known as the cross-domain scenario. To overcome this limitation, we propose a novel GAN-generated image detection framework by estimating artifact similarity, which is inspired by relation network. The proposed method consists of two stages, including representation learning and representation comparison. For representation learning, ResNet-50 equipped with Instance Normalization in the Shallow layers (ResNet-INS) is constructed as the embedding network to extract generalized features. For representation comparison, Category and Domain-Aware loss function (CDA loss) is designed by leveraging both category and domain information efficiently, which can enlarge inter-class discrepancy of different categories (GAN-generated or pristine images) and improve intra-class compactness from different domains (source attributions) in the same category. Extensive experiments are conducted which consider various cross-domain scenarios to verify the generalization of the proposed method. Besides, our method exhibits satisfying robustness against common post-processings, even when data augmentation is not considered during the training stage.
AB - Recently, researchers have been dedicated to discovering Generative Adversarial Network (GAN) artifacts and using them to identify generated images. However, current approaches exhibit restricted performance when testing against unseen GAN models, which is also known as the cross-domain scenario. To overcome this limitation, we propose a novel GAN-generated image detection framework by estimating artifact similarity, which is inspired by relation network. The proposed method consists of two stages, including representation learning and representation comparison. For representation learning, ResNet-50 equipped with Instance Normalization in the Shallow layers (ResNet-INS) is constructed as the embedding network to extract generalized features. For representation comparison, Category and Domain-Aware loss function (CDA loss) is designed by leveraging both category and domain information efficiently, which can enlarge inter-class discrepancy of different categories (GAN-generated or pristine images) and improve intra-class compactness from different domains (source attributions) in the same category. Extensive experiments are conducted which consider various cross-domain scenarios to verify the generalization of the proposed method. Besides, our method exhibits satisfying robustness against common post-processings, even when data augmentation is not considered during the training stage.
KW - Prototypes
KW - Generative adversarial networks
KW - Training
KW - Feature extraction
KW - Testing
KW - Optimization
KW - Task analysis
KW - Image forensics
KW - GAN-generated image detection
KW - relation network
KW - artifact similarity estimation
UR - http://www.scopus.com/inward/record.url?scp=85129962232&partnerID=8YFLogxK
UR - http://gateway.isiknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcAuth=LinksAMR&SrcApp=PARTNER_APP&DestLinkType=FullRecord&DestApp=WOS&KeyUT=000779602000001
UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85129962232&origin=recordpage
U2 - 10.1109/LSP.2021.3130525
DO - 10.1109/LSP.2021.3130525
M3 - RGC 21 - Publication in refereed journal
SN - 1070-9908
VL - 29
SP - 862
EP - 866
JO - IEEE Signal Processing Letters
JF - IEEE Signal Processing Letters
ER -