MDTL-NET: Computer-generated image detection based on multi-scale deep texture learning

Qiang Xu, Shan Jia, Xinghao Jiang, Tanfeng Sun, Zhe Wang*, Hong Yan

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

3 Citations (Scopus)

Abstract

Distinguishing between computer-generated (CG) and natural photographic (PG) images is of great importance to verify the authenticity and originality of digital images. However, the recent cutting-edge generation methods enable high qualities of synthesis in CG images, which makes this challenging task even trickier. To address this issue, a novel multi-scale deep texture learning neural network coined as MDTL-NET is proposed for CG image detection. We first utilize a global texture representation module incorporating the ResNet architecture to capture multi-scale texture patterns. Then, a deep texture enhancement module based on a semantic segmentation map guided affine transformation operation is designed for texture difference amplification. To enhance performance, we equip the MDTL-NET with channel and spatial attention mechanisms, which refines intermediate features and facilitates trace exploration in different domains. Moreover, a Low-rank Tensor Representation (LTR) strategy is also used for feature fusion. Extensive experiments on three public datasets and a newly constructed dataset1 with more realistic and diverse images show that the proposed approach outperforms existing methods in the field by a clear margin. Besides, results also demonstrate the detection robustness and generalization ability of the proposed approach to postprocessing operations. © 2024 Elsevier Ltd
Original languageEnglish
Article number123368
JournalExpert Systems with Applications
Volume248
Online published1 Feb 2024
DOIs
Publication statusPublished - 15 Aug 2024

Funding

This work is supported by National Natural Science Foundation of China (Grant No. 62272297 ), Hong Kong Innovation and Technology Commission (InnoHK Project CIMDA), Hong Kong Research Grants Council (Project 11204821 ), City University of Hong Kong (Project 9610034 ).

Research Keywords

  • Computer-generated (CG)
  • Image detection
  • Natural photographic (PG)
  • Texture enhancement
  • Texture representation

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'MDTL-NET: Computer-generated image detection based on multi-scale deep texture learning'. Together they form a unique fingerprint.

Cite this