Projects per year
Abstract
Distinguishing between computer-generated (CG) and natural photographic (PG) images is of great importance to verify the authenticity and originality of digital images. However, the recent cutting-edge generation methods enable high qualities of synthesis in CG images, which makes this challenging task even trickier. To address this issue, a novel multi-scale deep texture learning neural network coined as MDTL-NET is proposed for CG image detection. We first utilize a global texture representation module incorporating the ResNet architecture to capture multi-scale texture patterns. Then, a deep texture enhancement module based on a semantic segmentation map guided affine transformation operation is designed for texture difference amplification. To enhance performance, we equip the MDTL-NET with channel and spatial attention mechanisms, which refines intermediate features and facilitates trace exploration in different domains. Moreover, a Low-rank Tensor Representation (LTR) strategy is also used for feature fusion. Extensive experiments on three public datasets and a newly constructed dataset1 with more realistic and diverse images show that the proposed approach outperforms existing methods in the field by a clear margin. Besides, results also demonstrate the detection robustness and generalization ability of the proposed approach to postprocessing operations. © 2024 Elsevier Ltd
| Original language | English |
|---|---|
| Article number | 123368 |
| Journal | Expert Systems with Applications |
| Volume | 248 |
| Online published | 1 Feb 2024 |
| DOIs | |
| Publication status | Published - 15 Aug 2024 |
Funding
This work is supported by National Natural Science Foundation of China (Grant No. 62272297 ), Hong Kong Innovation and Technology Commission (InnoHK Project CIMDA), Hong Kong Research Grants Council (Project 11204821 ), City University of Hong Kong (Project 9610034 ).
Research Keywords
- Computer-generated (CG)
- Image detection
- Natural photographic (PG)
- Texture enhancement
- Texture representation
RGC Funding Information
- RGC-funded
Fingerprint
Dive into the research topics of 'MDTL-NET: Computer-generated image detection based on multi-scale deep texture learning'. Together they form a unique fingerprint.Projects
- 1 Active
-
GRF: Matching Large Feature Sets based on Hypergraph Models and Structurally Adaptive CUR Decompositions of Compatibility Tensors
YAN, H. (Principal Investigator / Project Coordinator)
1/01/22 → …
Project: Research