Skip to main navigation Skip to search Skip to main content

DeTinyLLM: Efficient detection of machine-generated text via compact paraphrase transformation

  • Shilei Tan (Co-first Author)
  • , Yongcheng Zhou (Co-first Author)
  • , Haoxiang Liu
  • , Xuesong Wang*
  • , Si Chen
  • , Wei Gong
  • *Corresponding author for this work

Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review

Abstract

The growing fusion of human-written and machine-generated text poses significant challenges in distinguishing their origins, as advanced large language models (LLMs) increasingly mimic human linguistic patterns. Existing detection methods, such as SimLLM, rely on querying proprietary LLMs for proofreading to measure similarity, which incurs high computational costs and instability due to dependency on fluctuating model updates. To address these limitations, we propose DeTinyLLM, a novel framework that leverages fusion-driven compact paraphrase models for efficient and stable detection. First, we train a lightweight transformation model (e.g., fine-tuned T5-large) to rewrite machine-generated text into human-like text, effectively “de-AI-ifying” it through iterative fusion of syntactic and semantic features. For detection, the input text and its rewritten version are fused and classified via a hybrid neural network, capitalizing on divergence patterns between human and machine text. Experiments across diverse datasets demonstrate that DeTinyLLM achieves state-of-the-art accuracy (surpassing SimLLM by 4.3 % in ROC-AUC) while reducing inference latency by 77.2 %. By eliminating reliance on proprietary LLMs and integrating multi-level fusion of linguistic signals, this work advances scalable, cost-effective solutions for real-world deployment in AI-generated text detection systems. © 2025 Elsevier B.V.
Original languageEnglish
Article number103713
JournalInformation Fusion
Volume127
Online published13 Sept 2025
DOIs
Publication statusPublished - Mar 2026

Funding

This work was supported in part by the National Natural Science Foundation of China under Grant 62302475, in part by the Hefei Municipal Natural Science Foundation under Grant 202328, and partly by the Anhui Science and Technology Innovation Tackling Plan Project under Grant 202423k09020044.

Research Keywords

  • DeTinyLLM
  • Machine-generated text detection
  • Paraphrase transformation
  • Text information fusion

Fingerprint

Dive into the research topics of 'DeTinyLLM: Efficient detection of machine-generated text via compact paraphrase transformation'. Together they form a unique fingerprint.

Cite this