A scalable framework for cross-lingual authorship identification

Raheem Sarwar, Qing Li, Thanawin Rakthanmanon, Sarana Nutanong*

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

22 Citations (Scopus)

Abstract

Cross-lingual authorship identification aims at finding the author of an anonymous document written in one language by using labeled documents written in other languages. The main challenge of cross-lingual authorship identification is that the stylistic markers (features) used in one language may not be applicable to other languages in the corpus. Existing methods overcome this challenge by using external resources such as machine translation and part-of-speech tagging. However, such solutions are not applicable to languages with poor external resources (known as low resource languages). They also fail to scale as the number of candidate authors and/or the number of languages in the corpus increases. In this investigation, we analyze different types of stylometric features and identify 10 high-performance language-independent features for cross-lingual stylometric analysis tasks. Based on these stylometric features, we propose a cross-lingual authorship identification solution that can accurately handle a large number of authors. Specifically, we partition the documents into fragments where each fragment is further decomposed into fixed size chunks. Using a multilingual corpus of 400 authors with 825 documents written in 6 different languages, we show that our method can achieve an accuracy level of 96.66%. Our solution also outperforms the best existing solution that does not rely on external resources.
Original languageEnglish
Pages (from-to)323-339
JournalInformation Sciences
Volume465
Online published10 Jul 2018
DOIs
Publication statusPublished - Oct 2018

Research Keywords

  • Authorship identification
  • Cross-lingual
  • Cyber forensic
  • Similarity search
  • Stylometric features
  • Writeprint

Fingerprint

Dive into the research topics of 'A scalable framework for cross-lingual authorship identification'. Together they form a unique fingerprint.

Cite this