Testing the Annotation Consistency of Hallidayan Transitivity Processes : A Multi-variable Structural Approach

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)peer-review

View graph of relations

Author(s)

Detail(s)

Original languageEnglish
Title of host publicationProceedings of the 18th Joint ACL - ISO workshop on Interoperable Semantic Annotation (ISA-18)
EditorsHarry Bunt
Place of PublicationParis
PublisherEuropean Language Resources Association (ELRA)
Pages53-60
Number of pages8
ISBN (Print)979-10-95546-81-8
Publication statusPublished - Jun 2022

Conference

Title18th Joint ACL - ISO Workshop on Interoperable Semantic Annotation, ISA-18
LocationLe Palais du Pharo
PlaceFrance
CityMarseille
Period20 June 2022

Link(s)

Abstract

SFL seeks to explain identifiable, observable phenomena of language use in context through the application of a theoretical framework which models language as a functional, meaning making system (Halliday & Matthiessen 2004). Due to the lack of explicit annotation criteria and the divide between conceptual vs. syntactic criteria in practice, it has been a tough job to achieve consistency in the annotation of Hallidayn transitivity processes. The present study proposed that explicit structural and syntactic criteria should be adopted as a basis. Drawing on syntactic and grammatical features as judgement cues, we applied structurally oriented criteria for the annotation of the process categories and participant roles combining a set of interrelated syntactic variables and established the annotation criteria for contextualised circumstantial categories in structural as well as semantic terms. An experiment was carried out to test the usefulness of these annotation criteria, applying percent agreement and Cohen’s kappa as measurements of interrater reliability between the two annotators in each of the five pairs. The results verified our assumptions, albeit rather mildly, and, more significantly, offered some first empirical indications about the practical consistency of transitivity analysis in SFL. In the future work, the research team expect to draw on the insights and experience from some of the ISO standards devoted to semantic annotation such as dialogue acts (Bunt et al. 2012) and semantic roles (ISO-24617-4, 2014).

Research Area(s)

  • annotation consistency, Hallidayan transitivity process, structurally oriented criteria

Citation Format(s)

Testing the Annotation Consistency of Hallidayan Transitivity Processes : A Multi-variable Structural Approach. / Dong, Min; Liu, Xiaoyan; Fang, Alex Chengyu.

Proceedings of the 18th Joint ACL - ISO workshop on Interoperable Semantic Annotation (ISA-18). ed. / Harry Bunt. Paris : European Language Resources Association (ELRA), 2022. p. 53-60.

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)peer-review

Download Statistics

No data available