Gist and Verbatim : Understanding Speech to Inform New Interfaces for Verbal Text Composition

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

2 Scopus Citations
View graph of relations

Author(s)

  • Brinda Mehra
  • Kejia Shen
  • Hen Chen Yen
  • Can Liu

Detail(s)

Original languageEnglish
Title of host publicationCUI '23: Proceedings of the 5th International Conference on Conversational User Interfaces
EditorsMinha Lee, Cosmin Munteanu, Martin Porcheron, Johanne Trippas, Sarah Theres Völkel
PublisherAssociation for Computing Machinery, Inc
ISBN (print)9798400700149
Publication statusPublished - Jul 2023

Publication series

NameProceedings of the International Conference on Conversational User Interfaces, CUI

Conference

Title5th International Conference on Conversational User Interfaces (CUI 2023)
LocationEindhoven University of Technology
PlaceNetherlands
CityEindhoven
Period19 - 21 July 2023

Abstract

Recent interest in speech-to-text applications has found speech to be an efficient modality for text input. However, the spontaneity of speech makes direct transcriptions of spoken compositions effortful to edit. While previous works in Human-Computer Interaction (HCI) domain focus on improving error correction, there is a lack of theoretical ground around the understanding of speech as an input modality. This work explores literature from Cognitive Science to synthesize relevant theories and findings for the HCI audience to reference. Motivated by the literature indicating a fast memory decay of speech production and a preference towards gist abstraction in memory traces, an experiment was conducted to observe users' immediate recall of their verbal composition. Based on the theories and findings, we introduce new interaction concepts and workflows that adapt to the characteristics of speech input. © 2023 ACM.

Research Area(s)

  • dictation, speech, speech-to-text, STT, text composition, text editing, text entry

Bibliographic Note

Full text of this publication does not contain sufficient affiliation information. Research Unit(s) information for this record is based on his previous affiliation.

Citation Format(s)

Gist and Verbatim: Understanding Speech to Inform New Interfaces for Verbal Text Composition. / Mehra, Brinda; Shen, Kejia; Yen, Hen Chen et al.
CUI '23: Proceedings of the 5th International Conference on Conversational User Interfaces. ed. / Minha Lee; Cosmin Munteanu; Martin Porcheron; Johanne Trippas; Sarah Theres Völkel. Association for Computing Machinery, Inc, 2023. 15 (Proceedings of the International Conference on Conversational User Interfaces, CUI).

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review