ThermalWear : Exploring Wearable On-chest Thermal Displays to Augment Voice Messages with Affect

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

31 Scopus Citations
View graph of relations

Author(s)

  • Abdallah El Ali
  • Swamy Ananthanarayan
  • Thomas Röggla
  • Jack Jansen
  • Jess Hartcher-O’Brien
  • Kaspar Jansen
  • Pablo Cesar

Detail(s)

Original languageEnglish
Title of host publicationCHI‘20
Subtitle of host publicationProceedings of the 2020 CHI Conference on Human Factors in Computing Systems
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery
ISBN (print)978-1-4503-6708-0
Publication statusPublished - 2020
Externally publishedYes

Conference

Title2020 CHI Conference on Human Factors in Computing Systems (CHI 2020)
LocationHawaii Convention Center
PlaceUnited States
CityHonolulu
Period25 - 30 April 2020

Abstract

Voice is a rich modality for conveying emotions, however emotional prosody production can be situationally or medically impaired. Since thermal displays have been shown to evoke emotions, we explore how thermal stimulation can augment perception of neutrally-spoken voice messages with affect. We designed ThermalWear, a wearable on-chest thermal display, then tested in a controlled study (N=12) the effects of fabric, thermal intensity, and direction of change. Thereafter, we synthesized 12 neutrally-spoken voice messages, validated (N=7) them, then tested (N=12) if thermal stimuli can augment their perception with affect. We found warm and cool stimuli (a) can be perceived on the chest, and quickly without fabric (4.7-5s) (b) do not incur discomfort (c) generally increase arousal of voice messages and (d) increase / decrease message valence, respectively. We discuss how thermal displays can augment voice perception, which can enhance voice assistants and support individuals with emotional prosody impairments. © 2020 Copyright is held by the owner/author(s). Publication rights licensed to ACM.

Research Area(s)

  • thermal, affect, emotion, voice, prosody, wearable, display, chest

Citation Format(s)

ThermalWear: Exploring Wearable On-chest Thermal Displays to Augment Voice Messages with Affect. / Ali, Abdallah El; Yang, Xingyu; Ananthanarayan, Swamy et al.
CHI‘20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. New York, NY: Association for Computing Machinery, 2020. 553.

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review