ParaGlassMenu: Towards Social-Friendly Subtle Interactions in Conversations

Runze Cai; Nuwan Janaka; Shengdong Zhao; Minghui Sun

doi:10.1145/3544548.3581065

ParaGlassMenu: Towards Social-Friendly Subtle Interactions in Conversations

Runze Cai, Nuwan Janaka, Shengdong Zhao, Minghui Sun

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

21 Citations (Scopus)

173 Downloads (CityUHK Scholars)

Abstract

Interactions with digital devices during social settings can reduce social engagement and interrupt conversations. To overcome these drawbacks, we designed ParaGlassMenu, a semi-transparent circular menu that can be displayed around a conversation partner's face on Optical See-Through Head-Mounted Display (OHMD) and interacted subtly using a ring mouse. We evaluated ParaGlassMenu with several alternative approaches (Smartphone, Voice assistant, and Linear OHMD menus) by manipulating Internet-of-Things (IoT) devices in a simulated conversation setting with a digital partner. Results indicated that the ParaGlassMenu offered the best overall performance in balancing social engagement and digital interaction needs in conversations. To validate these findings, we conducted a second study in a realistic conversation scenario involving commodity IoT devices. Results confirmed the utility and social acceptance of the ParaGlassMenu. Based on the results, we discuss implications for designing attention-maintaining subtle interaction techniques on OHMDs.

© 2023 Copyright held by the owner/author(s).

Original language	English
Title of host publication	CHI '23
Subtitle of host publication	Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Editors	Albrecht Schmidt, Kaisa Väänänen, Tesh Goyal, Per Ola Kristensson, Anicia Peters, Stefanie Mueller, Julie R. Williamson, Max L. Wilson
Publisher	Association for Computing Machinery
ISBN (Print)	978-1-4503-9421-5
DOIs	https://doi.org/10.1145/3544548.3581065
Publication status	Published - Apr 2023
Externally published	Yes
Event	2023 CHI Conference on Human Factors in Computing Systems (CHI ’23): reCHInnecting - Hybrid, Hamburg, Germany Duration: 23 Apr 2023 → 28 Apr 2023 https://dl.acm.org/doi/proceedings/10.1145/3544548 https://chi2023.acm.org/

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	2023 CHI Conference on Human Factors in Computing Systems (CHI ’23)
Abbreviated title	CHI 2023
Place	Germany
City	Hamburg
Period	23/04/23 → 28/04/23
Internet address	https://dl.acm.org/doi/proceedings/10.1145/3544548 https://chi2023.acm.org/

Research Keywords

circular menu
conversation
HMD
Internet-of-Things
IoT manipulation
ring interaction
smart glasses
social interaction

Publisher's Copyright Statement

This full text is made available under CC-BY 4.0. https://creativecommons.org/licenses/by/4.0/

Access Output

10.1145/3544548.3581065

190022583.pdfFinal Published version, 7.04 MBLicence: CC BY

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

Cai, R., Janaka, N., Zhao, S., & Sun, M. (2023). ParaGlassMenu: Towards Social-Friendly Subtle Interactions in Conversations. In A. Schmidt, K. Väänänen, T. Goyal, P. O. Kristensson, A. Peters, S. Mueller, J. R. Williamson, & M. L. Wilson (Eds.), CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems Article 721 (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery. https://doi.org/10.1145/3544548.3581065

Cai, Runze ; Janaka, Nuwan ; Zhao, Shengdong et al. / ParaGlassMenu : Towards Social-Friendly Subtle Interactions in Conversations. CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. editor / Albrecht Schmidt ; Kaisa Väänänen ; Tesh Goyal ; Per Ola Kristensson ; Anicia Peters ; Stefanie Mueller ; Julie R. Williamson ; Max L. Wilson. Association for Computing Machinery, 2023. (Conference on Human Factors in Computing Systems - Proceedings).

@inproceedings{136a0a4c23934cea941af123966d0274,

title = "ParaGlassMenu: Towards Social-Friendly Subtle Interactions in Conversations",

abstract = "Interactions with digital devices during social settings can reduce social engagement and interrupt conversations. To overcome these drawbacks, we designed ParaGlassMenu, a semi-transparent circular menu that can be displayed around a conversation partner's face on Optical See-Through Head-Mounted Display (OHMD) and interacted subtly using a ring mouse. We evaluated ParaGlassMenu with several alternative approaches (Smartphone, Voice assistant, and Linear OHMD menus) by manipulating Internet-of-Things (IoT) devices in a simulated conversation setting with a digital partner. Results indicated that the ParaGlassMenu offered the best overall performance in balancing social engagement and digital interaction needs in conversations. To validate these findings, we conducted a second study in a realistic conversation scenario involving commodity IoT devices. Results confirmed the utility and social acceptance of the ParaGlassMenu. Based on the results, we discuss implications for designing attention-maintaining subtle interaction techniques on OHMDs. {\textcopyright} 2023 Copyright held by the owner/author(s).",

keywords = "circular menu, conversation, HMD, Internet-of-Things, IoT manipulation, ring interaction, smart glasses, social interaction",

author = "Runze Cai and Nuwan Janaka and Shengdong Zhao and Minghui Sun",

year = "2023",

month = apr,

doi = "10.1145/3544548.3581065",

language = "English",

isbn = "978-1-4503-9421-5",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery",

editor = "Albrecht Schmidt and Kaisa V{\"a}{\"a}n{\"a}nen and Tesh Goyal and Kristensson, {Per Ola} and Anicia Peters and Stefanie Mueller and Williamson, {Julie R.} and Wilson, {Max L.}",

booktitle = "CHI '23",

address = "United States",

note = "2023 CHI Conference on Human Factors in Computing Systems (CHI {\textquoteright}23) : reCHInnecting, CHI 2023 ; Conference date: 23-04-2023 Through 28-04-2023",

url = "https://dl.acm.org/doi/proceedings/10.1145/3544548, https://chi2023.acm.org/",

}

Cai, R, Janaka, N, Zhao, S & Sun, M 2023, ParaGlassMenu: Towards Social-Friendly Subtle Interactions in Conversations. in A Schmidt, K Väänänen, T Goyal, PO Kristensson, A Peters, S Mueller, JR Williamson & ML Wilson (eds), CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems., 721, Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery, 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), Hamburg, Germany, 23/04/23. https://doi.org/10.1145/3544548.3581065

ParaGlassMenu: Towards Social-Friendly Subtle Interactions in Conversations. / Cai, Runze; Janaka, Nuwan; Zhao, Shengdong et al.
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ed. / Albrecht Schmidt; Kaisa Väänänen; Tesh Goyal; Per Ola Kristensson; Anicia Peters; Stefanie Mueller; Julie R. Williamson; Max L. Wilson. Association for Computing Machinery, 2023. 721 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - ParaGlassMenu

T2 - 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23)

AU - Cai, Runze

AU - Janaka, Nuwan

AU - Zhao, Shengdong

AU - Sun, Minghui

PY - 2023/4

Y1 - 2023/4

N2 - Interactions with digital devices during social settings can reduce social engagement and interrupt conversations. To overcome these drawbacks, we designed ParaGlassMenu, a semi-transparent circular menu that can be displayed around a conversation partner's face on Optical See-Through Head-Mounted Display (OHMD) and interacted subtly using a ring mouse. We evaluated ParaGlassMenu with several alternative approaches (Smartphone, Voice assistant, and Linear OHMD menus) by manipulating Internet-of-Things (IoT) devices in a simulated conversation setting with a digital partner. Results indicated that the ParaGlassMenu offered the best overall performance in balancing social engagement and digital interaction needs in conversations. To validate these findings, we conducted a second study in a realistic conversation scenario involving commodity IoT devices. Results confirmed the utility and social acceptance of the ParaGlassMenu. Based on the results, we discuss implications for designing attention-maintaining subtle interaction techniques on OHMDs. © 2023 Copyright held by the owner/author(s).

AB - Interactions with digital devices during social settings can reduce social engagement and interrupt conversations. To overcome these drawbacks, we designed ParaGlassMenu, a semi-transparent circular menu that can be displayed around a conversation partner's face on Optical See-Through Head-Mounted Display (OHMD) and interacted subtly using a ring mouse. We evaluated ParaGlassMenu with several alternative approaches (Smartphone, Voice assistant, and Linear OHMD menus) by manipulating Internet-of-Things (IoT) devices in a simulated conversation setting with a digital partner. Results indicated that the ParaGlassMenu offered the best overall performance in balancing social engagement and digital interaction needs in conversations. To validate these findings, we conducted a second study in a realistic conversation scenario involving commodity IoT devices. Results confirmed the utility and social acceptance of the ParaGlassMenu. Based on the results, we discuss implications for designing attention-maintaining subtle interaction techniques on OHMDs. © 2023 Copyright held by the owner/author(s).

KW - circular menu

KW - conversation

KW - HMD

KW - Internet-of-Things

KW - IoT manipulation

KW - ring interaction

KW - smart glasses

KW - social interaction

UR - http://www.scopus.com/inward/record.url?scp=85160013758&partnerID=8YFLogxK

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85160013758&origin=recordpage

U2 - 10.1145/3544548.3581065

DO - 10.1145/3544548.3581065

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 978-1-4503-9421-5

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI '23

A2 - Schmidt, Albrecht

A2 - Väänänen, Kaisa

A2 - Goyal, Tesh

A2 - Kristensson, Per Ola

A2 - Peters, Anicia

A2 - Mueller, Stefanie

A2 - Williamson, Julie R.

A2 - Wilson, Max L.

PB - Association for Computing Machinery

Y2 - 23 April 2023 through 28 April 2023

ER -

Cai R, Janaka N, Zhao S, Sun M. ParaGlassMenu: Towards Social-Friendly Subtle Interactions in Conversations. In Schmidt A, Väänänen K, Goyal T, Kristensson PO, Peters A, Mueller S, Williamson JR, Wilson ML, editors, CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery. 2023. 721. (Conference on Human Factors in Computing Systems - Proceedings). Epub 2023 Apr 19. doi: 10.1145/3544548.3581065

ParaGlassMenu: Towards Social-Friendly Subtle Interactions in Conversations

Abstract

Publication series

Conference

Research Keywords

Publisher's Copyright Statement

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this