Demonstrating TOM: A Development Platform for Wearable Intelligent Assistants in Daily Activities

Nuwan Janaka; Shengdong Zhao; David Hsu; Sherisse Tan Jing Wen; Chun Keat Koh

doi:10.1145/3640471.3680445

Demonstrating TOM: A Development Platform for Wearable Intelligent Assistants in Daily Activities

Nuwan Janaka, Shengdong Zhao^*, David Hsu^*, Sherisse Tan Jing Wen, Chun Keat Koh

^*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

Abstract

Advanced wearable digital assistants can significantly enhance task performance, reduce user burden, and provide personalized guidance to improve users' abilities. However, developing these assistants presents several challenges. To address this, we introduce TOM (The Other Me), a conceptual architecture and open-source software platform (https://github.com/TOM-Platform) that supports the development of wearable intelligent assistants that are contextually aware of both the user and the environment. Collaboratively developed with researchers and developers, TOM meets their diverse requirements. TOM facilitates the creation of intelligent assistive AR applications for daily activities and supports the recording and analysis of user interactions, integration of new devices, and the provision of assistance for various activities. © 2024 Copyright held by the owner/author(s).

Original language	English
Title of host publication	MobileHCI '24 Adjunct Proceedings - Publication of the 26th International Conference on Mobile Human-Computer Interaction
Editors	Tilman Dingler, Flora Salim, Marion Koelle, Niels van Berkel, Jenny Waycott
Publisher	Association for Computing Machinery
ISBN (Print)	9798400705069
DOIs	https://doi.org/10.1145/3640471.3680445
Publication status	Published - Sept 2024
Event	26th International Conference on Mobile Human-Computer Interaction (MobileHCI 2024): Connecting Cultures - Melbourne, Australia Duration: 30 Sept 2024 → 3 Oct 2024 https://mobilehci.acm.org/2024/

Publication series

Name	MobileHCI Adjunct Proceedings - Publication of the International Conference on Mobile Human-Computer Interaction

Conference

Conference	26th International Conference on Mobile Human-Computer Interaction (MobileHCI 2024)
Abbreviated title	MobileHCI'24
Country/Territory	Australia
City	Melbourne
Period	30/09/24 → 3/10/24
Internet address	https://mobilehci.acm.org/2024/

Funding

This research is supported by the National Research Foundation, Singapore, under its AI Singapore Programme (AISG Award No: AISG2-RP-2020-016). The CityU Start-up Grant 9610677 also provides partial support. Any opinions, findings, conclusions, or recommendations expressed in this material are those of the author(s) and do not reflect the views of the National Research Foundation, Singapore.

Research Keywords

AI assistance
AI/ML
AR
augmented reality
context-aware system
HMD
interactions
MR
smart glasses
wearable
XR

Access Output

10.1145/3640471.3680445

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

Janaka, N., Zhao, S., Hsu, D., Wen, S. T. J., & Koh, C. K. (2024). Demonstrating TOM: A Development Platform for Wearable Intelligent Assistants in Daily Activities. In T. Dingler, F. Salim, M. Koelle, N. van Berkel, & J. Waycott (Eds.), MobileHCI '24 Adjunct Proceedings - Publication of the 26th International Conference on Mobile Human-Computer Interaction Article 21 (MobileHCI Adjunct Proceedings - Publication of the International Conference on Mobile Human-Computer Interaction). Association for Computing Machinery. https://doi.org/10.1145/3640471.3680445

Janaka, Nuwan ; Zhao, Shengdong ; Hsu, David et al. / Demonstrating TOM : A Development Platform for Wearable Intelligent Assistants in Daily Activities. MobileHCI '24 Adjunct Proceedings - Publication of the 26th International Conference on Mobile Human-Computer Interaction. editor / Tilman Dingler ; Flora Salim ; Marion Koelle ; Niels van Berkel ; Jenny Waycott. Association for Computing Machinery, 2024. (MobileHCI Adjunct Proceedings - Publication of the International Conference on Mobile Human-Computer Interaction).

@inproceedings{6722109f86e049379ac3b1b1365b62a3,

title = "Demonstrating TOM: A Development Platform for Wearable Intelligent Assistants in Daily Activities",

abstract = "Advanced wearable digital assistants can significantly enhance task performance, reduce user burden, and provide personalized guidance to improve users' abilities. However, developing these assistants presents several challenges. To address this, we introduce TOM (The Other Me), a conceptual architecture and open-source software platform (https://github.com/TOM-Platform) that supports the development of wearable intelligent assistants that are contextually aware of both the user and the environment. Collaboratively developed with researchers and developers, TOM meets their diverse requirements. TOM facilitates the creation of intelligent assistive AR applications for daily activities and supports the recording and analysis of user interactions, integration of new devices, and the provision of assistance for various activities. {\textcopyright} 2024 Copyright held by the owner/author(s).",

keywords = "AI assistance, AI/ML, AR, augmented reality, context-aware system, HMD, interactions, MR, smart glasses, wearable, XR",

author = "Nuwan Janaka and Shengdong Zhao and David Hsu and Wen, {Sherisse Tan Jing} and Koh, {Chun Keat}",

year = "2024",

month = sep,

doi = "10.1145/3640471.3680445",

language = "English",

isbn = "9798400705069",

series = "MobileHCI Adjunct Proceedings - Publication of the International Conference on Mobile Human-Computer Interaction",

publisher = "Association for Computing Machinery",

editor = "Tilman Dingler and Flora Salim and Marion Koelle and {van Berkel}, Niels and Jenny Waycott",

booktitle = "MobileHCI '24 Adjunct Proceedings - Publication of the 26th International Conference on Mobile Human-Computer Interaction",

address = "United States",

note = "26th International Conference on Mobile Human-Computer Interaction (MobileHCI 2024) : Connecting Cultures, MobileHCI'24 ; Conference date: 30-09-2024 Through 03-10-2024",

url = "https://mobilehci.acm.org/2024/",

}

Janaka, N, Zhao, S, Hsu, D, Wen, STJ & Koh, CK 2024, Demonstrating TOM: A Development Platform for Wearable Intelligent Assistants in Daily Activities. in T Dingler, F Salim, M Koelle, N van Berkel & J Waycott (eds), MobileHCI '24 Adjunct Proceedings - Publication of the 26th International Conference on Mobile Human-Computer Interaction., 21, MobileHCI Adjunct Proceedings - Publication of the International Conference on Mobile Human-Computer Interaction, Association for Computing Machinery, 26th International Conference on Mobile Human-Computer Interaction (MobileHCI 2024), Melbourne, Victoria, Australia, 30/09/24. https://doi.org/10.1145/3640471.3680445

Demonstrating TOM: A Development Platform for Wearable Intelligent Assistants in Daily Activities. / Janaka, Nuwan; Zhao, Shengdong; Hsu, David et al.
MobileHCI '24 Adjunct Proceedings - Publication of the 26th International Conference on Mobile Human-Computer Interaction. ed. / Tilman Dingler; Flora Salim; Marion Koelle; Niels van Berkel; Jenny Waycott. Association for Computing Machinery, 2024. 21 (MobileHCI Adjunct Proceedings - Publication of the International Conference on Mobile Human-Computer Interaction).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - Demonstrating TOM

T2 - 26th International Conference on Mobile Human-Computer Interaction (MobileHCI 2024)

AU - Janaka, Nuwan

AU - Zhao, Shengdong

AU - Hsu, David

AU - Wen, Sherisse Tan Jing

AU - Koh, Chun Keat

PY - 2024/9

Y1 - 2024/9

N2 - Advanced wearable digital assistants can significantly enhance task performance, reduce user burden, and provide personalized guidance to improve users' abilities. However, developing these assistants presents several challenges. To address this, we introduce TOM (The Other Me), a conceptual architecture and open-source software platform (https://github.com/TOM-Platform) that supports the development of wearable intelligent assistants that are contextually aware of both the user and the environment. Collaboratively developed with researchers and developers, TOM meets their diverse requirements. TOM facilitates the creation of intelligent assistive AR applications for daily activities and supports the recording and analysis of user interactions, integration of new devices, and the provision of assistance for various activities. © 2024 Copyright held by the owner/author(s).

AB - Advanced wearable digital assistants can significantly enhance task performance, reduce user burden, and provide personalized guidance to improve users' abilities. However, developing these assistants presents several challenges. To address this, we introduce TOM (The Other Me), a conceptual architecture and open-source software platform (https://github.com/TOM-Platform) that supports the development of wearable intelligent assistants that are contextually aware of both the user and the environment. Collaboratively developed with researchers and developers, TOM meets their diverse requirements. TOM facilitates the creation of intelligent assistive AR applications for daily activities and supports the recording and analysis of user interactions, integration of new devices, and the provision of assistance for various activities. © 2024 Copyright held by the owner/author(s).

KW - AI assistance

KW - AI/ML

KW - AR

KW - augmented reality

KW - context-aware system

KW - HMD

KW - interactions

KW - MR

KW - smart glasses

KW - wearable

KW - XR

UR - http://www.scopus.com/inward/record.url?scp=85206134470&partnerID=8YFLogxK

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85206134470&origin=recordpage

U2 - 10.1145/3640471.3680445

DO - 10.1145/3640471.3680445

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 9798400705069

T3 - MobileHCI Adjunct Proceedings - Publication of the International Conference on Mobile Human-Computer Interaction

BT - MobileHCI '24 Adjunct Proceedings - Publication of the 26th International Conference on Mobile Human-Computer Interaction

A2 - Dingler, Tilman

A2 - Salim, Flora

A2 - Koelle, Marion

A2 - van Berkel, Niels

A2 - Waycott, Jenny

PB - Association for Computing Machinery

Y2 - 30 September 2024 through 3 October 2024

ER -

Janaka N, Zhao S, Hsu D, Wen STJ, Koh CK. Demonstrating TOM: A Development Platform for Wearable Intelligent Assistants in Daily Activities. In Dingler T, Salim F, Koelle M, van Berkel N, Waycott J, editors, MobileHCI '24 Adjunct Proceedings - Publication of the 26th International Conference on Mobile Human-Computer Interaction. Association for Computing Machinery. 2024. 21. (MobileHCI Adjunct Proceedings - Publication of the International Conference on Mobile Human-Computer Interaction). Epub 2024 Sept 21. doi: 10.1145/3640471.3680445

Demonstrating TOM: A Development Platform for Wearable Intelligent Assistants in Daily Activities

Abstract

Publication series

Conference

Funding

Research Keywords

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this