TOM: A Development Platform For Wearable Intelligent Assistants

Nuwan Janaka; Shengdong Zhao; David Hsu; Sherisse Tan Jing Wen; Chun Keat Koh

doi:10.1145/3675094.3678382

TOM: A Development Platform For Wearable Intelligent Assistants

Nuwan Janaka, Shengdong Zhao^*, David Hsu^*, Sherisse Tan Jing Wen, Chun Keat Koh

^*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

6 Citations (Scopus)

54 Downloads (CityUHK Scholars)

Abstract

Advanced wearable digital assistants can significantly enhance task performance, reduce user burden, and provide personalized guidance to improve users' abilities. However, developing these assistants presents several challenges. To address this, we introduce TOM (The Other Me), a conceptual architecture and open-source software platform (https://github.com/TOM-Platform) that supports the development of wearable intelligent assistants that are contextually aware of both the user and the environment. Collaboratively developed with researchers and developers, TOM meets their diverse requirements. TOM facilitates the creation of intelligent assistive AR applications for daily activities, supports the recording and analysis of user interactions, and provides assistance for various activities, as demonstrated in our preliminary evaluations. © 2024 Copyright held by the owner/author(s).

Original language	English
Title of host publication	UbiComp '24
Subtitle of host publication	Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing
Publisher	Association for Computing Machinery
Pages	837-843
ISBN (Print)	979-8-4007-1058-2
DOIs	https://doi.org/10.1145/3675094.3678382
Publication status	Published - Oct 2024
Event	2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2024 International Symposium on Wearable Computers (UbiComp/ISWC 2024) - Sofitel Melbourne on Collins, Melbourne, Australia Duration: 5 Oct 2024 → 9 Oct 2024 https://www.ubicomp.org/ubicomp-iswc-2024/

Publication series

Name	UbiComp Companion - Companion of the ACM International Joint Conference on Pervasive and Ubiquitous Computing

Conference

Conference	2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2024 International Symposium on Wearable Computers (UbiComp/ISWC 2024)
Abbreviated title	UbiComp/ISWC '24
Country/Territory	Australia
City	Melbourne
Period	5/10/24 → 9/10/24
Internet address	https://www.ubicomp.org/ubicomp-iswc-2024/

Funding

This research is supported by the National Research Foundation, Singapore, under its AI Singapore Programme (AISG Award No: AISG2-RP-2020-016). The CityU Start-up Grant 9610677 also provides partial support. Any opinions, findings, conclusions, or recommendations expressed in this material are those of the author(s) and do not reflect the views of the National Research Foundation, Singapore.

Research Keywords

AI assistance
AI/ML
AR
augmented reality
context-aware system
HMD
interactions
MR
smart glasses
wearable
XR

Publisher's Copyright Statement

This full text is made available under CC-BY 4.0. https://creativecommons.org/licenses/by/4.0/

Access Output

10.1145/3675094.3678382

253383000.pdfFinal Published version, 7.09 MBLicence: CC BY

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

Janaka, N., Zhao, S., Hsu, D., Wen, S. T. J., & Koh, C. K. (2024). TOM: A Development Platform For Wearable Intelligent Assistants. In UbiComp '24: Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing (pp. 837-843). (UbiComp Companion - Companion of the ACM International Joint Conference on Pervasive and Ubiquitous Computing). Association for Computing Machinery. https://doi.org/10.1145/3675094.3678382

Janaka, Nuwan ; Zhao, Shengdong ; Hsu, David et al. / TOM : A Development Platform For Wearable Intelligent Assistants. UbiComp '24: Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing. Association for Computing Machinery, 2024. pp. 837-843 (UbiComp Companion - Companion of the ACM International Joint Conference on Pervasive and Ubiquitous Computing).

@inproceedings{1bfb569e3fda4bb39e3568367d67ec25,

title = "TOM: A Development Platform For Wearable Intelligent Assistants",

abstract = "Advanced wearable digital assistants can significantly enhance task performance, reduce user burden, and provide personalized guidance to improve users' abilities. However, developing these assistants presents several challenges. To address this, we introduce TOM (The Other Me), a conceptual architecture and open-source software platform (https://github.com/TOM-Platform) that supports the development of wearable intelligent assistants that are contextually aware of both the user and the environment. Collaboratively developed with researchers and developers, TOM meets their diverse requirements. TOM facilitates the creation of intelligent assistive AR applications for daily activities, supports the recording and analysis of user interactions, and provides assistance for various activities, as demonstrated in our preliminary evaluations. {\textcopyright} 2024 Copyright held by the owner/author(s).",

keywords = "AI assistance, AI/ML, AR, augmented reality, context-aware system, HMD, interactions, MR, smart glasses, wearable, XR",

author = "Nuwan Janaka and Shengdong Zhao and David Hsu and Wen, {Sherisse Tan Jing} and Koh, {Chun Keat}",

year = "2024",

month = oct,

doi = "10.1145/3675094.3678382",

language = "English",

isbn = "979-8-4007-1058-2",

series = "UbiComp Companion - Companion of the ACM International Joint Conference on Pervasive and Ubiquitous Computing",

publisher = "Association for Computing Machinery",

pages = "837--843",

booktitle = "UbiComp '24",

address = "United States",

note = "2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2024 International Symposium on Wearable Computers (UbiComp/ISWC 2024), UbiComp/ISWC '24 ; Conference date: 05-10-2024 Through 09-10-2024",

url = "https://www.ubicomp.org/ubicomp-iswc-2024/",

}

Janaka, N, Zhao, S, Hsu, D, Wen, STJ & Koh, CK 2024, TOM: A Development Platform For Wearable Intelligent Assistants. in UbiComp '24: Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing. UbiComp Companion - Companion of the ACM International Joint Conference on Pervasive and Ubiquitous Computing, Association for Computing Machinery, pp. 837-843, 2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2024 International Symposium on Wearable Computers (UbiComp/ISWC 2024), Melbourne, Victoria, Australia, 5/10/24. https://doi.org/10.1145/3675094.3678382

TOM: A Development Platform For Wearable Intelligent Assistants. / Janaka, Nuwan; Zhao, Shengdong; Hsu, David et al.
UbiComp '24: Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing. Association for Computing Machinery, 2024. p. 837-843 (UbiComp Companion - Companion of the ACM International Joint Conference on Pervasive and Ubiquitous Computing).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - TOM

T2 - 2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2024 International Symposium on Wearable Computers (UbiComp/ISWC 2024)

AU - Janaka, Nuwan

AU - Zhao, Shengdong

AU - Hsu, David

AU - Wen, Sherisse Tan Jing

AU - Koh, Chun Keat

PY - 2024/10

Y1 - 2024/10

N2 - Advanced wearable digital assistants can significantly enhance task performance, reduce user burden, and provide personalized guidance to improve users' abilities. However, developing these assistants presents several challenges. To address this, we introduce TOM (The Other Me), a conceptual architecture and open-source software platform (https://github.com/TOM-Platform) that supports the development of wearable intelligent assistants that are contextually aware of both the user and the environment. Collaboratively developed with researchers and developers, TOM meets their diverse requirements. TOM facilitates the creation of intelligent assistive AR applications for daily activities, supports the recording and analysis of user interactions, and provides assistance for various activities, as demonstrated in our preliminary evaluations. © 2024 Copyright held by the owner/author(s).

AB - Advanced wearable digital assistants can significantly enhance task performance, reduce user burden, and provide personalized guidance to improve users' abilities. However, developing these assistants presents several challenges. To address this, we introduce TOM (The Other Me), a conceptual architecture and open-source software platform (https://github.com/TOM-Platform) that supports the development of wearable intelligent assistants that are contextually aware of both the user and the environment. Collaboratively developed with researchers and developers, TOM meets their diverse requirements. TOM facilitates the creation of intelligent assistive AR applications for daily activities, supports the recording and analysis of user interactions, and provides assistance for various activities, as demonstrated in our preliminary evaluations. © 2024 Copyright held by the owner/author(s).

KW - AI assistance

KW - AI/ML

KW - AR

KW - augmented reality

KW - context-aware system

KW - HMD

KW - interactions

KW - MR

KW - smart glasses

KW - wearable

KW - XR

UR - http://www.scopus.com/inward/record.url?scp=85203867419&partnerID=8YFLogxK

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85203867419&origin=recordpage

U2 - 10.1145/3675094.3678382

DO - 10.1145/3675094.3678382

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 979-8-4007-1058-2

T3 - UbiComp Companion - Companion of the ACM International Joint Conference on Pervasive and Ubiquitous Computing

SP - 837

EP - 843

BT - UbiComp '24

PB - Association for Computing Machinery

Y2 - 5 October 2024 through 9 October 2024

ER -

Janaka N, Zhao S, Hsu D, Wen STJ, Koh CK. TOM: A Development Platform For Wearable Intelligent Assistants. In UbiComp '24: Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing. Association for Computing Machinery. 2024. p. 837-843. (UbiComp Companion - Companion of the ACM International Joint Conference on Pervasive and Ubiquitous Computing). Epub 2024 Oct 5. doi: 10.1145/3675094.3678382

TOM: A Development Platform For Wearable Intelligent Assistants

Abstract

Publication series

Conference

Funding

Research Keywords

Publisher's Copyright Statement

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this