AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart Glasses

Runze Cai; Nuwan Janaka; Hyeongcheol Kim; Yang Chen; Shengdong Zhao; Yun Huang; David Hsu

doi:10.1145/3706598.3713953

AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart Glasses

Runze Cai, Nuwan Janaka, Hyeongcheol Kim, Yang Chen, Shengdong Zhao^*, Yun Huang, David Hsu^*

^*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

4 Downloads (CityUHK Scholars)

Abstract

Unlike the free exploration of childhood, the demands of daily life reduce our motivation to explore our surroundings, leading to missed opportunities for informal learning. Traditional tools for knowledge acquisition are reactive, relying on user initiative and limiting their ability to uncover hidden interests. Through formative studies, we introduce AiGet, a proactive AI assistant integrated with AR smart glasses, designed to seamlessly embed informal learning into low-demand daily activities (e.g., casual walking and shopping). AiGet analyzes real-time user gaze patterns, environmental context, and user profiles, leveraging large language models to deliver personalized, context-aware knowledge with low disruption to primary tasks. In-lab evaluations and real-world testing, including continued use over multiple days, demonstrate AiGet's effectiveness in uncovering overlooked yet surprising interests, enhancing primary task enjoyment, reviving curiosity, and deepening connections with the environment. We further propose design guidelines for AI-assisted informal learning, focused on transforming everyday moments into enriching learning experiences. © 2025 Copyright held by the owner/author(s).

Original language	English
Title of host publication	CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
Editors	Naomi Yamashita, Vanessa Evers, Koji Yatani
Publisher	Association for Computing Machinery
ISBN (Print)	9798400713941
DOIs	https://doi.org/10.1145/3706598.3713953
Publication status	Published - Apr 2025
Event	2025 ACM CHI Conference on Human Factors in Computing Systems (CHI 2025): IkiCHI - PACIFICO Yokohama, Yokohama, Japan Duration: 26 Apr 2025 → 1 May 2025 https://chi2025.acm.org/

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	2025 ACM CHI Conference on Human Factors in Computing Systems (CHI 2025)
Abbreviated title	CHI'25
Country/Territory	Japan
City	Yokohama
Period	26/04/25 → 1/05/25
Internet address	https://chi2025.acm.org/

Funding

This research is supported by the National Research Foundation Singapore and DSO National Laboratories under the AI Singapore Programme (Award Number: AISG2-RP-2020-016). The CityU Startup Grant (9610677) also provides partial support. Any opinions, findings, conclusions, or recommendations expressed in this material are those of the author(s) and do not reflect the views of the National Research Foundation, Singapore. We extend our gratitude to the Lee Kong Chian Natural History Museum and NUS Museum for their invaluable assistance with our user studies and to all members of the Synteraction Lab for their help in completing this project. We also thank the reviewers for their valuable feedback.

Research Keywords

AI
HMD
human-ai interaction
incidental learning
informal learning
knowledge discovery
large language model
multimodal information
smart glasses
wearable-AI assistance

Publisher's Copyright Statement

This full text is made available under CC-BY 4.0. https://creativecommons.org/licenses/by/4.0/

Access Output

10.1145/3706598.3713953

288142372.pdfFinal Published version, 3.75 MBLicence: CC BY

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

Cai, R., Janaka, N., Kim, H., Chen, Y., Zhao, S., Huang, Y., & Hsu, D. (2025). AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart Glasses. In N. Yamashita, V. Evers, & K. Yatani (Eds.), CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems Article 631 (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery. https://doi.org/10.1145/3706598.3713953

Cai, Runze ; Janaka, Nuwan ; Kim, Hyeongcheol et al. / AiGet : Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart Glasses. CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. editor / Naomi Yamashita ; Vanessa Evers ; Koji Yatani. Association for Computing Machinery, 2025. (Conference on Human Factors in Computing Systems - Proceedings).

@inproceedings{10d7e068e8af4837ba6156f2a861558d,

title = "AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart Glasses",

abstract = "Unlike the free exploration of childhood, the demands of daily life reduce our motivation to explore our surroundings, leading to missed opportunities for informal learning. Traditional tools for knowledge acquisition are reactive, relying on user initiative and limiting their ability to uncover hidden interests. Through formative studies, we introduce AiGet, a proactive AI assistant integrated with AR smart glasses, designed to seamlessly embed informal learning into low-demand daily activities (e.g., casual walking and shopping). AiGet analyzes real-time user gaze patterns, environmental context, and user profiles, leveraging large language models to deliver personalized, context-aware knowledge with low disruption to primary tasks. In-lab evaluations and real-world testing, including continued use over multiple days, demonstrate AiGet's effectiveness in uncovering overlooked yet surprising interests, enhancing primary task enjoyment, reviving curiosity, and deepening connections with the environment. We further propose design guidelines for AI-assisted informal learning, focused on transforming everyday moments into enriching learning experiences. {\textcopyright} 2025 Copyright held by the owner/author(s).",

keywords = "AI, HMD, human-ai interaction, incidental learning, informal learning, knowledge discovery, large language model, multimodal information, smart glasses, wearable-AI assistance",

author = "Runze Cai and Nuwan Janaka and Hyeongcheol Kim and Yang Chen and Shengdong Zhao and Yun Huang and David Hsu",

year = "2025",

month = apr,

doi = "10.1145/3706598.3713953",

language = "English",

isbn = "9798400713941",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery",

editor = "Naomi Yamashita and Vanessa Evers and Koji Yatani",

booktitle = "CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems",

address = "United States",

note = "2025 ACM CHI Conference on Human Factors in Computing Systems (CHI 2025) : IkiCHI, CHI'25 ; Conference date: 26-04-2025 Through 01-05-2025",

url = "https://chi2025.acm.org/",

}

Cai, R, Janaka, N, Kim, H, Chen, Y, Zhao, S, Huang, Y & Hsu, D 2025, AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart Glasses. in N Yamashita, V Evers & K Yatani (eds), CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems., 631, Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery, 2025 ACM CHI Conference on Human Factors in Computing Systems (CHI 2025), Yokohama, Japan, 26/04/25. https://doi.org/10.1145/3706598.3713953

AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart Glasses. / Cai, Runze; Janaka, Nuwan; Kim, Hyeongcheol et al.
CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. ed. / Naomi Yamashita; Vanessa Evers; Koji Yatani. Association for Computing Machinery, 2025. 631 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - AiGet

T2 - 2025 ACM CHI Conference on Human Factors in Computing Systems (CHI 2025)

AU - Cai, Runze

AU - Janaka, Nuwan

AU - Kim, Hyeongcheol

AU - Chen, Yang

AU - Zhao, Shengdong

AU - Huang, Yun

AU - Hsu, David

PY - 2025/4

Y1 - 2025/4

N2 - Unlike the free exploration of childhood, the demands of daily life reduce our motivation to explore our surroundings, leading to missed opportunities for informal learning. Traditional tools for knowledge acquisition are reactive, relying on user initiative and limiting their ability to uncover hidden interests. Through formative studies, we introduce AiGet, a proactive AI assistant integrated with AR smart glasses, designed to seamlessly embed informal learning into low-demand daily activities (e.g., casual walking and shopping). AiGet analyzes real-time user gaze patterns, environmental context, and user profiles, leveraging large language models to deliver personalized, context-aware knowledge with low disruption to primary tasks. In-lab evaluations and real-world testing, including continued use over multiple days, demonstrate AiGet's effectiveness in uncovering overlooked yet surprising interests, enhancing primary task enjoyment, reviving curiosity, and deepening connections with the environment. We further propose design guidelines for AI-assisted informal learning, focused on transforming everyday moments into enriching learning experiences. © 2025 Copyright held by the owner/author(s).

AB - Unlike the free exploration of childhood, the demands of daily life reduce our motivation to explore our surroundings, leading to missed opportunities for informal learning. Traditional tools for knowledge acquisition are reactive, relying on user initiative and limiting their ability to uncover hidden interests. Through formative studies, we introduce AiGet, a proactive AI assistant integrated with AR smart glasses, designed to seamlessly embed informal learning into low-demand daily activities (e.g., casual walking and shopping). AiGet analyzes real-time user gaze patterns, environmental context, and user profiles, leveraging large language models to deliver personalized, context-aware knowledge with low disruption to primary tasks. In-lab evaluations and real-world testing, including continued use over multiple days, demonstrate AiGet's effectiveness in uncovering overlooked yet surprising interests, enhancing primary task enjoyment, reviving curiosity, and deepening connections with the environment. We further propose design guidelines for AI-assisted informal learning, focused on transforming everyday moments into enriching learning experiences. © 2025 Copyright held by the owner/author(s).

KW - AI

KW - HMD

KW - human-ai interaction

KW - incidental learning

KW - informal learning

KW - knowledge discovery

KW - large language model

KW - multimodal information

KW - smart glasses

KW - wearable-AI assistance

UR - http://www.scopus.com/inward/record.url?scp=105005731417&partnerID=8YFLogxK

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-105005731417&origin=recordpage

U2 - 10.1145/3706598.3713953

DO - 10.1145/3706598.3713953

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 9798400713941

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems

A2 - Yamashita, Naomi

A2 - Evers, Vanessa

A2 - Yatani, Koji

PB - Association for Computing Machinery

Y2 - 26 April 2025 through 1 May 2025

ER -

Cai R, Janaka N, Kim H, Chen Y, Zhao S, Huang Y et al. AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart Glasses. In Yamashita N, Evers V, Yatani K, editors, CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery. 2025. 631. (Conference on Human Factors in Computing Systems - Proceedings). Epub 2025 Apr 25. doi: 10.1145/3706598.3713953

AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart Glasses

Abstract

Publication series

Conference

Funding

Research Keywords

Publisher's Copyright Statement

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this