Designing Interactive Multimodal Information Retrieval and Access for Heads Up Computing (DIMIRA-HUC)

Haiming Liu; Shengdong Zhao; Silang Wang; Preben Hansen; Ian Oakley; Khanh-Duy Le

doi:10.1145/3698204.3716482

Designing Interactive Multimodal Information Retrieval and Access for Heads Up Computing (DIMIRA-HUC)

Haiming Liu^*
, Shengdong Zhao
, Silang Wang
, Preben Hansen
, Ian Oakley
, Khanh-Duy Le

^*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

Abstract

The advancement of wearable intelligent systems presents a unique opportunity to transform how humans interact with digital content. This workshop explores the design of Interactive Multimodal Information Retrieval and Access systems specifically tailored for Heads-Up Computing environments. By leveraging multimodal inputs, such as voice, gaze, and gesture, these systems enable real-time, hands-free access to digital information, facilitating seamless and efficient interaction. The goal is to support tasks requiring rapid information access in dynamic environments while ensuring users remain”heads-up” and engaged with the real world. This half-day workshop will share research outcomes and best practices, foster community building, and facilitate discussions on key challenges. By bringing together researchers and practitioners, it aims to drive further advancements in both research and practical applications within this rapidly evolving field. © 2025 Copyright held by the owner/author(s)

Original language	English
Title of host publication	CHIIR '25: Proceedings of the 2025 ACM SIGIR Conference on Human Information Interaction and Retrieval
Editors	George Buchanan, Haiming Liu, Dana McKay
Publisher	Association for Computing Machinery
Pages	416-418
ISBN (Print)	9798400712906
DOIs	https://doi.org/10.1145/3698204.3716482
Publication status	Published - Mar 2025
Event	2025 ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2025) - Melbourne, Australia Duration: 24 Mar 2025 → 28 Mar 2025

Publication series

Name	CHIIR - Proceedings of the ACM SIGIR Conference on Human Information Interaction and Retrieval

Conference

Conference	2025 ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2025)
Place	Australia
City	Melbourne
Period	24/03/25 → 28/03/25

Bibliographical note

Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).

Funding

This research activity is partially funded by the AugmentAERO project (Applying AI and AR Technology to the Aerospace Market), supported by Innovate UK (Project No. 10105198).

Research Keywords

Conversational Search
Generative AI
Heads-up Computing
Interactive Information Retrieval
Multimodal Interaction Design
Seeking and Access
User Search Behavior

Access Output

10.1145/3698204.3716482

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

Liu, H., Zhao, S., Wang, S., Hansen, P., Oakley, I., & Le, K.-D. (2025). Designing Interactive Multimodal Information Retrieval and Access for Heads Up Computing (DIMIRA-HUC). In G. Buchanan, H. Liu, & D. McKay (Eds.), CHIIR '25: Proceedings of the 2025 ACM SIGIR Conference on Human Information Interaction and Retrieval (pp. 416-418). (CHIIR - Proceedings of the ACM SIGIR Conference on Human Information Interaction and Retrieval). Association for Computing Machinery. https://doi.org/10.1145/3698204.3716482

Liu, Haiming ; Zhao, Shengdong ; Wang, Silang et al. / Designing Interactive Multimodal Information Retrieval and Access for Heads Up Computing (DIMIRA-HUC). CHIIR '25: Proceedings of the 2025 ACM SIGIR Conference on Human Information Interaction and Retrieval. editor / George Buchanan ; Haiming Liu ; Dana McKay. Association for Computing Machinery, 2025. pp. 416-418 (CHIIR - Proceedings of the ACM SIGIR Conference on Human Information Interaction and Retrieval).

@inproceedings{19105c28ebf945b78da06d98bc3354e1,

title = "Designing Interactive Multimodal Information Retrieval and Access for Heads Up Computing (DIMIRA-HUC)",

abstract = "The advancement of wearable intelligent systems presents a unique opportunity to transform how humans interact with digital content. This workshop explores the design of Interactive Multimodal Information Retrieval and Access systems specifically tailored for Heads-Up Computing environments. By leveraging multimodal inputs, such as voice, gaze, and gesture, these systems enable real-time, hands-free access to digital information, facilitating seamless and efficient interaction. The goal is to support tasks requiring rapid information access in dynamic environments while ensuring users remain”heads-up” and engaged with the real world. This half-day workshop will share research outcomes and best practices, foster community building, and facilitate discussions on key challenges. By bringing together researchers and practitioners, it aims to drive further advancements in both research and practical applications within this rapidly evolving field. {\textcopyright} 2025 Copyright held by the owner/author(s)",

keywords = "Conversational Search, Generative AI, Heads-up Computing, Interactive Information Retrieval, Multimodal Interaction Design, Seeking and Access, User Search Behavior",

author = "Haiming Liu and Shengdong Zhao and Silang Wang and Preben Hansen and Ian Oakley and Khanh-Duy Le",

note = "Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).; 2025 ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2025) ; Conference date: 24-03-2025 Through 28-03-2025",

year = "2025",

month = mar,

doi = "10.1145/3698204.3716482",

language = "English",

isbn = "9798400712906",

series = "CHIIR - Proceedings of the ACM SIGIR Conference on Human Information Interaction and Retrieval",

publisher = "Association for Computing Machinery",

pages = "416--418",

editor = "Buchanan, \{George \} and Haiming Liu and Dana McKay",

booktitle = "CHIIR '25: Proceedings of the 2025 ACM SIGIR Conference on Human Information Interaction and Retrieval",

address = "United States",

}

Liu, H, Zhao, S, Wang, S, Hansen, P, Oakley, I & Le, K-D 2025, Designing Interactive Multimodal Information Retrieval and Access for Heads Up Computing (DIMIRA-HUC). in G Buchanan, H Liu & D McKay (eds), CHIIR '25: Proceedings of the 2025 ACM SIGIR Conference on Human Information Interaction and Retrieval. CHIIR - Proceedings of the ACM SIGIR Conference on Human Information Interaction and Retrieval, Association for Computing Machinery, pp. 416-418, 2025 ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2025), Melbourne, Australia, 24/03/25. https://doi.org/10.1145/3698204.3716482

Designing Interactive Multimodal Information Retrieval and Access for Heads Up Computing (DIMIRA-HUC). / Liu, Haiming; Zhao, Shengdong; Wang, Silang et al.
CHIIR '25: Proceedings of the 2025 ACM SIGIR Conference on Human Information Interaction and Retrieval. ed. / George Buchanan; Haiming Liu; Dana McKay. Association for Computing Machinery, 2025. p. 416-418 (CHIIR - Proceedings of the ACM SIGIR Conference on Human Information Interaction and Retrieval).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - Designing Interactive Multimodal Information Retrieval and Access for Heads Up Computing (DIMIRA-HUC)

AU - Liu, Haiming

AU - Zhao, Shengdong

AU - Wang, Silang

AU - Hansen, Preben

AU - Oakley, Ian

AU - Le, Khanh-Duy

N1 - Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).

PY - 2025/3

Y1 - 2025/3

N2 - The advancement of wearable intelligent systems presents a unique opportunity to transform how humans interact with digital content. This workshop explores the design of Interactive Multimodal Information Retrieval and Access systems specifically tailored for Heads-Up Computing environments. By leveraging multimodal inputs, such as voice, gaze, and gesture, these systems enable real-time, hands-free access to digital information, facilitating seamless and efficient interaction. The goal is to support tasks requiring rapid information access in dynamic environments while ensuring users remain”heads-up” and engaged with the real world. This half-day workshop will share research outcomes and best practices, foster community building, and facilitate discussions on key challenges. By bringing together researchers and practitioners, it aims to drive further advancements in both research and practical applications within this rapidly evolving field. © 2025 Copyright held by the owner/author(s)

AB - The advancement of wearable intelligent systems presents a unique opportunity to transform how humans interact with digital content. This workshop explores the design of Interactive Multimodal Information Retrieval and Access systems specifically tailored for Heads-Up Computing environments. By leveraging multimodal inputs, such as voice, gaze, and gesture, these systems enable real-time, hands-free access to digital information, facilitating seamless and efficient interaction. The goal is to support tasks requiring rapid information access in dynamic environments while ensuring users remain”heads-up” and engaged with the real world. This half-day workshop will share research outcomes and best practices, foster community building, and facilitate discussions on key challenges. By bringing together researchers and practitioners, it aims to drive further advancements in both research and practical applications within this rapidly evolving field. © 2025 Copyright held by the owner/author(s)

KW - Conversational Search

KW - Generative AI

KW - Heads-up Computing

KW - Interactive Information Retrieval

KW - Multimodal Interaction Design

KW - Seeking and Access

KW - User Search Behavior

UR - https://www.scopus.com/pages/publications/105005275034

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-105005275034&origin=recordpage

U2 - 10.1145/3698204.3716482

DO - 10.1145/3698204.3716482

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 9798400712906

T3 - CHIIR - Proceedings of the ACM SIGIR Conference on Human Information Interaction and Retrieval

SP - 416

EP - 418

BT - CHIIR '25: Proceedings of the 2025 ACM SIGIR Conference on Human Information Interaction and Retrieval

A2 - Buchanan, George

A2 - Liu, Haiming

A2 - McKay, Dana

PB - Association for Computing Machinery

T2 - 2025 ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2025)

Y2 - 24 March 2025 through 28 March 2025

ER -

Liu H, Zhao S, Wang S, Hansen P, Oakley I, Le KD. Designing Interactive Multimodal Information Retrieval and Access for Heads Up Computing (DIMIRA-HUC). In Buchanan G, Liu H, McKay D, editors, CHIIR '25: Proceedings of the 2025 ACM SIGIR Conference on Human Information Interaction and Retrieval. Association for Computing Machinery. 2025. p. 416-418. (CHIIR - Proceedings of the ACM SIGIR Conference on Human Information Interaction and Retrieval). doi: 10.1145/3698204.3716482

Designing Interactive Multimodal Information Retrieval and Access for Heads Up Computing (DIMIRA-HUC)

Abstract

Publication series

Conference

Bibliographical note

Funding

Research Keywords

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this