Heads-Up Computing : Opportunities and Challenges of the Next Interaction Paradigm with Wearable Intelligent Assistants

Modern smartglasses, such as Apple's Vision Pro and Meta's Quest series, feature high-end displays and rich multi-modal sensing. They are on the brink of redefining the concept of wearable intelligent assistants. However, despite this unfolding technological revolution, there is much we do not know about how to design for such devices and, ultimately, how they will be used. Heads-Up Computing is vision for wearable displays that focuses on how they can enrich human interaction without being obtrusive, on how they can be designed to be both ergonomic and intuitive, and how the interactions that drive them can be aware of, and respond to, a user's context and resources. Achieving this vision of seamless integration presents numerous challenges in areas as diverse as providing non-intrusive support, adapting to diverse contexts, enabling expressive input and safeguarding privacy. This workshop aims to convene domain experts to deliberate on these nascent issues and set a collaborative research agenda that prioritizes user-centered design in the ongoing development of Heads-up Computing and seeks to impact the next generation of wearable intelligent assistants. © 2024 Copyright held by the owner/author(s).