Skip to main navigation Skip to search Skip to main content

ProInterAR: A Visual Programming Platform for Creating Immersive AR Interactions

  • Hui Ye (Co-first Author)
  • , Jiaye Leng (Co-first Author)
  • , Pengfei Xu
  • , Karan Singh
  • , Hongbo Fu*
  • *Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

AR applications commonly contain diverse interactions among different AR contents. Creating such applications requires creators to have advanced programming skills for scripting interactive behaviors of AR contents, repeated transferring and adjustment of virtual contents from virtual to physical scenes, testing by traversing between desktop interfaces and target AR scenes, and digitalizing AR contents. Existing immersive tools for prototyping/authoring such interactions are tailored for domain-specific applications. To support programming general interactive behaviors of real object(s)/environment(s) and virtual object(s)/environment(s) for novice AR creators, we propose ProInterAR, an integrated visual programming platform to create immersive AR applications with a tablet and an AR-HMD. Users can construct interaction scenes by creating virtual contents and augmenting real contents from the view of an AR-HMD, script interactive behaviors by stacking blocks from a tablet UI, and then execute and control the interactions in the AR scene. We showcase a wide range of AR application scenarios enabled by ProInterAR, including AR game, AR teaching, sequential animation, AR information visualization, etc. Two usability studies validate that novice AR creators can easily program various desired AR applications using ProInterAR. © 2024 The owner/author(s). 
Original languageEnglish
Title of host publicationCHI'24: Proceedings of the CHI Conference on Human Factors in Computing Systems
EditorsFlorian ‘Floyd’ Mueller, Penny Kyburz, Julie R. Williamson, Corina Sas, Max L. Wilson, Phoebe Toups Dugas, Irina Shklovski
Place of PublicationNewYork, NY
PublisherAssociation for Computing Machinery
ISBN (Print)979-8-4007-0330-0
DOIs
Publication statusPublished - 2024
Event2024 ACM CHI Conference on Human Factors in Computing Systems (CHI 2024): Surfing the World - Hybrid, Honolulu, United States
Duration: 11 May 202416 May 2024
https://chi2024.acm.org/

Conference

Conference2024 ACM CHI Conference on Human Factors in Computing Systems (CHI 2024)
Abbreviated titleCHI '24
PlaceUnited States
CityHonolulu
Period11/05/2416/05/24
Internet address

Funding

We thank the anonymous reviewers for their constructive comments and the user study participants for their time. This work was supported by grants from the Innovation and Technology Commission (No. ITS/106/22), the City University of Hong Kong (Project No. 9667260, 7005729, 9667234), NSFC (62072316), and NSF of Guangdong Province (2023A1515011297).

Research Keywords

  • AR contents
  • AR interactions
  • Visual programming

Fingerprint

Dive into the research topics of 'ProInterAR: A Visual Programming Platform for Creating Immersive AR Interactions'. Together they form a unique fingerprint.

Cite this