Mobi3DSketch: 3D Sketching in Mobile AR

Kin Chung Kwan; Hongbo Fu

doi:10.1145/3290605.3300406

Mobi3DSketch: 3D Sketching in Mobile AR

Kin Chung Kwan, Hongbo Fu

School of Creative Media

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

81 Citations (Scopus)

426 Downloads (CityUHK Scholars)

Abstract

Mid-air 3D sketching has been mainly explored in Virtual Reality (VR) and typically requires special hardware for motion capture and immersive, stereoscopic displays. The recently developed motion tracking algorithms allow real-time tracking of mobile devices, and have enabled a few mobile applications for 3D sketching in Augmented Reality (AR). However, they are more suitable for making simple drawings only, since they do not consider special challenges with mobile AR 3D sketching, including the lack of stereo display, narrow field of view, and the coupling of 2D input, 3D input and display. To address these issues, we present Mobi3DSketch, which integrates multiple sources of inputs with tools, mainly different versions of 3D snapping and planar/curves surface proxies. Our multimodal interface supports both absolute and relative drawing, allowing easy creation of 3D concept designs in situ. The effectiveness and expressiveness of Mobi3DSketch are demonstrated via a pilot study.

Original language	English
Title of host publication	CHI 2019 - Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
Publisher	Association for Computing Machinery
ISBN (Print)	9781450359702
DOIs	https://doi.org/10.1145/3290605.3300406
Publication status	Published - May 2019
Event	2019 CHI Conference on Human Factors in Computing Systems (CHI 2019) - Glasgow, United Kingdom Duration: 4 May 2019 → 9 May 2019

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	2019 CHI Conference on Human Factors in Computing Systems (CHI 2019)
Place	United Kingdom
City	Glasgow
Period	4/05/19 → 9/05/19

Research Keywords

3D concept design
3D sketching
Augmented reality
Mid-air drawing
Mobile interaction
Relative drawing

Publisher's Copyright Statement

COPYRIGHT TERMS OF DEPOSITED POSTPRINT FILE: © ACM 2019. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in CHI 2019 - Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, http://dx.doi.org/10.1145/3290605.3300406.

Access Output

10.1145/3290605.3300406

Postprint.pdfPost-print, 9.15 MBLicence: Unspecified

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

@inproceedings{d60648d2b23b43d7ae5617210993eb00,

title = "Mobi3DSketch: 3D Sketching in Mobile AR",

abstract = "Mid-air 3D sketching has been mainly explored in Virtual Reality (VR) and typically requires special hardware for motion capture and immersive, stereoscopic displays. The recently developed motion tracking algorithms allow real-time tracking of mobile devices, and have enabled a few mobile applications for 3D sketching in Augmented Reality (AR). However, they are more suitable for making simple drawings only, since they do not consider special challenges with mobile AR 3D sketching, including the lack of stereo display, narrow field of view, and the coupling of 2D input, 3D input and display. To address these issues, we present Mobi3DSketch, which integrates multiple sources of inputs with tools, mainly different versions of 3D snapping and planar/curves surface proxies. Our multimodal interface supports both absolute and relative drawing, allowing easy creation of 3D concept designs in situ. The effectiveness and expressiveness of Mobi3DSketch are demonstrated via a pilot study.",

keywords = "3D concept design, 3D sketching, Augmented reality, Mid-air drawing, Mobile interaction, Relative drawing",

author = "Kwan, {Kin Chung} and Hongbo Fu",

year = "2019",

month = may,

doi = "10.1145/3290605.3300406",

language = "English",

isbn = "9781450359702",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery",

booktitle = "CHI 2019 - Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems",

address = "United States",

note = "2019 CHI Conference on Human Factors in Computing Systems (CHI 2019) ; Conference date: 04-05-2019 Through 09-05-2019",

}

Kwan, KC & Fu, H 2019, Mobi3DSketch: 3D Sketching in Mobile AR. in CHI 2019 - Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems., 176, Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery, 2019 CHI Conference on Human Factors in Computing Systems (CHI 2019), Glasgow, United Kingdom, 4/05/19. https://doi.org/10.1145/3290605.3300406

Mobi3DSketch: 3D Sketching in Mobile AR. / Kwan, Kin Chung; Fu, Hongbo.
CHI 2019 - Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, 2019. 176 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - Mobi3DSketch

T2 - 2019 CHI Conference on Human Factors in Computing Systems (CHI 2019)

AU - Kwan, Kin Chung

AU - Fu, Hongbo

PY - 2019/5

Y1 - 2019/5

N2 - Mid-air 3D sketching has been mainly explored in Virtual Reality (VR) and typically requires special hardware for motion capture and immersive, stereoscopic displays. The recently developed motion tracking algorithms allow real-time tracking of mobile devices, and have enabled a few mobile applications for 3D sketching in Augmented Reality (AR). However, they are more suitable for making simple drawings only, since they do not consider special challenges with mobile AR 3D sketching, including the lack of stereo display, narrow field of view, and the coupling of 2D input, 3D input and display. To address these issues, we present Mobi3DSketch, which integrates multiple sources of inputs with tools, mainly different versions of 3D snapping and planar/curves surface proxies. Our multimodal interface supports both absolute and relative drawing, allowing easy creation of 3D concept designs in situ. The effectiveness and expressiveness of Mobi3DSketch are demonstrated via a pilot study.

AB - Mid-air 3D sketching has been mainly explored in Virtual Reality (VR) and typically requires special hardware for motion capture and immersive, stereoscopic displays. The recently developed motion tracking algorithms allow real-time tracking of mobile devices, and have enabled a few mobile applications for 3D sketching in Augmented Reality (AR). However, they are more suitable for making simple drawings only, since they do not consider special challenges with mobile AR 3D sketching, including the lack of stereo display, narrow field of view, and the coupling of 2D input, 3D input and display. To address these issues, we present Mobi3DSketch, which integrates multiple sources of inputs with tools, mainly different versions of 3D snapping and planar/curves surface proxies. Our multimodal interface supports both absolute and relative drawing, allowing easy creation of 3D concept designs in situ. The effectiveness and expressiveness of Mobi3DSketch are demonstrated via a pilot study.

KW - 3D concept design

KW - 3D sketching

KW - Augmented reality

KW - Mid-air drawing

KW - Mobile interaction

KW - Relative drawing

UR - http://www.scopus.com/inward/record.url?scp=85067618236&partnerID=8YFLogxK

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85067618236&origin=recordpage

U2 - 10.1145/3290605.3300406

DO - 10.1145/3290605.3300406

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 9781450359702

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI 2019 - Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

Y2 - 4 May 2019 through 9 May 2019

ER -

Mobi3DSketch: 3D Sketching in Mobile AR

Abstract

Publication series

Conference

Research Keywords

Publisher's Copyright Statement

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

GRF: Support-driven Shape Analysis

Cite this

Mobi3DSketch: 3D Sketching in Mobile AR

Abstract

Publication series

Conference

Research Keywords

Publisher's Copyright Statement

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Projects

GRF: Support-driven Shape Analysis

Cite this