SweepCanvas: Sketch-based 3D Prototyping on an RGB-D Image

Yuwei  Li; Xi Luo; Youyi Zheng; Pengfei Xu; Hongbo Fu

doi:10.1145/3126594.3126611

SweepCanvas: Sketch-based 3D Prototyping on an RGB-D Image

Yuwei Li, Xi Luo, Youyi Zheng^*, Pengfei Xu, Hongbo Fu

^*Corresponding author for this work

School of Creative Media

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

37 Citations (Scopus)

187 Downloads (CityUHK Scholars)

Abstract

The creation of 3D contents still remains one of the most crucial problems for the emerging applications such as 3D printing and Augmented Reality. In Augmented Reality, how to create virtual contents that seamlessly overlay with the real environment is a key problem for human-computer interaction and many subsequent applications. In this paper, we present a sketch-based interactive tool, which we term Sweep-Canvas, for rapid exploratory 3D modeling on top of an RGB-D image. Our aim is to offer end-users a simple yet efficient way to quickly create 3D models on an image. We develop a novel sketch-based modeling interface, which takes a pair of user strokes as input and instantly generates a curved 3D surface by sweeping one stroke along the other. A key enabler of our system is an optimization procedure that extracts pairs of spatial planes from the context to position and sweep the strokes. We demonstrate the effectiveness and power of our modeling system on various RGB-D data sets and validate the use cases via a pilot study.

Original language	English
Title of host publication	UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
Publisher	Association for Computing Machinery
Pages	387-399
ISBN (Electronic)	9781450349819
DOIs	https://doi.org/10.1145/3126594.3126611
Publication status	Published - 20 Oct 2017
Event	UIST 2017 : 30th ACM User Interface Software and Technology Symposium - Quebec City, Canda, Quebec City, Canada Duration: 22 Oct 2017 → 25 Oct 2017 https://uist.acm.org/uist2017/

Conference

Conference	UIST 2017
Place	Canada
City	Quebec City
Period	22/10/17 → 25/10/17
Internet address	https://uist.acm.org/uist2017/

Bibliographical note

Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).

Research Keywords

Sketch-based modeling
modeling in context
swept surfaces

Publisher's Copyright Statement

COPYRIGHT TERMS OF DEPOSITED POSTPRINT FILE: © Li, Y., Luo, X., Zheng, Y., Xu, P., & FU, H | ACM 2017. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in UIST '17 Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, http://dx.doi.org/10.1145/3126594.3126611

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access Output

10.1145/3126594.3126611

Post-print.pdfPost-print, 44.5 MBLicence: Unspecified

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

@inproceedings{110e606732f44b3ea19ead4c34fdba6a,

title = "SweepCanvas: Sketch-based 3D Prototyping on an RGB-D Image",

abstract = "The creation of 3D contents still remains one of the most crucial problems for the emerging applications such as 3D printing and Augmented Reality. In Augmented Reality, how to create virtual contents that seamlessly overlay with the real environment is a key problem for human-computer interaction and many subsequent applications. In this paper, we present a sketch-based interactive tool, which we term Sweep-Canvas, for rapid exploratory 3D modeling on top of an RGB-D image. Our aim is to offer end-users a simple yet efficient way to quickly create 3D models on an image. We develop a novel sketch-based modeling interface, which takes a pair of user strokes as input and instantly generates a curved 3D surface by sweeping one stroke along the other. A key enabler of our system is an optimization procedure that extracts pairs of spatial planes from the context to position and sweep the strokes. We demonstrate the effectiveness and power of our modeling system on various RGB-D data sets and validate the use cases via a pilot study.",

keywords = "Sketch-based modeling, modeling in context, swept surfaces",

author = "Yuwei Li and Xi Luo and Youyi Zheng and Pengfei Xu and Hongbo Fu",

note = "Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).; UIST 2017 : 30th ACM User Interface Software and Technology Symposium ; Conference date: 22-10-2017 Through 25-10-2017",

year = "2017",

month = oct,

day = "20",

doi = "10.1145/3126594.3126611",

language = "English",

pages = "387--399",

booktitle = "UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology",

publisher = "Association for Computing Machinery",

address = "United States",

url = "https://uist.acm.org/uist2017/",

}

SweepCanvas: Sketch-based 3D Prototyping on an RGB-D Image. / Li, Yuwei ; Luo, Xi; Zheng, Youyi et al.
UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, 2017. p. 387-399.

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - SweepCanvas

T2 - UIST 2017

AU - Li, Yuwei

AU - Luo, Xi

AU - Zheng, Youyi

AU - Xu, Pengfei

AU - Fu, Hongbo

N1 - Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).

PY - 2017/10/20

Y1 - 2017/10/20

N2 - The creation of 3D contents still remains one of the most crucial problems for the emerging applications such as 3D printing and Augmented Reality. In Augmented Reality, how to create virtual contents that seamlessly overlay with the real environment is a key problem for human-computer interaction and many subsequent applications. In this paper, we present a sketch-based interactive tool, which we term Sweep-Canvas, for rapid exploratory 3D modeling on top of an RGB-D image. Our aim is to offer end-users a simple yet efficient way to quickly create 3D models on an image. We develop a novel sketch-based modeling interface, which takes a pair of user strokes as input and instantly generates a curved 3D surface by sweeping one stroke along the other. A key enabler of our system is an optimization procedure that extracts pairs of spatial planes from the context to position and sweep the strokes. We demonstrate the effectiveness and power of our modeling system on various RGB-D data sets and validate the use cases via a pilot study.

AB - The creation of 3D contents still remains one of the most crucial problems for the emerging applications such as 3D printing and Augmented Reality. In Augmented Reality, how to create virtual contents that seamlessly overlay with the real environment is a key problem for human-computer interaction and many subsequent applications. In this paper, we present a sketch-based interactive tool, which we term Sweep-Canvas, for rapid exploratory 3D modeling on top of an RGB-D image. Our aim is to offer end-users a simple yet efficient way to quickly create 3D models on an image. We develop a novel sketch-based modeling interface, which takes a pair of user strokes as input and instantly generates a curved 3D surface by sweeping one stroke along the other. A key enabler of our system is an optimization procedure that extracts pairs of spatial planes from the context to position and sweep the strokes. We demonstrate the effectiveness and power of our modeling system on various RGB-D data sets and validate the use cases via a pilot study.

KW - Sketch-based modeling

KW - modeling in context

KW - swept surfaces

UR - https://www.scopus.com/record/display.uri?eid=2-s2.0-85041513444&origin=inward&txGid=0cd61f35f59d9cca68c06d26d0eba4c1

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85041513444&origin=recordpage

U2 - 10.1145/3126594.3126611

DO - 10.1145/3126594.3126611

M3 - RGC 32 - Refereed conference paper (with host publication)

SP - 387

EP - 399

BT - UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

PB - Association for Computing Machinery

Y2 - 22 October 2017 through 25 October 2017

ER -

SweepCanvas: Sketch-based 3D Prototyping on an RGB-D Image

Abstract

Conference

Bibliographical note

Research Keywords

Publisher's Copyright Statement

UN SDGs

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

GRF: Support-driven Shape Analysis

GRF: Data-Driven 3D Interpretation of Freehand Drawings

GRF: A Part Assembly Framework for Recovering 3D Geometry and Structure of Everyday Objects

Cite this

SweepCanvas: Sketch-based 3D Prototyping on an RGB-D Image

Abstract

Conference

Bibliographical note

Research Keywords

Publisher's Copyright Statement

UN SDGs

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Projects

GRF: Support-driven Shape Analysis

GRF: Data-Driven 3D Interpretation of Freehand Drawings

GRF: A Part Assembly Framework for Recovering 3D Geometry and Structure of Everyday Objects

Cite this