Sketch2Stress: Sketching with Structural Stress Awareness

Deng Yu, Chufeng Xiao, Manfred Lau*, Hongbo Fu*

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

2 Citations (Scopus)
69 Downloads (CityUHK Scholars)

Abstract

In the process of product design and digital fabrication, the structural analysis of a designed prototype is a fundamental and essential step. However, such a step is usually invisible or inaccessible to designers at the early sketching phase. This limits the user's ability to consider a shape's physical properties and structural soundness. To bridge this gap, we introduce a novel approach Sketch2Stress that allows users to perform structural analysis of desired objects at the sketching stage. This method takes as input a 2D freehand sketch and one or multiple locations of user-assigned external forces. With the specially-designed two-branch generative-adversarial framework, it automatically predicts a normal map and a corresponding structural stress map distributed over the user-sketched underlying object. In this way, our method empowers designers to easily examine the stress sustained everywhere and identify potential problematic regions of their sketched object. Furthermore, combined with the predicted normal map, users are able to conduct a region- wise structural analysis efficiently by aggregating the stress effects of multiple forces in the same direction. Finally, we demonstrate the effectiveness and practicality of our system with extensive experiments and user studies. © 2023 IEEE.
Original languageEnglish
Pages (from-to)6851-6865
JournalIEEE Transactions on Visualization and Computer Graphics
Volume30
Issue number10
Online published13 Dec 2023
DOIs
Publication statusPublished - Oct 2024

Funding

We thank the anonymous reviewers for their constructive comments. This work was partially supported by grants from the Research Grants Council of the Hong Kong Special Administrative Region, China (No. CityU 11212119, 11206319, and 11205420) and the Centre for Applied Computing and Interactive Media (ACIM) of the School of Creative Media, CityU.

Research Keywords

  • sketching
  • sketch-based image synthesis
  • digital fabrication

Publisher's Copyright Statement

  • COPYRIGHT TERMS OF DEPOSITED POSTPRINT FILE: Yu, D., Xiao, C., Lau, M., & Fu, H. (2023). Sketch2Stress: Sketching with Structural Stress Awareness. IEEE Transactions on Visualization and Computer Graphics. Advance online publication. https://doi.org/10.1109/TVCG.2023.3342119

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'Sketch2Stress: Sketching with Structural Stress Awareness'. Together they form a unique fingerprint.

Cite this