Generated realistic noise and rotation-equivariant models for data-driven mesh denoising

Sipeng Yang, Wenhui Ren, Xiwen Zeng, Qingchuan Zhu, Hongbo Fu, Kaijun Fan, Lei Yang, Jingping Yu, Qilong Kou, Xiaogang Jin*

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

3D mesh denoising is a crucial pre-processing step in many graphics applications. However, existing data-driven mesh denoising models, primarily trained on synthetic white noise, are less effective when applied to real-world meshes with the noise of complex intensities and distributions. Moreover, how to comprehensively capture information from input meshes and apply suitable denoising models for feature-preserving mesh denoising remains a critical and unresolved challenge. This paper presents a rotation-Equivariant model-based Mesh Denoising (EMD) model and a Realistic Mesh Noise Generation (RMNG) model to address these issues. Our EMD model leverages rotation-equivariant features and self-attention weights of geodesic patches for more effective feature extraction, thereby achieving SOTA denoising results. The RMNG model, based on the Generative Adversarial Networks (GANs) architecture, generates massive amounts of realistic noisy and noiseless mesh pairs data for data-driven mesh denoising model training, significantly benefiting real-world denoising tasks. To address the smooth degradation and loss of sharp edges commonly observed in captured meshes, we further introduce varying levels of Laplacian smoothing to input meshes during the paired training data generation, endowing the trained denoising model with feature recovery capabilities. Experimental results demonstrate the superior performance of our proposed method in preserving fine-grained features while removing noise on real-world captured meshes. © 2024 Elsevier B.V.
Original languageEnglish
Article number102306
JournalComputer Aided Geometric Design
Volume111
Online published25 Apr 2024
DOIs
Publication statusPublished - Jun 2024

Research Keywords

  • Equivariant models
  • Mesh denoising
  • Realistic noise generation

Fingerprint

Dive into the research topics of 'Generated realistic noise and rotation-equivariant models for data-driven mesh denoising'. Together they form a unique fingerprint.

Cite this