Skip to main navigation Skip to search Skip to main content

Unsupervised 3D Point Cloud Completion via Multi-view Adversarial Learning

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

In real-world scenarios, scanned point clouds are often incomplete due to occlusion issues. The tasks of self-supervised and weakly-supervised point cloud completion involve reconstructing missing regions of these incomplete objects without the supervision of complete ground truth. Current methods either rely on multiple views of partial observations for supervision or overlook the intrinsic geometric similarity that can be identified and utilized from the given partial point clouds. In this paper, we propose MAL-UPC, a framework that effectively leverages both region-level and category-specific geometric similarities to complete missing structures. Our MAL-UPC does not require any 3D complete supervision and only necessitates single-view partial observations in the training set. Specifically, we first introduce a Pattern Retrieval Network to retrieve similar position and curvature patterns between the partial input and the predicted shape, then leverage these similarities to densify and refine the reconstructed results. Additionally, we render the reconstructed complete shape into multi-view depth maps and design an adversarial learning module to learn the geometry of the target shape from category-specific single-view depth images of the partial point clouds in the training set. To achieve anisotropic rendering, we design a density-aware radius estimation algorithm to improve the quality of the rendered images. Our MAL-UPC outperforms current state-of-the-art self-supervised methods and even some unpaired approaches. © 2025 IEEE.
Original languageEnglish
Pages (from-to)7890 - 7905
JournalIEEE Transactions on Visualization and Computer Graphics
Volume31
Issue number10
Online published9 Apr 2025
DOIs
Publication statusPublished - Oct 2025

Funding

This project was supported in part by the NSFC Excellent Young Scientists Fund 62422118, in part by the Hong Kong Research Grants Council under Grant 11219422, Grant 11202320, and Grant 11218121, and in part by the Shenzhen Science and Technology Program under Grant KJZD20230923114600002.

Research Keywords

  • Point cloud completion
  • shape completion
  • unsupervised learning
  • generative adversarial learning

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'Unsupervised 3D Point Cloud Completion via Multi-view Adversarial Learning'. Together they form a unique fingerprint.

Cite this