Noise-Resilient Reconstruction of Panoramas and 3D Scenes Using Robot-Mounted Unsynchronized Commodity RGB-D Cameras

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

1 Scopus Citations
View graph of relations

Author(s)

  • Sheng YANG
  • Beichen LI
  • Yan-Pei CAO
  • Yu-Kun LAI
  • Leif KOBBELT
  • Shi-Min HU

Related Research Unit(s)

Detail(s)

Original languageEnglish
Article number152
Journal / PublicationACM Transactions on Graphics
Volume39
Issue number5
Online publishedJul 2020
Publication statusPublished - Sep 2020

Abstract

We present a two-stage approach to first constructing 3D panoramas and then stitching them for noise-resilient reconstruction of large-scale indoor scenes. Our approach requires multiple unsynchronized RGB-D cameras, mounted on a robot platform, which can perform in-place rotations at different locations in a scene. Such cameras rotate on a common (but unknown) axis, which provides a novel perspective for coping with unsynchronized cameras, without requiring sufficient overlap of their Field-of-View (FoV). Based on this key observation, we propose novel algorithms to track these cameras simultaneously. Furthermore, during the integration of raw frames onto an equirectangular panorama, we derive uncertainty estimates from multiple measurements assigned to the same pixels. This enables us to appropriately model the sensing noise and consider its influence, so as to achieve better noise resilience, and improve the geometric quality of each panorama and the accuracy of global inter-panorama registration. We evaluate and demonstrate the performance of our proposed method for enhancing the geometric quality of scene reconstruction from both real-world and synthetic scans.

Research Area(s)

  • Panorama, reconstruction, robotics, SLAM

Citation Format(s)

Noise-Resilient Reconstruction of Panoramas and 3D Scenes Using Robot-Mounted Unsynchronized Commodity RGB-D Cameras. / YANG, Sheng; LI, Beichen; CAO, Yan-Pei; FU, Hongbo; LAI, Yu-Kun; KOBBELT, Leif; HU, Shi-Min.

In: ACM Transactions on Graphics, Vol. 39, No. 5, 152, 09.2020.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review