Depth map misalignment correction and dilation for DIBR view synthesis

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalNot applicablepeer-review

20 Scopus Citations
View graph of relations

Author(s)

  • Xuyuan Xu
  • Ka-Ho Ng
  • Litong Feng
  • Kwok-Wai Cheung
  • Chun-Ho Cheung
  • Chi-Wang Ting

Detail(s)

Original languageEnglish
Pages (from-to)1023-1045
Journal / PublicationSignal Processing: Image Communication
Volume28
Issue number9
Early online date22 Apr 2013
Publication statusPublished - Oct 2013

Abstract

The quality of the synthesized views by Depth Image Based Rendering (DIBR) highly depends on the accuracy of the depth map, especially the alignment of object boundaries of texture image. In practice, the misalignment of sharp depth map edges is the major cause of the annoying artifacts at the disoccluded regions of the synthesized views. Conventional smooth filter approach blurs the depth map to reduce the disoccluded regions. The drawbacks are the degradation of 3D perception of the reconstructed 3D videos and the destruction of the texture in background regions. Conventional edge preserving filter utilizes the color image information in order to align the depth edges with color edges. Unfortunately, the characteristics of color edges and depth edges are very different which causes annoying boundaries artifacts in the synthesized virtual views. Recent solution of reliability-based approach uses reliable warping information from other views to fill the holes. However, it is not suitable for the view synthesis in video-plus-depth based DIBR applications. In this paper, a new depth map preprocessing approach is proposed. It utilizes Watershed color segmentation method to correct the depth map misalignment and then the depth map object boundaries are extended to cover the transitional edge regions of color image. This approach can handle the sharp depth map edges lying inside or outside the object boundaries in 2D sense. The quality of the disoccluded regions of the synthesized views can be significantly improved and unknown depth values can also be estimated. Experimental results show that the proposed method achieves superior performance for view synthesis by DIBR especially for generating large baseline virtual views. © 2013 Elsevier B.V. All rights reserved.

Research Area(s)

  • Depth Image Based Rendering, Depth map, DIBR, Dilation, Misalignment correction, View synthesis

Citation Format(s)

Depth map misalignment correction and dilation for DIBR view synthesis. / Xu, Xuyuan; Po, Lai-Man; Ng, Ka-Ho; Feng, Litong; Cheung, Kwok-Wai; Cheung, Chun-Ho; Ting, Chi-Wang.

In: Signal Processing: Image Communication, Vol. 28, No. 9, 10.2013, p. 1023-1045.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalNot applicablepeer-review