Light Field Depth Estimation via Stitched Epipolar Plane Images

Ping Zhou*, Langqing Shi, Xiaoyang Liu, Jing Jin, Yuting Zhang, Junhui Hou*

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

17 Citations (Scopus)

Abstract

Depth estimation is a fundamental problem in light field processing. Epipolar-plane image (EPI)-based methods often encounter challenges such as low accuracy in slope computation due to discretization errors and limited angular resolution. Besides, existing methods perform well in most regions but struggle to produce sharp edges in occluded regions and resolve ambiguities in texture-less regions. To address these issues, we propose the concept of stitched-EPI (SEPI) to enhance slope computation. SEPI achieves this by shifting and concatenating lines from different EPIs that correspond to the same 3D point. Moreover, we introduce the half-SEPI algorithm, which focuses exclusively on the non-occluded portion of lines to handle occlusion. Additionally, we present a depth propagation strategy aimed at improving depth estimation in texture-less regions. This strategy involves determining the depth of such regions by progressing from the edges towards the interior, prioritizing accurate regions over coarse regions. Through extensive experimental evaluations and ablation studies, we validate the effectiveness of our proposed method. The results demonstrate its superior ability to generate more accurate and robust depth maps across all regions compared to state-of-the-art methods. © 2023 IEEE.
Original languageEnglish
Pages (from-to)6866-6879
JournalIEEE Transactions on Visualization and Computer Graphics
Volume30
Issue number10
Online published19 Dec 2023
DOIs
Publication statusPublished - Oct 2024

Bibliographical note

Research Unit(s) information for this publication is provided by the author(s) concerned.

Funding

This work was supported in part by the National Natural Science Foundation of China under Grants 52071075 and 11572087, in part by the Hong Kong Research Grants Council under Grant 11218121, and in part by Hong Kong Innovation and Technology Fund under Grant MHP/117/21.

Research Keywords

  • Light Field
  • Depth Estimation
  • Stitched-EPI
  • Occlusion
  • Texture-less Region

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'Light Field Depth Estimation via Stitched Epipolar Plane Images'. Together they form a unique fingerprint.

Cite this