SURFACE CONSISTENT LIGHT FIELD EXTRAPOLATION OVER STRATIFIED DISPARITY AND SPATIAL GRANULARITIES

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)

View graph of relations

Author(s)

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publication2020 IEEE International Conference on Multimedia and Expo (ICME)
PublisherIEEE
ISBN (Electronic)9781728113319
ISBN (Print)9781728113326
Publication statusPublished - Jul 2020

Publication series

NameProceedings - IEEE International Conference on Multimedia and Expo
Volume2020-July
ISSN (Print)1945-7871
ISSN (Electronic)1945-788X

Conference

Title2020 IEEE International Conference on Multimedia and Expo (ICME 2020)
LocationVirtual
PlaceUnited Kingdom
CityLondon
Period6 - 10 July 2020

Abstract

The light field captures both the spatial and angular configurations of the scene, which facilitates a wide range of imaging possibilities. In this work, we propose an LF view extrapolation algorithm which renders high quality novel LF views far outside the range of given angular baselines. A stratified synthesis strategy is adopted which projects the scene content based on stratified disparity layers and across varying scales of spatial granularities. Such a stratified methodology proves to help preserve scene structures over large angular shifts, and provide informative clues for inferring the contents of occluded regions. A generative-adversarial network model is further adopted for parallax correction and occlusion completion conditioned on surface consistent feature. Experiments show that our proposed model can provide more reliable novel view extrapolation quality at large baseline extension ratios compared with state-of-the-art LF synthesis algorithms.

Research Area(s)

  • Light field, angular extrapolation, GAN, inpainting

Bibliographic Note

Research Unit(s) information for this publication is provided by the author(s) concerned.

Citation Format(s)

SURFACE CONSISTENT LIGHT FIELD EXTRAPOLATION OVER STRATIFIED DISPARITY AND SPATIAL GRANULARITIES. / Chen, Jie; Chau, Lap-Pui; Hou, Junhui.

2020 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 2020. 9102806 (Proceedings - IEEE International Conference on Multimedia and Expo; Vol. 2020-July).

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)