Light Field Spatial Super-resolution via CNN Guided by A Single High-resolution RGB Image
Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Title of host publication | 2018 IEEE 23rd International Conference on Digital Signal Processing (DSP) |
Publisher | Institute of Electrical and Electronics Engineers, Inc. |
ISBN (electronic) | 9781538668115 |
ISBN (print) | 9781538668122 |
Publication status | Published - Nov 2018 |
Publication series
Name | International Conference on Digital Signal Processing, DSP |
---|---|
Volume | 2018-November |
ISSN (Print) | 1546-1874 |
ISSN (electronic) | 2165-3577 |
Conference
Title | 23rd IEEE International Conference on Digital Signal Processing (DSP 2018) |
---|---|
Location | ShanghaiTech University |
Place | China |
City | Shanghai |
Period | 19 - 21 November 2018 |
Link(s)
Abstract
Light field (LF) has proven to be promising in immersive representation of the real world. However, a major limitation of micro-lens array based LF camera is the low spatial resolution, due to the inherent trade-off between angular and spatial dimensions. In this paper, we propose a framework to show that a single high-resolution (HR) RGB image effectively improves the performance of LF spatial super-resolution. We adopt an end-to-end convolutional neural network, which takes a low-resolution (LR) light field image (LFI) and a single HR center view as inputs. The LFI provides the information about LF structure in angular domain, while the HR center view provides more details in spatial domain. Experimental results on 57 test LFIs with various challenging natural scenes demonstrate that our algorithm outperforms current state-of-the-art methods.
Research Area(s)
- deep learning, Light field, super-resolution
Citation Format(s)
Light Field Spatial Super-resolution via CNN Guided by A Single High-resolution RGB Image. / Jin, Jing; Hou, Junhui; Chen, Jie et al.
2018 IEEE 23rd International Conference on Digital Signal Processing (DSP). Institute of Electrical and Electronics Engineers, Inc., 2018. 8631859 (International Conference on Digital Signal Processing, DSP; Vol. 2018-November).
2018 IEEE 23rd International Conference on Digital Signal Processing (DSP). Institute of Electrical and Electronics Engineers, Inc., 2018. 8631859 (International Conference on Digital Signal Processing, DSP; Vol. 2018-November).
Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review