TY - GEN
T1 - Light Field Compression via a Variational Graph Auto-Encoder
AU - TENG, Wenjun
AU - LI, Yong
AU - KWONG, Sam
PY - 2021/12
Y1 - 2021/12
N2 - Massive light field (LF) data bring tremendous storage and transmission challenges, making the LF compression scheme highly demanded. This paper proposes a novel LF compression method via a variational graph auto-encoder (VGAE), aiming to exploit better the structural information of edges and vertices of the graph LF image. More specifically, the graph adjacency ma-trix and feature matrix are derived from the original graph data in the encoder. Subsequently, a graph convolutional network (GCN) is utilized to determine a multi-dimensional Gaussian distribution, from which the latent representation can be derived by sampling. Finally, the graph LF image can be reconstructed by the inner product of the latent variable in the decoder. The distinct charac-teristics of the proposed scheme lie in that VGAE encoder applies GCN as a function, which can better alleviate the loss of compression. Moreover, the divergence between the original and the reconstructed signals is evaluated using KL divergence to ensure that the estimator is unbiased, leading to better adaptability. The ex-perimental results demonstrate that the proposed method achieves better performance than the state-of-the-art methods.
AB - Massive light field (LF) data bring tremendous storage and transmission challenges, making the LF compression scheme highly demanded. This paper proposes a novel LF compression method via a variational graph auto-encoder (VGAE), aiming to exploit better the structural information of edges and vertices of the graph LF image. More specifically, the graph adjacency ma-trix and feature matrix are derived from the original graph data in the encoder. Subsequently, a graph convolutional network (GCN) is utilized to determine a multi-dimensional Gaussian distribution, from which the latent representation can be derived by sampling. Finally, the graph LF image can be reconstructed by the inner product of the latent variable in the decoder. The distinct charac-teristics of the proposed scheme lie in that VGAE encoder applies GCN as a function, which can better alleviate the loss of compression. Moreover, the divergence between the original and the reconstructed signals is evaluated using KL divergence to ensure that the estimator is unbiased, leading to better adaptability. The ex-perimental results demonstrate that the proposed method achieves better performance than the state-of-the-art methods.
KW - Graph convolutional network
KW - Light field compression
KW - Variational graph auto-encoder
UR - http://www.scopus.com/inward/record.url?scp=85127563978&partnerID=8YFLogxK
UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85127563978&origin=recordpage
U2 - 10.1109/ICWAPR54887.2021.9736152
DO - 10.1109/ICWAPR54887.2021.9736152
M3 - RGC 32 - Refereed conference paper (with host publication)
SN - 978-1-6654-6612-7
T3 - International Conference on Wavelet Analysis and Pattern Recognition
BT - Proceedings of 2021 International Conference on Wavelet Analysis and Pattern Recognition
PB - IEEE
T2 - 18th International Conference on Wavelet Analysis and Pattern Recognition (ICWAPR 2021)
Y2 - 4 December 2021 through 5 December 2021
ER -