The plenoptic illumination function

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

34 Scopus Citations
View graph of relations


Related Research Unit(s)


Original languageEnglish
Pages (from-to)361-371
Journal / PublicationIEEE Transactions on Multimedia
Issue number3
Publication statusPublished - Sep 2002


Image-based modeling and rendering has been demonstrated as a cost-effective and efficient approach to virtual reality applications. The computational model that most image-based techniques are based on is the plenoptic function. Since the original formulation of the plenoptic function does not include illumination, most previous image-based virtual reality applications simply assume that the illumination is fixed. In this paper, we propose a new formulation of the plenoptic function, called the plenoptic illumination function, which explicitly specifies the illumination component. Techniques based on this new formulation can be extended to support relighting as well as view interpolation. To relight images with various illumination configurations, we also propose a local illumination model, which utilizes the rules of image superposition. We demonstrate how this new formulation can be applied to extend two existing image-based representations, panorama representation such as QuickTime VR and two-plane parametrization (light field and lumigraph), to support relighting with trivial modifications. The core of this framework is compression, and we therefore show how to exploit two types of data correlation, the intra-pixel and the inter-pixel correlations, in order to achieve a manageable storage size.

Research Area(s)

  • Data compression, Image-based modeling and rendering, Light field, Lumigraph, Multimedia application, Panorama, Plenoptic function, Spherical harmonic transform, Virtual reality

Citation Format(s)

The plenoptic illumination function. / Wong, Tien-Tsin; Fu, Chi-Wing; Heng, Pheng-Ann; Leung, Chi-Sing.

In: IEEE Transactions on Multimedia, Vol. 4, No. 3, 09.2002, p. 361-371.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review