Layered Dynamic Textures
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review
Author(s)
Detail(s)
Original language | English |
---|---|
Pages (from-to) | 1862-1879 |
Journal / Publication | IEEE Transactions on Pattern Analysis and Machine Intelligence |
Volume | 31 |
Issue number | 10 |
Online published | 5 May 2009 |
Publication status | Published - Oct 2009 |
Externally published | Yes |
Link(s)
Abstract
A novel video representation, the layered dynamic texture (LDT), is proposed. The LDT is a generative model, which represents a video as a collection of stochastic layers of different appearance and dynamics. Each layer is modeled as a temporal texture sampled from a different linear dynamical system. The LDT model includes these systems, a collection of hidden layer assignment variables (which control the assignment of pixels to layers), and a Markov random field prior on these variables (which encourages smooth segmentations). An EM algorithm is derived for maximum-likelihood estimation of the model parameters from a training video. It is shown that exact inference is intractable, a problem which is addressed by the introduction of two approximate inference procedures: a Gibbs sampler and a computationally efficient variational approximation. The trade-off between the quality of the two approximations and their complexity is studied experimentally. The ability of the LDT to segment videos into layers of coherent appearance and dynamics is also evaluated, on both synthetic and natural videos. These experiments show that the model possesses an ability to group regions of globally homogeneous, but locally heterogeneous, stochastic dynamics currently unparalleled in the literature.
Research Area(s)
- Dynamic texture, Expectation-maximization, Gibbs sampling, Kalman filter, Linear dynamical systems, Markov random fields, Mixture models, Motion segmentation, Probabilistic models, Temporal textures, Variational approximation, Video modeling
Citation Format(s)
Layered Dynamic Textures. / Chan, Antoni B.; Vasconcelos, Nuno.
In: IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31, No. 10, 10.2009, p. 1862-1879.
In: IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31, No. 10, 10.2009, p. 1862-1879.
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review