PRIMAL-GMM : PaRametrIc MAnifold Learning of Gaussian Mixture Models
Research output: Journal Publications and Reviews (RGC: 21, 22, 62) › 21_Publication in refereed journal › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Pages (from-to) | 3197-3211 |
Journal / Publication | IEEE Transactions on Pattern Analysis and Machine Intelligence |
Volume | 44 |
Issue number | 6 |
Online published | 1 Jan 2021 |
Publication status | Published - Jun 2022 |
Link(s)
Abstract
We propose a ParametRIc MAnifold Learning (PRIMAL) algorithm for Gaussian Mixtures Models (GMM), assuming that GMMs lie on or near to a manifold of probability distributions that is generated from a low-dimensional hierarchical latent space through parametric mappings. Inspired by Principal Component Analysis (PCA), the generative processes for priors, means and covariance matrices are modeled by their respective latent space and parametric mapping. Then, the dependencies between latent spaces are captured by a hierarchical latent space by a linear or kernelized mapping. The function parameters and hierarchical latent space are learned by minimizing the reconstruction error between ground-truth GMMs and manifold-generated GMMs, measured by Kullback-Leibler Divergence (KLD). Variational approximation is employed to handle the intractable KLD between GMMs and a variational EM algorithm is derived to optimize the objective function. Experiments on synthetic data, flow cytometry analysis, eye-fixation analysis and topic models show that PRIMAL learns a continuous and interpretable manifold of GMM distributions and achieves a minimum reconstruction error.
Research Area(s)
- Dimensionality Reduction and Manifold Learning, Gaussian Mixture Models, Interpretability, Probabilistic Models, Unsupervised Learning
Citation Format(s)
PRIMAL-GMM: PaRametrIc MAnifold Learning of Gaussian Mixture Models. / Liu, Ziquan; Yu, Lei; Hsiao, Janet H. et al.
In: IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 44, No. 6, 06.2022, p. 3197-3211.
In: IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 44, No. 6, 06.2022, p. 3197-3211.
Research output: Journal Publications and Reviews (RGC: 21, 22, 62) › 21_Publication in refereed journal › peer-review