An online spatio-temporal tensor learning model for visual tracking and its applications to facial expression recognition
Research output: Journal Publications and Reviews (RGC: 21, 22, 62) › 21_Publication in refereed journal › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Pages (from-to) | 427-438 |
Journal / Publication | Expert Systems with Applications |
Volume | 90 |
Online published | 23 Aug 2017 |
Publication status | Published - 30 Dec 2017 |
Link(s)
Abstract
Robust visual tracking remains a technical challenge in real-world applications, as an object may involve many appearance variations. In existing tracking frameworks, objects in an image are often represented as vector observations, which discounts the 2-D intrinsic structure of the image. By considering an image in its actual form as a matrix, we construct the 3rd order tensor based object representation to preserve the spatial correlation within the 2-D image and fully exploit the useful temporal information. We perform incremental update of the object template using the N-mode SVD to model the appearance variations, which reduces the influence of template drifting and object occlusions. The proposed scheme efficiently learns a low-dimensional tensor representation through adaptively updating the eigenbasis of the tensor. Tensor based Bayesian inference in the particle filter framework is then utilized to realize tracking. We present the validation of the proposed tracking system by conducting the real-time facial expression recognition with video data and a live camera. Experiment evaluation on challenging benchmark image sequences undergoing appearance variations demonstrates the significance and effectiveness of the proposed algorithm.
Research Area(s)
- Appearance model, Facial expression recognition, Incremental N-mode SVD, Object tracking
Citation Format(s)
An online spatio-temporal tensor learning model for visual tracking and its applications to facial expression recognition. / Khan, Sheheryar; Xu, Guoxia; Chan, Raymond; Yan, Hong.
In: Expert Systems with Applications, Vol. 90, 30.12.2017, p. 427-438.Research output: Journal Publications and Reviews (RGC: 21, 22, 62) › 21_Publication in refereed journal › peer-review