Video event detection using motion relativity and feature selection

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

29 Scopus Citations
View graph of relations

Author(s)

Related Research Unit(s)

Detail(s)

Original languageEnglish
Article number6783709
Pages (from-to)1303-1315
Journal / PublicationIEEE Transactions on Multimedia
Volume16
Issue number5
Online published4 Apr 2014
Publication statusPublished - Aug 2014

Abstract

Event detection plays an essential role in video content analysis. In this paper, we present our approach based on motion relativity and feature selection for video event detection. First, we propose a new motion feature, namely Expanded Relative Motion Histogram of Bag-of-Visual-Words (ERMH-BoW) to employ motion relativity for event detection. In ERMH-BoW, by representing what aspect of an event with Bag-of-Visual-Words (BoW), we construct relative motion histograms between different visual words to depict the objects' activities or how aspect of the event. ERMH-BoW thus integrates both what and how aspects for a complete event description. Meanwhile, we show that by employing motion relativity, ERMH-BoW is invariant to the varying camera movement and able to honestly describe the object activities in an event. Furthermore, compared with other motion features, ERMH-BoW encodes not only the motion of objects, but also the interactions between different objects/scenes. Second, to address the high-dimensionality problem of the ERMH-BoW feature, we further propose an approach based on information gain and informativeness weighting to select a cleaner and more discriminative set of features. Our experiments carried out on several challenging datasets provided by TRECVID for the MED (Multimedia Event Detection) task demonstrate that our proposed approach outperforms the state-of-the-art approaches for video event detection. © 1999-2012 IEEE.

Research Area(s)

  • Feature selection, motion relativity, video event detection

Citation Format(s)

Video event detection using motion relativity and feature selection. / Wang, Feng; Sun, Zhanhu; Jiang, Yu-Gang; Ngo, Chong-Wah.

In: IEEE Transactions on Multimedia, Vol. 16, No. 5, 6783709, 08.2014, p. 1303-1315.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review