A scalable and accurate descriptor for dynamic textures using bag of system trees

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

28 Scopus Citations
View graph of relations

Author(s)

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)697-712
Journal / PublicationIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume37
Issue number4
Online published18 Sept 2014
Publication statusPublished - Apr 2015

Link(s)

Abstract

The bag-of-systems (BoS) representation is a descriptor of motion in a video, where dynamic texture (DT) codewords represent the typical motion patterns in spatio-temporal patches extracted from the video. The efficacy of the BoS descriptor depends on the richness of the codebook, which depends on the number of codewords in the codebook. However, for even modest sized codebooks, mapping videos onto the codebook results in a heavy computational load. In this paper we propose the BoS Tree, which constructs a bottom-up hierarchy of codewords that enables efficient mapping of videos to the BoS codebook. By leveraging the tree structure to efficiently index the codewords, the BoS Tree allows for fast look-ups in the codebook and enables the practical use of larger, richer codebooks. We demonstrate the effectiveness of BoS Trees on classification of four video datasets, as well as on annotation of a video dataset and a music dataset. Finally, we show that, although the fast look-ups of BoS Tree result in different descriptors than BoS for the same video, the overall distance (and kernel) matrices are highly correlated resulting in similar classification performance.

Research Area(s)

  • bag of systems, dynamic texture recognition, Dynamic textures, efficient indexing, large codebooks, music annotation, video annotation

Citation Format(s)

A scalable and accurate descriptor for dynamic textures using bag of system trees. / Mumtaz, Adeel; Coviello, Emanuele; Lanckriet, Gert R.G. et al.
In: IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 37, No. 4, 04.2015, p. 697-712.

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Download Statistics

No data available