Unsupervised video shot detection using clustering ensemble with a color global scale-invariant feature transform descriptor

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

30 Scopus Citations
View graph of relations

Author(s)

  • Yuchou Chang
  • D. J. Lee
  • Yi Hong
  • James Archibald

Related Research Unit(s)

Detail(s)

Original languageEnglish
Article number860743
Journal / PublicationEurasip Journal on Image and Video Processing
Volume2008
Publication statusPublished - 2008

Link(s)

Abstract

Scale-invariant feature transform (SIFT) transforms a grayscale image into scale-invariant coordinates of local features that are invariant to image scale, rotation, and changing viewpoints. Because of its scale-invariant properties, SIFT has been successfully used for object recognition and content-based image retrieval. The biggest drawback of SIFT is that it uses only grayscale information and misses important visual information regarding color. In this paper, we present the development of a novel color feature extraction algorithm that addresses this problem, and we also propose a new clustering strategy using clustering ensembles for video shot detection. Based on Fibonacci lattice-quantization, we develop a novel color global scale-invariant feature transform (CGSIFT) for better description of color contents in video frames for video shot detection. CGSIFT first quantizes a color image, representing it with a small number of color indices, and then uses SIFT to extract features from the quantized color index image. We also develop a new space description method using small image regions to represent global color features as the second step of CGSIFT. Clustering ensembles focusing on knowledge reuse are then applied to obtain better clustering results than using single clustering methods for video shot detection. Evaluation of the proposed feature extraction algorithm and the new clustering strategy using clustering ensembles reveals very promising results for video shot detection.

Research Area(s)

Download Statistics

No data available