Unsupervised feature selection using clustering ensembles and population based incremental learning algorithm

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

137 Scopus Citations
View graph of relations

Author(s)

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)2742-2756
Journal / PublicationPattern Recognition
Volume41
Issue number9
Publication statusPublished - Sept 2008

Abstract

This paper describes a novel feature selection algorithm for unsupervised clustering, that combines the clustering ensembles method and the population based incremental learning algorithm. The main idea of the proposed unsupervised feature selection algorithm is to search for a subset of all features such that the clustering algorithm trained on this feature subset can achieve the most similar clustering solution to the one obtained by an ensemble learning algorithm. In particular, a clustering solution is firstly achieved by a clustering ensembles method, then the population based incremental learning algorithm is adopted to find the feature subset that best fits the obtained clustering solution. One advantage of the proposed unsupervised feature selection algorithm is that it is dimensionality-unbiased. In addition, the proposed unsupervised feature selection algorithm leverages the consensus across multiple clustering solutions. Experimental results on several real data sets demonstrate that the proposed unsupervised feature selection algorithm is often able to obtain a better feature subset when compared with other existing unsupervised feature selection algorithms. © 2008 Elsevier Ltd. All rights reserved.

Research Area(s)

  • Clustering ensembles, Dimensionality unbiased, Population based incremental learning algorithm, Unsupervised feature selection