A Feature Selection Algorithm Based on Equal Interval Division and Minimal-Redundancy-Maximal-Relevance

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal

View graph of relations

Author(s)

  • Xiangyuan Gu
  • Jichang Guo
  • Lijun Xiao
  • Tao Ming
  • Chongyi Li

Related Research Unit(s)

Detail(s)

Original languageEnglish
Journal / PublicationNeural Processing Letters
Publication statusOnline published - 4 Nov 2019

Abstract

Minimal-redundancy-maximal-relevance (mRMR) algorithm is a typical feature selection algorithm. To select the feature which has minimal redundancy with the selected features and maximal relevance with the class label, the objective function of mRMR subtracts the average value of mutual information between features from mutual information between features and the class label, and selects the feature with the maximum difference. However, the problem is that the feature with the maximum difference is not always the feature with minimal redundancy maximal relevance. To solve the problem, the objective function of mRMR is first analyzed and a constraint condition that determines whether the objective function can guarantee the effectiveness of the selected features is achieved. Then, for the case where the objective function is not accurate, an idea of equal interval division is proposed and combined with ranking to process the interval of mutual information between features and the class label, and that of the average value of mutual information between features. Finally, a feature selection algorithm based on equal interval division and minimal-redundancy-maximal-relevance (EID-mRMR) is proposed. To validate the performance of EID-mRMR, we compare it with several incremental feature selection algorithms based on mutual information and other feature selection algorithms. Experimental results demonstrate that the EID-mRMR algorithm can achieve better feature selection performance.

Research Area(s)

  • Minimal-redundancy-maximal-relevance, Equal interval division, Mutual information, Feature selection, MUTUAL INFORMATION, CLASSIFICATION, FRAMEWORK