A Feature Selection Algorithm Based on Equal Interval Division and Minimal-Redundancy-Maximal-Relevance

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

View graph of relations

Author(s)

  • Xiangyuan Gu
  • Jichang Guo
  • Lijun Xiao
  • Tao Ming
  • Chongyi Li

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)1237–1263
Journal / PublicationNeural Processing Letters
Volume51
Issue number2
Online published4 Nov 2019
Publication statusPublished - Apr 2020

Abstract

Minimal-redundancy-maximal-relevance (mRMR) algorithm is a typical feature selection algorithm. To select the feature which has minimal redundancy with the selected features and maximal relevance with the class label, the objective function of mRMR subtracts the average value of mutual information between features from mutual information between features and the class label, and selects the feature with the maximum difference. However, the problem is that the feature with the maximum difference is not always the feature with minimal redundancy maximal relevance. To solve the problem, the objective function of mRMR is first analyzed and a constraint condition that determines whether the objective function can guarantee the effectiveness of the selected features is achieved. Then, for the case where the objective function is not accurate, an idea of equal interval division is proposed and combined with ranking to process the interval of mutual information between features and the class label, and that of the average value of mutual information between features. Finally, a feature selection algorithm based on equal interval division and minimal-redundancy-maximal-relevance (EID-mRMR) is proposed. To validate the performance of EID-mRMR, we compare it with several incremental feature selection algorithms based on mutual information and other feature selection algorithms. Experimental results demonstrate that the EID-mRMR algorithm can achieve better feature selection performance.

Research Area(s)

  • Minimal-redundancy-maximal-relevance, Equal interval division, Mutual information, Feature selection, MUTUAL INFORMATION, CLASSIFICATION, FRAMEWORK

Citation Format(s)

A Feature Selection Algorithm Based on Equal Interval Division and Minimal-Redundancy-Maximal-Relevance. / Gu, Xiangyuan; Guo, Jichang; Xiao, Lijun; Ming, Tao; Li, Chongyi.

In: Neural Processing Letters, Vol. 51, No. 2, 04.2020, p. 1237–1263.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review