Two credit scoring models based on dual strategy ensemble trees

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalNot applicablepeer-review

94 Scopus Citations
View graph of relations

Author(s)

  • Gang Wang
  • Jian Ma
  • Lihua Huang
  • Kaiquan Xu

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)61-68
Journal / PublicationKnowledge-Based Systems
Volume26
Publication statusPublished - Feb 2012

Abstract

Decision tree (DT) is one of the most popular classification algorithms in data mining and machine learning. However, the performance of DT based credit scoring model is often relatively poorer than other techniques. This is mainly due to two reasons: DT is easily affected by (1) the noise data and (2) the redundant attributes of data under the circumstance of credit scoring. In this study, we propose two dual strategy ensemble trees: RS-Bagging DT and Bagging-RS DT, which are based on two ensemble strategies: bagging and random subspace, to reduce the influences of the noise data and the redundant attributes of data and to get the relatively higher classification accuracy. Two real world credit datasets are selected to demonstrate the effectiveness and feasibility of proposed methods. Experimental results reveal that single DT gets the lowest average accuracy among five single classifiers, i.e., Logistic Regression Analysis (LRA), Linear Discriminant Analysis (LDA), Multi-layer Perceptron (MLP) and Radial Basis Function Network (RBFN). Moreover, RS-Bagging DT and Bagging-RS DT get the better results than five single classifiers and four popular ensemble classifiers, i.e., Bagging DT, Random Subspace DT, Random Forest and Rotation Forest. The results show that RS-Bagging DT and Bagging-RS DT can be used as alternative techniques for credit scoring. © 2011 Elsevier B.V. All rights reserved.

Research Area(s)

  • Bagging, Credit scoring, Decision tree, Ensemble learning, Random subspace

Citation Format(s)

Two credit scoring models based on dual strategy ensemble trees. / Wang, Gang; Ma, Jian; Huang, Lihua; Xu, Kaiquan.

In: Knowledge-Based Systems, Vol. 26, 02.2012, p. 61-68.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalNot applicablepeer-review