Boosting the generalized margin in cost-sensitive multiclass classification

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

8 Scopus Citations
View graph of relations



Original languageEnglish
Pages (from-to)178-192
Journal / PublicationJournal of Computational and Graphical Statistics
Issue number1
Publication statusPublished - 2013
Externally publishedYes


The boosting algorithm is one of the most successful binary classification techniques due to its relative immunity to overfitting and flexible implementation. Several attempts have been made to extend the binary boosting algorithm to multiclass classification. In this article,a novel cost-sensitive multiclass boosting algorithm is proposed that naturally extends the popular binary AdaBoost algorithm and admits unequal misclassification costs. The proposed multiclass boosting algorithm achieves superior classification per-formance by combining weak candidate models that only need to be better than random guessing. More importantly, the proposed algorithm achieves a large margin separation of the training sample while attaining an L1-norm constraint on the model complexity. Finally, the effectiveness of the proposed algorithm is demonstrated in a number of simulated and real experiments. The supplementary files are available online, including the technical proofs, the implemented R code, and the real datasets. © 2013 American Statistical Association, Institute of Mathematical Statistics, and Interface Foundation of North America.

Research Area(s)

  • Adaboost, Classification tree, Generalization, Margin, Misclassification cost