Empirical investigation of fault predictors in context of class membership probability estimation

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)

View graph of relations

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publicationSAC '16 Proceedings of the 31st Annual ACM Symposium on Applied Computing
PublisherACM New York
Pages1550-1553
ISBN (Print)978-1-4503-3739-7
Publication statusPublished - 4 Apr 2016

Conference

TitleSAC '16 the 31st Annual ACM Symposium on Applied Computing
PlaceItaly
Period4 - 8 April 2016

Abstract

In the domain of software fault prediction, class membership probability of a selected classifier and the factors related to its estimation can be considered as necessary information for tester to take informed decisions about software quality issues. The objective of this study is to empirically investigate the class membership probability estimation capability of 15 classifiers/fault predictors on 12 datasets of open source projects retrieved from PROMISE repository. We empirically validate the effect of dataset characteristics and set of metrics on the performance of classifiers in estimating the class membership probability. We used Receiver Operating Characteristics-Area under Curve (ROC-AUC) value and overall accuracy as benchmarks to evaluate and compare the performance of classifiers. We apply Friedman's, post-hoc Nemenyi and Analysis of Means (ANOM) test to compare the significant performance of classifiers. We conclude that ADTree and RandomForest outperform, while ZeroR classifier cannot show significant performance for estimation of class membership probability.

Research Area(s)

  • Accuracy, Chidamber and Kemerer metrics, Classifiers, Estimation, Performance, Probability, Weka

Citation Format(s)

Empirical investigation of fault predictors in context of class membership probability estimation. / Hussain, Shahid; Khan, Arif Ali; Bennin, Kwabena Ebo.

SAC '16 Proceedings of the 31st Annual ACM Symposium on Applied Computing. ACM New York, 2016. p. 1550-1553.

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)