ROCT : Radius-based class overlap cleaning technique to alleviate the class overlap problem in software defect prediction

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)peer-review

View graph of relations

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publicationProceedings - 2021 IEEE 45th Annual Computers, Software, and Applications Conference, COMPSAC 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages228-237
ISBN (Print)9781665424639
Publication statusPublished - 2021

Publication series

NameProceedings - IEEE Annual Computers, Software, and Applications Conference, COMPSAC
ISSN (Print)0730-3157

Conference

Title45th IEEE Annual Computers, Software, and Applications Conference (COMPSAC 2021)
LocationVirtual
PlaceSpain
Period12 - 16 July 2021

Abstract

The training data commonly used in software defect prediction (SDP) usually contains some instances that have similar values on features but are in different classes, which significantly degrades the performance of prediction models trained using these instances. This is referred to as the class overlap problem (COP). Previous studies have concluded that COP has a more negative impact on the performance of prediction models than the class imbalance problem (CIP). However, less research has been conducted on COP than CIP. Moreover, the performance of the existing class overlap cleaning techniques heavily relies on the settings of hyperparameters such as the value of K in the K-nearest neighbor algorithm or the K-means algorithm, but how to find those optimal hyperparameters is still a challenge. In this study, we propose a novel technique named the radius-based class overlap cleaning technique (ROCT) to better alleviate COP without tuning hyperparameters in SDP. The basic idea of ROCT is to take each instance as the center of a hypersphere and directly optimize the radius of the hypersphere. Then ROCT identifies those instances with the opposite label of the center instance as the overlapping instance and removes them. To investigate the performance of ROCT, we conduct the empirical experiment across 29 datasets collected from various software repositories on the K-nearest neighbor, random forest, logistic regression, and naive Bayes classifiers measured by AUC, balance, pd, and pf. The experimental results show that ROCT performs the best and significantly improves the performance of prediction models by as much as 15.2% and 29.9% in terms of AUC and balance compared with the existing class overlap cleaning techniques. The superior performance of ROCT indicates that ROCT should be recommended as an efficient alternative to alleviate COP in SDP.

Research Area(s)

  • Class imbalance, Class overlap, Data preprocessing, Software defect prediction

Citation Format(s)

ROCT : Radius-based class overlap cleaning technique to alleviate the class overlap problem in software defect prediction. / Feng, Shuo; Keung, Jacky; Liu, Jie; Xiao, Yan; Yu, Xiao; Zhang, Miao.

Proceedings - 2021 IEEE 45th Annual Computers, Software, and Applications Conference, COMPSAC 2021. Institute of Electrical and Electronics Engineers Inc., 2021. p. 228-237 (Proceedings - IEEE Annual Computers, Software, and Applications Conference, COMPSAC).

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)peer-review