Cross-company defect prediction via semi-supervised clustering-based data filtering and MSTrA-based transfer learning

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal

View graph of relations

Author(s)

  • Man Wu
  • Yiheng Jian
  • Mandi Fu
  • Chuanxiang Ma

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)3461-3472
Journal / PublicationSoft Computing
Volume22
Issue number10
Early online date8 Mar 2018
StatePublished - May 2018

Abstract

Cross-company defect prediction (CCDP) is a practical way that trains a prediction model by exploiting one or multiple projects of a source company and then applies the model to a target company. Unfortunately, larger irrelevant cross-company (CC) data usually make it difficult to build a prediction model with high performance. On the other hand, brute force leveraging of CC data poorly related to within-company data may decrease the prediction model performance. To address such issues, we aim to provide an effective solution for CCDP. First, we propose a novel semi-supervised clustering-based data filtering method (i.e., SSDBSCAN filter) to filter out irrelevant CC data. Second, based on the filtered CC data, we for the first time introduce multi-source TrAdaBoost algorithm, an effective transfer learning method, into CCDP to import knowledge not from one but from multiple sources to avoid negative transfer. Experiments on 15 public datasets indicate that: (1) our proposed SSDBSCAN filter achieves better overall performance than compared data filtering methods; (2) our proposed CCDP approach achieves the best overall performance among all tested CCDP approaches; and (3) our proposed CCDP approach performs significantly better than with-company defect prediction models.

Research Area(s)

  • Cross-company defect prediction, Multi-source TrAdaBoost, SSDBSCAN, Transfer learning