Cross-validation based K nearest neighbor imputation for software quality datasets : An empirical study

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal

9 Scopus Citations
View graph of relations

Author(s)

  • Jianglin Huang
  • Federica Sarro
  • Yan-Fu Li

Detail(s)

Original languageEnglish
Pages (from-to)226-252
Journal / PublicationJournal of Systems and Software
Volume132
Online published13 Jul 2017
Publication statusPublished - Oct 2017

Abstract

Being able to predict software quality is essential, but also it pose significant challenges in software engineering. Historical software project datasets are often being utilized together with various machine learning algorithms for fault-proneness classification. Unfortunately, the missing values in datasets have negative impacts on the estimation accuracy and therefore, could lead to inconsistent results. As a method handling missing data, K nearest neighbor (KNN) imputation gradually gains acceptance in empirical studies by its exemplary performance and simplicity. To date, researchers still call for optimized parameter setting for KNN imputation to further improve its performance. In the work, we develop a novel incomplete-instance based KNN imputation technique, which utilizes a cross-validation scheme to optimize the parameters for each missing value. An experimental assessment is conducted on eight quality datasets under various missingness scenarios. The study also compared the proposed imputation approach with mean imputation and other three KNN imputation approaches. The results show that our proposed approach is superior to others in general. The relatively optimal fixed parameter settings for KNN imputation for software quality data is also determined. It is observed that the classification accuracy is improved or at least maintained by using our approach for missing data imputation.

Research Area(s)

  • Cross-validation, Empirical software engineering estimation, Imputation, KNN, Missing data

Citation Format(s)