A two-step parametric method for failure prediction in hard disk drives

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

80 Scopus Citations
View graph of relations

Author(s)

Related Research Unit(s)

Detail(s)

Original languageEnglish
Article number6517515
Pages (from-to)419-430
Journal / PublicationIEEE Transactions on Industrial Informatics
Volume10
Issue number1
Online published20 May 2013
Publication statusPublished - Feb 2014

Abstract

Predicting the impending failure of hard disk drives (HDDs) is crucial for preventing essential data from losing. In this paper, a two-step parametric method was developed to predict the impending failure of HDDs using the aggregate of statistical models. This method deals with the problem of failure prediction in two steps: anomaly detection and failure prediction. First, Mahalanobis distance was used for aggregating all the monitored variables into one index, which was then transformed into Gaussian variables by Box-Cox transformation. By defining an appropriate threshold, anomalies in HDDs were detected as a result. Second, a sliding-window-based generalized likelihood ratio test was proposed to track the anomaly progression in an HDD. When the occurrence of anomalies in a time interval is found to be statistically significant, indicating the HDD is approaching failure. In this work, we also derived a new cost function to adjust the prediction rate. This is important in a way to balance the failure detection rate and false alarm rate as well as to provide an advanced warning of HDD failures to the users, whereby the users can back up their data in time. Then the developed method was applied on a synthetic data set showing its effectiveness on predicting failures. To demonstrate the practical usefulness, this method was also applied on a real-life HDD data set. The result shows that our method could achieve 68% failure detection rate with 0% false alarm rate. This is much better than the results achieved by the state-of-the-art methods, such as support vector machine and hidden Markov models. © 2005-2012 IEEE.

Research Area(s)

  • Anomaly detection, failure prediction, generalized likelihood ratio test, hard disk drive (HDD)

Citation Format(s)

A two-step parametric method for failure prediction in hard disk drives. / Wang, Yu; Ma, Eden W. M.; Chow, Tommy W. S.; Tsui, Kwok-Leung.

In: IEEE Transactions on Industrial Informatics, Vol. 10, No. 1, 6517515, 02.2014, p. 419-430.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review