Improved discriminate analysis for high-dimensional data and its application to face recognition

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

68 Scopus Citations
View graph of relations



Original languageEnglish
Pages (from-to)1570-1578
Journal / PublicationPattern Recognition
Issue number5
Publication statusPublished - May 2007
Externally publishedYes


Many pattern recognition applications involve the treatment of high-dimensional data and the small sample size problem. Principal component analysis (PCA) is a common used dimension reduction technique. Linear discriminate analysis (LDA) is often employed for classification. PCA plus LDA is a famous framework for discriminant analysis in high-dimensional space and singular cases. In this paper, we examine the theory of this framework and find out that even if there is no small sample size problem the PCA dimension reduction cannot guarantee the subsequent successful application of LDA. We thus develop an improved discriminate analysis method by introducing an inverse Fisher criterion and adding a constrain in PCA procedure so that the singularity phenomenon will not occur. Experiment results on face recognition suggest that this new approach works well and can be applied even when the number of training samples is one per class. © 2006 Pattern Recognition Society.

Research Area(s)

  • Face recognition, Feature extraction, Linear discriminant analysis, Principal component analysis, Small sample size problem