Simultaneous Dimensionality Reduction and Classification via Dual Embedding Regularized Nonnegative Matrix Factorization

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalNot applicablepeer-review

View graph of relations

Detail(s)

Original languageEnglish
Article number8672942
Pages (from-to)3836-3847
Journal / PublicationIEEE Transactions on Image Processing
Volume28
Issue number8
Early online date22 Mar 2019
Publication statusPublished - Aug 2019

Abstract

Nonnegative matrix factorization (NMF) is a wellknown paradigm for data representation. Traditional NMFbased classification methods first perform NMF or one of itsvariants on input data samples to obtain their low-dimensionalrepresentations, which are successively classified by means of atypical classifier (e.g., k-nearest neighbors (KNN) and supportvector machine (SVM)). Such a stepwise manner may overlookthe dependency between the two processes, resulting in thecompromise of the classification accuracy. In this paper, weelegantly unify the two processes by formulating a novel constrained optimization model, namely dual embedding regularizedNMF (DENMF), which is semi-supervised. Our DENMF solutionsimultaneously finds the low-dimensional representations andassignment matrix via joint optimization for better classification.Specifically, input data samples are projected onto a couple oflow-dimensional spaces (i.e., feature and label spaces), and locallylinear embedding is employed to preserve the identical localgeometric structure in different spaces. Moreover, we proposean alternating iteration algorithm to solve the resulting DENMF,whose convergence is theoretically proven. Experimental resultsover five benchmark datasets demonstrate that DENMF canachieve higher classification accuracy than state-of-the-art algorithms.

Research Area(s)

  • Nonnegative matrix factorization, semisupervised learning, classification

Citation Format(s)

Simultaneous Dimensionality Reduction and Classification via Dual Embedding Regularized Nonnegative Matrix Factorization. / Wu, Wenhui; Kwong, Sam; Hou, Junhui; Jia, Yuheng; Ip, Horace Ho Shing.

In: IEEE Transactions on Image Processing, Vol. 28, No. 8, 8672942, 08.2019, p. 3836-3847.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalNot applicablepeer-review