Properties of Standard and Sketched Kernel Fisher Discriminant

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

1 Scopus Citations
View graph of relations

Author(s)

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)10596-10602
Number of pages8
Journal / PublicationIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume45
Issue number8
Online published6 Feb 2023
Publication statusPublished - Aug 2023

Abstract

Kernel Fisher discriminant (KFD) is a popular tool as a nonlinear extension of Fisher's linear discriminant, based on the use of the kernel trick. However, its asymptotic properties are still rarely studied. We first present an operator-theoretical formulation of KFD which elucidates the population target of the estimation problem. Convergence of the KFD solution to its population target is then established. However, the complexity of finding the solution poses significant challenges when n is large and we further propose a sketched estimation approach based on a m x sketching matrix which possesses the same asymptotic properties (in terms of convergence rate) even when m
is much smaller than n. Some numerical results are presented to illustrate the performances of the sketched estimator. © 2023  IEEE.

Research Area(s)

  • Convergence, Eigenvalues and eigenfunctions, Estimation, Kernel, Kernel method, random projection, reproducing kernel Hilbert space, Sociology, Standards, Urban areas, variance operator

Citation Format(s)

Properties of Standard and Sketched Kernel Fisher Discriminant. / Liu, Jiamin; Xu, Wangli; Zhang, Fode et al.
In: IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 45, No. 8, 08.2023, p. 10596-10602.

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review