Capacity of reproducing kernel spaces in learning theory

Ding-Xuan Zhou

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

207 Citations (Scopus)

Abstract

The capacity of reproducing kernel Hilbert spaces (RKHS) plays an essential role in the analysis of learning theory. Covering numbers and packing numbers of balls of these reproducing kernel spaces are important measurements of this capacity. In this paper, we first present lower bound estimates for the packing numbers by means of nodal functions. Then we show that if a Mercer kernel is Cs (for some s > 0 being not an even integer), the RKHS associated with this kernel can be embedded into Cs/2. This gives upper-bound estimates for the covering number concerning Sobolev smooth kernels. Examples and applications to Vγ dimension and Tikhonov regularization are presented to illustrate the upper- and lower-bound estimates.
Original languageEnglish
Pages (from-to)1743-1752
JournalIEEE Transactions on Information Theory
Volume49
Issue number7
DOIs
Publication statusPublished - Jul 2003

Research Keywords

  • Capacity
  • Covering number
  • Learning theory
  • Nodal function
  • Packing number
  • Reproducing kernel Hilbert space (RKHS)

Fingerprint

Dive into the research topics of 'Capacity of reproducing kernel spaces in learning theory'. Together they form a unique fingerprint.

Cite this