TY - JOUR
T1 - Capacity of reproducing kernel spaces in learning theory
AU - Zhou, Ding-Xuan
PY - 2003/7
Y1 - 2003/7
N2 - The capacity of reproducing kernel Hilbert spaces (RKHS) plays an essential role in the analysis of learning theory. Covering numbers and packing numbers of balls of these reproducing kernel spaces are important measurements of this capacity. In this paper, we first present lower bound estimates for the packing numbers by means of nodal functions. Then we show that if a Mercer kernel is Cs (for some s > 0 being not an even integer), the RKHS associated with this kernel can be embedded into Cs/2. This gives upper-bound estimates for the covering number concerning Sobolev smooth kernels. Examples and applications to Vγ dimension and Tikhonov regularization are presented to illustrate the upper- and lower-bound estimates.
AB - The capacity of reproducing kernel Hilbert spaces (RKHS) plays an essential role in the analysis of learning theory. Covering numbers and packing numbers of balls of these reproducing kernel spaces are important measurements of this capacity. In this paper, we first present lower bound estimates for the packing numbers by means of nodal functions. Then we show that if a Mercer kernel is Cs (for some s > 0 being not an even integer), the RKHS associated with this kernel can be embedded into Cs/2. This gives upper-bound estimates for the covering number concerning Sobolev smooth kernels. Examples and applications to Vγ dimension and Tikhonov regularization are presented to illustrate the upper- and lower-bound estimates.
KW - Capacity
KW - Covering number
KW - Learning theory
KW - Nodal function
KW - Packing number
KW - Reproducing kernel Hilbert space (RKHS)
UR - http://www.scopus.com/inward/record.url?scp=0038105204&partnerID=8YFLogxK
UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-0038105204&origin=recordpage
U2 - 10.1109/TIT.2003.813564
DO - 10.1109/TIT.2003.813564
M3 - RGC 21 - Publication in refereed journal
SN - 0018-9448
VL - 49
SP - 1743
EP - 1752
JO - IEEE Transactions on Information Theory
JF - IEEE Transactions on Information Theory
IS - 7
ER -