TY - JOUR
T1 - Learning by nonsymmetric kernels with data dependent spaces and l1-regularizer
AU - Xiao, Quan-Wu
AU - Zhou, Ding-Xuan
PY - 2010/10
Y1 - 2010/10
N2 - We study a learning algorithm for regression. The algorithm is a regularization scheme with l1 regularizer stated in a hypothesis space trained from data or samples by a nonsymmetric kernel. The data dependent nature of the algorithm leads to an extra error term called hypothesis error, which is essentially different from regularization schemes with data independent hypothesis spaces. By dealing with regularization error, sample error and hypothesis error, we estimate the total error in terms of properties of the kernel, the input space, the marginal distribution, and the regression function of the regression problem. Learning rates are derived by choosing suitable values of the regularization parameter. An improved error decomposition approach is used in our data dependent setting.
AB - We study a learning algorithm for regression. The algorithm is a regularization scheme with l1 regularizer stated in a hypothesis space trained from data or samples by a nonsymmetric kernel. The data dependent nature of the algorithm leads to an extra error term called hypothesis error, which is essentially different from regularization schemes with data independent hypothesis spaces. By dealing with regularization error, sample error and hypothesis error, we estimate the total error in terms of properties of the kernel, the input space, the marginal distribution, and the regression function of the regression problem. Learning rates are derived by choosing suitable values of the regularization parameter. An improved error decomposition approach is used in our data dependent setting.
KW - Data dependent hypothesis spaces
KW - Error analysis
KW - Learning theory
KW - Nonsymmetric kernel
KW - Regularization scheme
UR - http://www.scopus.com/inward/record.url?scp=77958610829&partnerID=8YFLogxK
UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-77958610829&origin=recordpage
U2 - 10.11650/twjm/1500406018
DO - 10.11650/twjm/1500406018
M3 - RGC 21 - Publication in refereed journal
SN - 1027-5487
VL - 14
SP - 1821
EP - 1836
JO - Taiwanese Journal of Mathematics
JF - Taiwanese Journal of Mathematics
IS - 5
ER -