Learning with varying insensitive loss

Support vector machines for regression are implemented based on regularization schemes in reproducing kernel Hilbert spaces associated with an -insensitive loss. The insensitive parameter >0 changes with the sample size and plays a crucial role in the learning algorithm. The purpose of this paper is to present a perturbation theorem to show how the medium function of the probability measure for regression (with =0) can be approximated by learning the minimizer of the generalization error with sufficiently small parameter >0. A concrete learning rate is provided under a regularity condition of the medium function and a noise condition of the probability measure. © 2011 Elsevier Ltd. All rights reserved.