Sample Efficient Nonparametric Regression via Low-Rank Regularization
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Journal / Publication | Journal of Computational and Graphical Statistics |
Online published | 22 Nov 2024 |
Publication status | Online published - 22 Nov 2024 |
Link(s)
Abstract
Nonparametric regression suffers from curse of dimensionality, requiring a relatively large sample size for accurate estimation beyond the univariate case. In this article, we consider a simple method of dimension reduction in nonparametric regression via series estimation, based on the concept of low-rankness which was previously studied in parametric multivariate reduced-rank regression and matrix regression. For d > 2, the low-rank assumption is realized via tensor regression. We establish a faster convergence rate of the estimator in the (approximate) low-rank case. Limitations of the model are also discussed. Through simulation studies and real data analysis, we compare the estimation accuracy of the proposed method with that of existing approaches. The results demonstrate that the proposed method yields estimates with lower RMSE compared to existing methods. Supplementary materials for this article are available online. © 2024 American Statistical Association and Institute of Mathematical Statistics.
Research Area(s)
- Low-rank matrix estimation, Nonparametric regression, Tensor decomposition
Citation Format(s)
Sample Efficient Nonparametric Regression via Low-Rank Regularization. / Jiang, Jiakun; Peng, Jiahao; Lian, Heng.
In: Journal of Computational and Graphical Statistics, 22.11.2024.
In: Journal of Computational and Graphical Statistics, 22.11.2024.
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review