Statistical performance of quantile tensor regression with convex regularization

Wenqi Lu, Zhongyi Zhu, Rui Li*, Heng Lian

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

In this paper, we consider high-dimensional quantile tensor regression using a general convex decomposable regularizer and analyze the statistical performances of the estimator. The rates are stated in terms of the intrinsic dimension of the estimation problem, which is, roughly speaking, the dimension of the smallest subspace that contains the true coefficient. Previously, convex regularized tensor regression has been studied with a least squares loss, Gaussian tensorial predictors and Gaussian errors, with rates that depend on the Gaussian width of a convex set. Our results extend the previous work to nonsmooth quantile loss. To deal with the non-Gaussian setting, we use the concept of Rademacher complexity with appropriate concentration inequalities instead of the Gaussian width. For the multi-linear nuclear norm penalty, our Orlicz norm bound for the operator norm of a random matrix may be of independent interest. We validate the theoretical guarantees in numerical experiments. We also demonstrate advantage of quantile regression over mean regression, and compare the performance of convex regularization method and nonconvex decomposition method in solving quantile tensor regression problem in simulation studies. © 2023 Elsevier Inc.
Original languageEnglish
Article number105249
JournalJournal of Multivariate Analysis
Volume200
Online published14 Nov 2023
DOIs
Publication statusPublished - Mar 2024

Funding

The authors sincerely thank the Editor, the Associate Editor and two reviewers for their insightful comments that significantly improved the manuscript. The research of Wenqi Lu is supported by NSFC (12301343), Tianjin Municipal Natural Science Foundation (22JCQNJC01670), and Fundamental Research Funds for the Central Universities, Nankai University (63231192). The research of Zhongyi Zhu is supported by NSFC (12331009, 12071087). The research of Rui Li is supported by Humanities and Social Sciences Fund of Ministry of Education 23YJA910003. The research of Heng Lian is partially supported by NSFC 12371297 at CityU Shenzhen Research Institute, NSF of Jiangxi Province under Grant 20223BCJ25017, and by Hong Kong RGC general research fund 11300519, 11300721 and 11311822, and by CityU internal grant 7005514 and 9680239.

Research Keywords

  • Convex optimization
  • Quantile regression
  • Risk bound
  • Tensor estimation

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'Statistical performance of quantile tensor regression with convex regularization'. Together they form a unique fingerprint.

Cite this