Skip to main navigation Skip to search Skip to main content

Communication-efficient estimation of quantile matrix regression for massive datasets

  • Yaohong Yang
  • , Lei Wang
  • , Jiamin Liu
  • , Rui Li*
  • , Heng Lian
  • *Corresponding author for this work

Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review

Abstract

In modern scientific applications, more and more data sets contain natural matrix predictors and traditional regression methods are not directly applicable. Matrix regression has been adapted to such data structure and received increasing attention in recent years. In this paper, we consider estimation of the conditional quantile in high-dimensional regularized matrix regression with a nuclear norm penalty and establish the convergence rate of the estimator. In order to construct a quantile matrix regression estimator in the distributed setting or for massive data sets, we propose a regularized communication-efficient surrogate loss (CSL) function. The proposed CSL method only needs the worker machines to compute the gradient based on local data and the central machine solves a regularized estimation problem. We prove that the estimation error based on the proposed CSL method matches the estimation error bound of the centralized method that analyzes the entire data set. An alternating direction method of multipliers algorithm is developed to efficiently obtain the distributed CSL estimator. The finite-sample performance of the proposed estimator is studied through simulations and an application to Beijing Air Quality data set. © 2023 Elsevier B.V.
Original languageEnglish
Article number107812
JournalComputational Statistics and Data Analysis
Volume187
Online published27 Jun 2023
DOIs
Publication statusPublished - Nov 2023

Funding

The authors would like to thank Editor, Associate Editor, and two anonymous referees for helpful comments and suggestions. All authors contributed to this work equally. Lei Wang's research was supported by the Fundamental Research Funds for the Central Universities and the National Natural Science Foundation of China (12271272). Heng Lian's research is supported by NSF of Jiangxi Province (No 20223BCJ25017) and by Hong Kong RGC general research fund 11300519, 11300721, 11311822 and 11301423.

Research Keywords

  • Communication-efficient surrogate loss
  • Distributed estimator
  • Divide and conquer
  • Empirical processes
  • High-dimensional matrix regression

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'Communication-efficient estimation of quantile matrix regression for massive datasets'. Together they form a unique fingerprint.

Cite this