Skip to main navigation Skip to search Skip to main content

Distributed iterative hard thresholding for variable selection in Tobit models

  • Changxin Yang
  • , Zhongyi Zhu
  • , Hongmei Lin*
  • , Zengyan Fan
  • , Heng Lian
  • *Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

While there is a substantial body of research on high-dimensional regression with left-censored responses, few methods address this problem in a distributed manner. Due to data transmission limitations and privacy concerns, centralizing all data is often impractical, necessitating a method for collaborative learning with distributed data. In this paper, we employ the Iterative Hard Thresholding (IHT) method for the Tobit model to address this challenge, allowing one to directly specify the desired sparsity and offering an alternative estimation and variable selection approach. Theoretical analysis shows that our estimator achieves a nearly minimax-optimal convergence rate using only a few rounds of communication. Its practical performance is evaluated under both the pooled and the distributed setting. The former highlights its competitive estimation efficiency and variable selection performance compared to existing approaches, while the latter demonstrates that the decentralized estimator closely matches the performance of its centralized counterpart. When applied to high-dimensional left-censored HIV viral load data, our method also demonstrates comparable performance. © 2025 Elsevier B.V.
Original languageEnglish
Article number108227
Number of pages14
JournalComputational Statistics & Data Analysis
Volume211
Online published3 Jun 2025
DOIs
Publication statusPublished - Nov 2025

Funding

The authors sincerely thank the editors and anonymous reviewers for their insightful comments that led to a much improved manuscript. Zhongyi Zhu's research was partially supported by the National Natural Science Foundation of China (12331009). Hongmei Lin's research was partially supported by the National Natural Science Foundation of China (12171310, 12371272), the Shanghai “Project Dawn 2022” (22SG52) and the Basic Research Project of Shanghai Science and Technology Commission (22JC1400800). The research of Heng Lian is partially supported by NSFC 12371297 at CityUHK Shenzhen Research Institute, and by Hong Kong RGC general research fund 11300721, 11311822, 11300424.

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 3 - Good Health and Well-being
    SDG 3 Good Health and Well-being
  2. SDG 5 - Gender Equality
    SDG 5 Gender Equality

Research Keywords

  • Censored regression
  • Distributed optimization
  • Hard thresholding
  • High-dimension statistics
  • Linear convergence

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'Distributed iterative hard thresholding for variable selection in Tobit models'. Together they form a unique fingerprint.

Cite this