Skip to main navigation Skip to search Skip to main content

Scalable algorithms for the sparse ridge regression

Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review

Abstract

Sparse regression and variable selection for large-scale data have been rapidly developed in the past decades. This work focuses on sparse ridge regression, which enforces the sparsity by use of the L0 norm. We first prove that the continuous relaxation of the mixed integer second order conic (MISOC) reformulation using perspective formulation is equivalent to that of the convex integer formulation proposed in recent work. We also show that the convex hull of the constraint system of the MISOC formulation is equal to its continuous relaxation. Based upon these two formulations (i.e., the MISOC formulation and convex integer formulation), we analyze two scalable algorithms, the greedy and randomized algorithms, for sparse ridge regression with desirable theoretical properties. The proposed algorithms are proved to yield near-optimal solutions under mild conditions. We further propose integrating the greedy algorithm with the randomized algorithm, which can greedily search the features from the nonzero subset identified by the continuous relaxation of the MISOC formulation. The merits of the proposed methods are illustrated through numerical examples in comparison with several existing ones. © 2020 Society for Industrial and Applied Mathematics.
Original languageEnglish
Pages (from-to)3359-3386
JournalSIAM Journal on Optimization
Volume30
Issue number4
Online published17 Dec 2020
DOIs
Publication statusPublished - 2020
Externally publishedYes

Research Keywords

  • Approximation algorithm
  • Chance constraint
  • Conic program
  • Mixed integer
  • Ridge regression

Fingerprint

Dive into the research topics of 'Scalable algorithms for the sparse ridge regression'. Together they form a unique fingerprint.

Cite this