Separation of covariates into nonparametric and parametric parts in high-dimensional partially linear additive models

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

36 Scopus Citations
View graph of relations

Author(s)

Detail(s)

Original languageEnglish
Pages (from-to)591-607
Journal / PublicationStatistica Sinica
Volume25
Issue number2
Publication statusPublished - 1 Apr 2015
Externally publishedYes

Abstract

Determining which covariates enter the linear part of a partially linear additive model is always challenging. It is more serious when the number of covariates diverges with the sample size. In this paper, we propose a double penalization based procedure to distinguish covariates that enter the nonparametric and parametric parts and to identify insignificant covariates simultaneously for the "large p small n" setting. The procedure is shown to be consistent for model structure identification, it can identify zero, linear, and nonlinear components correctly. The resulting estimators of the linear coefficients are shown to be asymptotically normal. We discuss how to choose the penalty parameters and provide theoretical justification. We conduct extensive simulation experiments to evaluate the numerical performance of the proposed methods and analyze a gene data set for an illustration.

Research Area(s)

  • Adaptive LASSO, Curse of dimensionality, Oracle property, Penalized likelihood, Polynomial splines, Structure identification consistency