Optimal weight choice for frequentist model average estimators

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal

88 Scopus Citations
View graph of relations

Author(s)

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)1053-1066
Journal / PublicationJournal of the American Statistical Association
Volume106
Issue number495
Publication statusPublished - 2011

Abstract

There has been increasing interest recently in model averaging within the frequentist paradigm. The main benefit of model averaging over model selection is that it incorporates rather than ignores the uncertainty inherent in the model selection process. One of the most important, yet challenging, aspects of model averaging is how to optimally combine estimates from different models. In this work, we suggest a procedure of weight choice for frequentist model average estimators that exhibits optimality properties with respect to the estimator's mean squared error (MSE). As a basis for demonstrating our idea, we consider averaging over a sequence of linear regression models. Building on this base, we develop a model weighting mechanism that involves minimizing the trace of an unbiased estimator of the model average estimator's MSE. We further obtain results that reflect the finite sample as well as asymptotic optimality of the proposed mechanism. A Monte Carlo study based on simulated and real data evaluates and compares the finite sample properties of this mechanism with those of existing methods. The extension of the proposed weight selection scheme to general likelihood models is also considered. This article has supplementary material online. © 2011 American Statistical Association.

Research Area(s)

  • Asymptotic optimality, Finite sample properties, Mallows criterion, Smoothed AIC, Smoothed BIC, Unbiased MSE estimate