Translator Disclaimer
2013 Model selection in regression under structural constraints
Felix Abramovich, Vadim Grinshtein
Electron. J. Statist. 7: 480-498 (2013). DOI: 10.1214/13-EJS780

Abstract

The paper considers model selection in regression under the additional structural constraints on admissible models where the number of potential predictors miht be even larger than the available sample size. We develop a Bayesian formalism which is used as a natural tool for generating a wide class of model selection criteria based on penalized least squares estimation with various complexity penalties associated with a prior on a model size. The resulting criteria are adaptive to structural constraints. We establish the upper bound for the quadratic risk of the resulting MAP estimator and the corresponding lower bound for the minimax risk over a set of admissible models of a given size. We then specify the class of priors (and, therefore, the class of complexity penalties) where for the “nearly-orthogonal” design the MAP estimator is asymptotically at least nearly-minimax (up to a log-factor) simultaneously over an entire range of sparse and dense setups. Moreover, when the numbers of admissible models are “small” (e.g., ordered variable selection) or, on the opposite, for the case of complete variable selection, the proposed estimator achieves the exact minimax rates.

Citation

Download Citation

Felix Abramovich. Vadim Grinshtein. "Model selection in regression under structural constraints." Electron. J. Statist. 7 480 - 498, 2013. https://doi.org/10.1214/13-EJS780

Information

Published: 2013
First available in Project Euclid: 21 February 2013

zbMATH: 1337.62156
MathSciNet: MR3035263
Digital Object Identifier: 10.1214/13-EJS780

Subjects:
Primary: 62C99
Secondary: 62C10, 62C20, 62J05

Rights: Copyright © 2013 The Institute of Mathematical Statistics and the Bernoulli Society

JOURNAL ARTICLE
19 PAGES


SHARE
Back to Top