- Bayesian Anal.
- Volume 7, Number 2 (2012), 477-502.
Regularization in Regression: Comparing Bayesian and Frequentist Methods in a Poorly Informative Situation
Using a collection of simulated and real benchmarks, we compare Bayesian and frequentist regularization approaches under a low informative constraint when the number of variables is almost equal to the number of observations on simulated and real datasets. This comparison includes new global noninformative approaches for Bayesian variable selection built on Zellner’s -priors that are similar to Liang et al. (2008). The interest of those calibration-free proposals is discussed. The numerical experiments we present highlight the appeal of Bayesian regularization methods, when compared with non-Bayesian alternatives. They dominate frequentist methods in the sense that they provide smaller prediction errors while selecting the most relevant variables in a parsimonious way.
Bayesian Anal., Volume 7, Number 2 (2012), 477-502.
First available in Project Euclid: 16 June 2012
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Celeux, Gilles; El Anbari, Mohammed; Marin, Jean-Michel; Robert, Christian P. Regularization in Regression: Comparing Bayesian and Frequentist Methods in a Poorly Informative Situation. Bayesian Anal. 7 (2012), no. 2, 477--502. doi:10.1214/12-BA716. https://projecteuclid.org/euclid.ba/1339878896