- Bayesian Anal.
- Volume 7, Number 3 (2012), 567-590.
Simulation-based Regularized Logistic Regression
In this paper, we develop a simulation-based framework for regularized logistic regression, exploiting two novel results for scale mixtures of normals. By carefully choosing a hierarchical model for the likelihood by one type of mixture, and implementing regularization with another, we obtain new MCMC schemes with varying efficiency depending on the data type (binary v. binomial, say) and the desired estimator (maximum likelihood, maximum a posteriori, posterior mean). Advantages of our omnibus approach include flexibility, computational efficiency, applicability in $p\gg n$ settings, uncertainty estimates, variable selection, and assessing the optimal degree of regularization. We compare our methodology to modern alternatives on both synthetic and real data. An R package called reglogit is available on CRAN.
Bayesian Anal. Volume 7, Number 3 (2012), 567-590.
First available in Project Euclid: 28 August 2012
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Gramacy, Robert B.; Polson, Nicholas G. Simulation-based Regularized Logistic Regression. Bayesian Anal. 7 (2012), no. 3, 567--590. doi:10.1214/12-BA719. http://projecteuclid.org/euclid.ba/1346158776.