Bayesian Analysis

The Scaled Beta2 Distribution as a Robust Prior for Scales

María-Eglée Pérez, Luis Raúl Pericchi, and Isabel Cristina Ramírez

Full-text: Open access

Abstract

We put forward the Scaled Beta2 (SBeta2) as a flexible and tractable family for modeling scales in both hierarchical and non-hierarchical settings. Various sensible alternatives to the overuse of vague Inverted Gamma priors have been proposed, mainly for hierarchical models. Several of these alternatives are particular cases of the SBeta2 or can be well approximated by it. This family of distributions can be obtained in closed form as a Gamma scale mixture of Gamma distributions, as the Student distribution can be obtained as a Gamma scale mixture of Normal variables. Members of the SBeta2 family arise as intrinsic priors and as divergence based priors in diverse situations, hierarchical and non-hierarchical.

The SBeta2 family unifies and generalizes different proposals in the Bayesian literature, and has numerous theoretical and practical advantages: it is flexible, its members can be lighter, as heavy or heavier tailed as the half-Cauchy, and different behaviors at the origin can be modeled. It has the reciprocality property, i.e if the variance parameter is in the family the precision also is. It is easy to simulate from, and can be embedded in a Gibbs sampling scheme. Short of not being conjugate, it is also amazingly tractable: when coupled with a conditional Cauchy prior for locations, the marginal prior for locations can be found explicitly as proportional to known transcendental functions, and for integer values of the hyperparameters an analytical closed form exists. Furthermore, for specific choices of the hyperparameters, the marginal is found to be an explicit “horseshoe prior”, which are known to have excellent theoretical and practical properties. To our knowledge this is the first closed form horseshoe prior obtained. We also show that for certain values of the hyperparameters the mixture of a Normal and a Scaled Beta2 distribution also gives a closed form marginal.

Examples include robust normal and binomial hierarchical modeling and meta-analysis, with real and simulated data.

Article information

Source
Bayesian Anal. Volume 12, Number 3 (2017), 615-637.

Dates
First available in Project Euclid: 26 July 2016

Permanent link to this document
https://projecteuclid.org/euclid.ba/1469553353

Digital Object Identifier
doi:10.1214/16-BA1015

Keywords
Scaled Beta2 distribution prior for scale parameters horseshoe prior intrinsic priors divergence priors reciprocality

Rights
Creative Commons Attribution 4.0 International License.

Citation

Pérez, María-Eglée; Pericchi, Luis Raúl; Ramírez, Isabel Cristina. The Scaled Beta2 Distribution as a Robust Prior for Scales. Bayesian Anal. 12 (2017), no. 3, 615--637. doi:10.1214/16-BA1015. https://projecteuclid.org/euclid.ba/1469553353


Export citation

References

  • Andrade, J. A. A. and O’Hagan, A. (2006). “Bayesian robustness modelling using regularly varying distributions.” Bayesian Analysis, 1: 169–188.
  • Berger, J. (2006). “The case for objective Bayesian analysis.” Bayesian Analysis, 1(3): 385–402.
  • Bradlow, E., Hardie, B., and Fader, P. (2002). “Closed-Form Bayesian Inference for the Negative Binomial Distribution.” Journal of Computational and Graphical Statistics, 11: 189–202.
  • Carvalho, C., Polson, N., and Scott, J. (2010). “The horseshoe estimator for sparse signals.” Biometrika, 87(2): 465–480.
  • De Finetti, B. (1961). “The Bayesian Approach to the Rejection of Outliers.” In Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Contributions to the Theory of Statistics, 199–210. Berkeley, Calif.: University of California Press. http://projecteuclid.org/euclid.bsmsp/1200512167.
  • Diaconis, P. and Ylvisaker, D. (1979). “Conjugate priors for exponential families.” The Annals of Statistics, 7: 269–281.
  • Efron, B. (2010). “The future of indirect evidence.” Statistical Science, 25(2): 145–157.
  • Efron, B. and Morris, C. (1972). “Limiting the risk of Bayes and empirical Bayes estimators-part II: The empirical Bayes case.” Journal of the American Statistical Association, 67: 130–139.
  • Frühwirth-Schnatter, S. and Wagner, H. (2010). “Bayesian Variable Selection for Random Intercept Modeling of Gaussian and non-Gaussian Data.” In Bayesian Statistics 9. J. Bernardo and M. Bayarri and J. O. Berger and A. P. Dawid and D. Heckerman and A. F. M. Smith and M West (eds.).
  • Fúquene, J., Pérez, M., and Pericchi, L. (2014). “An alternative to the Inverted Gamma for the variances to modelling outliers and structural breaks in dynamic models.” Brazilian Journal of Probability and Statistics, 28(2): 288–299.
  • Gelman, A. (2006). “Prior distributions for variance parameters in hierarchical models.” Bayesian Analysis, 1(3): 515–533.
  • Giron, J., Martinez, L., Moreno, E., and Torres, F. (2006). “Objective testing procedures in linear models: Calibration of the p-values.” Scandinavian Journal of Statistics, 33(4): 765–784.
  • Griffin, J. E. and Brown, P. J. (2010). “Inference with normal-gamma prior distributions in regression problems.” Bayesian Analysis, 5(1): 171–188.
  • Liang, F., Paulo, R., Molina, G., Clyde, M., and Berger, J. (2008). “Mixtures of g priors for Bayesian variable selection.” Journal of the American Statistical Association, 103(481): 410–423.
  • Maruyama, Y. and George, E. (2011). “Fully Bayes factors with a generalized g-prior.” The Annals of Statistics, 39: 2740–2765.
  • Normand, S. T. and Shahian, D. M. (2007). “Statistical and clinical aspects of hospital outcomes profiling.” Statistical Science, 22(2): 206–226.
  • Pérez, M., Pericchi, L., and Ramírez, I. (2016). “Supplementary Material of “The Scaled Beta2 Distribution as a Robust Prior for Scales”.” Bayesian Analysis.
  • Pericchi, L. (2005). “Model selection and hypothesis testing based on objective probabilities and Bayes factors.” In Handbook of Statistics, 25, 115–149.
  • Pericchi, L. (2010). “Discussion of Polson, N, and Scott, J.” In Bayesian Statistics 9, 531. Oxford University Press.
  • Pericchi, L., Figueroa, N., Perez, J., and Torres, D. (2011). “Age-Period-Cohort Robust Bayesian Models for Projecting Cancer Incidence and Mortality in Puerto Rico.” Working Paper, Center for Biostatistics and Bioinformatics, UPR-RRP. http://hdl.handle.net/10586 /145
  • Polson, N. and Scott, J. (2012). “On the half-Cauchy prior for a global scale parameter.” Bayesian Analysis, 4: 771–1052.
  • Scott, J. G. and Berger, J. O. (2006). “An exploration of aspects of Bayesian multiple testing.” Journal of Statistical Planning and Inference, 136: 2144–2162.
  • Sparks, D., Khare, K., Ghosh, M., and Xiang, R. (2013). “Necessary and sufficient conditions for posterior consistency under g prior.” OBayes 2013, Duke University, Raleigh, USA. http://bayesian.org/sites/default/files/MGhosh.pdf.
  • Thomas, A., Hara, B. O., Ligges, U., and Sturtz, S. (2006). “Making BUGS open.” R News, 6: 12–17.
  • Wang, M. and Sun, X. (2013). “Bayes factor consistency for one-way random effects model.” Statistics: A Journal of Theoretical and Applied Statistics, 47(5): 1104–1115.
  • Wolfram Alpha LLC. (2014). “Wolfram|Alpha.” Access August 20, 2014. http://www.wolframalpha.com.

Supplemental materials