Bayesian Analysis

Hypothesis Assessment and Inequalities for Bayes Factors and Relative Belief Ratios

Zeynep Baskurt and Michael Evans

Full-text: Open access

Abstract

We discuss the definition of a Bayes factor and develop some inequalities relevant to Bayesian inferences. An approach to hypothesis assessment based on the computation of a Bayes factor, a measure of the strength of the evidence given by the Bayes factor via a posterior probability, and the point where the Bayes factor is maximized is recommended. It is also recommended that the a priori properties of a Bayes factor be considered to assess possible bias inherent in the Bayes factor. This methodology can be seen to deal with many of the issues and controversies associated with hypothesis assessment. We present an application to a two-way analysis.

Article information

Source
Bayesian Anal., Volume 8, Number 3 (2013), 569-590.

Dates
First available in Project Euclid: 9 September 2013

Permanent link to this document
https://projecteuclid.org/euclid.ba/1378729920

Digital Object Identifier
doi:10.1214/13-BA824

Mathematical Reviews number (MathSciNet)
MR3102226

Zentralblatt MATH identifier
1329.62115

Keywords
Bayes factors relative belief ratios strength of evidence a priori bias

Citation

Baskurt, Zeynep; Evans, Michael. Hypothesis Assessment and Inequalities for Bayes Factors and Relative Belief Ratios. Bayesian Anal. 8 (2013), no. 3, 569--590. doi:10.1214/13-BA824. https://projecteuclid.org/euclid.ba/1378729920


Export citation

References

  • Aitkin, M. (2010) Statistical Inference: An Integrated Bayesian/LikelihoodApproach. CRC Press, Boca Raton.
  • Berger, J.O. and Delampady, M. (1987) Testing Precise Hypotheses.Statistical Science, 2, 317–335.
  • Berger, J.O., Liseo, B., and Wolpert, R.L. (1999) Integratedlikelihood methods for eliminating nuisance parameters. Statistical Science, 14, 1, 1–28.
  • Berger, J.O. and Perrichi, R.L. (1996). The intrinsic Bayes factorfor model selection and prediction. Journal of the American Statistical Association 91:10–122.
  • Dickey, J.M. and Lientz, B.P. (1970). The weighted likelihood ratio, sharp hypotheses about chances, the order of a Markov chain. Annals of Mathematical Statistics, 41, 1, 214–226.
  • Dickey, J.M. (1971). The weighted likelihood ratio, linearhypotheses on normal location parameters. Annals of Statistics, 42, 204–223.
  • Evans, M. Bayesian inference procedures derived via the concept ofrelative surprise. (1997) Communications in Statistics, Theory and Methods, 26, 5, 1125–1143, 1997.
  • Evans, M. Guttman, I. and Swartz, T. (2006) Optimality andcomputations for relative surprise inferences. Canadian Journal of Statistics, 34, 1, 113–129.
  • Evans, M. and Jang, G-H. (2011a) Weak informativity and theinformation in one prior relative to another. Statistical Science, 2011, 26, 3, 423–439.
  • Evans, M. and Jang, G-H. (2011b) A limit result for the priorpredictive applied to checking for prior-data conflict. Statistics andProbability Letters, 81, 1034–1038.
  • Evans, M. and Jang, G-H. (2011c) Inferences from prior-based lossfunctions. Technical Report No. 1104, Department of Statistics, University of Toronto.
  • Evans, M. and Moshonov, H. (2006) Checking for prior-data conflict. Bayesian Analysis, 1, 4, 893–914.
  • Evans, M. and Shakhatreh, M. (2008) Optimal properties of some Bayesian inferences. Electronic Journal of Statistics, 2, 1268–1280.
  • Garcia-Donato, G. and Chen, M-H. (2005) Calibrating Bayes factorunder prior predictive distributions. Statistica Sinica, 15, 359–380.
  • Gelman, A., Carlin, J.B., Stern, H.S. and Rubin, D.B. (2004) Bayesian Data Analysis, Second Edition. Chapman and Hall/CRC, Boca Raton, FL.
  • Jeffreys, H. (1935) Some Tests of Significance, Treated by theTheory of Probability. Proceedings of the Cambridge Philosophy Society, 31, 203–222.
  • Jeffreys, H. (1961) Theory of Probability (3rd ed.), OxfordUniversity Press, Oxford.
  • Johnson, V.E., Rossell, D. (2010) On the use of non-local priordensities in Bayesian hypothesis tests. Journal of the Royal StatisticalSociety: Series B, 72, 2, 143–170.
  • Kass, R.E. and Raftery, A.E. (1995) Bayes factors. Journal of theAmerican Statistical Association, 90, 430, 773-795.
  • Lavine, M. and Schervish, M.J. (1999) Bayes Factors: what they areand what they are not. The American Statistician, 53, 2, 119–122.
  • Marin, J-M., and Robert, C.P. (2010) On resolving the Savage-Dickeyparadox. Electronic Journal of Statistics, 4, 643-654.
  • O’Hagan, A. (1995) Fractional Bayes factors for modelcomparisons (with discussion). Journal of the Royal Statistical Society B56:3–48.
  • Robert, C.P., Chopin, N. and Rousseau, J. (2009) Harold Jeffreys’s Theory of Probability Revisited (with discussion). Statistical Science, 24, 2, 141–172.
  • Royall, R. (1997) Statistical Evidence. A likelihood paradigm.Chapman and Hall, London.
  • Royall, R. (2000) On the probability of observing misleadingstatistical evidence (with discussion). Journal of the AmericanStatistical Association, 95, 451, 760–780.
  • Rudin, W. (1974) Real and Complex Analysis, Second Edition.McGraw-Hill, New York.
  • Tjur, T. (1974) Conditional Probability Models. Institute ofMathematical Statistics, University of Copenhagen, Copenhagen.
  • Verdinelli, I. and Wasserman, L. (1995) Computing Bayes factorsusing a generalization of the Savage-Dickey density ratio. Journal of theAmerican Statistical Association, 90, 430, 614–618.
  • Vlachos, P.K. and Gelfand, A.E. (2003) On the calibration ofBayesian model choice criteria. Journal of Statistical Planning and Inference, 111, 223–234.