Bayesian Analysis

On the Limiting Behavior of the “Probability of Claiming Superiority” in a Bayesian Context

Morris L. Eaton, Robb J. Muirhead, and Adina I. Soaita

Full-text: Open access

Abstract

In the context of Bayesian sample size determination in clinical trials, a quantity of interest is the marginal probability that the posterior probability of an alternative hypothesis of interest exceeds a specified threshold. This marginal probability is the same as “average power”; that is, the average of the power function with respect to the prior distribution when using a test based on a Bayesian rejection region. We give conditions under which this marginal probability (or average power) converges to the prior probability of the alternative hypothesis as the sample size increases. This same large sample behavior also holds for the average power of a (frequentist) consistent test. We also examine the limiting behavior of “conditional average power”; that is, power averaged with respect to the prior distribution conditional on the alternative hypothesis being true.

Article information

Source
Bayesian Anal., Volume 8, Number 1 (2013), 221-232.

Dates
First available in Project Euclid: 4 March 2013

Permanent link to this document
https://projecteuclid.org/euclid.ba/1362406658

Digital Object Identifier
doi:10.1214/13-BA809

Mathematical Reviews number (MathSciNet)
MR3036260

Zentralblatt MATH identifier
1329.62126

Keywords
Bayesian design probability of a successful trial average power Bayesian hypothesis testing clinical trials sample size determination

Citation

Eaton, Morris L.; Muirhead, Robb J.; Soaita, Adina I. On the Limiting Behavior of the “Probability of Claiming Superiority” in a Bayesian Context. Bayesian Anal. 8 (2013), no. 1, 221--232. doi:10.1214/13-BA809. https://projecteuclid.org/euclid.ba/1362406658


Export citation

References

  • Billingsley, P. (1968). Convergence of Probability Measures. New York: Wiley.
  • Blackwell, D. and Dubins, L. (1962). “Merging of opinions with increasing information.” Annals of Mathematical Statistics, 33: 882–886.
  • Brutti, P., De Santis, F., and Gubiotti, S. (2008). “Robust Bayesian sample size determination in clinical trials.” Statistics in Medicine, 27: 2290–2306.
  • Doob, J. L. (1949). “Application of the theory of martingales.” In Le Calcul des Probabilites et ses Applications, 23–27. Centre National de la Recherche Scientifique, Paris. Colloques Internationalaux du Centre National de le Recherche Scientifique, no 13.
  • Ghosh, J. K. and Ramamoorthi, R. V. (2003). Bayesian Nonparametrics. New York: Springer Verlag.
  • Muirhead, R. J. and Soaita, A. I. (2012). “On an approach to Bayesian sample sizing in clinical trials.” In Jones, G. and Shen, X. (eds.), Multivariate Statistics in Modern Statistical Analysis: A Festschrift in honor of Morris L. Eaton. Institute of Mathematical Statistics, Beachwood, Ohio. To appear. Available online at arXiv:1204.4460v1.
  • O’Hagan, A., Steven, J. W., and Campbell, M. J. (2005). “Assurance in clinical trial design.” Pharmaceutical Statistics, 4: 187–201.
  • Spiegelhalter, D. J., Abrams, K. R., and Myles, J. P. (2004). Bayesian Approaches to Clinical Trials and Health Care Evaluation. New York: Wiley.
  • Whitehead, J., Valdes-Marquez, E., Johnson, P., and Graham, G. (2008). “Bayesian sample size for exploratory clinical trials incorporating historical data.” Statistics in Medicine, 27: 2307–2327.