The Annals of Statistics
- Ann. Statist.
- Volume 39, Number 4 (2011), 2007-2020.
On Bayes’s theorem for improper mixtures
Although Bayes’s theorem demands a prior that is a probability distribution on the parameter space, the calculus associated with Bayes’s theorem sometimes generates sensible procedures from improper priors, Pitman’s estimator being a good example. However, improper priors may also lead to Bayes procedures that are paradoxical or otherwise unsatisfactory, prompting some authors to insist that all priors be proper. This paper begins with the observation that an improper measure on Θ satisfying Kingman’s countability condition is in fact a probability distribution on the power set. We show how to extend a model in such a way that the extended parameter space is the power set. Under an additional finiteness condition, which is needed for the existence of a sampling region, the conditions for Bayes’s theorem are satisfied by the extension. Lack of interference ensures that the posterior distribution in the extended space is compatible with the original parameter space. Provided that the key finiteness condition is satisfied, this probabilistic analysis of the extended model may be interpreted as a vindication of improper Bayes procedures derived from the original model.
Ann. Statist., Volume 39, Number 4 (2011), 2007-2020.
First available in Project Euclid: 24 August 2011
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Primary: 62F15: Bayesian inference
Secondary: 62C10: Bayesian problems; characterization of Bayes procedures
McCullagh, Peter; Han, Han. On Bayes’s theorem for improper mixtures. Ann. Statist. 39 (2011), no. 4, 2007--2020. doi:10.1214/11-AOS892. https://projecteuclid.org/euclid.aos/1314190621