Open Access
November, 1992 Inference from Iterative Simulation Using Multiple Sequences
Andrew Gelman, Donald B. Rubin
Statist. Sci. 7(4): 457-472 (November, 1992). DOI: 10.1214/ss/1177011136


The Gibbs sampler, the algorithm of Metropolis and similar iterative simulation methods are potentially very helpful for summarizing multivariate distributions. Used naively, however, iterative simulation can give misleading answers. Our methods are simple and generally applicable to the output of any iterative simulation; they are designed for researchers primarily interested in the science underlying the data and models they are analyzing, rather than for researchers interested in the probability theory underlying the iterative simulations themselves. Our recommended strategy is to use several independent sequences, with starting points sampled from an overdispersed distribution. At each step of the iterative simulation, we obtain, for each univariate estimand of interest, a distributional estimate and an estimate of how much sharper the distributional estimate might become if the simulations were continued indefinitely. Because our focus is on applied inference for Bayesian posterior distributions in real problems, which often tend toward normality after transformations and marginalization, we derive our results as normal-theory approximations to exact Bayesian inference, conditional on the observed simulations. The methods are illustrated on a random-effects mixture model applied to experimental measurements of reaction times of normal and schizophrenic patients.


Download Citation

Andrew Gelman. Donald B. Rubin. "Inference from Iterative Simulation Using Multiple Sequences." Statist. Sci. 7 (4) 457 - 472, November, 1992.


Published: November, 1992
First available in Project Euclid: 19 April 2007

zbMATH: 06853057
Digital Object Identifier: 10.1214/ss/1177011136

Keywords: Bayesian inference , Convergence of stochastic processes , ECM , EM , Gibbs sampler , importance sampling , Metropolis algorithm , multiple imputation , random-effects model , SIR

Rights: Copyright © 1992 Institute of Mathematical Statistics

Vol.7 • No. 4 • November, 1992
Back to Top