The Annals of Statistics

Convergence properties of the Gibbs sampler for perturbations of Gaussians

Yali Amit

Full-text: Open access

PDF File (278 KB)

Abstract

The exact second eigenvalue of the Markov operator of the Gibbs sampler with random sweep strategy for Gaussian densities is calculated. A comparison lemma yields an upper bound on the second eigenvalue for bounded perturbations of Gaussians which is a significant improvement over previous bounds. For two-block Gibbs sampler algorithms with a perturbation of the form $\chi(g_1(x^{(1)}) + g_2(x^{(2)}))$ the derivative of the second eigenvalue of the algorithm is calculated exactly at $\chi = 0$, in terms of expectations of the Hessian matrices of $g_1$ and $g_2$.

Article information

Source
Ann. Statist., Volume 24, Number 1 (1996), 122-140.

Dates
First available in Project Euclid: 26 September 2002

Permanent link to this document
https://projecteuclid.org/euclid.aos/1033066202

Digital Object Identifier
doi:10.1214/aos/1033066202

Mathematical Reviews number (MathSciNet)
MR1389883

Zentralblatt MATH identifier
0854.60066

Subjects
Primary: 60J10: Markov chains (discrete-time Markov processes on discrete state spaces) 47B38: Operators on function spaces (general)

Keywords
Second eigenvalue Markov chains integral operators

Citation

Amit, Yali. Convergence properties of the Gibbs sampler for perturbations of Gaussians. Ann. Statist. 24 (1996), no. 1, 122--140. doi:10.1214/aos/1033066202. https://projecteuclid.org/euclid.aos/1033066202


Export citation

References

  • AMIT, Y. 1991. On rates of convergence of stochastic relaxation for Gaussian and non-Gaussian distributions. J. Multivariate Anal. 38 82 100. Z.
    Mathematical Reviews (MathSciNet): MR92i:60069
    Zentralblatt MATH: 0735.60036
    Digital Object Identifier: doi:10.1016/0047-259X(91)90033-X
  • AMIT, Y. and GRENANDER, U. 1991. Comparing sweep strategies for stochastic relaxation. J. Multivariate Anal. 37 197 222. Z.
    Mathematical Reviews (MathSciNet): MR92i:62035
    Zentralblatt MATH: 0735.60035
    Digital Object Identifier: doi:10.1016/0047-259X(91)90080-L
  • AMIT, Y., GRENANDER, U. and PICCIONI, M. 1991. Structural image restoration through deformable templates. J. Amer. Statist. Assoc. 86 376 387. Z.
  • BARONE, P. and FRIGESSI, A. 1990. Improving stochastic relaxation for Gaussian random fields. Probab. Eng. Inform. Sci. 4 369 389. Z.
  • BESAG, J. and GREEN, P. J. 1993. Spatial statistics and Bayesian computation. J. Roy. Statist. Soc. Ser. B 55 25 37. Z.
    Mathematical Reviews (MathSciNet): MR1210422
    JSTOR: links.jstor.org
  • CRAMER, H. 1946. Mathematical Methods of Statistics. Princeton Univ. Press. ´ Z.
    Mathematical Reviews (MathSciNet): MR8,39f
  • DIACONIS, P. and SALOFF-COSTE, L. 1993. Comparison techniques for random walk on finite groups. Ann. Probab. 21 2131 2156. Z.
    Mathematical Reviews (MathSciNet): MR1245303
    Zentralblatt MATH: 0790.60011
    Digital Object Identifier: doi:10.1214/aop/1176989013
    Project Euclid: euclid.aop/1176989013
  • FRIEZE, A., KANNAN, R. and POLSON, N. G. 1994. Sampling from log-concave distributions. Ann.
    Zentralblatt MATH: 0813.60060
    Mathematical Reviews (MathSciNet): MR1284987
    Digital Object Identifier: doi:10.1214/aoap/1177004973
    Project Euclid: euclid.aoap/1177004973
  • GEMAN, D. 1991. Random Fields and Inverse Problems in Imaging. Lecture Notes in Math. 1427. Springer, Berlin. Z.
    Mathematical Reviews (MathSciNet): MR1100283
    Zentralblatt MATH: 0718.60119
  • GEMAN, S. and GEMAN, D. 1984. Stochastic relaxation. Gibbs distributions and the Bayesian restoration of images. IEEE Transactions on Pattern Analy sis and Machine Intelligence 6 721 741. Z.
    Zentralblatt MATH: 0573.62030
  • GOODMAN, J. and SOKAL, A. D. 1989. Multigrid Monte-Carlo method. Conceptual foundations. Phy s. Rev. D 40 2035 2071.
  • GRENANDER, U., CHOW, Y. and KEENAN, D. 1991. HANDS: A Pattern Theoretic Study of Biological Shapes. Springer, New York. Z.
    Mathematical Reviews (MathSciNet): MR1084371
    Zentralblatt MATH: 0808.68018
  • IBRAGIMOV, I. A. and ROZANOV, Y. A. 1978. Gaussian Processes. Springer, New York. Z.
    Mathematical Reviews (MathSciNet): MR543837
    Zentralblatt MATH: 0392.60037
  • KATO, T. 1976. Perturbation Theory for Linear Operators, 2nd ed. Springer, New York. Z.
    Mathematical Reviews (MathSciNet): MR407617
  • KNOERR, A. P. 1988. Global models of natural boundaries: Theory and applications. Ph.D. Thesis, Div. of Applied Mathematics, Brown Univ. Z.
  • MCCULLAGH, P. 1987. Tensor Methods in Statistics. Chapman and Hall, London. Z.
    Mathematical Reviews (MathSciNet): MR88k:62004
    Zentralblatt MATH: 0732.62003
  • MENGERSEN, K. L. and TWEEDIE, R. L. 1996. Rates of convergence of the Hastings and Metropolis algorithms. Ann. Statist. 24 101 121. Z.
    Mathematical Reviews (MathSciNet): MR98c:60081
    Zentralblatt MATH: 0854.60065
    Digital Object Identifier: doi:10.1214/aos/1033066201
    Project Euclid: euclid.aos/1033066201
  • ROSENTHAL, J. S. 1995. Minorization conditions and convergence rates for Markov chain Monte Carlo. J. Amer. Statist. Assoc. 90 558 566. Z.
    Zentralblatt MATH: 0824.60077
    Mathematical Reviews (MathSciNet): MR1340509
    Digital Object Identifier: doi:10.2307/2291067
    JSTOR: links.jstor.org
  • SMITH, A. F. M. and ROBERTS, G. O. 1993. Bayesian computation via the Gibbs sampler and Z. related Markov chain Monte Carlo methods with discussion. J. Roy. Statist. Soc. Ser. B 55 3 23.
    Mathematical Reviews (MathSciNet): MR1210421
    JSTOR: links.jstor.org
  • CHICAGO, ILLINOIS 60637-1514

The Institute of Mathematical Statistics

The Annals of Statistics

New content alerts

Email RSS ToC RSS Article
  • You have access to this content.
  • You have partial access to this content.
  • You do not have access to this content.
Turn Off MathJax

What is MathJax?

More like this

+ See more