## The Annals of Applied Probability

- Ann. Appl. Probab.
- Volume 4, Number 2 (1994), 347-389.

### On the Rate of Convergence of the Metropolis Algorithm and Gibbs Sampler by Geometric Bounds

#### Abstract

In this paper we obtain bounds on the spectral gap of the transition probability matrix of Markov chains associated with the Metropolis algorithm and with the Gibbs sampler. In both cases we prove that, for small values of $T,$ the spectral gap is equal to $1 - \lambda_2,$ where $\lambda_2$ is the second largest eigenvalue of $P$. In the case of the Metropolis algorithm we give also two examples in which the spectral gap is equal to $1 - \lambda_{\min}$, where $\lambda_{\min}$ is the smallest eigenvalue of $P$. Furthermore we prove that random updating dynamics on sites based on the Metropolis algorithm and on the Gibbs sampler have the same rate of convergence at low temperatures. The obtained bounds are discussed and compared with those obtained with a different approach.

#### Article information

**Source**

Ann. Appl. Probab., Volume 4, Number 2 (1994), 347-389.

**Dates**

First available in Project Euclid: 19 April 2007

**Permanent link to this document**

https://projecteuclid.org/euclid.aoap/1177005064

**Digital Object Identifier**

doi:10.1214/aoap/1177005064

**Mathematical Reviews number (MathSciNet)**

MR1272731

**Zentralblatt MATH identifier**

0802.60061

**JSTOR**

links.jstor.org

**Subjects**

Primary: 60J10: Markov chains (discrete-time Markov processes on discrete state spaces)

Secondary: 60J15 15A42: Inequalities involving eigenvalues and eigenvectors

**Keywords**

Gibbs sampler Markov chains Metropolis algorithm rate of convergence

#### Citation

Ingrassia, Salvatore. On the Rate of Convergence of the Metropolis Algorithm and Gibbs Sampler by Geometric Bounds. Ann. Appl. Probab. 4 (1994), no. 2, 347--389. doi:10.1214/aoap/1177005064. https://projecteuclid.org/euclid.aoap/1177005064