Open Access
February 2014 Error bounds for Metropolis–Hastings algorithms applied to perturbations of Gaussian measures in high dimensions
Andreas Eberle
Ann. Appl. Probab. 24(1): 337-377 (February 2014). DOI: 10.1214/13-AAP926

Abstract

The Metropolis-adjusted Langevin algorithm (MALA) is a Metropolis–Hastings method for approximate sampling from continuous distributions. We derive upper bounds for the contraction rate in Kantorovich–Rubinstein–Wasserstein distance of the MALA chain with semi-implicit Euler proposals applied to log-concave probability measures that have a density w.r.t. a Gaussian reference measure. For sufficiently “regular” densities, the estimates are dimension-independent, and they hold for sufficiently small step sizes $h$ that do not depend on the dimension either. In the limit $h\downarrow0$, the bounds approach the known optimal contraction rates for overdamped Langevin diffusions in a convex potential.

A similar approach also applies to Metropolis–Hastings chains with Ornstein–Uhlenbeck proposals. In this case, the resulting estimates are still independent of the dimension but less optimal, reflecting the fact that MALA is a higher order approximation of the diffusion limit than Metropolis–Hastings with Ornstein–Uhlenbeck proposals.

Citation

Download Citation

Andreas Eberle. "Error bounds for Metropolis–Hastings algorithms applied to perturbations of Gaussian measures in high dimensions." Ann. Appl. Probab. 24 (1) 337 - 377, February 2014. https://doi.org/10.1214/13-AAP926

Information

Published: February 2014
First available in Project Euclid: 9 January 2014

zbMATH: 1296.60195
MathSciNet: MR3161650
Digital Object Identifier: 10.1214/13-AAP926

Subjects:
Primary: 60J22
Secondary: 60J05 , 65C05 , 65C40

Keywords: contractivity of Markov kernels , coupling , Euler scheme , Langevin diffusion , Markov chain Monte Carlo , Metropolis algorithm

Rights: Copyright © 2014 Institute of Mathematical Statistics

Vol.24 • No. 1 • February 2014
Back to Top