April 2024 An entropic approach for Hamiltonian Monte Carlo: The idealized case
Pierre Monmarché
Author Affiliations +
Ann. Appl. Probab. 34(2): 2243-2293 (April 2024). DOI: 10.1214/23-AAP2021

Abstract

Quantitative long-time entropic convergence and short-time regularization are established for an idealized Hamiltonian Monte Carlo chain which alternatively follows an Hamiltonian dynamics for a fixed time and then partially or totally refreshes its velocity with an auto-regressive Gaussian step. These results, in discrete time, are the analogues of similar results for the continuous-time kinetic Langevin diffusion, and the latter can be obtained from our bounds in a suitable limit regime. The dependency in the log-Sobolev constant of the target measure is sharp and is illustrated on a mean-field case and on a low-temperature regime, with an application to the simulated annealing algorithm. The practical unadjusted algorithm is briefly discussed.

Funding Statement

This work has been partially funded by the French ANR grants EFI (ANR-17-CE40-0030) and SWIDIMS (ANR-20-CE40-0022) and by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation program (grant agreement No 810367), project EMC2.

Acknowledgments

P. Monmarché thanks Alain Durmus for fruitful discussions.

Citation

Download Citation

Pierre Monmarché. "An entropic approach for Hamiltonian Monte Carlo: The idealized case." Ann. Appl. Probab. 34 (2) 2243 - 2293, April 2024. https://doi.org/10.1214/23-AAP2021

Information

Received: 1 October 2022; Revised: 1 September 2023; Published: April 2024
First available in Project Euclid: 3 April 2024

MathSciNet: MR4728169
Digital Object Identifier: 10.1214/23-AAP2021

Subjects:
Primary: 65C05
Secondary: 65C40

Keywords: Langevin diffusion , modified entropy , Monte Carlo , splitting scheme

Rights: Copyright © 2024 Institute of Mathematical Statistics

JOURNAL ARTICLE
51 PAGES

This article is only available to subscribers.
It is not available for individual sale.
+ SAVE TO MY LIBRARY

Vol.34 • No. 2 • April 2024
Back to Top