February 2023 Variational formulas for asymptotic variance of general discrete-time Markov chains
Lu-Jing Huang, Yong-Hua Mao
Author Affiliations +
Bernoulli 29(1): 300-322 (February 2023). DOI: 10.3150/21-BEJ1458

Abstract

The asymptotic variance is an important criterion to evaluate the performance of Markov chains, especially for the central limit theorems. We give the variational formulas for the asymptotic variance of discrete-time (non-reversible) Markov chains on general state space. The variational formulas provide many applications, extending the classical Peskun’s comparison theorem to non-reversible Markov chains, and obtaining several comparison theorems between Markov chains with various perturbations.

Funding Statement

Lu-Jing Huang acknowledges support from NSFC (No. 11901096), NSF-Fujian (No. 2020J05036), the Program for Probability and Statistics: Theory and Application (No. IRTL1704), and the Program for Innovative Research Team in Science and Technology in Fujian Province University (IRTSTFJ). Yong-Hua Mao acknowledges support from NSFC (No. 11771047) and National Key Research and Development Program of China (2020YFA0712901).

Acknowledgements

We thank the anonymous referees for their careful reading and corrections. Lu-Jing Huang would like to thank Professors Chii-Ruey Hwang, Ting-Li Chen and Dr. Michael C.H. Choi for helpful discussions (Example 4.6 is from Professor Ting-Li Chen).

Citation

Download Citation

Lu-Jing Huang. Yong-Hua Mao. "Variational formulas for asymptotic variance of general discrete-time Markov chains." Bernoulli 29 (1) 300 - 322, February 2023. https://doi.org/10.3150/21-BEJ1458

Information

Received: 1 January 2021; Published: February 2023
First available in Project Euclid: 13 October 2022

MathSciNet: MR4497248
zbMATH: 1510.60067
Digital Object Identifier: 10.3150/21-BEJ1458

Keywords: asymptotic variance , Comparison theorem , Markov chain , non-reversible , Peskun’s theorem , variational formula

Vol.29 • No. 1 • February 2023
Back to Top