Electronic Journal of Probability
- Electron. J. Probab.
- Volume 20 (2015), paper no. 79, 32 pp.
Concentration inequalities for Markov chains by Marton couplings and spectral methods
We prove a version of McDiarmid’s bounded differences inequality for Markov chains, with constants proportional to the mixing time of the chain. We also show variance bounds and Bernstein-type inequalities for empirical averages of Markov chains. In the case of non-reversible chains, we introduce a new quantity called the “pseudo spectral gap”, and show that it plays a similar role for non-reversible chains as the spectral gap plays for reversible chains. Our techniques for proving these results are based on a coupling construction of Katalin Marton, and on spectral techniques due to Pascal Lezaud. The pseudo spectral gap generalises the multiplicative reversiblication approach of Jim Fill.
Electron. J. Probab., Volume 20 (2015), paper no. 79, 32 pp.
Accepted: 27 July 2015
First available in Project Euclid: 4 June 2016
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Primary: 60E15: Inequalities; stochastic orderings 60J05: Discrete-time Markov processes on general state spaces 60J10: Markov chains (discrete-time Markov processes on discrete state spaces) 28A35: Measures and integrals in product spaces
Secondary: 05C81: Random walks on graphs 68Q87: Probability in computer science (algorithm analysis, random structures, phase transitions, etc.) [See also 68W20, 68W40]
This work is licensed under aCreative Commons Attribution 3.0 License.
Paulin, Daniel. Concentration inequalities for Markov chains by Marton couplings and spectral methods. Electron. J. Probab. 20 (2015), paper no. 79, 32 pp. doi:10.1214/EJP.v20-4039. https://projecteuclid.org/euclid.ejp/1465067185