Electronic Communications in Probability

A Regeneration Proof of the Central Limit Theorem for Uniformly Ergodic Markov Chains

Witold Bednorz, Krzysztof Latuszynski, and Rafal Latala

Full-text: Open access

Abstract

Central limit theorems for functionals of general state space Markov chains are of crucial importance in sensible implementation of Markov chain Monte Carlo algorithms as well as of vital theoretical interest. Different approaches to proving this type of results under diverse assumptions led to a large variety of CLT versions. However due to the recent development of the regeneration theory of Markov chains, many classical CLTs can be reproved using this intuitive probabilistic approach, avoiding technicalities of original proofs. In this paper we provide a characterization of CLTs for ergodic Markov chains via regeneration and then use the result to solve the open problem posed in [Roberts & Rosenthal 2005]. We then discuss the difference between one-step and multiple-step small set condition.

Article information

Source
Electron. Commun. Probab. Volume 13 (2008), paper no. 9, 85-98.

Dates
Accepted: 24 January 2008
First available in Project Euclid: 6 June 2016

Permanent link to this document
https://projecteuclid.org/euclid.ecp/1465233436

Digital Object Identifier
doi:10.1214/ECP.v13-1354

Mathematical Reviews number (MathSciNet)
MR2386065

Zentralblatt MATH identifier
1194.60046

Subjects
Primary: 60J05: Discrete-time Markov processes on general state spaces
Secondary: 60F05: Central limit and other weak theorems

Keywords
Markov chains central limit theorems regeneration ergodicity uniform ergodicity Harris recurrence

Rights
This work is licensed under a Creative Commons Attribution 3.0 License.

Citation

Bednorz, Witold; Latuszynski, Krzysztof; Latala, Rafal. A Regeneration Proof of the Central Limit Theorem for Uniformly Ergodic Markov Chains. Electron. Commun. Probab. 13 (2008), paper no. 9, 85--98. doi:10.1214/ECP.v13-1354. https://projecteuclid.org/euclid.ecp/1465233436


Export citation

References

  • Athreya, K. B.; Ney, P. A new approach to the limit theory of recurrent Markov chains.\n Trans. Amer. Math. Soc. 245 (1978), 493–501.
  • Bradley, Richard C., Jr. Information regularity and the central limit question. Rocky\n Mountain J. Math. 13 (1983), no. 1, 77–97.
  • Breyer, L. A.; Roberts, G. O. Catalytic perfect simulation. Methodol. Comput. Appl.\n Probab. 3 (2001), no. 2, 161–177.
  • Cogburn, R. (1972). The Central Limit Theorem for Markov Processes. In Le Cam, L. E.,\n Neyman, J. & Scott, E. L. (Eds) Proc. Sixth Ann. Berkley Symp. Math. Sttist. and Prob. 2\n 458–512.
  • Geyer C. J. (1992). Practical Markov Chain Monte Carlo. Stat. Sci. 7,\n 473–511.
  • Häggström, Olle. On the central limit theorem for geometrically ergodic Markov chains.\n Probab. Theory Related Fields 132 (2005), no. 1, 74–82.
  • Hobert, James P.; Robert, Christian P. A mixture representation of $\pi$ with\n applications in Markov chain Monte Carlo and perfect sampling. Ann. Appl. Probab. 14 (2004),\n no. 3, 1295–1305.
  • Ibragimov, I. A.; Linnik, Yu. V. Independent and stationary sequences of random\n variables. With a supplementary chapter by I. A. Ibragimov and V. V. Petrov. Translation from\n the Russian edited by J. F. C. Kingman. Wolters-Noordhoff Publishing, Groningen, 1971. 443\n pp.
  • Jones, Galin L. On the Markov chain central limit theorem. Probab. Surv. 1 (2004),\n 299–320 (electronic).
  • Jones, Galin L.; Haran, Murali; Caffo, Brian S.; Neath, Ronald. Fixed-width output\n analysis for Markov chain Monte Carlo. J. Amer. Statist. Assoc. 101 (2006), no. 476,\n 1537–1547.
  • Meyn, S. P.; Tweedie, R. L. Markov chains and stochastic stability.Communications and\n Control Engineering Series. Springer-Verlag London, Ltd., London, 1993. xvi+ 548 pp. ISBN:\n 3-540-19832-6
  • Nummelin, E. A splitting technique for Harris recurrent Markov chains. Z. Wahrsch.\n Verw. Gebiete 43 (1978), no. 4, 309–318.
  • Nummelin, Esa. General irreducible Markov chains and nonnegative operators.Cambridge\n Tracts in Mathematics, 83. Cambridge University Press, Cambridge, 1984. xi+156 pp. ISBN:\n 0-521-25005-6
  • Nummelin E. (2002). MC's for MCMC'ists. International Statistical Review. 70\n 215–240.
  • Propp, James Gary; Wilson, David Bruce. Exact sampling with coupled Markov chains and\n applications to statistical mechanics. Proceedings of the Seventh International Conference on\n Random Structures and Algorithms (Atlanta, GA, 1995). Random Structures Algorithms 9 (1996),\n no. 1-2, 223–252.
  • Roberts, Gareth O.; Rosenthal, Jeffrey S. Geometric ergodicity and hybrid Markov\n chains. Electron. Comm. Probab. 2 (1997), no. 2, 13–25 (electronic). \n
  • Roberts, Gareth O.; Rosenthal, Jeffrey S. General state space Markov chains and MCMC\n algorithms. Probab. Surv. 1 (2004), 20–71 (electronic).