We obtain moment and Gaussian bounds for general coordinate-wise Lipschitz functions evaluated along the sample path of a Markov chain. We treat Markov chains on general (possibly unbounded) state spaces via a coupling method. If the first moment of the coupling time exists, then we obtain a variance inequality. If a moment of order $1+a$ $(a > 0)$ of the coupling time exists, then depending on the behavior of the stationary distribution, we obtain higher moment bounds. This immediately implies polynomial concentration inequalities. In the case that a moment of order $1+ a$ is finite, uniformly in the starting point of the coupling, we obtain a Gaussian bound. We illustrate the general results with house of cards processes, in which both uniform and non-uniform behavior of moments of the coupling time can occur.
References
R. Adamczak, A tail inequality for suprema of unbounded empirical processes with applications to Markov chains. Electron. J. Prob. 13, 1000-1034, (2008). MR2424985 1190.60010 10.1214/EJP.v13-521 euclid.ejp/1464819107R. Adamczak, A tail inequality for suprema of unbounded empirical processes with applications to Markov chains. Electron. J. Prob. 13, 1000-1034, (2008). MR2424985 1190.60010 10.1214/EJP.v13-521 euclid.ejp/1464819107
S. Bobkov and F. Götze. Exponential integrability and transportation cost related to logarithmic Sobolev inequalities. J. Funct. Anal. 163 (1999), 1–28. J. Funct. Anal. 163 (1999), 1–28. 0924.46027 10.1006/jfan.1998.3326S. Bobkov and F. Götze. Exponential integrability and transportation cost related to logarithmic Sobolev inequalities. J. Funct. Anal. 163 (1999), 1–28. J. Funct. Anal. 163 (1999), 1–28. 0924.46027 10.1006/jfan.1998.3326
S. Boucheron, O. Bousquet, G. Lugosi and P. Massart, Moment inequalities for functions of independent random variables. Ann. Prob. 33, 514-560, (2005). 1074.60018 10.1214/009117904000000856 euclid.aop/1109868590S. Boucheron, O. Bousquet, G. Lugosi and P. Massart, Moment inequalities for functions of independent random variables. Ann. Prob. 33, 514-560, (2005). 1074.60018 10.1214/009117904000000856 euclid.aop/1109868590
X. Bressaud, R. Fernández, and A. Galves. Decay of correlations for non-Hölderian dynamics. A coupling approach. Electron. J. Probab. 4 (1999), no. 3 (19 pp.).X. Bressaud, R. Fernández, and A. Galves. Decay of correlations for non-Hölderian dynamics. A coupling approach. Electron. J. Probab. 4 (1999), no. 3 (19 pp.).
D.L. Burkholder. Sharp inequalities for martingales and stochastic integrals. Colloque Paul Lévy sur les Processus Stochastiques (Palaiseau, 1987). Astérisque No. 157-158 (1988), 75–94. MR976214D.L. Burkholder. Sharp inequalities for martingales and stochastic integrals. Colloque Paul Lévy sur les Processus Stochastiques (Palaiseau, 1987). Astérisque No. 157-158 (1988), 75–94. MR976214
S. Chatterjee. Stein's method for concentration inequalities. Probab. Theory Related Fields 138 (2007), no. 1-2, 305–321. 1116.60056 10.1007/s00440-006-0029-yS. Chatterjee. Stein's method for concentration inequalities. Probab. Theory Related Fields 138 (2007), no. 1-2, 305–321. 1116.60056 10.1007/s00440-006-0029-y
J.-R. Chazottes, P. Collet, C. Külske and F. Redig. Concentration inequalities for random fields via coupling. Probab. Theory Related Fields 137 (2007), no. 1-2, 201–225. 1111.60070 10.1007/s00440-006-0026-1J.-R. Chazottes, P. Collet, C. Külske and F. Redig. Concentration inequalities for random fields via coupling. Probab. Theory Related Fields 137 (2007), no. 1-2, 201–225. 1111.60070 10.1007/s00440-006-0026-1
P. Collet. Variance and exponential estimates via coupling. Bull. Braz. Math. Soc. 37 (2006), no. 4, 461–475. 1114.60025 10.1007/s00574-006-0022-1P. Collet. Variance and exponential estimates via coupling. Bull. Braz. Math. Soc. 37 (2006), no. 4, 461–475. 1114.60025 10.1007/s00574-006-0022-1
H. Djellout, A. Guillin and L. Wu. Transportation cost-information inequalities and applications to random dynamical systems and diffusions. Ann. Probab. 32 (2004), no. 3B, 2702–2732. 1061.60011 10.1214/009117904000000531 euclid.aop/1091813628H. Djellout, A. Guillin and L. Wu. Transportation cost-information inequalities and applications to random dynamical systems and diffusions. Ann. Probab. 32 (2004), no. 3B, 2702–2732. 1061.60011 10.1214/009117904000000531 euclid.aop/1091813628
R. Douc, A. Guillin and E. Moulines. Bounds on Regeneration Times and Limit Theorems for Subgeometric Markov Chains. Annales Inst. H. Poincaré, to appear. 1176.60063 10.1214/07-AIHP109 euclid.aihp/1207948218R. Douc, A. Guillin and E. Moulines. Bounds on Regeneration Times and Limit Theorems for Subgeometric Markov Chains. Annales Inst. H. Poincaré, to appear. 1176.60063 10.1214/07-AIHP109 euclid.aihp/1207948218
R. Douc, G. Fort, E. Moulines and P. Soulier, Practical drift conditions for subgeometric rates of convergence. Ann. Appl. Prob. 14, 1353-1377, (2004). 1082.60062 10.1214/105051604000000620 euclid.aoap/1089736288R. Douc, G. Fort, E. Moulines and P. Soulier, Practical drift conditions for subgeometric rates of convergence. Ann. Appl. Prob. 14, 1353-1377, (2004). 1082.60062 10.1214/105051604000000620 euclid.aoap/1089736288
R. Douc, E. Moulines and P. Soulier, Computable convergence rates for sub-geometric ergodic Markov chains. Bernoulli 13, 831-848 (2007). 1131.60065 10.3150/07-BEJ5162 euclid.bj/1186503489R. Douc, E. Moulines and P. Soulier, Computable convergence rates for sub-geometric ergodic Markov chains. Bernoulli 13, 831-848 (2007). 1131.60065 10.3150/07-BEJ5162 euclid.bj/1186503489
A. Fey-den Boer, R. Meester, Ronald, C. Quant, and F. Redig. A probabilistic approach to Zhang's sandpile model. Comm. Math. Phys. 280, 351–388, (2008). 1208.82032 10.1007/s00220-008-0470-0A. Fey-den Boer, R. Meester, Ronald, C. Quant, and F. Redig. A probabilistic approach to Zhang's sandpile model. Comm. Math. Phys. 280, 351–388, (2008). 1208.82032 10.1007/s00220-008-0470-0
S. Goldstein. A note on specifications. Z. Wahrsch. Verw. Gebiete, 46, 45-51 (1978/79). 0405.60089 10.1007/BF00535686S. Goldstein. A note on specifications. Z. Wahrsch. Verw. Gebiete, 46, 45-51 (1978/79). 0405.60089 10.1007/BF00535686
L. Kontorovich and K. Ramanan. Concentration Inequalities for Dependent Random Variables via the Martingale Method, prepint (2007), to appear in Ann. Probab. Mathreview number not available 1154.60310 10.1214/07-AOP384 euclid.aop/1229696598L. Kontorovich and K. Ramanan. Concentration Inequalities for Dependent Random Variables via the Martingale Method, prepint (2007), to appear in Ann. Probab. Mathreview number not available 1154.60310 10.1214/07-AOP384 euclid.aop/1229696598
L. Kontorovich. Obtaining Measure Concentration from Markov Contraction, preprint, 2007 (arXiv:0711.0987). Mathreview number not available 0711.0987 1286.60073L. Kontorovich. Obtaining Measure Concentration from Markov Contraction, preprint, 2007 (arXiv:0711.0987). Mathreview number not available 0711.0987 1286.60073
C. McDiarmid. On the method of bounded differences, Surveys in Combinatorics 1989, Cambridge University Press, Cambridge (1989) 148–188. MR1036755 0712.05012C. McDiarmid. On the method of bounded differences, Surveys in Combinatorics 1989, Cambridge University Press, Cambridge (1989) 148–188. MR1036755 0712.05012
K. Marton. Bounding D-distance by informational divergence: a method to prove measure concentration. Ann. Probab. 24 (1996), no. 2, 857–866. MR1404531 0865.60017 10.1214/aop/1039639365 euclid.aop/1039639365K. Marton. Bounding D-distance by informational divergence: a method to prove measure concentration. Ann. Probab. 24 (1996), no. 2, 857–866. MR1404531 0865.60017 10.1214/aop/1039639365 euclid.aop/1039639365
K. Marton. A measure concentration inequality for contracting Markov chains. Geom. Funct. Anal. 6 (1996), no. 3, 556–571. [Erratum: Geom. Funct. Anal. 7 (1997), no. 3, 609–613.] 0856.60072 10.1007/BF02249263K. Marton. A measure concentration inequality for contracting Markov chains. Geom. Funct. Anal. 6 (1996), no. 3, 556–571. [Erratum: Geom. Funct. Anal. 7 (1997), no. 3, 609–613.] 0856.60072 10.1007/BF02249263
K. Marton. Measure concentration for a class of random processes. Probab. Theory Related Fields 110 (1998), no. 3, 427–439. 0927.60050 10.1007/s004400050154K. Marton. Measure concentration for a class of random processes. Probab. Theory Related Fields 110 (1998), no. 3, 427–439. 0927.60050 10.1007/s004400050154
Y.H. Mao, Convergence rates in strong ergodicity for Markov processes. Stochastic Process. Appl. 116, no. 12, 1964–1976, (2006). MR2307067 10.1016/j.spa.2006.05.008Y.H. Mao, Convergence rates in strong ergodicity for Markov processes. Stochastic Process. Appl. 116, no. 12, 1964–1976, (2006). MR2307067 10.1016/j.spa.2006.05.008
E. Rio. Inégalités de Hoeffding pour les fonctions lipschitziennes de suites dépendantes. [Hoeffding inequalities for Lipschitz functions of dependent sequences] C. R. Acad. Sci. Paris Sér. I Math. 330 (2000), no. 10, 905–908.E. Rio. Inégalités de Hoeffding pour les fonctions lipschitziennes de suites dépendantes. [Hoeffding inequalities for Lipschitz functions of dependent sequences] C. R. Acad. Sci. Paris Sér. I Math. 330 (2000), no. 10, 905–908.
P.-M. Samson. Concentration of measure inequalities for Markov chains and $Phi$-mixing processes. Ann. Probab. 28 (2000), no. 1, 416–461. 1044.60061 10.1214/aop/1019160125 euclid.aop/1019160125P.-M. Samson. Concentration of measure inequalities for Markov chains and $Phi$-mixing processes. Ann. Probab. 28 (2000), no. 1, 416–461. 1044.60061 10.1214/aop/1019160125 euclid.aop/1019160125
H. Thorisson. Coupling, stationarity, and regeneration. Probability and its Applications (New York). Springer-Verlag, New York, 2000. 0949.60007H. Thorisson. Coupling, stationarity, and regeneration. Probability and its Applications (New York). Springer-Verlag, New York, 2000. 0949.60007
