Source: Ann. Appl. Probab. Volume 19, Number 2
(2009), 737-777.
We provide a sharp nonasymptotic analysis of the rates of convergence for some standard multivariate Markov chains using spectral techniques. All chains under consideration have multivariate orthogonal polynomial as eigenfunctions. Our examples include the Moran model in population genetics and its variants in community ecology, the Dirichlet-multinomial Gibbs sampler, a class of generalized Bernoulli–Laplace processes, a generalized Ehrenfest urn model and the multivariate normal autoregressive process.
References
[1] Aldous, D. and Diaconis, P. (1987). Strong uniform times and finite random walks. Adv. in Appl. Math. 8 69–97.
Mathematical Reviews (MathSciNet):
MR876954
[2] Athreya, K. B., Doss, H. and Sethuraman, J. (1996). On the convergence of the Markov chain simulation method. Ann. Statist. 24 69–100.
[3] Barone, P., Sebastiani, G. and Stander, J. (2000). General overrelaxation MCMC algorithms for Gaussian densities. Technical Report 9/2000, Istituto por le Applicazioni del Calcolo “M. Picone,” Consiglio Nazionale delle Ricerche, Rome, Italy.
[4] Barone, P. and Frigessi, A. (1990). Improving stochastic relaxation for Gaussian random fields. Probab. Engrg. Inform. Sci. 4 369–389.
[5] Cannings, C. (1974). The latent roots of certain Markov chains arising in genetics: A new approach. I. Haploid models. Adv. in Appl. Probab. 6 260–290.
Mathematical Reviews (MathSciNet):
MR343949
[6] Diaconis, P. and Shahshahani, M. (1987). Time to reach stationarity in the Bernoulli–Laplace diffusion model. SIAM J. Math. Anal. 18 208–218.
Mathematical Reviews (MathSciNet):
MR871832
[7] Diaconis, P. and Fill, J. A. (1990). Strong stationary times via a new form of duality. Ann. Probab. 18 1483–1522.
[8] Diaconis, P. and Stroock, D. (1991). Geometric bounds for eigenvalues of Markov chains. Ann. Appl. Probab. 1 36–61.
[9] Diaconis, P. and Freedman, D. (1999). Iterated random functions. SIAM Rev. 41 45–76 (electronic).
[10] Diaconis, P., Khare, K. and Saloff-Coste, L. (2008). Gibbs sampling, exponential families and coupling. Submitted.
[11] Diaconis, P., Khare, K. and Saloff-Coste, L. (2008). Gibbs sampling, exponential families and orthogonal polynomials. Statist. Sci. 23 151–200.
[12] Diaconis, P. and Saloff-Coste, L. (1996). Nash inequalities for finite Markov chains. J. Theoret. Probab. 9 459–510.
[13] Diaconis, P. and Saloff-Coste, L. (1996). Logarithmic Sobolev inequalities for finite Markov chains. Ann. Appl. Probab. 6 695–750.
[14] Diaconis, P. and Stanton, D. (2008). Hypergeometric walk. Preprint, Dept. Statistics, Stanford Univ.
[15] Donnelly, P., Lloyd, P. and Sudbury, A. (1994). Approach to stationarity of the Bernoulli–Laplace diffusion model. Adv. in Appl. Probab. 26 715–727.
[16] Donnelly, P. and Rodrigues, E. R. (2000). Convergence to stationarity in the Moran model. J. Appl. Probab. 37 705–717.
[17] Dunkl, C. F. and Xu, Y. (2001). Orthogonal Polynomials of Several Variables. Encyclopedia of Mathematics and Its Applications 81. Cambridge Univ. Press.
[18] Ewens, W. J. (2004). Mathematical Population Genetics. I, 2nd ed. Interdisciplinary Applied Mathematics 27. Springer, New York.
[19] Feller, W. (1951). Diffusion processes in genetics. In Proc. Second Berkeley Symp. Math. Statist. Probab. 1950 227–246. Univ. California Press, Berkeley.
Mathematical Reviews (MathSciNet):
MR46022
[20] Feller, W. (1968). An Introduction to Probability Theory and Its Applications. Vol. I. 3rd ed. Wiley, New York.
Mathematical Reviews (MathSciNet):
MR228020
[21] Fulman, J. (2008). Commutation relations and Markov chains. Probab. Theory Related Fields. To appear.
[22] Goodman, J. and Sokal, L. (1984). Multigrid Monte Carlo method: Conceptual foundations. Phys. Rev. D 40 2035–2071.
[23] Griffiths, R. C. (1971). Orthogonal polynomials on the multinomial distribution. Austral. J. Statist. 13 27–35.
Mathematical Reviews (MathSciNet):
MR275548
[24] Griffiths, R. C. (1979). A transition density expansion for a multi-allele diffusion model. Adv. in Appl. Probab. 11 310–325.
Mathematical Reviews (MathSciNet):
MR526415
[25] Griffiths, R. C. and Spano, D. (2008). Multivariate Jacobi and Laguerre polynomials, infinite-dimensional extensions, and their probabilistic connections with multivariate Hahn and Meixner polynomials. Available at www.citebase.org/abstract?id=oai:arXiv. org:0809.1431.
[26] Griffiths, R. C. (2006). Orthogonal polynomials on the multinomial. Preprint, Dept. Statistics, Univ. Oxford.
[27] Hubbell, S. P. (2001). The Unified Neutral Theory of Biodiversity and Biogeography. Monographs in Population Biology 32. Princeton Univ. Press.
[28] Iliev, P. and Xu, Y. (2007). Discrete orthogonal polynomials and difference equations of several variables. Adv. Math. 212 1–36.
[29] Ismail, M. E. H. (2005). Classical and Quantum Orthogonal Polynomials in One Variable. Encyclopedia of Mathematics and Its Applications 98. Cambridge Univ. Press.
[30] Jerrum, M. and Sinclair, A. (1989). Approximating the permanent. SIAM J. Comput. 18 1149–1178.
[31] Johnson, N. L. and Kotz, S. (1977). Urn Models and Their Application. Wiley, New York.
Mathematical Reviews (MathSciNet):
MR488211
[32] Johnson, N. L., Kotz, S. and Balakrishnan, N. (1997). Discrete Multivariate Distributions. Wiley, New York.
[33] Jones, G. L. and Hobert, J. P. (2001). Honest exploration of intractable probability distributions via Markov chain Monte Carlo. Statist. Sci. 16 312–334.
[34] Kac, M. (1947). Random walk and the theory of Brownian motion. Amer. Math. Monthly 54 369–391.
Mathematical Reviews (MathSciNet):
MR21262
[35] Karlin, S. and McGregor, J. (1965). Ehrenfest urn models. J. Appl. Probab. 2 352–376.
Mathematical Reviews (MathSciNet):
MR184284
[36] Karlin, S. and McGregor, J. (1975). Linear growth models with many types and multidimensional Hahn polynomials. In Theory and Application of Special Functions (R. A. Askey, ed.) 261–288. Academic Press, New York.
Mathematical Reviews (MathSciNet):
MR406574
[37] Koornwinder, T. H. and Schwartz, A. L. (1997). Product formulas and associated hypergroups for orthogonal polynomials on the simplex and on a parabolic biangle. Constr. Approx. 13 537–567.
[38] McGill, B. J. (2003). A test of the unified neutral theory of biodiversity. Nature 6934 881–885.
[39] Moran, P. A. P. (1958). Random processes in genetics. Proc. Cambridge Philos. Soc. 54 60–71.
Mathematical Reviews (MathSciNet):
MR127989
[40] Roberts, G. O. and Sahu, S. K. (1997). Updating schemes, correlation structure, blocking and parameterization for the Gibbs sampler. J. Roy. Statist. Soc. Ser. B 59 291–317.
[41] van Doorn, E. A. (2003). Birth–death processes and associated polynomials. In Proceedings of the Sixth International Symposium on Orthogonal Polynomials, Special Functions and Their Applications (Rome, 2001) 153 497–506.
[42] Wilson, D. B. (2004). Mixing times of Lozenge tiling and card shuffling Markov chains. Ann. Appl. Probab. 14 274–325.
[43] Zhou, H. and Lange, K. (2008). Composition Markov chains of multinomial type. J. Appl. Probab. To appear.
[44] Zhou, H. (2008). Examples of multivariate Markov chains with orthogonal polynomial eigenfunctions. Ph.D. thesis, Stanford Univ.