Lancelot F. James
This paper explores large sample properties of the two-parameter (α, θ) Poisson–Dirichlet Process in two contexts. In a Bayesian context of estimating an unknown probability measure, viewing this process as a natural extension of the Dirichlet process, we explore the consistency and weak convergence of the the two-parameter Poisson–Dirichlet posterior process. We also establish the weak convergence of properly centered two-parameter Poisson–Dirichlet processes for large θ+nα. This latter result complements large θ results for the Dirichlet process and Poisson–Dirichlet sequences, and complements a recent result on large deviation principles for the two-parameter Poisson–Dirichlet process. A crucial component of our results is the use of distributional identities that may be useful in other contexts.
References
[1] Alexander, K. S. (1987). Central limit theorems for stochastic processes under random entropy conditions. Probab. Theory Related Fields 75 351–378.
Mathematical Reviews (MathSciNet):
MR890284
[2] Barron, A., Schervish, M. J. and Wasserman, L. (1999). The consistency of posterior distributions in nonparametric problems. Ann. Statist. 27 536–561.
[3] Bickel, P. J. and Freedman, D. A. (1981). Some asymptotic theory for the bootstrap. Ann. Statist. 9 1196–1217.
Mathematical Reviews (MathSciNet):
MR630103
[4] Blackwell, D. and MacQueen, J. B. (1973). Ferguson distributions via Pólya urn schemes. Ann. Statist. 1 353–355.
[5] Brunner, L. J. and Lo, A. Y. (1996). Limiting posterior distributions under mixture of conjugate priors. Statist. Sinica 6 187–197.
[6] Chaumont, L. and Yor, M. (2003). Exercises in Probability. A Guided Tour from Measure Theory to Random Processes, via Conditioning. Cambridge Univ. Press.
[7] Dawson, D. A. and Feng, S. (2006). Asymptotic behavior of the Poisson–Dirichlet distribution for large mutation rate. Ann. Appl. Probab. 16 562–582.
[8] Feng, S. (2007). Large deviations for Dirichlet processes and Poisson–Dirichlet distribution with two parameters. Electron. J. Probab. 12 787–807.
[9] Ferguson, T. S. (1973). A Bayesian analysis of some nonparametric problems. Ann. Statist. 1 209–230.
Mathematical Reviews (MathSciNet):
MR350949
[10] Freedman, D. A. and Diaconis, P. (1983). On inconsistent Bayes estimates in the discrete case. Ann. Statist. 11 1109–1118.
Mathematical Reviews (MathSciNet):
MR720257
[11] Ghosal, S., Ghosh, J. K. and Ramamoorthi, R. V. (1999). Posterior consistency of Dirichlet mixtures in density estimation. Ann. Statist. 27 143–158.
[12] Ghosal, S., Ghosh, J. K. and van der Vaart, A. W. (2000). Convergence rates of posterior distributions. Ann. Statist. 28 500–531.
[13] Ghosh, J. K. and Ramamoorthi, R. V. (2003). Bayesian Nonparametrics. Springer, New York.
[14] Giné, E. (1997). Lectures on some aspects of the bootstrap. Lectures on Probability Theory and Statistics (Saint-Flour, 1996) 37–151. Lecture Notes in Math. 1665. Springer, Berlin.
[15] Giné, E. and Zinn, J. (1984). Some limit theorems for empirical processes (with discussion). Ann. Probab. 12 929–998.
Mathematical Reviews (MathSciNet):
MR757767
[16] Giné, E. and Zinn, J. (1990). Bootstrapping general empirical measures. Ann. Probab. 18 851–869.
[17] Ishwaran, H. and James, L. F. (2003). Generalized weighted Chinese restaurant processes for species sampling mixture models. Statist. Sinica 13 1211–1235.
[18] Ishwaran, H. and James, L. F. (2001). Gibbs sampling methods for stick-breaking priors. J. Amer. Statist. Assoc. 96 161–173.
[19] James, L. F., Lijoi, A. and Prünster, I. (2008). Distributions of linear functionals of two-parameter Poisson–Dirichlet random measures. Ann. Appl. Probab. 18 521–551.
[20] Jang, J., Lee, J. and Lee, S. (2007). Posterior consistency of species sampling models. Preprint.
[21] Joyce, P., Krone, S. M. and Kurtz, T. G. (2002). Gaussian limits associated with the Poisson–Dirichlet distribution and the Ewens sampling formula. Ann. Appl. Probab. 12 101–124.
[22] Kim, Y. and Lee, J. (2004). A Bernstein-von Mises theorem in the nonparametric right-censoring model. Ann. Statist. 32 1492–1512.
[23] Ledoux, M. and Talagrand, M. (1991). Probability in Banach Spaces. Isoperimetry and Processes. Springer, Berlin.
[24] Ledoux, M. and Talagrand, M. (1986). Conditions d’intégrabilité pour les multiplicateurs dans le TLC banachique. Ann. Probab. 14 916–921.
[25] Lijoi, A., Prünster, I. and Walker, S. G. (2005). On consistency of nonparametric normal mixtures for Bayesian density estimation. J. Amer. Statist. Assoc. 100 1292–1296.
[26] Lo, A. Y. (1993). A Bayesian bootstrap for censored data. Ann. Statist. 21 100–123.
[27] Lo, A. Y. (1987). A large sample study of the Bayesian bootstrap. Ann. Statist. 15 360–375.
Mathematical Reviews (MathSciNet):
MR885742
[28] Lo, A. Y. (1986). A remark on the limiting posterior distribution of the multiparameter Dirichlet process. Sankhyā Ser. A 48 247–249.
Mathematical Reviews (MathSciNet):
MR905464
[29] Lo, A. Y. (1984). On a class of Bayesian nonparametric estimates. I. Density estimates. Ann. Statist. 12 351–357.
Mathematical Reviews (MathSciNet):
MR733519
[30] Lo, A. Y. (1983). Weak convergence for Dirichlet processes. Sankhyā Ser. A 45 105–111.
Mathematical Reviews (MathSciNet):
MR749358
[31] Lo, A. Y. (1982). Bayesian nonparametric statistical inference for Poisson point processes. Z. Wahrsch. Verw. Gebiete 59 55–66.
Mathematical Reviews (MathSciNet):
MR643788
[32] Lynch, J. and Sethuraman, J. (1987). Large deviations for processes with independent increments. Ann. Probab. 15 610–627.
Mathematical Reviews (MathSciNet):
MR885133
[33] Mason, D. M. and Newton, M. A. (1992). A rank statistics approach to the consistency of a general bootstrap. Ann. Statist. 20 1611–1624.
[34] Pitman, J. (2006). Combinatorial Stochastic Processes. Summer School on Probability Theory held in Saint-Flour, July 7–24, 2002. Lecture Notes in Math. 1875. Springer, Berlin.
[35] Pitman, J. (1996). Some developments of the Blackwell–MacQueen urn scheme. Statistics, Probability and Game Theory 245–267. IMS Lecture Notes Monogr. Ser. 30. IMS, Hayward, CA.
[36] Pitman, J. and Yor, M. (1997). The two-parameter Poisson–Dirichlet distribution derived from a stable subordinator. Ann. Probab. 25 855–900.
[37] Praestgaard, J. and Wellner, J. A. (1993). Exchangeably weighted bootstraps of the general empirical process. Ann. Probab. 21 2053–2086.
[38] van der Vaart, A. W. (1998). Asymptotic Statistics. Cambridge Univ. Press.
[39] van der Vaart, A. W. and Wellner, J. A. (1996). Weak Convergence and Empirical Processes. With Applications to Statistics. Springer, New York.
[40] Vershik, A., Yor, M. and Tsilevich, N. (2004). On the Markov–Krein identity and quasi-invariance of the gamma process. J. Math. Sci. 121 2303–2310.
[41] Ziegler, K. (1997). Functional central limit theorems for triangular arrays of function-indexed processes under uniformly integrable entropy conditions. J. Multivariate Anal. 62 233–272.