A fundamental problem in Bayesian nonparametrics consists of selecting a prior distribution by assuming that the corresponding predictive probabilities obey certain properties. An early discussion of such a problem, although in a parametric framework, dates back to the seminal work by English philosopher W. E. Johnson, who introduced a noteworthy characterization for the predictive probabilities of the symmetric Dirichlet prior distribution. This is typically referred to as Johnson’s “sufficientness” postulate. In this paper, we review some nonparametric generalizations of Johnson’s postulate for a class of nonparametric priors known as species sampling models. In particular, we revisit and discuss the “sufficientness” postulate for the two parameter Poisson–Dirichlet prior within the more general framework of Gibbs-type priors and their hierarchical generalizations.
Statist. Sci.
32(4):
487-500
(November 2017).
DOI: 10.1214/17-STS619
[1] Antoniak, C. E. (1974). Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems. Ann. Statist. 2 1152–1174. MR365969 10.1214/aos/1176342871 euclid.aos/1176342871
[1] Antoniak, C. E. (1974). Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems. Ann. Statist. 2 1152–1174. MR365969 10.1214/aos/1176342871 euclid.aos/1176342871
[2] Arbel, J., Favaro, S., Nipoti, B. and Teh, Y. W. (2017). Bayesian nonparametric inference for discovery probabilities: Credible intervals and large sample asymptotics. Statist. Sinica 27 839–858.[2] Arbel, J., Favaro, S., Nipoti, B. and Teh, Y. W. (2017). Bayesian nonparametric inference for discovery probabilities: Credible intervals and large sample asymptotics. Statist. Sinica 27 839–858.
[3] Bacallado, S., Battiston, M., Favaro, S. and Trippa, L. (2017). Supplement to “Sufficientness postulates for Gibbs-type priors and hierarchical generalizations.” DOI:10.1214/17-STS619SUPP.[3] Bacallado, S., Battiston, M., Favaro, S. and Trippa, L. (2017). Supplement to “Sufficientness postulates for Gibbs-type priors and hierarchical generalizations.” DOI:10.1214/17-STS619SUPP.
[6] Bacallado, S., Favaro, S. and Trippa, L. (2015). Bayesian nonparametric inference for shared species richness in multiple populations. J. Statist. Plann. Inference 166 14–23.[6] Bacallado, S., Favaro, S. and Trippa, L. (2015). Bayesian nonparametric inference for shared species richness in multiple populations. J. Statist. Plann. Inference 166 14–23.
[7] Battiston, M., Favaro, S., Roy, D. M. and Teh, Y. W. (2016). A characterization of product-form exchangeable feature probability functions. Preprint. Available at arXiv:1607.02066. 1607.02066[7] Battiston, M., Favaro, S., Roy, D. M. and Teh, Y. W. (2016). A characterization of product-form exchangeable feature probability functions. Preprint. Available at arXiv:1607.02066. 1607.02066
[8] Bertoin, J. (2006). Random Fragmentation and Coagulation Processes. Cambridge Studies in Advanced Mathematics 102. Cambridge Univ. Press, Cambridge.[8] Bertoin, J. (2006). Random Fragmentation and Coagulation Processes. Cambridge Studies in Advanced Mathematics 102. Cambridge Univ. Press, Cambridge.
[9] Blackwell, D. and MacQueen, J. B. (1973). Ferguson distributions via Pólya urn schemes. Ann. Statist. 1 353–355. MR362614 10.1214/aos/1176342372 euclid.aos/1176342372
[9] Blackwell, D. and MacQueen, J. B. (1973). Ferguson distributions via Pólya urn schemes. Ann. Statist. 1 353–355. MR362614 10.1214/aos/1176342372 euclid.aos/1176342372
[11] Caron, F. (2012). Bayesian nonparametric models for bipartite graphs. In NIPS’12. Proc. 25th International Conference on Neural Information Processing Systems 2051–2059. Curran Associates Inc., Red Hook, NY.[11] Caron, F. (2012). Bayesian nonparametric models for bipartite graphs. In NIPS’12. Proc. 25th International Conference on Neural Information Processing Systems 2051–2059. Curran Associates Inc., Red Hook, NY.
[12] Caron, F. and Fox, E. B. (2015). Sparse graphs with exchangeable random measures. Preprint. Available at arXiv:1401.1137. 1401.1137[12] Caron, F. and Fox, E. B. (2015). Sparse graphs with exchangeable random measures. Preprint. Available at arXiv:1401.1137. 1401.1137
[13] Caron, F., Teh, Y. W. and Murphy, T. B. (2014). Bayesian nonparametric Plackett–Luce models for the analysis of preferences for college degree programmes. Ann. Appl. Stat. 8 1145–1181.[13] Caron, F., Teh, Y. W. and Murphy, T. B. (2014). Bayesian nonparametric Plackett–Luce models for the analysis of preferences for college degree programmes. Ann. Appl. Stat. 8 1145–1181.
[14] Chen, C., Ding, N. and Buntine, W. (2012). Dependent hierarchical normalized random measures for dynamic topic modeling. In Proc. 29th International Conference on Machine Learning (ICML-12) 895–902.[14] Chen, C., Ding, N. and Buntine, W. (2012). Dependent hierarchical normalized random measures for dynamic topic modeling. In Proc. 29th International Conference on Machine Learning (ICML-12) 895–902.
[15] Chen, C., Rao, V. A., Buntine, W. and Teh, Y. W. (2013). Dependent normalized random measures. In Proc. 30th International Conference on Machine Learning (ICML-13) 969–977.[15] Chen, C., Rao, V. A., Buntine, W. and Teh, Y. W. (2013). Dependent normalized random measures. In Proc. 30th International Conference on Machine Learning (ICML-13) 969–977.
[18] De Blasi, P., Favaro, S., Lijoi, A., Mena, R. H., Prünster, I. and Ruggiero, M. (2015). Are Gibbs-type priors the most natural generalization of the Dirichlet process? IEEE Trans. Pattern Anal. Mach. Intell. 37 212–229.[18] De Blasi, P., Favaro, S., Lijoi, A., Mena, R. H., Prünster, I. and Ruggiero, M. (2015). Are Gibbs-type priors the most natural generalization of the Dirichlet process? IEEE Trans. Pattern Anal. Mach. Intell. 37 212–229.
[20] Ewens, W. J. (1972). The sampling theory of selectively neutral alleles. Theor. Popul. Biol. 3 87–112. Erratum, ibid. 3 240 (1972); erratum, ibid. 3 376 (1972).[20] Ewens, W. J. (1972). The sampling theory of selectively neutral alleles. Theor. Popul. Biol. 3 87–112. Erratum, ibid. 3 240 (1972); erratum, ibid. 3 376 (1972).
[21] Favaro, S., Lijoi, A., Mena, R. H. and Prünster, I. (2009). Bayesian non-parametric inference for species variety with a two-parameter Poisson–Dirichlet process prior. J. R. Stat. Soc. Ser. B. Stat. Methodol. 71 993–1008. MR2750254 10.1111/j.1467-9868.2009.00717.x[21] Favaro, S., Lijoi, A., Mena, R. H. and Prünster, I. (2009). Bayesian non-parametric inference for species variety with a two-parameter Poisson–Dirichlet process prior. J. R. Stat. Soc. Ser. B. Stat. Methodol. 71 993–1008. MR2750254 10.1111/j.1467-9868.2009.00717.x
[23] Favaro, S. and Walker, S. G. (2013). Slice sampling $\sigma$-stable Poisson–Kingman mixture models. J. Comput. Graph. Statist. 22 830–847. MR3173745 10.1080/10618600.2012.681211[23] Favaro, S. and Walker, S. G. (2013). Slice sampling $\sigma$-stable Poisson–Kingman mixture models. J. Comput. Graph. Statist. 22 830–847. MR3173745 10.1080/10618600.2012.681211
[24] Feng, S. and Hoppe, F. M. (1998). Large deviation principles for some random combinatorial structures in population genetics and Brownian motion. Ann. Appl. Probab. 8 975–994.[24] Feng, S. and Hoppe, F. M. (1998). Large deviation principles for some random combinatorial structures in population genetics and Brownian motion. Ann. Appl. Probab. 8 975–994.
[26] Fisher, R. A., Corbet, A. S. and Williams, C. B. (1943). The relation between the number of species and the number of individuals in a random sample of an animal population. J. Anim. Ecol. 12 42–58.[26] Fisher, R. A., Corbet, A. S. and Williams, C. B. (1943). The relation between the number of species and the number of individuals in a random sample of an animal population. J. Anim. Ecol. 12 42–58.
[29] Heaukulani, C. and Roy, D. M. (2015). Gibbs-type Indian buffet processes. Preprint. Available at arXiv:1512.02543. 1512.02543[29] Heaukulani, C. and Roy, D. M. (2015). Gibbs-type Indian buffet processes. Preprint. Available at arXiv:1512.02543. 1512.02543
[30] Herlau, T. (2015). Completely random measures for modeling block-structured sparse networks. Preprint. Available at arXiv:1507.02925. 1507.02925[30] Herlau, T. (2015). Completely random measures for modeling block-structured sparse networks. Preprint. Available at arXiv:1507.02925. 1507.02925
[32] Ho, M., James, L. F. and Lau, J. W. (2007). Gibbs partitions (EPPF’s) derived from a stable subordinator are Fox H and Meijer G transforms. Preprint. Available at arXiv:0708.0619. 0708.0619[32] Ho, M., James, L. F. and Lau, J. W. (2007). Gibbs partitions (EPPF’s) derived from a stable subordinator are Fox H and Meijer G transforms. Preprint. Available at arXiv:0708.0619. 0708.0619
[35] James, L. F. (2002). Poisson process partition calculus with applications to exchangeable models and Bayesian nonparametrics. Preprint. Available at arXiv:math/0205093.[35] James, L. F. (2002). Poisson process partition calculus with applications to exchangeable models and Bayesian nonparametrics. Preprint. Available at arXiv:math/0205093.
[36] James, L. F. (2013). Stick-breaking $\operatorname{PG}(\alpha,\zeta)$-generalized Gamma processes. Preprint. Available at arXiv:1308.6570. 1308.6570[36] James, L. F. (2013). Stick-breaking $\operatorname{PG}(\alpha,\zeta)$-generalized Gamma processes. Preprint. Available at arXiv:1308.6570. 1308.6570
[37] Jo, S., Lee, J., Müller, P., Quintana, F. A. and Trippa, L. (2017). Dependent species sampling models for spatial density estimation. Bayesian Anal. 12 379–406.[37] Jo, S., Lee, J., Müller, P., Quintana, F. A. and Trippa, L. (2017). Dependent species sampling models for spatial density estimation. Bayesian Anal. 12 379–406.
[41] Lee, J., Quintana, F. A., Müller, P. and Trippa, L. (2013). Defining predictive probability functions for species sampling models. Statist. Sci. 28 209–222.[41] Lee, J., Quintana, F. A., Müller, P. and Trippa, L. (2013). Defining predictive probability functions for species sampling models. Statist. Sci. 28 209–222.
[42] Lijoi, A., Mena, R. H. and Prünster, I. (2005). Hierarchical mixture modeling with normalized inverse-Gaussian priors. J. Amer. Statist. Assoc. 100 1278–1291.[42] Lijoi, A., Mena, R. H. and Prünster, I. (2005). Hierarchical mixture modeling with normalized inverse-Gaussian priors. J. Amer. Statist. Assoc. 100 1278–1291.
[43] Lijoi, A., Mena, R. H. and Prünster, I. (2007). Bayesian nonparametric estimation of the probability of discovering new species. Biometrika 94 769–786.[43] Lijoi, A., Mena, R. H. and Prünster, I. (2007). Bayesian nonparametric estimation of the probability of discovering new species. Biometrika 94 769–786.
[44] Lijoi, A., Mena, R. H. and Prünster, I. (2007). Controlling the reinforcement in Bayesian non-parametric mixture models. J. R. Stat. Soc. Ser. B. Stat. Methodol. 69 715–740.[44] Lijoi, A., Mena, R. H. and Prünster, I. (2007). Controlling the reinforcement in Bayesian non-parametric mixture models. J. R. Stat. Soc. Ser. B. Stat. Methodol. 69 715–740.
[45] Lijoi, A. and Prünster, I. (2010). Models beyond the Dirichlet process. In Bayesian Nonparametrics. Camb. Ser. Stat. Probab. Math. 28 80–136. Cambridge Univ. Press, Cambridge.[45] Lijoi, A. and Prünster, I. (2010). Models beyond the Dirichlet process. In Bayesian Nonparametrics. Camb. Ser. Stat. Probab. Math. 28 80–136. Cambridge Univ. Press, Cambridge.
[47] Lijoi, A., Prünster, I. and Walker, S. G. (2008). Bayesian nonparametric estimators derived from conditional Gibbs structures. Ann. Appl. Probab. 18 1519–1547.[47] Lijoi, A., Prünster, I. and Walker, S. G. (2008). Bayesian nonparametric estimators derived from conditional Gibbs structures. Ann. Appl. Probab. 18 1519–1547.
[49] Lo, A. Y. (1991). A characterization of the Dirichlet process. Statist. Probab. Lett. 12 185–187. MR1130354 10.1016/0167-7152(91)90075-3[49] Lo, A. Y. (1991). A characterization of the Dirichlet process. Statist. Probab. Lett. 12 185–187. MR1130354 10.1016/0167-7152(91)90075-3
[50] Lomelí, M., Favaro, S. and Teh, Y. W. (2017). A marginal sampler for $\sigma$-stable Poisson–Kingman mixture models. J. Comput. Graph. Statist. 26 44–53.[50] Lomelí, M., Favaro, S. and Teh, Y. W. (2017). A marginal sampler for $\sigma$-stable Poisson–Kingman mixture models. J. Comput. Graph. Statist. 26 44–53.
[51] Perman, M., Pitman, J. and Yor, M. (1992). Size-biased sampling of Poisson point processes and excursions. Probab. Theory Related Fields 92 21–39.[51] Perman, M., Pitman, J. and Yor, M. (1992). Size-biased sampling of Poisson point processes and excursions. Probab. Theory Related Fields 92 21–39.
[53] Pitman, J. (1996). Some developments of the Blackwell–MacQueen urn scheme. In Statistics, Probability and Game Theory. Institute of Mathematical Statistics Lecture Notes—Monograph Series 30 245–267. IMS, Hayward, CA.[53] Pitman, J. (1996). Some developments of the Blackwell–MacQueen urn scheme. In Statistics, Probability and Game Theory. Institute of Mathematical Statistics Lecture Notes—Monograph Series 30 245–267. IMS, Hayward, CA.
[54] Pitman, J. (2003). Poisson–Kingman partitions. In Statistics and Science: A Festschrift for Terry Speed. Institute of Mathematical Statistics Lecture Notes—Monograph Series 40 1–34. IMS, Beachwood, OH.[54] Pitman, J. (2003). Poisson–Kingman partitions. In Statistics and Science: A Festschrift for Terry Speed. Institute of Mathematical Statistics Lecture Notes—Monograph Series 40 1–34. IMS, Beachwood, OH.
[55] Pitman, J. (2006). Combinatorial Stochastic Processes. Lecture Notes in Math. 1875. Springer, Berlin. Lectures from the 32nd Summer School on Probability Theory held in Saint-Flour, July 7–24, 2002, with a foreword by Jean Picard.[55] Pitman, J. (2006). Combinatorial Stochastic Processes. Lecture Notes in Math. 1875. Springer, Berlin. Lectures from the 32nd Summer School on Probability Theory held in Saint-Flour, July 7–24, 2002, with a foreword by Jean Picard.
[57] Prünster, I. (2002). Random probability measures derived from increasing additive processes and their application to Bayesian statistics Ph.D. thesis, Univ. Pavia.[57] Prünster, I. (2002). Random probability measures derived from increasing additive processes and their application to Bayesian statistics Ph.D. thesis, Univ. Pavia.
[58] Quintana, F. A. and Iglesias, P. L. (2003). Bayesian clustering and product partition models. J. R. Stat. Soc. Ser. B. Stat. Methodol. 65 557–574.[58] Quintana, F. A. and Iglesias, P. L. (2003). Bayesian clustering and product partition models. J. R. Stat. Soc. Ser. B. Stat. Methodol. 65 557–574.
[59] Ravel, J., Gajer, P., Abdo, Z., Schneider, G. M., Koenig, S. S., McCulle, S. L., Karlebach, S., Gorle, R., Russell, J., Tacket, C. O., Brotman, R. M., Davis, C. C., Ault, K., Peralta, L. and Forney, L. J. (2011). Vaginal microbiome of reproductive-age women. Proc. Natl. Acad. Sci. USA 108 4680–4687.[59] Ravel, J., Gajer, P., Abdo, Z., Schneider, G. M., Koenig, S. S., McCulle, S. L., Karlebach, S., Gorle, R., Russell, J., Tacket, C. O., Brotman, R. M., Davis, C. C., Ault, K., Peralta, L. and Forney, L. J. (2011). Vaginal microbiome of reproductive-age women. Proc. Natl. Acad. Sci. USA 108 4680–4687.
[60] Regazzini, E. (1978). Intorno ad alcune questioni relative alla definizione del premio secondo la teoria della credibilià. G. Ist. Ital. Attuari 41 77–89.[60] Regazzini, E. (1978). Intorno ad alcune questioni relative alla definizione del premio secondo la teoria della credibilià. G. Ist. Ital. Attuari 41 77–89.
[61] Regazzini, E., Lijoi, A. and Prünster, I. (2003). Distributional results for means of normalized random measures with independent increments. Ann. Statist. 31 560–585.[61] Regazzini, E., Lijoi, A. and Prünster, I. (2003). Distributional results for means of normalized random measures with independent increments. Ann. Statist. 31 560–585.
[63] Roy, D. M. (2014). The continuum-of-urns scheme, generalized beta and Indian buffet processes, and hierarchies thereof. Preprint. Available at arXiv:1501.00208. 1501.00208[63] Roy, D. M. (2014). The continuum-of-urns scheme, generalized beta and Indian buffet processes, and hierarchies thereof. Preprint. Available at arXiv:1501.00208. 1501.00208
[64] Sato, K. (1999). Lévy Processes and Infinitely Divisible Distributions. Cambridge Studies in Advanced Mathematics 68. Cambridge Univ. Press, Cambridge. Translated from the 1990 Japanese original, revised by the author.[64] Sato, K. (1999). Lévy Processes and Infinitely Divisible Distributions. Cambridge Studies in Advanced Mathematics 68. Cambridge Univ. Press, Cambridge. Translated from the 1990 Japanese original, revised by the author.
[65] Teh, Y. W. (2006). A hierarchical Bayesian language model based on Pitman–Yor processes. In Proceedings of the 21st International Conference on Computational Linguistic.[65] Teh, Y. W. (2006). A hierarchical Bayesian language model based on Pitman–Yor processes. In Proceedings of the 21st International Conference on Computational Linguistic.
[66] Teh, Y. W. and Görür (2010). Indian buffet processes with power-law behavior. In NIPS’09. Proc. 22nd International Conference on Neural Information Processing Systems 1838–1846. Curran Associates Inc., Red Hook, NY.[66] Teh, Y. W. and Görür (2010). Indian buffet processes with power-law behavior. In NIPS’09. Proc. 22nd International Conference on Neural Information Processing Systems 1838–1846. Curran Associates Inc., Red Hook, NY.
[67] Teh, Y. W. and Jordan, M. I. (2010). Hierarchical Bayesian nonparametric models with applications. In Bayesian Nonparametrics. Camb. Ser. Stat. Probab. Math. 28 158–207. Cambridge Univ. Press, Cambridge.[67] Teh, Y. W. and Jordan, M. I. (2010). Hierarchical Bayesian nonparametric models with applications. In Bayesian Nonparametrics. Camb. Ser. Stat. Probab. Math. 28 158–207. Cambridge Univ. Press, Cambridge.
[69] Walker, S. and Muliere, P. (1999). A characterization of a neutral to the right prior via an extension of Johnson’s sufficientness postulate. Ann. Statist. 27 589–599.[69] Walker, S. and Muliere, P. (1999). A characterization of a neutral to the right prior via an extension of Johnson’s sufficientness postulate. Ann. Statist. 27 589–599.
[74] Zabell, S. L. (1997). The continuum of inductive methods revisited. In The Cosmos of Science: Essays in Exploration (J. Earman and J. D. Norton, eds.) Univ. Pittsburgh Press, Pittsburgh, PA.[74] Zabell, S. L. (1997). The continuum of inductive methods revisited. In The Cosmos of Science: Essays in Exploration (J. Earman and J. D. Norton, eds.) Univ. Pittsburgh Press, Pittsburgh, PA.