A survey of modern Bayesian asymptotics is given. Specific attention is paid to the Hellinger consistency of posterior distributions and the asymptotic study of Bayes factors.
References
Barron, A. (1988). The exponential convergence of posterior probabilities with implications for Bayes estimators of density functions. Unpublished manuscript. Barron, A. (1988). The exponential convergence of posterior probabilities with implications for Bayes estimators of density functions. Unpublished manuscript.
Barron, A., Schervish, M. J. and Wasserman, L. (1999). The consistency of posterior distributions in nonparametric problems. Ann. Statist. 27 536--561. MR1714718 10.1214/aos/1017939142 euclid.aos/1018031206 0980.62039 Barron, A., Schervish, M. J. and Wasserman, L. (1999). The consistency of posterior distributions in nonparametric problems. Ann. Statist. 27 536--561. MR1714718 10.1214/aos/1017939142 euclid.aos/1018031206 0980.62039
Bernardo, J. M. and Smith, A. F. M. (1994). Bayesian Theory. Wiley, New York. MR1274699 0796.62002 Bernardo, J. M. and Smith, A. F. M. (1994). Bayesian Theory. Wiley, New York. MR1274699 0796.62002
Diaconis, P. and Freedman, D. (1986). On the consistency of Bayes estimates (with discussion). Ann. Statist. 14 1--67. MR829555 0090-5364%28198603%2914%3A1%3C1%3AOTCOBE%3E2.0.CO%3B2-U Diaconis, P. and Freedman, D. (1986). On the consistency of Bayes estimates (with discussion). Ann. Statist. 14 1--67. MR829555 0090-5364%28198603%2914%3A1%3C1%3AOTCOBE%3E2.0.CO%3B2-U
Diaconis, P. and Freedman, D. (1993). Nonparametric binary regression: A Bayesian approach. Ann. Statist. 21 2108--2137. MR1245784 0090-5364%28199312%2921%3A4%3C2108%3ANBRABA%3E2.0.CO%3B2-V Diaconis, P. and Freedman, D. (1993). Nonparametric binary regression: A Bayesian approach. Ann. Statist. 21 2108--2137. MR1245784 0090-5364%28199312%2921%3A4%3C2108%3ANBRABA%3E2.0.CO%3B2-V
Diaconis, P. and Freedman, D. (1998). Consistency of Bayes estimates for nonparametric regression: Normal theory. Bernoulli 4 411--444. MR1679791 10.2307/3318659 1037.62031 euclid.bj/1173883814
Diaconis, P. and Freedman, D. (1998). Consistency of Bayes estimates for nonparametric regression: Normal theory. Bernoulli 4 411--444. MR1679791 10.2307/3318659 1037.62031 euclid.bj/1173883814
Doksum, K. A. (1974). Tailfree and neutral random probabilities and their posterior distributions. Ann. Probab. 2 183--201. MR373081 10.1214/aop/1176996703 Doksum, K. A. (1974). Tailfree and neutral random probabilities and their posterior distributions. Ann. Probab. 2 183--201. MR373081 10.1214/aop/1176996703
Draper, D. (1999). Discussion of ``Bayesian nonparametric inference for random distributions and related functions,'' by S. G. Walker, P. Damien, P. Laud and A. F. M. Smith. J. R. Stat. Soc. Ser. B Stat. Methodol. 61 510--513. MR1707858 10.1111/1467-9868.00190 0983.62027 Draper, D. (1999). Discussion of ``Bayesian nonparametric inference for random distributions and related functions,'' by S. G. Walker, P. Damien, P. Laud and A. F. M. Smith. J. R. Stat. Soc. Ser. B Stat. Methodol. 61 510--513. MR1707858 10.1111/1467-9868.00190 0983.62027
Ferguson, T. S. (1974). Prior distributions on spaces of probability measures. Ann. Statist. 2 615--629. MR438568 0090-5364%28197407%292%3A4%3C615%3APDOSOP%3E2.0.CO%3B2-7 Ferguson, T. S. (1974). Prior distributions on spaces of probability measures. Ann. Statist. 2 615--629. MR438568 0090-5364%28197407%292%3A4%3C615%3APDOSOP%3E2.0.CO%3B2-7
Ghosal, S., Ghosh, J. K. and Ramamoorthi, R. V. (1999a). Posterior consistency of Dirichlet mixtures in density estimation. Ann. Statist. 27 143--158. MR1701105 10.1214/aos/1018031105 euclid.aos/1018031105 0932.62043 Ghosal, S., Ghosh, J. K. and Ramamoorthi, R. V. (1999a). Posterior consistency of Dirichlet mixtures in density estimation. Ann. Statist. 27 143--158. MR1701105 10.1214/aos/1018031105 euclid.aos/1018031105 0932.62043
Ghosal, S., Ghosh, J. K. and Ramamoorthi, R. V. (1999b). Consistency issues in Bayesian nonparametrics. In Asymptotics, Nonparametrics and Time Series: A Tribute to Madan Lal Puri (S. Ghosh, ed.) 639--667. Dekker, New York. MR1724711 1069.62516 Ghosal, S., Ghosh, J. K. and Ramamoorthi, R. V. (1999b). Consistency issues in Bayesian nonparametrics. In Asymptotics, Nonparametrics and Time Series: A Tribute to Madan Lal Puri (S. Ghosh, ed.) 639--667. Dekker, New York. MR1724711 1069.62516
Ghosal, S., Ghosh, J. K. and van der Vaart, A. W. (2000). Convergence rates of posterior distributions. Ann. Statist. 28 500--531. MR1790007 10.1214/aos/1016218228 euclid.aos/1016218228 Ghosal, S., Ghosh, J. K. and van der Vaart, A. W. (2000). Convergence rates of posterior distributions. Ann. Statist. 28 500--531. MR1790007 10.1214/aos/1016218228 euclid.aos/1016218228
Ghosh, J. K. and Ramamoorthi, R. V. (2003). Bayesian Nonparametrics. Springer, New York. MR1992245 1029.62004 Ghosh, J. K. and Ramamoorthi, R. V. (2003). Bayesian Nonparametrics. Springer, New York. MR1992245 1029.62004
Hjort, N. L. (1990). Nonparametric Bayes estimators based on beta processes in models for life history data. Ann. Statist. 18 1259--1294. MR1062708 0090-5364%28199009%2918%3A3%3C1259%3ANBEBOB%3E2.0.CO%3B2-U Hjort, N. L. (1990). Nonparametric Bayes estimators based on beta processes in models for life history data. Ann. Statist. 18 1259--1294. MR1062708 0090-5364%28199009%2918%3A3%3C1259%3ANBEBOB%3E2.0.CO%3B2-U
Kim, Y. and Lee, J. (2001). On posterior consistency of survival models. Ann. Statist. 29 666--686. MR1865336 10.1214/aos/1009210685 euclid.aos/1009210685 1012.62105 Kim, Y. and Lee, J. (2001). On posterior consistency of survival models. Ann. Statist. 29 666--686. MR1865336 10.1214/aos/1009210685 euclid.aos/1009210685 1012.62105
Kraft, C. (1964). A class of distribution function processes which have derivatives. J. Appl. Probability 1 385--388. MR171296 10.2307/3211867 Kraft, C. (1964). A class of distribution function processes which have derivatives. J. Appl. Probability 1 385--388. MR171296 10.2307/3211867
Lavine, M. (1992). Some aspects of Pólya tree distributions for statistical modelling. Ann. Statist. 20 1222--1235. MR1186248 0090-5364%28199209%2920%3A3%3C1222%3ASAOPTD%3E2.0.CO%3B2-2 Lavine, M. (1992). Some aspects of Pólya tree distributions for statistical modelling. Ann. Statist. 20 1222--1235. MR1186248 0090-5364%28199209%2920%3A3%3C1222%3ASAOPTD%3E2.0.CO%3B2-2
Lavine, M. (1994). More aspects of Pólya tree distributions for statistical modelling. Ann. Statist. 22 1161--1176. MR1311970 0090-5364%28199409%2922%3A3%3C1161%3AMAOPTD%3E2.0.CO%3B2-R Lavine, M. (1994). More aspects of Pólya tree distributions for statistical modelling. Ann. Statist. 22 1161--1176. MR1311970 0090-5364%28199409%2922%3A3%3C1161%3AMAOPTD%3E2.0.CO%3B2-R
Lenk, P. J. (1991). Towards a practicable Bayesian nonparametric density estimator. Biometrika 78 531--543. MR1130921 0737.62035 10.2307/2337022 Lenk, P. J. (1991). Towards a practicable Bayesian nonparametric density estimator. Biometrika 78 531--543. MR1130921 0737.62035 10.2307/2337022
Lo, A. Y. (1984). On a class of Bayesian nonparametric estimates. I. Density estimates. Ann. Statist. 12 351--357. MR733519 0090-5364%28198403%2912%3A1%3C351%3AOACOBN%3E2.0.CO%3B2-D Lo, A. Y. (1984). On a class of Bayesian nonparametric estimates. I. Density estimates. Ann. Statist. 12 351--357. MR733519 0090-5364%28198403%2912%3A1%3C351%3AOACOBN%3E2.0.CO%3B2-D
Mauldin, R. D., Sudderth, W. D. and Williams, S. C. (1992). Pólya trees and random distributions. Ann. Statist. 20 1203--1221. MR1186247 0090-5364%28199209%2920%3A3%3C1203%3APTARD%3E2.0.CO%3B2-G Mauldin, R. D., Sudderth, W. D. and Williams, S. C. (1992). Pólya trees and random distributions. Ann. Statist. 20 1203--1221. MR1186247 0090-5364%28199209%2920%3A3%3C1203%3APTARD%3E2.0.CO%3B2-G
Schwartz, L. (1965). On Bayes procedures. Z. Wahrsch. Verw. Gebiete 4 10--26. MR184378 10.1007/BF00535479 Schwartz, L. (1965). On Bayes procedures. Z. Wahrsch. Verw. Gebiete 4 10--26. MR184378 10.1007/BF00535479
Shen, X. (2002). Asymptotic normality of semiparametric and nonparametric posterior distributions. J. Amer. Statist. Assoc. 97 222--235. MR1947282 10.1198/016214502753479365 1073.62517 Shen, X. (2002). Asymptotic normality of semiparametric and nonparametric posterior distributions. J. Amer. Statist. Assoc. 97 222--235. MR1947282 10.1198/016214502753479365 1073.62517
Shen, X. and Wasserman, L. (2001). Rates of convergence of posterior distributions. Ann. Statist. 29 687--714. MR1865337 10.1214/aos/1009210686 euclid.aos/1009210686 1041.62022 Shen, X. and Wasserman, L. (2001). Rates of convergence of posterior distributions. Ann. Statist. 29 687--714. MR1865337 10.1214/aos/1009210686 euclid.aos/1009210686 1041.62022
Walker, S. G. (2003). On sufficient conditions for Bayesian consistency. Biometrika 90 482--488. MR1986664 1034.62024 10.1093/biomet/90.2.482 Walker, S. G. (2003). On sufficient conditions for Bayesian consistency. Biometrika 90 482--488. MR1986664 1034.62024 10.1093/biomet/90.2.482
Walker, S. G. (2004). New approaches to Bayesian consistency. Ann. Statist. To appear. MR2102501 10.1214/009053604000000409 euclid.aos/1098883780 1056.62040 Walker, S. G. (2004). New approaches to Bayesian consistency. Ann. Statist. To appear. MR2102501 10.1214/009053604000000409 euclid.aos/1098883780 1056.62040
Walker, S. G., Damien, P. and Lenk, P. J. (2004). On priors with a Kullback--Leibler property. J. Amer. Statist. Assoc. 99 404--408. MR2062826 10.1198/016214504000000386 1117.62437 Walker, S. G., Damien, P. and Lenk, P. J. (2004). On priors with a Kullback--Leibler property. J. Amer. Statist. Assoc. 99 404--408. MR2062826 10.1198/016214504000000386 1117.62437
Walker, S. G. and Hjort, N. L. (2001). On Bayesian consistency. J. R. Stat. Soc. Ser. B Stat. Methodol. 63 811--821. MR1872068 10.1111/1467-9868.00314 0987.62021 Walker, S. G. and Hjort, N. L. (2001). On Bayesian consistency. J. R. Stat. Soc. Ser. B Stat. Methodol. 63 811--821. MR1872068 10.1111/1467-9868.00314 0987.62021
Wasserman, L. (1998). Asymptotic properties of nonparametric Bayesian procedures. In Practical Nonparametric and Semiparametric Bayesian Statistics. Lecture Notes in Statist. 133 293--304. Springer, New York. MR1630088 0918.62045 Wasserman, L. (1998). Asymptotic properties of nonparametric Bayesian procedures. In Practical Nonparametric and Semiparametric Bayesian Statistics. Lecture Notes in Statist. 133 293--304. Springer, New York. MR1630088 0918.62045
Wong, W. H. and Shen, X. (1995). Probability inequalities for likelihood ratios and convergence rates of sieve MLEs. Ann. Statist. 23 339--362. MR1332570 0090-5364%28199504%2923%3A2%3C339%3APIFLRA%3E2.0.CO%3B2-3 Wong, W. H. and Shen, X. (1995). Probability inequalities for likelihood ratios and convergence rates of sieve MLEs. Ann. Statist. 23 339--362. MR1332570 0090-5364%28199504%2923%3A2%3C339%3APIFLRA%3E2.0.CO%3B2-3