Open Access
February 2004 Modern Bayesian Asymptotics
Stephen G. Walker
Statist. Sci. 19(1): 111-117 (February 2004). DOI: 10.1214/088342304000000134
Abstract

A survey of modern Bayesian asymptotics is given. Specific attention is paid to the Hellinger consistency of posterior distributions and the asymptotic study of Bayes factors.

References

1.

Barron, A. (1988). The exponential convergence of posterior probabilities with implications for Bayes estimators of density functions. Unpublished manuscript. Barron, A. (1988). The exponential convergence of posterior probabilities with implications for Bayes estimators of density functions. Unpublished manuscript.

2.

Barron, A., Schervish, M. J. and Wasserman, L. (1999). The consistency of posterior distributions in nonparametric problems. Ann. Statist. 27 536--561. MR1714718 10.1214/aos/1017939142 euclid.aos/1018031206 0980.62039 Barron, A., Schervish, M. J. and Wasserman, L. (1999). The consistency of posterior distributions in nonparametric problems. Ann. Statist. 27 536--561. MR1714718 10.1214/aos/1017939142 euclid.aos/1018031206 0980.62039

3.

Bernardo, J. M. and Smith, A. F. M. (1994). Bayesian Theory. Wiley, New York. MR1274699 0796.62002 Bernardo, J. M. and Smith, A. F. M. (1994). Bayesian Theory. Wiley, New York. MR1274699 0796.62002

4.

Diaconis, P. and Freedman, D. (1986). On the consistency of Bayes estimates (with discussion). Ann. Statist. 14 1--67. MR829555 0090-5364%28198603%2914%3A1%3C1%3AOTCOBE%3E2.0.CO%3B2-U Diaconis, P. and Freedman, D. (1986). On the consistency of Bayes estimates (with discussion). Ann. Statist. 14 1--67. MR829555 0090-5364%28198603%2914%3A1%3C1%3AOTCOBE%3E2.0.CO%3B2-U

5.

Diaconis, P. and Freedman, D. (1993). Nonparametric binary regression: A Bayesian approach. Ann. Statist. 21 2108--2137. MR1245784 0090-5364%28199312%2921%3A4%3C2108%3ANBRABA%3E2.0.CO%3B2-V Diaconis, P. and Freedman, D. (1993). Nonparametric binary regression: A Bayesian approach. Ann. Statist. 21 2108--2137. MR1245784 0090-5364%28199312%2921%3A4%3C2108%3ANBRABA%3E2.0.CO%3B2-V

6.

Diaconis, P. and Freedman, D. (1995). Nonparametric binary regression with random covariates. Probab. Math. Statist. 15 243--273. MR1369802 Diaconis, P. and Freedman, D. (1995). Nonparametric binary regression with random covariates. Probab. Math. Statist. 15 243--273. MR1369802

7.

Diaconis, P. and Freedman, D. (1998). Consistency of Bayes estimates for nonparametric regression: Normal theory. Bernoulli 4 411--444. MR1679791 10.2307/3318659 1037.62031 euclid.bj/1173883814 Diaconis, P. and Freedman, D. (1998). Consistency of Bayes estimates for nonparametric regression: Normal theory. Bernoulli 4 411--444. MR1679791 10.2307/3318659 1037.62031 euclid.bj/1173883814

8.

Doksum, K. A. (1974). Tailfree and neutral random probabilities and their posterior distributions. Ann. Probab. 2 183--201. MR373081 10.1214/aop/1176996703 Doksum, K. A. (1974). Tailfree and neutral random probabilities and their posterior distributions. Ann. Probab. 2 183--201. MR373081 10.1214/aop/1176996703

9.

Draper, D. (1999). Discussion of ``Bayesian nonparametric inference for random distributions and related functions,'' by S. G. Walker, P. Damien, P. Laud and A. F. M. Smith. J. R. Stat. Soc. Ser. B Stat. Methodol. 61 510--513. MR1707858 10.1111/1467-9868.00190 0983.62027 Draper, D. (1999). Discussion of ``Bayesian nonparametric inference for random distributions and related functions,'' by S. G. Walker, P. Damien, P. Laud and A. F. M. Smith. J. R. Stat. Soc. Ser. B Stat. Methodol. 61 510--513. MR1707858 10.1111/1467-9868.00190 0983.62027

10.

Ferguson, T. S. (1973). A Bayesian analysis of some nonparametric problems. Ann. Statist. 1 209--230. MR350949 Ferguson, T. S. (1973). A Bayesian analysis of some nonparametric problems. Ann. Statist. 1 209--230. MR350949

11.

Ferguson, T. S. (1974). Prior distributions on spaces of probability measures. Ann. Statist. 2 615--629. MR438568 0090-5364%28197407%292%3A4%3C615%3APDOSOP%3E2.0.CO%3B2-7 Ferguson, T. S. (1974). Prior distributions on spaces of probability measures. Ann. Statist. 2 615--629. MR438568 0090-5364%28197407%292%3A4%3C615%3APDOSOP%3E2.0.CO%3B2-7

12.

Ghosal, S., Ghosh, J. K. and Ramamoorthi, R. V. (1999a). Posterior consistency of Dirichlet mixtures in density estimation. Ann. Statist. 27 143--158. MR1701105 10.1214/aos/1018031105 euclid.aos/1018031105 0932.62043 Ghosal, S., Ghosh, J. K. and Ramamoorthi, R. V. (1999a). Posterior consistency of Dirichlet mixtures in density estimation. Ann. Statist. 27 143--158. MR1701105 10.1214/aos/1018031105 euclid.aos/1018031105 0932.62043

13.

Ghosal, S., Ghosh, J. K. and Ramamoorthi, R. V. (1999b). Consistency issues in Bayesian nonparametrics. In Asymptotics, Nonparametrics and Time Series: A Tribute to Madan Lal Puri (S. Ghosh, ed.) 639--667. Dekker, New York. MR1724711 1069.62516 Ghosal, S., Ghosh, J. K. and Ramamoorthi, R. V. (1999b). Consistency issues in Bayesian nonparametrics. In Asymptotics, Nonparametrics and Time Series: A Tribute to Madan Lal Puri (S. Ghosh, ed.) 639--667. Dekker, New York. MR1724711 1069.62516

14.

Ghosal, S., Ghosh, J. K. and van der Vaart, A. W. (2000). Convergence rates of posterior distributions. Ann. Statist. 28 500--531. MR1790007 10.1214/aos/1016218228 euclid.aos/1016218228 Ghosal, S., Ghosh, J. K. and van der Vaart, A. W. (2000). Convergence rates of posterior distributions. Ann. Statist. 28 500--531. MR1790007 10.1214/aos/1016218228 euclid.aos/1016218228

15.

Ghosh, J. K. and Ramamoorthi, R. V. (2003). Bayesian Nonparametrics. Springer, New York. MR1992245 1029.62004 Ghosh, J. K. and Ramamoorthi, R. V. (2003). Bayesian Nonparametrics. Springer, New York. MR1992245 1029.62004

16.

Hjort, N. L. (1990). Nonparametric Bayes estimators based on beta processes in models for life history data. Ann. Statist. 18 1259--1294. MR1062708 0090-5364%28199009%2918%3A3%3C1259%3ANBEBOB%3E2.0.CO%3B2-U Hjort, N. L. (1990). Nonparametric Bayes estimators based on beta processes in models for life history data. Ann. Statist. 18 1259--1294. MR1062708 0090-5364%28199009%2918%3A3%3C1259%3ANBEBOB%3E2.0.CO%3B2-U

17.

Kim, Y. and Lee, J. (2001). On posterior consistency of survival models. Ann. Statist. 29 666--686. MR1865336 10.1214/aos/1009210685 euclid.aos/1009210685 1012.62105 Kim, Y. and Lee, J. (2001). On posterior consistency of survival models. Ann. Statist. 29 666--686. MR1865336 10.1214/aos/1009210685 euclid.aos/1009210685 1012.62105

18.

Kraft, C. (1964). A class of distribution function processes which have derivatives. J. Appl. Probability 1 385--388. MR171296 10.2307/3211867 Kraft, C. (1964). A class of distribution function processes which have derivatives. J. Appl. Probability 1 385--388. MR171296 10.2307/3211867

19.

Lavine, M. (1992). Some aspects of Pólya tree distributions for statistical modelling. Ann. Statist. 20 1222--1235. MR1186248 0090-5364%28199209%2920%3A3%3C1222%3ASAOPTD%3E2.0.CO%3B2-2 Lavine, M. (1992). Some aspects of Pólya tree distributions for statistical modelling. Ann. Statist. 20 1222--1235. MR1186248 0090-5364%28199209%2920%3A3%3C1222%3ASAOPTD%3E2.0.CO%3B2-2

20.

Lavine, M. (1994). More aspects of Pólya tree distributions for statistical modelling. Ann. Statist. 22 1161--1176. MR1311970 0090-5364%28199409%2922%3A3%3C1161%3AMAOPTD%3E2.0.CO%3B2-R Lavine, M. (1994). More aspects of Pólya tree distributions for statistical modelling. Ann. Statist. 22 1161--1176. MR1311970 0090-5364%28199409%2922%3A3%3C1161%3AMAOPTD%3E2.0.CO%3B2-R

21.

Lenk, P. J. (1988). The logistic normal distribution for Bayesian, nonparametric predictive densities. J. Amer. Statist. Assoc. 83 509--516. MR971380 Lenk, P. J. (1988). The logistic normal distribution for Bayesian, nonparametric predictive densities. J. Amer. Statist. Assoc. 83 509--516. MR971380

22.

Lenk, P. J. (1991). Towards a practicable Bayesian nonparametric density estimator. Biometrika 78 531--543. MR1130921 0737.62035 10.2307/2337022 Lenk, P. J. (1991). Towards a practicable Bayesian nonparametric density estimator. Biometrika 78 531--543. MR1130921 0737.62035 10.2307/2337022

23.

Lo, A. Y. (1984). On a class of Bayesian nonparametric estimates. I. Density estimates. Ann. Statist. 12 351--357. MR733519 0090-5364%28198403%2912%3A1%3C351%3AOACOBN%3E2.0.CO%3B2-D Lo, A. Y. (1984). On a class of Bayesian nonparametric estimates. I. Density estimates. Ann. Statist. 12 351--357. MR733519 0090-5364%28198403%2912%3A1%3C351%3AOACOBN%3E2.0.CO%3B2-D

24.

Mauldin, R. D., Sudderth, W. D. and Williams, S. C. (1992). Pólya trees and random distributions. Ann. Statist. 20 1203--1221. MR1186247 0090-5364%28199209%2920%3A3%3C1203%3APTARD%3E2.0.CO%3B2-G Mauldin, R. D., Sudderth, W. D. and Williams, S. C. (1992). Pólya trees and random distributions. Ann. Statist. 20 1203--1221. MR1186247 0090-5364%28199209%2920%3A3%3C1203%3APTARD%3E2.0.CO%3B2-G

25.

Schwartz, L. (1965). On Bayes procedures. Z. Wahrsch. Verw. Gebiete 4 10--26. MR184378 10.1007/BF00535479 Schwartz, L. (1965). On Bayes procedures. Z. Wahrsch. Verw. Gebiete 4 10--26. MR184378 10.1007/BF00535479

26.

Shen, X. (2002). Asymptotic normality of semiparametric and nonparametric posterior distributions. J. Amer. Statist. Assoc. 97 222--235. MR1947282 10.1198/016214502753479365 1073.62517 Shen, X. (2002). Asymptotic normality of semiparametric and nonparametric posterior distributions. J. Amer. Statist. Assoc. 97 222--235. MR1947282 10.1198/016214502753479365 1073.62517

27.

Shen, X. and Wasserman, L. (2001). Rates of convergence of posterior distributions. Ann. Statist. 29 687--714. MR1865337 10.1214/aos/1009210686 euclid.aos/1009210686 1041.62022 Shen, X. and Wasserman, L. (2001). Rates of convergence of posterior distributions. Ann. Statist. 29 687--714. MR1865337 10.1214/aos/1009210686 euclid.aos/1009210686 1041.62022

28.

Walker, S. G. (2003). On sufficient conditions for Bayesian consistency. Biometrika 90 482--488. MR1986664 1034.62024 10.1093/biomet/90.2.482 Walker, S. G. (2003). On sufficient conditions for Bayesian consistency. Biometrika 90 482--488. MR1986664 1034.62024 10.1093/biomet/90.2.482

29.

Walker, S. G. (2004). New approaches to Bayesian consistency. Ann. Statist. To appear. MR2102501 10.1214/009053604000000409 euclid.aos/1098883780 1056.62040 Walker, S. G. (2004). New approaches to Bayesian consistency. Ann. Statist. To appear. MR2102501 10.1214/009053604000000409 euclid.aos/1098883780 1056.62040

30.

Walker, S. G., Damien, P. and Lenk, P. J. (2004). On priors with a Kullback--Leibler property. J. Amer. Statist. Assoc. 99 404--408. MR2062826 10.1198/016214504000000386 1117.62437 Walker, S. G., Damien, P. and Lenk, P. J. (2004). On priors with a Kullback--Leibler property. J. Amer. Statist. Assoc. 99 404--408. MR2062826 10.1198/016214504000000386 1117.62437

31.

Walker, S. G. and Hjort, N. L. (2001). On Bayesian consistency. J. R. Stat. Soc. Ser. B Stat. Methodol. 63 811--821. MR1872068 10.1111/1467-9868.00314 0987.62021 Walker, S. G. and Hjort, N. L. (2001). On Bayesian consistency. J. R. Stat. Soc. Ser. B Stat. Methodol. 63 811--821. MR1872068 10.1111/1467-9868.00314 0987.62021

32.

Wasserman, L. (1998). Asymptotic properties of nonparametric Bayesian procedures. In Practical Nonparametric and Semiparametric Bayesian Statistics. Lecture Notes in Statist. 133 293--304. Springer, New York. MR1630088 0918.62045 Wasserman, L. (1998). Asymptotic properties of nonparametric Bayesian procedures. In Practical Nonparametric and Semiparametric Bayesian Statistics. Lecture Notes in Statist. 133 293--304. Springer, New York. MR1630088 0918.62045

33.

Wong, W. H. and Shen, X. (1995). Probability inequalities for likelihood ratios and convergence rates of sieve MLEs. Ann. Statist. 23 339--362. MR1332570 0090-5364%28199504%2923%3A2%3C339%3APIFLRA%3E2.0.CO%3B2-3 Wong, W. H. and Shen, X. (1995). Probability inequalities for likelihood ratios and convergence rates of sieve MLEs. Ann. Statist. 23 339--362. MR1332570 0090-5364%28199504%2923%3A2%3C339%3APIFLRA%3E2.0.CO%3B2-3
Copyright © 2004 Institute of Mathematical Statistics
Stephen G. Walker "Modern Bayesian Asymptotics," Statistical Science 19(1), 111-117, (February 2004). https://doi.org/10.1214/088342304000000134
Published: February 2004
Vol.19 • No. 1 • February 2004
Back to Top