Rates of convergence for the posterior distributions of mixtures of Betas and adaptive nonparametric estimation of the density
Judith Rousseau
Source: Ann. Statist. Volume 38, Number 1
(2010), 146-180.
Abstract
In this paper, we investigate the asymptotic properties of nonparametric Bayesian mixtures of Betas for estimating a smooth density on [0, 1]. We consider a parametrization of Beta distributions in terms of mean and scale parameters and construct a mixture of these Betas in the mean parameter, while putting a prior on this scaling parameter. We prove that such Bayesian nonparametric models have good frequentist asymptotic properties. We determine the posterior rate of concentration around the true density and prove that it is the minimax rate of concentration when the true density belongs to a Hölder class with regularity β, for all positive β, leading to a minimax adaptive estimating procedure of the density. We also believe that the approximating results obtained on these mixtures of Beta densities can be of interest in a frequentist framework.
First Page:
Show
Hide
Keywords: Bayesian nonparametric; rates of convergence; mixtures of Betas; adaptive estimation; kernel
Full-text: Access denied (no subscription
detected)
We're sorry, but we are unable to provide
you with the full text of this article because we are not able to identify
you as a subscriber.
If you have a personal subscription to
this journal, then please login. If you are already logged in, then you
may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers
Permanent link to this document: http://projecteuclid.org/euclid.aos/1262271612
Digital Object Identifier: doi:10.1214/09-AOS703
Zentralblatt MATH identifier: 1181.62047
Mathematical Reviews number (MathSciNet): MR2589319
References
[1] Abramowitz, M. and Stegun, I. A. (1965). Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables. Dover, New York.
[2] Ferguson, T. S. (1983). Bayesian density estimation by mixtures of Normal distributions. In Recent Advances in Statistics (M. H. Rizvi, J. S. Rustagi and D. Siegmund, eds.) 287–302. Academic Press, New York.
Mathematical Reviews (MathSciNet): MR736538
Zentralblatt MATH: 0557.62030
[3] Ghosal, S. (2001). Convergence rates for density estimation with Bernstein polynomials. Ann. Statist. 29 1264–1280.
Mathematical Reviews (MathSciNet): MR1873330
Zentralblatt MATH: 1043.62024
Digital Object Identifier: doi:10.1214/aos/1013203453
Project Euclid: euclid.aos/1013203453
[4] Ghosal, S. and van der Vaart, A. (2001). Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities. Ann. Statist. 29 1233–1263.
Mathematical Reviews (MathSciNet): MR1873329
Zentralblatt MATH: 1043.62025
Digital Object Identifier: doi:10.1214/aos/1013203453
Project Euclid: euclid.aos/1013203452
[5] Ghosal, S. and van der Vaart, A. (2007). Posterior convergence rates of Dirichlet mixtures of normal distributions for smooth densities. Ann. Statist. 35 697–723.
[6] Ghosal, S. and van der Vaart, A. (2007). Convergence rates of posterior distributions for non-i.i.d. observations. Ann. Statist. 35 192–223.
Mathematical Reviews (MathSciNet): MR2332274
Digital Object Identifier: doi:10.1214/009053606000001172
Project Euclid: euclid.aos/1181100186
[7] Kruijer, W. (2008). Convergence rates in nonparametric Bayesian density estimation. Ph.D. thesis, Vrije Univ., Amsterdam.
[8] Kruijer, W. and van der Vaart, A. (2008). Posterior convergence rates for Dirichlet mixtures of Beta densities. J. Statist. Plann. Inference 138 1981–1992.
Mathematical Reviews (MathSciNet): MR2406419
Zentralblatt MATH: 1134.62023
Digital Object Identifier: doi:10.1016/j.jspi.2007.07.012
[9] Lo, A. (1984). On a class of Bayesian nonparametric estimates. I. Density estimates. Ann. Statist. 12 351–357.
Mathematical Reviews (MathSciNet): MR733519
Zentralblatt MATH: 0557.62036
Digital Object Identifier: doi:10.1214/aos/1176346412
Project Euclid: euclid.aos/1176346412
[10] McLachlan, G. and Peel D. (2000). Finite Mixture Models. Wiley, New York.
Mathematical Reviews (MathSciNet): MR1789474
[11] Marin, J. M., Mengersen, K. and Robert, C. P. (2005). Bayesian modelling and inference on mixtures of distributions. Handbook of Statist. 25 459–507.
Mathematical Reviews (MathSciNet): MR2490536
[12] Rousseau, J. (2007). Approximating interval hypothesis: p-values and Bayes factors. In Bayesian Statistics (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 8. Oxford Univ. Press, Oxford.
Mathematical Reviews (MathSciNet): MR2433202
[13] McVinish, R., Rousseau, J. and Mengerson, K. (2005). Bayesian goodness of fit testing with mixtures of triangular distributions. Preprint.
[14] Petrone, S. and Veronese, P. (2002). Nonparametric mixture priors based on an exponential random scheme. Stat. Methods Appl. 11 1–20.
[15] Scricciolo, C. (2009). Convergence rates of posterior distributions for Dirichlet mixtures of normal densities. Scand. J. Statist. 36 337–354.
[16] van der Vaart, A. W. and van Zanten, J. H. (2007). Bayesian inference with rescaled Gaussian process priors. Electron. J. Stat. 1 433–448.
Mathematical Reviews (MathSciNet): MR2357712
Zentralblatt MATH: 1140.62066
Digital Object Identifier: doi:10.1214/07-EJS098
Project Euclid: euclid.ejs/1193074818
[17] van der Vaart, A. W. and van Zanten, J. H. (2009). Adaptive Bayesian estimation using a Gaussian random field with inverse Gamma bandwidth. Ann. Statist. 37 2655–2675.
Mathematical Reviews (MathSciNet): MR2541442
Zentralblatt MATH: 1173.62021
Digital Object Identifier: doi:10.1214/08-AOS678
Project Euclid: euclid.aos/1247836664
[18] Wu, Y. and Ghosal, S. (2008). Kullback–Leibler property of kernel mixture priors in Bayesian density estimation. Electron. J. Stat. 2 298–331.
Mathematical Reviews (MathSciNet): MR2399197
Zentralblatt MATH: 1135.62022
Digital Object Identifier: doi:10.1214/07-EJS130
Project Euclid: euclid.ejs/1210254767
