- Bayesian Anal.
- Volume 1, Number 1 (2006), 121-143.
Variational inference for Dirichlet process mixtures
Dirichlet process (DP) mixture models are the cornerstone of nonparametric Bayesian statistics, and the development of Monte-Carlo Markov chain (MCMC) sampling methods for DP mixtures has enabled the application of nonparametric Bayesian methods to a variety of practical data analysis problems. However, MCMC sampling can be prohibitively slow, and it is important to explore alternatives. One class of alternatives is provided by variational methods, a class of deterministic algorithms that convert inference problems into optimization problems (Opper and Saad 2001; Wainwright and Jordan 2003). Thus far, variational methods have mainly been explored in the parametric setting, in particular within the formalism of the exponential family (Attias 2000; Ghahramani and Beal 2001; Blei et al. 2003). In this paper, we present a variational inference algorithm for DP mixtures. We present experiments that compare the algorithm to Gibbs sampling algorithms for DP mixtures of Gaussians and present an application to a large-scale image analysis problem.
Bayesian Anal. Volume 1, Number 1 (2006), 121-143.
First available in Project Euclid: 22 June 2012
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Blei, David M.; Jordan, Michael I. Variational inference for Dirichlet process mixtures. Bayesian Anal. 1 (2006), no. 1, 121--143. doi:10.1214/06-BA104. https://projecteuclid.org/euclid.ba/1340371077