- Bayesian Anal.
- Volume 7, Number 4 (2012), 997-1034.
The Discrete Infinite Logistic Normal Distribution
We present the discrete infinite logistic normal distribution (DILN), a Bayesian nonparametric prior for mixed membership models. DILN generalizes the hierarchical Dirichlet process (HDP) to model correlation structure between the weights of the atoms at the group level. We derive a representation of DILN as a normalized collection of gamma-distributed random variables and study its statistical properties. We derive a variational inference algorithm for approximate posterior inference. We apply DILN to topic modeling of documents and study its empirical performance on four corpora, comparing performance with the HDP and the correlated topic model (CTM). To compute with large-scale data, we develop a stochastic variational inference algorithm for DILN and compare with similar algorithms for HDP and latent Dirichlet allocation (LDA) on a collection of 350,000 articles from Nature.
Bayesian Anal., Volume 7, Number 4 (2012), 997-1034.
First available in Project Euclid: 27 November 2012
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Paisley, John; Wang, Chong; Blei, David M. The Discrete Infinite Logistic Normal Distribution. Bayesian Anal. 7 (2012), no. 4, 997--1034. doi:10.1214/12-BA734. https://projecteuclid.org/euclid.ba/1354024470