Electronic Journal of Statistics
- Electron. J. Statist.
- Volume 13, Number 1 (2019), 166-207.
Trace class Markov chains for the Normal-Gamma Bayesian shrinkage model
High-dimensional data, where the number of variables exceeds or is comparable to the sample size, is now pervasive in many scientific applications. In recent years, Bayesian shrinkage models have been developed as effective and computationally feasible tools to analyze such data, especially in the context of linear regression. In this paper, we focus on the Normal-Gamma shrinkage model developed by Griffin and Brown . This model subsumes the popular Bayesian lasso model, and a three-block Gibbs sampling algorithm to sample from the resulting intractable posterior distribution has been developed in . We consider an alternative two-block Gibbs sampling algorithm, and rigorously demonstrate its advantage over the three-block sampler by comparing specific spectral properties. In particular, we show that the Markov operator corresponding to the two-block sampler is trace class (and hence Hilbert-Schmidt), whereas the operator corresponding to the three-block sampler is not even Hilbert-Schmidt. The trace class property for the two-block sampler implies geometric convergence for the associated Markov chain, which justifies the use of Markov chain CLT’s to obtain practical error bounds for MCMC based estimates. Additionally, it facilitates theoretical comparisons of the two-block sampler with sandwich algorithms which aim to improve performance by inserting inexpensive extra steps in between the two conditional draws of the two-block sampler.
Electron. J. Statist., Volume 13, Number 1 (2019), 166-207.
Received: March 2017
First available in Project Euclid: 16 January 2019
Permanent link to this document
Digital Object Identifier
Primary: 60J05: Discrete-time Markov processes on general state spaces 60J20: Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) [See also 90B30, 91D10, 91D35, 91E40]
Secondary: 33C10: Bessel and Airy functions, cylinder functions, $_0F_1$
Zhang, Liyuan; Khare, Kshitij; Xing, Zeren. Trace class Markov chains for the Normal-Gamma Bayesian shrinkage model. Electron. J. Statist. 13 (2019), no. 1, 166--207. doi:10.1214/18-EJS1491. https://projecteuclid.org/euclid.ejs/1547607848