The Annals of Statistics
- Ann. Statist.
- Volume 39, Number 2 (2011), 838-864.
Bayesian analysis of variable-order, reversible Markov chains
We define a conjugate prior for the reversible Markov chain of order r. The prior arises from a partially exchangeable reinforced random walk, in the same way that the Beta distribution arises from the exchangeable Polyá urn. An extension to variable-order Markov chains is also derived. We show the utility of this prior in testing the order and estimating the parameters of a reversible Markov model.
Ann. Statist., Volume 39, Number 2 (2011), 838-864.
First available in Project Euclid: 9 March 2011
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Primary: 62M02: Markov processes: hypothesis testing
Secondary: 62C10: Bayesian problems; characterization of Bayes procedures
Bacallado, Sergio. Bayesian analysis of variable-order, reversible Markov chains. Ann. Statist. 39 (2011), no. 2, 838--864. doi:10.1214/10-AOS857. https://projecteuclid.org/euclid.aos/1299680956
- Supplementary material: Law of a variable-order, reinforced random walk. We provide a closed form expression for this law as a function of transition counts and suggest how it could be useful.