The Annals of Applied Probability
- Ann. Appl. Probab.
- Volume 26, Number 5 (2016), 3044-3077.
Perfect sampling for nonhomogeneous Markov chains and hidden Markov models
We obtain a perfect sampling characterization of weak ergodicity for backward products of finite stochastic matrices, and equivalently, simultaneous tail triviality of the corresponding nonhomogeneous Markov chains. Applying these ideas to hidden Markov models, we show how to sample exactly from the finite-dimensional conditional distributions of the signal process given infinitely many observations, using an algorithm which requires only an almost surely finite number of observations to actually be accessed. A notion of “successful” coupling is introduced and its occurrence is characterized in terms of conditional ergodicity properties of the hidden Markov model and related to the stability of nonlinear filters.
Ann. Appl. Probab. Volume 26, Number 5 (2016), 3044-3077.
Received: October 2014
Revised: December 2015
First available in Project Euclid: 19 October 2016
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Whiteley, Nick; Lee, Anthony. Perfect sampling for nonhomogeneous Markov chains and hidden Markov models. Ann. Appl. Probab. 26 (2016), no. 5, 3044--3077. doi:10.1214/15-AAP1169. https://projecteuclid.org/euclid.aoap/1476884311