Open Access
April, 1990 On Direct Convergence and Periodicity for Transition Probabilities of Markov Chains in Random Environments
Robert Cogburn
Ann. Probab. 18(2): 642-654 (April, 1990). DOI: 10.1214/aop/1176990850
Abstract

We study direct convergence of the products $P(\theta_0) \cdots P(\theta_n)$ of random stochastic matrices. These products can be interpreted as the transition probabilities of nonhomogeneous Markov chains selected at random by a stationary "environmental" sequence $\{\theta_n\}$, in other words, a Markov chain in a random environment. Rather than make assumptions analogous to irreducibility and aperiodicity for homogeneous Markov chains, we introduce equivalence relations that allow convergence results on the equivalence classes. The classical decomposition into a cycle of periodic sets is not possible in general, so the "periodicity" in the title is meant only to be suggestive. We also examine the frequency of times of positive probability of return to a state or set.

Copyright © 1990 Institute of Mathematical Statistics
Robert Cogburn "On Direct Convergence and Periodicity for Transition Probabilities of Markov Chains in Random Environments," The Annals of Probability 18(2), 642-654, (April, 1990). https://doi.org/10.1214/aop/1176990850
Published: April, 1990
Vol.18 • No. 2 • April, 1990
Back to Top