Abstract
We investigate a Markov chain with a state space stopping at appearance of patterns consisting of two consecutive states. It is observed that the expected stopping times of the chain have surprising oscillating dependencies on starting positions. Analogously, the stopping probabilities also have oscillating dependencies on terminal states. In a nonstopping Markov chain the frequencies of appearances of two consecutive states are found explicitly.
Citation
Azer Kerimov. Abdullah Öner. "Oscillation properties of expected stopping times and stopping probabilities for patterns consisting of consecutive states in Markov chains." Rocky Mountain J. Math. 50 (5) 1709 - 1721, October 2020. https://doi.org/10.1216/rmj.2020.50.1709
Information