Open Access
Translator Disclaimer
October, 1974 $R$-Theory for Markov Chains on a General State Space I: Solidarity Properties and $R$-Recurrent Chains
Richard L. Tweedie
Ann. Probab. 2(5): 840-864 (October, 1974). DOI: 10.1214/aop/1176996552


This paper develops, for a Markov chain $\{X_n\}$ on a general space $(\mathscr{X}, \mathscr{F})$ with $n$-step transition probabilities $P^n(x, A), x \in \mathscr{X}, A \in \mathscr{F}$, a theory analogous to that of Vere-Jones for Markov chains on the integers. If the chain is $\phi$-irreducible there is a partition $\mathscr{K}$ of $\mathscr{X}$ such that $\phi$-almost all of the power series $G_z(x, A) = \sum_n P^n(x, A)z^n$ have a common radius of convergence $R$ for $A$ in any element of $\mathscr{K}$, and they all diverge ($R$-recurrence) or all converge ($R$-transience) for $z = R$. The $R$-recurrent case is then investigated, and it is shown that there exist essentially unique non-zero solutions $Q, f$ to the $R$-subinvariant equations $Q \geqq RQP$ and $f \geqq RPf$, and that $Q$ and $f$ satisfy these inequalities with equality: a relationship between $Q$ and $f$ and first-entrance probabilities is also established. Further, if $\{X_n\}$ is aperiodic, $\lim_{n\rightarrow\infty} R^nP^n(x, A) = f(x)Q(A)/\int_\mathscr{X} f(y)Q(dy)$ for almost all $x \in \mathscr{X}$ and $A$ in any element of a second partition. The methods used are probabilistic and depend mainly on generating function techniques: it is pointed out that these techniques do not depend on the substochasticity of the transition probabilities, and hence the results are true in a much wider context.


Download Citation

Richard L. Tweedie. "$R$-Theory for Markov Chains on a General State Space I: Solidarity Properties and $R$-Recurrent Chains." Ann. Probab. 2 (5) 840 - 864, October, 1974.


Published: October, 1974
First available in Project Euclid: 19 April 2007

zbMATH: 0292.60097
MathSciNet: MR368151
Digital Object Identifier: 10.1214/aop/1176996552

Primary: 60J05
Secondary: 45C05‎ , 45N05 , 47A35 , 47D05 , 60J35

Keywords: $R$-recurrence , $R$-theory , equilibrium measures , invariant functions , Invariant measures , limit probabilities , Markov chains , ‎positive operators , ratio limit theorems

Rights: Copyright © 1974 Institute of Mathematical Statistics


Vol.2 • No. 5 • October, 1974
Back to Top