## The Annals of Mathematical Statistics

- Ann. Math. Statist.
- Volume 38, Number 1 (1967), 201-205.

### Identification of State-calculable Functions of Finite Markov Chains

#### Abstract

If $\{f(X_n): n = 1, 2, \cdots \}$ is a finite-state function of a finite-state Markov chain $\{X_n\}$, it is known that the distribution of $\{f(X_n)\}$ is determined by the distribution of $(f(X_1), f(X_2), \cdots, f(X_K))$ for suitable $K$, and a finite construction utilizing only the latter distribution exists in special cases yielding the probability structure of a chain $\{X'_n\}$ and a function $f'$ such that $\{f(X_n\}$ and $\{f'(X'_n)\}$ have the same distribution [7]. We obtain a finite construction when $(\{X_n\}, f)$ is such that if $i$ is a state of $\{X_n\}$ and $j$ is a state of $\{f(X_n)\}$, then there is at most one transition from $i$ to the set $f^{-1}(j)$ and the distribution of $X_1$ assigns positive probability to at most one state in each set $f^{-1}(j)$. Such "state-calculability" is a rather severe, but natural, structural restriction subsuming certain cases not previously treated. The corresponding finite construction is very simple and directly related to the representation of any finite-state process $\{Y_n\}$ by a function of a (possibly countable-state) Markov chain.

#### Article information

**Source**

Ann. Math. Statist., Volume 38, Number 1 (1967), 201-205.

**Dates**

First available in Project Euclid: 27 April 2007

**Permanent link to this document**

https://projecteuclid.org/euclid.aoms/1177699071

**Digital Object Identifier**

doi:10.1214/aoms/1177699071

**Mathematical Reviews number (MathSciNet)**

MR208672

**Zentralblatt MATH identifier**

0171.16103

**JSTOR**

links.jstor.org

#### Citation

Carlyle, J. W. Identification of State-calculable Functions of Finite Markov Chains. Ann. Math. Statist. 38 (1967), no. 1, 201--205. doi:10.1214/aoms/1177699071. https://projecteuclid.org/euclid.aoms/1177699071