Open Access
March, 1947 On the Theory of Markoff Chains
Elliott W. Montroll
Ann. Math. Statist. 18(1): 18-36 (March, 1947). DOI: 10.1214/aoms/1177730489


Although there exists voluminous literature on the theory of probability of independent events, and powerful techniques have been developed for the analysis of most of the interesting problems in this field, the theory of probability of dependent events has been rather neglected. The first detailed investigations in this subject were published by A. Markoff [1]. S. Bernstein [2] has extended the fundamental limit theorems to chains of dependent events. The most extensive exposition of this field has been made by M. Frechet [3]. In the present paper we shall develop methods of averaging functions over chains of dependent variables and find the probability distribution of these functions. It will be shown that for certain types of chains these averages and distribution functions can be expressed in terms of the characteristic values and vectors of a certain operator equation. Many of the methods discussed here have been applied to problems in statistical mechanics [4,5,6,7,8]. The most important application has been made by L. Onsager [8] who proved rigorously (on the basis of a simplified model) that Boltzmann's energy distribution in a solid with cooperative elements leads to a phase transition. The first explicit application of linear operator theory (through matrices and integral equations) to probability chains has apparently been made by Hostinsky [9].


Download Citation

Elliott W. Montroll. "On the Theory of Markoff Chains." Ann. Math. Statist. 18 (1) 18 - 36, March, 1947.


Published: March, 1947
First available in Project Euclid: 28 April 2007

zbMATH: 0032.17203
MathSciNet: MR19864
Digital Object Identifier: 10.1214/aoms/1177730489

Rights: Copyright © 1947 Institute of Mathematical Statistics

Vol.18 • No. 1 • March, 1947
Back to Top