The Annals of Mathematical Statistics

The Efficient Construction of an Unbiased Random Sequence

Peter Elias

Full-text: Open access

Abstract

We consider procedures for converting input sequences of symbols generated by a stationary random process into sequences of independent, equiprobable output symbols, measuring the efficiency of such a procedure when the input sequence is finite by the expected value of the ratio of output symbols to input symbols. For a large class of processes and a large class of procedures we give an obvious information-theoretic upper bound to efficiency. We also construct procedures which attain this bound in the limit of long input sequences without making use of the process parameters, for two classes of processes. In the independent case we generalize a 1951 result of von Neumann and 1970 results of Hoeffding and Simons for independent but biased binary input, gaining a factor of 3 or 4 in efficiency. In the finite-state case we generalize a 1968 result of Samuelson for two-state binary Markov input, gaining a larger factor in efficiency.

Article information

Source
Ann. Math. Statist., Volume 43, Number 3 (1972), 865-870.

Dates
First available in Project Euclid: 27 April 2007

Permanent link to this document
https://projecteuclid.org/euclid.aoms/1177692552

Digital Object Identifier
doi:10.1214/aoms/1177692552

Zentralblatt MATH identifier
0245.65003

JSTOR
links.jstor.org

Citation

Elias, Peter. The Efficient Construction of an Unbiased Random Sequence. Ann. Math. Statist. 43 (1972), no. 3, 865--870. doi:10.1214/aoms/1177692552. https://projecteuclid.org/euclid.aoms/1177692552


Export citation