Open Access
Translator Disclaimer
June, 1972 The Efficient Construction of an Unbiased Random Sequence
Peter Elias
Ann. Math. Statist. 43(3): 865-870 (June, 1972). DOI: 10.1214/aoms/1177692552


We consider procedures for converting input sequences of symbols generated by a stationary random process into sequences of independent, equiprobable output symbols, measuring the efficiency of such a procedure when the input sequence is finite by the expected value of the ratio of output symbols to input symbols. For a large class of processes and a large class of procedures we give an obvious information-theoretic upper bound to efficiency. We also construct procedures which attain this bound in the limit of long input sequences without making use of the process parameters, for two classes of processes. In the independent case we generalize a 1951 result of von Neumann and 1970 results of Hoeffding and Simons for independent but biased binary input, gaining a factor of 3 or 4 in efficiency. In the finite-state case we generalize a 1968 result of Samuelson for two-state binary Markov input, gaining a larger factor in efficiency.


Download Citation

Peter Elias. "The Efficient Construction of an Unbiased Random Sequence." Ann. Math. Statist. 43 (3) 865 - 870, June, 1972.


Published: June, 1972
First available in Project Euclid: 27 April 2007

zbMATH: 0245.65003
Digital Object Identifier: 10.1214/aoms/1177692552

Rights: Copyright © 1972 Institute of Mathematical Statistics


Vol.43 • No. 3 • June, 1972
Back to Top