Open Access
February, 1982 Channel Entropy and Primitive Approximation
David L. Neuhoff, Paul C. Shields
Ann. Probab. 10(1): 188-198 (February, 1982). DOI: 10.1214/aop/1176993922


For stationary channels, channel entropy is defined as the supremum of the conditional output entropy over all stationary input sources. If the channel is $\bar{d}$-continuous and conditionally almost block independent, channel entropy gives an upper bound to the output rate of the channel. Furthermore, the channel can be approximated arbitrarily well in the $\bar{d}$-metric by any primitive channel whose noise source entropy exceeds channel entropy and cannot be so approximated if the noise source entropy is less than channel entropy.


Download Citation

David L. Neuhoff. Paul C. Shields. "Channel Entropy and Primitive Approximation." Ann. Probab. 10 (1) 188 - 198, February, 1982.


Published: February, 1982
First available in Project Euclid: 19 April 2007

zbMATH: 0513.94011
MathSciNet: MR637385
Digital Object Identifier: 10.1214/aop/1176993922

Primary: 94A20
Secondary: 28A70

Keywords: $\bar{d}$-distance , Channel , Entropy

Rights: Copyright © 1982 Institute of Mathematical Statistics

Vol.10 • No. 1 • February, 1982
Back to Top