Open Access
Translator Disclaimer
February, 1982 Channel Entropy and Primitive Approximation
David L. Neuhoff, Paul C. Shields
Ann. Probab. 10(1): 188-198 (February, 1982). DOI: 10.1214/aop/1176993922

Abstract

For stationary channels, channel entropy is defined as the supremum of the conditional output entropy over all stationary input sources. If the channel is $\bar{d}$-continuous and conditionally almost block independent, channel entropy gives an upper bound to the output rate of the channel. Furthermore, the channel can be approximated arbitrarily well in the $\bar{d}$-metric by any primitive channel whose noise source entropy exceeds channel entropy and cannot be so approximated if the noise source entropy is less than channel entropy.

Citation

Download Citation

David L. Neuhoff. Paul C. Shields. "Channel Entropy and Primitive Approximation." Ann. Probab. 10 (1) 188 - 198, February, 1982. https://doi.org/10.1214/aop/1176993922

Information

Published: February, 1982
First available in Project Euclid: 19 April 2007

zbMATH: 0513.94011
MathSciNet: MR637385
Digital Object Identifier: 10.1214/aop/1176993922

Subjects:
Primary: 94A20
Secondary: 28A70

Keywords: $\bar{d}$-distance , Channel , Entropy

Rights: Copyright © 1982 Institute of Mathematical Statistics

JOURNAL ARTICLE
11 PAGES


SHARE
Vol.10 • No. 1 • February, 1982
Back to Top