CAPACITY OF CHANNELS WITH UNCODED SIDE INFORMATION

被引:54
作者
SHAMAI, S
VERDU, S
机构
[1] Dept. Electrical Eng., Technion, Haifa
[2] Dept. Electrical Eng, Princeton University Princeton, New Jersey
来源
EUROPEAN TRANSACTIONS ON TELECOMMUNICATIONS | 1995年 / 6卷 / 05期
关键词
D O I
10.1002/ett.4460060514
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Parallel independent channels where no encoding is allowed for one of the channels are studied. The Slepian-Wolf theorem on source coding of correlated sources is used to show that any information source whose entropy rate is below the sum of the capacity of the coded channel and the input/output mutual information of the uncoded channel is transmissible with arbitrary reliability. The converse is also shown. Thus, coding of the side information channel is unnecessary when its mutual information is maximized by the source distribution. Applications to superposed coded/uncoded transmission on Gaussian channels are studied and an information-theoretic interpretation of Parallel-Concatenated channel codes and, in particular, Turbo codes is put forth.
引用
收藏
页码:587 / 600
页数:14
相关论文
共 32 条
[1]  
Slepian D., Wolf J.K., Noiseless coding of correlated information sources, IEEE Transactions on Information Theory, 19 IT, pp. 471-480, (1973)
[2]  
Berrou C., Glavieux A, Thitimajshima P., pp. 1064-1070, (1993)
[3]  
Cover T.M., A proof of the data compression theorem of Slepian and Wolf for ergodic sources, IEEE Trans. Information Theory, 22 IT, pp. 226-228, (1975)
[4]  
Cover T.M., Thomas J.A., Elements of information theory, (1991)
[5]  
Ahlswede R., Coloring hypergraphs: a new approach to multiuser source coding, J J. Comb. Inf. Syst. Sci., 1, pp. 76-115, (1979)
[6]  
Hagenauer J.
[7]  
Wyner A.D., Recent results in the Shannon theory, IEEE Transactions on Information Theory, 20 IT, pp. 2-10, (1974)
[8]  
Gabidulin E.M., Limits for the decoding error probability when linear codes are used in memoryless channels, Problemv Per‐edachi Informatsii, 3, pp. 55-62, (1967)
[9]  
Sias P.E., Coding for noisy channels, IRE Convention Record, 4, pp. 37-46, (1955)
[10]  
Han T.S., Verdu S., Approximation theory of output statistics, IEEE Trans. Information Theory, 39, pp. 752-772, (1993)