A simple proof of the entropy-power inequality

被引:93
作者
Verdú, S [1 ]
Guo, DN
机构
[1] Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA
[2] Northwestern Univ, Dept Elect Engn & Comp Sci, Evanston, IL 60208 USA
基金
美国国家科学基金会;
关键词
differential entropy; entropy-power inequality (EPI); minimum mean-square error (MMSE);
D O I
10.1109/TIT.2006.872978
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 [计算机科学与技术];
摘要
This correspondence gives a simple proof of Shannon's entropy-power inequality (EPI) using the relationship between mutual information and minimum mean-square error (MMSE) in Gaussian channels.
引用
收藏
页码:2165 / 2166
页数:2
相关论文
共 8 条
[1]
A NEW ENTROPY POWER INEQUALITY [J].
COSTA, MHM .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1985, 31 (06) :751-760
[2]
INFORMATION THEORETIC INEQUALITIES [J].
DEMBO, A ;
COVER, TM ;
THOMAS, JA .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1991, 37 (06) :1501-1518
[3]
GUO D, P 2006 IEEE INT S IN
[4]
Mutual information and minimum mean-square error in Gaussian channels [J].
Guo, DN ;
Shamai, S ;
Verdú, S .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2005, 51 (04) :1261-1282
[5]
PROOF OF AN ENTROPY CONJECTURE OF WEHRL [J].
LIEB, EH .
COMMUNICATIONS IN MATHEMATICAL PHYSICS, 1978, 62 (01) :35-41
[6]
SHANNON E, 1948, BELL SYST TECH J, V379, P623
[7]
Stam A. J., 1959, Inf. Control, V2, P101, DOI DOI 10.1016/S0019-9958(59)90348-1
[8]
A GENERALIZATION OF THE ENTROPY POWER INEQUALITY WITH APPLICATIONS [J].
ZAMIR, R ;
FEDER, M .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1993, 39 (05) :1723-1728