Generalized entropy power inequalities and monotonicity properties of information

被引:106
作者
Madiman, Mokshay [1 ]
Barron, Andrew [1 ]
机构
[1] Yale Univ, Dept Stat, New Haven, CT 06511 USA
关键词
central limit theorem; entropy power; information inequalities;
D O I
10.1109/TIT.2007.899484
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 [计算机科学与技术];
摘要
New families of Fisher information and entropy power inequalities for sums of independent random variables are presented. These inequalities relate the information in the sum of n independent random variables to the information contained in sums over subsets of the random variables, for an arbitrary collection of subsets. As a consequence, a simple proof of the monotonicity of information in central limit theorems is obtained, both in the setting of independent and identically distributed (i.i.d.) summands as well as in the more general setting of independent summands with variance-standardized sums.
引用
收藏
页码:2317 / 2329
页数:13
相关论文
共 45 条
[31]
ON A SOURCE-CODING PROBLEM WITH 2 CHANNELS AND 3 RECEIVERS [J].
OZAROW, L .
BELL SYSTEM TECHNICAL JOURNAL, 1980, 59 (10) :1909-1921
[32]
ASYMPTOTIC-DISTRIBUTION OF SYMMETRIC STATISTICS [J].
RUBIN, H ;
VITALE, RA .
ANNALS OF STATISTICS, 1980, 8 (01) :165-170
[33]
SCHIMIZU R, 1975, STAT DISTRIBUTIONS S, V3, P305
[34]
SCHULTZ H, 2005, SEMICIRCULARITY GAUS
[35]
A MATHEMATICAL THEORY OF COMMUNICATION [J].
SHANNON, CE .
BELL SYSTEM TECHNICAL JOURNAL, 1948, 27 (03) :379-423
[36]
SHLYAKHTENKO D, 2005, FREE ANALOGUE SHANNO
[37]
Stam A. J., 1959, Inf. Control, V2, P101, DOI DOI 10.1016/S0019-9958(59)90348-1
[38]
AN EFRON-STEIN INEQUALITY FOR NONSYMMETRIC STATISTICS [J].
STEELE, JM .
ANNALS OF STATISTICS, 1986, 14 (02) :753-758
[39]
TAKEMURA A, 1983, J AM STAT ASSOC, V78, P894
[40]
Monotonic decrease of the non-Gaussianness of the sum of independent random variables:: A simple proof [J].
Tulino, Antonia M. ;
Verdu, Sergio .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (09) :4295-4297