Entropy inequalities and the Central Limit Theorem

被引:17
作者
Johnson, O [1 ]
机构
[1] Univ Cambridge, Stat Lab, Cambridge CB2 1SB, England
基金
英国工程与自然科学研究理事会;
关键词
normal convergence; entropy; Fisher information;
D O I
10.1016/S0304-4149(00)00006-5
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 [统计学]; 070103 [概率论与数理统计]; 0714 [统计学];
摘要
Motivated by Barren (1986, Ann. Probab. 14, 336-342), Brown (1982, Statistics and Probability: Essays in Honour of C.R. Rao, pp. 141-148) and Carlen and Soffer (1991, Comm. Math. Phys. 140, 339-371), we prove a version of the Lindeberg-Feller Theorem, showing normal convergence of the normalised sum of independent, not necessarily identically distributed random variables, under standard conditions. We give a sufficient condition for convergence in the relative entropy sense of Kullback-Leibler, which is strictly stronger than L-1. In the IID case we recover the main result of Barren [1] (c) 2000 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:291 / 304
页数:14
相关论文
共 9 条
[1]
ENTROPY AND THE CENTRAL-LIMIT-THEOREM [J].
BARRON, AR .
ANNALS OF PROBABILITY, 1986, 14 (01) :336-342
[2]
THE CONVOLUTION INEQUALITY FOR ENTROPY POWERS [J].
BLACHMAN, NM .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1965, 11 (02) :267-271
[3]
Brown L. D., 1982, STAT PROBABILITY ESS, P141
[4]
ENTROPY PRODUCTION BY BLOCK VARIABLE SUMMATION AND CENTRAL LIMIT-THEOREMS [J].
CARLEN, EA ;
SOFFER, A .
COMMUNICATIONS IN MATHEMATICAL PHYSICS, 1991, 140 (02) :339-371
[5]
Gnedenko B.V., 1954, LIMITS DISTRIBUTIONS
[7]
Linnik JV., 1959, THEORY PROBABILITY I, V4, P288
[8]
Stam A. J., 1959, Inf. Control, V2, P101, DOI DOI 10.1016/S0019-9958(59)90348-1
[9]
Szego G., 1958, ORTHOGONAL POLYNOMIA