Bias analysis in entropy estimation

被引：77

作者：

Schürmann, T ^{[1
]}

机构：

[1] Westdeutsch Genossensch Zentralbank EG, D-40227 Dusseldorf, Germany

来源：

JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL | 2004年 / 37卷 / 27期

关键词：

D O I：

10.1088/0305-4470/37/27/L02

中图分类号：

O4 [物理学];

学科分类号：

0702 ;

摘要：

We consider the problem of finite sample corrections for entropy estimation. New estimates of the Shannon entropy are proposed and their systematic error (the bias) is computed analytically. We find that our results cover correction formulae of current entropy estimates recently discussed in the literature. The trade-off between bias reduction and the increase of the corresponding statistical error is analysed.

引用

页码：L295 / L301

页数：7

共 8 条

[1]

[Anonymous], 1964, Handbook of mathematical functions

[2]

[Anonymous], 1955, INFORM THEORY PSYCHO

[3] FINITE-SAMPLE CORRECTIONS TO ENTROPY AND DIMENSION ESTIMATES [J].

GRASSBERGER, P .

PHYSICS LETTERS A, 1988, 128 (6-7) :369-373

[4]

GRASSBERGER P, 2003, PHYSICS0307138

[5]

Harris B, 1975, TOPICS INF THEORY KE, V16, P323

[6]

HERZEL H, 1988, SYST ANAL MODEL SIM, V5, P435

[7] Estimation of entropy and mutual information [J].

Paninski, L .

NEURAL COMPUTATION, 2003, 15 (06) :1191-1253

[8]

Shannon Claude, 1998, The Mathematical Theory of Communication

← 1 →