Measures of statistical complexity: Why?

被引:297
作者
Feldman, DP [1 ]
Crutchfield, JP
机构
[1] Univ Calif Davis, Dept Phys, Davis, CA 95616 USA
[2] Univ Calif Berkeley, Dept Phys, Berkeley, CA 94720 USA
[3] Santa Fe Inst, Santa Fe, NM 87501 USA
关键词
statistical complexity; excess entropy; mutual information; Shannon entropy; Kolmogorov complexity;
D O I
10.1016/S0375-9601(97)00855-4
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
We review several statistical complexity measures proposed over the last decade and a half as general indicators of structure or correlation. Recently, Lopez-Ruiz, Mancini, and Calbet [Phys. Lett, A 209 (1995) 321] introduced another measure of statistical complexity C-LMC that, like others, satisfies the "boundary conditions" of vanishing in the extreme ordered and disordered limits. We examine some properties of C-LMC and find that it is neither an intensive nor an extensive thermodynamic variable and that it vanishes exponentially in the thermodynamic limit for all one-dimensional finite-range spin systems. We propose a simple alteration of C-LMC that renders it extensive. However, this remedy results in a quantity that is a trivial function of the entropy density and hence of no use as a measure of structure or memory. We conclude by suggesting that a useful "statistical complexity" must not only obey the ordered-random boundary conditions of vanishing, it must also be defined in a setting that gives a clear interpretation to what structures are quantified. (C) 1998 Elsevier Science B.V.
引用
收藏
页码:244 / 252
页数:9
相关论文
共 32 条
[1]  
[Anonymous], COM SYS
[2]   Some features of the Lopez-Ruiz-Mancini-Calbet (LMC) statistical measure of complexity [J].
Anteneodo, C ;
Plastino, AR .
PHYSICS LETTERS A, 1996, 223 (05) :348-354
[3]  
Bennet C. H., 1990, COMPLEXITY ENTROPY P, VVIII, P137
[5]  
Bronson R, 1989, MATRIX OPERATIONS
[6]   ON LENGTH OF PROGRAMS FOR COMPUTING FINITE BINARY SEQUENCES [J].
CHAITIN, GJ .
JOURNAL OF THE ACM, 1966, 13 (04) :547-+
[7]  
Cover T. M., 2005, ELEM INF THEORY, DOI 10.1002/047174882X
[8]   SYMBOLIC DYNAMICS OF NOISY CHAOS [J].
CRUTCHFIELD, JP ;
PACKARD, NH .
PHYSICA D, 1983, 7 (1-3) :201-223
[9]   TURBULENT PATTERN BASES FOR CELLULAR-AUTOMATA [J].
CRUTCHFIELD, JP ;
HANSON, JE .
PHYSICA D, 1993, 69 (3-4) :279-301
[10]   INFERRING STATISTICAL COMPLEXITY [J].
CRUTCHFIELD, JP ;
YOUNG, K .
PHYSICAL REVIEW LETTERS, 1989, 63 (02) :105-108