Estimating the entropy rate of spike trains via Lempel-Ziv complexity

被引:117
作者
Amigó, JM
Szczepanski, J
Wajnryb, E
Sanchez-Vives, MV
机构
[1] Inst Fundamental Technol Res, PL-00049 Warsaw, Poland
[2] Univ Miguel Hernandez, CSIC, Inst Neurociencias, Alacant 03550, Spain
关键词
D O I
10.1162/089976604322860677
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Normalized Lempel-Ziv complexity, which measures the generation rate of new patterns along a digital sequence, is closely related to such important source properties as entropy and compression ratio, but, in contrast to these, it is a property of individual sequences. In this article, we propose to exploit this concept to estimate (or, at least, to bound from below) the entropy of neural discharges (spike trains). The main advantages of this method include fast convergence of the estimator (as supported by numerical simulation) and the fact that there is no need to know the probability law of the process generating the signal. Furthermore, we present numerical and experimental comparisons of the new method against the standard method based on word frequencies, providing evidence that this new approach is an alternative entropy estimator for binned spike trains.
引用
收藏
页码:717 / 736
页数:20
相关论文
共 15 条
  • [1] On the number of states of the neuronal sources
    Amigó, JM
    Szczepanski, J
    Wajnryb, E
    Sanchez-Vives, MV
    [J]. BIOSYSTEMS, 2003, 68 (01) : 57 - 66
  • [2] Information theory and neural coding
    Borst, A
    Theunissen, FE
    [J]. NATURE NEUROSCIENCE, 1999, 2 (11) : 947 - 957
  • [3] Cover T. M., 2005, ELEM INF THEORY, DOI 10.1002/047174882X
  • [4] COMPLEXITY OF FINITE SEQUENCES
    LEMPEL, A
    ZIV, J
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 1976, 22 (01) : 75 - 81
  • [5] MacKAY DONALD M., 1952, BULL MATH BIOPHYS, V14, P127, DOI 10.1007/BF02477711
  • [6] Estimation of entropy and mutual information
    Paninski, L
    [J]. NEURAL COMPUTATION, 2003, 15 (06) : 1191 - 1253
  • [7] Temporal coding of visual information in the thalamus
    Reinagel, P
    Reid, RC
    [J]. JOURNAL OF NEUROSCIENCE, 2000, 20 (14) : 5392 - 5400
  • [8] Rieke F., 1998, SPIKES EXPLORING NAT
  • [9] Sanchez-Vives MV, 2000, J NEUROSCI, V20, P4267
  • [10] Sanchez-Vives MV, 2000, J NEUROSCI, V20, P4286