Mutual information, Fisher information, and population coding

被引:234
作者
Brunel, N
Nadal, JP
机构
[1] Ecole Normale Super, Phys Stat Lab, CNRS, F-75231 Paris 05, France
[2] Univ Paris 06, Phys Stat Lab, CNRS, Ecole Normale Super, F-75231 Paris 05, France
[3] Univ Paris 07, Phys Stat Lab, CNRS, Ecole Normale Super, F-75231 Paris 05, France
关键词
D O I
10.1162/089976698300017115
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the context of parameter estimation and model selection, it is only quite recently that a direct link between the Fisher information and information-theoretic quantities has been exhibited. We give an interpretation of this link within the standard framework of information theory. We show that in the context of population coding, the mutual information between the activity of a large array of neurons and a stimulus to which the neurons are tuned is naturally related to the Fisher information. In the light of this result, we consider the optimization of the tuning curves parameters in the case of neurons responding to a stimulus represented by an angular variable.
引用
收藏
页码:1731 / 1757
页数:27
相关论文
共 27 条
  • [1] Could information theory provide an ecological theory of sensory processing?
    Aticky, Joseph J.
    [J]. NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2011, 22 (1-4) : 4 - 44
  • [2] Finding Minimum Entropy Codes
    Barlow, H. B.
    Kaushal, T. P.
    Mitchison, G. J.
    [J]. NEURAL COMPUTATION, 1989, 1 (03) : 412 - 423
  • [3] Bhattacharya RN., 1976, NORMAL APPROXIMATION
  • [4] READING A NEURAL CODE
    BIALEK, W
    RIEKE, F
    VANSTEVENINCK, RRD
    WARLAND, D
    [J]. SCIENCE, 1991, 252 (5014) : 1854 - 1857
  • [5] Blahut R.E., 1988, PRINCIPLES PRACTICE
  • [6] INFORMATION-THEORETIC ASYMPTOTICS OF BAYES METHODS
    CLARKE, BS
    BARRON, AR
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 1990, 36 (03) : 453 - 471
  • [7] COVER T, 1991, INFORMATION THEORY
  • [8] GEORGOPOULOS AP, 1982, J NEUROSCI, V2, P1527
  • [9] Green DM., 1966, SIGNAL DETECTION THE
  • [10] LAUGHLIN S, 1981, Z NATURFORSCH C, V36, P910