Difficulty of singularity in population coding

被引:26
作者
Amari, S [1 ]
Nakahara, H [1 ]
机构
[1] RIKEN, Brain Sci Inst, Lab Math Neurosci, Wako, Saitama 3510198, Japan
关键词
D O I
10.1162/0899766053429426
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Fisher information has been used to analyze the accuracy of neural population coding. This works well when the Fisher information does not degenerate, but when two stimuli are presented to a population of neurons, a singular structure emerges by their mutual interactions. In this case, the Fisher information matrix degenerates, and the regularity condition ensuring the Cramer-Rao paradigm of statistics is violated. An animal shows pathological behavior in such a situation. We present a novel method of statistical analysis to understand information in population coding in which algebraic singularity plays a major role. The method elucidates the nature of the pathological case by calculating the Fisher information. We then suggest that synchronous firing can resolve singularity and show a method of analyzing the binding problem in terms of the Fisher information. Our method integrates a variety of disciplines in population coding, such as nonregular statistics, Bayesian statistics, singularity in algebraic geometry, and synchronous firing, under the theme of Fisher information.
引用
收藏
页码:839 / 858
页数:20
相关论文
共 42 条
[1]  
Abeles M., 1991, CORTICONICS
[2]   Natural gradient works efficiently in learning [J].
Amari, S .
NEURAL COMPUTATION, 1998, 10 (02) :251-276
[3]   Synchronous firing and higher-order interactions in neuron pool [J].
Amari, S ;
Nakahara, H ;
Wu, S ;
Sakai, Y .
NEURAL COMPUTATION, 2003, 15 (01) :127-142
[4]  
Amari S, 2001, IEICE T FUND ELECTR, VE84A, P31
[5]   DYNAMICS OF PATTERN FORMATION IN LATERAL-INHIBITION TYPE NEURAL FIELDS [J].
AMARI, SI .
BIOLOGICAL CYBERNETICS, 1977, 27 (02) :77-87
[6]  
AMARI SI, 2000, METHODS INFORMATION
[7]  
[Anonymous], 1977, SYSTEMS NEUROSCIENCE
[8]  
BURNASHEV MV, 2002, PROBLEMS INFORMATION, V38, P328
[9]   INFORMATION-THEORETIC ASYMPTOTICS OF BAYES METHODS [J].
CLARKE, BS ;
BARRON, AR .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1990, 36 (03) :453-471
[10]  
DACUNHACASTELLE D, 1997, PROBABILITY STAT, V1, P285