Optimal short-term population coding: When Fisher information fails

被引:75
作者
Bethge, M [1 ]
Rotermund, D [1 ]
Pawelzik, K [1 ]
机构
[1] Univ Bremen, Inst Theoret Phys, D-28334 Bremen, Germany
关键词
D O I
10.1162/08997660260293247
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Efficient coding has been proposed as a first principle explaining neuronal response properties in the central nervous system. The shape of optimal codes, however, strongly depends on the natural limitations of the particular physical system. Here we investigate how optimal neuronal encoding strategies are influenced by the finite number of neurons N (place constraint), the limited decoding time window length T (time constraint), the maximum neuronal firing rate f(max) (power constraint), and the maximal average rate (f)(max) (energy constraint). While Fisher information provides a general lower bound for the mean squared error of unbiased signal reconstruction, its use to characterize the coding precision is limited. Analyzing simple examples, we illustrate some typical pitfalls and thereby show that Fisher information provides a valid measure for the precision of a code only if the dynamic range (f(min)T, f(max)T) is sufficiently large. In particular, we demonstrate that the optimal width of gaussian tuning curves depends on the available decoding time T. Within the broader class of unimodal tuning functions, it turns out that the shape of a Fisher-optimal coding scheme is not unique. We solve this ambiguity by taking the minimum mean square error into account, which leads to flat tuning curves. The tuning width, however, remains to be determined by energy constraints rather than by the principle of efficient coding.
引用
收藏
页码:2317 / 2351
页数:35
相关论文
共 35 条
[1]  
AITKEN AC, 1942, P ROY SOC EDINB A, V62, P369
[2]   SOME INFORMATIONAL ASPECTS OF VISUAL PERCEPTION [J].
ATTNEAVE, F .
PSYCHOLOGICAL REVIEW, 1954, 61 (03) :183-193
[3]   HOW SENSORY MAPS COULD ENHANCE RESOLUTION THROUGH ORDERED ARRANGEMENTS OF BROADLY TUNED RECEIVERS [J].
BALDI, P ;
HEILIGENBERG, W .
BIOLOGICAL CYBERNETICS, 1988, 59 (4-5) :313-318
[4]  
BARLOW HB, 1959, MECH THOUGHT PROCESS, P535
[5]  
BETHGE M, 2002, UNPUB OPTIMAL NEURAL
[6]  
Bishop C. M., 1995, NEURAL NETWORKS PATT
[7]  
Braitenberg V., 1991, ANATOMY CORTEX STAT
[8]   Mutual information, Fisher information, and population coding [J].
Brunel, N ;
Nadal, JP .
NEURAL COMPUTATION, 1998, 10 (07) :1731-1757
[9]   INFORMATION-THEORETIC ASYMPTOTICS OF BAYES METHODS [J].
CLARKE, BS ;
BARRON, AR .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1990, 36 (03) :453-471
[10]  
Cover T. M., 2005, ELEM INF THEORY, DOI 10.1002/047174882X