Energy efficient neural codes

被引:334
作者
Levy, WB
Baxter, RA
机构
[1] Department of Neurosurgery, University of Virginia, Charlottesville
关键词
D O I
10.1162/neco.1996.8.3.531
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In 1969 Barlow introduced the phrase ''economy of impulses'' to express the tendency for successive neural systems to use lower and lower levels of cell firings to produce equivalent encodings. From this viewpoint, the ultimate economy of impulses is a neural code of minimal redundancy. The hypothesis motivating our research is that energy expenditures, e.g., the metabolic cost of recovering from an action potential relative to the cost of inactivity, should also be factored into the economy of impulses. In fact, coding schemes with the largest representational capacity are not, in general, optimal when energy expenditures are taken into account. We show that for both binary and analog neurons, increased energy expenditure per neuron implies a decrease in average firing rate if energy efficient information transmission is to be maintained.
引用
收藏
页码:531 / 543
页数:13
相关论文
共 18 条
[1]   INFORMATION MAINTENANCE AND STATISTICAL DEPENDENCE REDUCTION IN SIMPLE NEURAL NETWORKS [J].
ADELSBERGERMANGAN, DM ;
LEVY, WB .
BIOLOGICAL CYBERNETICS, 1992, 67 (05) :469-477
[2]   Could information theory provide an ecological theory of sensory processing? [J].
Aticky, Joseph J. .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2011, 22 (1-4) :4-44
[3]  
Barlow H., 1969, Information processing in the nervous system pp., P209, DOI DOI 10.1007/978-3-662-25549-0_11
[4]  
Barlow H B., 1959, SENSORY MECH REDUCTI, P535
[5]  
Clarke DD, 1989, BASIC NEUROCHEMISTRY, P565
[6]  
Cover T. M., 2005, ELEM INF THEORY, DOI 10.1002/047174882X
[7]   FORMING SPARSE REPRESENTATIONS BY LOCAL ANTI-HEBBIAN LEARNING [J].
FOLDIAK, P .
BIOLOGICAL CYBERNETICS, 1990, 64 (02) :165-170
[8]   INFORMATION THEORY AND STATISTICAL MECHANICS [J].
JAYNES, ET .
PHYSICAL REVIEW, 1957, 106 (04) :620-630
[9]   INFORMATION THEORY AND STATISTICAL MECHANICS .2. [J].
JAYNES, ET .
PHYSICAL REVIEW, 1957, 108 (02) :171-190
[10]   DIFFERENTIAL-EFFECTS OF ELECTRICAL-STIMULATION OF SCIATIC-NERVE ON METABOLIC-ACTIVITY IN SPINAL-CORD AND DORSAL-ROOT GANGLION IN THE RAT [J].
KADEKARO, M ;
CRANE, AM ;
SOKOLOFF, L .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1985, 82 (17) :6010-6013