Self-organization and dynamics reduction in recurrent networks: stimulus presentation and learning

被引:37
作者
Dauce, E
Quoy, M
Cessac, B
Doyon, B
Samuelides, M
机构
[1] CERT DTIM, ONERA, F-31055 Toulouse 4, France
[2] UCP, ETIS, F-95014 Cergy Pontoise, France
[3] Inst Nonlineaire Nice, F-06560 Valbonne, France
[4] CHU Purpan, Serv Neurol, INSERM, U455, F-31059 Toulouse, France
[5] ENSAE, F-31055 Toulouse 4, France
关键词
asymmetric recurrent network; attractor neural networks; bifurcations; chaos; Hebbian learning rule; non-linear dynamics; self-organization; statistical neurodynamics;
D O I
10.1016/S0893-6080(97)00131-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Freeman's investigations on the olfactory bulb of the rabbit showed that its signal dynamics was chaotic, and that recognition of a learned stimulus is linked to a dimension reduction of the dynamics attractor. In this paper we address the question whether this behavior is specific of this particular architecture, or if it is a general property. We study the dynamics of a non-convergent recurrent model-the random recurrent neural networks. In that model a mean-field theory can be used to analyze the autonomous dynamics. We extend this approach with various observations on significant changes in the dynamical regime when sending static random stimuli. Then we propose a Hebb-like learning rule, viewed as a self-organization dynamical process inducing specific reactivity to one random stimulus. We numerically show the dynamics reduction during learning and recognition processes and analyze it in terms of dynamical repartition of local neural activity. (C) 1998 Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:521 / 533
页数:13
相关论文
共 29 条
[1]   PATTERN-RECOGNITION BY AN ARTIFICIAL NETWORK DERIVED FROM BIOLOGIC NEURONAL SYSTEMS [J].
ALKON, DL ;
BLACKWELL, KT ;
BARBOUR, GS ;
RIGLER, AK ;
VOGL, TP .
BIOLOGICAL CYBERNETICS, 1990, 62 (05) :363-376
[2]   CHARACTERISTICS OF RANDOM NETS OF ANALOG NEURON-LIKE ELEMENTS [J].
AMARI, S .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1972, SMC2 (05) :643-&
[3]   EVIDENCE OF CHAOTIC DYNAMICS OF BRAIN ACTIVITY DURING THE SLEEP CYCLE [J].
BABLOYANTZ, A ;
SALAZAR, JM ;
NICOLIS, C .
PHYSICS LETTERS A, 1985, 111 (03) :152-156
[4]  
Ben Arous G., 1995, PROBAB THEORY REL, V102, P455
[5]   MEAN-FIELD EQUATIONS, BIFURCATION MAP AND ROUTE TO CHAOS IN DISCRETE-TIME NEURAL NETWORKS [J].
CESSAC, B ;
DOYON, B ;
QUOY, M ;
SAMUELIDES, M .
PHYSICA D, 1994, 74 (1-2) :24-44
[6]  
CESSAC B, 1995, J PHYS I, V5, P409, DOI 10.1051/jp1:1995135
[7]   NEURONAL MODELS OF COGNITIVE FUNCTIONS [J].
CHANGEUX, JP ;
DEHAENE, S .
COGNITION, 1989, 33 (1-2) :63-109
[8]  
DERRIDA B, 1988, NONLINEAR EVOLUTION
[9]   CONTROL OF THE TRANSITION TO CHAOS IN NEURAL NETWORKS WITH RANDOM CONNECTIVITY [J].
Doyon, B. ;
Cessac, B. ;
Quoy, M. ;
Samuelides, M. .
INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS, 1993, 3 (02) :279-291
[10]   COHERENT OSCILLATIONS - A MECHANISM OF FEATURE LINKING IN THE VISUAL-CORTEX - MULTIPLE ELECTRODE AND CORRELATION ANALYSES IN THE CAT [J].
ECKHORN, R ;
BAUER, R ;
JORDAN, W ;
BROSCH, M ;
KRUSE, W ;
MUNK, M ;
REITBOECK, HJ .
BIOLOGICAL CYBERNETICS, 1988, 60 (02) :121-130