Dynamics of a winner-take-all neural network

被引:40
作者
Fang, YG
Cohen, MA
Kincaid, TG
机构
[1] BOSTON UNIV, DEPT ELECT COMP & SYST ENGN, BOSTON, MA 02215 USA
[2] BOSTON UNIV, DEPT COGNIT & NEURAL SYST, BOSTON, MA 02215 USA
关键词
winner-take-all; shunting inhibition; lateral inhibition; competition; VLSI neural networks; MOSFET; nonlinear dynamics;
D O I
10.1016/0893-6080(96)00019-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper describes a neural network with lateral inhibition, which exhibits dynamic winner-take-all (WTA) behavior. The equations of this network model a current input MOSFET WTA circuit, which motivates the discussion. A very general sufficient condition for the network to have a WTA equilibrium point is obtained and sufficient conditions for the network to converge to the WTA point are presented. This gives explicit expressions for the resolution and lower bound of the input currents. We also show that whenever the network gets into the WTA region, it will stay in that region and settle down exponentially fast to the WTA point. This provides a speed up procedure for the decision making: as soon as it gets into the region, the winner can be picked up. Finally, we show that this WTA neural network has a self-resetting property. Copyright (C) 1996 Elsevier Science Ltd
引用
收藏
页码:1141 / 1154
页数:14
相关论文
共 37 条
[1]   CURRENT-MODE SUBTHRESHOLD MOS CIRCUITS FOR ANALOG VLSI NEURAL SYSTEMS [J].
ANDREOU, AG ;
BOAHEN, KA ;
POULIQUEN, PO ;
PAVASOVIC, A ;
JENKINS, RE ;
STROHBEHN, K .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1991, 2 (02) :205-213
[2]   A HIGH-PRECISION VLSI WINNER-TAKE-ALL CIRCUIT FOR SELF-ORGANIZING NEURAL NETWORKS [J].
CHOI, J ;
SHEU, BJ .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 1993, 28 (05) :576-584
[3]   ABSOLUTE STABILITY OF GLOBAL PATTERN-FORMATION AND PARALLEL MEMORY STORAGE BY COMPETITIVE NEURAL NETWORKS [J].
COHEN, MA ;
GROSSBERG, S .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1983, 13 (05) :815-826
[4]   COMPLEX DYNAMICS IN WINNER-TAKE-ALL NEURAL NETS WITH SLOW INHIBITION [J].
ERMENTROUT, B .
NEURAL NETWORKS, 1992, 5 (03) :415-431
[5]   A VLSI NEURAL PROCESSOR FOR IMAGE DATA-COMPRESSION USING SELF-ORGANIZATION NETWORKS [J].
FANG, WC ;
SHEU, BJ ;
CHEN, OTC ;
CHOI, J .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (03) :506-518
[6]  
FELDMAN JA, 1982, COGNITIVE SCI, V6, P205, DOI 10.1016/S0364-0213(82)80001-3
[7]   COMPETITION, DECISION, AND CONSENSUS [J].
GROSSBERG, S .
JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 1978, 66 (02) :470-493
[8]   NONLINEAR NEURAL NETWORKS - PRINCIPLES, MECHANISMS, AND ARCHITECTURES [J].
GROSSBERG, S .
NEURAL NETWORKS, 1988, 1 (01) :17-61
[9]  
GROSSBERG S, 1973, STUD APPL MATH, V52, P213
[10]  
Haykin S., 1994, NEURAL NETWORKS COMP