Analysis of Linsker's application of Hebbian rules to linear networks

被引:55
作者
MacKay, David J. C. [1 ]
Miller, Kenneth D. [2 ]
机构
[1] Calif Inst Technol 139 74, Pasadena, CA 91125 USA
[2] Univ Calif San Francisco, Dept Physiol, San Francisco, CA 94143 USA
关键词
D O I
10.1088/0954-898X/1/3/001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Linsker has reported the development of structured receptive fields in simulations of a Hebb-type synaptic plasticity rule in a feedforward linear network. The synapses develop under dynamics determined by a matrix that is closely related to the covariance matrix of input cell activities. We analyse the dynamics of the learning rule in terms of the eigenvectors of this matrix. These eigenvectors represent independently evolving weight structures. Some general theorems are presented regarding the properties of these eigenvectors and their eigenvalues. For a general covariance matrix four principal parameter regimes are predicted. We concentrate on the Gaussian covariances at layer B -> C of Linsker's network. Analytic and numerical solutions for the eigenvectors at this layer are presented. Three eigenvectors clonunate the dynamics: a DC eigenvector, in which all synapses have the same sign; a bi-lobed, oriented eigenvector; and a circularly symmetric, centre-surround eigenvector. Analysis of the circumstances in which each of these vectors dominates yields an explanation of the emergence of centre-surround structures and symmetry-breaking bi-lobed structures. Criteria are developed estimating the boundary of the parameter regime in which centre-surround structures emerge. The application of our analysis to Linsker's higher layers, at which the covariance functions were oscillatory, is briefly discussed.
引用
收藏
页码:257 / 297
页数:41
相关论文
共 16 条
[1]  
[Anonymous], 1965, FOURIER TRANSFORM IT
[2]  
Atkinson FV., 1964, DISCRETE CONTINUOUS
[4]   SELF-ORGANIZATION IN A PERCEPTUAL NETWORK [J].
LINSKER, R .
COMPUTER, 1988, 21 (03) :105-117
[5]  
LINSKER R, 1988, COMPUTER SIMULATION, P416
[6]  
MACKAY DJC, 1990, ADV NEURAL INFORM PR, V2, P694
[7]  
MACKAY DJC, 1990, NEURAL COMPUT, V2, P169
[8]  
Merzbacher E., 1970, QUANTUM MECH
[9]  
MILLER K D, 1989, Society for Neuroscience Abstracts, V15, P794
[10]  
Miller K.D., 1990, NEUROSCIENCE CONNECT, P267