ON THE COMPUTATIONAL POWER OF NEURAL NETS

被引:407
作者
SIEGELMANN, HT [1 ]
SONTAG, ED [1 ]
机构
[1] RUTGERS STATE UNIV,DEPT MATH,NEW BRUNSWICK,NJ 08903
关键词
D O I
10.1006/jcss.1995.1013
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper deals with finite size networks which consist of interconnections of synchronously evolving processors. Each processor updates its state by applying a ''sigmoidal'' function to a linear combination of the previous states of all units. We prove that one may simulate all Turing machines by such nets. In particular, one can simulate any multi-stack Turing machine in real time, and there is a net made up of 886 processors which computes a universal partial-recursive function. Products (high order nets) are not required, contrary to what had been stated in the literature. Non-deterministic Turing machines can be simulated by non-deterministic rational nets, also in real time. The simulation result has many consequences regarding the decidability, or more generally the complexity, of questions about recursive nets. (C) 1995 Academic Press, Inc.
引用
收藏
页码:132 / 150
页数:19
相关论文
共 30 条
[1]   EFFICIENT SIMULATION OF FINITE AUTOMATA BY NEURAL NETS [J].
ALON, N ;
DEWDNEY, AK ;
OTT, TJ .
JOURNAL OF THE ACM, 1991, 38 (02) :495-514
[2]   A MULTILAYER NEURAL NETWORK WITH PIECEWISE-LINEAR STRUCTURE AND BACK-PROPAGATION LEARNING [J].
BATRUNI, R .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1991, 2 (03) :395-403
[3]  
Berstel J., 1988, RATIONAL SERIES THEI
[4]   ON A THEORY OF COMPUTATION AND COMPLEXITY OVER THE REAL NUMBERS - NP-COMPLETENESS, RECURSIVE FUNCTIONS AND UNIVERSAL MACHINES [J].
BLUM, L ;
SHUB, M ;
SMALE, S .
BULLETIN OF THE AMERICAN MATHEMATICAL SOCIETY, 1989, 21 (01) :1-46
[5]  
BROWN JR, 1988, 2ND P S FRONT MASS P, P43
[6]   Finite State Automata and Simple Recurrent Networks [J].
Cleeremans, Axel ;
Servan-Schreiber, David ;
McClelland, James L. .
NEURAL COMPUTATION, 1989, 1 (03) :372-381
[7]   FINDING STRUCTURE IN TIME [J].
ELMAN, JL .
COGNITIVE SCIENCE, 1990, 14 (02) :179-211
[8]  
FRANKLIN S, 1990, PROGR NEURAL NETWORK, P128
[9]  
GARZON M, 1989, 3RD P INT JOINT C NE, V2, P631
[10]   LEARNING AND EXTRACTING FINITE STATE AUTOMATA WITH 2ND-ORDER RECURRENT NEURAL NETWORKS [J].
GILES, CL ;
MILLER, CB ;
CHEN, D ;
CHEN, HH ;
SUN, GZ ;
LEE, YC .
NEURAL COMPUTATION, 1992, 4 (03) :393-405