FEEDBACK STABILIZATION USING 2-HIDDEN-LAYER NETS

被引:116
作者
SONTAG, ED
机构
[1] RUTGERS STATE UNIV, DEPT COMP SCI, NEW BRUNSWICK, NJ 08903 USA
[2] RUTGERS STATE UNIV, DEPT ELECT & COMP ENGN, NEW BRUNSWICK, NJ 08903 USA
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 1992年 / 3卷 / 06期
关键词
NEURAL NETS; NONLINEAR CONTROL SYSTEMS; FEEDBACK;
D O I
10.1109/72.165599
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper compares the representational capabilities of one hidden layer and two hidden layer nets consisting of feedforward interconnections of linear threshold units. It is remarked that for certain problems two hidden layers are required, contrary to what might be in principle expected from the known approximation theorems. The differences are not based on numerical accuracy or number of units needed, nor on capabilities for feature extraction, but rather on a much more basic classification into "direct" and "inverse" problems. The former correspond to the approximation of continuous functions, while the latter are concerned with approximating one-sided inverses of continuous functions-and are often encountered in the context of inverse kinematics determination or in control questions. A general result is given showing that nonlinear control systems can be stabilized using two hidden layers, but not in general using just one.
引用
收藏
页码:981 / 990
页数:10
相关论文
共 14 条
[1]   APPROXIMATION-THEORY AND FEEDFORWARD NETWORKS [J].
BLUM, EK ;
LI, LK .
NEURAL NETWORKS, 1991, 4 (04) :511-515
[2]  
CHESTER D, 1990, 1990 P INT JOINT C N, pI265
[3]  
Cybenko G., 1989, Mathematics of Control, Signals, and Systems, V2, P303, DOI 10.1007/BF02551274
[4]   ON THE APPROXIMATE REALIZATION OF CONTINUOUS-MAPPINGS BY NEURAL NETWORKS [J].
FUNAHASHI, K .
NEURAL NETWORKS, 1989, 2 (03) :183-192
[5]  
Hirsch M. W., 1976, DIFFERENTIAL TOPOLOG, V33
[6]   MULTILAYER FEEDFORWARD NETWORKS ARE UNIVERSAL APPROXIMATORS [J].
HORNIK, K ;
STINCHCOMBE, M ;
WHITE, H .
NEURAL NETWORKS, 1989, 2 (05) :359-366
[7]  
Narendra K S, 1990, IEEE Trans Neural Netw, V1, P4, DOI 10.1109/72.80202
[8]  
Sontag E.D., 1990, MATH CONTROL THEORY
[9]   REMARKS ON PIECEWISE-LINEAR ALGEBRA [J].
SONTAG, ED .
PACIFIC JOURNAL OF MATHEMATICS, 1982, 98 (01) :183-201
[10]   NON-LINEAR REGULATION - THE PIECEWISE LINEAR-APPROACH [J].
SONTAG, ED .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1981, 26 (02) :346-358