RECURRENT NEURAL NETWORKS CAN BE TRAINED TO BE MAXIMUM A-POSTERIORI PROBABILITY CLASSIFIERS

被引:16
作者
SANTINI, S
DELBIMBO, A
机构
关键词
RECURRENT NEURAL NETWORKS; MAP CLASSIFIER; SUPERVISED LEARNING; NONLINEAR KALMAN FILTER; REASONABLE ERROR MEASURES;
D O I
10.1016/0893-6080(94)00059-U
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proves that supervised learning algorithms used to train recurrent neural networks have an equilibrium point when the network implements a maximum a posteriori probability (MAP) classifier. The result holds as a limit when the size of the training set goes to infinity. The result is general, because it stems as a property of cost minimizing algorithms, but to prove it we implicitly assume that the network we are training has enough computing power to actually implement the MAP classifier. This assumption can be satisfied using a universal dynamic system approximator. We refer our discussion to Block Feedback Neural Networks (B(F)Ns) and show that they actually have the universal approximation property.
引用
收藏
页码:25 / 29
页数:5
相关论文
共 7 条
[1]  
[Anonymous], 1988, NONLINEAR NONSTATION
[2]   APPROXIMATION-THEORY AND FEEDFORWARD NETWORKS [J].
BLUM, EK ;
LI, LK .
NEURAL NETWORKS, 1991, 4 (04) :511-515
[3]  
HAMPSHIRE J, 1990, 1990 P CONN MOD SUMM
[4]   APPROXIMATION CAPABILITIES OF MULTILAYER FEEDFORWARD NETWORKS [J].
HORNIK, K .
NEURAL NETWORKS, 1991, 4 (02) :251-257
[5]  
SANTINI S, 1991, TR1091 U FIR DIP SIS
[6]  
SANTINI S, 1994, NEURAL NETWORKS, V7
[7]  
[No title captured]