A CONVERGENT GENERATOR OF NEURAL NETWORKS

被引:8
作者
COURRIEU, P
机构
[1] Centre de Recherche en Psychologie Cognitive, CNRS-Université de Provence
关键词
NEURAL NETWORKS; CONNECTIONISM; SUPERVISED LEARNING; NEURAL ARCHITECTURE GENERATION; OPTIMIZATION;
D O I
10.1016/S0893-6080(05)80128-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article presents a new algorithm for the automatic generation of neural architectures and supervised learning. Given a set of examples, the algorithm generates an architecture and synaptic weights that are adapted to the sampled problem. The algorithm supports any type and amount of numerical input and output. The learning/generation process is guaranteed to converge in a strictly finite number of steps. With the exception of certain a priori nonoptimal architectures, all architectures without internal loops are potentially accessible, and the algorithm tends to generate architectures of minimal complexity, giving it high generalization performance in the learned domain.
引用
收藏
页码:835 / 844
页数:10
相关论文
共 14 条
  • [1] COURRIEU P, 1991, CREPCOF13621 U PROV
  • [2] COURRIEU P, 1992, CREPCO TA9202 U PROV
  • [3] FUNCTION MINIMIZATION BY CONJUGATE GRADIENTS
    FLETCHER, R
    REEVES, CM
    [J]. COMPUTER JOURNAL, 1964, 7 (02) : 149 - &
  • [4] FREAN M, 1990, UPSTART ALGORITHM ME
  • [5] KAYAMA M, 1990, 3RD P INT WORKSH NEU, P363
  • [6] Knerr S., 1990, Neurocomputing, Algorithms, Architectures and Applications. Proceedings of the NATO Advanced Research Workshop, P41
  • [7] LENGELLE R, 1992, SEP ICANN92 BRIGHT
  • [8] McClelland J. L., 1986, PARALLEL DISTRIBUTED, V1
  • [9] LEARNING IN FEEDFORWARD LAYERED NETWORKS - THE TILING ALGORITHM
    MEZARD, M
    NADAL, JP
    [J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1989, 22 (12): : 2191 - 2203
  • [10] Minsky M., 1969, PERCEPTRONS