Associative neural network

被引:71
作者
Tetko, IV
机构
[1] GSF, MIPS, Inst Bioinformat, D-85764 Neuherberg, Germany
[2] Ukrainian Acad Sci, Inst Bioorgan & Petr Chem, Biomed Dept, UA-253660 Kiev 660, Ukraine
关键词
associative memory; bias correction; classification; function approximation; k-nearest neighbors; memory-based methods; memoryless; prototype selection;
D O I
10.1023/A:1019903710291
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An associative neural network (ASNN) is a combination of an ensemble of the feed-forward neural networks and the K-nearest neighbor technique. The introduced network uses correlation between ensemble responses as a measure of distance among the analyzed cases for the nearest neighbor technique and provides an improved prediction by the bias correction of the neural network ensemble both for function approximation and classification. Actually, the proposed method corrects a bias of a global model for a considered data case by analyzing the biases of its nearest neighbors determined in the space of calculated models. An associative neural network has a memory that can coincide with the training set. If new data become available the network can provide a reasonable approximation of such data without a need to retrain the neural network ensemble. Applications of ASNN for prediction of lipophilicity of chemical compounds and classification of UCI letter and satellite data set are presented. The developed algorithm is available on-line at http://www.virtuallaboratory.org/lab/asnn.
引用
收藏
页码:187 / 199
页数:13
相关论文
共 27 条
[1]  
ABELES M, 1991, CORTICOTRONICS NEURA
[2]  
[Anonymous], UCI REPOSITORY MACHI
[3]  
Bishop C. M, 1995, NEURAL NETWORKS PATT
[4]  
Breiman L, 1998, ANN STAT, V26, P801
[5]  
Dasarthy B, 1991, NEAREST NEIGHBOR NN
[6]  
Fahlman S., 1990, ADV NEURAL INFORMATI, V2, P524
[7]  
Freund Y, 1996, Experiments with a new boosting algorithm. In proceedings 13th Int Conf Mach learn. Pp.148-156, P45
[8]   Rate coding versus temporal order coding: a theoretical approach [J].
Gautrais, J ;
Thorpe, S .
BIOSYSTEMS, 1998, 48 (1-3) :57-65
[9]   NEURAL NETWORKS AND THE BIAS VARIANCE DILEMMA [J].
GEMAN, S ;
BIENENSTOCK, E ;
DOURSAT, R .
NEURAL COMPUTATION, 1992, 4 (01) :1-58
[10]  
Hardle W, 1990, SMOOTHING TECHNIQUES