Decision boundary feature extraction for neural networks

被引:89
作者
Lee, C [1 ]
Landgrebe, DA [1 ]
机构
[1] PURDUE UNIV,SCH ELECT & COMP ENGN,W LAFAYETTE,IN 47907
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 1997年 / 8卷 / 01期
基金
美国国家航空航天局;
关键词
neural networks; feature extraction; decision boundary; classification; decision boundary feature matrix; pattern recognition;
D O I
10.1109/72.554193
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a new feature extraction method for feedforward neural networks. The method is based on the recently published decision boundary feature extraction algorithm which is based on the fact that all the necessary features for classification can be extracted from the decision boundary. The decision boundary feature extraction algorithm can take advantage of characteristics of neural networks which can solve complex problems with arbitrary decision boundaries without assuming underlying probability distribution functions of the data. To apply the decision boundary feature extraction method, we first give a specific definition for the decision boundary in a neural network. Then, we propose a procedure for extracting all the necessary features for classification from the decision boundary. Experiments show promising results.
引用
收藏
页码:75 / 83
页数:9
相关论文
共 27 条
[1]   NEURAL NETWORKS AND PRINCIPAL COMPONENT ANALYSIS - LEARNING FROM EXAMPLES WITHOUT LOCAL MINIMA [J].
BALDI, P ;
HORNIK, K .
NEURAL NETWORKS, 1989, 2 (01) :53-58
[2]  
BIEHL LL, 1982, P MACH PROC REM SENS
[3]   FAST GENETIC SELECTION OF FEATURES FOR NEURAL NETWORK CLASSIFIERS [J].
BRILL, FZ ;
BROWN, DE ;
MARTIN, WN .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (02) :324-328
[4]  
Duda R. O., 1973, PATTERN CLASSIFICATI, V3
[5]  
ERSOY O, 1990, IEEE T NEURAL NE JUN, V1
[6]  
FOLDIAK P, 1989, JUN P IJCNN INT JOIN, V1, P401
[7]   OPTIMAL SET OF DISCRIMINANT VECTORS [J].
FOLEY, DH ;
SAMMON, JW .
IEEE TRANSACTIONS ON COMPUTERS, 1975, C 24 (03) :281-289
[8]   NONPARAMETRIC DISCRIMINANT-ANALYSIS [J].
FUKUNAGA, K ;
MANTOCK, JM .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1983, 5 (06) :671-678
[9]   APPLICATION OF KARHUNEN-LOEVE EXPANSION TO FEATURE SELECTION AND ORDERING [J].
FUKUNAGA, K ;
KOONTZ, WLG .
IEEE TRANSACTIONS ON COMPUTERS, 1970, C 19 (04) :311-&
[10]  
FUKUNAGA K, 1990, INTRO STATISTICAL PA