Decision boundary preserving prototype selection for nearest neighbor classification

被引:45
作者
Barandela, R
Ferri, FJ
Sánchez, JS
机构
[1] Inst Technol Toluca, Metepec 52140, Mexico
[2] Univ Valencia, Dept Informat, E-46100 Valencia, Spain
[3] Univ Jaume 1, Dept Llenguatges & Sistemes Informat, Castellon de La Plana 12071, Spain
关键词
Nearest Neighbor rule; size reduction; classification accuracy; consistent subset; decision boundaries;
D O I
10.1142/S0218001405004332
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The excessive computational resources required by the Nearest Neighbor rule are a major concern for a number of specialists and practitioners in the Pattern Recognition community. Many proposals for decreasing this computational burden, through reduction of the training sample size, have been published. This paper introduces an algorithm to reduce the training sample size while preserving the original decision boundaries as much as possible. Consequently, the algorithm tends to obtain classification accuracy close to that of the whole training sample. Several experimental results demonstrate the effectiveness of this method when compared to other reduction algorithms based on similar ideas.
引用
收藏
页码:787 / 806
页数:20
相关论文
共 31 条
[1]  
AHA DW, 1991, MACH LEARN, V6, P37, DOI 10.1007/BF00153759
[2]   Voting over multiple condensed nearest neighbors [J].
Alpaydin, E .
ARTIFICIAL INTELLIGENCE REVIEW, 1997, 11 (1-5) :115-132
[3]   Multiple-prototype classifier design [J].
Bezdek, JC ;
Reichherzer, TR ;
Lim, GS ;
Attikiouzel, Y .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 1998, 28 (01) :67-79
[4]   Advances in instance selection for instance-based learning algorithms [J].
Brighton, H ;
Mellish, C .
DATA MINING AND KNOWLEDGE DISCOVERY, 2002, 6 (02) :153-172
[5]   Another move toward the minimum consistent subset:: A tabu search approach to the condensed nearest neighbor rule [J].
Cerverón, V ;
Ferri, FJ .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2001, 31 (03) :408-413
[6]   FINDING PROTOTYPES FOR NEAREST NEIGHBOR CLASSIFIERS [J].
CHANG, CL .
IEEE TRANSACTIONS ON COMPUTERS, 1974, C 23 (11) :1179-1184
[7]   MINIMAL CONSISTENT SET (MCS) IDENTIFICATION FOR OPTIMAL NEAREST-NEIGHBOR DECISION SYSTEMS-DESIGN [J].
DASARATHY, BV .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1994, 24 (03) :511-517
[8]   An incremental prototype set building technique [J].
Devi, VS ;
Murty, MN .
PATTERN RECOGNITION, 2002, 35 (02) :505-513
[9]  
GASCA E, 2000, P 6 BRAZ S NEUR NETW
[10]  
GATES GW, 1972, IEEE T INFORM THEORY, V18, P431, DOI 10.1109/TIT.1972.1054809