Kernel nearest-neighbor algorithm

被引:104
作者
Yu, K [1 ]
Ji, L [1 ]
Zhang, XG [1 ]
机构
[1] Tsing Hua Univ, Dept Automat, Inst Informat Proc, State Key Lab Intelligent Technol & Syst, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
kernel; nearest-neighbor; nonlinear classification;
D O I
10.1023/A:1015244902967
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The 'kernel approach' has attracted great attention with the development of support vector machine (SVM) and has been studied in a general way. It offers an alternative solution to increase the computational power of linear learning machines by mapping data into a high dimensional feature space. This 'approach' is extended to the well-known nearest-neighbor algorithm in this paper. It can be realized by substitution of a kernel distance metric for the original one in Hilbert space, and the corresponding algorithm is called kernel nearest-neighbor algorithm. Three data sets, an artificial data set, BUPA liver disorders database and USPS database, were used for testing. Kernel nearest-neighbor algorithm was compared with conventional nearest-neighbor algorithm and SVM Experiments show that kernel nearest-neighbor algorithm is more powerful than conventional nearest-neighbor algorithm, and it can compete with SVM.
引用
收藏
页码:147 / 156
页数:10
相关论文
共 12 条
[11]  
Vapnik V, 1999, NATURE STAT LEARNING
[12]   ASYMPTOTIC PROPERTIES OF NEAREST NEIGHBOR RULES USING EDITED DATA [J].
WILSON, DL .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1972, SMC2 (03) :408-&