Improving support vector machine classifiers by modifying kernel functions

被引:786
作者
Amari, S [1 ]
Wu, S [1 ]
机构
[1] RIKEN, Brain Sci Inst, Inst Phys & Chem Res, Wako, Saitama, Japan
关键词
support vector machine; pattern classification; information geometry; kernel function; radial basis function; Riemannian geometry; kernel adatron; nonlinear classification;
D O I
10.1016/S0893-6080(99)00032-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a method of modifying a kernel function to improve the performance of a support vector machine classifier. This is based on the structure of the Riemannian geometry induced by the kernel function. The idea is to enlarge the spatial resolution around the separating boundary surface, by a conformal mapping, such that the separability between classes is increased. Examples are given specifically for modifying Gaussian Radial Basis Function kernels. Simulation results for both artificial and real data show remarkable improvement of generalization errors, supporting our idea. (C) 1999 Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:783 / 789
页数:7
相关论文
共 14 条
[1]  
Aizerman M., 1964, AUTOMAT REM CONTR, V25, P821, DOI DOI 10.1234/12345678
[2]   THE ADATRON - AN ADAPTIVE PERCEPTRON ALGORITHM [J].
ANLAUF, JK ;
BIEHL, M .
EUROPHYSICS LETTERS, 1989, 10 (07) :687-692
[3]  
[Anonymous], P INT C ENG APPL NEU
[4]  
BOSER BE, 1992, 5 ANN WORKSH COMP LE
[5]  
Burges CJC, 1999, ADVANCES IN KERNEL METHODS, P89
[6]  
CORTES C, 1995, MACH LEARN, V20, P273, DOI 10.1023/A:1022627411411
[7]  
FRIESS TT, 1998, P 1K INT C MACHINE L
[8]   REGULARIZATION THEORY AND NEURAL NETWORKS ARCHITECTURES [J].
GIROSI, F ;
JONES, M ;
POGGIO, T .
NEURAL COMPUTATION, 1995, 7 (02) :219-269
[9]   An equivalence between sparse approximation and support vector machines [J].
Girosi, F .
NEURAL COMPUTATION, 1998, 10 (06) :1455-1480
[10]   ASYMPTOTIC THEORY OF SEQUENTIAL ESTIMATION - DIFFERENTIAL GEOMETRICAL APPROACH [J].
OKAMOTO, I ;
AMARI, S ;
TAKEUCHI, K .
ANNALS OF STATISTICS, 1991, 19 (02) :961-981