A novel and quick SVM-based multi-class classifier

被引:65
作者
Liu, Yiguang [1 ]
You, Zhisheng
Cao, Liping
机构
[1] Sichuan Univ, Sch Comp Sci & Engn, Inst Image & Graph, Chengdu 610064, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Elect Engn, Ctr Nonlinear & Complex Syst, Chengdu 610054, Peoples R China
[3] Sichuan Univ Lib, Chengdu 610064, Peoples R China
基金
中国国家自然科学基金;
关键词
SVM; multi-class classifier; SVMlight approach; objective function;
D O I
10.1016/j.patcog.2006.05.034
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Use different real positive numbers pi to represent all kinds of pattern categories, after mapping the inputted patterns into a special feature space by a non-linear mapping, a linear relation between the mapped patterns and numbers pi is assumed, whose bias and coefficients are undetermined, and the hyper-plane corresponding to zero output of the linear relation is looked as the base hyper-plane. To determine the pending parameters, an objective function is founded aiming to minimize the difference between the outputs of the patterns belonging to a same type and the corresponding pi, and to maximize the distance between any two different hyper-planes corresponding to different pattern types. The objective function is same to that of support vector regression in form, so the coefficients and bias of the linear relation are calculated by some known methods such as SVMlight approach. Simultaneously, three methods are also given to determine pi, the best one is to determine them in training process, which has relatively high accuracy. Experiment results of the IRIS data set show that, the accuracy of this method is better than those of many SVM-based multi-class classifiers, and close to that of DAGSVM (decision-directed acyclic graph SVM), emphatically, the recognition speed is the highest. (c) 2006 Published by Elsevier Ltd on behalf of Pattern Recognition Society.
引用
收藏
页码:2258 / 2264
页数:7
相关论文
共 18 条
  • [1] A new method for multiclass support vector machines.
    Anguita, D
    Ridella, S
    Sterpi, D
    [J]. 2004 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2004, : 407 - 412
  • [2] K-SVCR.: A support vector machine for multi-class classification
    Angulo, C
    Parra, X
    Català, A
    [J]. NEUROCOMPUTING, 2003, 55 (1-2) : 57 - 77
  • [3] Multicategory classification by support vector machines
    Bredensteiner, EJ
    Bennett, KP
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 1999, 12 (1-3) : 53 - 79
  • [4] A tutorial on Support Vector Machines for pattern recognition
    Burges, CJC
    [J]. DATA MINING AND KNOWLEDGE DISCOVERY, 1998, 2 (02) : 121 - 167
  • [5] David V., 2003, NEUROCOMPUTING, V55, P5
  • [6] Duan KB, 2005, LECT NOTES COMPUT SC, V3541, P278
  • [7] Mean field method for the support vector machine regression
    Gao, JB
    Gunn, SR
    Harris, CJ
    [J]. NEUROCOMPUTING, 2003, 50 : 391 - 405
  • [8] Unified dual for bi-class SVM approaches
    González, L
    Angulo, C
    Velasco-Morente, F
    Català, A
    [J]. PATTERN RECOGNITION, 2005, 38 (10) : 1772 - 1774
  • [9] A comparison of methods for multiclass support vector machines
    Hsu, CW
    Lin, CJ
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (02): : 415 - 425
  • [10] Joachims T., 1998, MAKING LARGE SCALE S