An efficient kernel matrix evaluation measure

被引:51
作者
Nguyen, Canh Hao [1 ]
Ho, Tu Bao [1 ]
机构
[1] Japan Adv Inst Sci & Technol, Sch Knowledge Sci, Nomi, Ishikawa 9231292, Japan
关键词
classification; kernel methods; kernel matrix quality measure; kernel target alignment; class separability measure;
D O I
10.1016/j.patcog.2008.04.005
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We study the problem of evaluating the goodness of a kernel matrix for a classification task. As kernel matrix evaluation is usually used in other expensive procedures like feature and model selections, the goodness measure must be Calculated efficiently. Most previous approaches are not efficient except for kernel target alignment (KTA) that can be calculated in O(n(2)) time complexity. Although KTA is widely used, we show that it has some serious drawbacks. We propose an efficient surrogate measure to evaluate the goodness of a kernel matrix based on the data distributions of classes in the feature space. The measure not only overcomes the limitations of KTA but also possesses other properties like invariance, efficiency and an error bound guarantee. Comparative experiments show that the measure is a good indication of the goodness of a kernel matrix. (C) 2008 Elsevier Ltd. All rights reserved.
引用
收藏
页码:3366 / 3372
页数:7
相关论文
共 27 条
[1]  
[Anonymous], 2004, KERNEL METHODS PATTE
[2]  
[Anonymous], 2000, NATURE STAT LEARNING
[3]  
[Anonymous], 1990, SPLINE MODELS OBSERV
[4]  
[Anonymous], 1998, Encyclopedia of Biostatistics
[5]  
[Anonymous], 2005, ADV NEURAL INFORM PR
[6]  
Boyd S., 2004, CONVEX OPTIMIZATION
[7]  
CRAMMER K, 2002, ADV NEURAL INFORM PR, P537
[8]  
Cristianini N., 2001, ADV NEURAL INFORM PR
[9]  
Feller W., 1971, An introduction to probability theory and its applications
[10]   Efficient SVM training using low-rank kernel representations [J].
Fine, S ;
Scheinberg, K .
JOURNAL OF MACHINE LEARNING RESEARCH, 2002, 2 (02) :243-264