Discriminant Analysis for Fast Multiclass Data Classification Through Regularized Kernel Function Approximation

被引:25
作者
Ghorai, Santanu [1 ]
Mukherjee, Anirban [1 ]
Dutta, Pranab K. [1 ]
机构
[1] Indian Inst Technol, Dept Elect Engn, Kharagpur 721302, W Bengal, India
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2010年 / 21卷 / 06期
关键词
Discriminant analysis; function approximation; multiclass data classification; support vector machine (SVM); SUPPORT VECTOR MACHINE; GENE SELECTION;
D O I
10.1109/TNN.2010.2046646
中图分类号
TP18 [人工智能理论];
学科分类号
140502 [人工智能];
摘要
In this brief we have proposed the multiclass data classification by computationally inexpensive discriminant analysis through vector-valued regularized kernel function approximation (VVRKFA). VVRKFA being an extension of fast regularized kernel function approximation (FRKFA), provides the vector-valued response at single step. The VVRKFA finds a linear operator and a bias vector by using a reduced kernel that maps a pattern from feature space into the low dimensional label space. The classification of patterns is carried out in this low dimensional label subspace. A test pattern is classified depending on its proximity to class centroids. The effectiveness of the proposed method is experimentally verified and compared with multiclass support vector machine (SVM) on several benchmark data sets as well as on gene microarray data for multi-category cancer classification. The results indicate the significant improvement in both training and testing time compared to that of multiclass SVM with comparable testing accuracy principally in large data sets. Experiments in this brief also serve as comparison of performance of VVRKFA with stratified random sampling and sub-sampling.
引用
收藏
页码:1020 / 1029
页数:10
相关论文
共 43 条
[1]
Reducing multiclass to binary: A unifying approach for margin classifiers [J].
Allwein, EL ;
Schapire, RE ;
Singer, Y .
JOURNAL OF MACHINE LEARNING RESEARCH, 2001, 1 (02) :113-141
[2]
Selection bias in gene extraction on the basis of microarray gene-expression data [J].
Ambroise, C ;
McLachlan, GJ .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2002, 99 (10) :6562-6566
[3]
[Anonymous], [No title captured]
[4]
[Anonymous], 1977, Solution of illposed problems
[5]
[Anonymous], 1984, OLSHEN STONE CLASSIF, DOI 10.2307/2530946
[6]
[Anonymous], 2000, P 17 INT C MACHINE L
[7]
[Anonymous], 2000, Pattern Classification
[8]
MLL translocations specify a distinct gene expression profile that distinguishes a unique leukemia [J].
Armstrong, SA ;
Staunton, JE ;
Silverman, LB ;
Pieters, R ;
de Boer, ML ;
Minden, MD ;
Sallan, SE ;
Lander, ES ;
Golub, TR ;
Korsmeyer, SJ .
NATURE GENETICS, 2002, 30 (01) :41-47
[9]
Classification of human lung carcinomas by mRNA expression profiling reveals distinct adenocarcinoma subclasses [J].
Bhattacharjee, A ;
Richards, WG ;
Staunton, J ;
Li, C ;
Monti, S ;
Vasa, P ;
Ladd, C ;
Beheshti, J ;
Bueno, R ;
Gillette, M ;
Loda, M ;
Weber, G ;
Mark, EJ ;
Lander, ES ;
Wong, W ;
Johnson, BE ;
Golub, TR ;
Sugarbaker, DJ ;
Meyerson, M .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2001, 98 (24) :13790-13795
[10]
Blake C. L., 1998, Uci repository of machine learning databases