A unified framework for semi-supervised dimensionality reduction

被引:175
作者
Song, Yangqiu [1 ]
Nie, Feiping [1 ]
Zhang, Changshui [1 ]
Xiang, Shiming [1 ]
机构
[1] Tsinghua Univ, State Key Lab Intelligent Technol & Syst, Tsinghua Natl Lab Informat Sci & Technol TNList, Dept Automat, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
dimensionality reduction; discriminant analysis; manifold analysis; semi-supervised learning;
D O I
10.1016/j.patcog.2008.01.001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In practice, many applications require a dimensionality reduction method to deal with the partially labeled problem. In this paper, we propose a semi-supervised dimensionality reduction framework, which can efficiently handle the unlabeled data. Under the framework, several classical methods, such as principal component analysis (PCA), linear discriminant analysis (LDA), maximum margin criterion (MMC), locality preserving projections (LPP) and their corresponding kernel versions can be seen as special cases. For high-dimensional data, we can give a low-dimensional embedding result for both discriminating multi-class sub-manifolds and preserving local manifold structure. Experiments show that our algorithms can significantly improve the accuracy rates of the corresponding supervised and unsupervised approaches. (c) 2008 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2789 / 2799
页数:11
相关论文
共 27 条
[1]  
[Anonymous], P INT C COMP VIS
[2]  
[Anonymous], UCI REPOSITORY MACHI
[3]   Generalized discriminant analysis using a kernel approach [J].
Baudat, G ;
Anouar, FE .
NEURAL COMPUTATION, 2000, 12 (10) :2385-2404
[4]   Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection [J].
Belhumeur, PN ;
Hespanha, JP ;
Kriegman, DJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) :711-720
[5]  
Belkin M, 2002, ADV NEUR IN, V14, P585
[6]  
Belkin M., 2006, J MACHINE LEARNING R, V1, P1
[7]   Nonlinear Fisher discriminant analysis using a minimum squared error cost function and the orthogonal least squares algorithm [J].
Billings, SA ;
Lee, KL .
NEURAL NETWORKS, 2002, 15 (02) :263-270
[8]  
Chung Fan R. K., 1997, CBMS REGIONAL C SERI, V92
[9]  
Du W., 2005, P FUZZ SYST KNOWL DI, P1
[10]  
Fukunaga K., 1990, INTRO STAT PATTERN R