Incremental nonlinear dimensionality reduction by manifold learning

被引:196
作者
Law, MHC [1 ]
Jain, AK [1 ]
机构
[1] Michigan State Univ, Dept Comp Sci & Engn, E Lansing, MI 48824 USA
关键词
incremental learning; dimensionality reduction; ISOMAP; manifold learning; unsupervised learning;
D O I
10.1109/TPAMI.2006.56
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Understanding the structure of multidimensional patterns, especially in unsupervised cases, is of fundamental importance in data mining, pattern recognition, and machine learning. Several algorithms have been proposed to analyze the structure of high-dimensional data based on the notion of manifold learning. These algorithms have been used to extract the intrinsic characteristics of different types of high-dimensional data by performing nonlinear dimensionality reduction. Most of these algorithms operate in a '' batch '' modeand cannot be efficiently applied when data are collected sequentially. In this paper, we describe an incremental version of ISOMAP, one of the key manifold learning algorithms. Our experiments on synthetic data as well as real world images demonstrate that our modified algorithm can maintain an accurate low-dimensional representation of the data in an efficient manner.
引用
收藏
页码:377 / 391
页数:15
相关论文
共 53 条
[1]  
[Anonymous], 200227 STANF U DEP S
[2]  
[Anonymous], ADV NEURAL INFORM PR
[3]  
[Anonymous], 2003, Advances in NIPS 15, DOI DOI 10.1109/34.682189
[4]  
[Anonymous], 2005, ADV NEURAL INFORM PR, DOI DOI 10.1002/jps.21929
[5]   NEURAL NETWORKS AND PRINCIPAL COMPONENT ANALYSIS - LEARNING FROM EXAMPLES WITHOUT LOCAL MINIMA [J].
BALDI, P ;
HORNIK, K .
NEURAL NETWORKS, 1989, 2 (01) :53-58
[6]   Laplacian eigenmaps for dimensionality reduction and data representation [J].
Belkin, M ;
Niyogi, P .
NEURAL COMPUTATION, 2003, 15 (06) :1373-1396
[7]  
BERNSTEIN M., 2000, Technical Report
[8]  
BEYGELZIMER A, 2005, COVER TREES NEAREST
[9]   GTM: The generative topographic mapping [J].
Bishop, CM ;
Svensen, M ;
Williams, CKI .
NEURAL COMPUTATION, 1998, 10 (01) :215-234
[10]  
BRUN A, 2003, P 9 INT C AID SYST T, V2809