Embedding new data points for manifold learning via coordinate propagation

被引:39
作者
Xiang, Shiming [1 ]
Nie, Feiping [1 ]
Song, Yangqiu [1 ]
Zhang, Changshui
Zhang, Chunxia
机构
[1] Tsinghua Univ, Dept Automat, Tsinghua Natl Lab Informat Sci & Technol TNList, Beijing 100084, Peoples R China
关键词
Manifold learning; Out-of-sample; Coordinate propagation; Tangent space projection; Smooth spline; Quadratic programming; NONLINEAR DIMENSIONALITY REDUCTION; COMPONENT ANALYSIS; ALGORITHMS; EIGENMAPS;
D O I
10.1007/s10115-008-0161-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, a series of manifold learning algorithms have been proposed for nonlinear dimensionality reduction. Most of them can run in a batch mode for a set of given data points, but lack a mechanism to deal with new data points. Here we propose an extension approach, i.e., mapping new data points into the previously learned manifold. The core idea of our approach is to propagate the known coordinates to each of the new data points. We first formulate this task as a quadratic programming, and then develop an iterative algorithm for coordinate propagation. Tangent space projection and smooth splines are used to yield an initial coordinate for each new data point, according to their local geometrical relations. Experimental results and applications to camera direction estimation and face pose estimation illustrate the validity of our approach.
引用
收藏
页码:159 / 184
页数:26
相关论文
共 54 条
  • [1] [Anonymous], P IEEE INT C IM PROC
  • [2] [Anonymous], 2005, P 22 INT C MACHINE L
  • [3] [Anonymous], 2006, ICML '06: Proceedings of the 23rd international conference on Machine learning, DOI [DOI 10.1145/1143844.1143978, 10.1145/1143844.1143978]
  • [4] [Anonymous], 2003, Advances in Neural Information Processing Systems 15, DOI DOI 10.1109/34.682189
  • [5] NEURAL NETWORKS AND PRINCIPAL COMPONENT ANALYSIS - LEARNING FROM EXAMPLES WITHOUT LOCAL MINIMA
    BALDI, P
    HORNIK, K
    [J]. NEURAL NETWORKS, 1989, 2 (01) : 53 - 58
  • [6] Laplacian eigenmaps for dimensionality reduction and data representation
    Belkin, M
    Niyogi, P
    [J]. NEURAL COMPUTATION, 2003, 15 (06) : 1373 - 1396
  • [7] BENGIO Y, 2004, ADV NEURAL INFORM PR, P16
  • [8] GTM: The generative topographic mapping
    Bishop, CM
    Svensen, M
    Williams, CKI
    [J]. NEURAL COMPUTATION, 1998, 10 (01) : 215 - 234
  • [9] Boyd S., 2004, Convex Optimization, DOI [10.1017/cbo9780511804441, DOI 10.1017/CBO9780511804441, 10.1017/CBO9780511804441]
  • [10] Brun A, 2003, LECT NOTES COMPUT SC, V2809, P518