Unsupervised learning of image manifolds by semidefinite programming

被引:433
作者
Weinberger, Kilian Q. [1 ]
Saul, Lawrence K. [1 ]
机构
[1] Univ Penn, Dept Comp & Informat Sci, Philadelphia, PA 19104 USA
基金
美国国家科学基金会;
关键词
manifold learning; dimensionality reduction; semidefinite programming; kernel methods; data analysis; image manifolds; semidefinite embedding;
D O I
10.1007/s11263-005-4939-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Can we detect low dimensional structure in high dimensional data sets of images? In this paper, we propose an algorithm for unsupervised learning of image manifolds by semidefinite programming. Given a data set of images, our algorithm computes a low dimensional representation of each image with the property that distances between nearby images are preserved. More generally, it can be used to analyze high dimensional data that lies on or near a low dimensional manifold. We illustrate the algorithm on easily visualized examples of curves and surfaces, as well as on actual images of faces, handwritten digits, and solid objects.
引用
收藏
页码:77 / 90
页数:14
相关论文
共 47 条
[1]  
[Anonymous], 200227 STANF U DEP S
[2]  
[Anonymous], P 22 INT C MACH LEAR
[3]   Laplacian eigenmaps for dimensionality reduction and data representation [J].
Belkin, M ;
Niyogi, P .
NEURAL COMPUTATION, 2003, 15 (06) :1373-1396
[4]   Shape matching and object recognition using shape contexts [J].
Belongie, S ;
Malik, J ;
Puzicha, J .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (04) :509-522
[5]  
Bengio Y, 2004, ADV NEUR IN, V16, P177
[6]   Image representations for visual learning [J].
Beymer, D ;
Poggio, T .
SCIENCE, 1996, 272 (5270) :1905-1909
[7]  
BISWAS P, 2003, DISTRIBUTED METHODS
[8]  
Blitzer J., 2005, ADV NEURAL INFORM PR
[9]   CSDP, a C library for semidefinite programming [J].
Borchers, B .
OPTIMIZATION METHODS & SOFTWARE, 1999, 11-2 (1-4) :613-623
[10]  
BOWLING M, 2005, P 22 INT C MACH LEAR