Supervised dimension reduction of intrinsically low-dimensional data

被引:37
作者
Vlassis, N [1 ]
Motomura, Y
Kröse, B
机构
[1] Univ Amsterdam, RWCP, Autonomous Learning Funct SNN, NL-1012 WX Amsterdam, Netherlands
[2] Electrotech Lab, Tsukuba, Ibaraki 3058568, Japan
关键词
D O I
10.1162/089976602753284491
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High-dimensional data generated by a system with limited degrees of freedom are often constrained in low-dimensional manifolds in the original space. In this article, we investigate dimension-reduction methods for such intrinsically low-dimensional data through linear projections that preserve the manifold structure of the data. For intrinsically one-dimensional data, this implies projecting to a curve on the plane with as few intersections as possible. We are proposing a supervised projection pursuit method that can be regarded as an extension of the single-index model for nonparametric regression. We show results from a toy and two robotic applications.
引用
收藏
页码:191 / 215
页数:25
相关论文
共 19 条
[1]  
[Anonymous], 1999, P 1 INT WORKSH IND C
[2]  
Cover T. M., 2005, ELEM INF THEORY, DOI 10.1002/047174882X
[3]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[4]  
Gill M., 1981, Practical Optimization
[5]   ON PROJECTION PURSUIT REGRESSION [J].
HALL, P .
ANNALS OF STATISTICS, 1989, 17 (02) :573-588
[6]   OPTIMAL SMOOTHING IN SINGLE-INDEX MODELS [J].
HARDLE, W ;
HALL, P ;
ICHIMURA, H .
ANNALS OF STATISTICS, 1993, 21 (01) :157-178
[7]   PRINCIPAL CURVES [J].
HASTIE, T ;
STUETZLE, W .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1989, 84 (406) :502-516
[8]   PROJECTION PURSUIT [J].
HUBER, PJ .
ANNALS OF STATISTICS, 1985, 13 (02) :435-475
[10]   Subspace methods for robot vision [J].
Nayar, SK ;
Nene, SA ;
Murase, H .
IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1996, 12 (05) :750-758