Modeling the manifolds of images of handwritten digits

被引:213
作者
Hinton, GE
Dayan, P
Revow, M
机构
[1] Department of Computer Science, University of Toronto, Toronto
[2] Center for Biological and Computational Learning, Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 1997年 / 8卷 / 01期
关键词
principal components; factor analysis; autoencoder; minimum description length; density estimation;
D O I
10.1109/72.554192
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper describes two new methods for modeling the manifolds of digitized images of handwritten digits. The models allow a priori information about the structure of the manifolds to be combined with empirical data. Accurate modeling of the manifolds allows digits to be discriminated using the relative probability densities under the alternative models. One of the methods is grounded in principal components analysis, the other in factor analysis. Both methods are based on locally linear low-dimensional approximations to the underlying data manifold. Links with other methods that model the manifold are discussed.
引用
收藏
页码:65 / 74
页数:10
相关论文
共 28 条
[1]  
[Anonymous], 1989, P ADV NEURAL INFORM
[2]  
[Anonymous], 1979, Multivariate analysis
[3]  
BISHOP C, 1975, NEURAL NETWORKS PATT
[4]  
BREGLER C, 1995, ADV NEURAL INFORMATI, V7, P971
[5]   THE HELMHOLTZ MACHINE [J].
DAYAN, P ;
HINTON, GE ;
NEAL, RM ;
ZEMEL, RS .
NEURAL COMPUTATION, 1995, 7 (05) :889-904
[6]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[7]  
Everitt BS., 1984, INTRO LATENT VARIABL
[8]   REPRESENTATION AND MATCHING OF PICTORIAL STRUCTURES [J].
FISCHLER, MA ;
ELSCHLAGER, RA .
IEEE TRANSACTIONS ON COMPUTERS, 1973, C 22 (01) :67-92
[9]  
Fleiss JL., 1981, MEASUREMENT INTERRAT
[10]  
Hastie T., 1995, Advances in Neural Information Processing Systems 7, P999