A numeral character recognition using the PCA mixture model

被引:17
作者
Kim, HC [1 ]
Kim, DJ [1 ]
Bang, SY [1 ]
机构
[1] POSTECH, Dept Comp Engn & Sci, Pohang 790784, South Korea
关键词
mixture model; principal component analysis; PCA mixture model; numeral character recognition; EM algorithm;
D O I
10.1016/S0167-8655(01)00093-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a method for recognizing the numeral characters based on the PCA (Principal Component Analysis) mixture model. The proposed method is motivated by the idea that the classification accuracy is improved by modeling each class into a mixture of several components and by performing the classification in the compact and decorrelated feature space. For realizing the idea, each numeral class is partitioned into several clusters and each cluster's density is estimated by a Gaussian distribution function in the PCA transformed space. The parameter estimation is performed by an iterative EM (Expectation Maximization) algorithm, and model order is selected by a fast sub-optimal validation scheme. The proposed method is also computation-effective because the optimal feature components for a cluster are determined by a sequential elimination of insignificant feature due to the ordering property of the significance among the feature components in the PCA transformed space. Simulation results shows that the proposed recognition method outperforms other methods such as the k-NN (Nearest Neighbor) method, a single PCA model, or the ICA (Independent Component Analysis) mixture model in terms of recognition accuracy. (C) 2002 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:103 / 111
页数:9
相关论文
共 13 条
[1]  
BELLAN R, 1961, ADAPTIVE CONTROL PRO
[2]  
Blake C.L., 1998, UCI repository of machine learning databases
[3]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[4]  
Duda R. O., 1974, Pattern classification and scene analysis
[5]   Modeling the manifolds of images of handwritten digits [J].
Hinton, GE ;
Dayan, P ;
Revow, M .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1997, 8 (01) :65-74
[6]  
HOSTELLING H, 1933, J EDUC PSYCHOL, V24, P417
[7]   A DATABASE FOR HANDWRITTEN TEXT RECOGNITION RESEARCH [J].
HULL, JJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1994, 16 (05) :550-554
[8]   Adaptive Mixtures of Local Experts [J].
Jacobs, Robert A. ;
Jordan, Michael I. ;
Nowlan, Steven J. ;
Hinton, Geoffrey E. .
NEURAL COMPUTATION, 1991, 3 (01) :79-87
[9]   HIERARCHICAL MIXTURES OF EXPERTS AND THE EM ALGORITHM [J].
JORDAN, MI ;
JACOBS, RA .
NEURAL COMPUTATION, 1994, 6 (02) :181-214
[10]  
Lee TW, 1999, ADV NEUR IN, V11, P508