Are multilayer perceptrons adequate for pattern recognition and verification?

被引:56
作者
Gori, M
Scarselli, F
机构
[1] Univ Siena, Dipartimento Ingn Informaz, I-53100 Siena, Italy
[2] Univ Florence, Dipartimento Ingn Sistemi & Informat, I-50139 Florence, Italy
关键词
multilayer perceptrons; pattern recognition; pattern verification; function approximation; closed hemisphere problem;
D O I
10.1109/34.730549
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper discusses the ability of multilayer perceptrons (MLPs) to model the probability distribution of data in typical pattern recognition and verification problems. It is proven that multilayer perceptrons with sigmoidal units and a number of hidden units less or equal than the number of inputs are unable to model patterns distributed in typical clusters, since these networks draw open separation surfaces in the pattern space. When using more hidden units than inputs, the separation surfaces can be closed but, unfortunately, it is proven that determining whether or not an MLP draws closed separation surfaces in the pattern space is NP-hard. The major conclusion of this paper is somewhat opposite to what is believed and reported in many application papers: MLPs are definitely not adequate for applications of pattern recognition requiring a reliable rejection and, especially, they are not adequate for pattern verification tasks.
引用
收藏
页码:1121 / 1132
页数:12
相关论文
共 17 条
[1]   Signature verification using multiple neural classifiers [J].
Bajaj, R ;
Chaudhury, S .
PATTERN RECOGNITION, 1997, 30 (01) :1-7
[2]   A neural network approach to off-line signature verification using directional PDF [J].
Drouhard, JP ;
Sabourin, R ;
Godbout, M .
PATTERN RECOGNITION, 1996, 29 (03) :415-424
[3]   A neural network-based model for paper currency recognition and verification [J].
Frosini, A ;
Gori, M ;
Priami, P .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1996, 7 (06) :1482-1490
[4]   Text-independent speaker identification [J].
Gish, Herbert ;
Schmidt, Michael .
IEEE SIGNAL PROCESSING MAGAZINE, 1994, 11 (04) :18-32
[5]   ON THE PROBLEM OF LOCAL MINIMA IN BACKPROPAGATION [J].
GORI, M ;
TESI, A .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (01) :76-86
[6]   Autoassociator-based models for speaker verification [J].
Gori, M ;
Lastrucci, L ;
Soda, G .
PATTERN RECOGNITION LETTERS, 1996, 17 (03) :241-250
[7]   A neural network approach to quality control of padlock manufacturing [J].
Hakulinen, A ;
Hakkarainen, J .
PATTERN RECOGNITION LETTERS, 1996, 17 (04) :357-362
[8]   Face recognition using a hybrid supervised unsupervised neural network [J].
Intrator, N ;
Reisfeld, D ;
Yeshurun, Y .
PATTERN RECOGNITION LETTERS, 1996, 17 (01) :67-76
[9]  
Johnson D. S., 1978, Theoretical Computer Science, V6, P93, DOI 10.1016/0304-3975(78)90006-3
[10]   Backpropagation Applied to Handwritten Zip Code Recognition [J].
LeCun, Y. ;
Boser, B. ;
Denker, J. S. ;
Henderson, D. ;
Howard, R. E. ;
Hubbard, W. ;
Jackel, L. D. .
NEURAL COMPUTATION, 1989, 1 (04) :541-551