Theoretical performance of genetic pattern classifier

被引:9
作者
Bandyopadhyay, S [1 ]
Murthy, CA [1 ]
Pal, SK [1 ]
机构
[1] Indian Stat Inst, Machine Intelligence Unit, Calcutta 700035, W Bengal, India
来源
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS | 1999年 / 336卷 / 03期
关键词
D O I
10.1016/S0016-0032(98)00035-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
An investigation is carried out to formulate some theoretical results regarding the behavior of a genetic-algorithm-based pattern classification methodology, for an infinitely large number of training data points n, in an N-dimensional space R-N. It is proved that for n --> infinity, and for a sufficiently large number of iterations, the performance of this classifier (when hyperplanes are considered to generate class boundaries) approaches that of the Bayes classifier, which is the optimal classifier when the class distributions and the a priori probabilities are known. It is shown that the optimum number of hyperplanes generated by the proposed classifier is equal to that required to model the Bayes decision boundary when there exists only one partition of the feature space that provides the Bayes error probability. Extensive experimental results on overlapping data sets following triangular and normal distributions with both linear and non-linear class boundaries are provided that conform to these claims. The claims also hold good when circular surfaces are considered as constituting elements/segments of boundaries. It is also shown experimentally that the variation of recognition score with a priori class probability for both the classifiers is similar. (C) 1999 The Franklin Institute. Published by Elsevier Science Ltd.
引用
收藏
页码:387 / 422
页数:36
相关论文
共 21 条
[1]  
[Anonymous], 1991, Handbook of genetic algorithms
[2]  
Apostol T.A., 1985, MATH ANAL, V2nd
[3]  
Ash R. B., 1972, REAL ANAL PROBABILIT, DOI DOI 10.1016/C2013-0-06164-6
[4]   PATTERN-CLASSIFICATION WITH GENETIC ALGORITHMS [J].
BANDYOPADHYAY, S ;
MURTHY, CA ;
PAL, SK .
PATTERN RECOGNITION LETTERS, 1995, 16 (08) :801-808
[5]   Genetic algorithm with elitist model and its convergence [J].
Bhandari, D ;
Murthy, CA ;
Pal, SK .
INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 1996, 10 (06) :731-747
[6]  
Buchanan B. G., 1989, Machine Learning, V4, P251, DOI 10.1007/BF00130712
[7]  
Davis L., 1985, P INT C GENETIC ALGO, P136
[8]  
FORREST S, 1993, P 5 INT C GEN ALG
[9]  
Fukunaga K., 1972, Introduction to statistical pattern recognition
[10]  
GOLDBERG DE, 1989, SERCH OPTIMIZATION M