ON THE RELATIONSHIP BETWEEN THE INFORMATION MEASURES AND THE BAYES PROBABILITY OF ERROR

被引:17
作者
GOLIC, JD [1 ]
机构
[1] UNIV BELGRADE, FAC ELECT ENGN, YU-11000 BELGRADE, YUGOSLAVIA
关键词
PATTERN RECOGNITION - PROBABILITY;
D O I
10.1109/TIT.1987.1057357
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Concave measures as a general class of efficiency measures and information measures as a special class of concave measures are defined and investigated. The relationship between any concave measure, information measure in particular, and the Bayes probability of error P//B is determined for any 2 less than equivalent to Q less than infinity , where Q denotes the number of categories in a multicategory information system. The so-called epsilon //0 and epsilon //m criteria are proposed as the similarity measures between the information measures and P//B. The problems of determination, for any 2 less than equivalent to Q less than infinity , of all the information measures with minimal epsilon //0 and epsilon //m criteria, called epsilon //0 -optimal and epsilon //m-optimal, are formulated and completely solved. The minimal values of epsilon //0 and epsilon //m criteria are evaluated as well.
引用
收藏
页码:681 / 693
页数:13
相关论文
共 17 条
[1]  
BAZARA MS, 1973, NONLINEAR PROGRAMMIN
[2]   SOME ASPECTS OF ERROR-BOUNDS IN FEATURE-SELECTION [J].
BOEKEE, DE ;
VANDERLUBBE, JCA .
PATTERN RECOGNITION, 1979, 11 (5-6) :353-360
[3]   ON THE CONVEXITY OF SOME DIVERGENCE MEASURES BASED ON ENTROPY FUNCTIONS [J].
BURBEA, J ;
RAO, CR .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1982, 28 (03) :489-495
[4]   INFORMATION AND DISTANCE MEASURES, ERROR BOUNDS, AND FEATURE SELECTION [J].
CHEN, CH .
INFORMATION SCIENCES, 1976, 10 (02) :159-173
[5]   INEQUALITIES BETWEEN INFORMATION MEASURES AND ERROR PROBABILITY [J].
CHU, JT ;
CHUEH, JC .
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 1966, 282 (02) :121-&
[6]   NEAREST NEIGHBOR PATTERN CLASSIFICATION [J].
COVER, TM ;
HART, PE .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1967, 13 (01) :21-+
[7]   NEW CLASS OF BOUNDS ON BAYES RISK IN MULTIHYPOTHESIS PATTERN-RECOGNITION [J].
DEVIJVER, PA .
IEEE TRANSACTIONS ON COMPUTERS, 1974, C 23 (01) :70-80
[8]  
FANO RM, 1961, TRANSMISSION INFORMA
[9]   ON THE RELATIONSHIP BETWEEN THE EFFICIENCY MEASURES OF MULTICATEGORY INFORMATION-SYSTEMS [J].
GOLIC, JD .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1987, 33 (04) :531-538
[10]   PROBABILITY OF ERROR, EQUIVOCATION, AND CHERNOFF BOUND [J].
HELLMAN, ME ;
RAVIV, J .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1970, 16 (04) :368-+