Bias reduction in skewed binary classification with Bayesian neural networks

被引:15
作者
Lisboa, PJG [1 ]
Vellido, A [1 ]
Wong, H [1 ]
机构
[1] Liverpool John Moores Univ, Sch Comp & Math Sci, Liverpool L3 3AF, Merseyside, England
关键词
calibration; marginalisation; Bayesian neural networks; bias;
D O I
10.1016/S0893-6080(00)00022-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 [模式识别与智能系统]; 0812 [计算机科学与技术]; 0835 [软件工程]; 1405 [智能科学与技术];
摘要
The Bayesian evidence framework has become a standard of good practice for neural network estimation of class conditional probabilities. In this approach the conditional probability is marginalised over the distribution of network weights, which is usually approximated by an analytical expression that moderates the network output towards the midrange. In this paper, it is shown that the network calibration is considerably improved by marginalising to the prior distribution. Moreover, marginalisation to the midrange can seriously bias the estimates of the conditional probabilities calculated from the evidence framework. This is especially the case in the modelling of censored data. (C) 2000 Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:407 / 410
页数:4
相关论文
共 8 条
[1]
Biganzoli E, 1998, STAT MED, V17, P1169, DOI 10.1002/(SICI)1097-0258(19980530)17:10<1169::AID-SIM796>3.3.CO
[2]
2-4
[3]
Regularization in skewed binary classification [J].
Lee, SS .
COMPUTATIONAL STATISTICS, 1999, 14 (02) :277-292
[4]
OPTIMIZED FEATURE-EXTRACTION AND THE BAYES DECISION IN FEEDFORWARD CLASSIFIER NETWORKS [J].
LOWE, D ;
WEBB, AR .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1991, 13 (04) :355-364
[5]
THE EVIDENCE FRAMEWORK APPLIED TO CLASSIFICATION NETWORKS [J].
MACKAY, DJC .
NEURAL COMPUTATION, 1992, 4 (05) :720-736
[6]
Tarassenko L, 1998, A Guide to Neural Computing Applications, V1st
[7]
Segmentation of the on-line shopping market using neural networks [J].
Vellido, A ;
Lisboa, PJG ;
Meehan, K .
EXPERT SYSTEMS WITH APPLICATIONS, 1999, 17 (04) :303-314
[8]
WONG H, 1999, INT JOINT C NEUR NET