A contaminated binormal model for ROC data - Part II. A formal model

被引:63
作者
Dorfman, DD
Berbaum, KS
机构
[1] Univ Iowa, Dept Psychol, Iowa City, IA 52242 USA
[2] Univ Iowa, Dept Radiol, Iowa City, IA 52242 USA
关键词
decision theory; diagnostic radiology; receiver operating characteristic (ROC) curve;
D O I
10.1016/S1076-6332(00)80383-9
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Rationale and Objectives. A contaminated binormal receiver operating characteristic (ROC) model is proposed to account for ROC data that have very few false-positive reports even though many healthy subjects are sampled. The model assumes that no signal information is captured for a proportion of abnormalities, and that these abnormalities have the same distribution as noise along the latent decision axis. Materials and Methods. The authors developed a formal psychophysical model, presented here in detail. They have specified the psychophysical assumptions of the theory, and have provided proofs that include all essential details, from assumptions to implications. With the technical details that are provided, this theory can be implemented with computer programs to fit data. Results. The new model can fit ROC data in which some or all of the ROC points have false-positive fractions of 0 and true-positive fractions of less than 1, without implying that performance is perfect. The resulting ROC curves are always proper, never exhibiting inappropriate chance line crossings. The model predicts that, under certain conditions, a bimodal categorical rating histogram will be observed for the signal distribution. The model predicts a relationship between the mean and standard deviation of the signal distribution and holds that, for expert decision makers, there are situations in which the prevalence and utility matrix preclude operating points in some ROC regions. The model has a straightforward extension to the joint detection and localization ROC curve. Conclusion. The contaminated binormal model accounts for ROC data with few or no false-positive reports.
引用
收藏
页码:427 / 437
页数:11
相关论文
共 21 条
[1]   NEURAL THEORIES OF SIMPLE VISUAL DISCRIMINATIONS [J].
BLACKWELL, HR .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA, 1963, 53 (01) :129-&
[2]  
BLACKWELL HR, 1953, B ENG RES I U MICH, V36, P14
[3]  
BRANDSER EA, IN PRESS AJR
[4]  
Clark CR, 1994, ORTHOPAEDICS ESSENTI
[5]  
Dorfman D. D., 1982, EVALUATION DIAGNOSTI, P212
[6]   MAXIMUM-LIKELIHOOD ESTIMATION OF PARAMETERS OF SIGNAL-DETECTION THEORY AND DETERMINATION OF CONFIDENCE INTERVALS - RATING-METHOD DATA [J].
DORFMAN, DD ;
ALF, E .
JOURNAL OF MATHEMATICAL PSYCHOLOGY, 1969, 6 (03) :487-&
[7]   DEGENERACY AND DISCRETE RECEIVER OPERATING CHARACTERISTIC RATING DATA [J].
DORFMAN, DD ;
BERBAUM, KS .
ACADEMIC RADIOLOGY, 1995, 2 (10) :907-915
[8]   Proper receiver operating characteristic analysis: The bigamma model [J].
Dorfman, DD ;
Berbaum, KS ;
Metz, CE ;
Lenth, RV ;
Hanley, JA ;
AbuDagga, H .
ACADEMIC RADIOLOGY, 1997, 4 (02) :138-149
[9]   MAXIMUM LIKELIHOOD ESTIMATION OF PARAMETERS OF SIGNAL DETECTION THEORY - A DIRECT SOLUTION [J].
DORFMAN, DD ;
ALF, E .
PSYCHOMETRIKA, 1968, 33 (01) :117-&
[10]   A contaminated binormal model for ROC data - Part I. Some interesting examples of binormal degeneracy [J].
Dorfman, DD ;
Berbaum, KS ;
Brandser, EA .
ACADEMIC RADIOLOGY, 2000, 7 (06) :420-426