A two-stage ROC curve regression model when sampling a population of diagnosticians

被引:1
作者
Beam, CA [1 ]
机构
[1] Med Coll Wisconsin, Milwaukee, WI 53226 USA
来源
MEDICAL IMAGING 2002: IMAGE PERCEPTION, OBSERVER PERFORMANCE, AND TECHNOLOGY ASSESSMENT | 2002年 / 4686卷
关键词
ROC curve; regression; population reader studies;
D O I
10.1117/12.462697
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
This paper presents a statistical method to explore and assess variability among diagnosticians in their accuracy and the association between accuracy and characteristics of diagnosticians and patients. The method assumes random sampling from a population of diagnosticians in addition to, and independent of, the random sampling from a population of patients. It is assumed the diagnosticians provide ordinal diagnostic ratings to all patients. In "Stage I", the Binormal Model is used to summarize the data into diagnostician-specific accuracy parameters at each patient covariate level. In "Stage II", the reduced data is then regressed on characteristics of the diagnosticians. Statistical inference is driven by bootstrapping. An application of the method to a national study of mammogram interpretation variability is presented. Empirical and theoretical evaluations are presented which substantiate the method. It will be shown that the model belongs to the well-known class of General Linear Models. The primary strength of the method is that it facilitates familiar and graphical approaches to the analysis of complex diagnostic ratings data arising from the simultaneous sampling of the population of diagnosticians as well as of the population of patients.
引用
收藏
页码:236 / 247
页数:12
相关论文
共 14 条
[1]  
[Anonymous], 1989, SELECTED PAPERS C R
[2]   Variability in the interpretation of screening mammograms by US radiologists - Findings from a national sample [J].
Beam, CA ;
Layde, PM ;
Sullivan, DC .
ARCHIVES OF INTERNAL MEDICINE, 1996, 156 (02) :209-213
[3]   Components-of-variance models and multiple-bootstrap experiments: An alternative method for random-effects, receiver operating characteristic analysis [J].
Beiden, SV ;
Wagner, RF ;
Campbell, G .
ACADEMIC RADIOLOGY, 2000, 7 (05) :341-349
[4]   RECEIVER OPERATING CHARACTERISTIC RATING ANALYSIS - GENERALIZATION TO THE POPULATION OF READERS AND PATIENTS WITH THE JACKKNIFE METHOD [J].
DORFMAN, DD ;
BERBAUM, KS ;
METZ, CE .
INVESTIGATIVE RADIOLOGY, 1992, 27 (09) :723-731
[5]  
Efron B., 1982, SOC IND APPL MATH CB, V38, DOI [10.1137/1.9781611970319, DOI 10.1137/1.9781611970319]
[6]   BOOTSTRAPPING REGRESSION-MODELS [J].
FREEDMAN, DA .
ANNALS OF STATISTICS, 1981, 9 (06) :1218-1228
[7]  
FULLER WA, 1991, MEASUREMENT ERRORS S, pCH30
[8]  
Gatsonis C A, 1995, Acad Radiol, V2 Suppl 1, pS14
[9]   BASIC PRINCIPLES OF ROC ANALYSIS [J].
METZ, CE .
SEMINARS IN NUCLEAR MEDICINE, 1978, 8 (04) :283-298
[10]   ANALYSIS OF REPEATED ORDERED CATEGORICAL OUTCOMES WITH POSSIBLY MISSING OBSERVATIONS AND TIME-DEPENDENT COVARIATES [J].
STRAM, DO ;
WEI, LJ ;
WARE, JH .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1988, 83 (403) :631-637