Problems with the differential receiver operating characteristic (DROC) method

被引:4
作者
Chakraborty, DP [1 ]
机构
[1] Univ Pittsburgh, Dept Radiol, Pittsburgh, PA 15213 USA
来源
MEDICAL IMAGING 2004: IMAGE PERCEPTION, OBSERVER PERFORMANCE, AND TECHNOLOGY ASSESSMENT | 2004年 / 5372卷
关键词
observer performance; ROC; DROC; differential ROC; modality evaluation;
D O I
10.1117/12.533300
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Most papers in these proceedings present ideas that work. This is the story of an idea that did not work as intended. The differential receiver operating characteristic (DROC) method was proposed about 8 years ago. It was intended to measure the difference in performance between two imaging modalities. It was expected that the DROC method could outperform the ROC method in statistical power. This expectation has not been borne out and the author no longer recommends the DROC method. The purpose of this paper is to present a critical look at this method, why the author initially believed it should work, the assumptions involved and the fallacies. The author believes there is value to this frank account as it has yielded, at least for the author, new insights into ROC analysis. The author concludes. with a few personal reflections on his experience with this project and advice on how to deal with negative results.
引用
收藏
页码:138 / 143
页数:6
相关论文
共 18 条
[1]   COMPARISON OF RECEIVER OPERATING CHARACTERISTIC AND FORCED-CHOICE OBSERVER PERFORMANCE-MEASUREMENT METHODS [J].
BURGESS, AE .
MEDICAL PHYSICS, 1995, 22 (05) :643-655
[2]  
Chakraborty D. P., 2000, HDB MED IMAGING, P771
[3]   The Differential Receiver Operating Characteristic (DROC) method: Rationale and results of recent experiments [J].
Chakraborty, DP ;
Howard, NS ;
Kundel, H .
MEDICAL IMAGING 1999: IMAGE PERCEPTION AND PERFORMANCE, 1999, 3663 :82-90
[4]   Proposed solution to the FROC problem and an invitation to collaborate [J].
Chakraborty, DP .
MEDICAL IMAGING 2003: IMAGE PERCEPTION, OBSERVER PERFORMANCE, AND TECHNOLOGY ASSESSMENT, 2003, 5034 :204-212
[5]   FREE-RESPONSE METHODOLOGY - ALTERNATE ANALYSIS AND A NEW OBSERVER-PERFORMANCE EXPERIMENT [J].
CHAKRABORTY, DP ;
WINTER, LHL .
RADIOLOGY, 1990, 174 (03) :873-881
[6]   The differential receiver operating characteristic (DROC) method [J].
Chakraborty, DP ;
Kundel, HL ;
Nodine, C ;
Narayan, TK ;
Devaraju, V .
MEDICAL IMAGING 1998: IMAGE PROCESSING, PTS 1 AND 2, 1998, 3338 :234-240
[7]  
CHAKRABORTY DP, 1997, DIFFERENTIAL RECEIVE
[8]  
CHAKRABORTY DP, 2004, METHODOLOGIES OBSERV
[9]  
CHAKRABORTY DP, 2004, STAT METHODS MED IMA
[10]  
CHAKRABORTY DP, 1999, FAR W IM PERC C CALG