Effect of Computer-aided Detection for CT Colonography in a Multireader, Multicase Trial

被引:69
作者
Dachman, Abraham H. [1 ]
Obuchowski, Nancy A. [2 ]
Hoffmeister, Jeffrey W. [3 ]
Hinshaw, J. Louis [4 ]
Frew, Michael I. [5 ]
Winter, Thomas C. [6 ]
Van Uitert, Robert L. [3 ]
Periaswamy, Senthil [3 ]
Summers, Ronald M. [7 ]
Hillman, Bruce J. [8 ]
机构
[1] Univ Chicago, Dept Radiol, Chicago, IL 60637 USA
[2] Cleveland Clin, Dept Quantitat Hlth Sci, Cleveland, OH USA
[3] ICAD, Nashua, NH USA
[4] Univ Wisconsin Hosp & Clin, Dept Radiol, Madison, WI USA
[5] Walter Reed Army Med Ctr, Dept Radiol, Washington, DC 20307 USA
[6] Univ Utah, Dept Radiol, Salt Lake City, UT 84132 USA
[7] Natl Inst Hlth Clin Ctr, Imaging Biomarkers & Computer Aided Diag Lab, Dept Radiol & Imaging Sci, Bethesda, MD USA
[8] Univ Virginia Hlth Syst, Dept Radiol Res, Charlottesville, VA USA
基金
美国国家卫生研究院;
关键词
ASSISTED READER SOFTWARE; TOMOGRAPHIC COLONOGRAPHY; POLYP DETECTION; DETECTION CAD; VIRTUAL COLONOSCOPY; 2ND READER; PRIMARY; 2D; PERFORMANCE; PARADIGM; SENSITIVITY;
D O I
10.1148/radiol.10091890
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose: To assess the effect of using computer-aided detection (CAD) in second-read mode on readers' accuracy in interpreting computed tomographic (CT) colonographic images. Materials and Methods: The contributing institutions performed the examinations under approval of their local institutional review board, with waiver of informed consent, for this HIPAA-compliant study. A cohort of 100 colonoscopy-proved cases was used: In 52 patients with findings positive for polyps, 74 polyps of 6 mm or larger were observed in 65 colonic segments; in 48 patients with findings negative for polyps, no polyps were found. Nineteen blinded readers interpreted each case at two different times, with and without the assistance of a commercial CAD system. The effect of CAD was assessed in segment-level and patient-level receiver operating characteristic (ROC) curve analyses. Results: Thirteen (68%) of 19 readers demonstrated higher accuracy with CAD, as measured with the segment-level area under the ROC curve (AUC). The readers' average segment-level AUC with CAD (0.758) was significantly greater (P = .015) than the average AUC in the unassisted read (0.737). Readers' per-segment, per-patient, and per-polyp sensitivity for all polyps of 6 mm or larger was higher (P < .011,.007,.005, respectively) for readings with CAD compared with unassisted readings (0.517 versus 0.465, 0.521 versus 0.466, and 0.477 versus 0.422, respectively). Sensitivity for patients with at least one large polyp of 10 mm or larger was also higher (P < .047) with CAD than without (0.777 versus 0.743). Average reader sensitivity also improved with CAD by more than 0.08 for small adenomas. Use of CAD reduced specificity of readers by 0.025 (P = .05). Conclusion: Use of CAD resulted in a significant improvement in overall reader performance. CAD improves reader sensitivity when measured per segment, per patient, and per polyp for small polyps and adenomas and also reduces specificity by a small amount. (C) RSNA, 2010
引用
收藏
页码:827 / 835
页数:9
相关论文
共 40 条
[1]  
American College of Radiology, ACR PRACT GUID PERF
[2]   Missed lesions and false-positive findings on computed-tomographic colonography: a controlled prospective analysis [J].
Arnesen, RB ;
Adamsen, S ;
Svendsen, LB ;
Raaschou, HO ;
von Benzon, E ;
Hansen, OH .
ENDOSCOPY, 2005, 37 (10) :937-944
[3]   Computer-aided detection of colorectal polyps: Can it improve sensitivity of less-experienced readers? Preliminary findings [J].
Baker, Mark E. ;
Bogoni, Luca ;
Obuchowski, Nancy A. ;
Dass, Chandra ;
Kendzierski, Renee M. ;
Remer, Erick M. ;
Einstein, David M. ;
Cathier, Pascal ;
Jerebko, Anna ;
Lakare, Sarang ;
Blum, Andrew ;
Caroline, Dina F. ;
Macari, Michael .
RADIOLOGY, 2007, 245 (01) :140-149
[4]   Computer-aided detection (CAD) for CT colonography: a tool to address a growing need [J].
Bogoni, L ;
Cathier, P ;
Dundar, M ;
Jerebko, A ;
Lakare, S ;
Liang, J ;
Periaswamy, S ;
Baker, ME ;
MacAri, M .
BRITISH JOURNAL OF RADIOLOGY, 2005, 78 :S57-S62
[5]   Virtual colonoscopy: effect of computer-assisted detection (CAD) on radiographer performance [J].
Burling, D. ;
Moore, A. ;
Marshall, M. ;
Weldon, J. ;
Gillen, C. ;
Baldwin, R. ;
Smith, K. ;
Pickhardt, P. ;
Honeyfield, L. ;
Taylor, S. .
CLINICAL RADIOLOGY, 2008, 63 (05) :549-556
[6]   Formative evaluation of standardized training for CT colonographic image interpretation by novice readers [J].
Dachman, Abraham H. ;
Kelly, Katherine B. ;
Zintsmaster, Michael P. ;
Rana, Rich ;
Khankari, Shweta ;
Novak, Joseph D. ;
Ali, Arif N. ;
Qalbani, Adnan ;
Fletcher, Joel G. .
RADIOLOGY, 2008, 249 (01) :167-177
[7]   COMPARING THE AREAS UNDER 2 OR MORE CORRELATED RECEIVER OPERATING CHARACTERISTIC CURVES - A NONPARAMETRIC APPROACH [J].
DELONG, ER ;
DELONG, DM ;
CLARKEPEARSON, DI .
BIOMETRICS, 1988, 44 (03) :837-845
[8]   CT colonography: False-negative interpretations [J].
Doshi, Taral ;
Rusinak, David ;
Halvorsen, Robert A. ;
Rockey, Don C. ;
Suzuki, Kenji ;
Dachman, Abraham H. .
RADIOLOGY, 2007, 244 (01) :165-173
[9]   Computer-aided detection in CT colonography:: initial clinical experience using a prototype system [J].
Graser, A. ;
Kolligs, F. T. ;
Mang, T. ;
Schaefer, C. ;
Geisbuesch, S. ;
Reiser, M. F. ;
Becker, C. R. .
EUROPEAN RADIOLOGY, 2007, 17 (10) :2608-2615
[10]   Computed tomographic colonography: Assessment of radiologist performance with and without computer-aided detection [J].
Halligan, Steve ;
Altman, Douglas G. ;
Mallett, Susan ;
Taylor, Stuart A. ;
Burling, David ;
Roddie, Mary ;
Honeyfield, Lesley ;
McQuillan, Justine ;
Amin, Hamdan ;
Dehmeshki, Jamshid .
GASTROENTEROLOGY, 2006, 131 (06) :1690-1699