Reproducibility -: an important factor determining the quality of computer aided detection (CAD) systems

被引:30
作者
Malich, A [1 ]
Azhari, T [1 ]
Böhm, T [1 ]
Fleck, M [1 ]
Kaiser, WA [1 ]
机构
[1] Univ Jena, Inst Diagnost & Intervent Radiol, D-07740 Jena, Germany
关键词
reproducibility; computer aided detection; breast cancer;
D O I
10.1016/S0720-048X(00)00189-3
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose: To test the reproducibility of markings on mammography films set by a commercial computer aided detection (CAD) system. Patients and methods: One hundred unilateral mammography examinations (each in CC and MLO) of 100 patients with mammographically detected suspicious foci, which were histopathologically proven to be malignant, were scanned three times with the CAD system. retrospectively. Every fifth patient of the institutional tumor case sampler was enrolled in the study. Only cases with one visible lesion were included in the study. Reproducibility and sensitivity (in both the strict and the broader sense) were determined. Strict sensitivity means the correct set of markers in both images, whereas broader sensitivity means the correct set in at least one of the images. Sixteen of 100 malignancies were indicated by focal suspicious microcalcification clusters, 53 tumors by masses and 31 cases by both signs of breast cancer. The CAD evaluation was divided into only two different markers: one for microcalcifications and one fur masses. Thus, 47 (16 +/- 31) tumor-induced microcalcifications and 84 (53 + 31) malignancy-related masses were checked using the CAD system. Results: Eighteen of 100 unilateral mammography examinations revealed identical patterns in all three scans (18% reproducibility). Eleven of 47 suspicious focal microcalcification clusters and 43/84 masses were correctly marked on both mammographic views in all three CAD scans (strict and broader sensitivity, 23.4 and 51.1%, respectively). Six of 47 microcalcification clusters and 8/84 masses were totally missed in all images by the system (false negative rate. 12.8 and 9.6%, respectively). Conclusion: Reproducibility is essential for CAD systems. Currently, reproducibility of the used CAD system appears to be insufficient for clinical routine. Improvement of the system characteristics would make such systems valuable as a 'second reader' in clinical examination. (C) 2000 Elsevier Science Ireland Ltd. All rights reserved.
引用
收藏
页码:170 / 174
页数:5
相关论文
共 14 条
[1]  
*AM CANC SOC, 1996, BREAST CANC FACTS FI
[2]  
BIRD RE, 1990, RADIOLOGY, V177, P8
[3]   IMPROVEMENT IN RADIOLOGISTS DETECTION OF CLUSTERED MICROCALCIFICATIONS ON MAMMOGRAMS - THE POTENTIAL OF COMPUTER-AIDED DIAGNOSIS [J].
CHAN, HP ;
DOI, K ;
VYBORNY, CJ ;
SCHMIDT, RA ;
METZ, CE ;
LAM, KL ;
OGURA, T ;
WU, YZ ;
MACMAHON, H .
INVESTIGATIVE RADIOLOGY, 1990, 25 (10) :1102-1110
[4]   Robustness of computerized identification of masses in digitized mammograms - A preliminary assessment [J].
Chang, YH ;
Zheng, B ;
Gur, D .
INVESTIGATIVE RADIOLOGY, 1996, 31 (09) :563-568
[5]   Computer-aided detection of clustered microcalcifications on digitized mammograms: A robustness experiment [J].
Chang, YH ;
Zheng, B ;
Gur, D .
ACADEMIC RADIOLOGY, 1997, 4 (06) :415-418
[6]  
Funovics M, 1998, Wien Med Wochenschr, V148, P321
[7]  
GUGGENMOOSHOLZM.I, 1996, MED STAT
[8]   Automated detection of clustered microcalcifications on mammograms: CAD system application to MIAS database [J].
Ibrahim, N ;
Fujita, H ;
Hara, T ;
Endo, T .
PHYSICS IN MEDICINE AND BIOLOGY, 1997, 42 (12) :2577-2589
[9]   Computer-assisted reading of mammograms [J].
Karssemeijer, N ;
Hendriks, JHCL .
EUROPEAN RADIOLOGY, 1997, 7 (05) :743-748
[10]  
ROBRA PB, 1994, MAMMOGRAPHIE KREBSFR, P19