Improvement in radiologists' characterization of malignant and benign breast masses on serial mammograms with computer-aided diagnosis: An ROC study

PURPOSE: To evaluate the effects of computer-aided diagnosis (CAD) on radiologists' characterization of masses on serial mammograms. MATERIALS AND METHODS: Two hundred fifty-three temporal image pairs (138 malignant and,115 benign) obtained from 96 patients who had masses on serial mammograms were evaluated. The temporal pairs were formed by matchingmasses of the same view from two different examinations. Eight radiologists, and two breast imaging fellows assessed the temporal pairs with and without computer aid. The classification of accuracy was quantified by using the area under receiver operating characteristic curve (A(z))-. The statistical significance of the difference in A(z) between the different reading conditions was estimated with the Dorfman-Berbaum-Metz method for analysis of multireader multicase data and with the Student paired t test for analysis of observer-specific paired data. RESULTS: The average A(z)for radiologists' estimates of the likelihood of malignancy was 0.79 without CAD and improved to 0.84 with CAD. The improvement was statistically significant (P =.005). The corresponding average partial area index was 0.25 without CAD and improved to 0.37 with CAD. The improvement,was also statistically significant (P =.005). On the basis of Breast Imaging Reporting and Data System assessments, it was estimated that with CAD, each radiologist, on average,, reduced 0.7% (0.8'of 115) ofunnecessary biopsies a nd correctly recommended 5.7% (7.8 of 138) of additional biopsies. CONCLUSION: CAD based on analysis of interval changes can significantly increase radiologists' accuracy in classification of masses and thereby may be useful in improving correct biopsy recommendations. RSNA, 2004.