Computer-aided diagnosis in chest radiography: Results of large-scale observer tests at the 1996-2001 RSNA scientific assemblies

Since 1996, computer-aided diagnosis (CAD) schemes have been presented as interactive demonstrations on computer workstations at each scientific assembly of the Radiological Society of North America. The schemes involved (a) detection of pulmonary nodules, (b) temporal subtraction, (c) detection of interstitial lung disease, (d) differential diagnosis of interstitial lung disease, and (e) distinction between benign and malignant pulmonary nodules on chest radiographs. Large-scale observer tests were carried out to examine how radiologists can benefit from CAD systems. Observer performance was evaluated by analysis of receiver operating characteristic (ROC) curves. The statistical significance of the difference between the areas under the ROC curves without and with CAD was analyzed with the Student t test. In all of the tests, the diagnostic accuracy of the radiologists in total improved significantly when CAD was used. This result provides additional evidence that CAD has the potential to improve the performance of radiologists in their decision-making process in interpreting chest radiographs.