How well can radiologists using neural network software diagnose pulmonary embolism?

OBJECTIVE. This study evaluated and optimized the performance of an automated artificial neural network image interpreter in the diagnosis of pulmonary embolism on ventilation-perfusion lung scans. The computer interpretations were compared with the interpretations of three experienced observers. MATERIALS AND METHODS. Digital data were obtained from 100 patients with normal findings on chest radiographs who were undergoing both radionuclide ventilation-perfusion scanning and pulmonary angiography. Interpretations of differently trained neural networks were compared with those of three experienced nuclear medicine practitioners unaware of the clinical diagnosis. RESULTS. Machines running neural networks performed similarly to experienced scan interpreters in the detection of pulmonary embolism. Both the human observers and the networks performed best in cases with large emboli. Neural network performance was best in the right lung, when the networks were trained using only cases with large emboli and when networks were trained independently in the right and left lungs. The best predictions resulted from a collaborative interpretation incorporating both the human and computer predictions. CONCLUSION. Computers running artificial neural networks using scan data obtained directly from the anterior and posterior ventilation and perfusion images, without human involvement, perform comparably with experienced observers in patients with normal findings on chest radiographs. Human observers can improve their interpretations by incorporating computer output to formulate diagnostic prediction. The method of training the networks is critical to optimizing performance.