Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation

被引:434
作者
Roth, Holger R. [1 ]
Lu, Le [1 ]
Liu, Jiamin [1 ]
Yao, Jianhua [1 ]
Seff, Ari [1 ]
Cherry, Kevin [1 ]
Kim, Lauren [1 ]
Summers, Ronald M. [1 ]
机构
[1] NIH, Imaging Biomarkers & Comp Aided Diag Lab, Radiol & Imaging Sci Dept, Ctr Clin, Bldg 10, Bethesda, MD 20892 USA
关键词
Computer aided diagnosis; computed tomography; medical diagnostic imaging; machine learning; object detection; artificial neural networks; multi-layer neural network; deep learning; BONE METASTASIS; SEGMENTATION; POLYPS;
D O I
10.1109/TMI.2015.2482920
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Automated computer-aided detection (CADe) has been an important tool in clinical practice and research. State-of-the-art methods often show high sensitivities at the cost of high false-positives (FP) per patient rates. We design a two-tiered coarse-to-fine cascade framework that first operates a candidate generation system at sensitivities similar to 100% of but at high FP levels. By leveraging existing CADe systems, coordinates of regions or volumes of interest (ROI or VOI) are generated and function as input for a second tier, which is our focus in this study. In this second stage, we generate 2D (two-dimensional) or 2.5D views via sampling through scale transformations, random translations and rotations. These random views are used to train deep convolutional neural network (ConvNet) classifiers. In testing, the ConvNets assign class (e.g., lesion, pathology) probabilities for a new set of random views that are then averaged to compute a final per-candidate classification probability. This second tier behaves as a highly selective process to reject difficult false positives while preserving high sensitivities. The methods are evaluated on three data sets: 59 patients for sclerotic metastasis detection, 176 patients for lymph node detection, and 1,186 patients for colonic polyp detection. Experimental results show the ability of ConvNets to generalize well to different medical imaging CADe applications and scale elegantly to various data sets. Our proposed methods improve performance markedly in all cases. Sensitivities improved from 57% to 70%, 43% to 77%, and 58% to 75% at 3 FPs per patient for sclerotic metastases, lymph nodes and colonic polyps, respectively.
引用
收藏
页码:1170 / 1181
页数:12
相关论文
共 59 条
[31]   Automatic detection of lytic and blastic thoracolumbar spine metastases on computed tomography [J].
Hammon, Matthias ;
Dankerl, Peter ;
Tsymbal, Alexey ;
Wels, Michael ;
Kelm, Michael ;
May, Matthias ;
Suehling, Michael ;
Uder, Michael ;
Cavallaro, Alexander .
EUROPEAN RADIOLOGY, 2013, 23 (07) :1862-1870
[32]   Accuracy of CT colonography for detection of large adenomas and cancers [J].
Johnson, C. Daniel ;
Chen, Mei-Hsiu ;
Toledano, Alicia Y. ;
Heiken, Jay P. ;
Dachman, Abraham ;
Kuo, Mark D. ;
Menias, Christine O. ;
Siewert, Betina ;
Cheema, Jugesh I. ;
Obregon, Richard G. ;
Fidler, Jeff L. ;
Zimmerman, Peter ;
Horton, Karen M. ;
Coakley, Kevin ;
Iyer, Revathy B. ;
Hara, Amy K. ;
Halvorsen, Robert A., Jr. ;
Casola, Giovanna ;
Yee, Judy ;
Herman, Benjamin A. ;
Burgart, Lawrence J. ;
Limburg, Paul J. .
NEW ENGLAND JOURNAL OF MEDICINE, 2008, 359 (12) :1207-1217
[33]   THE LEARNING MACHINES [J].
Jones, Nicola .
NATURE, 2014, 505 (7482) :146-148
[34]   Large-scale Video Classification with Convolutional Neural Networks [J].
Karpathy, Andrej ;
Toderici, George ;
Shetty, Sanketh ;
Leung, Thomas ;
Sukthankar, Rahul ;
Fei-Fei, Li .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :1725-1732
[35]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[36]  
Krizhevsky Alex, 2014, arXiv
[37]  
Le Lu, 2014, Medical Computer Vision Large Data in Medical Imaging. Third International MICCAI Workshop, MCV 2013. Revised Selected Papers. LNCS: 8331, P161, DOI 10.1007/978-3-319-05530-5_16
[38]  
Lu L, 2008, LECT NOTES COMPUT SC, V5305, P465
[39]  
Lu L, 2011, PROC CVPR IEEE, P1049, DOI 10.1109/CVPR.2011.5995359
[40]  
Lu L, 2009, LECT NOTES COMPUT SC, V5762, P1009, DOI 10.1007/978-3-642-04271-3_122