Detection and localization of hand fractures based on GA_Faster R-CNN

被引:25
作者
Xue, Linyan [1 ,2 ,3 ,5 ]
Yan, Weina [1 ,3 ,5 ]
Luo, Ping [1 ,3 ,5 ]
Zhang, Xiongfeng [1 ]
Chaikovska, Tetiana [4 ]
Liu, Kun [1 ,3 ]
Gao, Wenshan [5 ]
Yang, Kun [1 ,3 ]
机构
[1] Hebei Univ, Coll Qual & Tech Supervis, Baoding 071002, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Biomed Engn, Shanghai 200240, Peoples R China
[3] Hebei Univ, Natl & Local Joint Engn Res Ctr Metrol Instrument, Baoding 071002, Peoples R China
[4] Clin Infect Dis Hosp N1, Dept Med Imaging, UA-02154 Kryvyi Rih, Ukraine
[5] Hebei Univ, Dept Orthoped, Affiliated Hosp, Baoding 071002, Peoples R China
关键词
hand fracture (HF); Computer-aided diagnosis (CAD); Convolutional neural network (CNN); Guided anchoring; Feature pyramid network (FPN);
D O I
10.1016/j.aej.2021.03.005
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
X-ray imaging is the primary diagnostic tool for clinical diagnosis of suspected fracture. Hand fracture (HF) is a world-leading health problem for children, adolescents and the elderly. A missed diagnosis of hand fracture on radiography may lead to severe consequences for patients, resulting in delayed treatment and poor recovery of function. Nevertheless, many hand fractures are fairly insidious, which often lead to misdiagnosis. In this dissertation, we propose GA_Faster R-CNN in which a guided anchoring method (GA) of GA_RPN is applied to detect and localize hand fractures in radiographs. Our new guided anchoring method makes the anchor generation more accurate and efficient, greatly improves the network performance, and saves computing power. In our work, Feature Pyramid Network (FPN) is used to solve the problem of tiny object detection which mostly appears at the joint of fingertips and knuckles. In addition, Balanced L1 Loss is applied to adapt to the imbalance of learning tasks. We evaluate the proposed algorithm on a HF dataset containing 3,067 X-ray radiographs, 2,453 of which are assigned as the training dataset and 614 as the testing dataset. The present framework achieved accuracies of 97%-99% and an average precision (AP) of 70.7%, thereby outperforming the previous state-of-the-art methods for detecting HF. As a consequence, the GA_Faster R-CNN has great potential for clinical applications. (C) 2021 THE AUTHOR. Published by Elsevier BV on behalf of Faculty of Engineering, Alexandria University.
引用
收藏
页码:4555 / 4562
页数:8
相关论文
共 25 条
[1]   Deep learning predicts hip fracture using confounding patient and healthcare variables [J].
Badgeley, Marcus A. ;
Zech, John R. ;
Oakden-Rayner, Luke ;
Glicksberg, Benjamin S. ;
Liu, Manway ;
Gale, William ;
McConnell, Michael, V ;
Percha, Bethany ;
Snyder, Thomas M. ;
Dudley, Joel T. .
NPJ DIGITAL MEDICINE, 2019, 2 (1)
[2]   Detection and localization of distal radius fractures: Deep learning system versus radiologists [J].
Bluethgen, Christian ;
Becker, Anton S. ;
de Martini, Ilaria Vittoria ;
Meier, Andreas ;
Martini, Katharina ;
Frauenfelder, Thomas .
EUROPEAN JOURNAL OF RADIOLOGY, 2020, 126
[3]   Application of a deep learning algorithm for detection and visualization of hip fractures on plain pelvic radiographs [J].
Cheng, Chi-Tung ;
Ho, Tsung-Ying ;
Lee, Tao-Yi ;
Chang, Chih-Chen ;
Chou, Ching-Cheng ;
Chen, Chih-Chi ;
Chung, I-Fang ;
Liao, Chien-Hung .
EUROPEAN RADIOLOGY, 2019, 29 (10) :5469-5477
[4]  
Erhan D., SSD: single shot multibox detector. in: Computer Vision-ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part I 14, Springer
[5]  
2016
[6]   Evaluation of an artificial intelligence system for detecting vertical root fracture on panoramic radiography [J].
Fukuda, Motoki ;
Inamoto, Kyoko ;
Shibata, Naoki ;
Ariji, Yoshiko ;
Yanashita, Yudai ;
Kutsuna, Shota ;
Nakata, Kazuhiko ;
Katsumata, Akitoshi ;
Fujita, Hiroshi ;
Ariji, Eiichiro .
ORAL RADIOLOGY, 2020, 36 (04) :337-343
[7]   Arm fracture detection in X-rays based on improved deep convolutional neural network [J].
Guan, Bin ;
Zhang, Guoshan ;
Yao, Jinkun ;
Wang, Xinbo ;
Wang, Mengxuan .
COMPUTERS & ELECTRICAL ENGINEERING, 2020, 81 (81)
[8]   Thigh fracture detection using deep learning method based on new dilated convolutional feature pyramid network [J].
Guan, Bin ;
Yao, Jinkun ;
Zhang, Guoshan ;
Wang, Xinbo .
PATTERN RECOGNITION LETTERS, 2019, 125 :521-526
[9]   Assessment of a deep-learning system for fracture detection in musculoskeletal radiographs [J].
Jones, Rebecca M. ;
Sharma, Anuj ;
Hotchkiss, Robert ;
Sperling, John W. ;
Hamburger, Jackson ;
Ledig, Christian ;
O'Toole, Robert ;
Gardner, Michael ;
Venkatesh, Srivas ;
Roberts, Matthew M. ;
Sauvestre, Romain ;
Shatkhin, Max ;
Gupta, Anant ;
Chopra, Sumit ;
Kumaravel, Manickam ;
Daluiski, Aaron ;
Plogger, Will ;
Nascone, Jason ;
Potter, Hollis G. ;
Lindsey, Robert, V .
NPJ DIGITAL MEDICINE, 2020, 3 (01)
[10]  
Joseph R., 2018, YOLOV3 INCREMENTAL I, DOI DOI 10.48550/ARXIV.1804.02767