A real-time detection approach for bridge cracks based on YOLOv4-FPM

被引:262
作者
Yu, Zhenwei [1 ]
Shen, Yonggang [1 ]
Shen, Chenkai [2 ]
机构
[1] Zhejiang Univ, Coll Civil Engn & Architecture, Hangzhou, Peoples R China
[2] Wuhan Univ, Sch Comp Sci, Wuhan, Peoples R China
关键词
YOLOv4-FPM; Crack detection; UAV; Real-time detection; UAV;
D O I
10.1016/j.autcon.2020.103514
中图分类号
TU [建筑科学];
学科分类号
081407 [建筑环境与能源工程];
摘要
In order to realize real-time detection for bridge cracks by unmanned aerial vehicle (UAV), a deep learning model named YOLOv4-FPM is proposed on the basis of the YOLOv4 model. In YOLOv4-FPM, focal loss is used to optimize the loss function, which improves the accuracy and overcomes the challenges of complex background. Pruning algorithm is used to simplify the network and accelerate the detection speed. The multi-scale dataset is used to expand the predictable range of YOLOv4-FPM and enhance its scale robustness. The experimental results show that the mean average precision (mAP) of YOLOv4-FPM is 0.976, which is 0.064 higher than YOLOv4. The size and parameters of the model are reduced to 18.2%, and the model processes in real-time (119FPS) images at 1000 x 1000 pixels, which is 20 times faster than in a recent work. Moreover, it can effectively detect cracks in images of different sizes.
引用
收藏
页数:11
相关论文
共 39 条
[1]
Analysis of edge-detection techniques for crack identification in bridges [J].
Abdel-Qader, L ;
Abudayyeh, O ;
Kelly, ME .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2003, 17 (04) :255-263
[2]
Arthur D., 2007, P 18 ANN ACM SIAM S, DOI DOI 10.1145/1283383.1283494
[3]
Car Detection using Unmanned Aerial Vehicles: Comparison between Faster R-CNN and YOLOv3 [J].
Benjdira, Bilel ;
Khursheed, Taha ;
Koubaa, Anis ;
Ammar, Adel ;
Ouni, Kais .
2019 1ST INTERNATIONAL CONFERENCE ON UNMANNED VEHICLE SYSTEMS-OMAN (UVS), 2019,
[4]
Bochkovskiy A., 2020, Technical Report
[5]
EuroCity Persons: A Novel Benchmark for Person Detection in Traffic Scenes [J].
Braun, Markus ;
Krebs, Sebastian ;
Flohr, Fabian ;
Gavrila, Dariu M. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (08) :1844-1861
[6]
Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks [J].
Cha, Young-Jin ;
Choi, Wooram ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2017, 32 (05) :361-378
[7]
NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naive Bayes Data Fusion [J].
Chen, Fu-Chen ;
Jahanshahi, Mohammad R. .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2018, 65 (05) :4392-4400
[8]
Gaussian YOLOv3: An Accurate and Fast Object Detector Using Localization Uncertainty for Autonomous Driving [J].
Choi, Jiwoong ;
Chun, Dayoung ;
Kim, Hyun ;
Lee, Hyuk-Jae .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :502-511
[9]
Evaluation of bridge decks with overlays using impact echo, a deep learning approach [J].
Dorafshan, Sattar ;
Azari, Hoda .
AUTOMATION IN CONSTRUCTION, 2020, 113
[10]
Fattal A, 2017, 2017 IEEE 20 INT C I, P1, DOI [10.1109/itsc.2017.8317756, DOI 10.1109/ITSC.2017.8317756]