A vision-based method for automatic tracking of construction machines at nighttime based on deep learning illumination enhancement

被引:39
作者
Xiao, Bo [1 ]
Lin, Qiang [2 ]
Chen, Yuan [3 ]
机构
[1] Univ Alberta, Dept Civil & Environm Engn, Edmonton, AB T6G 2R3, Canada
[2] Chongqing Univ, Sch Civil Engn, Chongqing 400045, Peoples R China
[3] Tianjin Univ, Coll Management & Econ, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Image enhancement; Construction machines; Nighttime construction; Automatic tracking; CLASSIFICATION; FEATURES;
D O I
10.1016/j.autcon.2021.103721
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Nighttime construction has been widely conducted in many construction scenarios, but it is also much riskier due to low lighting conditions and fatiguing environments. Therefore, this study proposes a vision-based method specifically for automatic tracking of construction machines at nighttime by integrating the deep learning illumination enhancement. Five main modules are involved in the proposed method, including illumination enhancement, machine detection, Kalman filter tracking, machine association, and linear assignment. Then, a testing experiment based on nine nighttime videos is conducted to evaluate the tracking performance using this approach. The results show that the method developed in this study achieved 95.1% in MOTA and 75.9% in MTOP. Compared with the baseline method SORT, the proposed method has improved the tracking robustness of 21.7% in nighttime construction scenarios. The proposed methodology can also be used to help accomplish automated surveillance tasks in nighttime construction to improve the productivity and safety performance.
引用
收藏
页数:13
相关论文
共 64 条
  • [1] Dataset and benchmark for detecting moving objects in construction sites
    An Xuehui
    Zhou Li
    Liu Zuguang
    Wang Chengzhi
    Li Pengfei
    Li Zhiwei
    [J]. AUTOMATION IN CONSTRUCTION, 2021, 122 (122)
  • [2] Tracking multiple construction workers through deep learning and the gradient based method with re-matching based on multi-object tracking accuracy
    Angah, Ohay
    Chen, Albert Y.
    [J]. AUTOMATION IN CONSTRUCTION, 2020, 119
  • [3] Fatal accidents in nighttime vs. daytime highway construction work zones
    Arditi, David
    Lee, Dong-Eun
    Polat, Gul
    [J]. JOURNAL OF SAFETY RESEARCH, 2007, 38 (04) : 399 - 405
  • [4] Server-Customer Interaction Tracker: Computer Vision-Based System to Estimate Dirt-Loading Cycles
    Azar, Ehsan Rezazadeh
    Dickinson, Sven
    McCabe, Brenda
    [J]. JOURNAL OF CONSTRUCTION ENGINEERING AND MANAGEMENT, 2013, 139 (07) : 785 - 794
  • [5] Bailer C, 2014, LECT NOTES COMPUT SC, V8695, P170, DOI 10.1007/978-3-319-10584-0_12
  • [6] Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
    Bernardin, Keni
    Stiefelhagen, Rainer
    [J]. EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2008, 2008 (1)
  • [7] Bewley A, 2016, IEEE IMAGE PROC, P3464, DOI 10.1109/ICIP.2016.7533003
  • [8] Development of an Image Data Set of Construction Machines for Deep Learning Object Detection
    Xiao, Bo
    Kang, Shih-Chung
    [J]. JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2021, 35 (02)
  • [9] Bochinski Erik, 2017, 2017 14th IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS), DOI 10.1109/AVSS.2017.8078516
  • [10] ANALYSIS OF THE RETINEX THEORY OF COLOR-VISION
    BRAINARD, DH
    WANDELL, BA
    [J]. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1986, 3 (10): : 1651 - 1661