Part based model and spatial-temporal reasoning to recognize hydraulic excavators in construction images and videos

被引:113
作者
Azar, Ehsan Rezazadeh [1 ]
McCabe, Brenda [1 ]
机构
[1] Univ Toronto, Dept Civil Engn, Toronto, ON M5S 1A4, Canada
关键词
Computer vision; Object recognition; Earthmoving equipment; Automated data collection; Digital images; Spatial-temporal reasoning;
D O I
10.1016/j.autcon.2012.03.003
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Detection of earthmoving equipment in construction images and videos can increase the automation level of many construction management tasks such as productivity measurement, locating of machines, work-zone safety, and semantic image and video indexing. Some of the earthmoving plants, such as hydraulic excavator, have articulated shapes making them a difficult target for even state of the art object recognition algorithms. The goal of this paper is to develop a model for non-rigid equipment detection and pose estimation in construction images and videos. In this paper, we describe an object recognition system based on mixture of appearances of deformable body parts of the hydraulic excavator and compare its results with general Histogram of Oriented Gradient detectors in both images and videos. Then a spatial-temporal reasoning model is presented which uses time and space constraints of the excavators' moving patterns to improve the detection results in videos. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:194 / 202
页数:9
相关论文
共 29 条
  • [1] Andriluka M, 2009, PROC CVPR IEEE, P1014, DOI 10.1109/CVPRW.2009.5206754
  • [2] [Anonymous], CONSTR RES C
  • [3] [Anonymous], 2010, PASCAL VISUAL OBJECT
  • [4] Azar E. Rezazadeh, 2011, 3 INT 9 CONSTR SPEC, pCN
  • [5] Caterpillar, 2011, EL CONTR UN
  • [6] Automated Object Identification Using Optical Video Cameras on Construction Sites
    Chi, Seokho
    Caldas, Carlos H.
    [J]. COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2011, 26 (05) : 368 - 380
  • [7] Histograms of oriented gradients for human detection
    Dalal, N
    Triggs, B
    [J]. 2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, : 886 - 893
  • [8] Dickinson S., 2009, OBJECT CATEGORIZATIO, P1
  • [9] Everingham M., 2011, PASCAL VIS OBJ CLASS
  • [10] Object Detection with Discriminatively Trained Part-Based Models
    Felzenszwalb, Pedro F.
    Girshick, Ross B.
    McAllester, David
    Ramanan, Deva
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (09) : 1627 - 1645