Robust real-time traffic light detection and distance estimation using a single camera

被引:83
作者
Diaz-Cabrera, Moises [1 ]
Cerri, Pietro [2 ]
Medici, Paolo [2 ]
机构
[1] Univ Las Palmas Gran Canaria, Inst Univ Desarrollo Tecnol & Innovac Comunicac, Las Palmas Gran Canaria, Spain
[2] Univ Parma, Dept Informat Engn, I-43100 Parma, Italy
关键词
Traffic light detection; Advanced driver assistance systems; Intelligent transportation systems; Image recognition; Intelligent vehicles;
D O I
10.1016/j.eswa.2014.12.037
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a robust technique to detect traffic lights during both day and night conditions and estimate their distance. The traffic light detection is based initially on color properties. To enhance the color on the video sequences, the acquisition is adapted according to the luminosity of the pixels on the top of the image. A fuzzy clustering provides a better division of the traffic light colors. The traffic light color properties have been estimated from registered sequences including both colors from LED spot lights and from traditional light bulbs. The filters rules based on the traffic light aspect ratios as well as the tracking stage are used to decide whether the spots on the frames are likely to be traffic lights. Then, the distance between traffic lights and the autonomous vehicle is estimated by applying Bayesian filters to the traffic lights represented on the frames. The tests are validated with more than an hour in real urban scenarios during day and night. The paper shows that the developed advanced driver assistance system is able to detect the traffic lights with 99.4% of accuracy in the range of 10-115 m. The utility of this system has been demonstrated during the Public ROad Urban Driverless car test in Italy in 2013. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:3911 / 3923
页数:13
相关论文
共 35 条
[1]  
[Anonymous], 2002, J TAIWAN NORM UNIV-M
[2]   GOLD: A framework for developing intelligent-vehicle vision applications [J].
Bertozzi, Massimo ;
Bombini, Luca ;
Broggi, Alberto ;
Cerri, Pietro ;
Grisleri, Paolo ;
Medici, Paolo ;
Zani, Paolo .
IEEE INTELLIGENT SYSTEMS, 2008, 23 (01) :69-71
[3]  
Caraffi Claudio, 2008, 2008 IEEE Intelligent Vehicles Symposium (IV), P834, DOI 10.1109/IVS.2008.4621306
[4]   Environment-Detection-and-Mapping Algorithm for Autonomous Driving in Rural or Off-Road Environment [J].
Choi, Jaewoong ;
Lee, Junyoung ;
Kim, Dongwook ;
Soprani, Giacomo ;
Cerri, Pietro ;
Broggi, Alberto ;
Yi, Kyongsu .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2012, 13 (02) :974-982
[5]   Traffic Light Recognition using Image Processing Compared to Learning Processes [J].
de Charette, Raoul ;
Nashashibi, Fawzi .
2009 IEEE-RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2009, :333-338
[6]   Real Time Visual Trafric Lights Recognition Based on Spot Light Detection and Adaptive Traffic Lights Templates [J].
de Charette, Raoul ;
Nashashibi, Fawzi .
2009 IEEE INTELLIGENT VEHICLES SYMPOSIUM, VOLS 1 AND 2, 2009, :358-363
[7]  
Díaz-Cabrera M, 2013, LECT NOTES COMPUT SC, V8112, P93, DOI 10.1007/978-3-642-53862-9_13
[8]  
Diaz-Cabrera M, 2012, IEEE INT C INTELL TR, P1315, DOI 10.1109/ITSC.2012.6338765
[9]   Comparison of resampling schemes for particle filtering [J].
Douc, R ;
Cappé, O ;
Moulines, E .
ISPA 2005: Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005, :64-69
[10]  
Fairfield N., 2011, 2011 IEEE International Conference on Robotics and Automation (ICRA 2011), P5421, DOI 10.1109/ICRA.2011.5980164