A shape-independent method for pedestrian detection with far-infrared images

被引:93
作者
Fang, YJ [1 ]
Yamada, K
Ninomiya, Y
Horn, BKP
Masaki, I
机构
[1] MIT, Intelligent Transportat Res Ctr, Microsyst Technol Labs, Elect Engn & Comp Sci Dept, Cambridge, MA 02139 USA
[2] Toyota Cent Res & Dev Labs Inc, Nagakute, Aichi 4801192, Japan
关键词
autonomous driving; classification; infrared image processing; intelligent transportation system (ITS); intelligent vehicle (IV); night vision; pattern recognition; pedestrian detection; shape independent;
D O I
10.1109/TVT.2004.834875
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Nighttime driving is more dangerous than daytime driving-particularly for senior drivers. Three to four times as many driving-related deaths occur at night than in the daytime. To improve the safety of night driving, automatic pedestrian detection based on infrared images has drawn increased attention because pedestrians tend to stand out more against the background in infrared images than they do in visible light images. Nevertheless, pedestrian detection in infrared images is by no means trivial-many of the known difficulties carry over from visible light images, such as image variability occasioned by pedestrians being in different poses. Typically, several different pedestrian templates have to be used in order to deal with a range of poses. Furthermore, pedestrian detection is difficult because of poor infrared image quality (low resolution, low contrast, few distinguishable feature points, little texture information, etc.) and misleading signals. To address these problems, this paper introduces a shape-independent pedestrian-detection method. Our segmentation algorithm first estimates pedestrians' horizontal locations through projection-based horizontal segmentation and then determines pedestrians' vertical locations through brightness/bodyline-based vertical segmentation. Our classification method defines multidimensional histogram-, inertia-, and contrast-based classification features. The features are shape-independent, complementary to one another, and capture the statistical similarities of image patches containing pedestrians with different poses. Thus, our pedestrian-detection system needs only one pedestrian template-corresponding to a generic walking pose-and avoids brute-force searching for pedestrians throughout whole images, which typically involves brightness-similarity comparisons between candidate image patches and a multiplicity of pedestrian templates. Our pedestrian-detection system is neither based on tracking nor does it depend on camera calibration to determine the relationship between an object's height and its vertical image locations. Thus, it is less restricted in applicability. Even if much work is still needed to bridge the gap between present pedestrian-detection performance and the high reliability required for real-world applications, our pedestrian-detection system is straightforward and provides encouraging results in improving speed, reliability, and simplicity.
引用
收藏
页码:1679 / 1697
页数:19
相关论文
共 19 条
[1]  
[Anonymous], P IEEE INT VEH S
[2]  
[Anonymous], IEEE INT VEH S
[3]   Pedestrian detection in infrared images [J].
Bertozzi, M ;
Broggi, A ;
Grisleri, P ;
Graf, T ;
Meinecke, M .
IEEE IV2003: INTELLIGENT VEHICLES SYMPOSIUM, PROCEEDINGS, 2003, :662-667
[4]   Stereo vision-based vehicle detection [J].
Bertozzi, M ;
Broggi, A ;
Fascioli, A ;
Nichele, S .
PROCEEDINGS OF THE IEEE INTELLIGENT VEHICLES SYMPOSIUM 2000, 2000, :39-44
[5]  
BERTOZZI M, 2002, P IEEE INT VEH S JUN, V1, P1
[6]   Walking Pedestrian Recognition [J].
Curio, Cristobal ;
Edelbrunner, Johann ;
Kalinke, Thomas ;
Tzomakas, Christos ;
von Seelen, Werner .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2000, 1 (03) :155-163
[7]   Integrated person tracking using stereo, color, and pattern detection. [J].
Darrell, T ;
Gordon, G ;
Harville, M ;
Woodfill, J .
1998 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1998, :601-608
[8]   Comparison between infrared-image-based and visible-image-based approaches for pedestrian detection [J].
Fang, YJ ;
Yamada, K ;
Ninomiya, Y ;
Horn, B ;
Masaki, I .
IEEE IV2003: INTELLIGENT VEHICLES SYMPOSIUM, PROCEEDINGS, 2003, :505-510
[9]  
FENGLIANG X, 2002, P IEEE INT VEH S JUN, V1, P21
[10]  
GUILLOUX Y, 2002, P IEEE INT VEH S JUN, V1, P81