A foveated silicon retina for two-dimensional tracking

被引:68
作者
Etienne-Cummings, R [1 ]
Van der Spiegel, J
Mueller, P
Zhang, MZ
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21218 USA
[2] Univ Penn, Moore Sch Elect Engn, Ctr Sensor Technol, Philadelphia, PA 19104 USA
[3] Corticon Inc, Philadelphia, PA 19104 USA
来源
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-ANALOG AND DIGITAL SIGNAL PROCESSING | 2000年 / 47卷 / 06期
基金
美国国家科学基金会;
关键词
centroid-localization chip; foveated silicon retina; motion chip; target-tracking chip; vision chip;
D O I
10.1109/82.847066
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A silicon retina chip with a central foveal region for smooth-pursuit tracking and a peripheral region for saccadic target acquisition is presented. The foveal region contains a 9 x 9 dense array of large dynamic range photoreceptors and edge detectors. Two-dimensional direction of foveal motion is computed outside the imaging array. The peripheral region contains a sparse array of 19 x 17 similar, but larger, photoreceptors with in-pixel edge and temporal ON-set detection. The coordinates of moving or flashing targets are computed with two one-dimensional centroid localization circuits located on the outskirts of the peripheral region. The chip is operational for ambient intensities ranging over six orders of magnitude, targets contrast as low as 10%, foveal speed ranging from 1.5 to 10K pixels/s, and peripheral ON-set frequencies from <0.1 to 800 kHz. The chip is implemented in 2-mu m N well CMOS process and consumes 15 mW (V dd = 4 V) in normal indoor light (25 mu W/cm(2)). It has been used as a person tracker in a smart surveillance system and a road follower in an autonomous navigation system.
引用
收藏
页码:504 / 517
页数:14
相关论文
共 45 条
[1]   CURRENT-MODE SUBTHRESHOLD MOS CIRCUITS FOR ANALOG VLSI NEURAL SYSTEMS [J].
ANDREOU, AG ;
BOAHEN, KA ;
POULIQUEN, PO ;
PAVASOVIC, A ;
JENKINS, RE ;
STROHBEHN, K .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1991, 2 (02) :205-213
[2]  
BANDERA C, 1990, THESIS SUNY BUFFALO
[3]  
BARLOW H, 1982, SENSES PHYSL RETINA
[4]  
COLLA A, 1995, P 5 IEEE WORKSH NEUR, P571
[5]   REAL-TIME BINOCULAR SMOOTH-PURSUIT [J].
COOMBS, D ;
BROWN, C .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1993, 11 (02) :147-164
[6]   Real-time obstacle avoidance using central flow divergence, and peripheral flow [J].
Coombs, D ;
Herman, M ;
Hong, TH ;
Nashman, M .
IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1998, 14 (01) :49-59
[7]   A 256x256 CMOS imaging array with wide dynamic range pixels and column-parallel digital output [J].
Decker, S ;
McGrath, RD ;
Brehmer, K ;
Sodini, CG .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 1998, 33 (12) :2081-2091
[8]  
DEWEERTH S, 1991, P IEEE INT C ROB AUT
[9]   ANALOG VLSI CIRCUITS FOR STIMULUS LOCALIZATION AND CENTROID COMPUTATION [J].
DEWEERTH, SP .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1992, 8 (03) :191-202
[10]   EFFECT OF TRACKING STRATEGIES ON THE VELOCITY STRUCTURE OF 2-DIMENSIONAL IMAGE SEQUENCES [J].
ECKERT, MP ;
BUCHSBAUM, G .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1993, 10 (07) :1582-1585