Ultra-low-cost 3D gaze estimation: an intuitive high information throughput compliment to direct brain-machine interfaces

被引:60
作者
Abbott, W. W. [1 ]
Faisal, A. A. [1 ,2 ]
机构
[1] Univ London Imperial Coll Sci Technol & Med, Dept Bioengn, London SW7 2AZ, England
[2] Univ London Imperial Coll Sci Technol & Med, Dept Comp, London SW7 2AZ, England
基金
英国工程与自然科学研究理事会;
关键词
OPTICAL RADIATION; EYE-MOVEMENTS; DISEASE; SYSTEM; NOISE;
D O I
10.1088/1741-2560/9/4/046016
中图分类号
R318 [生物医学工程];
学科分类号
100103 [病原生物学];
摘要
Eye movements are highly correlated with motor intentions and are often retained by patients with serious motor deficiencies. Despite this, eye tracking is not widely used as control interface for movement in impaired patients due to poor signal interpretation and lack of control flexibility. We propose that tracking the gaze position in 3D rather than 2D provides a considerably richer signal for human machine interfaces by allowing direct interaction with the environment rather than via computer displays. We demonstrate here that by using mass-produced video-game hardware, it is possible to produce an ultra-low-cost binocular eye-tracker with comparable performance to commercial systems, yet 800 times cheaper. Our head-mounted system has 30 USD material costs and operates at over 120 Hz sampling rate with a 0.5-1 degree of visual angle resolution. We perform 2D and 3D gaze estimation, controlling a real-time volumetric cursor essential for driving complex user interfaces. Our approach yields an information throughput of 43 bits s(-1), more than ten times that of invasive and semi-invasive brain-machine interfaces (BMIs) that are vastly more expensive. Unlike many BMIs our system yields effective real-time closed loop control of devices (10 ms latency), after just ten minutes of training, which we demonstrate through a novel BMI benchmark-the control of the video arcade game 'Pong'.
引用
收藏
页数:11
相关论文
共 39 条
[1]
Abbott WW, 2011, BMC NEUROSCI, V12, P103
[2]
[Anonymous], 2006, P 2006 S EYE TRACKIN, DOI DOI 10.1145/1117309.1117350
[3]
Brain-Computer Interface Based on Generation of Visual Images [J].
Bobrov, Pavel ;
Frolov, Alexander ;
Cantor, Charles ;
Fedulova, Irina ;
Bakhnyan, Mikhail ;
Zhavoronkov, Alexander .
PLOS ONE, 2011, 6 (06)
[4]
Brolly XLC, 2004, P 2004 C COMP VIS PA, V8, P134
[5]
Duchowski A. T., 2002, Proceedings ETRA 2002. Eye Tracking Research and Applications Symposium, P103, DOI 10.1145/507072.507094
[6]
Faisal A.A., 2010, STOCHASTIC METHODS N, P297
[7]
Noise in the nervous system [J].
Faisal, A. Aldo ;
Selen, Luc P. J. ;
Wolpert, Daniel M. .
NATURE REVIEWS NEUROSCIENCE, 2008, 9 (04) :292-303
[8]
Ion-channel noise places limits on the miniaturization of the brain's wiring [J].
Faisal, AA ;
White, JA ;
Laughlin, SB .
CURRENT BIOLOGY, 2005, 15 (12) :1143-1149
[9]
How reliable is the connectivity in cortical neural networks? [J].
Faisal, AA ;
Laughlin, SB ;
White, JA .
PROCEEDING OF THE 2002 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-3, 2002, :1661-1666
[10]
Faisal AA, 1998, AB BAF MU MAG KASH B