Active tactile exploration using a brain-machine-brain interface

被引:421
作者
O'Doherty, Joseph E. [1 ,2 ]
Lebedev, Mikhail A. [2 ,3 ]
Ifft, Peter J. [1 ,2 ]
Zhuang, Katie Z. [1 ,2 ]
Shokur, Solaiman [4 ]
Bleuler, Hannes [4 ]
Nicolelis, Miguel A. L. [1 ,2 ,3 ,5 ,6 ]
机构
[1] Duke Univ, Dept Biomed Engn, Durham, NC 27708 USA
[2] Duke Univ, Ctr Neuroengn, Durham, NC 27710 USA
[3] Duke Univ, Dept Neurobiol, Durham, NC 27710 USA
[4] Ecole Polytech Fed Lausanne, STIIMT, CH-1015 Lausanne, Switzerland
[5] Duke Univ, Dept Psychol & Neurosci, Durham, NC 27708 USA
[6] Edmond & Lily Safra Int Inst Neurosci Natal, BR-59066060 Natal, RN, Brazil
关键词
CORTICAL CONTROL; CORTEX; ARM; NEURONS; STIMULATION; GRIP; SKIN;
D O I
10.1038/nature10489
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Brain-machine interfaces(1,2) use neuronal activity recorded from the brain to establish direct communication with external actuators, such as prosthetic arms. It is hoped that brain-machine interfaces can be used to restore the normal sensorimotor functions of the limbs, but so far they have lacked tactile sensation. Here we report the operation of a brain-machine-brain interface (BMBI) that both controls the exploratory reaching movements of an actuator and allows signalling of artificial tactile feedback through intracortical microstimulation (ICMS) of the primary somatosensory cortex. Monkeys performed an active exploration task in which an actuator (a computer cursor or a virtual-reality arm) was moved using a BMBI that derived motor commands from neuronal ensemble activity recorded in the primary motor cortex. ICMS feedback occurred whenever the actuator touched virtual objects. Temporal patterns of ICMS encoded the artificial tactile properties of each object. Neuronal recordings and ICMS epochs were temporally multiplexed to avoid interference. Two monkeys operated this BMBI to search for and distinguish one of three visually identical objects, using the virtual-reality arm to identify the unique artificial texture associated with each. These results suggest that clinical motor neuroprostheses might benefit from the addition of ICMS feedback to generate artificial somatic perceptions associated with mechanical, robotic or even virtual prostheses.
引用
收藏
页码:228 / U106
页数:5
相关论文
共 30 条
[1]   Learning to control a brain-machine interface for reaching and grasping by primates [J].
Carmena, JM ;
Lebedev, MA ;
Crist, RE ;
O'Doherty, JE ;
Santucci, DM ;
Dimitrov, DF ;
Patil, PG ;
Henriquez, CS ;
Nicolelis, MAL .
PLOS BIOLOGY, 2003, 1 (02) :193-208
[2]   Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex [J].
Chapin, JK ;
Moxon, KA ;
Markowitz, RS ;
Nicolelis, MAL .
NATURE NEUROSCIENCE, 1999, 2 (07) :664-670
[3]   A brain-computer interface with vibrotactile biofeedback for haptic information [J].
Chatterjee, Aniruddha ;
Aggarwal, Vikram ;
Ramos, Ander ;
Acharya, Soumyadipta ;
Thakor, Nitish V. .
JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2007, 4 (1)
[4]   Neural correlates of mental rehearsal in dorsal premotor cortex [J].
Cisek, P ;
Kalaska, JF .
NATURE, 2004, 431 (7011) :993-996
[5]   Neurons in primary motor cortex engaged during action observation [J].
Dushanova, Juliana ;
Donoghue, John .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2010, 31 (02) :386-398
[6]   Primate reaching cued by multichannel spatiotemporal cortical microstimulation [J].
Fitzsimmons, N. A. ;
Drake, W. ;
Hanson, T. L. ;
Lebedev, M. A. ;
Nicolelis, M. A. L. .
JOURNAL OF NEUROSCIENCE, 2007, 27 (21) :5593-5602
[7]  
FLANAGAN JR, 1993, EXP BRAIN RES, V95, P131
[8]   Coding the location of the arm by sight [J].
Graziano, MSA ;
Cooke, DF ;
Taylor, CSR .
SCIENCE, 2000, 290 (5497) :1782-1786
[9]   The neural basis of haptic object processing [J].
James, Thomas W. ;
Kim, Sunah ;
Fisher, Jerry S. .
CANADIAN JOURNAL OF EXPERIMENTAL PSYCHOLOGY-REVUE CANADIENNE DE PSYCHOLOGIE EXPERIMENTALE, 2007, 61 (03) :219-229
[10]  
JOHANSSON RS, 1984, EXP BRAIN RES, V56, P550