Give me a sign: decoding four complex hand gestures based on high-density ECoG

被引:52
作者
Bleichner, M. G. [1 ]
Freudenburg, Z. V. [1 ]
Jansma, J. M. [1 ]
Aarnoutse, E. J. [1 ]
Vansteensel, M. J. [1 ]
Ramsey, N. F. [1 ,2 ]
机构
[1] UMC Utrecht Brain Ctr Rudolf Magnus, Utrecht, Netherlands
[2] Univ Medisch Centrum Utrecht, Heidelberglaan 100,Huispost G03-124, NL-3584 CX Utrecht, Netherlands
关键词
Electrocorticography; High density; Sign language; Gestures; Decoding; BRAIN-COMPUTER-INTERFACE; CORTICAL ACTIVITY; MOTOR; MOVEMENTS; CORTEX; STIMULATION; REPRESENTATION; COMMUNICATION; TOPOGRAPHY; GRASP;
D O I
10.1007/s00429-014-0902-x
中图分类号
R602 [外科病理学、解剖学]; R32 [人体形态学];
学科分类号
100101 ;
摘要
The increasing understanding of human brain functions makes it possible to directly interact with the brain for therapeutic purposes. Implantable brain computer interfaces promise to replace or restore motor functions in patients with partial or complete paralysis. We postulate that neuronal states associated with gestures, as they are used in the finger spelling alphabet of sign languages, provide an excellent signal for implantable brain computer interfaces to restore communication. To test this, we evaluated decodability of four gestures using high-density electrocorticography in two participants. The electrode grids were located subdurally on the hand knob area of the sensorimotor cortex covering a surface of 2.5-5.2 cm(2). Using a pattern-matching classification approach four types of hand gestures were classified based on their pattern of neuronal activity. In the two participants the gestures were classified with 97 and 74 % accuracy. The high frequencies (> 65 Hz) allowed for the best classification results. This proof-of-principle study indicates that the four gestures are associated with a reliable and discriminable spatial representation on a confined area of the sensorimotor cortex. This robust representation on a small area makes hand gestures an interesting control feature for an implantable BCI to restore communication for severely paralyzed people.
引用
收藏
页码:203 / 216
页数:14
相关论文
共 46 条
[1]   Single-trial analysis and classification of ERP components - A tutorial [J].
Blankertz, Benjamin ;
Lemm, Steven ;
Treder, Matthias ;
Haufe, Stefan ;
Mueller, Klaus-Robert .
NEUROIMAGE, 2011, 56 (02) :814-825
[2]   Give Me a Sign: Decoding Complex Coordinated Hand Movements Using High-Field fMRI [J].
Bleichner, Martin G. ;
Jansma, Johan M. ;
Sellmeijer, Jim ;
Raemaekers, Mathijs ;
Ramsey, Nicolas F. .
BRAIN TOPOGRAPHY, 2014, 27 (02) :248-257
[3]  
Blokland Y, 2012, IEEE ENG MED BIO, P3967, DOI 10.1109/EMBC.2012.6346835
[4]   Long-term Outcomes of Deep Brain Stimulation for Neuropathic Pain [J].
Boccard, Sandra G. J. ;
Pereira, Erlick A. C. ;
Moir, Liz ;
Aziz, Tipu Z. ;
Green, Alexander L. .
NEUROSURGERY, 2013, 72 (02) :221-230
[5]   Does the 'P300' speller depend on eye gaze? [J].
Brunner, P. ;
Joshi, S. ;
Briskin, S. ;
Wolpaw, J. R. ;
Bischof, H. ;
Schalk, G. .
JOURNAL OF NEURAL ENGINEERING, 2010, 7 (05)
[6]   New morphologic variants of the hand motor cortex as seen with MR imaging in a large study population [J].
Caulo, M. ;
Briganti, C. ;
Mattei, P. A. ;
Perfetti, B. ;
Ferretti, A. ;
Romani, G. L. ;
Tartaro, A. ;
Colosimo, C. .
AMERICAN JOURNAL OF NEURORADIOLOGY, 2007, 28 (08) :1480-1485
[7]   Hand posture classification using electrocorticography signals in the gamma band over human sensorimotor brain areas [J].
Chestek, Cynthia A. ;
Gilja, Vikash ;
Blabe, Christine H. ;
Foster, Brett L. ;
Shenoy, Krishna V. ;
Parvizi, Josef ;
Henderson, Jaimie M. .
JOURNAL OF NEURAL ENGINEERING, 2013, 10 (02)
[8]   High-performance neuroprosthetic control by an individual with tetraplegia [J].
Collinger, Jennifer L. ;
Wodlinger, Brian ;
Downey, John E. ;
Wang, Wei ;
Tyler-Kabara, Elizabeth C. ;
Weber, Douglas J. ;
McMorland, Angus J. C. ;
Velliste, Meel ;
Boninger, Michael L. ;
Schwartz, Andrew B. .
LANCET, 2013, 381 (9866) :557-564
[9]   Functional reorganization and stability of somatosensory-motor cortical topography in a tetraplegic subject with late recovery [J].
Corbetta, M ;
Burton, H ;
Sinclair, RJ ;
Conturo, TE ;
Akbudak, E ;
McDonald, JW .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2002, 99 (26) :17066-17071
[10]   Brain motor system function after chronic, complete spinal cord injury [J].
Cramer, SC ;
Lastra, L ;
Lacourse, MG ;
Cohen, MJ .
BRAIN, 2005, 128 :2941-2950