Classification of intended phoneme production from chronic intracortical microelectrode recordings in speech-motor cortex

被引:81
作者
Brumberg, Jonathan S. [1 ]
Wright, E. Joe [2 ]
Andreasen, Dinal S. [2 ,3 ]
Guenther, Frank H. [1 ,4 ,5 ]
Kennedy, Philip R. [2 ]
机构
[1] Boston Univ, Dept Cognit & Neural Syst, Boston, MA 02215 USA
[2] Neural Signals Inc, Duluth, GA USA
[3] Georgia Tech Res Inst, Marietta, GA USA
[4] Boston Univ, Dept Speech Language & Hearing Sci, Boston, MA 02215 USA
[5] Harvard Univ, MIT, Div Hlth Sci & Technol, Cambridge, MA 02139 USA
基金
美国国家科学基金会;
关键词
locked-in syndrome; speech prosthesis; neurotrophic electrode; chronic recording; motor cortex; BRAIN-COMPUTER INTERFACE; ELECTROCORTICOGRAPHIC GAMMA ACTIVITY; MENTAL PROSTHESIS; VIRTUAL KEYBOARD; CORTICAL CONTROL; CONE ELECTRODE; POTENTIALS; PATIENT; DEVICE; ARRAY;
D O I
10.3389/fnins.2011.00065
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
We conducted a neurophysiological study of attempted speech production in a paralyzed human volunteer using chronic microelectrode recordings. The volunteer suffers from locked-in syndrome leaving him in a state of near-total paralysis, though he maintains good cognition and sensation. In this study, we investigated the feasibility of supervised classification techniques for prediction of intended phoneme production in the absence of any overt movements including speech. Such classification or decoding ability has the potential to greatly improve the quality-of-life of many people who are otherwise unable to speak by providing a direct communicative link to the general community. We examined the performance of three classifiers on a multi-class discrimination problem in which the items were 38 American English phonemes including monophthong and diphthong vowels and consonants. The three classifiers differed in performance, but averaged between 16 and 21% overall accuracy (chance-level is 1/38 or 2.6%). Further, the distribution of phonemes classified statistically above chance was non-uniform though 20 of 38 phonemes were classified with statistical significance for all three classifiers. These preliminary results suggest supervised classification techniques are capable of performing large scale multi-class discrimination for attempted speech production and may provide the basis for future communication prostheses.
引用
收藏
页码:1 / 12
页数:12
相关论文
共 70 条
[61]   THE BRAIN RESPONSE INTERFACE - COMMUNICATION THROUGH VISUALLY-INDUCED ELECTRICAL BRAIN RESPONSES [J].
SUTTER, EE .
JOURNAL OF MICROCOMPUTER APPLICATIONS, 1992, 15 (01) :31-45
[62]   Direct cortical control of 3D neuroprosthetic devices [J].
Taylor, DM ;
Tillery, SIH ;
Schwartz, AB .
SCIENCE, 2002, 296 (5574) :1829-1832
[63]   ECoG gamma activity during a language task: differentiating expressive and receptive speech areas [J].
Towle, Vernon L. ;
Yoon, Hyun-Ah ;
Castelle, Michael ;
Edgar, J. Christopher ;
Biassou, Nadia M. ;
Frim, David M. ;
Spire, Jean-Paul ;
Kohrman, Michael H. .
BRAIN, 2008, 131 :2013-2027
[64]   The wadsworth BCI research and development program: At home with BCI [J].
Vaughan, Theresa M. ;
McFarland, Dennis J. ;
Schalk, Gerwin ;
Sarnacki, William A. ;
Krusienski, Dean J. ;
Sellers, Eric W. ;
Wolpaw, Jonathan R. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2006, 14 (02) :229-233
[65]   Cortical control of a prosthetic arm for self-feeding [J].
Velliste, Meel ;
Perel, Sagi ;
Spalding, M. Chance ;
Whitford, Andrew S. ;
Schwartz, Andrew B. .
NATURE, 2008, 453 (7198) :1098-1101
[66]  
Venables W. N., 2002, Modern Applied Statistics with S, V4th ed.
[67]   Toward a comparison of microelectrodes for acute and chronic recordings [J].
Ward, Matthew P. ;
Rajdev, Pooja ;
Ellison, Casey ;
Irazoqui, Pedro P. .
BRAIN RESEARCH, 2009, 1282 :183-200
[68]   Long-term neural recording characteristics of wire microelectrode arrays implanted in cerebral cortex [J].
Williams, JC ;
Rennaker, RL ;
Kipke, DR .
BRAIN RESEARCH PROTOCOLS, 1999, 4 (03) :303-313
[69]   AN INTEGRATED-CIRCUIT APPROACH TO EXTRACELLULAR MICROELECTRODES [J].
WISE, KD ;
ANGELL, JB ;
STARR, A .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 1970, BM17 (03) :238-+
[70]   Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans [J].
Wolpaw, JR ;
McFarland, DJ .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2004, 101 (51) :17849-17854