Brain-computer interfaces for speech communication

被引:150
作者
Brumberg, Jonathan S. [1 ,5 ]
Nieto-Castanon, Alfonso [6 ]
Kennedy, Philip R. [5 ]
Guenther, Frank H. [1 ,2 ,3 ,4 ]
机构
[1] Boston Univ, Dept Cognit & Neural Syst, Boston, MA 02215 USA
[2] Boston Univ, Sargent Coll Hlth & Rehabil Sci, Dept Speech Language & Hearing Sci, Boston, MA 02215 USA
[3] Harvard Univ, MIT, Div Hlth Sci & Technol, Cambridge, MA 02139 USA
[4] Massachusetts Gen Hosp, Athinoula A Martinos Ctr Biomed Imaging, Charlestown, MA 02129 USA
[5] Neural Signals Inc, Duluth, GA 30096 USA
[6] StatsANC LLC, Buenos Aires, DF, Argentina
基金
美国国家科学基金会;
关键词
Brain-computer interface; Neural prosthesis; Speech restoration; THOUGHT-TRANSLATION DEVICE; INTRACORTICAL ELECTRODE ARRAY; NEURAL-NETWORK MODEL; ELECTROCORTICOGRAPHIC SIGNALS; MICROELECTRODE ARRAYS; MACHINE INTERFACE; CORTICAL CONTROL; CONE ELECTRODE; RECOGNITION; CORTEX;
D O I
10.1016/j.specom.2010.01.001
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This paper briefly reviews current silent speech methodologies for normal and disabled individuals. Current techniques utilizing electromyographic (EMG) recordings of vocal tract movements are useful for physically healthy individuals but fail for tetraplegic individuals who do not have accurate voluntary control over the speech articulators. Alternative methods utilizing EMG from other body parts (e.g., hand, arm, or facial muscles) or electroencephalography (EEG) can provide capable silent communication to severely paralyzed users, though current interfaces are extremely slow relative to normal conversation rates and require constant attention to a computer screen that provides visual feedback and/or cueing. We present a novel approach to the problem of silent speech via an intracortical microelectrode brain-computer interface (BCI) to predict intended speech information directly from the activity of neurons involved in speech production. The predicted speech is synthesized and acoustically fed back to the user with a delay under 50 ms. We demonstrate that the Neurotrophic Electrode used in the BCI is capable of providing useful neural recordings for over 4 years, a necessary property for BCIs that need to remain viable over the lifespan of the user. Other design considerations include neural decoding techniques based on previous research involving BCIs for computer cursor or robotic arm control via prediction of intended movement kinematics from motor cortical signals in monkeys and humans. Initial results from a study of continuous speech production with instantaneous acoustic feedback show the BCI user was able to improve his control over an artificial speech synthesizer both within and across recording sessions. The success of this initial trial validates the potential of the intracortical microelectrode-based approach for providing a speech prosthesis that can allow much more rapid communication rates. (C) 2010 Elsevier By. All rights reserved.
引用
收藏
页码:367 / 379
页数:13
相关论文
共 76 条
  • [1] Towards an independent brain-computer interface using steady state visual evoked potentials
    Allison, Brendan. Z.
    McFarland, Dennis J.
    Schalk, Gerwin
    Zheng, Shi Dong
    Jackson, Melody Moore
    Wolpaw, Jonathan R.
    [J]. CLINICAL NEUROPHYSIOLOGY, 2008, 119 (02) : 399 - 408
  • [2] [Anonymous], 1959, Speech and Brain Mechanisms
  • [3] Neurotrophic electrode: Method of assembly and implantation into human motor speech cortex
    Bartels, Jess
    Andreasen, Dinal
    Ehirim, Princewill
    Mao, Hui
    Seibert, Steven
    Wright, E. Joe
    Kennedy, Philip
    [J]. JOURNAL OF NEUROSCIENCE METHODS, 2008, 174 (02) : 168 - 176
  • [4] Small-vocabulary speech recognition using surface electromyography
    Betts, Bradley J.
    Binsted, Kim
    Jorgensen, Charles
    [J]. INTERACTING WITH COMPUTERS, 2006, 18 (06) : 1242 - 1259
  • [5] The thought-translation device (TTD):: Neurobehavioral mechanisms and clinical outcome
    Birbaumer, N
    Hinterberger, T
    Kübler, A
    Neumann, N
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2003, 11 (02) : 120 - 123
  • [6] A spelling device for the paralysed
    Birbaumer, N
    Ghanayim, N
    Hinterberger, T
    Iversen, I
    Kotchoubey, B
    Kübler, A
    Perelmouter, J
    Taub, E
    Flor, H
    [J]. NATURE, 1999, 398 (6725) : 297 - 298
  • [7] The thought translation device (TTD) for completely paralyzed patients
    Birbaumer, N
    Kübler, A
    Ghanayim, N
    Hinterberger, T
    Perelmouter, J
    Kaiser, J
    Iversen, I
    Kotchoubey, B
    Neumann, N
    Flor, H
    [J]. IEEE TRANSACTIONS ON REHABILITATION ENGINEERING, 2000, 8 (02): : 190 - 193
  • [8] Brown EN, 2004, MATH COMP BIOL SER, P253
  • [9] Brumberg J. S., 2009, P 10 ANN C INT SPEEC
  • [10] Learning to control a brain-machine interface for reaching and grasping by primates
    Carmena, JM
    Lebedev, MA
    Crist, RE
    O'Doherty, JE
    Santucci, DM
    Dimitrov, DF
    Patil, PG
    Henriquez, CS
    Nicolelis, MAL
    [J]. PLOS BIOLOGY, 2003, 1 (02) : 193 - 208