Enhanced performance by a hybrid NIRS-EEG brain computer interface

被引:418
作者
Fazli, Siamac [1 ,2 ]
Mehnert, Jan [3 ,4 ]
Steinbrink, Jens [2 ,3 ]
Curio, Gabriel [2 ,5 ]
Villringer, Arno [3 ,4 ,6 ]
Mueller, Klaus-Robert [1 ,2 ,8 ]
Blankertz, Benjamin [1 ,2 ,7 ]
机构
[1] Berlin Inst Technol, Machine Learning Dept, Berlin, Germany
[2] Bernstein Focus Neurotechnol, Berlin, Germany
[3] Univ Hosp Charite, Berlin NeuroImaging Ctr, Berlin, Germany
[4] Max Planck Inst Human Cognit & Brain Sci, Leipzig, Germany
[5] Univ Hosp Charite, Dept Neurol, Berlin, Germany
[6] Humboldt Univ, Berlin Sch Mind & Brain, D-1086 Berlin, Germany
[7] Fraunhofer FIRST IDA, Berlin, Germany
[8] Univ Calif Los Angeles, Inst Pure & Appl Math IPAM, Los Angeles, CA USA
关键词
Combined NIRS-EEG; Hybrid BCI; Meta-classifier; NEAR-INFRARED SPECTROSCOPY; BLOOD OXYGENATION; MOTOR IMAGERY; FMRI; SIGNALS; CLASSIFICATION; CORTEX; COMMUNICATION; ACTIVATION; EXECUTION;
D O I
10.1016/j.neuroimage.2011.07.084
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Noninvasive Brain Computer Interfaces (BCI) have been promoted to be used for neuroprosthetics. However, reports on applications with electroencephalography (EEG) show a demand for a better accuracy and stability. Here we investigate whether near-infrared spectroscopy (NIRS) can be used to enhance the EEG approach. In our study both methods were applied simultaneously in a real-time Sensory Motor Rhythm (SMR)-based BCI paradigm, involving executed movements as well as motor imagery. We tested how the classification of NIRS data can complement ongoing real-time EEG classification. Our results show that simultaneous measurements of NIRS and EEG can significantly improve the classification accuracy of motor imagery in over 90% of considered subjects and increases performance by 5% on average (p<0:01). However, the long time delay of the hemodynamic response may hinder an overall increase of bit-rates. Furthermore we find that EEG and NIRS complement each other in terms of information content and are thus a viable multimodal imaging technique, suitable for BCI. (C) 2011 Elsevier Inc. All rights reserved.
引用
收藏
页码:519 / 529
页数:11
相关论文
共 71 条
  • [11] Cope M, 1988, Adv Exp Med Biol, V222, P183
  • [12] On the suitability of near-infrared (NIR) systems for next-generation brain-computer interfaces
    Coyle, S
    Ward, T
    Markham, C
    McDarby, G
    [J]. PHYSIOLOGICAL MEASUREMENT, 2004, 25 (04) : 815 - 822
  • [13] Brain-computer interface using a simplified functional near-infrared spectroscopy system
    Coyle, Shirley M.
    Ward, Tomas E.
    Markham, Charles M.
    [J]. JOURNAL OF NEURAL ENGINEERING, 2007, 4 (03) : 219 - 226
  • [14] Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms
    Dornhege, G
    Blankertz, B
    Curio, G
    Müller, KR
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2004, 51 (06) : 993 - 1002
  • [15] Dornhege G., 2007, Toward Brain-Computer Interfacing
  • [16] CORTICAL CORRELATES OF AUDITORY SENSORY GATING: A SIMULTANEOUS NEAR-INFRARED SPECTROSCOPY EVENT-RELATED POTENTIAL STUDY
    Ehlis, A. -C.
    Ringel, T. M.
    Plichta, M. M.
    Richter, M. M.
    Herrmann, M. J.
    Fallgatter, A. J.
    [J]. NEUROSCIENCE, 2009, 159 (03) : 1032 - 1043
  • [17] Fazli S., 2009, Advances in Neural Information Processing Systems, P513
  • [18] l1-penalized linear mixed-effects models for high dimensional data with application to BCI
    Fazli, Siamac
    Danoczy, Marton
    Schelldorfer, Juerg
    Mueller, Klaus-Robert
    [J]. NEUROIMAGE, 2011, 56 (04) : 2100 - 2108
  • [19] Subject-independent mental state classification in single trials
    Fazli, Siamac
    Popescu, Florin
    Danoczy, Marton
    Blankertz, Benjamin
    Mueller, Klaus-Robert
    Grozea, Cristian
    [J]. NEURAL NETWORKS, 2009, 22 (09) : 1305 - 1312
  • [20] Electrocorticographically controlled brain-computer interfaces using motor and sensory imagery in patients with temporary subdural electrode implants - Report of four cases
    Felton, Elizabeth A.
    Wilson, J. Adam
    Williams, Justin C.
    Garell, P. Charles
    [J]. JOURNAL OF NEUROSURGERY, 2007, 106 (03) : 495 - 500