Enhanced performance by a hybrid NIRS-EEG brain computer interface

被引:418
作者
Fazli, Siamac [1 ,2 ]
Mehnert, Jan [3 ,4 ]
Steinbrink, Jens [2 ,3 ]
Curio, Gabriel [2 ,5 ]
Villringer, Arno [3 ,4 ,6 ]
Mueller, Klaus-Robert [1 ,2 ,8 ]
Blankertz, Benjamin [1 ,2 ,7 ]
机构
[1] Berlin Inst Technol, Machine Learning Dept, Berlin, Germany
[2] Bernstein Focus Neurotechnol, Berlin, Germany
[3] Univ Hosp Charite, Berlin NeuroImaging Ctr, Berlin, Germany
[4] Max Planck Inst Human Cognit & Brain Sci, Leipzig, Germany
[5] Univ Hosp Charite, Dept Neurol, Berlin, Germany
[6] Humboldt Univ, Berlin Sch Mind & Brain, D-1086 Berlin, Germany
[7] Fraunhofer FIRST IDA, Berlin, Germany
[8] Univ Calif Los Angeles, Inst Pure & Appl Math IPAM, Los Angeles, CA USA
关键词
Combined NIRS-EEG; Hybrid BCI; Meta-classifier; NEAR-INFRARED SPECTROSCOPY; BLOOD OXYGENATION; MOTOR IMAGERY; FMRI; SIGNALS; CLASSIFICATION; CORTEX; COMMUNICATION; ACTIVATION; EXECUTION;
D O I
10.1016/j.neuroimage.2011.07.084
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Noninvasive Brain Computer Interfaces (BCI) have been promoted to be used for neuroprosthetics. However, reports on applications with electroencephalography (EEG) show a demand for a better accuracy and stability. Here we investigate whether near-infrared spectroscopy (NIRS) can be used to enhance the EEG approach. In our study both methods were applied simultaneously in a real-time Sensory Motor Rhythm (SMR)-based BCI paradigm, involving executed movements as well as motor imagery. We tested how the classification of NIRS data can complement ongoing real-time EEG classification. Our results show that simultaneous measurements of NIRS and EEG can significantly improve the classification accuracy of motor imagery in over 90% of considered subjects and increases performance by 5% on average (p<0:01). However, the long time delay of the hemodynamic response may hinder an overall increase of bit-rates. Furthermore we find that EEG and NIRS complement each other in terms of information content and are thus a viable multimodal imaging technique, suitable for BCI. (C) 2011 Elsevier Inc. All rights reserved.
引用
收藏
页码:519 / 529
页数:11
相关论文
共 71 条
  • [1] Real-time imaging of human brain function by near-infrared spectroscopy using an adaptive general linear model
    Abdelnour, A. Farras
    Huppert, Theodore
    [J]. NEUROIMAGE, 2009, 46 (01) : 133 - 143
  • [2] Development, set-up and first results for a one-channel near-infrared spectroscopy system
    Bauernfeind, Guenther
    Leeb, Robert
    Wriessnegger, Selina Christin
    Pfurtscheller, Gert
    [J]. BIOMEDIZINISCHE TECHNIK, 2008, 53 (01): : 36 - 43
  • [3] BIESSMANN F, 2011, IEEE REV BIOME UNPUB
  • [4] Temporal kernel CCA and its application in multimodal neuronal data analysis
    Biessmann, Felix
    Meinecke, Frank C.
    Gretton, Arthur
    Rauch, Alexander
    Rainer, Gregor
    Logothetis, Nikos K.
    Mueller, Klaus-Robert
    [J]. MACHINE LEARNING, 2010, 79 (1-2) : 5 - 27
  • [5] A spelling device for the paralysed
    Birbaumer, N
    Ghanayim, N
    Hinterberger, T
    Iversen, I
    Kotchoubey, B
    Kübler, A
    Perelmouter, J
    Taub, E
    Flor, H
    [J]. NATURE, 1999, 398 (6725) : 297 - 298
  • [6] Optimizing spatial filters for robust EEG single-trial analysis
    Blankertz, Benjamin
    Tomioka, Ryota
    Lemm, Steven
    Kawanabe, Motoaki
    Mueller, Klaus-Robert
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2008, 25 (01) : 41 - 56
  • [7] The non-invasive Berlin Brain-Computer Interface:: Fast acquisition of effective performance in untrained subjects
    Blankertz, Benjamin
    Dornhege, Guido
    Krauledat, Matthias
    Mueller, Klaus-Robert
    Curio, Gabriel
    [J]. NEUROIMAGE, 2007, 37 (02) : 539 - 550
  • [8] Rapid communication with a "P300" matrix speller using electrocorticographic signals (ECoG)
    Brunner, Peter
    Ritaccio, Anthony L.
    Emrich, Joseph F.
    Bischof, Horst
    Schalk, Gerwin
    [J]. FRONTIERS IN NEUROSCIENCE, 2011, 5
  • [9] Towards a robust BCI:: Error potentials and online learning
    Buttfield, Anna
    Ferrez, Pierre W.
    Millan, Jose del R.
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2006, 14 (02) : 164 - 168
  • [10] Design and implementation of a brain-computer interface with high transfer rates
    Cheng, M
    Gao, XR
    Gao, SG
    Xu, DF
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2002, 49 (10) : 1181 - 1186