Integrating dynamic stopping, transfer learning and language models in an adaptive zero-training ERP speller

被引:81
作者
Kindermans, Pieter-Jan [1 ]
Tangermann, Michael [2 ]
Mueller, Klaus-Robert [3 ,4 ]
Schrauwen, Benjamin [1 ]
机构
[1] Univ Ghent, Elect & Informat Syst ELIS Dept, B-9000 Ghent, Belgium
[2] Univ Freiburg, Dept Comp Sci, BrainLinks BrainTools Excellence Cluster, D-79104 Freiburg, Germany
[3] Tech Univ Berlin, Machine Learning Lab, D-10587 Berlin, Germany
[4] Korea Univ, Dept Brain & Cognit Engn, Seoul 136713, South Korea
基金
新加坡国家研究基金会;
关键词
BCI; unsupervised learning; subject-to-subject transfer; visual event-related potentials; P300; speller matrix;
D O I
10.1088/1741-2560/11/3/035005
中图分类号
R318 [生物医学工程];
学科分类号
100103 [病原生物学];
摘要
Objective. Most BCIs have to undergo a calibration session in which data is recorded to train decoders with machine learning. Only recently zero-training methods have become a subject of study. This work proposes a probabilistic framework for BCI applications which exploit event-related potentials (ERPs). For the example of a visual P300 speller we show how the framework harvests the structure suitable to solve the decoding task by (a) transfer learning, (b) unsupervised adaptation, (c) language model and (d) dynamic stopping. Approach. A simulation study compares the proposed probabilistic zero framework (using transfer learning and task structure) to a state-of-the-art supervised model on n = 22 subjects. The individual influence of the involved components (a)-(d) are investigated. Main results. Without any need for a calibration session, the probabilistic zero-training framework with inter-subject transfer learning shows excellent performance-competitive to a state-of-the-art supervised method using calibration. Its decoding quality is carried mainly by the effect of transfer learning in combination with continuous unsupervised adaptation. Significance. A high-performing zero-training BCI is within reach for one of the most popular BCI paradigms: ERP spelling. Recording calibration data for a supervised BCI would require valuable time which is lost for spelling. The time spent on calibration would allow a novel user to spell 29 symbols with our unsupervised approach. It could be of use for various clinical and non-clinical ERP-applications of BCI.
引用
收藏
页数:9
相关论文
共 34 条
[1]
[Anonymous], 2011, P 28 INT C MACH LEAR
[2]
Bishop C, 2007, PATTERN RECOGN, V4, P1
[3]
The Berlin brain-computer interface: non-medical uses of BCI technology [J].
Blankertz, Benjamin ;
Tangermann, Michael ;
Vidaurre, Carmen ;
Fazli, Siamac ;
Sannelli, Claudia ;
Haufe, Stefan ;
Maeder, Cecilia ;
Ramsey, Lenny ;
Sturm, Irene ;
Curio, Gabriel ;
Mueller, Klaus-Robert .
FRONTIERS IN NEUROSCIENCE, 2010, 4
[4]
Single-trial analysis and classification of ERP components - A tutorial [J].
Blankertz, Benjamin ;
Lemm, Steven ;
Treder, Matthias ;
Haufe, Stefan ;
Mueller, Klaus-Robert .
NEUROIMAGE, 2011, 56 (02) :814-825
[5]
Colwell K, 2013, P 5 INT BRAIN COMP I, P10
[6]
Dahne S., 2011, Proceedings of the 5th International BCI Conference, P92
[7]
The Utility Metric: A Novel Method to Assess the Overall Performance of Discrete Brain-Computer Interfaces [J].
Dal Seno, Bernardo ;
Matteucci, Matteo ;
Mainardi, Luca T. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2010, 18 (01) :20-28
[8]
MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[9]
Interactions Between Pre-Processing and Classification Methods for Event-Related-Potential Classification [J].
Farquhar, J. ;
Hill, N. J. .
NEUROINFORMATICS, 2013, 11 (02) :175-192
[10]
TALKING OFF THE TOP OF YOUR HEAD - TOWARD A MENTAL PROSTHESIS UTILIZING EVENT-RELATED BRAIN POTENTIALS [J].
FARWELL, LA ;
DONCHIN, E .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1988, 70 (06) :510-523