An online brain-computer interface in mobile virtual reality environments

被引:14
作者
Yao, Zhaolin [1 ,2 ]
Wang, Yijun [1 ,2 ]
Yang, Chen [3 ]
Pei, Weihua [1 ,2 ]
Gao, Xiaorong [3 ]
Chen, Hongda [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Semicond, State Key Lab Integrated Optoelect, Beijing 100083, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Tsinghua Univ, Dept Biomed Engn, Beijing, Peoples R China
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Brain-computer interface; electroencephalogram; virtual reality; steady-state visual evoked potential; RHYTHMS; WALKING; SYSTEM;
D O I
10.3233/ICA-180586
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The brain-computer interface (BCI) technology provides a potential tool for communication and control in immersive virtual reality (VR) environments. However, implementing a BCI with current VR platforms remains a challenge due to difficulties in system design and electroencephalogram (EEG) analysis. This study aims to explore the feasibility of a steady-state visual evoked potential (SSVEP)-based BCI for applications in room-scale VR with an HTC VIVE headset. A four-class BCI was designed to simulate a cursor control system. Subjects were instructed to perform a cue-guided target selection task during standing or walking on a treadmill at four different speeds (0, 0.45, 0.89, and 1.34 meters per second (m/s)). During the experiment, two fixing modes of visual stimuli (head-fixed and earth-fixed) were presented to the head-mounted display (HMD). The results from a group of 10 subjects indicated that the system worked well regarding classification accuracy. The BCI performance decreased as the walking speed increased. Interestingly, the earth-fixed condition showed significantly higher performance than the head-fixed condition, showing online and offline information transfer rates (ITR5) corresponding to unsupervised and supervised algorithms above 10 bits/min and 21 bits/min, respectively. These results demonstrated the potential of an SSVEP-based BCI for applications in room-scale mobile VR environments.
引用
收藏
页码:345 / 360
页数:16
相关论文
共 48 条
[1]   BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? [J].
Allison, Brendan ;
Lueth, Thorsten ;
Valbuena, Diana ;
Teymourian, Amir ;
Volosyak, Ivan ;
Graeser, Axel .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2010, 18 (02) :107-116
[2]   Eyes on target: What neurons must do for the vestibuloocular reflex during linear motion [J].
Angelaki, DE .
JOURNAL OF NEUROPHYSIOLOGY, 2004, 92 (01) :20-35
[3]   A virtual reality testbed for brain-computer interface research [J].
Bayliss, JD ;
Ballard, DH .
IEEE TRANSACTIONS ON REHABILITATION ENGINEERING, 2000, 8 (02) :188-190
[4]   Using a Hybrid Brain Computer Interface and Virtual Reality System to Monitor and Promote Cortical Reorganization through Motor Activity and Motor Imagery Training [J].
Bermudez i Badia, S. ;
Garcia Morgade, A. ;
Samaha, H. ;
Verschure, P. F. M. J. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2013, 21 (02) :174-181
[5]   An online multi-channel SSVEP-based brain-computer interface using a canonical correlation analysis method [J].
Bin, Guangyu ;
Gao, Xiaorong ;
Yan, Zheng ;
Hong, Bo ;
Gao, Shangkai .
JOURNAL OF NEURAL ENGINEERING, 2009, 6 (04)
[6]   Reading from a Head-Fixed Display during Walking: Adverse Effects of Gaze Stabilization Mechanisms [J].
Borg, Olivier ;
Casanova, Remy ;
Bootsma, Reinoud J. .
PLOS ONE, 2015, 10 (06)
[7]   Brain-Computer Interface after Nervous System Injury [J].
Burns, Alexis ;
Adeli, Hojjat ;
Buford, John A. .
NEUROSCIENTIST, 2014, 20 (06) :639-651
[8]   Control of a 7-DOF Robotic Arm System With an SSVEP-Based BCI [J].
Chen, Xiaogang ;
Zhao, Bing ;
Wang, Yijun ;
Xu, Shengpu ;
Gao, Xiaorong .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2018, 28 (08)
[9]   High-speed spelling with a noninvasive brain-computer interface [J].
Chen, Xiaogang ;
Wang, Yijun ;
Nakanishi, Masaki ;
Gao, Xiaorong ;
Jung, Tzyy-Ping ;
Gao, Shangkai .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2015, 112 (44) :E6058-E6067
[10]   A high-ITR SSVEP-based BCI speller [J].
Chen, Xiaogang ;
Chen, Zhikai ;
Gao, Shangkai ;
Gao, Xiaorong .
BRAIN-COMPUTER INTERFACES, 2014, 1 (3-4) :181-191