Dynamic Difficulty Using Brain Metrics of Workload

被引:92
作者
Afergan, Daniel [1 ]
Peck, Evan M. [1 ]
Solovey, Erin T. [2 ]
Jenkins, Andrew [1 ]
Hincks, Samuel W. [1 ]
Brown, Eli T. [1 ]
Chang, Remco [1 ]
Jacob, Robert J. K. [1 ]
机构
[1] Tufts Univ, Medford, MA 02155 USA
[2] Drexel Univ, Philadelphia, PA 19104 USA
来源
32ND ANNUAL ACM CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2014) | 2014年
基金
美国国家科学基金会;
关键词
BCI; passive brain-computer interface; dynamic difficulty; fNIRS; near-infrared spectroscopy; workload; UAV; WORKING-MEMORY; PERFORMANCE; BACK; BOLD;
D O I
10.1145/2556288.2557230
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Dynamic difficulty adjustments can be used in human-computer systems in order to improve user engagement and performance. In this paper, we use functional near-infrared spectroscopy (fNIRS) to obtain passive brain sensing data and detect extended periods of boredom or overload. From these physiological signals, we can adapt a simulation in order to optimize workload in real-time, which allows the system to better fit the task to the user from moment to moment. To demonstrate this idea, we ran a laboratory study in which participants performed path planning for multiple unmanned aerial vehicles (UAVs) in a simulation. Based on their state, we varied the difficulty of the task by adding or removing UAVs and found that we were able to decrease errors by 35% over a baseline condition. Our results show that we can use fNIRS brain sensing to detect task difficulty in real-time and construct an interface that improves user performance through dynamic difficulty adjustment.
引用
收藏
页码:3797 / 3806
页数:10
相关论文
共 44 条
[31]  
Peck E. M., 2013, AUGMENTED HUMAN 2013, V2013
[32]   Boredom in Achievement Settings: Exploring Control-Value Antecedents and Performance Outcomes of a Neglected Emotion [J].
Pekrun, Reinhard ;
Goetz, Thomas ;
Daniels, Lia M. ;
Stupnisky, Robert H. ;
Perry, Raymond P. .
JOURNAL OF EDUCATIONAL PSYCHOLOGY, 2010, 102 (03) :531-549
[33]   Effects of a psychophysiological system for adaptive automation on performance, workload, and the event-related potential P300 component [J].
Prinzel, LJ ;
Freeman, FG ;
Scerbo, MW ;
Mikulka, PJ ;
Pope, AT .
HUMAN FACTORS, 2003, 45 (04) :601-613
[34]   Effects of different scenarios of game difficulty on player immersion [J].
Qin, Hua ;
Rau, Pei-Luen Patrick ;
Salvendy, Gavriel .
INTERACTING WITH COMPUTERS, 2010, 22 (03) :230-239
[35]  
Rani P., 2005, PULSE
[36]   DISCRIMINATION OF MENTAL WORKLOAD LEVELS IN HUMAN SUBJECTS WITH FUNCTIONAL NEAR-INFRARED SPECTROSCOPY [J].
Sassaroli, Angelo ;
Zheng, Feng ;
Hirshfield, Leanne M. ;
Girouard, Audrey ;
Solovey, Erin Treacy ;
Jacob, Robert J. K. ;
Fantini, Sergio .
JOURNAL OF INNOVATIVE OPTICAL HEALTH SCIENCES, 2008, 1 (02) :227-237
[37]  
Solovey ET, 2009, UIST 2009: PROCEEDINGS OF THE 22ND ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, P157
[38]   A quantitative comparison of simultaneous BOLD fMRI and NIRS recordings during functional brain activation [J].
Strangman, G ;
Culver, JP ;
Thompson, JH ;
Boas, DA .
NEUROIMAGE, 2002, 17 (02) :719-731
[39]  
Stripling R, 2007, LECT NOTES ARTIF INT, V4565, P346
[40]   Single-trial classification of NIRS signals during emotional induction tasks: towards a corporeal machine interface [J].
Tai, Kelly ;
Chau, Tom .
JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2009, 6