3D Gesture classification with linear acceleration and angular velocity sensing devices for video games

被引:15
作者
Cheema, Salman [1 ]
Hoffman, Michael [1 ]
LaViola, Joseph J., Jr. [1 ]
机构
[1] Univ Cent Florida, Dept EECS, Orlando, FL 32816 USA
基金
美国国家科学基金会;
关键词
Input devices; Interaction techniques; 3D Gesture recognition; Machine learning; Video games; Linear Classifier; Support Vector Machine; AdaBoost; Decision Tree; Bayes Classifier;
D O I
10.1016/j.entcom.2012.09.002
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We present the results of two experiments that explore various aspects of 3D gesture recognition using linear acceleration and angular velocity data. We examine relationships between variables affecting recognition accuracy, including size of gesture set, amount of training data, choice of classifier, and training configuration (user dependent/independent). Using a set of 25 gestures, we first compare the performance of four machine learning algorithms (AdaBoost, SVM, Bayes and Decision Trees) with existing results (Linear Classifier). Next, we investigate how results in existing literature apply to an application-oriented setting. We created a new 3D gesture database comprising 17,890 samples, containing examples of gestures performed in two different settings (a simple data collection setting vs a video game). We then compared the performance of all five classifiers on this new 3D gesture database. Our results indicate that the Linear Classifier can recognize up to 25 gestures at over 99% accuracy when trained in a user dependent configuration. However, in the video game setting, factors such as in-game stress and the ability to recall gestures cause a drop in recognition accuracy to 79%. We present a discussion of possible strategies to improve recognition accuracy in realistic settings by using a combination of recognition algorithms. (C) 2012 International Federation for Information Processing Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:11 / 24
页数:14
相关论文
共 31 条
[1]  
Agrawal Sandip, 2011, P 9 INT C MOBILE SYS, P15, DOI [DOI 10.1145/1999995.1999998, 10.1145/1999995.1999998]
[2]  
Amma Christoph, 2010, P 1 AUGM HUM INT C, P10
[3]  
Andre E., 2008, BCS HCI 08 P 22 BRIT, V1, P13
[4]  
Beedkar K., 2008, ACCELEROMET ER BASED
[5]  
Boll, 2008, P 2 INT C TANG EMB I, P11, DOI DOI 10.1145/1347390.1347395
[6]  
Bouckaert R.R., 2012, BAYESIAN NETWORK CLA
[7]  
Bowman D., 2004, 3D USER INTERFACES T
[8]  
Caridakis G., 2008, 2008 IEEE INT C MULT
[9]  
Chen M., 2012, PROC 3 ANN ACM SIGMM, P83, DOI DOI 10.1145/2155555.2155569
[10]  
Chen M., 2012, IEEE INT C AC SPEECH