Gesture spotting with body-worn inertial sensors to detect user activities

被引:221
作者
Junker, Holger [1 ]
Amft, Oliver [1 ]
Lukowicz, Paul [2 ]
Troester, Gerhard [1 ]
机构
[1] ETH, Wearable Comp Lab, CH-8092 Zurich, Switzerland
[2] Univ Passau, Embedded Syst Grp, D-94032 Passau, Germany
关键词
natural gesture segmentation; gesture spotting; activity recognition; automatic dietary monitoring; event detection;
D O I
10.1016/j.patcog.2007.11.016
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a method for spotting sporadically occurring gestures in a continuous data stream from body-worn inertial sensors. Our method is based on a natural partitioning of continuous sensor signals and uses a two-stage approach for the spotting task. In a first stage, signal sections likely to contain specific motion events are preselected using a simple similarity search. Those preselected sections are then further classified in a second stage, exploiting the recognition capabilities of hidden Markov models. Based on two case studies, we discuss implementation details of our approach and show that it is a feasible strategy for the spotting of various types of motion events. (C) 2007 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2010 / 2024
页数:15
相关论文
共 37 条
[1]   Detection of eating and drinking arm gestures using inertial body-worn sensors [J].
Amft, O ;
Junker, H ;
Tröster, G .
NINTH IEEE INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, PROCEEDINGS, 2005, :160-163
[2]  
Amft O, 2005, LECT NOTES COMPUT SC, V3660, P56
[3]   Waving real hand gestures recorded by wearable motion sensors to a virtual car and driver in a mixed-reality parking game [J].
Bannach, David ;
Amft, Oliver ;
Kunze, Kai S. ;
Heinz, Ernst A. ;
Troester, Gerhard ;
Lukowicz, Paul .
2007 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND GAMES, 2007, :32-39
[4]  
BAO L, 2003, THESIS MIT BOSTON US
[5]  
BENBASAT AY, 2000, THESIS MIT BOSTON US
[6]   Movement, activity and action: The role of knowledge in the perception of motion [J].
Bobick, AF .
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY OF LONDON SERIES B-BIOLOGICAL SCIENCES, 1997, 352 (1358) :1257-1265
[7]   Coupled hidden Markov models for complex action recognition [J].
Brand, M ;
Oliver, N ;
Pentland, A .
1997 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1997, :994-999
[8]   Using multiple sensors for mobile sign language recognition [J].
Brashear, H ;
Starner, T ;
Lukowicz, P ;
Junker, H .
SEVENTH IEEE INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, PROCEEDINGS, 2003, :45-52
[9]  
CAKMAKCI O, 2002, ECAI 2002
[10]  
CAMPBELL LW, 1995, FIFTH INTERNATIONAL CONFERENCE ON COMPUTER VISION, PROCEEDINGS, P624, DOI 10.1109/ICCV.1995.466880