A robust static hand gesture recognition system using geometry based normalizations and Krawtchouk moments

被引:104
作者
Priyal, S. Padam [1 ]
Bora, Prabin Kumar [1 ]
机构
[1] Indian Inst Technol Guwahati, Dept Elect & Elect Engn, Gauhati 781039, Assam, India
关键词
Hand extraction; Hand gesture; Krawtchouk moments; Minimum distance classifier; Rotation normalization; Skin color detection; View and user-independent recognition; IMAGE-ANALYSIS; SIGN RECOGNITION; FEATURES; POSTURE; COMMUNICATION;
D O I
10.1016/j.patcog.2013.01.033
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Static hand gesture recognition involves interpretation of hand shapes by a computer. This work addresses three main issues in developing a gesture interpretation system: They are (i) the separation of the hand from the forearm region, (ii) rotation normalization using the geometry of gestures and (iii) user and view independent gesture recognition. The gesture image comprising the hand and the forearm is detected through skin color detection and segmented to obtain a binary silhouette. A novel method based on the anthropometric measures of the hand is proposed for extracting the regions constituting the hand and the forearm. An efficient rotation normalization method that depends on the gesture geometry is devised for aligning the extracted hand. These normalized binary silhouettes are represented using the Krawtchouk moment features and classified using a minimum distance classifier. The Krawtchouk features are found to be robust to viewpoint changes and capable of achieving good recognition for a small number of training samples. Hence, these features exhibit user independence. The developed gesture recognition system is robust to similarity transformations and perspective distortions. It can be well realized for real-time implementation of gesture based applications. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2202 / 2219
页数:18
相关论文
共 56 条
[51]   Extraction of 2D motion trajectories and its application to hand gesture recognition [J].
Yang, MH ;
Ahuja, N ;
Tabb, M .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (08) :1061-1074
[52]   Image analysis by Krawtchouk moments [J].
Yap, PT ;
Paramesran, R ;
Ong, SH .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (11) :1367-1377
[53]   Hand gesture recognition using combined features of location, angle and velocity [J].
Yoon, HS ;
Soh, J ;
Bae, YJ ;
Yang, HS .
PATTERN RECOGNITION, 2001, 34 (07) :1491-1501
[54]   Review of shape representation and description techniques [J].
Zhang, DS ;
Lu, GJ .
PATTERN RECOGNITION, 2004, 37 (01) :1-19
[55]  
Zhou H., 2004, IEEE C COMPUTER VISI, P161, DOI DOI 10.1109/CVPR.2004.169
[56]  
Zhu L, 2009, LECT NOTES COMPUT SC, V5553, P310