A SRN/HMM system for signer-independent continuous sign language recognition

被引:18
作者
Fang, GL [1 ]
Gao, W [1 ]
机构
[1] Harbin Inst Technol, Dept Comp Sci & Engn, Harbin 150001, Peoples R China
来源
FIFTH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, PROCEEDINGS | 2002年
关键词
D O I
10.1109/AFGR.2002.1004172
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sign language recognition is to provide an efficient and accurate mechanism to transcribe sign language into text or speech. State-of-the-art sign language recognition should be able to solve the signer-independent continuous problem for practical applications. A divide-and-conquer approach, which takes the problem of continuous Chinese Sign Language (CSL) recognition as subproblems of isolated CSL recognition, is presented for signer-independent continuous CSL recognition in this paper. In the proposed approach, the improved simple recurrent network (SRN) is used to segment the continuous CSL. The outputs of SRN are regarded as the states of hidden Markov models (HMM) in which the Lattice Viterbi algorithm is employed for searching the best word sequence. Experimental results show that SRN/HMM approach has better performance than the standard HMM.
引用
收藏
页码:312 / 317
页数:6
相关论文
共 12 条
[1]  
[Anonymous], 1995, International Workshop on Automatic Face and Gesture Recognition
[2]   FINDING STRUCTURE IN TIME [J].
ELMAN, JL .
COGNITIVE SCIENCE, 1990, 14 (02) :179-211
[3]  
FANG GL, 2001, INTERACT2001 8 IFIP, P731
[4]  
Gao W, 2000, LECT NOTES COMPUT SC, V1948, P564
[5]  
Kershaw D, 1996, ADV NEUR IN, V8, P750
[6]   A real-time continuous gesture recognition system for sign language [J].
Liang, RH ;
Ouhyoung, M .
AUTOMATIC FACE AND GESTURE RECOGNITION - THIRD IEEE INTERNATIONAL CONFERENCE PROCEEDINGS, 1998, :558-567
[7]  
MURAKAMI K, 1991, CHI 91 C P, P237, DOI DOI 10.1145/108844.108900
[8]   AN APPLICATION OF RECURRENT NETS TO PHONE PROBABILITY ESTIMATION [J].
ROBINSON, AJ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02) :298-305
[9]  
Rumelhart D.E., 1987, Parallel Distributed Processing: Explorations in the Microstructure of Cognition, P318
[10]  
Senior A, 1996, ADV NEUR IN, V8, P743