Human action recognition using shape and CLG-motion flow from multi-view image sequences

被引：88

作者：

Ahmad, Mohiuddin ^{[1
]}

Lee, Seong-Whan ^{[1
]}

机构：

[1] Korea Univ, Dept Comp Sci & Engn, Seoul 136713, South Korea

来源：

PATTERN RECOGNITION | 2008年 / 41卷 / 07期

关键词：

action recognition; action matrix; combined local-global (CLG) optic flow; invariant Zernike moments; multi-view image sequence; multidimensional hidden Markov model (MDHMM);

D O I：

10.1016/j.patcog.2007.12.008

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this paper, we present a method for human action recognition from multi-view image sequences that uses the combined motion and shape flow information with variability consideration. A combined local-global (CLG) optic flow is used to extract motion flow feature and invariant moments with flow deviations are used to extract the global shape flow feature from the image sequences. In our approach, human action is represented as a set of multidimensional CLG optic flow and shape flow feature vectors in the spatial-temporal action boundary. Actions are modeled by using a set of multidimensional HMMs for multiple views using the combined features, which enforce robust view-invariant operation. We recognize different human actions in daily life successfully in the indoor and outdoor environment using the maximum likelihood estimation approach. The results suggest robustness of the proposed method with respect to Multiple views action recognition, scale and phase variations, and invariant analysis of silhouettes. (c) 2007 Elsevier Ltd. All rights reserved.

引用

页码：2237 / 2252

页数：16

共 45 条

[1] Human motion analysis: A review [J].

Aggarwal, JK ;

Cai, Q .

COMPUTER VISION AND IMAGE UNDERSTANDING, 1999, 73 (03) :428-440

[2]

Ahmad M, 2006, INT C PATT RECOG, P263

[3] Segmentation and recognition of continuous human activity [J].

Ali, A ;

Aggarwal, JK .

IEEE WORKSHOP ON DETECTION AND RECOGNITION OF EVENTS IN VIDEO, PROCEEDINGS, 2001, :28-35

[4] Compressed domain action classification using HMM [J].

Babu, RV ;

Anantharaman, B ;

Ramakrishnan, KR ;

Srinivasan, SH .

PATTERN RECOGNITION LETTERS, 2002, 23 (10) :1203-1213

[5] Human activity recognition using multidimensional indexing [J].

Ben-Arie, J ;

Wang, ZQ ;

Pandit, P ;

Rajaram, S .

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (08) :1091-1104

[6] The recognition of human movement using temporal templates [J].

Bobick, AF ;

Davis, JW .

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (03) :257-267

[7] Coupled hidden Markov models for complex action recognition [J].

Brand, M ;

Oliver, N ;

Pentland, A .

1997 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1997, :994-999

[8] Learning and recognizing human dynamics in video sequences [J].

Bregler, C .

1997 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1997, :568-574

[9] Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods [J].

Bruhn A. ;

Weickert J. ;

Schnörr C. .

International Journal of Computer Vision, 2005, 61 (3) :1-21

[10]

BUNKE H, 2001, HMMS APPL COMPUTER V

← 1 2 3 4 5 →