Automatic location and tracking of the facial region in color video sequences

被引:47
作者
Herodotou, N
Plataniotis, KN
Venetsanopoulos, AN
机构
[1] Univ Toronto, Dept Elect & Comp Engn, Toronto, ON M5S 3G4, Canada
[2] Ryerson Polytech Univ, Dept Math Phys & Comp Sci, Toronto, ON M5B 2K3, Canada
关键词
face localization and tracking; color image segmentation; video processing; facial features; fuzzy membership functions;
D O I
10.1016/S0923-5965(98)00018-6
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A novel technique is introduced to locate and track the facial area in videophone-type sequences. The proposed method essentially consists of two components: (i) a color processing unit, and (ii) a knowledge-based shape and color analysis module. The color processing component utilizes the distribution of skin-tones in the HSV color space to obtain an initial set of candidate regions or objects. The second component in the segmentation scheme, that is, the shape and color analysis module is used to correctly identify and select the facial region in the case where more than one object has been extracted. A number of fuzzy membership functions are devised to provide information about each object's shape, orientation, location and average hue. An aggregation operator finally combines these measures and correctly selects the facial area. The suggested approach is robust with regard to different skin types, and various types of object or background motion within the scene. Furthermore, the algorithm can be implemented at a low computational complexity due to the binary nature of the operations involved. Experimental results are presented for a series of CIF and QCIF video sequences. (C) 1999 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:359 / 388
页数:30
相关论文
共 32 条
[1]  
[Anonymous], IMAGE COMMUN
[2]  
BRUNELLI R, 1993, IEEE T PATTERN ANAL, V15
[3]   CLUSTERING OF MULTIDIMENSIONAL PICTORIAL DATA [J].
BRYANT, J .
PATTERN RECOGNITION, 1979, 11 (02) :115-125
[4]   HISTOGRAM ANALYSIS USING A SCALE-SPACE APPROACH [J].
CARLOTTO, MJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1987, 9 (01) :121-129
[5]   MPEG and multimedia communications [J].
Chiariglione, L .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 1997, 7 (01) :5-18
[6]   AUTOMATIC FACE LOCATION DETECTION FOR MODEL-ASSISTED RATE CONTROL IN H.261-COMPATIBLE CODING OF VIDEO [J].
ELEFTHERIADIS, A ;
JACQUIN, A .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 1995, 7 (4-6) :435-455
[7]  
Evans R.M., 1948, INTRO COLOR
[8]  
Foley J. D., 1990, Computer Graphics, Principles and Practice, V2nd
[9]   DETECTION OF REGIONS MATCHING SPECIFIED CHROMATIC FEATURES [J].
GONG, YH ;
SAKAUCHI, M .
COMPUTER VISION AND IMAGE UNDERSTANDING, 1995, 61 (02) :263-269
[10]  
HERODOTOU N, 1997, 13 INT C DIG SIGN PR