Looking at the viewer: analysing facial activity to detect personal highlights of multimedia contents

被引：59

作者：

Joho, Hideo ^{[2
]}

Staiano, Jacopo ^{[1
]}

Sebe, Nicu ^{[1
]}

Jose, Joemon M. ^{[3
]}

机构：

[1] Univ Trent, Dept Informat Engn & Comp Sci, I-38100 Trento, Italy

[2] Univ Tsukuba, Dept Lib Informat & Media Studies, Tsukuba, Ibaraki 3058550, Japan

[3] Univ Glasgow, Sch Comp Sci, Glasgow G12 8QQ, Lanark, Scotland

来源：

MULTIMEDIA TOOLS AND APPLICATIONS | 2011年 / 51卷 / 02期

关键词：

Facial activity; Facial expression; Affective summarization; MODELS; CLASSIFIERS; RETRIEVAL; FRAMEWORK;

D O I：

10.1007/s11042-010-0632-x

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

This paper presents an approach to detect personal highlights in videos based on the analysis of facial activities of the viewer. Our facial activity analysis was based on the motion vectors tracked on twelve key points in the human face. In our approach, the magnitude of the motion vectors represented a degree of a viewer's affective reaction to video contents. We examined 80 facial activity videos recorded for ten participants, each watching eight video clips in various genres. The experimental results suggest that useful motion vectors to detect personal highlights varied significantly across viewers. However, it was suggested that the activity in the upper part of face tended to be more indicative of personal highlights than the activity in the lower part.

引用

页码：505 / 523

页数：19

共 31 条

[1]

[Anonymous], 2000, THESIS U ILLINOIS UR

[2]

ARIFIN S, 2007, ACM INT C MULT

[3] Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications [J].

Calvo, Rafael A. ;

D'Mello, Sidney .

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2010, 1 (01) :18-37

[4]

CHEON Y, 2009, PATTERN RECOGN, V42, P260

[5]

Ching Hau Chan, 2005, 13th Annual ACM International Conference on Multimedia, P427, DOI 10.1145/1101149.1101243

[6] Semisupervised learning of classifiers: Theory, algorithms, and their application to human-computer interaction [J].

Cohen, I ;

Cozman, FG ;

Sebe, N ;

Cirelo, MC ;

Huang, TS .

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (12) :1553-1567

[7] Facial expression recognition from video sequences: temporal and static modeling [J].

Cohen, I ;

Sebe, N ;

Garg, A ;

Chen, LS ;

Huang, TS .

COMPUTER VISION AND IMAGE UNDERSTANDING, 2003, 91 (1-2) :160-187

[8]

DIETZ R, 1999, COGN TECHN C

[9]

Ekman P., 1978, Facial action coding system: a technique for the measurement of facial movement

[10] Extracting moods from pictures and sounds [J].

Hanjalic, A .

IEEE SIGNAL PROCESSING MAGAZINE, 2006, 23 (02) :90-100

← 1 2 3 4 →