Fusion of audio and video information for multi modal person authentication

被引:94
作者
Duc, B [1 ]
Bigun, ES
Bigun, J
Maitre, G
Fischer, S
机构
[1] Swiss Fed Inst Technol, Signal Proc Lab, Lausanne, Switzerland
[2] Univ Stockholm, Dept Stat, Stockholm, Sweden
[3] Royal Inst Technol, Ctr Safety Res, S-10044 Stockholm, Sweden
[4] Swiss Fed Inst Technol, Microproc & Interface Lab, Lausanne, Switzerland
[5] IDIAP, Martigny, Switzerland
关键词
multimedia data analysis; decision fusion; Bayesian statistics; elastic graph matching; hidden Markov model;
D O I
10.1016/S0167-8655(97)00071-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 [模式识别与智能系统]; 0812 [计算机科学与技术]; 0835 [软件工程]; 1405 [智能科学与技术];
摘要
We present an algorithm functioning as a supervisor module in a multi-expert decision making machine. It uses the Bayes theory in order to estimate the biases of individual expert opinions. The biases are used to calibrate and conciliate expert opinions to a single decision. This supervision technique is applied to the real case of a person authentication technique using two modalities, face and speech. The visual part involves the matching of a coarse grid containing Gabor phase information from face images. The acoustic part is performed by a text-dependent speaker verification system based on Hidden Markov Models. Experimental results show that the proposed fusion method improves the quality of individual expert decisions by reaching success rates of 99.5%. (C) 1997 Elsevier Science B.V.
引用
收藏
页码:835 / 843
页数:9
相关论文
共 15 条
[1]
[Anonymous], 1982, Pattern recognition: A statistical approach
[2]
Bernardo M, 1994, BAYESIAN THEORY
[3]
BIGUN E, 1997, SAFETY RELIABILITY, P146
[4]
Risk analysis of catastrophes using experts' judgements: An empirical study on risk analysis of major civil aircraft accidents in Europe [J].
Bigun, ES .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1995, 87 (03) :599-612
[5]
N-FOLDED SYMMETRIES BY COMPLEX MOMENTS IN GABOR SPACE AND THEIR APPLICATION TO UNSUPERVISED TEXTURE SEGMENTATION [J].
BIGUN, J ;
DUBUF, JM .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1994, 16 (01) :80-87
[6]
PERSON IDENTIFICATION USING MULTIPLE CUES [J].
BRUNELLI, R ;
FALAVIGNA, D .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1995, 17 (10) :955-966
[7]
Dasarathy B.V., 1994, DECISION FUSION
[8]
DIECKMANN U, 1997, P 1 INT C AUD VID BA, V1206, P301
[9]
DUC B, 1997, P 1997 INT C AC SPEE
[10]
GENOUD D, 1995, CH1920 IDIAP