Assessing automaticity in audiovisual speech integration: evidence from the speeded classification task

被引:91
作者
Soto-Faraco, S [1 ]
Navarra, J [1 ]
Alsius, A [1 ]
机构
[1] Univ Barcelona, Dept Psicol Bas, SPPB Grp, E-08035 Barcelona, Spain
关键词
audiovisual speech; multisensory integration; McGurk illusion; attention; speeded discrimination;
D O I
10.1016/j.cognition.2003.10.005
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The McGurk effect is usually presented as an example of fast, automatic, multisensory integration. We report a series of experiments designed to directly assess these claims. We used a syllabic version of the speeded classification paradigm, whereby response latencies to the first (target) syllable of spoken word-like stimuli are slowed down when the second (irrelevant) syllable varies from trial to trial. This interference effect is interpreted as a failure of selective attention to filter out the irrelevant syllable. In Experiment 1 we reproduced the syllabic interference effect with bimodal stimuli containing auditory as well as visual lip movement information, thus confirming the generalizability of the phenomenon. In subsequent experiments we were able to produce (Experiment 2) and to eliminate (Experiment 3) syllabic interference by introducing 'illusory' (McGurk) audiovisual stimuli in the irrelevant syllable, suggesting that audiovisual integration occurs prior to attentional selection in this paradigm. (C) 2004 Elsevier B.V. All rights reserved.
引用
收藏
页码:B13 / B23
页数:11
相关论文
共 26 条
[1]   Activation of auditory cortex during silent lipreading [J].
Calvert, GA ;
Bullmore, ET ;
Brammer, MJ ;
Campbell, R ;
Williams, SCR ;
McGuire, PK ;
Woodruff, PWR ;
Iverson, SD ;
David, AS .
SCIENCE, 1997, 276 (5312) :593-596
[2]   Mismatch negativity evoked by the McGurk-MacDonald effect: a phonetic representation within short-term memory [J].
Colin, C ;
Radeau, M ;
Soquet, A ;
Demolin, D ;
Colin, F ;
Deltenre, P .
CLINICAL NEUROPHYSIOLOGY, 2002, 113 (04) :495-506
[3]   Multisensory integration, perception and ecological validity [J].
De Gelder, B ;
Bertelson, P .
TRENDS IN COGNITIVE SCIENCES, 2003, 7 (10) :460-467
[4]   Restricted attentional capacity within but not between sensory modalities [J].
Duncan, J ;
Martens, S ;
Ward, R .
NATURE, 1997, 387 (6635) :808-810
[5]   PERCEPTUAL DOMINANCE DURING LIPREADING [J].
EASTON, RD ;
BASALA, M .
PERCEPTION & PSYCHOPHYSICS, 1982, 32 (06) :562-570
[6]  
GARNER WR, 1974, PROCESSING INFORMATI
[7]   INTEGRAL PROCESSING OF VISUAL PLACE AND AUDITORY VOICING INFORMATION DURING PHONETIC PERCEPTION [J].
GREEN, KP ;
KUHL, PK .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 1991, 17 (01) :278-288
[8]   Attentional requirements in a 'preattentive' feature search task [J].
Joseph, JS ;
Chun, MM ;
Nakayama, K .
NATURE, 1997, 387 (6635) :805-807
[9]   THE MOTOR THEORY OF SPEECH-PERCEPTION REVISED [J].
LIBERMAN, AM ;
MATTINGLY, IG .
COGNITION, 1985, 21 (01) :1-36
[10]  
Maddox T., 1992, MULTIDIMENSIONAL MOD, P147