Audio-visual speech perception is special

被引:90
作者
Tuomainen, J
Andersen, TS
Tiippana, K
Sams, M
机构
[1] Univ Technol, Lab Comp Engn, FIN-02015 Helsinki, Finland
[2] Turku Univ, Phonet Lab, FIN-20014 Turku, Finland
基金
芬兰科学院;
关键词
audio-visual speech perception; sine wave speech; selective attention; multisensory integration;
D O I
10.1016/j.cognition.2004.10.004
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
In face-to-face conversation speech is perceived by ear and eye. We studied the prerequisites of audio-visual speech perception by using perceptually ambiguous sine wave replicas of natural speech as auditory stimuli. When the subjects were not aware that the auditory stimuli were speech, they showed only negligible integration of auditory and visual stimuli. When the same subjects learned to perceive the same auditory stimuli as speech, they integrated the auditory and visual stimuli in a similar manner as natural speech. These results demonstrate the existence of a multisensory speech-specific mode of perception. (c) 2004 Elsevier B.V. All rights reserved.
引用
收藏
页码:B13 / B22
页数:10
相关论文
共 27 条
[1]  
[Anonymous], PRAAT SYSTEM DOING P
[2]   Crossmodal processing in the human brain: Insights from functional neuroimaging studies [J].
Calvert, GA .
CEREBRAL CORTEX, 2001, 11 (12) :1110-1123
[3]  
Duncan J., 1996, ATTENTION PERFORM, P549
[4]   Listeners do hear sounds, not tongues [J].
Fowler, CA .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1996, 99 (03) :1730-1741
[5]   Echoes of echoes? An episodic theory of lexical access [J].
Goldinger, SD .
PSYCHOLOGICAL REVIEW, 1998, 105 (02) :251-279
[6]   The use of visible speech cues for improving auditory detection of spoken sentences [J].
Grant, KW ;
Seitz, PF .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2000, 108 (03) :1197-1208
[7]   INTEGRATING SPEECH INFORMATION ACROSS TALKERS, GENDER, AND SENSORY MODALITY - FEMALE FACES AND MALE VOICES IN THE MCGURK EFFECT [J].
GREEN, KP ;
KUHL, PK ;
MELTZOFF, AN ;
STEVENS, EB .
PERCEPTION & PSYCHOPHYSICS, 1991, 50 (06) :524-536
[8]   Does audiovisual speech perception use information about facial configuration? [J].
Hietanen, JK ;
Manninen, P ;
Sams, M ;
Surakka, V .
EUROPEAN JOURNAL OF COGNITIVE PSYCHOLOGY, 2001, 13 (03) :395-407
[9]  
Jones J. A., 1997, Canadian Acoustics, V25, P13
[10]   'Putting the face to the voice': Matching identity across modality [J].
Kamachi, M ;
Hill, H ;
Lander, K ;
Vatikiotis-Bateson, E .
CURRENT BIOLOGY, 2003, 13 (19) :1709-1714