VISUAL INFLUENCES ON AUDITORY PLUCK AND BOW JUDGMENTS

被引:74
作者
SALDANA, HM [1 ]
ROSENBLUM, LD [1 ]
机构
[1] UNIV CALIF RIVERSIDE,DEPT PSYCHOL,RIVERSIDE,CA 92521
来源
PERCEPTION & PSYCHOPHYSICS | 1993年 / 54卷 / 03期
关键词
D O I
10.3758/BF03205276
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
In the McGurk effect, visual information specifying a speaker's articulatory movements can influence auditory judgments of speech. In the present study, we attempted to find an analogue of the McGurk effect by using nonspeech stimuli-the discrepant audiovisual tokens of plucks and bows on a cello. The results of an initial experiment revealed that subjects' auditory judgments were influenced significantly by the visual pluck and bow stimuli. However, a second experiment in which speech syllables were used demonstrated that the visual influence on consonants was significantly greater than the visual influence observed for pluck-bow stimuli. This result could be interpreted to suggest that the nonspeech visual influence was not a true McGurk effect. In a third experiment, visual stimuli consisting of the words pluck and bow were found to have no influence over auditory pluck and bow judgments. This result could suggest that the nonspeech effects found in Experiment 1 were based on the audio and visual information's having an ostensive lawful relation to the specified event. These results are discussed in terms of motor-theory, ecological, and FLMP approaches to speech perception.
引用
收藏
页码:406 / 416
页数:11
相关论文
共 43 条
[1]   VOWELS, CONSONANTS, SPEECH, AND NON-SPEECH [J].
ADES, AE .
PSYCHOLOGICAL REVIEW, 1977, 84 (06) :524-530
[2]   EFFECT OF DEGREE OF SEPARATION OF VISUAL-AUDITORY STIMULUS AND EYE POSITION UPON SPATIAL INTERACTION OF VISION AND AUDITION [J].
BERMANT, RI ;
WELCH, RB .
PERCEPTUAL AND MOTOR SKILLS, 1976, 43 (02) :487-493
[3]   VENTRILOQUIST EFFECT - VISUAL DOMINANCE OR RESPONSE BIAS [J].
CHOE, CS ;
WELCH, RB ;
GILFORD, RM ;
JUOLA, JF .
PERCEPTION & PSYCHOPHYSICS, 1975, 18 (01) :55-60
[4]  
COHEN MM, 1993, UNPUB PERCEIVING VIS
[5]   CATEGORIES AND BOUNDARIES IN SPEECH AND MUSIC [J].
CUTTING, JE ;
ROSNER, BS .
PERCEPTION & PSYCHOPHYSICS, 1974, 16 (03) :564-570
[6]   PLUCKS AND BOWS ARE CATEGORICALLY PERCEIVED, SOMETIMES [J].
CUTTING, JE .
PERCEPTION & PSYCHOPHYSICS, 1982, 31 (05) :462-476
[7]   PERCEPTUAL CATEGORIES FOR MUSIC-LIKE SOUNDS - IMPLICATIONS FOR THEORIES OF SPEECH-PERCEPTION [J].
CUTTING, JE ;
ROSNER, BS ;
FOARD, CF .
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1976, 28 (AUG) :361-378
[8]   QUANTITATIVE CONFIRMATION OF VISUAL CAPTURE OF CURVATURE [J].
EASTON, RD ;
MORAN, PW .
JOURNAL OF GENERAL PSYCHOLOGY, 1978, 98 (01) :105-112
[9]  
FOWLER CA, 1991, MODULARITY AND THE MOTOR THEORY OF SPEECH PERCEPTION, P33
[10]   LISTENING WITH EYE AND HAND - CROSS-MODAL CONTRIBUTIONS TO SPEECH-PERCEPTION [J].
FOWLER, CA ;
DEKLE, DJ .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 1991, 17 (03) :816-828