Vision and touch are automatically integrated for the perception of sequences of events

被引:121
作者
Bresciani, Jean-Pierre [1 ]
Dammeier, Franziska [1 ]
Ernst, Marc O. [1 ]
机构
[1] Max Planck Inst Biol Cybernet, Tubingen, Germany
来源
JOURNAL OF VISION | 2006年 / 6卷 / 05期
关键词
tactile; visual; multimodal interaction; illusions; sensory systems; Bayesian integration;
D O I
10.1167/6.5.2
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
The purpose of the present experiment was to investigate the integration of sequences of visual and tactile events. Subjects were presented with sequences of visual. ashes and tactile taps simultaneously and instructed to count either the. ashes ( Session 1) or the taps ( Session 2). The number of. ashes could differ from the number of taps by +/-1. For both sessions, the perceived number of events was significantly influenced by the number of events presented in the task-irrelevant modality. Touch had a stronger influence on vision than vision on touch. Interestingly, touch was the more reliable of the two modalities-less variable estimates when presented alone. For both sessions, the perceptual estimates were less variable when stimuli were presented in both modalities than when the task-relevant modality was presented alone. These results indicate that even when one signal is explicitly task irrelevant, sensory information tends to be automatically integrated across modalities. They also suggest that the relative weight of each sensory channel in the integration process depends on its relative reliability. The results are described using a Bayesian probabilistic model for multimodal integration that accounts for the coupling between the sensory estimates.
引用
收藏
页码:554 / 564
页数:11
相关论文
共 30 条
[1]   The ventriloquist effect results from near-optimal bimodal integration [J].
Alais, D ;
Burr, D .
CURRENT BIOLOGY, 2004, 14 (03) :257-262
[2]   Maximum Likelihood Integration of rapid flashes and beeps [J].
Andersen, TS ;
Tiippana, K ;
Sams, M .
NEUROSCIENCE LETTERS, 2005, 380 (1-2) :155-160
[3]   EFFECT OF DEGREE OF SEPARATION OF VISUAL-AUDITORY STIMULUS AND EYE POSITION UPON SPATIAL INTERACTION OF VISION AND AUDITION [J].
BERMANT, RI ;
WELCH, RB .
PERCEPTUAL AND MOTOR SKILLS, 1976, 43 (02) :487-493
[4]   EFFECTS OF AN AUDITORY SIGNAL ON VISUAL REACTION TIME [J].
BERNSTEIN, IH ;
CLARK, MH ;
EDELSTEIN, BA .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1969, 80 (3P1) :567-+
[5]   CROSS-MODAL BIAS AND PERCEPTUAL FUSION WITH AUDITORY-VISUAL SPATIAL DISCORDANCE [J].
BERTELSON, P ;
RADEAU, M .
PERCEPTION & PSYCHOPHYSICS, 1981, 29 (06) :578-584
[6]   Feeling what you hear: auditory signals can modulate tactile tap perception [J].
Bresciani, JP ;
Ernst, MO ;
Drewing, K ;
Bouyer, G ;
Maury, V ;
Kheddar, A .
EXPERIMENTAL BRAIN RESEARCH, 2005, 162 (02) :172-180
[7]   Multisensory integration, perception and ecological validity [J].
De Gelder, B ;
Bertelson, P .
TRENDS IN COGNITIVE SCIENCES, 2003, 7 (10) :460-467
[8]  
Ernst M. O., 2005, PERCEPTION HUMAN BOD, P105
[9]   Humans integrate visual and haptic information in a statistically optimal fashion [J].
Ernst, MO ;
Banks, MS .
NATURE, 2002, 415 (6870) :429-433
[10]   Merging the senses into a robust percept [J].
Ernst, MO ;
Bülthoff, HH .
TRENDS IN COGNITIVE SCIENCES, 2004, 8 (04) :162-169