No direction-specific bimodal facilitation for audiovisual motion detection

被引:96
作者
Alais, D [1 ]
Burr, D [1 ]
机构
[1] CNR, Ist Neurofisiol, I-56125 Pisa, Italy
来源
COGNITIVE BRAIN RESEARCH | 2004年 / 19卷 / 02期
关键词
visual psychophysics; auditory psychophysics; motion detection; crossmodal interaction; bimodal; audiovisual;
D O I
10.1016/j.cogbrainres.2003.11.011
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
After several decades of unimodal perceptual research, interest is turning increasingly to cross-modal interactions. At a physiological level, the existence of bimodal cells is well documented and it is known that correlated audiovisual input enhances localisation and orienting behaviours. Audiovisual perceptual interactions have also been demonstrated (e.g., the well-known McGurk effect). The present study explores motion perception and asks whether correlated audiovisual motion signals would be better detected than unimodal motions or bimodal motions in opposing directions. Using a dynamic random-dot field with variable motion coherence as a visual stimulus, together with an auditory motion defined by a stereo noise source smoothly translating along a horizontal trajectory, we find that correlated bimodal motion yields only a slight improvement (approximately a square root of two advantage) in detection threshold relative to unimodal detection. The size of this benefit is consistent with a statistical advantage rather than a bimodal facilitation account. Moreover, anticorrelated bimodal motion showed the same modest improvement, again speaking against linear summation but consistent with statistical combination of visual and auditory signals. These findings were replicated in peripheral as well as in central vision, and with translating visual objects as well as with spatially distributed visual motion. The superadditivity observed neurally (especially in deep-layer superior collicular cells), when weak unimodal signals are combined in bimodal cells does not apply to the detection of linear translational motion. (C) 2004 Elsevier B.V. All rights reserved.
引用
收藏
页码:185 / 194
页数:10
相关论文
共 40 条
[1]   COMMON AUDITORY-VISUAL SPACE - EVIDENCE FOR ITS REALITY [J].
AUERBACH, C ;
SPERLING, P .
PERCEPTION & PSYCHOPHYSICS, 1974, 16 (01) :129-135
[2]   A relationship between behavioral choice and the visual responses of neurons in macaque MT [J].
Britten, KH ;
Newsome, WT ;
Shadlen, MN ;
Celebrini, S ;
Movshon, JA .
VISUAL NEUROSCIENCE, 1996, 13 (01) :87-100
[3]  
BRITTEN KH, 1992, J NEUROSCI, V12, P4745
[4]  
CARLILE S, 1996, AUDITORY SPACE GEN A
[5]   VENTRAL INTRAPARIETAL AREA OF THE MACAQUE - ANATOMIC LOCATION AND VISUAL RESPONSE PROPERTIES [J].
COLBY, CL ;
DUHAMEL, JR ;
GOLDBERG, ME .
JOURNAL OF NEUROPHYSIOLOGY, 1993, 69 (03) :902-914
[6]  
DESIMONE R, 1990, COLD SH Q B, V55, P963
[7]   Humans integrate visual and haptic information in a statistically optimal fashion [J].
Ernst, MO ;
Banks, MS .
NATURE, 2002, 415 (6870) :429-433
[8]   SPATIAL AND TEMPORAL FACTORS DETERMINE AUDITORY-VISUAL INTERACTIONS IN HUMAN SACCADIC EYE-MOVEMENTS [J].
FRENS, MA ;
VANOPSTAL, AJ ;
VANDERWILLIGEN, RF .
PERCEPTION & PSYCHOPHYSICS, 1995, 57 (06) :802-816
[9]   A system of multimodal areas in the primate brain [J].
Graziano, MSA .
NEURON, 2001, 29 (01) :4-6
[10]   Combining sensory information: Mandatory fusion within, but not between, senses [J].
Hillis, JM ;
Ernst, MO ;
Banks, MS ;
Landy, MS .
SCIENCE, 2002, 298 (5598) :1627-1630