Early modulation of visual cortex by sound: an MEG study

被引:104
作者
Shams, L [1 ]
Iwaki, S
Chawla, A
Bhattacharya, J
机构
[1] Univ Calif Los Angeles, Dept Psychol, Los Angeles, CA 90095 USA
[2] CALTECH, Div Biol, Pasadena, CA 91125 USA
[3] Natl Inst Adv Ind Sci & Technol, Ikeda, Osaka 5638577, Japan
[4] Austrian Acad Sci, Commiss Sci Visualizat, A-1220 Vienna, Austria
关键词
multisensory integration; sound-induced flash illusion; auditory-visual interactions; multisensory perception; MEG; cross-modal interactions;
D O I
10.1016/j.neulet.2004.12.035
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Sound can alter visual perception. This has been recently demonstrated by a strong illusion in which a single flash is perceived as multiple flashes when accompanied by multiple brief sounds. While psychophysical findings on this sound-induced flash illusion indicate that the modulations of visual percept by sound occur at a perceptual processing level, it remains unclear at what level of perceptual processing these interactions occur and what mechanisms mediate them. Here we investigated these questions using MEG. We found modulation of activity in occipital and parietal scalp locations, when comparing illusion trials with visual-alone and auditory-alone trials. This modulation occurred as early as 35-65 ms from the onset of the visual stimulus. Activity was also modulated in the occipital and parietal areas as well as anterior areas at a later (similar to 150 ms post-stimulus) onset. No significant interactions were observed in occipital and parietal areas in trials in which illusion was not perceived. These results indicate that the auditory alteration of visual perception as reflected by the illusion is associated with modulation of activity in visual cortex. The early onset of these modulations suggests that a feed-forward or lateral circuitry is at least partially involved in these interactions. (c) 2004 Elsevier Ireland Ltd. All rights reserved.
引用
收藏
页码:76 / 81
页数:6
相关论文
共 46 条
[1]   Visuo-haptic object-related activation in the ventral visual pathway [J].
Amedi, A ;
Malach, R ;
Hendler, T ;
Peled, S ;
Zohary, E .
NATURE NEUROSCIENCE, 2001, 4 (03) :324-330
[2]   Electrical activity in visual cortex associated with combined auditory and visual stimulation in temporal sequences known to be associated with a visual illusion [J].
Arden, GB ;
Wolf, JE ;
Messiter, C .
VISION RESEARCH, 2003, 43 (23) :2469-2478
[3]   Sound-induced illusory flash perception: role of gamma band responses [J].
Bhattacharya, J ;
Shams, L ;
Shimojo, S .
NEUROREPORT, 2002, 13 (14) :1727-1730
[4]  
CALVERT G, 2004, J PHYSL, V1, P191
[5]   Response amplification in sensory-specific cortices during crossmodal binding [J].
Calvert, GA ;
Brammer, MJ ;
Bullmore, ET ;
Campbell, R ;
Iversen, SD ;
David, AS .
NEUROREPORT, 1999, 10 (12) :2619-2623
[6]   Activation of auditory cortex during silent lipreading [J].
Calvert, GA ;
Bullmore, ET ;
Brammer, MJ ;
Campbell, R ;
Williams, SCR ;
McGuire, PK ;
Woodruff, PWR ;
Iverson, SD ;
David, AS .
SCIENCE, 1997, 276 (5312) :593-596
[7]   Crossmodal attention [J].
Driver, J ;
Spence, C .
CURRENT OPINION IN NEUROBIOLOGY, 1998, 8 (02) :245-253
[8]   Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading [J].
Driver, J .
NATURE, 1996, 381 (6577) :66-68
[9]   Humans integrate visual and haptic information in a statistically optimal fashion [J].
Ernst, MO ;
Banks, MS .
NATURE, 2002, 415 (6870) :429-433
[10]  
Falchier A, 2002, J NEUROSCI, V22, P5749