Audiovisual events in sensory memory

被引:13
作者
Besle, Julien [1 ]
Caclin, Anne [1 ]
Mayet, Romaine [1 ]
Delpuech, Claude [1 ,2 ]
Lecaignard, Francoise [2 ]
Giard, Marie-Helene [1 ]
Morlet, Dominique [1 ]
机构
[1] INSERM, U821, F-69008 Lyon, France
[2] CERMEP, Lyon, France
关键词
sensory memory; MMN; EEG; ERP; MEG; audiovisual; feature conjuction;
D O I
10.1027/0269-8803.21.34.231
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The functional properties of the auditory sensory memory have been extensively studied using the mismatch negativity (MMN) component of the auditory event-related potential (ERP) and its magnetic counterpart recorded using magneto-encephalography (MEG). It has been found that distinct auditory features (such as frequency or intensity) are encoded separately in sensory memory. Nevertheless, the conjunction of these features (auditory "gestalts") can also be encoded in auditory sensory memory. Here we investigated how auditory and visual features of bimodal events are represented in sensory memory by recording audiovisual MMNs in two different audiovisual oddball paradigms. The results of a first ERP experiment showed that the sensory memory representations of auditory and visual features of audiovisual events lie within the temporal and occipital cortex, respectively, yet with possible interactions between the processing of the unimodal features. In a subsequent MEG experiment, we found some evidence that audiovisual feature conjunctions could also be represented in sensory memory These results, thus, extend to the audiovisual domain a number of properties of sensory memory already established within the auditory system.
引用
收藏
页码:231 / 238
页数:8
相关论文
共 37 条
[1]  
[Anonymous], HDB MULTISENSORY PRO
[2]   Automatic visual bias of perceived auditory location [J].
Bertelson, P ;
Aschersleben, G .
PSYCHONOMIC BULLETIN & REVIEW, 1998, 5 (03) :482-489
[3]   Distraction effects in vision:: behavioral and event-related potential indices [J].
Berti, S ;
Schröger, E .
NEUROREPORT, 2004, 15 (04) :665-669
[4]   Is the auditory sensory memory sensitive to visual information? [J].
Besle, J ;
Fort, A ;
Giard, MH .
EXPERIMENTAL BRAIN RESEARCH, 2005, 166 (3-4) :337-344
[5]   Bimodal speech: early suppressive visual effects in human auditory cortex [J].
Besle, J ;
Fort, A ;
Delpuech, C ;
Giard, MH .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2004, 20 (08) :2225-2234
[6]   Separate neural processing of timbre dimensions in auditory sensory memory [J].
Caclin, Anne ;
Brattico, Elvira ;
Tervaniemi, Mari ;
Naatanen, Risto ;
Morlet, Dominique ;
Giard, Marie-Helene ;
McAdams, Stephen .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2006, 18 (12) :1959-1972
[7]  
Calvert G.A., 2004, HDB MULTISENSORY PRO
[8]   Generalization of the generation of an MMN by illusory McGurk percepts: voiceless consonants [J].
Colin, C ;
Radeau, M ;
Soquet, A ;
Deltenre, P .
CLINICAL NEUROPHYSIOLOGY, 2004, 115 (09) :1989-2000
[9]   Electrophysiology of spatial scene analysis: the mismatch negativity (MMN) is sensitive to the ventriloquism illusion [J].
Colin, C ;
Radeau, M ;
Soquet, A ;
Dachy, B ;
Deltenre, P .
CLINICAL NEUROPHYSIOLOGY, 2002, 113 (04) :507-518
[10]   Mismatch negativity evoked by the McGurk-MacDonald effect: a phonetic representation within short-term memory [J].
Colin, C ;
Radeau, M ;
Soquet, A ;
Demolin, D ;
Colin, F ;
Deltenre, P .
CLINICAL NEUROPHYSIOLOGY, 2002, 113 (04) :495-506