Attention and the multiple stages of multisensory integration: A review of audiovisual studies

被引:240
作者
Koelewijn, Thomas [1 ,2 ]
Bronkhorst, Adelbert [2 ,3 ]
Theeuwes, Jan [2 ]
机构
[1] Vrije Univ Amsterdam Med Ctr, ENT Audiol, NL-1081 HV Amsterdam, Netherlands
[2] Vrije Univ Amsterdam, Amsterdam, Netherlands
[3] TNO Human Factors, Soesterberg, Netherlands
关键词
Multisensory integration; Crossmodal; Attention; Audiovisual; SUPERIOR TEMPORAL SULCUS; EXOGENOUS SPATIAL ATTENTION; LATERAL INTRAPARIETAL AREA; ABRUPT VISUAL ONSETS; ILLUSORY LINE MOTION; CROSS-MODAL LINKS; SELECTIVE ATTENTION; STIMULUS-DRIVEN; REACTION-TIME; HUMAN BRAIN;
D O I
10.1016/j.actpsy.2010.03.010
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Multisensory integration and crossmodal attention have a large impact on how we perceive the world. Therefore, it is important to know under what circumstances these processes take place and how they affect our performance. So far, no consensus has been reached on whether multisensory integration and crossmodal attention operate independently and whether they represent truly automatic processes. This review describes the constraints under which multisensory integration and crossmodal attention occur and in what brain areas these processes take place. Some studies suggest that multisensory integration and crossmodal attention take place in higher heteromodal brain areas, while others show the involvement of early sensory specific areas. Additionally, the current literature suggests that multisensory integration and attention interact depending on what processing level integration takes place. To shed light on this issue, different frameworks regarding the level at which multisensory interactions takes place are discussed. Finally, this review focuses on the question whether audiovisual interactions and crossmodal attention in particular are automatic processes. Recent studies suggest that this is not always the case. Overall, this review provides evidence for a parallel processing framework suggesting that both multisensory integration and attentional processes take place and can interact at multiple stages in the brain. (C) 2010 Elsevier B.V. All rights reserved.
引用
收藏
页码:372 / 384
页数:13
相关论文
共 136 条
[81]   Increased structural connectivity in grapheme-color synesthesia [J].
Rouw, Romke ;
Scholte, H. Steven .
NATURE NEUROSCIENCE, 2007, 10 (06) :792-797
[82]   Is the exogenous orienting of spatial attention truly automatic? Evidence from unimodal and multisensory studies [J].
Santangelo, Valerio ;
Spence, Charles .
CONSCIOUSNESS AND COGNITION, 2008, 17 (03) :989-1015
[83]   Capturing spatial attention with multisensory cues [J].
Santangelo, Valerio ;
Ho, Cristy ;
Spence, Charles .
PSYCHONOMIC BULLETIN & REVIEW, 2008, 15 (02) :398-403
[84]   Multisensory integration affects ERP components elicited by exogenous cues [J].
Santangelo, Valerio ;
Van der Lubbe, Rob H. J. ;
Belardinelli, Marta Olivetti ;
Postma, Albert .
EXPERIMENTAL BRAIN RESEARCH, 2008, 185 (02) :269-277
[85]   Multisensory cues capture spatial attention regardless of perceptual load [J].
Santangelo, Valerio ;
Spence, Charles .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2007, 33 (06) :1311-1321
[86]   The suppression of reflexive visual and auditory orienting when attention is otherwise engaged [J].
Santangelo, Valerio ;
Belardinelli, Marta Olivetti .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2007, 33 (01) :137-148
[87]   Spatial attention triggered by unimodal, crossmodal, and bimodal exogenous cues: a comparison of reflexive orienting mechanisms [J].
Santangelo, Valerio ;
Van der Lubbe, Rob H. J. ;
Belardinelli, Marta Olivetti ;
Postma, Albert .
EXPERIMENTAL BRAIN RESEARCH, 2006, 173 (01) :40-48
[88]   Endogenous attention and illusory line motion reexamined [J].
Schmidt, WC .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2000, 26 (03) :980-996
[89]   Look who's talking: The deployment of visuo-spatial attention during multisensory speech processing under noisy environmental conditions [J].
Senkowski, Daniel ;
Saint-Amour, Dave ;
Gruber, Thomas ;
Foxe, John J. .
NEUROIMAGE, 2008, 43 (02) :379-387
[90]   Illusions - What you see is what you hear [J].
Shams, L ;
Kamitani, Y ;
Shimojo, S .
NATURE, 2000, 408 (6814) :788-788