Attention and the multiple stages of multisensory integration: A review of audiovisual studies

被引:240
作者
Koelewijn, Thomas [1 ,2 ]
Bronkhorst, Adelbert [2 ,3 ]
Theeuwes, Jan [2 ]
机构
[1] Vrije Univ Amsterdam Med Ctr, ENT Audiol, NL-1081 HV Amsterdam, Netherlands
[2] Vrije Univ Amsterdam, Amsterdam, Netherlands
[3] TNO Human Factors, Soesterberg, Netherlands
关键词
Multisensory integration; Crossmodal; Attention; Audiovisual; SUPERIOR TEMPORAL SULCUS; EXOGENOUS SPATIAL ATTENTION; LATERAL INTRAPARIETAL AREA; ABRUPT VISUAL ONSETS; ILLUSORY LINE MOTION; CROSS-MODAL LINKS; SELECTIVE ATTENTION; STIMULUS-DRIVEN; REACTION-TIME; HUMAN BRAIN;
D O I
10.1016/j.actpsy.2010.03.010
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Multisensory integration and crossmodal attention have a large impact on how we perceive the world. Therefore, it is important to know under what circumstances these processes take place and how they affect our performance. So far, no consensus has been reached on whether multisensory integration and crossmodal attention operate independently and whether they represent truly automatic processes. This review describes the constraints under which multisensory integration and crossmodal attention occur and in what brain areas these processes take place. Some studies suggest that multisensory integration and crossmodal attention take place in higher heteromodal brain areas, while others show the involvement of early sensory specific areas. Additionally, the current literature suggests that multisensory integration and attention interact depending on what processing level integration takes place. To shed light on this issue, different frameworks regarding the level at which multisensory interactions takes place are discussed. Finally, this review focuses on the question whether audiovisual interactions and crossmodal attention in particular are automatic processes. Recent studies suggest that this is not always the case. Overall, this review provides evidence for a parallel processing framework suggesting that both multisensory integration and attentional processes take place and can interact at multiple stages in the brain. (C) 2010 Elsevier B.V. All rights reserved.
引用
收藏
页码:372 / 384
页数:13
相关论文
共 136 条
[1]   Separate attentional resources for vision and audition [J].
Alais, D ;
Morrone, C ;
Burr, D .
PROCEEDINGS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2006, 273 (1592) :1339-1345
[2]  
[Anonymous], 1981, Attention and Performance, DOI DOI 10.1037/0096-1523.29.5.835
[3]   HEARING WORDS AND SEEING COLORS - AN EXPERIMENTAL INVESTIGATION OF A CASE OF SYNESTHESIA [J].
BARONCOHEN, S ;
WYKE, MA ;
BINNIE, C .
PERCEPTION, 1987, 16 (06) :761-767
[4]   Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions [J].
Barraclough, NE ;
Xiao, DK ;
Baker, CI ;
Oram, MW ;
Perrett, DI .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2005, 17 (03) :377-391
[5]   AUDITORY-VISUAL INTERACTION IN SINGLE CELLS IN CORTEX OF SUPERIOR TEMPORAL SULCUS AND ORBITAL FRONTAL CORTEX OF MACAQUE MONKEY [J].
BENEVENTO, LA ;
FALLON, J ;
DAVIS, BJ ;
REZAK, M .
EXPERIMENTAL NEUROLOGY, 1977, 57 (03) :849-872
[6]   EFFECTS OF SOME VARIATIONS IN AUDITORY INPUT UPON VISUAL CHOICE REACTION TIME [J].
BERNSTEIN, IH ;
EDELSTEIN, BA .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1971, 87 (02) :241-+
[7]   ''Acoustical vision'' of below threshold stimuli:: interaction among spatially converging audiovisual inputs [J].
Bolognini, N ;
Frassinetti, F ;
Serino, A ;
Ládavas, E .
EXPERIMENTAL BRAIN RESEARCH, 2005, 160 (03) :273-282
[8]   TASK COMBINATION AND SELECTIVE INTAKE OF INFORMATION [J].
BROADBENT, DE .
ACTA PSYCHOLOGICA, 1982, 50 (03) :253-290
[9]   VISUAL PROPERTIES OF NEURONS IN A POLYSENSORY AREA IN SUPERIOR TEMPORAL SULCUS OF THE MACAQUE [J].
BRUCE, C ;
DESIMONE, R ;
GROSS, CG .
JOURNAL OF NEUROPHYSIOLOGY, 1981, 46 (02) :369-384
[10]   The spread of attention across modalities and space in a multisensory object [J].
Busse, L ;
Roberts, KC ;
Crist, RE ;
Weissman, DH ;
Woldorff, MG .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2005, 102 (51) :18751-18756