Audiovisual attention boosts letter-speech sound integration

被引：9

作者：

Mittag, Maria ^{[1
]}

Alho, Kimmo ^{[2
,3
]}

Takegata, Rika ^{[1
]}

Makkonen, Tommi ^{[1
,4
]}

Kujala, Teija ^{[1
,5
]}

机构：

[1] Univ Helsinki, Cognit Brain Res Unit, Inst Behav Sci, FIN-00014 Helsinki, Finland

[2] Univ Helsinki, Inst Behav Sci, Div Cognit Psychol & Neuropsychol, FIN-00014 Helsinki, Finland

[3] Univ Helsinki, Helsinki Coll Adv Studies, FIN-00014 Helsinki, Finland

[4] Univ Jyvaskyla, Finnish Ctr Excellence Interdisciplinary Mus Res, Jyvaskyla, Finland

[5] Univ Helsinki, Cicero Learning Network, FIN-00014 Helsinki, Finland

来源：

PSYCHOPHYSIOLOGY | 2013年 / 50卷 / 10期

基金：

芬兰科学院;

关键词：

Attention; Mismatch negativity (MMN); Letter-speech sound integration; Audiovisual; P3; EVENT-RELATED POTENTIALS; SELECTIVE-ATTENTION; INVOLUNTARY ATTENTION; MMN; DISCRIMINATION; DEVIANCE; STIMULI;

D O I：

10.1111/psyp.12085

中图分类号：

B84 [心理学];

学科分类号：

04 ; 0402 ;

摘要：

We studied attention effects on the integration of written and spoken syllables in fluent adult readers by using event-related brain potentials. Auditory consonant-vowel syllables, including consonant and frequency changes, were presented in synchrony with written syllables or their scrambled images. Participants responded to longer-duration auditory targets (auditory attention), longer-duration visual targets (visual attention), longer-duration auditory and visual targets (audiovisual attention), or counted backwards mentally. We found larger negative responses for spoken consonant changes when they were accompanied by written syllables than when they were accompanied by scrambled text. This effect occurred at an early latency (approximate to 140ms) during audiovisual attention and later (approximate to 200ms) during visual attention. Thus, audiovisual attention boosts the integration of speech sounds and letters.

引用

页码：1034 / 1044

页数：11

共 36 条

[1] INTERMODAL SELECTIVE ATTENTION .2. EFFECTS OF ATTENTIONAL LOAD ON PROCESSING OF AUDITORY AND VISUAL-STIMULI IN CENTRAL SPACE [J].

ALHO, K ;

WOODS, DL ;

ALGAZI, A ;

NAATANEN, R .

ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1992, 82 (05) :356-368

[2] Effects of involuntary auditory attention on visual task performance and brain activity [J].

Alho, K ;

Escera, C ;

Diaz, R ;

Yago, E ;

Serra, JM .

NEUROREPORT, 1997, 8 (15) :3233-3237

[3] A method for generating natural-sounding speech stimuli for cognitive brain research [J].

Alku, P ;

Tiitinen, H ;

Näätänen, R .

CLINICAL NEUROPHYSIOLOGY, 1999, 110 (08) :1329-1333

[4]

[Anonymous], 2012, Event-related potentials

[5] Is the auditory sensory memory sensitive to visual information? [J].

Besle, J ;

Fort, A ;

Giard, MH .

EXPERIMENTAL BRAIN RESEARCH, 2005, 166 (3-4) :337-344

[6] Audiovisual events in sensory memory [J].

Besle, Julien ;

Caclin, Anne ;

Mayet, Romaine ;

Delpuech, Claude ;

Lecaignard, Francoise ;

Giard, Marie-Helene ;

Morlet, Dominique .

JOURNAL OF PSYCHOPHYSIOLOGY, 2007, 21 (3-4) :231-238

[7] Task-irrelevant visual letters interact with the processing of speech sounds in heteromodal and unimodal cortex [J].

Blau, Vera ;

van Atteveldt, Nienke ;

Formisano, Elia ;

Goebel, Rainer ;

Blomert, Leo .

EUROPEAN JOURNAL OF NEUROSCIENCE, 2008, 28 (03) :500-509

[8] Human brain activity associated with audiovisual perception and attention [J].

Degerman, Alexander ;

Rinne, Teemu ;

Pekkola, Johanna ;

Autti, Taina ;

Jaaskelainen, Iiro P. ;

Sams, Mikko ;

Alho, Kimmo .

NEUROIMAGE, 2007, 34 (04) :1683-1691

[9] EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis [J].

Delorme, A ;

Makeig, S .

JOURNAL OF NEUROSCIENCE METHODS, 2004, 134 (01) :9-21

[10] Involuntary attention and distractibility as evaluated with event-related brain potentials [J].

Escera, C ;

Alho, K ;

Schröger, E ;

Winkler, I .

AUDIOLOGY AND NEURO-OTOLOGY, 2000, 5 (3-4) :151-166

← 1 2 3 4 →