Multimodal contribution to speech perception revealed by independent component analysis: a single-sweep EEG case study

被引：71

作者：

Callan, DE

Callan, AM

Kroos, C

Vatikiotis-Bateson, E

机构：

[1] ATR, Human Informat Proc Res Labs, ATR Brain Act Imaging Ctr 1, Kyoto 6190288, Japan

[2] ATR, Human Informat Proc Res Labs, ATR Informat Sci Div, Kyoto 6190288, Japan

来源：

COGNITIVE BRAIN RESEARCH | 2001年 / 10卷 / 03期

关键词：

independent component analysis; single sweep; EEG; multimodal; speech; wavelet; audiovisual;

D O I：

10.1016/S0926-6410(00)00054-9

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this single-sweep electroencephalographic case study, independent component analysis (ICA) was used to investigate multimodal processes underlying the enhancement of speech intelligibility in noise (for monosyllabic English words) by visualizing facial motion concordant with the audio speech signal. Wavelet analysis of the single-sweep IC activation waveforms revealed increased high-frequency energy for two ICs underlying the visual enhancement effect. For one ICI current source density analysis localized activity mainly to the superior temporal gyrus, consistent with principles of multimodal integration. For the other IC, activity was distributed across multiple cortical areas perhaps reflecting global mappings underlying the visual enhancement effect. (C) 2001 Elsevier Science B.V. All rights reserved.

引用

页码：349 / 353

页数：5

共 27 条

[21] High-frequency brain activity: Its possible role in attention, perception and language processing [J].

Pulvermuller, F ;

Birbaumer, N ;

Lutzenberger, W ;

Mohr, B .

PROGRESS IN NEUROBIOLOGY, 1997, 52 (05) :427-445

[22] SEEING SPEECH - VISUAL INFORMATION FROM LIP MOVEMENTS MODIFIES ACTIVITY IN THE HUMAN AUDITORY-CORTEX [J].

SAMS, M ;

AULANKO, R ;

HAMALAINEN, M ;

HARI, R ;

LOUNASMAA, OV ;

LU, ST ;

SIMOLA, J .

NEUROSCIENCE LETTERS, 1991, 127 (01) :141-145

[23]

SINGER W, 1995, ANNU REV NEUROSCI, V18, P555, DOI 10.1146/annurev.ne.18.030195.003011

[24] Neuroscience - Storage and executive processes in the frontal lobes [J].

Smith, EE ;

Jonides, J .

SCIENCE, 1999, 283 (5408) :1657-1661

[25]

Stein Barry E., 1993, The Merging of the Senses. The Merging of the Senses. Cognitive Neuroscience

[26] VISUAL CONTRIBUTION TO SPEECH INTELLIGIBILITY IN NOISE [J].

SUMBY, WH ;

POLLACK, I .

JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1954, 26 (02) :212-215

[27] Oscillatory gamma activity in humans and its role in object representation [J].

Tallon-Baudry, C ;

Bertrand, O .

TRENDS IN COGNITIVE SCIENCES, 1999, 3 (04) :151-162

← 1 2 3 →