Multimodal contribution to speech perception revealed by independent component analysis: a single-sweep EEG case study

被引：71

作者：

Callan, DE

Callan, AM

Kroos, C

Vatikiotis-Bateson, E

机构：

[1] ATR, Human Informat Proc Res Labs, ATR Brain Act Imaging Ctr 1, Kyoto 6190288, Japan

[2] ATR, Human Informat Proc Res Labs, ATR Informat Sci Div, Kyoto 6190288, Japan

来源：

COGNITIVE BRAIN RESEARCH | 2001年 / 10卷 / 03期

关键词：

independent component analysis; single sweep; EEG; multimodal; speech; wavelet; audiovisual;

D O I：

10.1016/S0926-6410(00)00054-9

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this single-sweep electroencephalographic case study, independent component analysis (ICA) was used to investigate multimodal processes underlying the enhancement of speech intelligibility in noise (for monosyllabic English words) by visualizing facial motion concordant with the audio speech signal. Wavelet analysis of the single-sweep IC activation waveforms revealed increased high-frequency energy for two ICs underlying the visual enhancement effect. For one ICI current source density analysis localized activity mainly to the superior temporal gyrus, consistent with principles of multimodal integration. For the other IC, activity was distributed across multiple cortical areas perhaps reflecting global mappings underlying the visual enhancement effect. (C) 2001 Elsevier Science B.V. All rights reserved.

引用

页码：349 / 353

页数：5

共 27 条

[1] EFFECTS OF BISENSORY STIMULATION ON REACTION-TIME AND EVOKED CORTICAL POTENTIAL [J].