Spatial and linguistic aspects of visual imagery in sentence comprehension

被引:150
作者
Bergen, Benjamin K.
Lindsay, Shane
Matlock, Teenie
Narayanan, Srini
机构
[1] Univ Hawaii, Dept Linguist, Honolulu, HI 96822 USA
[2] Univ Sussex, Dept Psychol, Brighton BN1 9RH, E Sussex, England
[3] Univ California Merced, Dept Cognit Sci, Merced, CA 95344 USA
[4] Int Comp Sci Inst, Berkeley, CA 94704 USA
关键词
linguistics; psychology; communication; language understanding; mental simulation; perception; semantics; human experimentation; spatial cognition; abstract concepts;
D O I
10.1080/03640210701530748
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
There is mounting evidence that language comprehension involves the activation of mental imagery of the content of utterances (Barsalou, 1999; Bergen, Chang, & Narayan, 2004; Bergen, Narayan, & Feldman, 2003; Narayan, Bergen, & Weinberg, 2004; Richardson, Spivey, McRae, & Barsalou, 2003; Stanfield & Zwaan, 2001; Zwaan, Stanfield, & Yaxley, 2002). This imagery can have motor or perceptual content. Three main questions about the process remain under-explored, however. First, are lexical associations with perception or motion sufficient to yield mental simulation, or is the integration of lexical semantics into larger structures, like sentences, necessary? Second, what linguistic elements (e.g., verbs, nouns, etc.) trigger mental simulations? Third, how detailed are the visual simulations that are performed? A series of behavioral experiments address these questions, using a visual object categorization task to investigate whether up- or down-related language selectively interferes with visual processing in the same part of the visual field (following Richardson et al., 2003). The results demonstrate that either subject nouns or main verbs can trigger visual imagery, but only when used in literal sentences about real space-metaphorical language does not yield significant effects-which implies that it is the comprehension of the sentence as a whole and not simply lexical associations that yields imagery effects. These studies also show that the evoked imagery contains detail as to the part of the visual field where the described scene would take place.
引用
收藏
页码:733 / 764
页数:32
相关论文
共 53 条
[1]  
[Anonymous], METHODS COGNITIVE LI
[2]  
Bailey D. R., 1997, Ph.D. Dissertation
[3]  
Barnett V., 1984, Outliers in Statistical Data, V2nd
[4]  
Barsalou L.W., 2005, Grounding cognition: The role of perception and action in memory, language, and thought, P129, DOI DOI 10.1017/CBO9780511499968
[5]  
Barsalou L. W., 1997, CREATIVE THOUGHT INV, P267
[6]  
Barsalou LW, 1999, BEHAV BRAIN SCI, V22, P577, DOI 10.1017/S0140525X99532147
[7]   Grounding conceptual knowledge in modality-specific systems [J].
Barsalou, LW ;
Simmons, WK ;
Barbey, AK ;
Wilson, CD .
TRENDS IN COGNITIVE SCIENCES, 2003, 7 (02) :84-91
[8]  
Bergen B, 2003, PROCEEDINGS OF THE TWENTY-FIFTH ANNUAL CONFERENCE OF THE COGNITIVE SCIENCE SOCIETY, PTS 1 AND 2, P139
[9]  
Bergen B, 2004, PROCEEDINGS OF THE TWENTY-SIXTH ANNUAL CONFERENCE OF THE COGNITIVE SCIENCE SOCIETY, P108
[10]  
Bergen BK, 2005, CONSTR APPROACH LANG, V3, P147