Speechreading: illusion or window into pattern recognition

被引:35
作者
Massaro, DW [1 ]
机构
[1] Univ Calif Santa Cruz, Santa Cruz, CA 95060 USA
关键词
D O I
10.1016/S1364-6613(99)01360-1
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
In the Logical Model of Perception (FLMP) perceivers are conceptualized as forming perceptual judgments by evaluating and integrating multiple ambiguous sources of information, in an optimal manner based on relative goodness of match. This model has been tested favorably against a variety of competing theories and modes. Recent extensions of the FLMP are described in thin article along with empirical applications and and progress in the study of speech perception by ear and eye is reviewed within this general theoretical framework. The model illuminates the differences that are observed across different languages in terms of information as opposed to information-processing.. Pattern recognition of bimodal speech is representative of pattern recognition in a variety of other domains, such as emotion perception, and there are in-dependent reasons why multimodal presentation of audible and visible speech is particularly conducive to accurate pattern recognition. We believe that the positive outcome of this research provides a framework for the development: of computer animated agents which can serve as language tutors and as conversational characters in other domains, easing the interaction of humans and machines.
引用
收藏
页码:310 / 317
页数:8
相关论文
共 55 条
[21]  
JORDAN TR, 1998, ADV PSYCHOL SPEECHRE, P155
[22]  
Liberman A. M., 1996, Speech: A special code
[23]  
Massaro D.W., 1996, SPEECHREADING HUMANS, P79
[24]  
Massaro D.W., 1998, P AUD VIS SPEECH PER, P21
[25]  
Massaro D. W., 1998, PERCEIVING TALKING F
[26]  
Massaro D.W., 1987, Speech perception by ear and eye: A paradigm for psychological inquiry
[27]   Perception of asynchronous and conflicting visual and auditory speech [J].
Massaro, DW ;
Cohen, MM ;
Smeele, PMT .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1996, 100 (03) :1777-1786
[28]  
MASSARO DW, 1992, COGNITION : CONCEPTUAL AND METHODOLOGICAL ISSUES, P51, DOI 10.1037/10564-003
[29]   AMBIGUITY IN PERCEPTION AND EXPERIMENTATION [J].
MASSARO, DW .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 1988, 117 (04) :417-421
[30]   MODELS OF INTEGRATION GIVEN MULTIPLE SOURCES OF INFORMATION [J].
MASSARO, DW ;
FRIEDMAN, D .
PSYCHOLOGICAL REVIEW, 1990, 97 (02) :225-252