Speechreading: illusion or window into pattern recognition

被引:35
作者
Massaro, DW [1 ]
机构
[1] Univ Calif Santa Cruz, Santa Cruz, CA 95060 USA
关键词
D O I
10.1016/S1364-6613(99)01360-1
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
In the Logical Model of Perception (FLMP) perceivers are conceptualized as forming perceptual judgments by evaluating and integrating multiple ambiguous sources of information, in an optimal manner based on relative goodness of match. This model has been tested favorably against a variety of competing theories and modes. Recent extensions of the FLMP are described in thin article along with empirical applications and and progress in the study of speech perception by ear and eye is reviewed within this general theoretical framework. The model illuminates the differences that are observed across different languages in terms of information as opposed to information-processing.. Pattern recognition of bimodal speech is representative of pattern recognition in a variety of other domains, such as emotion perception, and there are in-dependent reasons why multimodal presentation of audible and visible speech is particularly conducive to accurate pattern recognition. We believe that the positive outcome of this research provides a framework for the development: of computer animated agents which can serve as language tutors and as conversational characters in other domains, easing the interaction of humans and machines.
引用
收藏
页码:310 / 317
页数:8
相关论文
共 55 条
[51]   MCGURK EFFECT IN NON-ENGLISH LISTENERS - FEW VISUAL EFFECTS FOR JAPANESE SUBJECTS HEARING JAPANESE SYLLABLES OF HIGH AUDITORY INTELLIGIBILITY [J].
SEKIYAMA, K ;
TOHKURA, Y .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1991, 90 (04) :1797-1805
[52]   Laterality in visual speech perception [J].
Smeele, PMT ;
Massaro, DW ;
Cohen, MM ;
Sittig, AC .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 1998, 24 (04) :1232-1242
[53]  
Summerfield Q., 1987, Hearing by eye: The psychology of lipreading, P3, DOI DOI 10.2307/1423237
[54]   PERCEPTUAL RESTORATION OF MISSING SPEECH SOUNDS [J].
WARREN, RM .
SCIENCE, 1970, 167 (3917) :392-&
[55]  
White E., 1989, CORTICAL CIRCUITS SY