QuickSet: Multimodal interaction for distributed applications

被引:132
作者
Cohen, PR [1 ]
Johnston, M [1 ]
McGee, D [1 ]
Oviatt, S [1 ]
Pittman, J [1 ]
Smith, I [1 ]
Chen, L [1 ]
Clow, J [1 ]
机构
[1] Oregon Grad Inst Sci & Technol, Ctr Human Comp Commun, Portland, OR 97291 USA
来源
ACM MULTIMEDIA 97, PROCEEDINGS | 1997年
关键词
multimodal interfaces; agent architecture; gesture recognition; speech recognition; natural language processing; distributed interactive simulation;
D O I
10.1145/266180.266328
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents an emerging application of multimodal interface research to distributed applications. We have developed the Quickset prototype, a pen/voice system running on a band-held PC, communicating via wireless LAN through an agent architecture to a number of systems, including NRaD's(1) LeatherNet system, a distributed interactive training simulator built for the US Marine Corps. The paper describes the overall system architecture, a novel multimodal integration strategy offering mutual compensation among modalities, and provides examples of multimodal simulation setup. Finally, we discuss our applications experience and evaluation.
引用
收藏
页码:31 / 40
页数:10
相关论文
共 32 条
[1]  
[Anonymous], P C HUM FACT COMP SY
[2]  
[Anonymous], 1994, P INT C SPOK LANG PR
[3]  
[Anonymous], INT C AC SPEECH SIGN
[4]  
[Anonymous], 1997, P C HUM FACT COMP SY
[5]  
[Anonymous], 1992, P UIST 92 C
[6]  
BAKER M, UNPUB HUMAN FACTORS
[7]  
Bolt R. A., 1980, Computer Graphics, V14, P262, DOI 10.1145/965105.807503
[8]  
BRISON E, UNPUB MULTIMODAL REF
[9]  
BROOKS F, 1996, UNPUB UIST 96 SEATTL
[10]  
CALDER J, 1987, CATEGORIES POLYMORPH, P65