FOUNDATIONS OF MULTIMODAL REPRESENTATIONS - A TAXONOMY OF REPRESENTATIONAL MODALITIES

被引:38
作者
BERNSEN, NO
机构
[1] Centre of Cognitive Science, Roskilde University, DK-4000
关键词
INTERFACES; MODALITIES; REPRESENTATIONS;
D O I
10.1016/0953-5438(94)90008-6
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Advances in information technologies are producing a very large number of possible interface modality combinations which are potentially useful for the expression and exchange of information in human-computer interaction. However, a principled basis for analysing arbitrary input/output modality types and combinations as to their capabilities of information representation and exchange is still lacking. The paper presents a generative approach to the analysis of output modality types and their combinations and takes some steps towards its implementation, departing from a taxonomy of generic unimodal modalities of representation. A small number of key properties appear sufficient for creating a taxonomy of generic output modalities which is relatively simple, robust, intuitively plausible and reasonably complete. These (orthogonal) properties are: analogue and non-analogue representations; arbitrary and non-arbitrary representations; static and dynamic representations; linguistic and non-linguistic representations; different media of representation; and modality structure. The work presented is part of the larger research agenda of modality theory.
引用
收藏
页码:347 / 371
页数:25
相关论文
共 11 条
[1]  
Bernsen N. O., 1993, P WORKSH GRAPH REPR, P43
[2]  
BERNSEN NO, 1993, UNPUB SPECIFICITY FO
[3]  
BERNSEN NO, 1994, IN PRESS P ERCIM WOR
[4]  
BERNSEN NO, 1993, METHODOLOGY MAPPING
[5]  
BERNSEN NO, 1993, MATCHING INFORMATION
[6]  
Haugeland J., 1991, PHILOS CONNECTIONIST
[7]  
HOVY E, 1990, P AAAI S HUM COMP IN
[8]  
SLACK J, 1993, ANIMATION REPRESENTA
[9]  
Stenning K., 1991, SITUATION THEORY ITS, V2, P607
[10]  
TUFTE ER, 1990, ENVISIONING INFORMAT