Evaluation of digital libraries

被引:104
作者
Fuhr N. [1 ]
Tsakonas G. [6 ]
Aalberg T. [2 ]
Agosti M. [5 ]
Hansen P. [3 ]
Kapidakis S. [6 ]
Klas C.-P. [1 ]
Kovács L. [4 ]
Landoni M. [8 ]
Micsik A. [4 ]
Papatheodorou C. [6 ]
Peters C. [7 ]
Sølvberg I. [2 ,6 ]
机构
[1] University of Duisburg-Essen, Duisburg
[2] Norwegian University of Science and Technology, Trondheim
[3] Swedish Institute of Computer Science, Kista
[4] Computer and Automation Research Institute of the Hungarian Academy of Sciences (MTA SZTAKI), Budapest
[5] University of Padua, Padova
[6] Department of Archive and Library Sciences, Ionian University, Corfu
[7] CNR-ISTI, Pisa
[8] Department of Computer and Information Sciences, University of Strathclyde, Glasgow
关键词
Digital Library; Evaluation Framework; Information Society Technology; Open Archival Information System; Information Access System;
D O I
10.1007/s00799-007-0011-z
中图分类号
学科分类号
摘要
Digital libraries (DLs) are new and innovative information systems, under constant development and change, and therefore evaluation is of critical importance to ensure not only their correct evolution but also their acceptance by the user and application communities. The Evaluation activity of the DELOS Network of Excellence has performed a large-scale survey of current DL evaluation activities. This study has resulted in a description of the state of the art in the field, which is presented in this paper. The paper also proposes a new framework for the evaluation of DLs, as well as for recording, describing and analyzing the related research field. The framework includes a methodology for the classification of current evaluation procedures. The objective is to provide a set of flexible and adaptable guidelines for DL evaluation. © 2007 Springer-Verlag.
引用
收藏
页码:21 / 38
页数:17
相关论文
共 71 条
[1]  
Fuhr N., Hansen P., Mabe M., Micsik A., Solvberg I., Digital libraries: A generic classification and evaluation scheme, Lecture Notes in Computer Science, 2163, pp. 187-199, (2001)
[2]  
DELOS Workshop on Evaluation of Digital Libraries: Testbeds, Measurements, and Metrics, (2002)
[3]  
Notes of the DELOS WP7 Workshop on the Evaluation of Digital Libraries, (2004)
[4]  
Cleverdon C., The Cranfield tests on index language devices, Readings in Information Retrieval, pp. 47-59, (1997)
[5]  
Turpin A., Hersh W., Why batch and user evaluations do not give the same results, Proceedings of the SIGIR01, pp. 225-231, (2001)
[6]  
A Reference Model for An Open Archival Information System, (2003)
[7]  
Functional Requirements for Bibliographic Records, (1998)
[8]  
Levy D., Marshall C., Going digital: A look at assumptions underlying digital libraries, Commun. ACM, 38, pp. 77-84, (1995)
[9]  
Borgman C., What are digital libraries? Competing visions, Inf. Process. Manage., 35, pp. 277-243, (1999)
[10]  
Reference Models for Digital Libraries: Actors and Roles - Final Report, (2003)