Multifaceted Evaluation Criteria of Digital Libraries in Academic Settings: Similarities and Differences From Different Stakeholders

被引:20
作者
Xie, Iris [1 ]
Joo, Soohyung [2 ]
Matusiak, Krystyna K. [3 ]
机构
[1] Univ Wisconsin, Sch Informat Studies, Northwest Quad Bldg B,2025 E Newport, Milwaukee, WI 53211 USA
[2] Univ Kentucky, Sch Informat Sci, 320 Little Lib Bldg, Lexington, KY 40506 USA
[3] Univ Denver, Res Methods & Informat Sci Dept, 1999 East Evans Ave, Denver, CO 80208 USA
关键词
Evaluation criteria; Evaluation dimensions; Digital libraries; Academic libraries; Stakeholders; USERS; PRESERVATION; USABILITY; MODEL; FRAMEWORK;
D O I
10.1016/j.acalib.2018.09.002
中图分类号
G25 [图书馆学、图书馆事业]; G35 [情报学、情报工作];
学科分类号
050302 [传播学]; 071101 [系统理论];
摘要
Digital library (DL) evaluation is essential to the success and enhancement of DLs. However, there is a lack of research on the assessment of comprehensive evaluation criteria across multiple dimensions of DLs. In particular, limited research is available on criteria prioritization to determine which criteria are perceived important by different stakeholders. This study was conducted to compare similarities and differences in perceptions of the importance of different DL evaluation criteria by heterogeneous stakeholders in academic settings. Ninety subjects were recruited with 30 from each of the group representing DL scholars, DL librarians, and DL users. Subjects were instructed to fill in an in-depth survey consisting of 10 evaluation dimensions with 94 criteria. ANOVA and t-test were applied to examine the similarities and differences among the three groups. This study reveals consensus and divergence in perceptions of criteria importance among the three groups, and indicates an inherent tension among the stakeholders. Moreover, the differences identify gaps not only between user expectations and the DL practice but also between what's desirable and what's possible in the academic environment. The findings provide a comprehensive list of criteria to guide practical evaluation of DLs, and contribute to the narrowing of the identified gaps.
引用
收藏
页码:854 / 863
页数:10
相关论文
共 50 条
[1]
Synthesizing visual digital library research to formulate a user-centered evaluation framework [J].
Albertson, Dan .
NEW LIBRARY WORLD, 2015, 116 (3-4) :122-135
[2]
[Anonymous], 2004, DELOS WP7 WORKSH EV
[3]
Beaudoin J. E., 2012, D LIB MAGAZINE1, V18
[4]
Beaudoin J. E., 2012, D LIB MAG, V18, P3
[5]
A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments [J].
Behnert, Christiane ;
Lewandowski, Dirk .
JOURNAL OF DOCUMENTATION, 2017, 73 (03) :509-527
[6]
Borgman CL, 1999, INFORM PROCESS MANAG, V35, P227, DOI 10.1016/S0306-4573(98)00059-4
[7]
Bui Y., 2006, CAIS ACSI 2006 INFOR
[8]
Candela L., 2007, D-Lib Magazine, V13
[9]
Carr It, 2006, WHAT USERS WANT ACAD