Alternative metric indicators for funding scheme evaluations

被引:34
作者
Thelwall, Mike [1 ]
Kousha, Kayvan [1 ]
Dinsmore, Adam [2 ]
Dolby, Kevin [2 ]
机构
[1] Wolverhampton Univ, Wolverhampton WV1 1DJ, W Midlands, England
[2] Wellcome Trust Res Labs, London, England
关键词
Altmetrics; Research evaluation; Funding programme; Funding scheme; Funding stream; Webometrics; RESEARCH IMPACT; CITATIONS; WEB;
D O I
10.1108/AJIM-09-2015-0146
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Purpose - The purpose of this paper is to investigate the potential of altmetric and webometric indicators to aid with funding agencies' evaluations of their funding schemes. Design/methodology/approach - This paper analyses a range of altmetric and webometric indicators in terms of suitability for funding scheme evaluations, compares them to traditional indicators and reports some statistics derived from a pilot study with Wellcome Trust-associated publications. Findings - Some alternative indicators have advantages to usefully complement scientometric data by reflecting a different type of impact or through being available before citation data. Research limitations/implications - The empirical part of the results is based on a single case study and does not give statistical evidence for the added value of any of the indicators. Practical implications - A few selected alternative indicators can be used by funding agencies as part of their funding scheme evaluations if they are processed in ways that enable comparisons between data sets. Their evidence value is only weak, however. Originality/value - This is the first analysis of altmetrics or webometrics from a funding scheme evaluation perspective.
引用
收藏
页码:2 / 18
页数:17
相关论文
共 69 条
[1]   The VQR, Italy's second national research assessment: Methodological failures and ranking distortions [J].
Abramo, Giovanni ;
D'Angelo, Ciriaco Andrea .
JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY, 2015, 66 (11) :2202-2214
[2]   Can the Impact of Non-Western Academic Books be Measured? An Investigation of Google Books and Google Scholar for Malaysia [J].
Abrizah, A. ;
Thelwall, Mike .
JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY, 2014, 65 (12) :2498-2508
[3]   Altmetric: enriching scholarly content with article-level discussion and metrics [J].
Adie, Euan ;
Roe, William .
LEARNED PUBLISHING, 2013, 26 (01) :11-+
[4]   Informetric analyses on the World Wide Web: Methodological approaches to 'webometrics' [J].
Almind, TC ;
Ingwersen, P .
JOURNAL OF DOCUMENTATION, 1997, 53 (04) :404-426
[5]  
[Anonymous], J ASS INFOR IN PRESS
[6]  
[Anonymous], 2014, SIG MET WORKSH
[7]  
[Anonymous], 2000, PROTECTING THEIR INT
[8]  
[Anonymous], J ASS INFOR IN PRESS
[9]  
[Anonymous], INTERIM EVALUATION 7
[10]  
[Anonymous], EVALUATION ESRC MRC