A sensitivity analysis of research institutions' productivity rankings to the time of citation observation

被引:8
作者
Abramo, Giovanni [1 ,2 ]
Cicero, Tindaro [1 ]
D'Angelo, Ciriaco Andrea [1 ]
机构
[1] Univ Roma Tor Vergata, Dept Management, Sch Engn, Lab Studies Res & Technol Transfer, Rome, Italy
[2] CNR, IASI, Inst Syst Anal & Comp Sci, I-00185 Rome, Italy
关键词
Research evaluation; Bibliometrics; Citation window; Productivity; Universities; Rankings;
D O I
10.1016/j.joi.2011.11.005
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
One of the critical issues in bibliometric research assessments is the time required to achieve maturity in citations. Citation counts can be considered a reliable proxy of the real impact of a work only if they are observed after sufficient time has passed from publication date. In the present work the authors investigate the effect of varying the time of citation observation on accuracy of productivity rankings for research institutions. Research productivity measures are calculated for all Italian universities active in the hard sciences in the 2001-2003 period, by individual field and discipline, with the time of the citation observation varying from 2004 to 2008. The objective is to support policy-makers in choosing a citation window that optimizes the tradeoff between accuracy of rankings and timeliness of the exercise. (C) 2011 Elsevier Ltd. All rights reserved.
引用
收藏
页码:298 / 306
页数:9
相关论文
共 15 条
  • [1] Assessment of sectoral aggregation distortion in research productivity measurements
    Abramo, Giovanni
    D'Angelo, Ciriaco Andrea
    Di Costa, Flavia
    [J]. RESEARCH EVALUATION, 2008, 17 (02) : 111 - 121
  • [2] Assessing the varying level of impact measurement accuracy as a function of the citation window length
    Abramo, Giovanni
    Cicero, Tindaro
    D'Angelo, Ciriaco Andrea
    [J]. JOURNAL OF INFORMETRICS, 2011, 5 (04) : 659 - 667
  • [3] A field-standardized application of DEA to national-scale research assessment of universities
    Abramo, Giovanni
    Cicero, Tindaro
    D'Angelo, Ciriaco Andrea
    [J]. JOURNAL OF INFORMETRICS, 2011, 5 (04) : 618 - 628
  • [4] Evaluating research: from informed peer review to bibliometrics
    Abramo, Giovanni
    D'Angelo, Ciriaco Andrea
    [J]. SCIENTOMETRICS, 2011, 87 (03) : 499 - 514
  • [5] Early citation counts correlate with accumulated impact
    Adams, J
    [J]. SCIENTOMETRICS, 2005, 63 (03) : 567 - 581
  • [6] A Heuristic Approach to Author Name Disambiguation in Bibliometrics Databases for Large-Scale Research Assessments
    D'Angelo, Ciriaco Andrea
    Giuffrida, Cristiano
    Abramo, Giovanni
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2011, 62 (02): : 257 - 269
  • [7] ERA, 2010, EXC RES AUSTR ERA IN
  • [8] Better late than never?: On the chance to become highly cited only beyond the standard bibliometric time horizon
    Glänzel, W
    Schlemmer, B
    Thijs, B
    [J]. SCIENTOMETRICS, 2003, 58 (03) : 571 - 586
  • [9] Lifting the crown-citation z-score
    Lundberg, Jonas
    [J]. JOURNAL OF INFORMETRICS, 2007, 1 (02) : 145 - 154
  • [10] The use and misuse of journal metrics and other citation indicators
    Pendlebury, David A.
    [J]. ARCHIVUM IMMUNOLOGIAE ET THERAPIAE EXPERIMENTALIS, 2009, 57 (01) : 1 - 11