Citation time window choice for research impact evaluation

被引:335
作者
Wang, Jian [1 ]
机构
[1] Inst Res Informat & Qual Assurance iFQ, D-10117 Berlin, Germany
关键词
Citation time window; Citation ageing; Research evaluation; Field normalization; HIGHLY CITED PAPERS; PRODUCTIVITY RANKINGS; SCIENTIFIC LITERATURE; SENSITIVITY-ANALYSIS; INDICATORS; ARTICLES; PATTERNS; JOURNALS; CAVEATS; SCIENCE;
D O I
10.1007/s11192-012-0775-9
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper aims to inform choice of citation time window for research evaluation, by answering three questions: (1) How accurate is it to use citation counts in short time windows to approximate total citations? (2) How does citation ageing vary by research fields, document types, publication months, and total citations? (3) Can field normalization improve the accuracy of using short citation time windows? We investigate the 31-year life time non-self-citation processes of all Thomson Reuters Web of Science journal papers published in 1980. The correlation between non-self-citation counts in each time window and total non-self-citations in all 31 years is calculated, and it is lower for more highly cited papers than less highly cited ones. There are significant differences in citation ageing between different research fields, document types, total citation counts, and publication months. However, the within group differences are more striking; many papers in the slowest ageing field may still age faster than many papers in the fastest ageing field. Furthermore, field normalization cannot improve the accuracy of using short citation time windows. Implications and recommendations for choosing adequate citation time windows are discussed.
引用
收藏
页码:851 / 872
页数:22
相关论文
共 35 条
  • [1] Italy introduces performance-related funding
    Abbott, Alison
    [J]. NATURE, 2009, 460 (7255) : 559 - 559
  • [2] A sensitivity analysis of research institutions' productivity rankings to the time of citation observation
    Abramo, Giovanni
    Cicero, Tindaro
    D'Angelo, Ciriaco Andrea
    [J]. JOURNAL OF INFORMETRICS, 2012, 6 (02) : 298 - 306
  • [3] A sensitivity analysis of researchers' productivity rankings to the time of citation observation
    Abramo, Giovanni
    Cicero, Tindaro
    D'Angelo, Ciriaco Andrea
    [J]. JOURNAL OF INFORMETRICS, 2012, 6 (02) : 192 - 201
  • [4] Assessing the varying level of impact measurement accuracy as a function of the citation window length
    Abramo, Giovanni
    Cicero, Tindaro
    D'Angelo, Ciriaco Andrea
    [J]. JOURNAL OF INFORMETRICS, 2011, 5 (04) : 659 - 667
  • [5] Early citation counts correlate with accumulated impact
    Adams, J
    [J]. SCIENTOMETRICS, 2005, 63 (03) : 567 - 581
  • [6] Characteristics of highly cited papers
    Aksnes, DW
    [J]. RESEARCH EVALUATION, 2003, 12 (03) : 159 - 170
  • [7] A macro study of self-citation
    Aksnes, DW
    [J]. SCIENTOMETRICS, 2003, 56 (02) : 235 - 246
  • [9] The "Mendel syndrome" in science: durability of scientific literature and its effects on bibliometric analysis of individual scientists
    Costas, Rodrigo
    van Leeuwen, Thed N.
    van Raan, Anthony F. J.
    [J]. SCIENTOMETRICS, 2011, 89 (01) : 177 - 205
  • [10] Is Scientific Literature Subject to a 'Sell-By-Date'? A General Methodology to Analyze the 'Durability' of Scientific Documents
    Costas, Rodrigo
    van Leeuwen, Thed N.
    van Raan, Anthony F. J.
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2010, 61 (02): : 329 - 339