Citation time window choice for research impact evaluation

被引:335
作者
Wang, Jian [1 ]
机构
[1] Inst Res Informat & Qual Assurance iFQ, D-10117 Berlin, Germany
关键词
Citation time window; Citation ageing; Research evaluation; Field normalization; HIGHLY CITED PAPERS; PRODUCTIVITY RANKINGS; SCIENTIFIC LITERATURE; SENSITIVITY-ANALYSIS; INDICATORS; ARTICLES; PATTERNS; JOURNALS; CAVEATS; SCIENCE;
D O I
10.1007/s11192-012-0775-9
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper aims to inform choice of citation time window for research evaluation, by answering three questions: (1) How accurate is it to use citation counts in short time windows to approximate total citations? (2) How does citation ageing vary by research fields, document types, publication months, and total citations? (3) Can field normalization improve the accuracy of using short citation time windows? We investigate the 31-year life time non-self-citation processes of all Thomson Reuters Web of Science journal papers published in 1980. The correlation between non-self-citation counts in each time window and total non-self-citations in all 31 years is calculated, and it is lower for more highly cited papers than less highly cited ones. There are significant differences in citation ageing between different research fields, document types, total citation counts, and publication months. However, the within group differences are more striking; many papers in the slowest ageing field may still age faster than many papers in the fastest ageing field. Furthermore, field normalization cannot improve the accuracy of using short citation time windows. Implications and recommendations for choosing adequate citation time windows are discussed.
引用
收藏
页码:851 / 872
页数:22
相关论文
共 35 条
  • [21] Patterns of annual citation of highly cited articles and the prediction of their citation ranking: A comparison across subjects
    Levitt, Jonathan M.
    Thelwall, Miki
    [J]. SCIENTOMETRICS, 2008, 77 (01) : 41 - 60
  • [22] Caveats for the use of citation indicators in research and journal evaluations
    Leydesdorff, Loet
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2008, 59 (02): : 278 - 287
  • [23] Normalization at the field level: Fractional counting of citations
    Leydesdorff, Loet
    Opthof, Tobias
    [J]. JOURNAL OF INFORMETRICS, 2010, 4 (04) : 644 - 646
  • [24] How are New Citation-Based Journal Indicators Adding to the Bibliometric Toolbox?
    Leydesdorff, Loet
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2009, 60 (07): : 1327 - 1336
  • [25] LINE MB, 1993, LIBR TRENDS, V41, P665
  • [26] THE APPLICATION OF BIBLIOMETRIC INDICATORS - IMPORTANT FIELD-DEPENDENT AND TIME-DEPENDENT FACTORS TO BE CONSIDERED
    MOED, HF
    BURGER, WJM
    FRANKFORT, JG
    VANRAAN, AFJ
    [J]. SCIENTOMETRICS, 1985, 8 (3-4) : 177 - 203
  • [27] A new classification system to describe the ageing of scientific journals and their impact factors
    Moed, HF
    Van Leeuwen, TN
    Reedijk, J
    [J]. JOURNAL OF DOCUMENTATION, 1998, 54 (04) : 387 - 419
  • [28] CITATION ANALYSIS - QUERIES AND CAVEATS
    PORTER, AL
    [J]. SOCIAL STUDIES OF SCIENCE, 1977, 7 (02) : 257 - 267
  • [29] Universality of citation distributions: Toward an objective measure of scientific impact
    Radicchi, Filippo
    Fortunato, Santo
    Castellano, Claudio
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2008, 105 (45) : 17268 - 17272
  • [30] Rescaling citations of publications in physics
    Radicchi, Filippo
    Castellano, Claudio
    [J]. PHYSICAL REVIEW E, 2011, 83 (04):