How important is choice of the scaling factor in standardizing citations?

被引:13
作者
Abramo, Giovanni [1 ,2 ]
Cicero, Tindaro [2 ]
D'Angelo, Ciriaco Andrea [2 ]
机构
[1] Natl Res Council Italy, Inst Syst Anal & Comp Sci IASI CNR, Rome, Italy
[2] Univ Roma Tor Vergata, Sch Engn, Dept Management, Lab Studies Res & Technol Transfer, Rome, Italy
关键词
Research evaluation; Bibliometrics; Citations; Scaling; Sensitivity analysis; Productivity; Researchers; RESEARCH PERFORMANCE; DISTRIBUTIONS; UNIVERSALITY; SCIENCE; MODEL;
D O I
10.1016/j.joi.2012.07.002
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Because of the variations in citation behavior across research fields, appropriate standardization must be applied as part of any bibliometric analysis of the productivity of individual scientists and research organizations. Such standardization involves scaling by some factor that characterizes the distribution of the citations of articles from the same year and subject category. In this work we conduct an analysis of the sensitivity of researchers' productivity rankings to the scaling factor chosen to standardize their citations. To do this we first prepare the productivity rankings for all researchers (more than 30,000) operating in the hard sciences in Italy, over the period 2004-2008. We then measure the shifts in rankings caused by adopting scaling factors other than the particular factor that seems more effective for comparing the impact of publications in different fields: the citation average of the distribution of cited-only publications. (C) 2012 Elsevier Ltd. All rights reserved.
引用
收藏
页码:645 / 654
页数:10
相关论文
共 27 条
[1]  
Abramo G, 2007, CURR SCI INDIA, V93, P762
[2]   Revisiting the scaling of citations for research assessment [J].
Abramo, Giovanni ;
Cicero, Tindaro ;
D'Angelo, Ciriaco Andrea .
JOURNAL OF INFORMETRICS, 2012, 6 (04) :470-479
[3]   Research productivity: Are higher academic ranks more productive than lower ones? [J].
Abramo, Giovanni ;
D'Angelo, Ciriaco Andrea ;
Di Costa, Flavia .
SCIENTOMETRICS, 2011, 88 (03) :915-928
[4]   National-scale research performance assessment at the individual level [J].
Abramo, Giovanni ;
D'Angelo, Ciriaco Andrea .
SCIENTOMETRICS, 2011, 86 (02) :347-364
[5]  
Albarran P., 2011, EC WORKING PAPERS U
[6]   Further steps towards an ideal method of measuring citation performance: The avoidance of citation (ratio) averages in field-normalization [J].
Bornmann, Lutz ;
Mutz, Ruediger .
JOURNAL OF INFORMETRICS, 2011, 5 (01) :228-230
[7]   A Heuristic Approach to Author Name Disambiguation in Bibliometrics Databases for Large-Scale Research Assessments [J].
D'Angelo, Ciriaco Andrea ;
Giuffrida, Cristiano ;
Abramo, Giovanni .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2011, 62 (02) :257-269
[8]   Power-law distributions for the citation index of scientific publications and scientists [J].
Gupta, HM ;
Campanha, JR ;
Pesce, RAG .
BRAZILIAN JOURNAL OF PHYSICS, 2005, 35 (4A) :981-986
[10]  
Leydesdorf, 2011, 2011 ATL C SCI TECHN