Are peer-review activities related to reviewer bibliometric performance? A scientometric analysis of Publons

被引:48
作者
Luis Ortega, Jose [1 ]
机构
[1] Cybermetr Lab, Madrid, Spain
关键词
Publons; Google Scholar Citations; Peer review; Manuscript acceptance; Scientometrics; SUBMITTED MANUSCRIPTS; QUALITY; INDICATORS; CITATIONS; EVOLUTION; AGREEMENT; ARTICLES; CHANCE; GENDER; SCORES;
D O I
10.1007/s11192-017-2399-6
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This study attempts to analyse the relationship between the peer-review activity of scholars registered in Publons and their research performance as reflected in Google Scholar. Using a scientometric approach, this work explores correlations between peer-review measures and bibliometric indicators. In addition, decision trees are used to explore which researchers (according to discipline, academic status and gender) make most of the reviews and which of them accept most of the papers, assuming that these are reasonable proxies for reviewing quality. Results show that there is a weak correlation between bibliometric indicators and peer-review activity. The decision tree analysis suggests that established male academics made the most reviews, while young female scholars are the most demanding reviewers. These results could help editors to select good reviewers as well as opening a new source of data for scientometrics analyses.
引用
收藏
页码:947 / 962
页数:16
相关论文
共 45 条
[1]   Evaluating research: from informed peer review to bibliometrics [J].
Abramo, Giovanni ;
D'Angelo, Ciriaco Andrea .
SCIENTOMETRICS, 2011, 87 (03) :499-514
[2]   Peer reviews and bibliometric indicators: a comparative study at a Norwegian university [J].
Aksnes, DW ;
Taxt, RE .
RESEARCH EVALUATION, 2004, 13 (01) :33-41
[3]  
[Anonymous], IND PHYS
[4]   What makes a good reviewer and a good review for a general medical journal? [J].
Black, N ;
van Rooyen, S ;
Godlee, F ;
Smith, R ;
Evans, S .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1998, 280 (03) :231-233
[5]   Selecting manuscripts for a high-impact journal through peer review:: A citation analysis of communications that were accepted by Angewandte Chemie International Edition, or rejected but published elsewhere [J].
Bornmann, Lutz ;
Daniel, Hans-Dieter .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2008, 59 (11) :1841-1852
[6]   THE EVOLUTION OF EDITORIAL PEER-REVIEW [J].
BURNHAM, JC .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1990, 263 (10) :1323-1329
[7]   Longitudinal Trends in the Performance of Scientific Peer Reviewers [J].
Callaham, Michael ;
McCulloch, Charles .
ANNALS OF EMERGENCY MEDICINE, 2011, 57 (02) :141-148
[8]   The relationship of previous training and experience of journal peer reviewers to subsequent review quality [J].
Callaham, Michael L. ;
Tercier, John .
PLOS MEDICINE, 2007, 4 (01) :32-40
[9]   Reliability of editors' subjective quality ratings of peer reviews of manuscripts [J].
Callaham, ML ;
Baxt, WG ;
Waeckerie, JF ;
Wears, RL .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1998, 280 (03) :229-231
[10]   CHANCE AND CONSENSUS IN PEER-REVIEW [J].
COLE, S ;
COLE, JR ;
SIMON, GA .
SCIENCE, 1981, 214 (4523) :881-886