National research assessment exercises: a comparison of peer review and bibliometrics rankings

被引:56
作者
Abramo, Giovanni [1 ,2 ]
D'Angelo, Ciriaco Andrea [1 ]
Di Costa, Flavia [1 ]
机构
[1] Univ Roma Tor Vergata, Lab Studies Res & Technol Transfer, Sch Engn, Dept Management, Rome, Italy
[2] IASI CNR, Natl Res Council Italy, Rome, Italy
关键词
Research assessment; Bibliometrics; Peer review; Research productivity; University; Italy; CITATION; INDICATORS;
D O I
10.1007/s11192-011-0459-x
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Development of bibliometric techniques has reached such a level as to suggest their integration or total substitution for classic peer review in the national research assessment exercises, as far as the hard sciences are concerned. In this work we compare rankings lists of universities captured by the first Italian evaluation exercise, through peer review, with the results of bibliometric simulations. The comparison shows the great differences between peer review and bibliometric rankings for excellence and productivity.
引用
收藏
页码:929 / 941
页数:13
相关论文
共 21 条
[1]   Assessment of sectoral aggregation distortion in research productivity measurements [J].
Abramo, Giovanni ;
D'Angelo, Ciriaco Andrea ;
Di Costa, Flavia .
RESEARCH EVALUATION, 2008, 17 (02) :111-121
[2]   Evaluating research: from informed peer review to bibliometrics [J].
Abramo, Giovanni ;
D'Angelo, Ciriaco Andrea .
SCIENTOMETRICS, 2011, 87 (03) :499-514
[3]   Peer review research assessment: a sensitivity analysis of performance rankings to the share of research product evaluated [J].
Abramo, Giovanni ;
D'Angelo, Ciriaco Andrea ;
Viel, Fulvio .
SCIENTOMETRICS, 2010, 85 (03) :705-720
[4]   Allocative efficiency in public research funding: Can bibliometrics help? [J].
Abramo, Giovanni ;
D'Angelo, Ciriaco Andrea ;
Caprasecca, Alessandro .
RESEARCH POLICY, 2009, 38 (01) :206-215
[5]   Peer reviews and bibliometric indicators: a comparative study at a Norwegian university [J].
Aksnes, DW ;
Taxt, RE .
RESEARCH EVALUATION, 2004, 13 (01) :33-41
[6]  
[Anonymous], CITATION ANAL RES EV
[7]   A Heuristic Approach to Author Name Disambiguation in Bibliometrics Databases for Large-Scale Research Assessments [J].
D'Angelo, Ciriaco Andrea ;
Giuffrida, Cristiano ;
Abramo, Giovanni .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2011, 62 (02) :257-269
[8]  
ERA, 2010, EXC RES AUSTR IN
[9]   The first Italian research assessment exercise: A bibliometric perspective [J].
Franceschet, Massimo ;
Costantini, Antonio .
JOURNAL OF INFORMETRICS, 2011, 5 (02) :275-291
[10]   THE PHILOSOPHICAL BASIS OF PEER-REVIEW AND THE SUPPRESSION OF INNOVATION [J].
HORROBIN, DF .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1990, 263 (10) :1438-1441