Evaluating research: from informed peer review to bibliometrics

被引:147
作者
Abramo, Giovanni [1 ,2 ]
D'Angelo, Ciriaco Andrea [1 ]
机构
[1] Univ Roma Tor Vergata, Dept Management, Lab Studies Res & Technol Transfer, Sch Engn, I-00133 Rome, Italy
[2] Natl Res Council Italy, Rome, Italy
关键词
Decision support systems; Research assessment; Peer review; Bibliometrics; Research productivity; INDICATORS;
D O I
10.1007/s11192-011-0352-7
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
National research assessment exercises are becoming regular events in ever more countries. The present work contrasts the peer-review and bibliometrics approaches in the conduct of these exercises. The comparison is conducted in terms of the essential parameters of any measurement system: accuracy, robustness, validity, functionality, time and costs. Empirical evidence shows that for the natural and formal sciences, the bibliometric methodology is by far preferable to peer-review. Setting up national databases of publications by individual authors, derived from Web of Science or Scopus databases, would allow much better, cheaper and more frequent national research assessments.
引用
收藏
页码:499 / 514
页数:16
相关论文
共 21 条
  • [1] The measurement of Italian universities' research productivity by a non parametric-bibliometric methodology
    Abramo, Giovanni
    D'Angelo, Ciriaco Andrea
    Pugini, Fabio
    [J]. SCIENTOMETRICS, 2008, 76 (02) : 225 - 244
  • [2] National-scale research performance assessment at the individual level
    Abramo, Giovanni
    D'Angelo, Ciriaco Andrea
    [J]. SCIENTOMETRICS, 2011, 86 (02) : 347 - 364
  • [3] Peer review research assessment: a sensitivity analysis of performance rankings to the share of research product evaluated
    Abramo, Giovanni
    D'Angelo, Ciriaco Andrea
    Viel, Fulvio
    [J]. SCIENTOMETRICS, 2010, 85 (03) : 705 - 720
  • [4] Allocative efficiency in public research funding: Can bibliometrics help?
    Abramo, Giovanni
    D'Angelo, Ciriaco Andrea
    Caprasecca, Alessandro
    [J]. RESEARCH POLICY, 2009, 38 (01) : 206 - 215
  • [5] ADAMS J, 1998, ANN EC STAT, V4950, P127
  • [6] When different persons have an identical author name. How frequent are homonyms?
    Aksnes, Dag W.
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2008, 59 (05): : 838 - 841
  • [7] Peer reviews and bibliometric indicators: a comparative study at a Norwegian university
    Aksnes, DW
    Taxt, RE
    [J]. RESEARCH EVALUATION, 2004, 13 (01) : 33 - 41
  • [8] [Anonymous], CITATION ANAL RES EV
  • [9] BUTLER L, 2007, POLITICAL STUDIES RE, V7, P3
  • [10] A Heuristic Approach to Author Name Disambiguation in Bibliometrics Databases for Large-Scale Research Assessments
    D'Angelo, Ciriaco Andrea
    Giuffrida, Cristiano
    Abramo, Giovanni
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2011, 62 (02): : 257 - 269