Assessment of research performance in biology: How well do peer review and bibliometry correlate?

被引:32
作者
Lovegrove, Barry G. [1 ]
Johnson, Steven D. [1 ]
机构
[1] Univ KwaZulu Natal, Sch Biol & Conservat Sci, Scottsville, South Africa
关键词
bibliometric scores; Hirsch index; peer review; citation record; publication record;
D O I
10.1641/B580210
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Bibliometric indices based on publishing output, and citation records used to measure scientific quality, are increasingly being employed to supplement and even replace traditional alternatives, such as the peer-review system. In this article we question whether peer review can predict bibliometric indices for individual researchers. We compared the ratings of scientific quality obtained using a peer-review system with the most popular bibliometric scores (h-, m-, and g-indices; total citations, and mean number of citations per publication) for 163 botanists and zoologists. Although the peer-review ratings were correlated with the bibliometric measures, they explained less than 40 percent of the variation in the scores. Most of this unexplained variation is presumably due to limitations of both the peer-review system and bibliometric scores. We propose a synergy between peer-review and bibliometric scores that can improve the assessment of scientific quality, especially by bench marking peer-review decisions against bibliometric thresholds.
引用
收藏
页码:160 / 164
页数:5
相关论文
共 17 条
[1]   Index aims for fair ranking of scientists [J].
Ball, P .
NATURE, 2005, 436 (7053) :900-900
[2]   Is it possible to compare researchers with different scientific interests? [J].
Batista, Pablo D. ;
Campiteli, Monica G. ;
Kinouchi, Osame ;
Martinez, Alexandre S. .
SCIENTOMETRICS, 2006, 68 (01) :179-189
[3]   What do we know about the h index? [J].
Bornmann, Lutz ;
Daniel, Hans-Dieter .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2007, 58 (09) :1381-1385
[5]   Hirsch index or Hirsch rate? Some thoughts arising from Liang's data [J].
Burrell, Quentin L. .
SCIENTOMETRICS, 2007, 73 (01) :19-28
[6]   Using the h-index to rank influential information scientists [J].
Cronin, Blaise ;
Meho, Lokman .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2006, 57 (09) :1275-1278
[7]  
Daniel HD, 2007, QUALITY ASSESSMENT FOR HIGHER EDUCATION IN EUROPE, P71
[8]   Dynamic h-index:: The Hirsch index in function of time [J].
Egghe, Leo .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2007, 58 (03) :452-454
[9]   Theory and practise of the g-index [J].
Egghe, Leo .
SCIENTOMETRICS, 2006, 69 (01) :131-152
[10]   An index to quantify an individual's scientific research output [J].
Hirsch, JE .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2005, 102 (46) :16569-16572