Fallout and miss in journal peer review

被引：8

作者：

Egghe, L. ^{[1
,2
]}

Bornmann, Lutz ^{[3
]}

机构：

[1] Univ Hasselt UHasselt, Diepenbeek, Belgium

[2] UA, IBW, Antwerp, Belgium

[3] Max Planck Gesell, Munich, Germany

来源：

JOURNAL OF DOCUMENTATION | 2013年 / 69卷 / 03期

关键词：

Information science; Evaluation; Information management; Serials; Peer review; PRECISION; NUMBER; RECALL;

D O I：

10.1108/JD-12-2011-0053

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Purpose - The authors exploit the analogy between journal peer review and information retrieval in order to quantify some imperfections of journal peer review. Design/methodology/approach - The authors define fallout rate and missing rate in order to describe quantitatively the weak papers that were accepted and the strong papers that were missed, respectively. To assess the quality of manuscripts the authors use bibliometric measures. Findings - Fallout rate and missing rate are put in relation with the hitting rate and success rate. Conclusions are drawn on what fraction of weak papers will be accepted in order to have a certain fraction of strong accepted papers. Originality/value - The paper illustrates that these curves are new in peer review research when interpreted in the information retrieval terminology.

引用

页码：411 / 416

页数：6

共 9 条

[1] Journal peer review as an information retrieval process [J].

Bornmann, Lutz ;

Egghe, Leo .

JOURNAL OF DOCUMENTATION, 2012, 68 (04) :527-535

[2] The manuscript reviewing process: Empirical research on review requests, review sequences, and decision rules in peer review [J].

Bornmann, Lutz ;

Daniel, Hans-Dieter .

LIBRARY & INFORMATION SCIENCE RESEARCH, 2010, 32 (01) :5-12

[3] The luck of the referee draw: the effect of exchanging reviews [J].

Bornmann, Lutz ;

Daniel, Hans-Dieter .

LEARNED PUBLISHING, 2009, 22 (02) :117-125

[4] The measures precision, recall, fallout and miss as a function of the number of retrieved documents and their mutual interrelations [J].

Egghe, L. .

INFORMATION PROCESSING & MANAGEMENT, 2008, 44 (02) :856-876

[5] Existence theorem of the quadruple (P, R, F, M):: Precision, recall, fallout and miss [J].

Egghe, L. .

INFORMATION PROCESSING & MANAGEMENT, 2007, 43 (01) :265-272

[6] A universal method of information retrieval evaluation:: the "missing" link M and the universal IR surface [J].

Egghe, L .

INFORMATION PROCESSING & MANAGEMENT, 2004, 40 (01) :21-30

[7]

Salton G., 1987, INTRO MODERN INFORM

[8] Are three heads better than two? How the number of reviewers and editor behavior affect the rejection rate [J].

Schultz, David M. .

SCIENTOMETRICS, 2010, 84 (02) :277-292

[9]

[No title captured]

← 1 →