NEGLECTED CONSIDERATIONS IN THE ANALYSIS OF AGREEMENT AMONG JOURNAL REFEREES

被引:30
作者
HARGENS, LL [1 ]
HERTING, JR [1 ]
机构
[1] STANFORD UNIV, DEPT SOCIOL, STANFORD, CA 94305 USA
关键词
D O I
10.1007/BF02130467
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Studies of representative samples of submissions to scientific journals show statistically significant associations between referees' recommendations. These associations are moderately large given the multidimensional and unstable character of scientists' evaluations of papers, and composites of referees' recommendations can significantly aid editors in selecting manuscripts for publication, especially when there is great variability in the quality of submissions and acceptance rates are low. Assessments of the value of peer-review procedures in journal manuscript evaluation should take into account features of the entire scholarly communications system present in a field. © 1990 Akadémiai Kiadó.
引用
收藏
页码:91 / 106
页数:16
相关论文
共 38 条
[21]   INSIDERS, OUTSIDERS, AND EFFICIENCY IN A NATIONAL SCIENCE-FOUNDATION PANEL [J].
KLAHR, D .
AMERICAN PSYCHOLOGIST, 1985, 40 (02) :148-154
[22]   ASSESSING PRECISION IN THE MANUSCRIPT REVIEW PROCESS - A LITTLE BETTER THAN A DICE ROLL [J].
LINDSEY, D .
SCIENTOMETRICS, 1988, 14 (1-2) :75-82
[23]  
Lindsey D, 1978, SCI PUBLICATION SYST
[24]  
LOCK S, 1986, DIFFICULT BALANCE ED
[25]  
Mahoney M. J., 1976, SCI SUBJECT PSYCHOL
[26]   RELIABILITY OF RATINGS OF RESEARCH PAPERS [J].
MCREYNOLDS, P .
AMERICAN PSYCHOLOGIST, 1971, 26 (04) :400-+
[27]  
Nunnally J., 1978, PSYCHOMETRIC METHODS, V2nd
[28]   PEER-REVIEW PRACTICES OF PSYCHOLOGICAL JOURNALS - THE FATE OF ACCEPTED, PUBLISHED ARTICLES, SUBMITTED AGAIN [J].
PETERS, DP ;
CECI, SJ .
BEHAVIORAL AND BRAIN SCIENCES, 1982, 5 (02) :187-195
[29]  
Roediger H. L., 1987, SCI EXCELLENCE ORIGI, P222
[30]   RELEVANCE - REVIEW OF AND A FRAMEWORK FOR THINKING ON NOTION IN INFORMATION-SCIENCE [J].
SARACEVIC, T .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE, 1975, 26 (06) :321-343