Peer review interrater concordance of scientific abstracts: A study of anesthesiology subspecialty and component societies

被引：4

作者：

Cohen, IT ^{[1
]}

Patel, K ^{[1
]}

机构：

[1] George Washington Univ, Childrens Natl Med Ctr, Dept Anesthesiol & Pediat, Washington, DC 20010 USA

来源：

ANESTHESIA AND ANALGESIA | 2006年 / 102卷 / 05期

关键词：

D O I：

10.1213/01.ane.0000200314.73035.4d

中图分类号：

R614 [麻醉学];

学科分类号：

100217 ;

摘要：

The abstracts presented at anesthesiology subspeciality and component society meetings are chosen by peer review. We assessed this process by examining selection criteria and determining interrater concordance. For the societies studied, the level of reviewer agreement ranged from poor to moderate, i.e., slightly better than by chance alone. We hypothesize that having clearer evaluation criteria, scoring systems with interval scales, and assessment based on quality can strengthen the peer review process.

引用

收藏

页码：1501 / 1503

页数：3

相关论文

共 15 条

[1] Interobserver agreement in the application of levels of evidence to scientific papers in The American Volume of The Journal of Bone and Joint Surgery [J].

Bhandari, M ;

Swiontkowski, MF ;

Einhorn, TA ;

Tornetta, P ;

Schemitsch, EH ;

Leece, P ;

Sprague, S ;

Wright, JG .

JOURNAL OF BONE AND JOINT SURGERY-AMERICAN VOLUME, 2004, 86A (08) :1717-1720

[2] Interrater reliability in grading abstracts for the Orthopaedic Trauma Association [J].

Bhandari, M ;

Templeman, D ;

Tornetta, P .

CLINICAL ORTHOPAEDICS AND RELATED RESEARCH, 2004, (423) :217-221

[3] Positive-outcome bias and other limitations in the outcome of research abstracts submitted to a scientific meeting [J].

Callaham, ML ;

Wears, RL ;

Weber, EJ ;

Barton, C ;

Young, G .

JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1998, 280 (03) :254-257

[4] Effect of structured workshop training on subsequent performance of journal peer reviewers [J].

Callaham, ML ;

Schriger, DL .

ANNALS OF EMERGENCY MEDICINE, 2002, 40 (03) :323-328

[5]

COHEN IT, 2005, J ED PERIOPERATIVE M, P7

[6]

ERNST E, 1994, J LAB CLIN MED, V124, P178

[7]

FLEISS JL, 1989, DESIGN ANAL CLIN EXP

[8] Improving participation and interrater agreement in scoring ambulatory pediatric association abstracts - How well have we succeeded? [J].

Kemper, KJ ;

McCarthy, PL ;

Cicchetti, DV .

ARCHIVES OF PEDIATRICS & ADOLESCENT MEDICINE, 1996, 150 (04) :380-383

[9] MEASUREMENT OF OBSERVER AGREEMENT FOR CATEGORICAL DATA [J].

LANDIS, JR ;

KOCH, GG .

BIOMETRICS, 1977, 33 (01) :159-174

[10] Inter-rater agreement in the scoring of abstracts submitted to a primary care research conference [J].

Montgomery, AA ;

Graham, A ;

Evans, PH ;

Fahey, T .

BMC HEALTH SERVICES RESEARCH, 2002, 2 (1)