R(WG) - AN ASSESSMENT OF WITHIN-GROUP INTERRATER AGREEMENT

被引:1722
作者
JAMES, LR
DEMAREE, RG
WOLF, G
机构
[1] TEXAS CHRISTIAN UNIV,DEPT PSYCHOL,FT WORTH,TX 76129
[2] SUNY STONY BROOK,DEPT MANAGEMENT,STONY BROOK,NY 11794
关键词
D O I
10.1037/0021-9010.78.2.306
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
Schmidt and Hunter (1989) critiqued the within-group interrater reliability statistic (r(wg)) described by James, Demaree, and Wolf(1984). Kozlowski and Hattrup (1992) responded to the Schmidt and Hunter critique and argued that r(wg) is a suitable index of interrater agreement. This article focuses on the interpretation of r(wg) as a measure of agreement among judges' ratings of a single target. A new derivation of r(wg) is given that underscores this interpretation.
引用
收藏
页码:306 / 309
页数:4
相关论文
共 23 条
[1]  
ALGINA J, 1978, PSYCHOL BULL, V85, P135
[2]  
[Anonymous], 1971, STAT PRINCIPLES EXPT
[3]  
BARTKO JJ, 1978, PSYCHOL BULL, V85, P139
[4]   VARIOUS INTRACLASS CORRELATION RELIABILITY COEFFICIENTS [J].
BARTKO, JJ .
PSYCHOLOGICAL BULLETIN, 1976, 83 (05) :762-765
[5]   RESPONSE SETS AND TEST VALIDITY [J].
Cronbach, Lee J. .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1946, 6 (04) :475-494
[6]   FURTHER EVIDENCE ON RESPONSE SETS AND TEST DESIGN [J].
Cronbach, Lee J. .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1950, 10 (01) :3-31
[7]  
CRONBACH LJ, 1972, DEPENDABILITY BEHAVI
[8]   A NOTE ON ESTIMATING RELIABILITY OF CATEGORICAL DATA [J].
FINN, RH .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1970, 30 (01) :71-&
[9]  
Guilford J. P., 1954, J EDUC PSYCHOL, Vsecond
[10]   SUPERIORS EVALUATIONS AND SUBORDINATES PERCEPTIONS OF TRANSFORMATIONAL AND TRANSACTIONAL LEADERSHIP [J].
HATER, JJ ;
BASS, BM .
JOURNAL OF APPLIED PSYCHOLOGY, 1988, 73 (04) :695-702