A NOTE ON INTERRATER AGREEMENT

被引:7
作者
HIRJI, KF
ROSOVE, MH
机构
[1] Department of Epidemiology, Faculty of Medicine, University of Dar Es Salaam
[2] Department of Medicine, UCLA School of Medicine, Los Angeles, California
关键词
D O I
10.1002/sim.4780090713
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
We investigate the properties of a measure of interrater agreement originally proposed by Rogot and Goldberg.1 Unlike commonly used measures, this measure not only adjusts for chance agreement, but it also standardizes for both perfect agreement as well as for perfect disagreement. Further, one can also use this measure to assess category specific conditional agreement, and thus apply it to situations with missing main diagonal data. We provide an asymptotic method for inference with this measure. Copyright © 1990 John Wiley & Sons, Ltd.
引用
收藏
页码:835 / 839
页数:5
相关论文
共 11 条
[1]  
Rogot E., Goldberg I.D., A proposed index for measuring agreement in test‐retest studies, Journal of Chronic Diseases, 19, pp. 991-1006, (1966)
[2]  
Fleiss J.L., Measuring agreement between two judges on the presence or absence of a trait, Biometrics, 31, pp. 651-659, (1975)
[3]  
Cohen J., A coefficient of agreement for nominal scales, Educational and Psychological Measurement, 20, pp. 37-46, (1960)
[4]  
Zwick R., Another look at interrater agreement, Psychological Bulletin, 103, pp. 374-378, (1988)
[5]  
Bishop Y.M.M., Fienberg S.E., Holland P.W., Discrete Multivariate Analysis: Theory and Practice, (1977)
[6]  
Rosove M.H., Brewer P.M.C., Runge A., Hirji K., Simultaneous lupus anticoagulant and anticardiolipin assays and clinical detection of antiphospholipids, American Journal of Hematology, 32, pp. 148-149, (1989)
[7]  
Sptizer R.L., Cohen J., Fleiss J.L., Endicott J., Quantification of agreement in psychiatric diagnosis, Archives of General Psychiatry, 17, pp. 83-87, (1967)
[8]  
Armitage P., Blendis L.M., Smyllie H.C., The measurement of observer disagreement in the recording of signs, Journal of the Royal Statistical Society. Series A (General), 129, pp. 98-109, (1966)
[9]  
Bennett B.M., Measures for clinicians' disagreement over signs, Biometrics, 28, pp. 607-612, (1972)
[10]  
Maxwell A.E., Pilliner A.E.G., Deriving coefficients of reliability and agreement for rating, British Journal of Mathematical and Statistical Psychology, 21, pp. 105-116, (1968)