RAKING KAPPA - DESCRIBING POTENTIAL IMPACT OF MARGINAL DISTRIBUTIONS ON MEASURES OF AGREEMENT

被引:30
作者
AGRESTI, A [1 ]
GHOSH, A [1 ]
BINI, M [1 ]
机构
[1] UNIV FLORIDA,DEPT STAT,GAINESVILLE,FL 32611
关键词
COHENS KAPPA; RAKED CONTINGENCY TABLES; RATER AGREEMENT; TABLE STANDARDIZATION; WEIGHTED KAPPA;
D O I
10.1002/bimj.4710370705
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Several authors have noted the dependence of kappa measures of inter-rater agreement on the marginal distributions of contingency tables displaying the joint ratings, This paper introduces a smoothed version of kappa computed after raking the table to achieve pre-specified marginal distributions. A comparison of kappa with raked kappa for various margins can indicate the extent of the dependence on the margins, and can indicate how much of the lack of agreement is due to marginal heterogeneity.
引用
收藏
页码:811 / 820
页数:10
相关论文
共 22 条
[1]  
Agresti A, 1992, Stat Methods Med Res, V1, P201, DOI 10.1177/096228029200100205
[2]  
AGRESTI A, 1981, J ROY STAT SOC B MET, V43, P293
[3]  
Agresti A., 1990, CATEGORICAL DATA ANA
[4]  
Becker RA, 1988, WADSWORTH BROOKSCOLE
[5]  
Cohen J., 1960, EDUC PSYCHOL MEAS, V20, P213, DOI DOI 10.1177/001316446002000104
[6]  
COMFORTINI M, 1993, ACTA CYTOL, V37, P49
[7]  
Darroch J.N., 1986, AUSTR J STATIST, V28, P371
[8]   On a least squares adjustment of a sampled frequency table when the expected marginal totals are known [J].
Deming, WE ;
Stephan, FF .
ANNALS OF MATHEMATICAL STATISTICS, 1940, 11 :427-444
[9]   HIGH AGREEMENT BUT LOW KAPPA .1. THE PROBLEMS OF 2 PARADOXES [J].
FEINSTEIN, AR ;
CICCHETTI, DV .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 1990, 43 (06) :543-549
[10]  
FLEISS JL, 1965, ARCH GEN PSYCHIAT, V12, P562