USING REPLICATE OBSERVATIONS IN OBSERVER AGREEMENT STUDIES WITH BINARY ASSESSMENTS

被引:24
作者
BAKER, SG [1 ]
FREEDMAN, LS [1 ]
PARMAR, MKB [1 ]
机构
[1] MRC,CANC TRIALS OFF,CAMBRIDGE CB2 2BW,ENGLAND
关键词
CATEGORICAL DATA; EM ALGORITHM; LATENT VARIABLES;
D O I
10.2307/2532389
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
By introducing replicate observations into observer agreement studies, one can obtain better measures of observer agreement than heretofore possible. New methodology based on the analysis of latent variables allows a separation of within- and between-observer variation for binary measures of assessment among pairs of observers. Maximum likelihood estimation and hypothesis testing are discussed. The methodology is illustrated using data on the assessment of dysplasia by pathologists.
引用
收藏
页码:1327 / 1338
页数:12
相关论文
共 24 条
[1]   A MODEL FOR AGREEMENT BETWEEN RATINGS ON AN ORDINAL SCALE [J].
AGRESTI, A .
BIOMETRICS, 1988, 44 (02) :539-548
[2]   REGRESSION-ANALYSIS FOR CATEGORICAL VARIABLES WITH OUTCOME SUBJECT TO NONIGNORABLE NONRESPONSE [J].
BAKER, SG ;
LAIRD, NM .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1988, 83 (401) :62-69
[3]   TUBERCULOSIS CASE FINDING - A COMPARISON OF THE EFFECTIVENESS OF VARIOUS ROENTGENOGRAPHIC AND PHOTOFLUOROGRAPHIC METHODS [J].
BIRKELO, CC ;
CHAMBERLAIN, WE ;
PHELPS, PS ;
SCHOOLS, PE ;
ZACKS, D ;
YERUSHALMY, J .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1947, 133 (06) :359-366
[4]   A NEW VIEW OF INTER-OBSERVER AGREEMENT [J].
BURDOCK, EI ;
FLEISS, JL ;
HARDESTY, AS .
PERSONNEL PSYCHOLOGY, 1963, 16 (04) :373-384
[6]  
Dawid A. P., 1979, J R STAT SOC C-APPL, V28, P20, DOI [10.2307/2346806, DOI 10.2307/2346806]
[7]  
Ebel RL., 1951, PSYCHOMETRIKA, V16, P407
[8]  
Efron B., 1985, BEHAVIORMETRIKA, V12, P1
[9]   MAXIMUM-LIKELIHOOD ESTIMATION AND MODEL SELECTION IN CONTINGENCY-TABLES WITH MISSING DATA [J].
FUCHS, C .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1982, 77 (378) :270-278
[10]   EXPLORATORY LATENT STRUCTURE-ANALYSIS USING BOTH IDENTIFIABLE AND UNIDENTIFIABLE MODELS [J].
GOODMAN, LA .
BIOMETRIKA, 1974, 61 (02) :215-231