Conditional inference for subject-specific and marginal agreement: Two families of agreement measures

A two-stage procedure is described for assessing subject-specific and marginal agreement for data from a test-retest reliability study of a binary classification procedure. Subject-specific agreement is parametrized through the log odds ratio, while marginal agreement is reflected by the log ratio of the off-diagonal Poisson means. A family of agreement measures in the interval [-1, 1] is presented for both types of agreement. The conditioning argument described facilitates exact inference. The proposed methodology is demonstrated by way of an example involving hypothetical data chosen for illustrative purposes, and data from a National Health Survey Study (Rogot and Goldberg 1966).