Microscopic measurement of inflammation in synovial tissue: inter-observer agreement for manual quantitative, semiquantitative and computerised digital image analysis

Objectives: To evaluate inter-observer agreement for microscopic measurement of inflammation in synovial tissue using manual quantitative, semiquantitative and computerised digital image analysis. Methods: Paired serial sections of synovial tissue, obtained at arthroscopic biopsy of the knee from patients with rheumatoid arthritis ( RA), were stained immunohistochemically for T lymphocyte ( CD3) and macrophage ( CD68) markers. Manual quantitative and semiquantitative scores for sub-lining layer CD3+ and CD68+ cell infiltration were independently derived in 6 international centres. Three centres derived scores using computerised digital image analysis. Inter-observer agreement was evaluated using Spearman's Rho and intraclass correlation coefficients ( ICCs). Results: Paired tissue sections from 12 patients were selected for evaluation. Satisfactory inter-observer agreement was demonstrated for all 3 methods of analysis. Using manual methods, ICCs for measurement of CD3+ and CD68+ cell infiltration were 0.73 and 0.73 for quantitative analysis and 0.83 and 0.78 for semiquantitative analysis, respectively. Corresponding ICCs of 0.79 and 0.58 were observed for the use of digital image analysis. All ICCs were significant at levels of p, 0.0001. At each participating centre, use of computerised image analysis produced results that correlated strongly and significantly with those obtained using manual measurement. Conclusion: Strong inter-observer agreement was demonstrated for microscopic measurement of synovial inflammation in RA using manual quantitative, semiquantitative and computerised digital methods of analysis. This further supports the development of these methods as outcome measures in RA.