Diagnostic accuracy of a rural live video telepathology system

Accuracy of diagnoses rendered using a live video telepathology network was assessed for permanent sections of surgical pathology specimens. To determine accuracy, telepathology diagnoses were compared with those obtained by directly viewing the glass slide using a standard microscope. A total of 294 cases were read via both telepathology and glass slide by attending pathologists at a tertiary care medical center. Overall accuracy was defined as exact concordance between diagnoses. Clinically insignificant differences in diagnoses were excluded to determine clinically significant accuracy. For the 285 cases with complete data, the overall accuracy for telepathology was 0.912 (95% confidence interval [CI], 0.872-0.941), whereas the overall accuracy for glass slide readings was 0.968 (95% CI, 0.939-0.985). This difference is statistically significant (p = 0.009). When focusing on clinically significant discrepancies, where the difference in diagnosis might affect therapeutic decisions, the video accuracy was only slightly less than the glass slide accuracy (0.965 [95% CI, 0.934-0.982] vs. 0.982 [95% CI, 0.957-0.994], respectively), but this difference is not statistically significant (p = 0.302). Most of the cases with clinically significant differences involved lesions with inherently high interobserver variation. Certainty of diagnosis did not differ between video and glass slide readings (p = 0.911), but there was an association between certainty of diagnosis and diagnostic accuracy for video (p = 0.003 for clinically significant accuracies). Based on these findings, we recommend when using this telepathology system that only preliminary diagnoses should be given in the following situations: for diagnostic areas with known high interobserver variability: when the consultant has any degree of uncertainty about the presence or absence of the lesion in question, and when then is insufficient experience using telepathology as a diagnostic medium.