A Mathematical Framework for Combining Decisions of Multiple Experts toward Accurate and Remote Diagnosis of Malaria Using Tele-Microscopy

被引:20
作者
Mavandadi, Sam [1 ,2 ]
Feng, Steve [1 ,2 ]
Yu, Frank [1 ,2 ]
Dimitrov, Stoyan [1 ,2 ]
Nielsen-Saines, Karin [3 ]
Prescott, William R. [4 ]
Ozcan, Aydogan [1 ,2 ,5 ,6 ]
机构
[1] Univ Calif Los Angeles, Dept Elect Engn, Los Angeles, CA 90024 USA
[2] Univ Calif Los Angeles, Dept Bioengn, Los Angeles, CA USA
[3] Univ Calif Los Angeles, Sch Med, Dept Pediat, Div Infect Dis, Los Angeles, CA 90024 USA
[4] Hydas World Hlth, Hershey, PA USA
[5] Univ Calif Los Angeles, Calif NanoSyst Inst, Los Angeles, CA USA
[6] Univ Calif Los Angeles, David Geffen Sch Med, Dept Surg, Los Angeles, CA 90095 USA
来源
PLOS ONE | 2012年 / 7卷 / 10期
基金
美国国家科学基金会;
关键词
IMAGE-ANALYSIS; PERFORMANCE;
D O I
10.1371/journal.pone.0046192
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
We propose a methodology for digitally fusing diagnostic decisions made by multiple medical experts in order to improve accuracy of diagnosis. Toward this goal, we report an experimental study involving nine experts, where each one was given more than 8,000 digital microscopic images of individual human red blood cells and asked to identify malaria infected cells. The results of this experiment reveal that even highly trained medical experts are not always self-consistent in their diagnostic decisions and that there exists a fair level of disagreement among experts, even for binary decisions (i.e., infected vs. uninfected). To tackle this general medical diagnosis problem, we propose a probabilistic algorithm to fuse the decisions made by trained medical experts to robustly achieve higher levels of accuracy when compared to individual experts making such decisions. By modelling the decisions of experts as a three component mixture model and solving for the underlying parameters using the Expectation Maximisation algorithm, we demonstrate the efficacy of our approach which significantly improves the overall diagnostic accuracy of malaria infected cells. Additionally, we present a mathematical framework for performing 'slide-level' diagnosis by using individual 'cell-level' diagnosis data, shedding more light on the statistical rules that should govern the routine practice in examination of e.g., thin blood smear samples. This framework could be generalized for various other tele-pathology needs, and can be used by trained experts within an efficient tele-medicine platform.
引用
收藏
页数:10
相关论文
共 34 条
[21]  
Menze BH, 2011, REC TECHN APPL MED I
[22]  
Montillo A, 2011, LECT NOTES COMPUT SC, V6801, P184, DOI 10.1007/978-3-642-22092-0_16
[23]   Automated image analysis in histopathology: a valuable tool in medical diagnostics [J].
Mulrane, Laoighse ;
Rexhepaj, Elton ;
Penney, Steve ;
Callanan, John J. ;
Gallagher, William M. .
EXPERT REVIEW OF MOLECULAR DIAGNOSTICS, 2008, 8 (06) :707-725
[24]   Simple steps for improving multiple-reader studies in radiology [J].
Obuchowski, NA ;
Zepp, RC .
AMERICAN JOURNAL OF ROENTGENOLOGY, 1996, 166 (03) :517-521
[25]   New methodological tools for multiple-reader ROC studies [J].
Obuchowski, Nancy A. .
RADIOLOGY, 2007, 243 (01) :10-12
[26]  
Papoulis A., 1984, PROBABILITY RANDOM V
[27]   Performance of a malaria microscopy image analysis slide reading device [J].
Prescott, William R. ;
Jordan, Robert G. ;
Grobusch, Martin P. ;
Chinchilli, Vernon M. ;
Kleinschmidt, Immo ;
Borovsky, Joseph ;
Plaskow, Mark ;
Torrez, Miguel ;
Mico, Maximo ;
Schwabe, Christopher .
MALARIA JOURNAL, 2012, 11
[28]  
Raykar VC., 2009, P 26 ANN INT C MACH, P889, DOI [10.1145/1553374.1553488, DOI 10.1145/1553374.1553488]
[29]  
Raykar VC, 2010, J MACH LEARN RES, V11, P1297
[30]   A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard [J].
Reitsma, Johannes B. ;
Rutjes, Anne W. S. ;
Khan, Khalid S. ;
Coomarasamy, Arri ;
Bossuyt, Patrick M. .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2009, 62 (08) :797-806