Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices

被引:830
作者
Abramoff, Michael D. [1 ,2 ,3 ,4 ]
Lavin, Philip T. [5 ]
Birch, Michele [6 ]
Shah, Nilay [7 ]
Folk, James C. [1 ,2 ,3 ]
机构
[1] Univ Iowa, Dept Ophthalmol & Visual Sci, Iowa City, IA 52242 USA
[2] Vet Adm Med Ctr, Iowa City, IA 52242 USA
[3] IDx LLC, Coralville, IA 52241 USA
[4] Univ Iowa, Inst Vis Res, Iowa City, IA 52242 USA
[5] Boston Biostat Res Fdn Inc, 3 Cahill Pk Dr, Framingham, MA 01702 USA
[6] Univ N Carolina, Sch Med, Acad Serv, Dept Family Med, Charlotte, NC 28204 USA
[7] Emmes Corp, 401 North Washington St,Suite 700, Rockville, MD 20850 USA
来源
NPJ DIGITAL MEDICINE | 2018年 / 1卷
关键词
COLOR FUNDUS PHOTOGRAPHS; AUTOMATED DETECTION; VISUAL RECOGNITION; FOLLOW-UP; SPECIFICITY; SENSITIVITY; POPULATION; GLAUCOMA; PROGRAM; LESIONS;
D O I
10.1038/s41746-018-0040-6
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Artificial Intelligence (AI) has long promised to increase healthcare affordability, quality and accessibility but FDA, until recently, had never authorized an autonomous AI diagnostic system. This pivotal trial of an AI system to detect diabetic retinopathy (DR) in people with diabetes enrolled 900 subjects, with no history of DR at primary care clinics, by comparing to Wisconsin Fundus Photograph Reading Center (FPRC) widefield stereoscopic photography and macular Optical Coherence Tomography (OCT), by FPRC certified photographers, and FPRC grading of Early Treatment Diabetic Retinopathy Study Severity Scale (ETDRS) and Diabetic Macular Edema (DME). More than mild DR (mtmDR) was defined as ETDRS level 35 or higher, and/or DME, in at least one eye. AI system operators underwent a standardized training protocol before study start. Median age was 59 years (range, 22-84 years); among participants, 47.5% of participants were male; 16.1% were Hispanic, 83.3% not Hispanic; 28.6% African American and 63.4% were not; 198 (23.8%) had mtmDR. The AI system exceeded all pre-specified superiority endpoints at sensitivity of 87.2% (95% CI, 81.8-91.2%) (> 85%), specificity of 90.7% (95% CI, 88.3-92.7%) (> 82.5%), and imageability rate of 96.1% (95% CI, 94.6-97.3%), demonstrating AI's ability to bring specialty-level diagnostics to primary care settings. Based on these results, FDA authorized the system for use by health care providers to detect more than mild DR and diabetic macular edema, making it, the first FDA authorized autonomous AI diagnostic system in any field of medicine, with the potential to help prevent vision loss in thousands of people with diabetes annually.
引用
收藏
页数:8
相关论文
共 60 条
[1]   Effect of ruboxistaurin on visual loss in patients with diabetic retinopathy [J].
Abraham, Prema ;
Adelman, Ron A. ;
Alfaro, Daniel Virgil, III ;
Anand, Rajiv ;
Antoszyk, Andrew ;
Bergsma, Donald ;
Hartnett, Mary Elizabeth ;
Brucker, Alexander J. ;
Carr, Tyree ;
Casey, Raynor C. ;
Rubino, John ;
Chandler, Thomas W. ;
Charles, Steven ;
Chaudhry, Nauman ;
Combs, James ;
Doft, Bernard ;
Young, Lucy H. Y. ;
Drouilhet, John H. ;
Dugel, Pravin U. ;
Feman, Stephen S. ;
Finkelstein, Daniel ;
Foster, Robert E. ;
Petersen, Michael R. ;
Fox, Gregory ;
Garretson, Bruce ;
Gieser, Jon P. ;
Gentile, Ronald C. ;
Giovinazzo, Vincent ;
Glazer, Louis ;
Goodart, Roy A. ;
Gottlieb, Justin ;
Greven, Craig ;
Grizzard, William S. ;
Hainsworth, Dean P. ;
Halperin, Lawrence ;
Heier, Jeffrey S. ;
Jackson, William ;
Kubacki, Joseph J. ;
Kanter, Eric D. ;
Keyser, Bruce ;
Kingsley, Ronald ;
Ko, Paula ;
Kokame, Gregg T. ;
Kuppermann, Baruch ;
Lambert, H. Michael ;
Lewis, Hilel ;
Lewis, Richard Alan ;
Marcus, Dennis ;
Nussbaum, Julian ;
Maturi, Raj K. .
OPHTHALMOLOGY, 2006, 113 (12) :2221-2230
[2]  
Abramoff M., 2000, Comp. Assi. Fun. Image Anal, V15
[3]   Web-based screening for diabetic retinopathy in a primary care population: The EyeCheck project [J].
Abramoff, MD ;
Suttorp-Schulten, MSA .
TELEMEDICINE JOURNAL AND E-HEALTH, 2005, 11 (06) :668-674
[4]   Automated segmentation of the optic disc from stereo color photographs using physiologically plausible features [J].
Abramoff, Michael D. ;
Alward, Wallace L. M. ;
Greenlee, Emily C. ;
Shuba, Lesya ;
Kim, Chan Y. ;
Fingert, John H. ;
Kwon, Young H. .
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2007, 48 (04) :1665-1673
[5]   Automated Analysis of Retinal Images for Detection of Referable Diabetic Retinopathy [J].
Abramoff, Michael D. ;
Folk, James C. ;
Han, Dennis P. ;
Walker, Jonathan D. ;
Williams, David F. ;
Russell, Stephen R. ;
Massin, Pascale ;
Cochener, Beatrice ;
Gain, Philippe ;
Tang, Li ;
Lamard, Mathieu ;
Moga, Daniela C. ;
Quellec, Gwenole ;
Niemeijer, Meindert .
JAMA OPHTHALMOLOGY, 2013, 131 (03) :351-357
[6]   Automated Early Detection of Diabetic Retinopathy [J].
Abramoff, Michael D. ;
Reinhardt, Joseph M. ;
Russell, Stephen R. ;
Folk, James C. ;
Mahajan, Vinit B. ;
Niemeijer, Meindert ;
Quellec, Gwenole .
OPHTHALMOLOGY, 2010, 117 (06) :1147-1154
[7]   Evaluation of a System for Automatic Detection of Diabetic Retinopathy From Color Fundus Photographs in a Large Population of Patients With Diabetes [J].
Abramoff, Michael D. ;
Niemeijer, Meindert ;
Suttorp-Schulten, Maria S. A. ;
Viergever, Max A. ;
Russell, Stephen R. ;
van Ginneken, Bram .
DIABETES CARE, 2008, 31 (02) :193-198
[8]   Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning [J].
Abramoff, Michael David ;
Lou, Yiyue ;
Erginay, Ali ;
Clarida, Warren ;
Amelon, Ryan ;
Folk, James C. ;
Niemeijer, Meindert .
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2016, 57 (13) :5200-5206
[9]   The sensitivity and specificity of nonmydriatic digital stereoscopic retinal imaging in detecting diabetic retinopathy [J].
Ahmed, Jehanara ;
Ward, Thomas P. ;
Bursell, Sven-Eric ;
Aiello, Lloyd M. ;
Cavallerano, Jerry D. ;
Vigersky, Robert A. .
DIABETES CARE, 2006, 29 (10) :2205-2209
[10]   13. Diabetes Care in the Hospital [J].
不详 .
DIABETES CARE, 2016, 39 :S99-S104