Validation and application of an artificial intelligence robot assisted diagnosis system for diabetic retinopathy

Authors:Gao Shaohui,  Jin Xuemin,  Zhao Zhaoxia,  Yu Weihong,  Chen Youxin,  Sun Yuhui,  Ding Dayong
DOI: 10.3760/cma.j.issn.2095-0160.2019.08.016
Published 2019-08-10
Cite as Chin J Exp Ophthalmol, 2019,37(8): 669-673.

Abstract

Objective

To evaluate the performance of an artificial intelligence (AI) assisted diagnosis system for diabetic retinopathy (DR) based on deep learning theory.

Methods

Diagnostic performance of a robot assisted diagnosis system called SongYue for DR was trained by using 25 297 retinal images tagged by fundus doctors from multiple hospitals in China.Four types of DR detection model consisting of abnormal DR, referable DR, severe non-proliferative and proliferative DR as well as proliferative DR according to fundus leisions identification were established.The ability of the system to distinguish DR was determined by using receiver operator characteristic (ROC) analysis, sensitivity and specificity of the system.

Results

SongYue system achieved an area under the ROC curve (AUC) of 0.920 for successfully distinguishing normal images from those DR with a sensitivity of 96.0% at a specificity of 87.9%.The AUC of SongYue for referable DR was 0.925, sensitivity was 90.4%, and specificity was 95.2%.For severe non-proliferative and proliferative DR, AUC was 0.845, sensitivity was 72.7%, and specificity was 96.2%.For proliferative DR, AUC was 0.855, sensitivity was 73.5%, and specificity was 97.3%.

Conclusions

SongYue robot assisted diagnosis system has high AUC, sensitivity and specificity for identifying DR, showing good clinical applicable benefits.

Key words:

Diabetic retinopathy; Artificial intelligence; Robot; Assisted diagnosis; Deep learning

Contributor Information

Gao Shaohui
Department of Ophthalmology, Henan Provincial People’s Hospital, Henan Eye Hospital, Henan Eye Institute, Zhengzhou 450003, China
Jin Xuemin
Department of Ophthalmology, Henan Provincial People’s Hospital, Henan Eye Hospital, Henan Eye Institute, Zhengzhou 450003, China
Zhao Zhaoxia
Department of Ophthalmology, Henan Provincial People’s Hospital, Henan Eye Hospital, Henan Eye Institute, Zhengzhou 450003, China
Yu Weihong
Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing 100730, China
Chen Youxin
Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing 100730, China
Sun Yuhui
Beijing Visionary Intelligence Technology Ltd., Beijing 100086, China
Ding Dayong
Beijing Visionary Intelligence Technology Ltd., Beijing 100086, China
(Read 26 times, 1 visits today)
Updated: October 9, 2019 — 6:35 am