Establishment and application of diabetic retinopathy intelligent assisted diagnostic technology evaluation system based on fundus photography

Authors: Zheng Bo,  Yang Weihua,  Wu Maonian,  Zhu Shaojun,  Weng Ming,  Zhang Xian,  Zhang Minjun

DOI: 10.3760/cma.j.issn.2095-0160.2019.08.017
Published 2019-08-10
Cite as Chin J Exp Ophthalmol, 2019,37(8): 674-679.

Abstract

Objective

To propose a new evaluation system and evaluate the application value of diabetic retinopathy (DR) intelligence assisted diagnostic technology based on fundus photography.

Methods

By using the diagnostic test method, an evaluation system of DR intelligent diagnostic technology based on fundus photography was established.The fundus photographs of 331 diabetic patients (662 eyes) with DR screening were collected in the First Affiliated Hospital of Huzhou University from January 2017 to October 2018.The results of experts’ diagnosis and intelligence assisted diagnosis were compared and evaluated.The evaluation system includes primary evaluation, intermediate evaluation and advanced evaluation.The primary evaluation is the consistency of non-DR (NDR) in all diabetic patients receiving DR-assisted diagnostic techniques; the intermediate evaluation is the diagnosis consistency of DR lesion degree in patients diagnosed with DR (grade 1-4); the advanced evaluation is the diagnosis consistency of DR classification (grade 0-4) in all diabetic patients receiving DR-assisted diagnostic techniques.The intermediate evaluation includes two evaluation methods.The main evaluation indicators include sensitivity, specificity and Kappa value.

Results

Based on experts’ diagnosis, NDR accounted for 22.7%; mild non-proliferative DR(NPDR), moderate NPDR, and severe NPDR accounted for 19.9%, 18.7% and 25.7%, respectively; proliferative DR(PDR) accounted for 13.0%.Based on intelligence diagnostic system, NDR accounted for 25.8%; mild NPDR, moderate NPDR and severe NPDR accounted for 19.7%, 19.3% and 22.8%, respectively; proliferative DR(PDR) accounted for 12.4%.Based on evaluation system in the paper, the sensitivity, specificity and Kappa value in primary evaluation were 91.4%, 84.7% and 0.72; the sensitivity, specificity and Kappa value in intermediate evaluation method one were 88.4%, 91.1% and 0.79; the sensitivity, specificity and Kappa value in intermediate evaluation method two were 80.5%, 93.3% and 0.75; the Kappa value in advanced evaluation was 0.62.

Conclusions

The evaluation system can be applied to the evaluation of DR intelligent diagnostic technology, and the evaluation result can be used as the basis for the selection of DR intelligent diagnosis application scene.

Key words:

Diabetic retinopathy; Artificial intelligence; Deep learning; Diagnostic imaging; Neural networks; Evaluation system; Intelligent diagnostic technology

Contributor Information

Zheng Bo
Key Laboratory of Medical Artificial Intelligence of Huzhou University, The Information Engineering College of Huzhou University, Huzhou 313000, China
Yang Weihua
Department of Ophthalmology, the First Affiliated Hospital of Huzhou University, Huzhou 313000, China
Wu Maonian
Key Laboratory of Medical Artificial Intelligence of Huzhou University, The Information Engineering College of Huzhou University, Huzhou 313000, China
Zhu Shaojun
Key Laboratory of Medical Artificial Intelligence of Huzhou University, The Information Engineering College of Huzhou University, Huzhou 313000, China
Weng Ming
Department of Ophthalmology, Wuxi Third People’s Hospital, Wuxi 214041, China
Zhang Xian
Department of Ophthalmology, Ningbo Medical Center Lihuili Eastern Hospital, Ningbo 315000, China
Zhang Minjun
Department of Ophthalmology, Huzhou Aier Eye Hospital, Huzhou 313000, China
(Read 41 times, 1 visits today)
Updated: September 26, 2019 — 3:05 am