Diabetic retinopathy detection algorithm based on transfer learning

Authors: Huang Yijin,  Lyu Junyan,  Li Meng,  Xia Honghui,  Yuan Jin,  Tang Xiaoying

DOI: 10.3760/cma.j.issn.2095-0160.2019.08.003
Published 2019-08-10
Cite as Chin J Exp Ophthalmol, 2019,37(8): 603-607.

Abstract

Objective

To investigate a diabetic retinopathy (DR) detection algorithm based on transfer learning in small sample dataset.

Methods

Total of 4 465 fundus color photographs taken by Gaoyao People’s Hospital was used as the full dataset.The model training strategies using fixed pre-trained parameters and fine-tuning pre-trained parameters were used as the transfer learning group to compare with the non-transfer learning strategy that randomly initializes parameters.These three training strategies were applied to the training of three deep learning networks: ResNet50, Inception V3 and NASNet.In addition, a small dataset randomly extracted from the full dataset was used to study the impact of the reduction of training data on different strategies.The accuracy and training time of the diagnostic model were used to analyze the performance of different training strategies.

Results

The best results in different network architectures were chosen.The accuracy of the model obtained by fine-tuning pre-training parameters strategy was 90.9%, which was higher than the strategy of fixed pre-training parameters (88.1%) and the strategy of randomly initializing parameters (88.4%). The training time for fixed pre-training parameters was 10 minutes, less than the strategy of fine-tuning pre-training parameters (16 hours) and the strategy of randomly initializing parameters (24 hours). After the training data was reduced, the accuracy of the model obtained by the strategy of randomly initializing parameters decreased by 8.6% on average, while the accuracy of the transfer learning group decreased by 2.5% on average.

Conclusions

The proposed automated and novel DR detection algorithm based on fine-tune and NASNet structure maintains high accuracy in small sample dataset, is found to be robust, and effective for the preliminary diagnosis of DR.

Key words:

Diabetic retinopathy; Transfer learning; NASNet; Medical image classification; Artificial intelligence

Contributor Information

Huang Yijin
Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen 518055, China
Lyu Junyan
Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen 518055, China
Li Meng
Zhongshan Ophthalmic Centre, Sun Yat-sen University, State Key Laboratory of Ophthalmology, Guangzhou 510060, China
Xia Honghui
Department of Ophthalmology, Gaoyao People’s Hospital, Zhaoqing 526040, China
Yuan Jin
Zhongshan Ophthalmic Centre, Sun Yat-sen University, State Key Laboratory of Ophthalmology, Guangzhou 510060, China
Tang Xiaoying
Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen 518055, China
(Read 26 times, 1 visits today)
Updated: September 25, 2019 — 10:21 am