Abstract [View PDF] [Read Full Text]
Objective
To investigate a diabetic retinopathy (DR) detection algorithm based on transfer learning in small sample dataset.
Methods
Total of 4 465 fundus color photographs taken by Gaoyao People’s Hospital was used as the full dataset.The model training strategies using fixed pre-trained parameters and fine-tuning pre-trained parameters were used as the transfer learning group to compare with the non-transfer learning strategy that randomly initializes parameters.These three training strategies were applied to the training of three deep learning networks: ResNet50, Inception V3 and NASNet.In addition, a small dataset randomly extracted from the full dataset was used to study the impact of the reduction of training data on different strategies.The accuracy and training time of the diagnostic model were used to analyze the performance of different training strategies.
Results
The best results in different network architectures were chosen.The accuracy of the model obtained by fine-tuning pre-training parameters strategy was 90.9%, which was higher than the strategy of fixed pre-training parameters (88.1%) and the strategy of randomly initializing parameters (88.4%). The training time for fixed pre-training parameters was 10 minutes, less than the strategy of fine-tuning pre-training parameters (16 hours) and the strategy of randomly initializing parameters (24 hours). After the training data was reduced, the accuracy of the model obtained by the strategy of randomly initializing parameters decreased by 8.6% on average, while the accuracy of the transfer learning group decreased by 2.5% on average.
Conclusions
The proposed automated and novel DR detection algorithm based on fine-tune and NASNet structure maintains high accuracy in small sample dataset, is found to be robust, and effective for the preliminary diagnosis of DR.