REAL-WORLD PRACTICE OF ARTIFICIAL INTELLIGENCE DIAGNOSTIC SYSTEM FOR DIABETIC RETINOPATHY IN TAIWAN.

Abstract

The authors evaluated the alterations of applying artificial intelligence (AI) diagnostic system for diabetic retinopathy screening in real-world practice. This retrospective study included 11,713 diabetic patients from the government-led Diabetes Shared Care Network. The AI system VeriSee DR was integrated into the clinical workflow to identify referable diabetic retinopathy (RDR). Its performance was compared with ophthalmologist grading at the patient level using sensitivity, specificity, accuracy, positive predictive value, negative predictive value, and area under the receiver operating characteristic curve. Subgroup analysis was performed by age and sex, with additional referral diseases identified by ophthalmologists. VeriSee DR achieved a sensitivity of 0.88, specificity of 0.86, accuracy of 0.86, positive predictive value of 0.58, negative predictive value of 0.97, and area under the receiver operating characteristic curve of 0.87 in detecting RDR. Performance declined with increasing age, whereas sex distribution remained consistent across age groups. The AI system identified a higher proportion of RDR than ophthalmologists (27.45% vs. 18.15%). In addition to 1,818 patients with RDR, ophthalmologists identified other referral-warranted ocular conditions in 4.5% of cases. The AI system referred age-related macular degeneration (Grades 2-4), whereas referral decisions for macular hole and macular edema (Grades 1-2) varied; however, glaucoma (Grades 0-1) identified by clinicians was not consistently referred. VeriSee DR demonstrated high accuracy in detecting RDR but exhibited reduced performance in older patients. It had a higher referral rate than ophthalmologists yet missed certain conditions such as glaucoma. Despite effectiveness in diabetic retinopathy screening, further refinement is required to support broader ophthalmic disease detection.