Publication
Article
Digital Edition
Deep learning discerns IIH, NAION, and normal eyes using single fundus image.
(Image Credit: AdobeStock/AndSus)
We developed a deep learning (DL) system that accurately differentiates optic disc swelling caused by idiopathic intracranial hypertension (IIH) from that of nonarteritic anterior ischemic optic neuropathy (NAION), as well as from healthy eyes, with an externally validated accuracy of 93.6%. Our findings, recently accepted by the American Journal of Ophthalmology1, are especially valuable in emergency departments and underresourced settings where specialists such as neuro-ophthalmologists are unavailable, or where clinicians are not comfortable interpreting fundus photographs.
The model distinguishes IIH, NAION, and healthy eyes using only a single fundus photograph, so it can help health care providers avoid invasive procedures such as lumbar punctures or costly imaging. It also identifies NAION with high accuracy, despite there being no definitive test for NAION and the fact that diagnosis typically hinges on clinical assessment. By accurately recognizing IIH, NAION, or healthy eyes from a single image, this tool bridges a critical gap in timely and accurate neuro-ophthalmic diagnoses.
IIH and NAION both present with optic disc swelling, which can blur the disc margins and lead to visual impairment.2,3 Although the swelling may appear similar in both conditions, the underlying mechanisms are distinct. IIH is linked to increased intracranial pressure without an identifiable structural cause. This condition is most commonly observed in young women with obesity, though it can also affect men and individuals from other demographic groups. NAION is optic nerve head swelling of an unknown etiology, leading to sudden, painless visual loss for which there is currently no treatment. This usually affects older adults, although there can be exceptions. Although neuro-ophthalmologists can often distinguish between these conditions, their subtle differences can cause confusion, especially for nonspecialists or busy clinicians who rarely see such patients.4
DL has quickly become an important tool in ophthalmology. Researchers have already applied DL techniques to identify diabetic retinopathy, glaucoma, and age-related macular degeneration in fundus photographs. Building on these successes, we and others have used DL to assess the severity of optic disc edema in neuro-ophthalmic disorders.5-17 These achievements, combined with the widespread availability and cost of fundus cameras, suggest that automated image analysis can significantly improve diagnostic efficiency, even in urgent or resource-limited settings.
We compiled more than 15,000 fundus photographs of the 3 categories. The IIH images were primarily drawn from a multicenter clinical trial18 and supplemented with real-world photographs of mild and severe IIH from several neuro-ophthalmology clinics. All photographs showed a Frisén grade of 1 or higher. The NAION photographs came from a large, prospective study of acute NAION19, supplemented with acute cases from multiple neuro-ophthalmology clinics. In addition, we collected healthy-eye images from healthy fellow eyes in the trials, clinics, and various public databases.20,21 These datasets spanned different imaging devices and resolutions to make the model more robust.
We excluded images that were too blurry or improperly exposed, or in which the optic disc was not centered. This filtering process prevented the system from picking up extraneous artifacts and forced it to focus on the optic disc and peripapillary retina.
We fine-tuned a ResNet-50 architecture initially trained on millions of natural images.22 After random rotations, translations, and color transformations, each fundus image was normalized and cropped so the optic disc was at the center. This approach reduced the chance that the model would memorize unique features from duplicate images of the same eye. We then evaluated the final model on an external dataset of more than 1100 previously unseen images—featuring new patients, varying demographics, and different cameras—to assess its ability to generalize to novel data.
On the internal validation sets, our model achieved an accuracy of 96.2%, with precision, recall, and F1 scores similarly high for IIH, NAION, and healthy eyes. In our external validation set, we reached 93.6% accuracy with F1 scores ranging from 0.90 – 0.95 and a macro-average area under the curve-receiver operating characteristic of 0.980 (Figure 1).1
Figure 1. Confusion Matrix and Receiver Operating Characteristic1. At left: External validation confusion matrix. Our model achieved an accuracy of 93.6% with precision values of 0.98, 0.93, and 0.91, recall values of 0.90, 0.88, and 1.00, and F1 scores of 0.94, 0.90, and 0.95 for eyes with idiopathic intracranial hypertension (IIH), nonarteritic anterior ischemic optic neuropathy (NAION), and healthy eyes, respectively. At right: Receiver operating characteristic curves for each class with a macroaverage area under the curve (AUC) of 0.980
One interesting aspect of our research was the use of heat maps, or areas within an image that the model highlights as important for determining the final diagnosis. In many photographs with IIH, the system appeared to focus on the inferior portion of the optic disc, which aligns with previous reports that inferior peripapillary nerve fiber layers are often thickened in papilledema. In NAION, the superior part of the disc was frequently emphasized, consistent with the common inferior hemifield visual defect observed in this disease.
With healthy eyes, the activations were often more uniform across the entire disc(Figure 2).1 This distinction is important because the underlying cause of NAION remains unknown, and identifying consistently emphasized regions may help guide future research toward understanding the disease’s mechanisms and affected structures.
Figure 2. Class-Wise Activation Maps1. Top row: Activation maps from the final gradient-weighted class activation mapping layer overlaid on photographs from each category from our external validation set, with each column representing one class. Bottom row: Average activation maps on centered optic discs for each class in external validation. Activation for idiopathic intracranial hypertension (IIH) focused on the inferior optic disc; for nonarteritic anterior ischemic optic neuropathy (NAION), it focused on the superior optic disc; and for healthy eyes, it focused on the entire disc. (Images courtesy of Szanto D, Erekat A, Woods B, et al1)
We believe our findings are especially relevant for emergency departments and remote clinics that may not have immediate access to neuro-ophthalmologists. Many providers may not feel comfortable capturing and interpreting fundus photographs. Our DL tool can support clinicians by quickly evaluating whether disc swelling aligns with papilledema, appears normal, or suggests the possibility of NAION in uncertain cases. This can reduce unnecessary referrals and potentially avoid some imaging tests or procedures if the system indicates that the optic disc appears normal. That does not replace expert evaluation, but it can serve as a triage tool.
Although we have confidence in the system’s performance, we do not advocate relying on a DL prediction alone to make definitive clinical decisions. Our approach is designed to complement clinical judgment. A single fundus photograph can miss certain pathologies. The best practice remains to combine findings with other imaging, labs, and a careful clinical history.
Our DL system offers a promising solution for differentiating papilledema from NAION and healthy eyes using a single fundus photograph. The level of accuracy and consistency across different datasets suggests that it can provide valuable support in a variety of clinical environments. We see potential applications ranging from emergency triage to routine follow-up visits, especially in places where ophthalmic care is limited. As we further develop and validate this model, we hope it will serve as a practical resource for many health care providers, promoting timely recognition of disc swelling and improving patient care.
Don’t miss out—get Ophthalmology Times updates on the latest clinical advancements and expert interviews, straight to your inbox.