Abstract
Ophthalmology is a subject that highly depends on imaging examination. Artificial intelligence (AI) technology has great potential in medical imaging analysis, including image diagnosis, classification, grading, guiding treatment and evaluating prognosis. The combination of the two can realize mass screening of grass-roots eye health, making it possible to seek medical treatment in the mode of “first treatment at the grass-roots level, two-way referral, emergency and slow treatment, and linkage between the upper and lower levels”. On the basis of summarizing the AI technology carried out by scholars and their teams all over the world in the field of ophthalmology, quite a lot of studies have confirmed that machine learning can assist in diagnosis, grading, providing optimal treatment plans and evaluating prognosis in corneal and conjunctival diseases, ametropia, lens diseases, glaucoma, iris diseases, etc. This paper systematically shows the application and progress of AI technology in common anterior segment ocular diseases, the current limitations, and prospects for the future.
Keywords: artificial intelligence, anterior segment ocular disease, ametropia, glaucoma
INTRODUCTION
The eye is the only part of the body that can directly observe blood vessels and nerves in vivo. Many types of medical images about this part, such as fundus photography, optical coherence tomography (OCT), slit lamp photography and so on, have the advantages of non-invasive and economical. Therefore, ophthalmology is a subject that highly depends on imaging examination, and the diagnosis of many eye diseases depends to a large extent on the results of imaging examination. At present, artificial intelligence (AI) technology is mainly used in medical imaging analysis, including automatic detection of disease occurrence, screening, diagnosis and grading, treatment guidance, quantification of treatment effect and identification of new treatment methods. Thus it can be seen that the combination of AI and ophthalmology has a great application prospect, and the development of ophthalmic AI is of great significance to realize the individual management of patients and to carry out large-scale eye health screening in different age groups.
WHAT IS ARTIFICIAL INTELLIGENCE?
AI is a new technology to develop theories, methods and technologies used to simulate and expand human intelligence. Machine learning (ML) is one of the research directions in this field, which aims to make computer systems extract generalized rules from data by algorithms characterized by “learning”. We can categorize ML into two main types: conventional machine learning (CML) and deep learning (DL). CML models, like support vector machines (SVM), random forests (RF), decision trees (DT), linear regression, and logistic regression, are often used for tasks like disease diagnosis or classification using medical records or population data. These models don't typically involve complex neural networks. On the other hand, DL is more commonly applied to multimedia data such as images, sound, and videos. DL utilizes large neural networks like artificial neural network (ANN), recurrent neural network (RNN), and convolutional neural network (CNN) to analyze and process these types of data[1]. The basic concept of operation is that the engineer encodes the clinician's decision and cognition into a set of databases that can be executed by computer algorithms[2]. At present, image classification by DL is the most common application, such as distinguishing whether there is a disease or classifying the severity of the disease[3]–[4]. AI can also contribute to improving the methods of diagnosis and detection. The most important thing to evaluate AI system is the accuracy of the model, which is usually described by data such as area under curve (AUC), sensitivity and specificity.
The current research[5] showed that in order to make full use of the complementarity of different modal images, it was necessary to shift from single-modal DL to multimodal DL, which means that the results of different types of imaging examinations were used as training sets to improve the accuracy of AI in the diagnosis. A work reported by Peking Union Medical College Hospital at the meeting of the International Association for Vision and Ophthalmology Research in 2021[6] showed that the multimodal DL model with color fundus photograph and OCT image sequences as input can be used to detect a variety of common ocular fundus diseases that cause blindness.
ANTERIOR SEGMENT DISEASES & ARTIFICIAL INTELLIGENCE
Anterior segment diseases refer to pathologies affecting the eyelids, conjunctiva, cornea, anterior chamber, iris and lens. These diseases can be caused by various factors, including infections, autoimmune diseases, trauma, etc. Early detection and appropriate management are crucial in controlling disease progression and optimizing treatment outcomes for anterior segment disorders.
Although application of AI in anterior segment diseases is later than that in fundus diseases, quite a lot of studies had confirmed that ML can assist in diagnosis, grading, providing optimal treatment plans and evaluating prognosis in corneal and conjunctival diseases, ametropia, lens diseases, glaucoma, iris diseases, etc. The accuracy of some of them can be comparable to the level of ophthalmologists. We will introduce the latest research and application of ML in different kinds of diseases mentioned above.
Application of Artificial Intelligence in Corneal Diseases
Corneal diseases frequently result in vision impairment, causing symptoms such as blurred vision, reduced visual acuity, and in severe cases, blindness. At present, it is known that ML models using the slit lamp photography, corneal topography, anterior segment optical coherence tomography (AS-OCT) and corneal confocal microscope examination are able to complete the detection of keratoconus, preoperative screening of postoperative dilatation risk, diagnosis of infectious keratitis, prediction of complications after keratoplasty and so on[7].
Keratoconus
Keratoconus is a non-inflammatory asymmetrical progressive dilated eye disease of bilateral cornea, which can lead to irregular astigmatism and high myopia, resulting in serious visual impairment. Lavric and Valentin[8] reported a CNN method called “KeratoDetect” for detecting keratoconus. The 3000 corneal topographic maps (half from healthy eyes and the other half from eyes diagnosed with keratoconus) were used for training. The verification set was 150 eyes, and the accuracy of the test set on 200 eyes was 99.3%. Kamiya et al[9] obtained a six-color coding map with the method of AS-OCT, which can be used to distinguish keratoconus from normal cornea and to grade the severity of the disease. In the treatment of keratoconus, Lyra et al[10] established a computer model based on ML and corneal tomographic data to predict the asphericity and average corneal thickness after intrastromal corneal ring segments (ICRS), which is helpful to make a better surgical plan to improve the prognosis. Different types of corneal rings have different thickness, diameter and profile. ICRS can be perfectly designed for patients according to ametropia, corneal thickness and corneal curvature.
Infectious keratitis
Infectious keratitis is a corneal disease that occurs in a short time and progresses rapidly and may cause corneal perforation and intraocular infection. It is the primary cause of corneal blindness globally[11]. The staining and culture of corneal scraping under microscope is the gold standard for determining the pathogenic microorganisms of infectious keratitis.
Kuo et al[12] effectively created a DL-based model for corneal photograph analysis, achieving an average accuracy of 70% in detecting fungal keratitis. This performance was similar to that of non-corneal specialist ophthalmologists. Zhang et al[13] employed model blending technology to create KeratitisNet, showcasing the highest average accuracy among various model development approaches. Hung et al[14] created DL models to distinguish between bacterial keratitis and fungal keratitis, achieving a maximum average accuracy of 80.0% with slit-lamp images obtained from 580 patients. In the study by Ghosh et al[15], CNN models were assessed for the ability to rapidly differentiate between fungal keratitis and bacterial keratitis. The top-performing model achieved an AUC of 0.86 using slit-lamp images from 194 patients. In another study conducted by Li et al[16], smartphone macro corneal photography was incorporated as a dataset. Surprisingly, this approach yielded promising results, with the top-performing algorithm achieving an AUC of 0.967 in detecting keratitis.
Keratoplasty
AI also has related research and application in keratoplasty. Using a DL-based classifier, Treder et al[17] reported a reliable automatic detection of keratograft dislocation in descemet membrane endothelial keratoplasty using a training set consisting of 1172 AS-OCT images (609 attached keratografts and 563 separate keratografts). Through the test set consisting of 100 AS-OCT images, the sensitivity of the classifier is up to 98%, the specificity is 94%, and the accuracy is 96%. Hayashi et al[18] established a VGG19 model, which used the rebubbling standard that keratograft detachment reached the central pupil region within 4.0 mm to determine whether anterior chamber needed to be bubbled again after descemet membrane endothelial keratoplasty. The AUC, sensitivity and specificity of the model are 0.96, 96.7%, and 91.5%, respectively.
Application of Artificial Intelligence in Conjunctival Diseases
Pterygium
Pterygium is a kind of fibrovascular tissue which originates from the conjunctiva and even spreads over the limbus. When pterygium grows to cover the iris and pupil area, it can lead to visual impairment. Due to uneven and irregular corneal curvature, corneal deformation caused by pterygium may lead to astigmatism. In the clinical process, the identification and diagnosis of pterygium usually requires to be stained by fluorescein in order to highlight the pterygium tissue, which is kind of invasive because it needs to drip fluorescein onto the surface of the eyeball. Gao et al[19] proposed a cortical cataract automatic grading system using an image processing algorithm for pterygium detection. They used color information to detect if there is pterygium in the sclera and pupil areas. Mesquita and Figueiredo[20] used ML to segment iris and the region growth algorithm to detect the progress of pterygium tissue. Wan Zaka et al[21] proposed a pterygium screening system by analyzing corneal morphologic features obtained from anterior segment images taken by smart phones. The systems above are mainly used to distinguish pterygium from normal cornea, and the prospective application of AI in pterygium can be the development of automatic pterygium grading system.
Trachoma
Despite considerable advancements in disease control efforts, trachoma remains the primary infectious cause of blindness worldwide. Socia et al[22] utilized a dataset comprising 2300 images, with a 5% positivity rate for trachomatous inflammation follicular. They constructed classifiers by employing two cutting-edge CNN architectures, ResNet101 and VGG16, and utilized various data augmentation and oversampling techniques on positive images. The top-performing models achieved a sensitivity of 95% and a positive predictive value ranging from 50% to 70%.
Application of Artificial Intelligence in Dry Eye Disease
Dry eye disease (DED) is a prevalent ocular condition affecting 10%–40% of the global population. It is characterized by disturbances in tear film composition, including hyperosmolarity and tear film instability, leading to multifactorial ocular surface issues[23].
Llorens-Quintana et al[24] devised a novel algorithm for automatically detecting the meibomian gland (MG) area and objectively analyzing the morphological characteristics of it. Wang et al[25] introduced a DL model built upon VGGNet-13 for automatically detecting lid margin abnormalities, which could indicate DED, in anterior segment photographs. Saha et al[26] introduced a classification-focused DL model for swift, automated, and unbiased assessment of MG morphological characteristics. This model encompasses MG segmentation, quantitative analysis of MG area and ratio, and determination of the meiboscore. It achieved accuracies of 73.01% and 59.17% for meiboscore classification on the validation set and images from independent centers, respectively. da Cruz et al[27] introduced an ML approach for classifying tear interferometry images, employing texture analysis with phylogenetic diversity indices. The RF classifier exhibited the most favorable outcomes, achieving an accuracy surpassing 97% and an AUC of 0.99.
Application of Artificial Intelligence in Ametropia
Ametropia, such as hyperopia, myopia, and astigmatism, are prevalent eye conditions. In China, the increasing prevalence of myopia in children has emerged as a significant societal concern.
Barraza-Bernal et al's[28] research utilized population-based data from Chinese children to create an ML algorithm for assessing the risk of myopia onset and progression. The most effective algorithm emerged from a blend of support vector regression and Gaussian process regression. In Lin et al's[29] research, the RF model can forecast the onset of high myopia by the age of 18 as early as 8y beforehand, achieving clinically acceptable accuracy through long-term refraction data. In addition, instead of relying on mydriatic optometry, utilizing SVM and gradient boosting regression tree for a comprehensive evaluation of axial length elongation, a crucial marker for high myopia, can effectively predict myopia progression[30]. Foo et al[31] created a DL system to identify children at risk of developing high myopia. The results indicated that their system achieved high accuracy, with all AUC scores surpassing 0.90.
Refractive surgery can be divided into corneal and intraocular refractive surgery. Yoo et al[32] devised an ML model, employing a multiclass eXtreme Gradient Boosting approach, to determine the most suitable refractive surgery for adult patients with myopia.
AI-supported contact lens therapy is gaining traction. Fan et al[33] developed an ML model utilizing various algorithms including linear regression, SVM, Bagged Trees and Gaussian processes to forecast the curvature of orthokeratology lenses. This predictive model reduces the need for multiple lens trials, enhancing efficiency and accuracy while lowering the risk of cross-infection associated with trial lenses.
Application of Artificial Intelligence in Lens Diseases
Cataract is currently the leading cause of visual impairment and blindness worldwide. The early diagnosis of cataract is of great significance to the prevention of cataract-related complications, the choice of surgical methods and the recovery of postoperative visual acuity. In the case of relatively unbalanced medical resources, the early screening of cataract patients by AI can avoid delaying the disease, and urge them to see a doctor and receive treatment in time. As a result, it can reduce the rate of blindness or visual impairment caused by the disease.
Age-related cataract
Age-related cataract is the predominant form of cataract. It primarily results from the progressive opacification of the lens due to aging, leading to vision impairment. The prevalence of it escalates with advancing age.
Wu et al[34] established and verified a DL algorithm ResNet, which can distinguish cataract, intraocular lens (IOL) and normal lens by recognizing slit lamp images accurately (AUC>0.99). In the meantime, it has great potential in grading and classifying cataracts. Xu et al[35] developed a CNN-based integration algorithm (AlexNet and VisualDN), which uses 8030 fundus images to diagnose and grade cataracts with high precision (86.2%). Keenan et al[36] developed DeepLensNet, which conducted automated and quantitative classification of cataract severity across all three age-related cataract types. It demonstrated notably higher accuracy compared to ophthalmologists for the two prevalent types (nuclear sclerosis and cortical lens opacity), while showing comparable performance for the less common type (posterior subcapsular cataract).
In terms of evaluating prognosis, AI has also been developed. The AI system built by Mohammadi et al[37] using ANN can predict the risk of posterior capsular opacification in patients after phacoemulsification. Jiang et al[38] proposed TempSeq-Net, a DL algorithm based on slit lamp images, which can predict the need of YAG laser capsulotomy during a 2-year follow-up in patients after phacoemulsification, with an accuracy of 92.2%.
Congenital cataract
Congenital cataract is the leading cause of reversible blindness in childhood. Treating these children necessitates specialized surgical procedures and follow-up.
In addition to age-related cataracts, AI screening for congenital cataracts have also been reported in recent years, such as the intelligent localization diagnosis framework for congenital cataracts developed by Liu et al[39] using CNN, SVM and other tools. A high-precision AI software that can diagnose, grade and provide treatment advice for children suffering from cataracts with sensitivity of 90% and specificity of 86% trained by Lin et al[40]. The AI diagnosis platform for congenital cataract based on cloud computing developed by Long et al[41].
Intraocular lens formula
Not only in diagnosis, but also in cataract surgery, AI may help to improve the performance of IOL formulas. With the increasing demand for visual acuity after cataract surgery, a generally accepted goal of postoperative refractive state is within 0.50 D of emmetropia or mild myopia. AI can provide an improved framework for optimizing IOL calculation formulas, which is more accurate and customized for specific cataract surgeons. A recent small-scale study using AI-hybrid formulas significantly improved the results supplied by a surgeon. the proportion of postoperative diopter less than 0.50 D of predicted diopter increased from 76% (using standard super formula) to 80% (using super formula assisted by AI algorithm). By learning from the parameters, AI can highlight those “high-risk” eyes with ametropia before operation[42]. Sramka et al[43] proposed that ML achieved significantly better results in IOL calculation (82.3%–82.7% within 0.50 D) than traditional clinical methods (57.7% within 0.50 D) by using SVM regression model and multilayer neural network integrated model, which is considered to be one of the most accurate formulas for IOL calculation, thus optimizing refractive results. It reduces the need for reoperation after cataract surgery.
At present, the AI-assisted IOL calculation formulas that have been published include Kane, Hill-RBF calculator, Pearl-DGS, FullMonte IOL software system, Ladas Super Formula AI, etc[44]. When using the same formula across various axial length subgroups, varying outcomes were noted. The Pearl-DGS formula yielded the smallest mean absolute error, while the RBF 2.0 formula exhibited the poorest performance in shorter eyes. Conversely, the Kane formula achieved the lowest mean absolute error in both medium and long eyes[45].
Application of Artificial Intelligence in Glaucoma
Glaucoma encompasses open angle and closed-angle types, both marked by sustained elevated intraocular pressure, resulting in damage to ocular structures and visual function. Untreated, it can progress to complete visual field loss and eventual blindness. The clinical classification of glaucoma depends on the degree of anterior chamber angle closure, the reference clinical standard for whose evaluation is gonioscopy. However, this technique is very subjective and not always repeatable. With the development of imaging technology like AS-OCT, direct and non-contact anterior chamber angle imaging becomes possible[7].
ResNet stood out as the most favored pretrained CNN in glaucoma researches, consistently delivering superior accuracy compared to other CNN models[46].
Kazemian et al[47] developed a new glaucoma prediction tool that can predict the degree of progression in patients with open-angle glaucoma at different levels of intraocular pressure. Based on the optic disc and retinal region's image feature model, Haleem et al[48] proposed an automatic glaucoma detection method, which can realize the automatic location and segmentation of optic disc and screen glaucoma according to the characteristics of different regions of the image, with an accuracy of 94.4%. Li et al[49] built an AI model named DiagnoseNet to differentiate color fundus photographs between glaucoma and non-glaucoma. Subsequently, they devised a pipeline called PredictNet to forecast the onset and progression of glaucoma. The AI model for predicting glaucoma incidence and progression achieved the AUC of 0.90 and 0.91 in the validation set.
de Vente et al[50] proposed the “Artificial Intelligence for Robust Glaucoma Screening” challenge aimed at developing AI algorithms for reliable glaucoma screening. The challenge included a vast dataset comprising approximately 113 000 images from 60 000 patients across 500 screening centers. Emphasizing robustness to diverse and unexpected input data, 14 teams participated, with top-performing teams matching the diagnostic accuracy of 20 expert ophthalmologists and optometrists. The leading team achieved an impressive AUC of 0.99 for real-time detection of ungradable images.
In the treatment of glaucoma, Koh et al[51] developed an automated algorithm to predict the success rate of laser peripheral iridotomy using AS-OCT for primary angle-closure glaucoma with an accuracy of 89.7%, a specificity of 95.2%, and a sensitivity of 36.4%. Banna et al[52] carried out the initial study to utilize ML for predicting trabeculectomy outcomes. RF emerged as the top-performing model, achieving an accuracy of 0.68 and an AUC of 0.74 with 5-fold cross-validation. These findings suggest that ML hold promise in forecasting trabeculectomy outcomes for patients with refractory glaucoma. Agnifili et al[53] focused on using ML to predict the outcome of filtration surgery. The classification tree algorithm was employed for data analysis and it achieved an AUC of 0.784 (0.692–0.860). According to the classification tree analysis, a thicker and hyper-reflective stroma preoperatively, along with younger age, were associated with an increased risk of filtration surgery failure.
Application of Artificial Intelligence in Iris Diseases and Iris Biometric Detection
Iris diseases primarily refer to abnormalities of the iris and its surrounding structures. Dimililer et al[54] proposed an intelligent ocular tumor detection system based on two traditional back-propagation neural networks, which could accurately detect different types of iris tumors with an accuracy of 95.7%. Another AI model[55], utilizing a K-means clustering approach, demonstrated perfect accuracy (100%) in automatically detecting iris tumors.
Iris biometric detection offers touchless authentication, leveraging the intricate texture and distinct characteristics of the iris for identification and authentication across various applications. Its procedure comprises three main stages: image preprocessing, feature extraction and matching identification. Nowadays, it's considered the most dependable and precise biometric identification AI system currently accessible[56].
There are relatively limited clinical studies on the application of AI in iris diseases compared with other anterior segment diseases. In fact, anterior segment photography of iris diseases can provide a basis for diagnosis and other abundant information for AI. It is believed that there will be more related studies in this field to explore the application value of AI in iris diseases.
TELEMEDICINE & ARTIFICIAL INTELLIGENCE
Telemedicine can provide a wealth of valuable data, such as real-time calculations of morbidity and disease progression in the real world. If applied correctly, the data collected will be incorporated into large databases that far exceed the data capture capabilities of most individual studies. In addition, the data will be valuable in the development of predictive capabilities for disease progression combined with AI.
Wu et al[34] introduced an AI-assisted telemedicine platform for the assessment and diagnosis of cataracts of varying severity in adults and children in the real world. Patients can be self-monitored at home by taking eye surface images using mobile phones, accompanied by a brief clinical history and vision condition. Then they will be arranged to community health facilities, where slit lamps are available and ophthalmic anterior segment images can be analysed by the DL system ResNet. If necessary, patients who have surgical indications will be given a referral to tertiary eye hospitals through the fast-track notification system. In addition, by integrating AI technologies, Ting et al[57]–[58] proposed that remote cataract screening workflows measured by the population ratio of ophthalmologists to patients could further improve productivity.
As the research progresses, more specialized eye images can also be taken with smartphones. For example, a smartphone attached to a slit-lamp could perform biometrical video imaging of the eye, allowing ophthalmologists to view a patient's ocular features in real time without the patient visiting the doctor[59]. Maamari et al[60] developed a new remote platform that uses a smartphone software to detect and diagnose corneal abrasions and ulcers. Consisting of a +25.0 D lens and a white and blue light emitting diode light source, it is specially designed to capture ophthalmic anterior segment images under a fluorescein staining test or not. The platform's performance in detecting corneal ulcers is excellent compared to the slit-lamp based assessment by ophthalmologists. A Japanese research team[61] invented a portable and recordable slit-lamp device, called “Smart Eye Camera”. It's a mobile phone accessory that can take videos of the eye surface, and it can also convert the light source of the smartphone to cobalt blue light and record the stained eye surface. At the same time, the diagnosis system of DED was developed by the research team using DL model. This model has high sensitivity (0.778), specificity (0.857) and AUC (0.813) for the diagnosis of DED. Shimizu et al[62] introduced an AI system for cataract diagnosis trained with ML algorithms and video recordings obtained through a portable slit-lamp device. This system demonstrated excellent sensitivity and specificity for diagnosing cataracts and estimating nuclear cataract grade. The model's performance closely resembled that of ophthalmologists. In the application of glaucoma, Wu et al[63] developed a smart phone tonometer combined with AI algorithm, whose prototype is an attachment fixed to the phone, falling into line with camera and flashlight. When measuring the intraocular pressure, the transparent block at its head will temporarily oppress the eye surface to produce an instantaneous flattening circle. The task of the ML algorithm is to detect the contact area and collapse depth of the eyeball caused by the tonometer in each frame of the video recorded by the smartphone, so as to calculate the intraocular pressure.
LIMITATION
At present, the sample sizes of training sets and verification sets of most ML methods are too small. In addition, there are still a relatively limited number of standardized data sets at home and abroad, so each team tends to use their own data sets, with different interpretability and reliability. In addition, because it is difficult to implement unified and standardized inspection equipment in different places, the image results obtained by different equipment are different in terms of color and resolution, thus affecting the accuracy of diagnosis. Therefore, validating algorithms externally encounters several obstacles. Their effectiveness may diminish in real-world clinical settings due to variations in image quality, imaging devices, and patient compliance, highlighting the need for enhancements in these aspects. The pixel regions of the images that AI observes and learns are not always consistent with those clinicians usually use to identify disease characteristics. If a small pixel disturbance is carried out on the image, the judgment provided by AI might be interfered with in the meantime[64]. Another aspect affecting the recognition of clinicians is that AI still lacks the ability to explain and generalize the diagnosis of diseases[65], and is also unable to diagnose rare diseases. Therefore, optimizing algorithm and resolution of images, expanding sample content and enriching subjects' type are powerful means to break the limitations.
SUMMARY & PROSPECT
With the popularity of AI technology in the field of ophthalmology, many computer programs and devices came into being, such as digital slit lamp combined with AI technology, automatic multifunctional comprehensive ophthalmoscope, which built a health screening net outside the hospital for screening anterior segment diseases, and made up for the shortage of professional ophthalmologists in basic-level eye health management institutions. AI algorithms for clinical use need to be personalized and contextualized. The incorporation of clinical histories and data (e.g., presence and duration of visual symptoms, associated risk factors and vision) into image-based AI algorithms, which should be called multi-modal DL[66], can improve the accuracy of AI as a substitute for diagnosis and referral by human beings[57]. Multi-modal ML can be used to assess whether the diagnostic or predictive capabilities of an AI algorithm will increase with the addition of more imaging modes[59]. Although the application of AI in anterior segment diseases is later than that in fundus diseases, the relatively abundant examination types of anterior segment diseases are advantageous for the development of multi-modal AI. Additionally, in recent years, most anterior segment diseases can be remotely diagnosed and treated through smartphone software assisted by AI, which is highly beneficial for early diagnosis.
“Foreseeing the future” is another research hotspot in the development of AI technology in ophthalmology. AI can be used to predict treatment response, optimal treatment interval and future disease progression in advance, thus making individualized prognostic intervention possible. While existing digital technologies focus on diagnosis, future AI will play a more and more important role in directing treatment[59]. At the same time, AI can provide valuable insights into the pathophysiological characteristics and mechanism of the disease by analyzing the microstructure characteristics of the disease model available, and open up new horizons.
In terms of treatment, with the growing range of surgical choices in anterior segment disease treatment, predictive models can enhance patient care and assist in making surgical decisions. At the same time, with the introduction of intelligent sensors into the intraocular surgical robot system, it is likely that certain procedure steps in ocular operations will evolve from robot-assisted to semi-autonomous operations one day in the future[67].
Although AI faces many medical challenges, with the joint efforts and participation of medical experts, image processing experts, and software developers, the shortcomings will eventually be solved, ushering in further changes and breakthroughs.
Footnotes
Authors' contributions: Li ZH and Ye Z are primarily responsible for oversight of the research project, including research protocol designing and manuscript preparation. Li ZH and Ye Z contributed to this work equally and both of them were co-corresponding authors. Liu YH and Li LY are primarily responsible for all literature screening, literature screening, data acquisition and drafting of the manuscript. Liu YH and Li LY contributed to this work equally and both were co-first authors. Liu SJ, Gao LX, and Tang Y helped perform the work with constructive discussions. All authors have given their written permission to include their names in this study and the corresponding authors have already confirmed it.
Foundations: Supported by National Natural Science Foundation of China (No.82101097; No.82070937).
Conflicts of Interest: Liu YH, None; Li LY, None; Liu SJ, None; Gao LX, None; Tang Y, None; Li ZH, None; Ye Z, None.
REFERENCES
- 1.Shao Y, Jie Y, Liu ZG, Expert Workgroup of Guidelines for the application of artificial intelligence in the diagnosis of anterior segment diseases (2023); Ophthalmic Imaging and Intelligent Medicine Branch of Chinese Medicine Education Association; Ophthalmology Committee of International Association of Translational Medicine; Chinese Ophthalmic Imaging Study Groups Guidelines for the application of artificial intelligence in the diagnosis of anterior segment diseases (2023) Int J Ophthalmol. 2023;16(9):1373–1385. doi: 10.18240/ijo.2023.09.03. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Sun T, Zhang YQ, Shao Y. The application of artificial intelligence on ophthalmic diseases. Recent Advances in Ophthalmology. 2020;40:793–796. [Google Scholar]
- 3.Son J, Shin JY, Kim HD, Jung KH, Park KH, Park SJ. Development and validation of deep learning models for screening multiple abnormal findings in retinal fundus images. Ophthalmology. 2020;127(1):85–94. doi: 10.1016/j.ophtha.2019.05.029. [DOI] [PubMed] [Google Scholar]
- 4.Varadarajan AV, Bavishi P, Ruamviboonsuk P, et al. Predicting optical coherence tomography-derived diabetic macular edema grades from fundus photographs using deep learning. Nat Commun. 2020;11(1):130. doi: 10.1038/s41467-019-13922-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Li XR. Multi-modal deep learning and its applications in ophthalmic artificial intelligence. Medical Journal of Peking Union Medical College Hospital. 2021;12(5):602–607. [Google Scholar]
- 6.Yang J, Yang Z, Mao Z, et al. Bi-modal deep learning for recognizing multiple retinal diseases based on color fundus photos and OCT Images. Invest Ophthalmol Vis Sci. 2021;62:2107–2107. [Google Scholar]
- 7.Ting DSJ, Foo VH, Yang LWY, Sia JT, Ang M, Lin HT, Chodosh J, Mehta JS, Ting DSW. Artificial intelligence for anterior segment diseases: emerging applications in ophthalmology. Br J Ophthalmol. 2021;105(2):158–168. doi: 10.1136/bjophthalmol-2019-315651. [DOI] [PubMed] [Google Scholar]
- 8.Lavric A, Valentin P. KeratoDetect: keratoconus detection algorithm using convolutional neural networks. Comput Intell Neurosci. 2019;2019:8162567. doi: 10.1155/2019/8162567. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Kamiya K, Ayatsuka Y, Kato Y, Fujimura F, Takahashi M, Shoji N, Mori Y, Miyata K. Keratoconus detection using deep learning of colour-coded maps with anterior segment optical coherence tomography: a diagnostic accuracy study. BMJ Open. 2019;9(9):e031313. doi: 10.1136/bmjopen-2019-031313. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Lyra D, Ribeiro G, Torquetti L, Ferrara P, Machado A, Lyra JM. Computational models for optimization of the intrastromal corneal ring choice in patients with keratoconus using corneal tomography data. J Refract Surg. 2018;34(8):547–550. doi: 10.3928/1081597X-20180615-01. [DOI] [PubMed] [Google Scholar]
- 11.Ting DSJ, Gopal BP, Deshmukh R, Seitzman GD, Said DG, Dua HS. Diagnostic armamentarium of infectious keratitis: a comprehensive review. Ocul Surf. 2022;23:27–39. doi: 10.1016/j.jtos.2021.11.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Kuo MT, Hsu BWY, Yin YK, Fang PC, Lai HY, Chen A, Yu MS, Tseng VS. A deep learning approach in diagnosing fungal keratitis based on corneal photographs. Sci Rep. 2020;10(1):14424. doi: 10.1038/s41598-020-71425-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Zhang ZJ, Wang HY, Wang SG, et al. Deep learning-based classification of infectious keratitis on slit-lamp images. Ther Adv Chronic Dis. 2022;13:20406223221136071. doi: 10.1177/20406223221136071. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Hung N, Shih AKY, Lin C, Kuo MT, Hwang YS, Wu WC, Kuo CF, Kang EYC, Hsiao CH. Using slit-lamp images for deep learning-based identification of bacterial and fungal keratitis: model development and validation with different convolutional neural networks. Diagnostics (Basel) 2021;11(7):1246. doi: 10.3390/diagnostics11071246. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Ghosh AK, Thammasudjarit R, Jongkhajornpong P, Attia J, Thakkinstian A. Deep learning for discrimination between fungal keratitis and bacterial keratitis: DeepKeratitis. Cornea. 2022;41(5):616–622. doi: 10.1097/ICO.0000000000002830. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Li ZW, Jiang JW, Chen K, Chen QQ, Zheng QX, Liu XT, Weng HF, Wu SJ, Chen W. Preventing corneal blindness caused by keratitis using artificial intelligence. Nat Commun. 2021;12(1):3738. doi: 10.1038/s41467-021-24116-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Treder M, Lauermann JL, Alnawaiseh M, Eter N. Using deep learning in automated detection of graft detachment in descemet membrane endothelial keratoplasty: a pilot study. Cornea. 2019;38(2):157–161. doi: 10.1097/ICO.0000000000001776. [DOI] [PubMed] [Google Scholar]
- 18.Hayashi T, Tabuchi H, Masumoto H, Morita S, Oyakawa I, Inoda S, Kato N, Takahashi H. A deep learning approach in rebubbling after descemet's membrane endothelial keratoplasty. Eye Contact Lens. 2020;46(2):121–126. doi: 10.1097/ICL.0000000000000634. [DOI] [PubMed] [Google Scholar]
- 19.Gao XT, Wong DWK, Aryaputera AW, Sun Y, Cheng CY, Cheung C, Wong TY. Automatic pterygium detection on cornea images to enhance computer-aided cortical cataract grading system. Annu Int Conf IEEE Eng Med Biol Soc. 2012;2012:4434–4437. doi: 10.1109/EMBC.2012.6346950. [DOI] [PubMed] [Google Scholar]
- 20.Mesquita RG, Figueiredo EMN. 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Kyoto, Japan: 2012. An algorithm for measuring pterygium's progress in already diagnosed eyes; pp. 733–736. [Google Scholar]
- 21.Wan Zaki WMD, Mat Daud M, Abdani SR, Hussain A, Mutalib HA. Automated pterygium detection method of anterior segment photographed images. Comput Methods Programs Biomed. 2018;154:71–78. doi: 10.1016/j.cmpb.2017.10.026. [DOI] [PubMed] [Google Scholar]
- 22.Socia D, Brady CJ, West SK, Cockrell RC. Detection of trachoma using machine learning approaches. PLoS Negl Trop Dis. 2022;16(12):e0010943. doi: 10.1371/journal.pntd.0010943. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Yamanishi R, Uchino M, Uchino Y, Kawashima M, Dogru M, Yokoi N, Tsubota K. Changes in distribution of dry eye diagnostic status among visual display terminal workers according to the revised criteria of the Asia dry eye society. Cornea. 2020;39(5):578–583. doi: 10.1097/ICO.0000000000002218. [DOI] [PubMed] [Google Scholar]
- 24.Llorens-Quintana C, Rico-Del-Viejo L, Syga P, Madrid-Costa D, Iskander DR. A novel automated approach for infrared-based assessment of meibomian gland morphology. Transl Vis Sci Technol. 2019;8(4):17. doi: 10.1167/tvst.8.4.17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Wang YX, Jia XH, Wei SS, Li XM. A deep learning model established for evaluating lid margin signs with colour anterior segment photography. Eye (Lond) 2023;37(7):1377–1382. doi: 10.1038/s41433-022-02088-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Saha RK, Chowdhury AMM, Na KS, Hwang GD, Eom Y, Kim J, Jeon HG, Hwang HS, Chung E. Automated quantification of meibomian gland dropout in infrared meibography using deep learning. Ocul Surf. 2022;26:283–294. doi: 10.1016/j.jtos.2022.06.006. [DOI] [PubMed] [Google Scholar]
- 27.da Cruz LB, Souza JC, de Sousa JA, Santos AM, de Paiva AC, de Almeida JDS, Silva AC, Junior GB, Gattass M. Interferometer eye image classification for dry eye categorization using phylogenetic diversity indexes for texture analysis. Comput Methods Programs Biomed. 2020;188:105269. doi: 10.1016/j.cmpb.2019.105269. [DOI] [PubMed] [Google Scholar]
- 28.Barraza-Bernal MJ, Ohlendorf A, Sanz Diez P, Feng XC, Yang LH, Lu MX, Wahl S, Kratzer T. Prediction of refractive error and its progression: a machine learning-based algorithm. BMJ Open Ophthalmol. 2023;8(1):e001298. doi: 10.1136/bmjophth-2023-001298. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Lin HT, Long EP, Ding XH, et al. Prediction of myopia development among Chinese school-aged children using refraction data from electronic medical records: a retrospective, multicentre machine learning study. PLoS Med. 2018;15(11):e1002674. doi: 10.1371/journal.pmed.1002674. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Yang X, Chen G, Qian YC, Wang YH, Zhai YS, Fan DB, Xu Y. Prediction of myopia in adolescents through machine learning methods. Int J Environ Res Public Health. 2020;17(2):463. doi: 10.3390/ijerph17020463. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Foo LL, Lim GYS, Lanca C, Wong CW, Hoang QV, Zhang XJ, Yam JC, Schmetterer L, Chia A, Wong TY, Ting DSW, Saw SM, Ang M. Deep learning system to predict the 5-year risk of high myopia using fundus imaging in children. NPJ Digit Med. 2023;6(1):10. doi: 10.1038/s41746-023-00752-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Yoo TK, Ryu IH, Choi H, Kim JK, Lee IS, Kim JS, Lee G, Rim TH. Explainable machine learning approach as a tool to understand factors used to select the refractive surgery technique on the expert level. Transl Vis Sci Technol. 2020;9(2):8. doi: 10.1167/tvst.9.2.8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Fan YZ, Yu ZK, Tang T, Liu X, Xu Q, Peng ZS, Li Y, Wang K, Qu J, Zhao MW. Machine learning algorithm improves accuracy of ortho-K lens fitting in vision shaping treatment. Cont Lens Anterior Eye. 2022;45(3):101474. doi: 10.1016/j.clae.2021.101474. [DOI] [PubMed] [Google Scholar]
- 34.Wu XH, Huang YL, Liu ZZ, et al. Universal artificial intelligence platform for collaborative management of cataracts. Br J Ophthalmol. 2019;103(11):1553–1560. doi: 10.1136/bjophthalmol-2019-314729. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Xu X, Zhang LL, Li JQ, Guan Y, Zhang L. A hybrid global-local representation CNN model for automatic cataract grading. IEEE J Biomed Health Inform. 2020;24(2):556–567. doi: 10.1109/JBHI.2019.2914690. [DOI] [PubMed] [Google Scholar]
- 36.Keenan TDL, Chen QY, Agrón E, et al. Deep Learning Research Group AREDS DeepLensNet: deep learning automated diagnosis and quantitative classification of cataract type and severity. Ophthalmology. 2022;129(5):571–584. doi: 10.1016/j.ophtha.2021.12.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Mohammadi SF, Sabbaghi M, Z-Mehrjardi H, Hashemi H, Alizadeh S, Majdi M, Taee F. Using artificial intelligence to predict the risk for posterior capsule opacification after phacoemulsification. J Cataract Refract Surg. 2012;38(3):403–408. doi: 10.1016/j.jcrs.2011.09.036. [DOI] [PubMed] [Google Scholar]
- 38.Jiang JW, Liu XY, Liu L, et al. Predicting the progression of ophthalmic disease based on slit-lamp images using a deep temporal sequence network. PLoS One. 2018;13(7):e0201142. doi: 10.1371/journal.pone.0201142. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Liu XY, Jiang JW, Zhang K, et al. Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network. PLoS One. 2017;12(3):e0168606. doi: 10.1371/journal.pone.0168606. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Lin HT, Li RY, Liu ZZ, et al. Diagnostic efficacy and therapeutic decision-making capacity of an artificial intelligence platform for childhood cataracts in eye clinics: a multicentre randomized controlled trial. EClinicalMedicine. 2019;9:52–59. doi: 10.1016/j.eclinm.2019.03.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Long EP, Lin HT, Liu ZZ, et al. An artificial intelligence platform for the multihospital collaborative management of congenital cataracts. Nat Biomed Eng. 2017;1:24. [Google Scholar]
- 42.Siddiqui AA, Ladas JG, Lee JK. Artificial intelligence in cornea, refractive, and cataract surgery. Curr Opin Ophthalmol. 2020;31(4):253–260. doi: 10.1097/ICU.0000000000000673. [DOI] [PubMed] [Google Scholar]
- 43.Sramka M, Slovak M, Tuckova J, Stodulka P. Improving clinical refractive results of cataract surgery by machine learning. PeerJ. 2019;7:e7202. doi: 10.7717/peerj.7202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Tognetto D, Giglio R, Vinciguerra AL, Milan S, Rejdak R, Rejdak M, Zaluska-Ogryzek K, Zweifel S, Toro MD. Artificial intelligence applications and cataract management: a systematic review. Surv Ophthalmol. 2022;67(3):817–829. doi: 10.1016/j.survophthal.2021.09.004. [DOI] [PubMed] [Google Scholar]
- 45.Cheng HH, Kane JX, Liu LP, Li JB, Cheng B, Wu MX. Refractive predictability using the IOLMaster 700 and artificial intelligence-based IOL power formulas compared to standard formulas. J Refract Surg. 2020;36(7):466–472. doi: 10.3928/1081597X-20200514-02. [DOI] [PubMed] [Google Scholar]
- 46.Huang XQ, Islam MR, Akter S, Ahmed F, Kazami E, Serhan HA, Abd-Alrazaq A, Yousefi S. Artificial intelligence in glaucoma: opportunities, challenges, and future directions. Biomed Eng Online. 2023;22(1):126. doi: 10.1186/s12938-023-01187-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Kazemian P, Lavieri MS, van Oyen MP, Andrews C, Stein JD. Personalized prediction of glaucoma progression under different target intraocular pressure levels using filtered forecasting methods. Ophthalmology. 2018;125(4):569–577. doi: 10.1016/j.ophtha.2017.10.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Haleem MS, Han LX, van Hemert J, Fleming A, Pasquale LR, Silva PS, Song BJ, Aiello LP. Regional image features model for automatic classification between normal and glaucoma in fundus and scanning laser ophthalmoscopy (SLO) images. J Med Syst. 2016;40(6):132. doi: 10.1007/s10916-016-0482-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Li F, Su YD, Lin FB, et al. A deep-learning system predicts glaucoma incidence and progression using retinal photographs. J Clin Invest. 2022;132(11):e157968. doi: 10.1172/JCI157968. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.de Vente C, Vermeer KA, Jaccard N, et al. AIROGS: artificial intelligence for robust glaucoma screening challenge. IEEE Trans Med Imaging. 2024;43(1):542–557. doi: 10.1109/TMI.2023.3313786. [DOI] [PubMed] [Google Scholar]
- 51.Koh V, Swamidoss IN, Aquino MCD, Chew PT, Sng C. Novel automated approach to predict the outcome of laser peripheral iridotomy for primary angle closure suspect eyes using anterior segment optical coherence tomography. J Med Syst. 2018;42(6):107. doi: 10.1007/s10916-018-0960-3. [DOI] [PubMed] [Google Scholar]
- 52.Banna HU, Zanabli A, McMillan B, Lehmann M, Gupta S, Gerbo M, Palko J. Evaluation of machine learning algorithms for trabeculectomy outcome prediction in patients with glaucoma. Sci Rep. 2022;12(1):2473. doi: 10.1038/s41598-022-06438-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Agnifili L, Figus M, Porreca A, et al. A machine learning approach to predict the glaucoma filtration surgery outcome. Sci Rep. 2023;13(1):18157. doi: 10.1038/s41598-023-44659-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Dimililer K, Ever YK, Ratemi H. Intelligent eye Tumour Detection System. Procedia Comput Sci. 2016;102:325–332. [Google Scholar]
- 55.Ouabida E, Essadike A, Bouzid A. Automated segmentation of ophthalmological images by an optical based approach for early detection of eye tumor growing. Phys Med. 2018;48:37–46. doi: 10.1016/j.ejmp.2018.03.014. [DOI] [PubMed] [Google Scholar]
- 56.Lee H, Park SH, Yoo JH, Jung SH, Huh JH. Face recognition at a distance for a stand-alone access control system. Sensors (Basel) 2020;20(3):785. doi: 10.3390/s20030785. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Ting DSJ, Ang M, Mehta JS, Ting DSW. Artificial intelligence-assisted telemedicine platform for cataract screening and management: a potential model of care for global eye health. Br J Ophthalmol. 2019;103(11):1537–1538. doi: 10.1136/bjophthalmol-2019-315025. [DOI] [PubMed] [Google Scholar]
- 58.Ting DSJ, Krause S, Said DG, Dua HS. Psychosocial impact of COVID-19 pandemic lockdown on people living with eye diseases in the UK. Eye (Lond) 2021;35(7):2064–2066. doi: 10.1038/s41433-020-01130-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Li JP O, Liu HR, Ting DSJ, et al. Digital technology, tele-medicine and artificial intelligence in ophthalmology: a global perspective. Prog Retin Eye Res. 2021;82:100900. doi: 10.1016/j.preteyeres.2020.100900. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Maamari RN, Ausayakhun S, Margolis TP, Fletcher DA, Keenan JD. Novel telemedicine device for diagnosis of corneal abrasions and ulcers in resource-poor settings. JAMA Ophthalmol. 2014;132(7):894–895. doi: 10.1001/jamaophthalmol.2014.335. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Shimizu E, Ishikawa T, Tanji M, et al. Artificial intelligence to estimate the tear film breakup time and diagnose dry eye disease. Sci Rep. 2023;13(1):5822. doi: 10.1038/s41598-023-33021-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Shimizu E, Tanji M, Nakayama S, et al. AI-based diagnosis of nuclear cataract from slit-lamp videos. Sci Rep. 2023;13(1):22046. doi: 10.1038/s41598-023-49563-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Wu Y, Luttrell I, Feng S, Chen PP, Spaide T, Lee AY, Wen JC. Development and validation of a machine learning, smartphone-based tonometer. Br J Ophthalmol. 2020;104(10):1394–1398. doi: 10.1136/bjophthalmol-2019-315446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.He MG, Liu C, Li ZX. Applying artificial intelligence in ophthalmic real-world practice: opportunities and challenges. Journal of Shandong University (Health Sciences) 2020;58(11):1–10. [Google Scholar]
- 65.Chen B, Fang XW, Wu MN, Zhu SJ, Zheng B, Liu BQ, Wu T, Hong XQ, Wang JT, Yang WH. Artificial intelligence assisted pterygium diagnosis: current status and perspectives. Int J Ophthalmol. 2023;16(9):1386–1394. doi: 10.18240/ijo.2023.09.04. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Ngiam J, Khosla A, Kim M, Nam J, Lee H, Ng A. International Conference on Machine Learning. DBLP; 2009. Multimodal deep learning. [Google Scholar]
- 67.Hei HH, Wu HQ. Progress in the application of artificial intelligence in ophthalmology. Guoji Yanke Zazhi (Int Eye Sci) 2020;20(6):1003–1006. [Google Scholar]