Key Points
Question
Can deep learning be used in corneal tomographic screening of candidates for refractive surgery?
Findings
In this diagnostic study including 1385 patients, a deep learning model achieved an overall detection accuracy of 94.7% on the validation data set. On the independent test data set, the model achieved a discrimination rate (95.0%) comparable to that of senior ophthalmologists who perform refractive surgery (92.8%).
Meaning
Corneal tomographic scanning with a deep learning algorithm may offer standardized results to reduce both the workload of surgeons and the risk of misclassification.
Abstract
Importance
Evaluating corneal morphologic characteristics with corneal tomographic scans before refractive surgery is necessary to exclude patients with at-risk corneas and keratoconus. In previous studies, researchers performed screening with machine learning methods based on specific corneal parameters. To date, a deep learning algorithm has not been used in combination with corneal tomographic scans.
Objective
To examine the use of a deep learning model in the screening of candidates for refractive surgery.
Design, Setting, and Participants
A diagnostic, cross-sectional study was conducted at the Zhongshan Ophthalmic Center, Guangzhou, China, with examination dates extending from July 18, 2016, to March 29, 2019. The investigation was performed from July 2, 2018, to June 28, 2019. Participants included 1385 patients; 6465 corneal tomographic images were used to generate the artificial intelligence (AI) model. The Pentacam HR system was used for data collection.
Interventions
The deidentified images were analyzed by ophthalmologists and the AI model.
Main Outcomes and Measures
The performance of the AI classification system.
Results
A classification system centered on the AI model Pentacam InceptionResNetV2 Screening System (PIRSS) was developed for screening potential candidates for refractive surgery. The model achieved an overall detection accuracy of 94.7% (95% CI, 93.3%-95.8%) on the validation data set. Moreover, on the independent test data set, the PIRSS model achieved an overall detection accuracy of 95% (95% CI, 88.8%-97.8%), which was comparable with that of senior ophthalmologists who are refractive surgeons (92.8%; 95% CI, 91.2%-94.4%) (P = .72). In distinguishing corneas with contraindications for refractive surgery, the PIRSS model performed better than the classifiers (95% vs 81%; P < .001) in the Pentacam HR system on an Asian patient database.
Conclusions and Relevance
PIRSS appears to be useful in classifying images to provide corneal information and preliminarily identify at-risk corneas. PIRSS may provide guidance to refractive surgeons in screening candidates for refractive surgery as well as for generalized clinical application for Asian patients, but its use needs to be confirmed in other populations.
This diagnostic study reports on a learning model used in screening individuals who wish to undergo corrective refractive surgery.
Introduction
The prevalence of myopia in young adults in East and Southeast Asia is approximately 80% to 90% owing to intensive education and limited time outdoors.1 Because myopia is irreversible and requires eyeglasses, which are considered by some to be inconvenient, many adults undergo refractive surgery, including corneal refractive surgery and intraocular refractive surgery. Corneal refractive surgery is essentially laser vision correction with a femtosecond laser or excimer laser. However, iatrogenic ectasia due to biomechanical decompensation may occur if a patient with an at-risk cornea or a subclinical keratoconus (KC) has undergone ill-advised laser vision correction. This type of corneal ectasia is characterized by a thinning and forward protrusion of the center of the cornea, accompanied by irregular astigmatism, and can affect visual quality or even cause vision loss. Evaluating corneal morphologic characteristics with corneal topographic and tomographic testing before laser vision correction is necessary to exclude at-risk corneas.
Patients with at-risk corneas should be followed up over time for signs indicating further development of KC. This disease has hereditary, biomechanical, and biochemical causes involving chronic inflammatory events, such as frequent rubbing of the eyes or long-term use of contact lenses.2 However, the exact source of KC is still uncertain.
Various devices have been used to help identify at-risk corneas and KC, including Placido disc-based topographic,3 scanning-slit tomographic4 and Scheimpflug-based tomographic tools.5 There have been several artificial intelligence (AI) systems with different kinds of mathematical models for corneal topographic- or tomographic-based diagnosis, including statistical models,6,7,8,9 linear discriminant analysis,10,11 neural network models,12,13,14,15,16,17 decision tree models,18,19,20 support vector machine models,21,22,23,24 and random forest models.25 Each of these AI systems has advantages as a useful complementary diagnostic tool, suggesting clinical diagnoses of at-risk corneas or KC.
The Pentacam HR system (OCULUS) has been suggested to be one of the most sensitive screening instruments for at-risk corneas and KC.26 The system primarily includes 2 classifiers; one of these is topographic KC (TKC) classification, which is an adaptation of the Amsler-Krumeich classification.27 The use of TKC includes hierarchical prompts based on the front shape of the cornea: normal; possible or suspect KC; KC1, KC1-2, KC2, KC2-3, KC3, KC3-4, and KC4, with the numbers representing mild (KC1) to moderate and severe (KC2-4) stages; corneal surgery; and abnormal. However, this system has poor performance in classifying suspect KC with the deficiency of corneal posterior surface information. Early-stage KC is the mild stage in the adapted Amsler-Krumeich classification, most likely with no slitlamp changes. A KC is a moderate or severe stage in the Amsler-Krumeich classification. Another categorizer—Belin-Ambrósio enhanced ectasia display (BAD)—was added, a screening tool that uses regression analysis based on a large, normative database of corneal anterior and posterior surfaces, as well as pachymetry progression. A total deviation value is calculated in the BAD system, using 5 specifically defined parameters, and the results are color coded as white (normal), yellow (suspect), or red (KC).28 A deviation threshold greater than 2.11 has a sensitivity of 99.59% and specificity of 100% for diagnosing KC; a deviation threshold greater than 1.22 provides 93.62% sensitivity and 94.56% specificity for detecting mild and subclinical disease.29 However, these criteria were based mainly on a database of patients who were non-Hispanic white. To our knowledge, no diagnostic AI system has been developed for Asian patients, who have smaller corneal diameters. Therefore, after obtaining corneal topographic or tomographic data, a refractive surgeon needs to evaluate the corneal morphologic characteristics based on a comprehensive analysis of the shape and color combined with the predetermined index of the system. Hence, detecting irregular corneas or subclinical forms of KC is still a challenge for eye practitioners.
It is well known that deep learning is good at learning images and has achieved human-level performance in image classification.30 Consequently, we decided to develop an AI model based on an image learning technique trained with a convolutional neural network, which was different from the early neural networks. With use of a deep learning algorithm with corneal tomographic imaging, this model may aid in identifying at-risk corneas and determining which patients are unsuited for corneal refractive surgery, thereby assisting in surgery decision-making.
Methods
The initial corneal tomographic data were collected with use of a Pentacam HR, version 1.21r41, at the Zhongshan Ophthalmic Center, Guangzhou, China, with examination dates extending from July 18, 2016, to March 29, 2019. The investigation was performed from July 2, 2018, to June 28, 2019. Four-map composite refractive images, comprising the axial curvature, front elevation, back elevation, and corneal thickness, were used to obtain the overall profile of the cornea. The sample population was patients throughout China who wanted to undergo refractive surgery, had a primary diagnosis of KC, and had stable postoperative refractive states. All curvature, pachymetry, and elevation color bars adopt a 61-color setting (contrast, 2.0; brightness, −7; and gamma, 5.0). The elevation reference shape diameter was set to 8 mm.
The Zhongshan Ophthalmic Center Ethics Review Committee approved this retrospective observational study, and the study protocol was conducted following the tenets of the Declaration of Helsinki.31 Because deidentified data were used, the review committee indicated that patient consent did not need to be collected in this research. Patients’ names appeared on the file in pinyin format (romanized system of Chinese characters), which is used as a deidentified system. This study followed the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) reporting guideline for diagnostic studies.
In total, 6465 corneal tomographic images from 1385 patients were collected to develop the AI model, and an expert team grouped the images according to a comprehensive analysis of all the morphologic and characteristic indices according to an Asian database.32 The expert team included 3 senior ophthalmologists (Y.X., X.Y., Q.L.) with at least 5 years of practical experience in the refractive surgery center in our clinic. Each image was independently labeled by the 3 experts and each did not know the labels selected by the others. When the labels differed, the one chosen by 2 of the 3 experts was selected as the standard. To better meet our clinical needs, 5 categories were proposed: normal cornea, suspected irregular cornea, early-stage KC, KC, and myopic postoperative cornea. A normal cornea has a natural shape with all the indices within a normal range. Normal corneas included with-the-rule (ie, within accepted parameters) astigmatism or normally thin corneas. A suspected irregular cornea describes an at-risk cornea. Such a cornea may have inferior-superior values outside the reference range or aberrant C-shaped or round posterior surface elevations. Alternatively, a suspected irregular cornea may have an unusual pachymetric progression.
The sample sizes were as follows: 1887 images of normal corneas from 1368 eyes, 799 images of suspected irregular corneas from 369 eyes, 731 images of early-stage KC from 202 eyes, 1978 images of KC from 389 eyes, and 1070 images of myopic postoperative corneas from 474 eyes. Later, images from 94 separate patients were collected and labeled, also from our center, with examination dates extending from January 7 to March 29, 2019, and 100 images, 20 from each category, were selected as a test data set (eFigure 1 in the Supplement).
High-quality images with normalized sizes and resolutions were collected, including the separated discernible pictorial parts and the embedded patient information (words and numbers). The pictorial parts were cropped out and merged to form images for the AI model in the preprocessing step. Next, each patient’s pictures were divided on the basis of pinyin identifiers into 2 independent data sets for training (5130 images from 1108 of 1383 patients [80%]) and validation (1335 images from 277 of 1385 patients [20%]) of the AI model.
We then used InceptionResNetV2 architecture in a convolutional neural network on the TensorFlow platform to create the AI model with transfer learning technique. InceptionResNetV2 is a variation of InceptionV3, which borrows some ideas from ResNet.33 This architecture has been tested and achieved higher accuracy than other main convolutional neural network models, such as Inception and ResNet, on the validation data set of the ImageNet classification challenge.34 Transfer learning was adopted because it has been associated with improved diagnostic accuracy of biomedical images.35 During the training process, only the weights for fully connected layers were updated in our training data set, and the other weights were pretrained on ImageNet and frozen. At each epoch, the accuracy and loss were calculated on the training and validation data sets to monitor the performance. After 100 epochs, the training was stopped owing to the absence of further improvement (model convergence) in both accuracy and cross-entropy loss. The model with the highest accuracy on the validation data set was saved as the best model (Figure).
The independent test data set of 100 images was used to compare the accuracy of our model with that of human specialists. The accuracy of 5 senior ophthalmologists who perform refractive surgery, 5 medical students of refractive surgery, 5 senior ophthalmologists who are not refractive surgeons, and 5 medical students who are not studying refractive surgery was judged by the results of corneal tomographic scanning in the test data set. In the senior refractive surgery group, 3 individuals were from the expert team that did the labeling. The performance of each human was evaluated against the ground truth.
We also compared our model with TKC and BAD to check the performance, taking advantage of the abovementioned test data set. To compare our model with TKC, we defined the cohorts as normal cornea; possible group as suspected irregular cornea; the KC1, KC1-2, and KC2 grades of KC as early KC; the KC2-3, KC3, KC3-4, and KC4 grades of KC as KC; and corneal surgery as myopic postoperative cornea. One hundred images were divided into 5 categories, and each category contained 20 images. To compare our model with BAD, we also collected the enhanced ectasia display with the total deviation value and checked the white, yellow, or red classification for each participant. We equated a white display with normal, a yellow display with suspect, and a red display with early KC plus KC. Eighty images were divided into 3 categories, with 20 normal images, 20 suspect images, and 40 early KC plus KC images.
Statistical Analysis
The receiver operator characteristic curves were plotted using Python, version 3.7 (Python Software Foundation) with packages of matplotlib 2.2.3 and scikit-learn 0.19.2. The 2-sided 95% CIs were Wilson score intervals for accuracy, sensitivity, and specificity, and were DeLong intervals for the area under receiver operator characteristic curve. The 2 proportion comparisons were tested with the McNemar test, analyzed using R, version 3.5.1 (R Foundation for Statistical Computing), with packages of Hmisc_4.2-0, pRoc_1.15.3, and stats (base package). All statistical tests were 2-sided with a significance level of .05.
Results
Performance of the AI Model
We developed a model to be used for classifying corneal types for patients wanting to undergo refractive surgery. The model achieved a total detection accuracy of 94.7% (95% CI, 93.3%-95.8%) on the validation data set. The areas under the receiver operator characteristic curves were above 0.99 on average. The performances for each category are presented in Table 1. We based our AI system centered on the model the Pentacam InceptionResNetV2 Screening System (PIRSS).
Table 1. Performance of PIRSS on the Validation Data Sets.
Data setsa | Images, No. | AUC (95% CI) | % (95% CI) | |
---|---|---|---|---|
Sensitivity | Specificity | |||
Overall | 1335 | 0.993 (0.983-1.000) | 91.9 (80.8-100) | 98.7 (97.1-100) |
Normal | 378 | 0.992 (0.989-0.995) | 95.2 (92.6-97) | 96.7 (95.4-97.7) |
Suspect | 115 | 0.980 (0.972-0.988) | 76.5 (68.0-83.3) | 98.2 (97.3-98.8) |
Early KC | 137 | 0.996 (0.993-0.999) | 92.0 (86.2-95.5) | 99.1 (98.4-99.5) |
KC | 446 | 0.999 (0.998-1.000) | 97.8 (95.9-98.8) | 99.2 (98.4-99.6) |
Postoperative | 259 | 0.998 (0.996-1.000) | 98.1 (96.6-99.2) | 100 (99.6-100) |
Abbreviations: AUC, area under the receiver operator characteristic curve; KC, keratoconus.
Normal indicates normal cornea; suspect, suspected irregular cornea; early KC, early-stage KC; KC, keratoconus diagnosis; postoperative, myopic postoperative cornea.
Twenty reviewers were invited to classify the 100 corneal tomographic images in the test data set. The total mean accuracies of the reviewers were as follows: senior refractive surgeons, 92.8%; student refractive surgeons, 85.6%; senior nonrefractive surgeons, 68.2%; and students not studying refractive surgery, 55.8% (eFigure 2 in the Supplement). Our model achieved an overall accuracy comparable to that of senior ophthalmologists who are refractive surgeons in our clinic (95.0%; 95% CI, 88.8%-97.8% vs 92.8%; 95% CI, 91.2%-94.4%; P = .72). (Table 2) The overall accuracies achieved by the 5 reviewers in the senior refractive surgeon group were 93.0%, 94.0%, 94.0%, 91.0%, and 92.0% (eFigure 3 in the Supplement). All reviewers had relatively poor performance for the suspect and early KC categories, since the decision was also a clinical dilemma. However, when presented with data that were not clear on the suspect and early KC diagnoses, PIRSS obtained similar sensitivity to the senior refractive surgeon group (suspect: 80.0% vs 83.0%, P = .92; early KC: 95% vs 87%, P = .60).
Table 2. Comparison of Human-Machine With Machine-Machine.
Classifier | Accuracy, % (95% CI) | P value |
---|---|---|
Overall of 5 categoriesa | ||
Senior RSb | 92.8 (91.2-94.4) | .72 |
PIRSS | 95.0 (88.8-97.8) | |
Overall of 5 categoriesa | ||
TKC | 81 (72.2-87.5) | <.001 |
PIRSS | 95 (88.8-97.8) | |
Exclude suspected irregular cornea | ||
TKC | 96.3 (89.5-98.7) | .48 |
PIRSS | 98.8 (93.3-99.9) | |
Overall of 3 categoriesc | ||
BAD | 86.2 (77.0-92.1) | .72 |
PIRSS | 93.7 (86.2-97.3) |
Abbreviations: BAD, Belin-Ambrósio enhanced ectasia display; PIRSS, Pentacam InceptionResNetV2 screening system; TKC, topographic keratoconus classification.
Normal cornea, suspected irregular cornea, early-stage keratoconus (KC), KC diagnosis, and myopic postoperative cornea.
Senior ophthalmologists who perform refractive surgery.
Normal cornea, suspected irregular cornea, and early KC plus KC.
After equating the scales in the TKC comparison (Table 2), we found that the overall accuracy of the TKC classifier was 81% (<95% of PRISS; P < .001): the TKC system correctly identified only 4 of 20 (20.0% accuracy) suspect images. For the other discrimination categories, TKC behaved similar to PIRSS (96.3%; 95% CI, 89.5%-98.7% vs 98.8%; 95% CI, 93.3%-99.9%; P = .48) owing to similar reference standards. BAD achieved a total accuracy of 86.2% (95% CI, 77.0%-92.1%), and PIRSS achieved a total accuracy of 93.7% (95% CI, 86.2%-97.3%) (P = .72) (Table 2). The false-positive rate of the suspect category was 10.0% in BAD and 1.7% in PIRSS. BAD misinterpreted 5 normal corneas as suspected irregular corneas among 6 false-positive cases (eFigure 4 and eFigure 5 in the Supplement).
Discussion
We developed the output categories normal cornea, suspected irregular cornea, early-stage KC, KC, and myopic postoperative cornea, using this type of classification to offer therapeutic guidance. Candidates with normal corneas in both eyes are eligible for refractive surgery if the residual corneal thickness is consistent with the safety criteria. Risks are associated with laser vision correction for individuals with suspected irregular cornea in 1 or both eyes. An eye with early-stage KC should be observed and given crosslinking at a proper time. An eye classified as KC indicates a moderate or advanced case, and early, active intervention is needed.
There are many terms that describe at-risk corneas. These corneas can be termed suspected KC because the condition may manifest as an increasing K value, inferior-superior dioptric asymmetry, or posterior surface elevation. Forme fruste KC (FFKC)36 is the normal contralateral eye of patients with clinically diagnosed unilateral KC. Since both eyes of patients with unilateral KC have the same genetic makeup, the less affected eye is known to have KC. The contralateral eye that has no clinical findings except for specific topographic or tomographic changes should also carry the diagnosis of FFKC.37 However, in some studies, FFKC was used to indicate the unusual shape of both eyes. Another term is subclinical KC, which indicates that no abnormalities are noted in a slitlamp examination. Currently, there is a lack of consensus in defining these cases, except for the universally accepted tenet that unilateral KC is rare. In our AI model, suspected irregular cornea was the category used to define high-risk corneas with suspicious corneal morphologic abnormalities, which not only reflected the morphologic differences compared with normal corneas, but also indicated the probability that there was no KC. Without disturbing the biomechanical stability due to corneal thinning, a person with suspected irregular corneas in both eyes may not develop KC during their lifetime. A label of KC suspect might cause concern for an individual wanting to undergo refractive surgery who might suspect that they have a serious inherited disease.
Our deep learning model is composed of multiple processing layers originating from a neural network. For classification tasks, higher layers of representation amplify aspects of the input that are important for discrimination and suppressing irrelevant variations.38 Deep convolutional neural networks have yielded breakthroughs in image processing and are widely used in medical imaging; ophthalmic photography is an important link. Deep learning is useful in diagnosing or making clinical decisions related to cataracts, glaucoma, age-related macular degeneration, and diabetic retinopathy. Classic convolutional neural network models include LeNet, AlexNet, the visual geometry group network, Xception, Inception, and ResNet. The InceptionResNetV2 algorithm, which yields a better performance result, was chosen in this study.
In previous studies, researchers used significant corneal parameters to form many intelligent indices to perform screening (Table 3).10,11,12,13,14,15,16,17,19,20,21,22,23,25,39 These previous AI tools were based on only specific parameters or small training data set. However, we chose to use heat maps containing all information related to the cornea, with a relatively large amount of data. When faced with a corneal map, surgeons usually do not have time in a busy clinic for a detailed study, which includes repeatedly comparing and considering. It appears we need a medical system or equipment that can automatically offer standardized judgments to reduce both the workload of surgeons and the risk of misclassification.
Table 3. Artificial Intelligence Mathematical Models Used on Videokeratographic and Corneal Topographic or Tomographic Imaging.
Source | Algorithm | Instrument | Input | Output | Data set, No. | Performance | |
---|---|---|---|---|---|---|---|
Training | Test/validation | ||||||
Maeda et al,101994 | KPI (linear discriminant analysis) | TMS-1 videokeratoscope | 8 Topographic indices | KC, non-KC | 100 | 100 | Accuracy, 96%; sensitivity, 89%; specificity, 99% (cutoff value, 0.23) |
Maeda et al,12 1995 | Neural network | TMS-1 videokeratoscope | 11 Topographic indices | Normal, WA, KC1, KC2, KC3, post-PRK, post-KP | 108 | 75 | Total accuracy, 80%; KC accuracy, 92%-97% |
Smolek and Klyce,13 1997 | KSI (neural network plus binary decision tree) | TMS-1 videokeratoscope | 10 Topographic indices | Other, KCS, KC1, KC2, KC3 | 150 | 150 | Total accuracy, 100%; KC accuracy, 100% |
Smolek and Klyce,14 2001 | Neural network | TMS-1 videokeratoscope | Wavelet data | Normal, post-RS | 138 | 138 | Total accuracy, 99.3% |
Accardo and Pensiero,15 2002 | Neural network | EyeSys 2000 | 9 Topographic indices | Normal, KC, others | 95 | 103 | Sensitivity, 94.1%; specificity, 97.6% |
Twa et al,19 2005 | Decision tree | Keratron corneal topographer | Seventh-order Zernike polynomial | Normal, KC | 244 | Cross-validation | Total accuracy, 92% |
Klyce et al,16 2005 | Corneal navigator (neural network) | OPD scanning system | 19 topographic indices | Normal, WA, KCS, KC, PMD, post-KP, HRS, post-RS, others | NA | NA | Unavailable |
Vieira de Carvalho and Barbosa,39 2008 | Neural network plus discriminant analysis | EyeSys 2000 | Zernike coefficients | KC, WA, AA, post-PRK | 40 | 40 | Total accuracy: 94% by NN, 85% by DA |
Souza et al,21 2010 | Neural network, support vector machine, multilayer perception | Orbscan system | 11 Topographic indices | KC, astigmatism, post-PRK | 318 | Cross-validation | AUC of KC: 0.99 by NN, 0.99 by SVM, 0.99 by MLP |
Saad and Gatinel,11 2012 | SCORE Analyzer (linear discriminant analysis) | Orbscan system | >10 Placido and tomographic indices | Normal, at risk for LASIK | NA | 183 | Sensitivity, 92%; specificity, 96% |
Arbelaez et al,222012 | Support vector machine | Sirius system | Indices based on curvature, thickness, and height data of both the anterior and posterior corneal surface and pachymetry | Normal, subclinical KC, KC, abnormal | 800 | 2702 | Total accuracy, 95.9%; normal accuracy, 98.1%; subclinical accuracy, 97.3%; KC accuracy, 98.2%; abnormal accuracy, 98.3% |
Smadja et al,20 2013 | Decision tree | Galilei system | 55 Parameters derived from anterior and posterior corneal measurements | Normal, FFKC, KC | 372 | Cross-validation | Sensitivity of KC and FFKC: KC vs normal cornea, 100%; FFKC vs normal cornea, 93.6% |
Kovács et al17 2016 | Neural network | Pentacam HR system | Unilateral and bilateral indices | Normal, FFKC, KC | 135 | Cross-validation | Sensitivity of KC and FFKC: KC vs normal cornea, 100%; FFKC vs normal cornea, 90% |
Ruiz Hidalgo et al,23 2016 | KA (support vector machine) | Pentacam HR system | 22 Parameters of the corneal curvature, eccentricity, anterior chamber, corneal volume, and pachymetry | Normal, KC, FFKC, AST, post-RS | 860 | Cross-validation | Total accuracy, 88.8%; sensitivity of KC and FFKC: KC vs normal cornea, 98.9%; FFKC vs normal cornea, 93.1% |
Lopes et al,25 2018 | PRFI (random forest) | Pentacam HR system | >20 Keratometric values, topometric indices, and tomographic indices | Stable LASIK, PLE, KC, FFKC, normal | 3233 | 486 From stable, VAE-NT, and VAE-E | Sensitivity of VAE-NT and VAE-E: VAE-NT vs normal cornea, 85.2%; VAE-E vs normal cornea, 100% |
Our model, 2019 | PIRSS | Pentacam HR system | Images of the corneal axial curvature, the front elevation, the back elevation, and the corneal thickness | Normal, suspect, early KC, KC, postoperative | 5130 | 1335 | Total accuracy, 95%; KC accuracy, 98% |
Abbreviations: AA, against-the-rule astigmatism; AST, astigmatism; AUC, area under the receiver operator characteristic curve; DA, discriminant analysis; FFKC, forme fruste keratoconus; HRS, hyperopic refractive surgery; KA, KC assistant; KC, keratoconus; KC1, mild keratoconus; KC2, moderate keratoconus; KC3, advanced keratoconus; KCS, suspected KC; KP, keratoplasty; KPI, KC predictive index; KSI, KC severity index; LASIK, laser in situ keratomileusis; MLP, multilayer perception; NA, not available; NN, neural network; PIRSS, Pentacam InceptionResNetV2 Screening System; PLE, post-LASIK ectasia; PMD, pellucid marginal degeneration; post-PRK, post–photorefractive keratectomy; post-KP, post–keratoplasty; post-RS, post–refractive surgery; PRFI, Pentacam random forest index; SVM, support vector machine; VAE-E, ectasia eye of very asymmetric cases; VAE-NT, normal topography eye of very asymmetric cases; WA, with-the-rule astigmatism.
This study represents a potentially useful development in translational medicine. A web service with PIRSS is being prepared (eFigure 6 in the Supplement). The PIRSS model also offers benefits for a refractive surgeon with less experience or for ophthalmologists who are not refractive surgeons but want to obtain the guidance from Pentacam HR tomographic scans. In addition, patients can upload their images to our service to receive advice. A larger sample size is needed to improve the performance of PIRSS, and we look forward to increasing our resources and the number of specialists to help build the model.
Limitations
PIRSS has limitations. First, when future versions of the Pentacam software change the way that the heat maps are generated or the composite image is organized differently the model may not work properly. Therefore, the images we put into the system have to meet the criteria we set for the time being. We need continually to modify a more intelligent algorithm. Second, this model did not provide fully quantitative results in the case of high interindividual variability. Because the database population was younger people (most aged 18-40 years), we did not consider age and sex in this AI model. Although the normal cornea becomes steeper and shifts from with-the-rule to against-the-rule astigmatism with increasing age,40 corneal astigmatism is found to be stable until middle age. In younger people, there was barely a sex-related difference in the corneal curvature or astigmatism patterns.41 However, there was an interference factor in the evaluation criterion, as the corneal diameter may affect the tomographic appearance. In the posterior elevation map, an abnormal figure is more likely to be present in a particular small-diameter cornea with other common indicators. We think that for diagnostic integrity, slitlamp examinations, refractive errors, and family history should be considered.
Moreover, for refractive surgery candidates with a normal cornea, laser vision correction is not entirely safe. It appears the reasons for accidental corneal ectasia need further assessment. Postoperative education should include instruction in avoidance of eye rubbing and allergen prevention. Technology is no substitute for clinical understanding, and clinical expertise remains essential. Artificial intelligence can use only the information currently available. Many further developments are needed before we are more reliant on AI technology in corneal tomographic-based evaluation and refractive candidate screening. Furthermore, biomechanical assessment has been suggested to enhance the ability to screen for KC. An AI model combined with a biomechanical index or images could be a powerful supplement for clinical decision-making.
Conclusions
The findings of this study suggest that PIRSS is able to classify images to offer corneal information and preliminarily identify at-risk corneas. This AI system has the potential for generalized clinical applications and provides new opportunities for screening individuals for refractive surgery.
References
- 1.Morgan IG, French AN, Ashby RS, et al. The epidemics of myopia: aetiology and prevention. Prog Retin Eye Res. 2018;62:134-149. doi: 10.1016/j.preteyeres.2017.09.004 [DOI] [PubMed] [Google Scholar]
- 2.Krachmer JH, Feder RS, Belin MW. Keratoconus and related noninflammatory corneal thinning disorders. Surv Ophthalmol. 1984;28(4):293-322. doi: 10.1016/0039-6257(84)90094-8 [DOI] [PubMed] [Google Scholar]
- 3.Brody J, Waller S, Wagoner M. Corneal topography: history, technique, and clinical uses. Int Ophthalmol Clin. 1994;34(3):197-207. doi: 10.1097/00004397-199403430-00018 [DOI] [PubMed] [Google Scholar]
- 4.Jonsson M, Markström K, Behndig A. Slit-scan tomography evaluation of the anterior chamber and corneal configurations at different ages. Acta Ophthalmol Scand. 2006;84(1):116-120. doi: 10.1111/j.1600-0420.2005.00577.x [DOI] [PubMed] [Google Scholar]
- 5.Rüfer F, Schröder A, Arvani MK, Erb C. Central and peripheral corneal pachymetry–standard evaluation with the Pentacam system. Klin Monbl Augenheilkd. In German. 2005;222(2):117-122. [DOI] [PubMed] [Google Scholar]
- 6.Rabinowitz YS, McDonnell PJ. Computer-assisted corneal topography in keratoconus. Refract Corneal Surg. 1989;5(6):400-408. [PubMed] [Google Scholar]
- 7.Rabinowitz YS. Videokeratographic indices to aid in screening for keratoconus. J Refract Surg. 1995;11(5):371-379. [DOI] [PubMed] [Google Scholar]
- 8.Rabinowitz YS, Rasheed K. KISA% index: a quantitative videokeratography algorithm embodying minimal topographic criteria for diagnosing keratoconus. J Cataract Refract Surg. 1999;25(10):1327-1335. doi: 10.1016/S0886-3350(99)00195-9 [DOI] [PubMed] [Google Scholar]
- 9.Mahmoud AM, Roberts CJ, Lembach RG, Twa MD, Herderick EE, McMahon TT; CLEK Study Group . CLMI: the cone location and magnitude index. Cornea. 2008;27(4):480-487. doi: 10.1097/ICO.0b013e31816485d3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Maeda N, Klyce SD, Smolek MK, Thompson HW. Automated keratoconus screening with corneal topography analysis. Invest Ophthalmol Vis Sci. 1994;35(6):2749-2757. [PubMed] [Google Scholar]
- 11.Saad A, Gatinel D. Validation of a new scoring system for the detection of early forme of keratoconus. Int J Kerat Ect Cor Dis. 2012;1:100-108. doi: 10.5005/jp-journals-10025-1019 [DOI] [Google Scholar]
- 12.Maeda N, Klyce SD, Smolek MK. Neural network classification of corneal topography: preliminary demonstration. Invest Ophthalmol Vis Sci. 1995;36(7):1327-1335. [PubMed] [Google Scholar]
- 13.Smolek MK, Klyce SD. Current keratoconus detection methods compared with a neural network approach. Invest Ophthalmol Vis Sci. 1997;38(11):2290-2299. [PubMed] [Google Scholar]
- 14.Smolek MK, Klyce SD. Screening of prior refractive surgery by a wavelet-based neural network. J Cataract Refract Surg. 2001;27(12):1926-1931. doi: 10.1016/S0886-3350(01)01182-8 [DOI] [PubMed] [Google Scholar]
- 15.Accardo PA, Pensiero S. Neural network–based system for early keratoconus detection from corneal topography. J Biomed Inform. 2002;35(3):151-159. doi: 10.1016/S1532-0464(02)00513-0 [DOI] [PubMed] [Google Scholar]
- 16.Klyce SD, Karon MD, Smolek MK. Screening patients with the corneal navigator. J Refract Surg. 2005;21(5)(suppl):S617-S622. doi: 10.3928/1081-597X-20050902-12 [DOI] [PubMed] [Google Scholar]
- 17.Kovács I, Miháltz K, Kránitz K, et al. Accuracy of machine learning classifiers using bilateral data from a Scheimpflug camera for identifying eyes with preclinical signs of keratoconus. J Cataract Refract Surg. 2016;42(2):275-283. doi: 10.1016/j.jcrs.2015.09.020 [DOI] [PubMed] [Google Scholar]
- 18.Twa MD, Parthasarathy S, Raasch TW. Decision tree classification of spatial data patterns from videokeratography using Zemike polynomials. SIAM International Conference on Data Mining. San Francisco: Society for industrial and applied mathematics. 2003;3-12. [Google Scholar]
- 19.Twa MD, Parthasarathy S, Roberts C, Mahmoud AM, Raasch TW, Bullimore MA. Automated decision tree classification of corneal shape. Optom Vis Sci. 2005;82(12):1038-1046. doi: 10.1097/01.opx.0000192350.01045.6f [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Smadja D, Touboul D, Cohen A, et al. Detection of subclinical keratoconus using an automated decision tree classification. Am J Ophthalmol. 2013;156(2):237-246.e1. doi: 10.1016/j.ajo.2013.03.034 [DOI] [PubMed] [Google Scholar]
- 21.Souza MB, Medeiros FW, Souza DB, Garcia R, Alves MR. Evaluation of machine learning classifiers in keratoconus detection from Orbscan II examinations. Clinics (Sao Paulo). 2010;65(12):1223-1228. doi: 10.1590/S1807-59322010001200002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Arbelaez MC, Versaci F, Vestri G, Barboni P, Savini G. Use of a support vector machine for keratoconus and subclinical keratoconus detection by topographic and tomographic data. Ophthalmology. 2012;119(11):2231-2238. doi: 10.1016/j.ophtha.2012.06.005 [DOI] [PubMed] [Google Scholar]
- 23.Ruiz Hidalgo I, Rodriguez P, Rozema JJ, et al. Evaluation of a machine-learning classifier for keratoconus detection based on Scheimpflug tomography. Cornea. 2016;35(6):827-832. doi: 10.1097/ICO.0000000000000834 [DOI] [PubMed] [Google Scholar]
- 24.Ruiz Hidalgo I, Rozema JJ, Saad A, et al. Validation of an objective keratoconus detection system implemented in a Scheimpflug tomographer and comparison with other methods. Cornea. 2017;36(6):689-695. doi: 10.1097/ICO.0000000000001194 [DOI] [PubMed] [Google Scholar]
- 25.Lopes BT, Ramos IC, Salomão MQ, et al. Enhanced tomographic assessment to detect corneal ectasia based on artificial intelligence. Am J Ophthalmol. 2018;195:223-232. doi: 10.1016/j.ajo.2018.08.005 [DOI] [PubMed] [Google Scholar]
- 26.FariaCorreia F . Ambrósio R. Clinical applications of the Scheimpflug principle in ophthalmology. Rev Bras Oftalmol. 2016;75(2):160-165. [Google Scholar]
- 27.Krumeich JH, Daniel J, Knülle A. Live-epikeratophakia for keratoconus. J Cataract Refract Surg. 1998;24(4):456-463. doi: 10.1016/S0886-3350(98)80284-8 [DOI] [PubMed] [Google Scholar]
- 28.Belin MW, Ambrósio R Jr. Corneal ectasia risk score: statistical validity and clinical relevance. J Refract Surg. 2010;26(4):238-240. doi: 10.3928/1081597X-20100318-01 [DOI] [PubMed] [Google Scholar]
- 29.Ambrósio R Jr, Valbon BF, Faria-Correia F, Ramos I, Luz A. Scheimpflug imaging for laser refractive surgery. Curr Opin Ophthalmol. 2013;24(4):310-320. doi: 10.1097/ICU.0b013e3283622a94 [DOI] [PubMed] [Google Scholar]
- 30.Long E, Lin H, Liu Z, et al. An artificial intelligence platform for the multihospital collaborative management of congenital cataracts. Nat Biomed Engineer: 0024. Published January 30, 2017. Accessed month day, year. https://www.nature.com/articles/s41551-016-0024
- 31.World Medical Association . World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. 2013;310(20):2191-2194. doi: 10.1001/jama.2013.281053 [DOI] [PubMed] [Google Scholar]
- 32.Ying J, Wang Q, Belin MW, et al. Corneal elevation in a large number of myopic Chinese patients. Cont Lens Anterior Eye. 2016;39(3):185-190. doi: 10.1016/j.clae.2016.01.005 [DOI] [PubMed] [Google Scholar]
- 33.Szegedy C, Ioffe S, Vanhoucke V. Inception-v4, Inception-ResNet and the impact of residual connections on learning. ArXiv: 1602.07261. Updated August 23, 2016. Accessed February 23, 2016. https://arxiv.org/abs/1602.07261
- 34.Keras Documentation. Accessed February 23, 2016. https://keras.io/applications/
- 35.Kermany DS, Goldbaum M, Cai W, et al. Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell. 2018;172(5):1122-1131.e9. doi: 10.1016/j.cell.2018.02.010 [DOI] [PubMed] [Google Scholar]
- 36.Amsler M. The “forme fruste” of keratoconus [in German]. Wien Klin Wochenschr. 1961;73:842-843. [PubMed] [Google Scholar]
- 37.Klyce SD. Chasing the suspect: keratoconus. Br J Ophthalmol. 2009;93(7):845-847. doi: 10.1136/bjo.2008.147371 [DOI] [PubMed] [Google Scholar]
- 38.LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521(7553):436-444. doi: 10.1038/nature14539 [DOI] [PubMed] [Google Scholar]
- 39.Vieira de Carvalho LA, Barbosa MS. Neural networks and statistical analysis for classification of corneal videokeratography maps based on Zernike coefficients: a quantitative comparison. Arq Bras Oftalmol. 2008;71(3):337-341. doi: 10.1590/S0004-27492008000300006 [DOI] [PubMed] [Google Scholar]
- 40.Hayashi K, Hayashi H, Hayashi F. Topographic analysis of the changes in corneal shape due to aging. Cornea. 1995;14(5):527-532. doi: 10.1097/00003226-199509000-00014 [DOI] [PubMed] [Google Scholar]
- 41.Goto T, Klyce SD, Zheng X, Maeda N, Kuroda T, Ide C. Gender- and age-related differences in corneal topography. Cornea. 2001;20(3):270-276. doi: 10.1097/00003226-200104000-00007 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.