Abstract
Purpose:
Test the hypothesis that visual field (VF) progression can be predicted from baseline and longitudinal optical coherence tomography (OCT) structural measures.
Design:
Prospective cohort study.
Methods:
104 eyes (104 patients) with ≥3 years of follow-up and ≥5 VF exams were enrolled. We defined VF progression based on pointwise linear regression on 24–2 VF (≥3 locations with slope ≤−1.0 dB/year and p<0.01). We used elastic net logistic regression (ENR) and machine learning (ML) to predict VF progression with demographics, baseline circumpapillary retinal nerve fiber layer (RNFL) and macular ganglion cell/inner plexiform layer (GCIPL) thickness and RNFL and GCIPL change rates at central 24 superpixels and 3 eccentricities 3.4°, 5.5° and 6.8° from fovea and hemimaculas. Areas-under-ROC curves (AUC) were used to compare models.
Results:
Average (SD) follow-up and VF exams were 4.5 (0.9) years and 8.7 (1.6), respectively. VF progression was detected in 23 eyes (22%). ENR selected rates of change of superotemporal RNFL sector and GCIPL change rates in five central superpixels and at 3.4° and 5.6° eccentricity as best predictor subset (AUC=0.79±0.12). Best ML predictors consisted of baseline superior hemimacular GCIPL thickness and GCIPL change rates at 3.4° eccentricity and three central superpixels (AUC=0.81±0.10). Models using GCIPL-only structural variables performed better than RNFL-only models.
Conclusions:
VF progression can be predicted with clinically relevant accuracy from baseline and longitudinal structural data. Further refinement of proposed models would assist clinicians with timely prediction of functional glaucoma progression and clinical decision-making.
Keywords: glaucoma, progression, prediction, GCIPL, ganglion cell/inner plexiform layer, RNFL, retinal nerve fiber layer, machine learning, elastic net
Introduction
Timely detection of visual field (VF) progression is an essential task in the management of glaucoma, especially in the more advanced stages where the remaining retinal ganglion cell (RGC) reserve is small. 1 However, by the time worsening trends or significant worsening of the VFs have been detected, restoration of already lost RGC function is unlikely. 2 Therefore, prediction of future VF worsening based on baseline risk factors and structural information and evidence of structural change collected during follow-up may help prevent visually significant progression as therapeutic measures can potentially be applied before VF deterioration occurs.
Most predictive models in the literature have relied on standard statistical methods to predict rates of change or VF worsening based on binary criteria. 3–5 However, the small number of study patients in relation to the large potential number of predictor variables can be a limiting factor for standard statistical techniques. Machine learning (ML) can combine features from different resources to identify disease markers. 6–15 Some of these techniques have shown acceptable precision in glaucoma diagnosis. 8,16,17 Such approaches have typically used single instrument-based optic disc or VF parameters for glaucoma diagnosis or prediction.
When a large number of variables are explored in prognostic models, collinearity among some variables of interest can influence the analysis. Penalized-regression models, such as elastic net logistic regression (ENR), provide a reasonable solution to this by shrinking the coefficient of less contributive variables toward zero. 18,19 These statistical methods could be helpful when numerous clinical, structural, and functional data need to be combined in order to predict glaucoma progression. In one study on prediction of drug response in cancer, ENR was introduced as an effective tool for selecting the highest performing genomic and molecular features. 20
The goal of this study is to use an array of baseline clinical and demographic variables, together with baseline and longitudinal structural parameters to predict VF deterioration in a cohort of glaucoma patients with advanced or central field damage at baseline. We explored and compared a statistical approach designed for best subset selection in this scenario, ENR, and machine learning methods due to the large number of predictors compared to the number of cases.
Methods
One hundred and four eyes from 104 patients from the Advanced Glaucoma Progression Study (AGPS) were selected for this study. The Advanced Glaucoma Progression Study is a longitudinal, prospective, observational study at the Stein Eye Institute, University of California Los Angeles (UCLA). The main goal of this study is to evaluate the role of central structural and functional measurements in detection of disease deterioration in eyes with advanced glaucoma. The current study was carried out in accordance with the tenets of the declaration of Helsinki and the Health Insurance Portability and Accountability Act (HIPAA) and was approved by the UCLA’s Human Research Protection Program.
The patient cohort consists of patients with glaucoma with clinical evidence of damage at the level of the optic disc and an associated VF defect on standard achromatic perimetry. One eye of each patient meeting the inclusion criteria was selected for further evaluation. If both eyes met the study criteria, the eye with worse mean deviation (MD) was selected to be enrolled. A VF defect was considered to be present if both of the following criteria were met: (1) Glaucoma Hemifield Test outside normal limits; and (2) four abnormal points with p <0.05 on the pattern deviation plot, both confirmed at least once. 21 Advanced glaucoma was defined in this study as VF mean deviation of −6.0 dB or worse, or evidence of central VF involvement, i.e., presence of ≥2 test locations with p <0.05 on the pattern deviation plot within the central 10° on 24–2 standard achromatic VFs confirmed at least once. This represents a group of glaucoma eyes that would be classified as having moderately to severe glaucoma. Patients must have had ≥3 years of follow-up and 5 or more 24–2 VF exams and macular and circumpapillary retinal nerve fiber layer (cp-RNFL) optical coherence tomography (OCT) images. The following baseline demographic data were also entered in the ENR and ML models: gender, race, age, intraocular pressure (IOP), central corneal thickness (CCT), axial length (AL) and baseline 24–2 VF MD and pattern standard deviation.
Macular and cp-RNFL imaging
Macular OCT imaging was performed with the Posterior Pole Algorithm of the Spectralis SD-OCT (Heidelberg Engineering®, Heidelberg, Germany). It acquires 61 horizontal B-scans each consisting of 768 A-scans and spanning a 30°×25° wide area parallel to the fovea-Bruch’s membrane opening axis. In order to decrease speckle noise and improve image quality, the B-scans are repeated 9–11 times. A built-in software, Glaucoma Module Premium Edition (GMPE) software, was used to segment individual macular layers. The segmentation accuracy was also checked manually and corrected as needed. Thickness measurements of individual macular layers are provided in an 8×8 grid of 64 superpixels, each 3°×3° in size. The macular outcome of interest in this study was the ganglion cell/inner plexiform layer (GCIPL). We estimated the rates of change of GCIPL in 24 central superpixels (the highlighted central superpixels in Figure 1) with univariate linear regression. Also, in order to decrease the possible contribution of noise when using superpixels, we grouped the superpixels into 3 circular clusters based on eccentricity (3.4°, 5.6° and 6.8° from fovea, or circles 1, 2 and 3, respectively; Figure 1) and superior and inferior hemimacular regions and estimated the corresponding rates of change. Circumpapillary retinal nerve fiber layer measurements were acquired with a single circular B-scan, consisting of 768 A-scans, 12° in diameter and centered on Bruch’s membrane opening centroid. Thickness of cp-RNFL is reported globally (G) and in the following sectors: superior temporal (ST), temporal (T), inferior temporal (IT), superior nasal (SN), nasal (N) and inferior nasal (IN). We estimated global and sectoral cp-RNFL rates of change with univariate linear regression.
Visual field procedures and definition of progression
All patients underwent standard achromatic perimetry with the 24–2 Swedish Interactive Thresholding Algorithm (SITA) standard strategy on the Humphrey Field Analyzer (Carl Zeiss Meditec®, Dublin, CA). Eyes with false positive rate higher than 15% were excluded. We averaged the total deviation (TD) values of the central 12 locations on the 24–2 VF after converting them to Lambert scale to estimate the ‘central’ MD for the study eyes.Threshold sensitivity in 54 test locations were exported as xml data and pointwise linear regression (PLR) of threshold sensitivities over time was carried out. 22,23 The definition for deterioration at each location was a rate of change ≤−1 dB/year with p <0.01. Presence of at least 3 deteriorating locations was required to call an eye progressing. 22,24–28
Statistical methods
We performed ENR and ML analyses to identify structural and functional parameters that best predict worsening of VF at the end of the follow-up. In addition to the demographic and clinical factors mentioned above, we investigated the following variables in both approaches: global and sectoral baseline thickness and rates of change for cp-RNFL, and baseline thickness and rates of change of GCIPL in central 24 superpixels, 3 eccentricities, and superior and inferior hemimacular regions. The total number of variables explored were 54, 40, and 20 for the demographic and combined GCIPL and cp-RNFL models, only GCIPL models and only cp-RNFL models, respectively.
A. Elastic net regression
Given the large number of predictors of interest, i.e., baseline cp-RNFL and macular thickness measurements and rates of change along with clinical factors and the potential correlation between some of the explored predictors, ENR was used to identify the most parsimonious and relevant set of variables and address collinearity. 29,30 Elastic net regression combines the properties of both lasso and ridge regression with regard to regularization of potential variable coefficients and is particularly useful when collinearity among predictors needs to be addressed. The ENR’s two major parameters α and λ were determined using 10-fold cross-validation after dividing the sample into training and validation subsets in 3 to 1 proportion. A multivariable logistic regression (MLR) with the 24–2 visual field progression as the dependent outcome (see above) was subsequently fit to assess the performance of the best subset of predictor variables identified with ENR. The area under the receiver characteristics curves (AUC) was subsequently calculated for each model. The ENR was performed through Glmnet package within the R programming language. 31,32
B. Machine learning approach
We developed a framework to evaluate glaucoma prediction power of subsets of features using different machine learning schemes. We employed subset feature selection, 33 which evaluates the worth of a subset of features by considering the individual glaucoma progression predictive ability of each feature along with the degree of redundancy among features. Feature selection has several advantages including better visualization, enhanced understanding of data, decreased computational complexity in terms of memory and time, avoidance of overfitting, and improved accuracy in most cases. 34,35 More specifically, we generated different subsets of features along with different classifiers in an optimization framework and assessed their AUC in predicting VF progression. To generate subsets of features, we performed a greedy forward or backward search through the space of all clinical, demographic, and OCT subsets of parameters. We started with a random subset and then gradually added or removed features according to the increase or decrease in the prediction accuracy in terms of AUC. As a result, a subset of parameters that was highly predictive of glaucoma progression with low intercorrelation was identified. We investigated several machine learning models including Naïve Bayes, Random Forests, and Support Vector Machine (SVM) and selected the model with the highest AUC. More specifically, we used 5-fold cross-validation to evaluate the accuracy of each model. 36 This approach involves randomly dividing the set of observations into five non-overlapping subsets, or folds, of approximately equal size. We trained the models using the combined four folds and tested the model using the remaining fold. 37 We repeated this process five times and then averaged the results. As cross-validation stratifies the samples in generating the folds, all samples are eventually used in training and testing in separate non-overlapping folds iteratively until all folds are tested independently. Cross-validation minimizes the bias and generates a robust and dependable outcome through evaluating all samples, which is very effective particularly when dealing with relatively small datasets.
Results
One hundred and four eyes from 104 patients were enrolled in this study. Table 1 represents the baseline demographics and clinical characteristics of the study sample. The median (interquartile [IQR]) follow up time, number of visits, and mean (± standard deviation [SD]) baseline 24–2 VF MD were 3.8 (0.9) years, 8.7 (1.6), −8.4 (±5.5) dB, respectively. The average (±SD) MD of the central 12 locations on the 24–2 VF was –4.4 (±3.7) dB. Eighty-four out of 104 eyes had central loss defined as presence of at least 2 test locations flagged as having a p <0.05 on the pattern deviation plot. Based on the PLR criteria, 23 eyes (22%) were determined to be progressing. The mean (±SD) of GCIPL rates of change in the superior hemimacula for non-progressing and progressing eyes were −0.12 (±0.51) and −0.50 (±0.71) μm/year, respectively, p =0.02, t test); the corresponding numbers in the inferior hemimacula were −0.25 (±0.42) and −0.53 (±0.72) μm/year, respectively (p =0.08, t test).
Table 1.
Variable | All Eyes | Stable | Progressing | P value |
---|---|---|---|---|
Follow-up time (years) | ||||
Median | 4.5 | 4.5 | 4.5 | 0.49 |
IQR | 4.0–5.0 | 4.0–5.1 | 4.2–4.7 | |
Age (years) | ||||
Mean (± SD) | 67.3 (± 8.2) | 66.6 (± 8) | 69.1 (± 7.7) | 0.19 |
Gender (%) | ||||
Female | 66 (63.9%) | 49 (60.5%) | 16 (69.5%) | 0.99 |
Male | 38 (36.1%) | 32 (39.5%) | 7 (30.4%) | 0.99 |
Race (%) | ||||
African American | 12 (12.0%) | 10 (12.3%) | 2 (8.7%) | 0.35 |
Asian | 24 (22.2%) | 19 (23.4%) | 3 (13.0%) | 0.70 |
Caucasian | 56 (53.7%) | 43 (53.0%) | 14 (60.8%) | 0.66 |
Hispanic | 12 (12.0%) | 9 (11.3%) | 4 (17.5%) | 0.47 |
Baseline IOP (mmHg) | ||||
Mean (± SD) | 12.5 (± 3.7) | 12.3 (± 3.7) | 12.9 (± 3.7) | 0.48 |
24–2 Baseline MD (dB) | ||||
Mean (± SD) | −8.4 (± 5.5) | −8.8 (± 6.2) | −7.5 (± 5.6) | 0.35 |
24–2 Baseline PSD (dB) | ||||
Mean (± SD) | 8.7 (± 4.3) | 8.2 (± 3.7) | 8.2 (± 3.5) | 0.99 |
CCT (μm) | ||||
Mean (± SD) | 533.3 (± 38.1) | 534.4 (±38.6) | 532.7(±38.1) | 0.85 |
Baseline global cp-RNFL thickness (μm) | ||||
Mean (± SD) | 62.9 (± 14.2) | 62.8 (± 14.5) | 62.3 (±13.2) | 0.85 |
Baseline average GCIPL thickness (μm) | ||||
Mean (± SD) | 56.7 (± 8.4) | 56.5 (± 8.9) | 56.5 (± 6.5) | 0.97 |
IQR = interquartile range; SD = standard deviation; cp-RNFL = circumpapillary retinal nerve fiber layer; GCIPL = ganglion cell/inner plexiform layer; IOP = intraocular pressure; CCT = central corneal thickness; MD = mean deviation; PSD = pattern standard deviation.
When both macular GCIPL and cp-RNFL variables along with demographic and clinical data were entered into the logistic models, the best predictive subset of variables forecasting 24–2 VF progression based on ENR consisted of rates of change of cp-RNFL in the superior temporal sector and GCIPL rates of change in superpixels 2.5, 4.2, 4.3, 5.3 and 5.6 and at 3.4°, 5.6° eccentricities. The final AUC (± 95% confidence interval [CI]) for discriminating progressing vs. stable eyes was 0.79 (±0.12). We also applied ENR to select the best subset of parameters when demographic/clinical variables were combined with only GCIPL data or only cp-RNFL data. For the GCIPL only model, the best subset of variables selected were GCIPL rates of change within superpixels 2.5, 4.2, 4.3, 5.3 and 5.6 and at 3.4°, 5.6° eccentricities with AUC (±SD) of 0.78 (± 0.12) for predicting glaucoma progression. The model combining demographic/clinical variables with only cp-RNFL data failed to identify any significant variables for prediction of progression. Table 2 provides the results of multivariable logistic regression with the ENR approach for the 2 models mentioned above. Figure 2 shows the receiver operating characteristics (ROC) curves of the 2 models.±
Table 2.
Predictor | Coefficient |
---|---|
Combined GCIPL, cp-RNFL and clinical data | |
Rates of cp-RNFL change, superior temporal sector | −0.016 |
Rates of GCIPL change at 3.4° eccentricity | −0.030 |
Rates of GCIPL change at 5.6° eccentricity | −0.066 |
Rates of GCIPL change, superpixel 5.3 | −0.040 |
Rates of GCIPL change, superpixel 5.6 | −0.024 |
Rates of GCIPL change, superpixel 4.3 | −0.008 |
Rates of GCIPL change, superpixel 4.2 | −0.016 |
Rates of GCIPL change, superpixel 2.5 | −0.010 |
Only GCIPL and clinical data | |
Rates of GCIPL change at 3.4° eccentricity | −0.008 |
Rates of GCIPL change at 5.6° eccentricity | −0.058 |
Rates of GCIPL change, superpixel 5.3 | −0.050 |
Rates of GCIPL change, superpixel 5.6 | −0.030 |
Rates of GCIPL change, superpixel 4.3 | −0.007 |
Rates of GCIPL change, superpixel 4.2 | −0.019 |
Rates of GCIPL change, superpixel 2.5 | −0.008 |
SE = standard error; cp-RNFL = circumpapillary retinal nerve fiber layer; GCIPL = ganglion cell/inner plexiform layer.
In the ML approach, baseline GCIPL thickness in the superior hemimacula and 3.4° eccentricity, rates of change of GCIPL at 3.4° eccentricity and superpixels 4.4, 5.4, 5.7, 7.4, and 7.5 along with AL were found to have the best performance for prediction of visual field progression with a Naïve Bayes classifier (AUC =0.81; 95% CI: 0.71–0.91) (Figure 3). The sensitivity and specificity of the final ML model were 66% and 85%, respectively. We also investigated several other machine learning classifiers including Random Forests and SVM; however, Naïve Bayes classifier was the best performing classifier on this subset of features and outperformed all the other classifiers. When the ML approach was applied to demographic/clinical data along with only GCIPL data, AL along with baseline GCIPL thickness in the superior hemimacula and 3.4° eccentricity, rates of change of GCIPL at 3.4° eccentricity and superpixels 4.4, 5.4, 5.7, 7.4 and 7.5 resulted in an AUC of 0.80 (95% CI: 0.69–0.91). When demographic/clinical data and only cp-RNFL data were used in the ML models, the best subset of parameters identified were AL, baseline RNFL thickness in the nasal superior sector and global RNFL rates of change and cp-RNFL change rates in the temporal and temporal superior sectors (AUC =0.61; 95% CI: 0.47–0.76). Table 3 summarizes the AUCs for various subsets used in the ENR and ML models.
Table 3.
Predictive data | AUC | 95% CI |
---|---|---|
Elastic net regression | ||
Demographic/clinical + GCIPL + cp-RNFL | 0.79 | 0.12 |
Demographic/clinical + GCIPL | 0.78 | 0.12 |
Machine Learning applied on most discriminative subset of features | ||
Demographic/clinical + GCIPL + cp-RNFL | 0.81 | 0.10 |
Demographic/clinical + GCIPL | 0.80 | 0.11 |
Demographic/clinical + cp-RNFL | 0.61 | 0.15 |
CI = confidence interval; cp-RNFL = circumpapillary retinal nerve fiber layer; GCIPL = ganglion cell/inner plexiform layer.
Figures 4a and 4b display Venn diagrams for agreement between ENR, ML model (both using the combined GCIPL and RNFL dataset), and the ground truth of progression based on PLR approach for stable and progressing eyes, respectively. While the agreement on progressing eyes was fair (Figure 4b), good agreement was observed on stable eyes (Figure 4a).
Discussion
We demonstrate the utility of structural measures including baseline measurements and rates of change of cp-RNFL and macular GCIPL thickness for predicting subsequent 24–2 VF progression based on both statistical (ENR) and machine learning approaches. We found that the best subset of parameters selected by ENR had a clinically relevant predictive performance for functional glaucoma progression (AUC =0.79). When cp-RNFL data were excluded, the performance of the best subset of variables only slightly decreased (AUC =0.78). The combination of demographic/clinical and cp-RNFL variables had the lowest performance. Similarly, with the ML approach, the best AUC was achieved with a Naïve Bayes classifier using all the demographic/clinical, GCIPL, and cp-RNFL data (AUC =0.81). Like logistic regression, the AUC for the prediction was almost as good when demographic/clinical data were combined with only GCIPL variables (AUC =0.80). When only cp-RNFL variables and demographic/clinical data were entered into the ML model, the model performance deteriorated (AUC =0.61).
The performance of either model (ENR or ML) with all the available demographic/clinical data and structural variables seems clinically relevant and is comparable or superior to the best predictor algorithms reported in the literature for forecasting glaucoma development or progression. The C statistic of the predictive model derived from the combined OHTS-EGPS database was 0.74 for predicting glaucoma progression during the initial 5-year period following patient enrollment. 38In our study, enrolled eyes had moderate to advanced glaucoma damage at baseline; depending on the level of structural damage in cp-RNFL vs. inner macular layers, the prediction power of the specific outcomes explored may be different as the structural outcome of interest that has not reached measurement floor would provide better predictions of VF progression. 39 In another study, De Moraes et al. reported good agreement between predicted and observed probability of progression based on their model with a C-index of 0.75. 3 The C-index has a similar interpretation as the AUC. Neither study utilized OCT data for prediction. Some studies considered OCT structural data for prediction of glaucoma progression. 40–43 In the study by Sung et al., the authors found that changes in the average full macular thickness was significantly higher in the progressing group. 43 We evaluated the utility of inner macular thickness measurements (specifically GCIPL where glaucoma damage is easier to detect) at the level of superpixels and 3 eccentricities. Schrems and colleagues evaluated cp-RNFL OCT thickness and neuroretinal rim measurements from confocal scanning laser ophthalmoscopy for predicting functional glaucoma progression; they reported that rates of cp-RNFL change within the temporal inferior sector was the best predictor of functional change; similarly, with only cp-RNFL thickness variables within the ML model, we found that rates of change of cp-RNFL within temporal and temporal inferior sectors were the best predictors. 40 Our study is among the first ones to use both baseline and longitudinal cp-RNFL and GCIPL structural data for predicting VF progression using ENR and ML approaches.
Yousefi et al. found that an ML approach (unsupervised Gaussian mixture model with expectation maximization) was able to detect glaucomatous VF progression earlier than other methods such as global MD change, or region-wise or pointwise change. 44 One of the advantages of the ML approach is the ability to select a smaller subset among multitude of parameters explored. The features (variables) with the highest Gini score in our study significantly improved the accuracy of the classifier compared to when all parameters were used. Traditional statistical methods such as logistic regression normally require much higher sample sizes given the large number of predicter variables investigated in this study. We used AUC values for assessing the performance of various ML and ENR model. Given the small number of progressing eyes, the sample is unbalanced and therefore, other measures such as confusion matrices could be misleading.
Daneshvar et al. recently reported the potential utility of baseline GCIPL and RNFL measures for prediction of subsequent glaucoma progression defined as worsening of 24–2 VFs based on event or trend criteria. 45 In that study, thinner RNFL or GCIPL thickness at baseline significantly improved prediction of subsequent glaucoma progression. The study sample in the current investigation consisted of eyes with baseline central damage or moderate to advanced glaucoma; this group of eyes would be expected to show evidence of change on the macular OCT images. 46–48 This fact partially explains the finding that GCIPL measures had a better performance than cp-RNFL measures for prediction of subsequent 24–2 VF progression. In advanced glaucoma, GCIPL reaches its measurement floor later than cp-RNFL. This could be another explanation for our finding that GCIPL was a better predictor of glaucoma progression based on 24–2 VFs than cp-RNFL in this group of patients with mostly moderate to advanced glaucoma. 47 Rates of change of GCIPL in individual superpixels were among the variables providing prediction ability for glaucoma progression; most of the identified superpixels were centrally located. This is consistent with the regions of the macular cube demonstrating the fastest rates of change in a recent study by Rabiolo and colleagues. 49 Rates of change of GCIPL at circles 1 and 2 for ENR and at circle 1 for ML approach were among the best subset of parameters for predicting glaucoma VF progression. This finding is in agreement with results reported by Mohammadzadeh et al. demonstrating that the average rates of GCIPL change on circles 1 and 2 had the highest correlation between with the corresponding regions of the central 10° VF. 50
Kim and colleagues reported that older age, higher peak IOP and glaucoma surgery during follow-up were associated with higher rates of VF progression assessed with different methods. 51 In our study, neither of the approaches considered age a predictor of glaucoma progression. This is in contrast of some previous prognostic studies on glaucoma progression. 52,53 The utility of IOP reduction for preventing glaucoma progression was proven by The Early Manifest Glaucoma Trial (EMGT). 53 The patients in the current study were all under treatment during the study period; this could have expectedly masked the influence of IOP on disease progression as eyes at higher risk of progression would presumably have received more intensive treatment.
Use of ENR for prognostication of glaucoma progression is novel. A Japanese study implemented lasso regression for predicting glaucoma progression. 54 The authors studied various regression models for predicting VF status from prior VF data and found that lasso regression was the most accurate method with the least prediction error. Elastic net regression is considered as hybrid of lasso and ridge regression approaches and the penalization method is also a mixture of those used by the 2 methods. It has been suggested that for datasets with highly correlated predictors, ENR can outperform lasso regression. 30
We found modest agreement between ENR and ML approaches for prediction of progressing eyes. This could be explained by the fact that the models identified different parameters to provide predictions. Future studies will explore combining such models in order to provide better predictions of progressing eyes and higher sensitivity.
The findings of our study, once corroborated and validated in other cohorts, could be used to enhance prediction of visual field progression during the follow-up period, especially in eyes displaying macular damage at baseline. These eyes are at highest risk of losing central vision and becoming visually disabled with disease deterioration. A change in macular superpixels could potentially be a harbinger of subsequent visual field loss and could be considered with other clinical factors for decision making on optimization of therapeutic measures. The main limitations of our study are the relatively small sample size and the fairly small number of eyes that progressed during the follow-up period. This could have affected our ability to identify all predictor variables for functional progression and hence, the predictive ability of the model. Despite this, the predictive performance of the model was clinically relevant. Nevertheless, we used stratified subsets of eyes in both training and testing and employed cross-validation to assure both groups were represented in training and testing. Future studies on larger sample sizes and with longer follow-up times will be able to address the above limitations. Another limitation is that, although the study eyes had central glaucoma damage at baseline, functional progression was defined based on PLR on 24–2 VF test locations, rather than 10–2 VFs.
In conclusion, we demonstrate that functional glaucoma progression can be confirmed or predicted with baseline and longitudinal structural data with clinically relevant accuracy. Further refinement of our approaches could provide clinicians with a valuable tool for forecasting functional progression and clinical decision making in glaucoma.
Acknowledgement
The study was supported by National Eye Institute (NEI) grants R01 EY029792 (KNM) and R21 EY030142 (SY), R21 EY031725 (SY), unrestricted departmental grants from Research to Prevent Blindness (KNM and SY) and an unrestricted grant from Heidelberg Engineering (KNM).
Footnotes
CRediT author statement
Nouri-Mahdavi, Kouros; Conceptualization, Methodology, Resources, Investigation, Validation, Formal Analysis, Data Curation, Writing - Original Draft, Visualization, Supervision, Project administration, Funding acquisition Mohammadzadeh, Vahid; Methodology, Software, Investigation, Formal Analysis, Writing - Original Draft, Visualization Rabiolo, Alessandro; Formal Analysis Edalati, Kiumars; Data collection Caprioli, Joseph; Writing - Review & Editing, Validation Yousefi, Siamak; Methodology, Software, Formal Analysis, Writing - Original Draft, Funding acquisition.
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
References
- 1.De Moraes CG, Liebmann JM, Levin LA. Detection and measurement of clinically meaningful visual field progression in clinical trials for glaucoma. Prog Retin Eye Res. 2017;56:107–147. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Harwerth RS, Quigley HA. Visual field defects and retinal ganglion cell losses in patients with glaucoma. Arch Ophthalmol. 2006;124(6):853–859. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.De Moraes CG, Sehi M, Greenfield DS, Chung YS, Ritch R, Liebmann JM. A validated risk calculator to assess risk and rate of visual field progression in treated glaucoma patients. Invest Ophthalmol Vis Sci. 2012;53(6):2702–2707. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Lee JM, Caprioli J, Nouri-Mahdavi K, et al. Baseline prognostic factors predict rapid visual field deterioration in glaucoma. Invest Ophthalmol Vis Sci. 2014;55(4):2228–2236. [DOI] [PubMed] [Google Scholar]
- 5.Nouri-Mahdavi K, Hoffman D, Coleman AL, et al. Predictive factors for glaucomatous visual field progression in the Advanced Glaucoma Intervention Study. Ophthalmology. 2004;111(9):1627–1635. [DOI] [PubMed] [Google Scholar]
- 6.Yousefi S, Goldbaum MH, Balasubramanian M, et al. Glaucoma progression detection using structural retinal nerve fiber layer measurements and functional visual field points. IEEE Trans Biomed Eng. 2014;61(4):1143–1154. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Raza AS, Zhang X, De Moraes CG, et al. Improving glaucoma detection using spatially correspondent clusters of damage and by combining standard automated perimetry and optical coherence tomography. Invest Ophthalmol Vis Sci. 2014;55(1):612–624. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Asaoka R, Iwase A, Hirasawa K, Murata H, Araie M. Identifying “preperimetric” glaucoma in standard automated perimetry visual fields. Invest Ophthalmol Vis Sci. 2014;55(12):7814–7820. [DOI] [PubMed] [Google Scholar]
- 9.Bizios D, Heijl A, Bengtsson B. Integration and fusion of standard automated perimetry and optical coherence tomography data for improved automated glaucoma diagnostics. BMC ophthalmology. 2011;11(1):1–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Bowd C, Weinreb RN, Balasubramanian M, et al. Glaucomatous patterns in Frequency Doubling Technology (FDT) perimetry data identified by unsupervised machine learning classifiers. PLoS One. 2014;9(1):e85941. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Yousefi S, Goldbaum MH, Balasubramanian M, et al. Glaucoma progression detection using structural retinal nerve fiber layer measurements and functional visual field points. IEEE Transactions on Biomedical Engineering, In press. 2014. [DOI] [PMC free article] [PubMed]
- 12.Yousefi S, Goldbaum MH, Balasubramanian M, et al. Learning from data: recognizing glaucomatous defect patterns and detecting progression from visual field measurements. IEEE Trans Biomed Eng. 2014;61(7):2112–2124. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Yousefi S, Goldbaum MH, Zangwill LM, Medeiros FA, Bowd C. Recognizing patterns of visual field loss using unsupervised machine learning. Paper presented at: SPIE, Medical Imaging2014; San Diego, USA. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Hirasawa H, Murata H, Mayama C, Araie M, Asaoka R. Evaluation of various machine learning methods to predict vision-related quality of life from visual field data and visual acuity in patients with glaucoma. Br J Ophthalmol. 2014;98(9):1230–1235. [DOI] [PubMed] [Google Scholar]
- 15.Bowd C, Hao J, Tavares IM, et al. Bayesian machine learning classifiers for combining structural and functional measurements to classify healthy and glaucomatous eyes. Invest Ophthalmol Vis Sci. 2008;49(3):945–953. [DOI] [PubMed] [Google Scholar]
- 16.Bowd C, Lee I, Goldbaum MH, et al. Predicting glaucomatous progression in glaucoma suspect eyes using relevance vector machine classifiers for combined structural and functional measurements. Invest Ophthalmol Vis Sci. 2012;53(4):2382–2389. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Racette L, Chiou CY, Hao J, et al. Combining functional and structural tests improves the diagnostic accuracy of relevance vector machine classifiers. J Glaucoma. 2010;19(3):167–175. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Bruce P BA, Gedeck P. Practical Statistics for Data Scientists: 50+ Essential Concepts Using R and Python. O’Reilly Media;. 2020. April 10.
- 19.James G, Daniela Witten, Trevor Hastie, and Robert Tibshirani. An Introduction to Statistical Learning: With Applications in R. Springer Publishing Company, Incorporated. 2014.. [Google Scholar]
- 20.Ammad-Ud-Din M, Khan SA, Wennerberg K, Aittokallio T. Systematic identification of feature combinations for predicting drug response with Bayesian multi-view multi-task linear regression. Bioinformatics. 2017;33(14):i359–i368. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Johnson CA, Sample PA, Cioffi GA, Liebmann JR, Weinreb RN. Structure and function evaluation (SAFE): I. criteria for glaucomatous visual field loss using standard automated perimetry (SAP) and short wavelength automated perimetry (SWAP). Am J Ophthalmol. 2002;134(2):177–185. [DOI] [PubMed] [Google Scholar]
- 22.Rabiolo A, Morales E, Mohamed L, et al. Comparison of Methods to Detect and Measure Glaucomatous Visual Field Progression. Transl Vis Sci Technol. 2019;8(5):2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.de Moraes CG, Song C, Liebmann JM, Simonson JL, Furlanetto RL, Ritch R. Defining 10–2 visual field progression criteria: exploratory and confirmatory factor analysis using pointwise linear regression. Ophthalmology. 2014;121(3):741–749. [DOI] [PubMed] [Google Scholar]
- 24.Artes PH, Nicolela MT, LeBlanc RP, Chauhan BC. Visual field progression in glaucoma: total versus pattern deviation analyses. Invest Ophthalmol Vis Sci. 2005;46(12):4600–4606. [DOI] [PubMed] [Google Scholar]
- 25.Saeedi OJ, Elze T, D’Acunto L, et al. Agreement and Predictors of Discordance of 6 Visual Field Progression Algorithms. Ophthalmology. 2019;126(6):822–828. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Nouri-Mahdavi K, Caprioli J, Coleman AL, Hoffman D, Gaasterland D. Pointwise linear regression for evaluation of visual field outcomes and comparison with the advanced glaucoma intervention study methods. Arch Ophthalmol. 2005;123(2):193–199. [DOI] [PubMed] [Google Scholar]
- 27.Johnson CA, Adams AJ, Casson EJ, Brandt JD. Progression of early glaucomatous visual field loss as detected by blue-on-yellow and standard white-on-white automated perimetry. Arch Ophthalmol. 1993;111(5):651–656. [DOI] [PubMed] [Google Scholar]
- 28.Kummet CM, Zamba KD, Doyle CK, Johnson CA, Wall M. Refinement of pointwise linear regression criteria for determining glaucoma progression. Invest Ophthalmol Vis Sci. 2013;54(9):6234–6241. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Hastie T TR, Wainwright M. Statistical learning with sparsity: the lasso and generalizations. CRC press. 2015. May 7. [Google Scholar]
- 30.Zou H HT. Regularization and variable selection via the elastic net. Journal of the royal statistical society: series B (statistical methodology). 2005. April;1(67):01–20. [Google Scholar]
- 31.Friedman J HT, Tibshirani R. Regularization Paths for Generalized Linear Models via Coordinate Descent. Journal of Statistical Software. 2010;33(1):1–22. [PMC free article] [PubMed] [Google Scholar]
- 32.Simon N FJ, Hastie T, Tibshirani R. Regularization Paths for Cox’s Proportional Hazards Model via Coordinate Descent. Journal of Statistical Software. 2011;39(5):1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Kohavi R, John GH. Wrappers for feature subset selection. Artif Intell. 1997;97(1–2):273–324. [Google Scholar]
- 34.Witten IH, Frank E, Hall MA, Pal CJ. Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann; 2016. [Google Scholar]
- 35.Loughrey J, Cunningham P. Overfitting in wrapper-based feature subset selection: The harder you try the worse it gets. Paper presented at: International Conference on Innovative Techniques and Applications of Artificial Intelligence2004. [Google Scholar]
- 36.Wong T-T. Parametric methods for comparing the performance of two classification algorithms evaluated by k-fold cross validation on multiple data sets. Pattern Recognition. 2017;65:97–107. [Google Scholar]
- 37.James G, Witten D, Hastie T, Tibshirani R. An introduction to statistical learning. Vol 112: Springer; 2013. [Google Scholar]
- 38.Gordon MO, Torri V, Miglior S, et al. Validated prediction model for the development of primary open-angle glaucoma in individuals with ocular hypertension. Ophthalmology. 2007;114(1):10–19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Miraftabi A, Amini N, Morales E, et al. Macular SD-OCT Outcome Measures: Comparison of Local Structure-Function Relationships and Dynamic Range. Invest Ophthalmol Vis Sci. 2016;57(11):4815–4823. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Schrems WA, Schrems-Hoesl LM, Mardin CY, Laemmer R, Kruse FE, Horn FK. Can Glaucomatous Visual Field Progression be Predicted by Structural and Functional Measures? J Glaucoma. 2017;26(4):373–382. [DOI] [PubMed] [Google Scholar]
- 41.Zheng Y, Xu L, Kiwaki T, et al. Glaucoma Progression Prediction Using Retinal Thickness via Latent Space Linear Regression. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining; 2019. [Google Scholar]
- 42.Ungar AK, Wollstein G, Ishikawa H, et al. Evaluating objective and subjective quantitative parameters at the initial visit to predict future glaucomatous visual field progression. Ophthalmic Surg Lasers Imaging. 2012;43(5):416–424. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Sung KR, Sun JH, Na JH, Lee JY, Lee Y. Progression detection capability of macular thickness in advanced glaucomatous eyes. Ophthalmology. 2012;119(2):308–313. [DOI] [PubMed] [Google Scholar]
- 44.Yousefi S, Kiwaki T, Zheng Y, et al. Detection of Longitudinal Visual Field Progression in Glaucoma Using Machine Learning. Am J Ophthalmol. 2018;193:71–79. [DOI] [PubMed] [Google Scholar]
- 45.Daneshvar R, Yarmohammadi A, Alizadeh R, et al. Prediction of Glaucoma Progression with Structural Parameters: Comparison of Optical Coherence Tomography and Clinical Disc Parameters. Am J Ophthalmol. 2019. December;1(208):19–29. [DOI] [PubMed] [Google Scholar]
- 46.Asrani S, Rosdahl JA, Allingham RR. Novel software strategy for glaucoma diagnosis: asymmetry analysis of retinal thickness. Arch Ophthalmol. 2011;129(9):1205–1211. [DOI] [PubMed] [Google Scholar]
- 47.Bowd C, Zangwill LM, Weinreb RN, Medeiros FA, Belghith A. Estimating Optical Coherence Tomography Structural Measurement Floors to Improve Detection of Progression in Advanced Glaucoma. Am J Ophthalmol. 2017;175:37–44. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Belghith A, Medeiros FA, Bowd C, et al. Structural Change Can Be Detected in Advanced-Glaucoma Eyes. Invest Ophthalmol Vis Sci. 2016;57(9):October 511–518. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Rabiolo A, Mohammadzadeh V, Fatehi N, et al. Comparison of Rates of Progression of Macular OCT Measures in Glaucoma. Transl Vis Sci Technol. 2020;9(7). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Mohammadzadeh V, Rabiolo A, Fu Q, et al. Longitudinal Macular Structure-Function Relationships in Glaucoma. Ophthalmology. 2020. July 1;127(7):888–900. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Kim JH, Rabiolo A, Morales E, et al. Risk Factors for Fast Visual Field Progression in Glaucoma. Am J Ophthalmol. 2019;207:268–278. [DOI] [PubMed] [Google Scholar]
- 52.Nouri-Mahdavi K, Hoffman D, Gaasterland D, Caprioli J. Prediction of visual field progression in glaucoma. Invest Ophthalmol Vis Sci. 2004;45(12):4346–4351. [DOI] [PubMed] [Google Scholar]
- 53.Leske MC, Heijl A, Hussein M, Bengtsson B, Hyman L, Komaroff E. Factors for glaucoma progression and the effect of treatment: the early manifest glaucoma trial. Arch Ophthalmol. 2003;121(1):48–56. [DOI] [PubMed] [Google Scholar]
- 54.Fujino Y, Murata H, Mayama C, Asaoka R. Applying “Lasso” Regression to Predict Future Visual Field Progression in Glaucoma Patients.Invest Ophthalmol Vis Sci. 2015;56(4):2334–2339. [DOI] [PubMed] [Google Scholar]