Skip to main content
Ophthalmology Science logoLink to Ophthalmology Science
. 2021 Sep 22;1(4):100059. doi: 10.1016/j.xops.2021.100059

An Initiative to Improve Follow-up of Patients with Glaucoma

Calvin C Robbins 1, Sidrah Anjum 1, Amer Mosa Alwreikat 1,2, Michael Lee Cooper 1, Paul R Cotran 1,2, Shiyoung Roh 1,2, David J Ramsey 1,2,
PMCID: PMC9560565  PMID: 36246940

Abstract

Purpose

This study describes the implementation of an electronic medical record (EMR)-based initiative aimed at reducing the number of patients with glaucoma-related diagnoses lost to follow-up (LTF) and reviews its short-term outcomes.

Design

Retrospective, comparative case series.

Participants

Patients with glaucoma-related diagnoses seen 1 year prior at the Lahey Medical Center and who had not returned within the 6-month period between January 1, 2020, and June 30, 2020, which spanned the outbreak of the Coronavirus Disease 2019 (COVID-19) pandemic in the United States.

Methods

An EMR-based tool was designed to identify patients suspected of being LTF with glaucoma-related diagnoses. Providers were enlisted to review the EMR for each of these patients and re-engage them, as appropriate. One month later, the initiative was evaluated by means of a retrospective chart review. Binary logistic regression analysis was used to identify demographic, clinical, and sociomedical factors associated with being LTF.

Main Outcome Measures

Patients who completed a telemedicine or in-person appointment, or had a future scheduled or ordered return appointment, were considered re-engaged.

Results

Of the 3551 patients seen during the study period, 384 patients were identified as LTF (11%), with 60 identifying COVID-19 as the reason for canceling their visit (16%). Patients who lived farther from the eye clinic (P < 0.001) or who had a history of canceling or missing an appointment (P < 0.001) were more likely to be LTF. Patients with open-angle glaucoma (P = 0.042) or who had completed a visual field (P < 0.001) or ophthalmic imaging (P < 0.001) within the past year were less likely to be LTF. One month after the re-engagement initiative, 124 LTF patients (32%) had been re-engaged (40% through telemedicine), 238 patients (62%) had future scheduling orders in place, and 22 patients (6%) had no active plan for future follow-up.

Conclusions

An EMR-based tool is an effective method for identifying patients at risk of being LTF and provides an opportunity for providers to recall and re-engage patients. Use of telemedicine to recontact LTF patients shows promise of improving the management of glaucoma, enhancing clinical productivity, and documenting treatment plans, thereby potentially reducing medicolegal liability.

Keywords: Adherence, Electronic Health Record, Glaucoma, Medical informatics, Open-Angle Glaucoma, Quality Improvement, Taxonomy

Abbreviations and Acronyms: CDR, cup-to-disc ratio; CI, confidence interval; COVID-19, Coronavirus Disease 2019; EMR, electronic medical record; IOP, intraocular pressure; LTF, lost to follow-up; OR, odds ratio; POAG, primary open-angle glaucoma; QI, quality improvement; RNFL, retinal nerve fiber layer; VA, visual acuity


Adherence to recommended follow-up for glaucoma has historically been poor, especially among asymptomatic patients or those with mild disease, with rates of “lost to follow-up” (LTF) as high as 46%.1, 2, 3, 4 The Coronavirus Disease 2019 (COVID-19) pandemic has increased the likelihood that patients with glaucoma will become LTF. In the first 6 weeks after the announcement of a statewide stay-at-home order in Massachusetts in response to the outbreak of COVID-19, total ophthalmology volume at our academic, multispecialty group practice decreased 86% and glaucoma visits, in particular, decreased 94%.5

This study presents a quality improvement (QI) initiative aimed at reducing LTF among patients with glaucoma-related diagnoses at an academic medical center. We used an electronic medical record (EMR)-based reporting tool to identify patients who were at risk of being LTF by virtue of not returning for follow-up care. We then enlisted providers to review the EMR for each of their patients and re-engage them, as appropriate, through a combination of telehealth and office-based recall orders. We evaluated the efficiency and effectiveness of such an EMR-based program, and examined several readily obtainable EMR data elements and sociomedical factors with the aim of understanding which factors might be exacerbating LTF. It is our hope that this EMR-based strategy will be adopted to improve patient retention and ultimately enhance glaucoma care and outcomes.

Methods

The research followed the tenets of the Declaration of Helsinki and was approved as a QI initiative by the Institutional Review Board of the Lahey Hospital & Medical Center, Burlington, Massachusetts. Information was gathered and secured in compliance with the Health Insurance Portability and Accountability Act. The requirement for informed consent was waived because of the retrospective nature of the study.

Patients with glaucoma-related diagnoses seen 1 year prior at the Lahey Hospital & Medical Center and who had not returned within the 6-month period between January 1, 2020, and June 30, 2020, were identified from the Lahey Hospital & Medical Center EMR on the basis of billing records and were flagged for provider review. This period coincided with the outbreak of the COVID-19 pandemic in the United States. Deceased patients and those with future scheduled appointments were excluded. Patient demographics (age, gender, race/ethnicity, and primary language spoken), clinical characteristics (visual acuity [VA], intraocular pressure [IOP], central corneal thickness, cup-to-disc ratio [CDR], and type of glaucoma), and ophthalmology appointment data (completed, canceled, and no-show appointments in the preceding year, medication refill requests, and history of visual field testing or imaging of the retinal nerve fiber layer [RNFL]) were extracted from the EMR for each patient by means of a custom reporting tool. Patients with glaucoma were defined broadly by International Classification of Diseases 10th Revision, Clinical Modification codes and divided into 4 groups: glaucoma suspects (H40.0) including OHT (H40.05); open-angle glaucoma (H40.1), including primary open-angle glaucoma (POAG) (H40.10 and H40.11), low-tension glaucoma (H40.12), pigmentary glaucoma (H40.13), and pseudoexfoliation glaucoma (H40.14); primary angle-closure glaucoma (H40.2); and secondary forms of glaucoma including unspecified (H40.9). Distance to the nearest Lahey Hospital & Medical Center eye clinic was computed by using an Excel VBA program to access Microsoft Maps (Microsoft Corp.) that calculated the distance between each patient’s home ZIP code and clinic ZIP code.

Quality Improvement Initiative

Providers received a list of their patients designated as potentially LTF based on the results of the EMR report and were asked to review the charts and re-engage patients, as appropriate, by means of telemedicine or scheduling orders for future recall in the EMR. Because the definition of potentially LTF was 6 months without being seen, providers were made aware that some of the patients identified in the report might not actually be due for return visits. Providers were not informed that the results of this initiative would be reviewed 1 month later to determine the efficacy and efficiency of this strategy.

Review of Quality Improvement Initiative

One month after this QI initiative, an EMR audit was performed by manually reviewing the charts of all patients sent to providers to ascertain their LTF status and to determine if the LTF status had changed as a result of the program. Patients who had scheduling orders that were not yet due (or due within the next 30 days relative to the start of the program) or had documented transfer of care to an outside provider were considered not to be LTF. Engagement by the program was divided into the following categories: patients who had completed (or scheduled) a telemedicine visit or in-person visit, those who declined follow-up when contacted, and those for whom a new scheduling order had been submitted during the period of the program. A review of existing scheduling orders in the EMR was also performed to determine if patients who remained LTF had an active, but overdue, scheduling order, an expired order (or an order that had been marked as completed in error), or no scheduling order placed at the time of their last follow-up. For patients who were LTF and had canceled or did not attend their most recent scheduled appointment, the reason for the missed appointment was noted, when known. Medication refill requests during the study period were also tabulated.

Statistical Analysis

SPSS Statistics version 27.0 (IBM Corp) was used to analyze data. Categorical variables are presented as percentages and compared using the 2-sided chi-square test with significance judged at the 5% level (P < 0.05). Data for continuous variables are recorded as mean ± standard deviation and compared using the 2-sided Student t test with significance judged at the 5% level (P < 0.05). Binary logistic regression analysis was used to identify demographic, clinical, and sociomedical factors associated with being LTF. For the logistic regression of multiple variables, we used a generalized linear model to determine the association between the variables included in the model and LTF status. Odds ratios (ORs) and 95% confidence intervals (CIs) were calculated for each variable with significance of the obtained results judged at the 5% level (P < 0.05).

Results

Demographics

From a total pool of 39 372 unique patients seen in ophthalmology between January 1, 2019, and June 30, 2019, 3666 patients (9.3%) with glaucoma-related diagnoses were identified (Fig 1). Of these, 558 patients were classified as potentially LTF (15%), having not been seen within the last 6 months, and were brought to the attention of their providers for further review. Providers were also notified of the 115 patients (3%) who were deceased.

Figure 1.

Figure 1

Process for patient identification and re-engagement strategy. An electronic medical record (EMR)-based strategy identified 558 potentially lost to follow-up (LTF) patients, of whom 384 patients were identified as LTF, comprising approximately 11% of all patients in the study period. One month after implementation of the quality improvement (QI) initiative, 124 of these LTF patients (32%) had been re-engaged: 40% through telemedicine, 57% with recall ordered or scheduled, and 4% declined follow-up when contacted. An additional 238 LTF patients (62%) had existing scheduling orders in the EMR; only 22 LTF patients (6%) had no active plan for future follow-up care.

A review of those patients forwarded on to providers confirmed that 384 patients were LTF (11%). Mean age of the LTF group was 76.0 ± 11.4 years, compared with 75.8 ± 11.1 years (P = 0.121) for the non-LTF group. The age distribution was not normally distributed and was skewed toward older ages in both groups (Shapiro–Wilk test, P < 0.001). Some 57% of the LTF patients were female, compared with 54% of the non-LTF group (chi-square = 1.68, P = 0.195). A majority of patients in the LTF and non-LTF groups self-identified as White, non-Hispanic (91% and 89%, respectively, chi-square = 1.254, P = 0.263). Additional clinical and demographic features are shown in Table 1.

Table 1.

Demographics and Clinical Characteristics and their Association with Loss to Follow-up

Characteristic Patients (n = 3551) Group
P Value
LTF (n = 384) Not LTF (n = 3167)
Continuous variables
 Age (yrs)
 Mean (SD) 74.2 (11.2) 76.0 (11.4) 74.1 (11.1) 0.121
 Median 76 77 76
 Range 18–101 38–98 18–101
 CCT (SD) 553.2 (41.2) 556.1 (39.4) 552.9 (41.4) 0.426
 IOP (SD) 16.1 (3.6) 16.1 (3.6) 16.2 (3.4) 0.706
 CDR (SD) 0.52 (0.23) 0.52 (0.21) 0.52 (0.24) 0.589
 CDR asymmetry (SD) 0.15 (0.19) 0.13 (0.16) 0.15 (0.19) 0.123
 Distance in miles to nearest eye clinic (SD) 16 (33) 23 (58) 15 (33) <0.001
Categorical variables
 Race (%)
 White 89.3 91.4 89.0 0.263
 Gender (%)
 Female 54.2 57.4 53.8 0.195
 Type of glaucoma (%)
 Glaucoma suspects 26 30 25 0.075
 Open-angle glaucoma 48 43 48 0.042
 Narrow-angle glaucoma 8 10 8 0.154
 Other 18 17 18 0.702
 Visual field in last year (%) 63 37 66 <0.001
 RNFL Imaging in Last Year (%) 50 24 53 <0.001

CCT = central corneal thickness; CDR = cup-to-disc ratio; IOP = intraocular pressure; LTF = lost to follow-up; RNFL = retinal nerve fiber layer; SD = standard deviation.

Including unspecified forms of glaucoma.

Comparison between the LTF and not LTF groups. Significance is marked in bold (P < 0.05).

Factors that Predict LTF

Several biometric and sociodemographic factors were found to be associated with the failure to follow-up among patients with glaucoma-related diagnoses. Patients LTF had similar CDRs and CDR asymmetry compared with those who were non-LTF (0.52 ± 0.21 vs. 0.52 ± 0.24, P = 0.589, and 0.13 ± 0.16 vs. 0.15 ± 0.19, P = 0.123, respectively). Specifically, patients who were LTF were less likely to have open-angle glaucoma (43% vs. 48%, chi-square = 4.127, P = 0.042) and even less likely to be LTF if they had POAG as a subtype of glaucoma (22% vs. 30%, chi-square = 10.506, P = 0.001). No significant difference was found for the rate of other glaucoma subtypes (data not shown). Finally, patients who had completed a visual field or imaging of the RNFL within the past year were less likely to be LTF, compared with those who did not have a history of such testing (66% vs. 37%, chi-square = 97.410, P < 0.001, and 53% vs. 24%, chi-square = 114.042, P < 0.001, respectively). Age, gender, race/ethnicity, primary language spoken, VA, and IOP all had no association with LTF status.

Ophthalmology appointment metrics were also evaluated for association with LTF status. Patients LTF completed fewer total ophthalmology appointments in the prior year than those who were not LTF (2.4 ± 1.8 vs. 3.9 ± 3.4, P < 0.001). Some 20% of patients LTF had canceled an appointment in the prior year, whereas only 10% of non-LTF patients had canceled (chi-square = 6.64, P = 0.010). Likewise, although 15% of patients who were LTF had not shown up for a scheduled appointment in the last year, the rate was only 8% for patients who were not LTF (chi-square = 19.00, P < 0.001).

Finally, distance to the clinic was directly related to the likelihood of being LTF. Patients who were LTF lived, on average, 50% farther from the nearest Lahey Hospital & Medical Center eye clinic compared with those whose follow-up was up-to-date (23 ± 58 miles vs. 15 ± 33 miles, P < 0.001).

Multiple Regression Analysis for Key Factors Associated with LTF

Stepwise multiple regression was used to assess variables that might influence LTF among patients with glaucoma-related diagnoses (Table 2). Variables selected for the final model included the number of ophthalmology appointments completed, canceled, and missed within the prior year, as well as a history of visual field testing or RNFL imaging within the prior year. The number of ophthalmology appointments completed within the prior year was inversely related to the risk of being LTF (OR, 0.75; 95% CI, 0.67–0.81, P < 0.001). The number of canceled or missed scheduled appointments increased the risk of being LTF (OR, 1.15; 95% CI, 1.11–1.25 P < 0.001 and OR, 1.75; 95% CI, 1.4–2.18, P < 0.001, respectively). Completing a visual field test or an RNFL image in the prior year was the strongest factor associated with a reduced risk of being LTF (OR, 0.43; 95% CI, 0.33–0.56, P < 0.001, and OR, 0.35; 95% CI, 0.27–0.46, P < 0.001, respectively). Age, sex, race/ethnicity, primary language, VA, IOP, CDR, type of glaucoma, and distance to the nearest eye clinic were all excluded because of a lack of significant unique predictive ability in the stepwise regression.

Table 2.

Logistic Regression of Multiple Variables Demonstrating Odds of a Patient Being Lost to Follow-up

β Standard
Error
Wald
Chi-square
P Value Adjusted OR 95% CI,
Lower-Bound Upper-Bound
Completed ophthalmology appointments in last year -0.292 0.036 67.102 <0.001 0.747 0.697 0.801
Canceled ophthalmology appointments in last year 0.161 0.039 16.713 <0.001 1.175 1.088 1.270
No Show Ophthalmology Appointments in last year 0.553 0.111 24.979 <0.001 1.739 1.400 2.161
Visual field completed in last year -0.722 0.133 31.409 <0.001 0.486 0.377 0.625
RNFL Imaging in Last year -1.059 0.133 63.353 <0.001 0.347 0.267 0.450

CDR = cup-to-disc ratio; CI = confidence interval; RNFL = retinal nerve fiber layer.

Significance is marked in bold (P < 0.05).

Review of Patient Re-engagement Initiative

Of the 558 potentially LTF patients identified by the EMR reporting tool, 384 patients were confirmed LTF (69%) after the provider review. One month after the QI initiative, 124 of these LTF patients (32%) had been re-engaged (40% through telemedicine), 238 LTF patients (62%) had future scheduling orders in place, and only 22 LTF patients (6%) had no active plan for future follow-up.

The most recent encounter was a no-show or cancellation for 322 LTF patients (84%), 317 of whom still had an active scheduling order accessible in the EMR (98%). Only 11 patients (3%) never had an order for follow-up care placed by the provider despite documented plan for follow-up. Overdue but active scheduling orders were in place for 24 patients (6%). Finally, 27 patients (7%) had scheduling orders marked as completed without a corresponding appointment scheduled. In total, 340 patients (88%) identified as LTF had active scheduling orders in the EMR.

For the 294 patients in the LTF group who had an appointment scheduled but not completed, the no-show rate was 24% (69 patients). The remainder canceled appointments, either by phone or electronic reminder system; 28% did so because of a conflict in schedule (63 patients), 27% because of a concern over COVID-19 exposure (60 patients), and 45% for no documented reason (102 patients).

An examination of the characteristics of the 174 patients who were determined not to be LTF despite identification by our EMR-based strategy (<5% of the total study population) revealed that 86 patients (49%) had transferred care or were otherwise documented to be followed by an eye care provider outside of the practice; 69 patients (40%) were found to have orders that were not yet due; and 19 patients (11%) did not require glaucoma follow-up, either due to low disease severity or resolution with treatment, such as an episode of ocular hypertension within a postoperative period. Therefore, the overall false-positive rate of our EMR-based strategy was 31%.

Medication Refills while LTF

Seventy of the 384 LTF patients (18%) had documented medication refills in the period after their last clinic visit. The average order was for a 205 ± 130-day supply. Only 13 patients (19%) received less than a 90-day supply, and 28 patients (40%) received a 1-year supply.

Results of Re-engagement Effort

Of 384 patients who were LTF, 124 (32%) were re-engaged by the time of the 1-month review (Fig 1). A total of 49 patients (40%) were re-engaged through telemedicine, 35 patients (28%) had a new order for follow-up placed, 35 patients (28%) were scheduled for a future in-person appointment, and 5 patients (4%) declined follow-up care when contacted. The likelihood to be re-engaged was not associated with age, sex, race/ethnicity, primary language, VA, central corneal thickness, IOP, CDR, type of glaucoma, or distance to the nearest eye clinic.

Discussion

Our study found that being LTF is a significant problem among patients with glaucoma-related diagnoses. In just 1 month after the initiation of a provider-based recall initiative to improve the delivery of care to these patients, approximately one-third of those identified as LTF were directly re-engaged, and the majority of the remainder were accounted for with provider-ordered recall or scheduled appointments. Literature from similar programs aimed at re-engagement of patients LTF in other medical specialties shows a variable record. A urology program re-engaged 56% of patients who had exceeded 90 days after ureteral stent placement,6 whereas a Veterans’ Affairs mental health re-engagement program successfully reached only 7% of patients.7

Glaucoma care historically has had poor compliance with follow-up. In one study, glaucoma care was provided to patients at no cost, with flexible clinic hours and transportation, but the follow-up rate after a positive glaucoma screen was only 41%.8 Our overall LTF rate (11%) is comparable to other studies of patients followed for glaucoma and related diagnoses (Table 3).1, 2, 3, 4 Notably, studies with lower rates of LTF tend to be carried out in settings of universal healthcare, such as the United Kingdom and South Korea.3,4 Differences in definition of LTF may also partially explain the difference in the rate of LTF between these studies. Kim et al3 defined LTF as greater than 12 months after proposed follow-up. Our study captured patients with as small a gap as 6 months after the last clinic contact. If we had adopted a 12-month cutoff for LTF, our rate would have fallen to 2.6%, which is significantly lower than Kim et al3 (chi-square = 7.66, P = 0.006). However, our rate would still be greater than Davis et al,4 who defined LTF as “no documented outcome” after chart review by a senior clinician (chi-square = 47.80, P < 0.001). We believe that a narrower definition of LTF is beneficial because it provides an opportunity to re-engage patients before irreversible vision loss has occurred. When patients with glaucoma and related conditions are left untreated, they are at significantly higher risk of ocular morbidity, compared with patients cared for by other ophthalmic subspecialties.4 For example, patients with suspicion for normal-tension glaucoma convert to glaucoma at a rate of 2.6% per year while LTF.9

Table 3.

Comparison of Loss to Follow-up in Studies of Patients with Glaucoma

Study LTF (n) Total (n) LTF (%) Chi-square P Value
Ngan et al, 20071 83 181 46% 202.4 <0.001
Batra et al, 20172 24 98 24% 19.4 <0.001
Lahey Hospital & Medical Center 384 3551 11%
Kim et al, 20173 247 6848 3.6% 199.6 <0.001
Davis et al, 20174 5251 410 060 1.3% 2310.3 <0.001

LTF = lost to follow-up.

Significance is marked in bold (P < 0.05).

Previous studies have identified several risk factors for LTF among patients with glaucoma, including older age, male gender, lower baseline IOP, distance from the place of care, frequency of visits, and unknown family history of glaucoma.3,10,11 Our study did not find age or gender to be predictive of LTF status, but we did find that the distance from the eye clinic and the number of appointments in the prior year were important factors. We also found a direct relationship between number of cancellations and missed appointments and the risk of LTF. We are unable to assess the specific impact of baseline IOP or family history of glaucoma in our study as a result of the limitations imposed by the use of an EMR tool to extract data elements, rather than performing a manual chart review. However, our study did identify several disease features that correlated with lower LTF, including having a history of open-angle glaucoma or POAG, and a history of glaucoma-related testing. These findings are reassuring in that they indicate that patients who have potentially more severe disease are less likely to be LTF.

The most common barriers cited by patients to follow-up in glaucoma clinics are long clinic waiting times, scheduling difficulties, comorbid conditions, and linguistic barriers.12 These barriers disproportionately affect minority populations, including Asian-Pacific Islanders,12,13 Black Americans,14, 15, 16 and Hispanic and Latino populations.12,13 We did not find any impact of race/ethnicity or primary language on LTF status in the present study, but careful attention to these sociomedical factors is warranted.

Another important contributor to our higher-than-expected LTF rate was the COVID-19 pandemic.5,17, 18, 19, 20, 21, 22 Indeed, the rate of LTF in our study is higher than several other reports,3,4 and the outbreak of COVID-19 at least partially accounts for this higher rate. The rate of no-show and canceled appointments increased by more than 33% between March and May 2020 compared with the same period 1 year earlier, and directly resulted in at least 60 patients canceling their visits (16% of all LTF patients). Patients who failed to appear for appointments or canceled through the automated appointment booking system may also have done so because of COVID-related concerns. Coronavirus Disease 2019 may also have contributed to other reasons given for canceling appointments, such as transportation issues.

A large proportion of LTF patients miss scheduled appointments and fail to reschedule, even though prompted by staff to do so. Approximately 90% of LTF patients had an active, overdue scheduling order in the EMR. There are several suspected causes of this outcome, including lack of documentation of an unsuccessful scheduling attempt, patients deferring scheduling when contacted, or an insufficient number of schedulers to reach out repeatedly to patients. This represents an important area for future practice improvement efforts.

Refill requests are a well-known, but poorly leveraged opportunity to recover patients.23,24 In our study, we found that the majority of medication refills for patients who were LTF were for greater than a 90-day supply. Although refilling medications for long periods without in-person examination and testing is clearly not optimal care, it is also possible that greater harm is done by limiting refills without a system in place for re-engaging patients. Patient- or pharmacy-initiated refills also provide an opportunity for providers and staff to review the treatment plan. A more detailed analysis of where refill requests came from, and which providers filled the requests, may reveal system-level processes that can be altered to reduce LTF.

One way to reduce LTF and improve patient re-engagement is tele-glaucoma. Tele-glaucoma has been shown to be a highly effective tool but requires patients to be seen by skilled technicians to obtain fundoscopy and tonometry.25, 26, 27, 28 Patient attitudes toward telemedicine are also an important consideration, with one survey of patients aged more than 60 years finding that more than 70% had at least neutral views toward telemedicine. The same study determined that patients were more likely to report a positive view of telemedicine if they were aged less than 70 years, had an education beyond high school, were of European descent, and had traveled a longer distance in the past 3 days.29 Our program resulted in 49 telehealth visits in just 1 month, which accounted for approximately 2% of total telehealth visits in ophthalmology during this period. A similar program directed at other eye conditions, such as diabetic retinopathy or macular degeneration, could have an even greater impact on clinical productivity.

Although our EMR-based strategy successfully identified patients at risk of being LTF, thereby providing an opportunity for providers to re-engage patients, approximately one-third of the patients whom providers reviewed in the program were not overdue for care. The specificity of reporting methods to identify patients LTF depends on parameters chosen, especially the interval used to define LTF. Notably, 90% of the potentially LTF patients in our study already had an active, but overdue, scheduling order. The training of support staff to review those orders would have reduced the average number of charts to fewer than 5 per provider in our cooperative group practice with 16 ophthalmologists and 8 optometrists. After the program was implemented, only 22 patients (6% of LTF patients, but <1% of patients overall) had not been contacted or had an active scheduling order. Those patients were re-engaged after this review. Continued use and refinement of this report are likely to improve its specificity and reveal the optimum interval for running this process.

Study Limitations

The limitations of the present study include its retrospective nature and small sample size derived from a single-center, outpatient clinic that serves as a glaucoma referral center. This may impact the prevalence of glaucoma-related diagnoses in our study population. Our study also defined glaucoma broadly, which means that the patients included in our study varied widely in their risk of disease and frequency of required follow-up, both of which were not directly assessed in our study. We also did not control for other comorbid eye diseases that could influence the frequency of patient follow-up. Although we examined the length of medication refills, we were unable to assess the specific impact of prior use of glaucoma medications, laser, or surgery on LTF status. All of these are factors that should be explored in future research. In our program, the actions taken by providers were left to individual clinical judgment, rather than based on a standardized set of recall guidelines. Future studies should also stratify data by provider type or experience to assess if this impacts the risk of a patient becoming LTF. Although we controlled for clinical events that could be expected to affect LTF, including the COVID-19 pandemic, other factors, such as time of year or turnover in clinical staff, may have affected our LTF rate. Finally, the short-term nature of our evaluation of outcomes limits our ability to draw conclusions about how our program will affect subsequent risk of LTF. Future directions for this research should include a longer study period and assess glaucoma-related outcomes.

In conclusion, an EMR-based QI initiative successfully identified patients with glaucoma-related diagnoses who were at risk of being LTF and used a provider-based strategy to selectively re-engage patients through a combination of telehealth and office-based recall orders. Such efforts not only promote optimal care of patients by potentially reducing the undesirable outcome of vision loss from inadequately managed glaucoma, but also serve to maintain clinical productivity, document treatment plans, and potentially reduce medicolegal liability arising from gaps in glaucoma care.30 Our study also identified several readily obtainable EMR data elements that are associated with LTF, including distance to the nearest eye clinic, ophthalmic appointment history, and prior ophthalmic testing history, that may alert clinicians to patients posing a relatively greater risk of LTF. This allows the opportunity to develop protocols for ensuring that higher-risk patients return for care.

Acknowledgments

The authors thank Dr Ying Jiang, Dr Noreen Shaikh, Kristen Kuo, Karen Latulippe, Christine Gould, Kira Szulborski, Ed Momplaisir, Hilcia M. Downs, and Carol Spencer, Lahey Hospital Librarian, for research support.

Manuscript no. D-21-00116.

Footnotes

Disclosure(s):

All authors have completed and submitted the ICMJE disclosures form.

The author(s) have no proprietary or commercial interest in any materials discussed in this article.

D.J.R.: Supported by the Harry N. Lee Family Chair in Innovation at the Lahey Hospital & Medical Center, Beth Israel Lahey Health.

HUMAN SUBJECTS: Human subjects were included in this study. The human ethics committees at the Lahey Hospital & Medical Center approved the study. All research adhered to the tenets of the Declaration of Helsinki. Informed consent was waived.

No animal subjects were used in this study.

Author Contributions:

Conception and design: Roh, Ramsey

Data collection: Robbins, Anjum, Alwreikat, Cotran, Roh, Ramsey

Analysis and interpretation: Robbins, Anjum, Alwreikat, Cooper, Cotran, Roh, Ramsey

Obtained funding: N/A; The study was performed as part of regular employment duties at the Lahey Hospital & Medical Center. No additional funding was provided.

Overall responsibility: Robbins, Anjum, Alwreikat, Cooper, Cotran, Roh, Ramsey

References

  • 1.Ngan R., Lam D.L., Mudumbai R.C., Chen P.P. Risk factors for noncompliance with follow-up among normal-tension glaucoma suspects. Am J Ophthalmol. 2007;144:310–311. doi: 10.1016/j.ajo.2007.04.005. [DOI] [PubMed] [Google Scholar]
  • 2.Batra R., Sharma H.E., Elaraoud I., Mohamed S. Resource planning in glaucoma: a tool to evaluate glaucoma service capacity. Semin Ophthalmol. 2018;33:733–738. doi: 10.1080/08820538.2017.1418012. [DOI] [PubMed] [Google Scholar]
  • 3.Kim Y.K., Jeoung J.W., Park K.H. Understanding the reasons for loss to follow-up in patients with glaucoma at a tertiary referral teaching hospital in Korea. Br J Ophthalmol. 2017;101:1059–1065. doi: 10.1136/bjophthalmol-2016-309103. [DOI] [PubMed] [Google Scholar]
  • 4.Davis A., Baldwin A., Hingorani M., et al. A review of 145 234 ophthalmic patient episodes lost to follow-up. Eye. 2017;31:422–429. doi: 10.1038/eye.2016.225. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Goldblatt J., Roh S., Sethi K., Ramsey D.J. Enhancing safety and performance in the COVID-19 era: strategies and modifications that may become the standard of care in ophthalmology practice. Ophthalmology Management. 2020;24:E2. [Google Scholar]
  • 6.Javier-DesLoges J.F., Johnson K.K., Kenney P.A., Motamedinia P. Novel use of the Epic electronic medical record platform to identify lost ureteral stents. J Endourol. 2019;33:858–862. doi: 10.1089/end.2019.0382. [DOI] [PubMed] [Google Scholar]
  • 7.Goodrich D.E., Bowersox N.W., Abraham K.M., et al. Leading from the middle: replication of a re-engagement program for veterans with mental disorders lost to follow-up care. Depress Res Treat. 2012;2012:325249. doi: 10.1155/2012/325249. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Quigley H.A., Kee Park C., Tracey P.A., Pollack I.P. Community screening for eye disease by laypersons: the Hoffberger program. Am J Ophthalmol. 2002;133:386–392. doi: 10.1016/s0002-9394(01)01380-0. [DOI] [PubMed] [Google Scholar]
  • 9.Lim J.H., Park J.S., Lee S.Y., Hong Y.J. Incidence of and risk factors for glaucoma in lost-to-follow-up normal-tension glaucoma suspect patients. BMC Ophthalmol. 2016;16:62. doi: 10.1186/s12886-016-0245-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Ashaye A.O., Adeoye A.O. Characteristics of patients who dropout from a glaucoma clinic. J Glaucoma. 2008;17:227–232. doi: 10.1097/IJG.0b013e31815768b3. [DOI] [PubMed] [Google Scholar]
  • 11.Lu Y.C., Pu C., Hou C.H. The effect of continuity of care and provider volume on late presentation of glaucoma: a nested case-control study. J Glaucoma. 2021:30187–30191. doi: 10.1097/IJG.0000000000001695. [DOI] [PubMed] [Google Scholar]
  • 12.Lee B.W., Murakami Y., Duncan M.T., et al. Patient-related and system-related barriers to glaucoma follow-up in a county hospital population. Invest Ophthalmol Vis Sci. 2013;54:6542–6548. doi: 10.1167/iovs.13-12108. [DOI] [PubMed] [Google Scholar]
  • 13.Murakami Y., Lee B.W., Duncan M., et al. Racial and ethnic disparities in adherence to glaucoma follow-up visits in a county hospital population. Arch Ophthalmol. 2011;129:872–878. doi: 10.1001/archophthalmol.2011.163. [DOI] [PubMed] [Google Scholar]
  • 14.Hark L., Acito M., Adeghate J., et al. Philadelphia telemedicine glaucoma detection and follow-up study: ocular findings at two health centers. J Health Care Poor Underserved. 2018;29:1400–1415. doi: 10.1353/hpu.2018.0103. [DOI] [PubMed] [Google Scholar]
  • 15.Zhao D., Guallar E., Bowie J.V., et al. Improving follow-up and reducing barriers for eye screenings in communities: The SToP Glaucoma Study. Am J Ophthalmol. 2018;188:19–28. doi: 10.1016/j.ajo.2018.01.008. [DOI] [PubMed] [Google Scholar]
  • 16.Zheng C.X., Hu W.D., Tran J., et al. Barriers to receiving follow-up eye care and detection of non-glaucomatous ocular pathology in the Philadelphia glaucoma detection and treatment project. J Community Health. 2016;41:359–367. doi: 10.1007/s10900-015-0104-3. [DOI] [PubMed] [Google Scholar]
  • 17.Lim L.W., Yip L.W., Tay H.W., et al. Sustainable practice of ophthalmology during COVID-19: challenges and solutions. Graefes Arch Clin Exp Ophthalmol. 2020;258:1427–1436. doi: 10.1007/s00417-020-04682-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Jayaram H., Strouthidis N.G., Gazzard G. The COVID-19 pandemic will redefine the future delivery of glaucoma care. Eye. 2020;34:1203–1205. doi: 10.1038/s41433-020-0958-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Recommendations for urgent and nonurgent patient care American Academy of Ophthalmology. https://www.aao.org/headline/new-recommendations-urgent-nonurgent-patient-care
  • 20.Lindeke-Myers A., Zhao P.Y.C., Meyer B.I., et al. Patient perceptions of SARS-CoV-2 exposure risk and association with continuity of ophthalmic care. JAMA Ophthalmol. 2021;139:508–515. doi: 10.1001/jamaophthalmol.2021.0114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Shalaby W.S., Odayappan A., Venkatesh R., et al. The impact of COVID-19 on individuals across the spectrum of visual impairment. Am J Ophthalmol. 2021;227:53–65. doi: 10.1016/j.ajo.2021.03.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Sethi K., Levine E.S., Roh S., et al. Modeling the impact of COVID-19 on retina clinic performance. BMC Ophthalmol. 2021;21:206. doi: 10.1186/s12886-021-01955-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Lee P.P., Walt J.G., Chiang T.H., et al. A gap analysis approach to assess patient persistence with glaucoma medication. Am J Ophthalmol. 2007;144:520–524. doi: 10.1016/j.ajo.2007.06.023. [DOI] [PubMed] [Google Scholar]
  • 24.Newman-Casey P.A., Salman M., Lee P.P., Gatwood J.D. Cost-utility analysis of glaucoma medication adherence. Ophthalmology. 2020;127:589–598. doi: 10.1016/j.ophtha.2019.09.041. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Clarke J., Puertas R., Kotecha A., et al. Virtual clinics in glaucoma care: face-to-face versus remote decision-making. Br J Ophthalmol. 2017;101:892. doi: 10.1136/bjophthalmol-2016-308993. [DOI] [PubMed] [Google Scholar]
  • 26.Hark L.A., Katz L.J., Myers J.S., et al. Philadelphia telemedicine glaucoma detection and follow-up study: methods and screening results. Am J Ophthalmol. 2017;181:114–124. doi: 10.1016/j.ajo.2017.06.024. [DOI] [PubMed] [Google Scholar]
  • 27.Thomas S.M., Jeyaraman M.M., Hodge W.G., et al. The effectiveness of teleglaucoma versus in-patient examination for glaucoma screening: a systematic review and meta-analysis. PloS One. 2014;9 doi: 10.1371/journal.pone.0113779. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Saleem S.M., Pasquale L.R., Sidoti P.A., Tsai J.C. Virtual ophthalmology: telemedicine in a COVID-19 era. Am J Ophthalmol. 2020;216:237–242. doi: 10.1016/j.ajo.2020.04.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Rhodes L.A., Huisingh C.E., McGwin G., et al. Glaucoma patient knowledge, perceptions, and predispositions for telemedicine. J Glaucoma. 2019;28:481–486. doi: 10.1097/IJG.0000000000001238. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Mavroforou A., Michalodimitrakis E. Physicians' liability in ophthalmology practice. Acta Ophthalmol Scand. 2003;81:321–325. doi: 10.1034/j.1600-0420.2003.00111.x. [DOI] [PubMed] [Google Scholar]

Articles from Ophthalmology Science are provided here courtesy of Elsevier

RESOURCES