Abstract
Background
No-shows, or missed appointments, are a problem for many medical practices. They result in fragmented care and reduce access for all patients.
Objective
To determine whether telephone reminder calls targeted to patients at high risk of no-show can reduce no-show rates.
Design
Single-center randomized controlled trial.
Participants
A total of 2247 primary care patients in a hospital-based primary care clinic at high risk of no-show (>15 % risk) for their appointment in 7 days.
Intervention
Seven days prior to their appointment, intervention arm patients were placed in a calling queue to receive a reminder phone call from a patient service coordinator. Coordinators were trained to engage patients in concrete planning. All patients received an automated phone call (usual care).
Main Measures
Primary outcome was no-show rate. Secondary outcomes included arrival rate, cancellation rate, reschedule rate, time to cancellation, and change in revenue.
Key Results
The no-show rate in the intervention arm (22.8 %) was significantly lower (absolute risk difference −6.4 %, p < 0.01, 95 % CI [−9.8 to −3.0 %]) than that in the control arm (29.2 %). Arrival, cancellation, and reschedule rates did not differ significantly. In the intervention arm, rescheduling and cancellations occurred further in advance of the appointment (mean difference, 0.35 days; 95 % CI [0.07–0.64]; p = 0.01). Reimbursement did not differ significantly.
Conclusions
A phone call 7 days prior to an appointment led to a significant reduction in no-shows and increased reimbursement among patients at high risk of no-show. The use of targeted interventions may be of interest to practices taking on increased accountability for population health.
Electronic supplementary material
The online version of this article (doi:10.1007/s11606-016-3813-0) contains supplementary material, which is available to authorized users.
KEY WORDS: access to care, applied informatics, primary care redesign, behavior change, population health
INTRODUCTION
The mission of accountable care organizations (ACOs) and patient-centered medical homes (PCMHs) is to coordinate the delivery of high-quality care to improve the health of patients while lowering overall costs.1 – 3 A key measure of the success of accountable care is timely access to high-quality primary care.4 – 7 In this setting “no-shows,” or missed appointments, present a clear problem for organizations taking on increased accountability for population health. No-shows result in fragmented continuity of care, reduce access for other patients in the practice, and decrease provider productivity.8 – 16
Studies in primary care and specialty clinics have demonstrated that staff phone calls are an effective intervention for reducing no-shows.17 – 30 However, this convincing work is difficult to apply, because staff phone calls are time-consuming and costly. Moreover, while this intervention is thought to be cost effective in clinics with high baseline no-show rates, the efficacy is less clear when baseline no-show rates are low.18 , 19 , 30 , 31 Nevertheless, even in practices with low baseline no-show rates, the risk of no-show is heterogeneous—that is, some patients are more likely of no-shows than others.9 , 10 , 28 , 29 , 32 – 34 Prior work has effectively demonstrated that no-shows are predictable; validated models can accurately predict the likelihood that a patient will fail to keep a scheduled appointment.9 , 35 – 38
Subspecialty clinics have made use of the predictability of no-shows by integrating predictive modeling to target interventions to those at high risk of no-show. In a study of five oncology practices, a patient navigator successfully reduced no-shows by 42 % in a subset of patients at high risk for non-adherence, and in a dermatology practice, predictive modeling has been used for algorithmic double-booking of appointments.38 , 39 We designed and executed a randomized controlled trial in an academic primary care clinic to answer the following question: Can targeted telephone reminder calls to patients at the highest risk of no-show reduce no-show rates?
METHODS
Study Setting
We conducted this study in the Internal Medicine Associates (IMA), an academic hospital-based primary care clinic at Massachusetts General Hospital (MGH). The IMA has 80,000 appointments scheduled annually, with an average 7 % no-show rate. The IMA is staffed by 66 internal medicine residents, 50 attending physicians, 8 nurse practitioners, 20 nurses, 22 medical assistants, and 36 patient service coordinators (PSCs). PSCs are responsible for answering phones, booking appointments, obtaining records, and coordinating referrals and testing. The practice is organized into 13 pods, each of which has 2–3 PSCs. As a part of usual practice, all patients receive an automated phone call 3 days prior to their appointment using TeleVox® Appointment Reminders (TeleVox Software, Mobile, AL).
Study Design and Implementation
All patients older than 18 years who had an appointment at the Internal Medicine Associates between May and November 2013 were assessed for enrollment eligibility. We calculated the likelihood that a patient would no-show using a predictive model developed using administrative data for outpatient MGH appointments, which was described previously.38 Predictive variables included age, wait days (days between the scheduling and appointment date), insurance type, and appointment adherence history over the previous 5 years. The model was derived and validated specifically for primary care practices (see online methods supplement). The Partners IRB reviewed and approved the study protocol, including waiver of consent prior to the enrollment of any patients.
We randomized patients with a predicted risk equal to or greater than 15 % to each study arm in a 1:1 ratio based upon the last digit of their medical record number. We defined the high-risk threshold based on prior work and internal sensitivity analyses (see online methods supplement).40 Patients in the intervention group appeared in our enterprise population health management platform, TopCare. TopCare is a web-based population health management platform developed as a collaboration between the Laboratory of Computer Science at MGH and SRG Technology (Fort Lauderdale, FL).41 The tool is used to augment cancer screening and improve chronic disease management, independent of office visits, by identifying patients “not at goal” based on processed data from the EMR. We developed a module in TopCare where patients assigned to the intervention would appear in a queue 7 days prior to their appointment. Information needed to contact the patient to remind them of their appointment included, but was not limited to, patient name, phone number(s), appointment date and time, physician, and emergency contact(s). The outcomes of the call—confirmed, left message, canceled, rescheduled, no message, invalid number—could be recorded, as well as any comments. Patients were removed from the calling queue when a call outcome was recorded, the appointment date passed, or the appointment was cancelled. PSCs were responsible for making reminder phone calls and recording the outcomes using TopCare.
Intervention
All 36 PSCs received a brief one-on-one training prior to the start of the trial. The training was designed (1) to teach PSCs to access and use the calling tool and (2) to show PSCs how to use language designed to increase follow-through on good intentions.42 – 45 For example, to engage patients in concrete planning, even after patients confirmed their appointment, the PSCs were asked to follow up by asking patients, “What are you doing before your appointment?” (online appendix). PSCs had no specific clinical or social work training. There were no changes in other appointment booking practices, including double-booking during this period.
Outcomes
The primary outcome was no-show rate as defined by the number of no-shows divided by the sum of no-shows and arrived appointments. Secondary outcomes, defined a priori, included arrival rate (arrived appointments divided by all appointments), cancellation rate (cancelled appointments divided by all appointments), reschedule rate (rescheduled appointments divided by all appointments), and time to cancellation (number of days between the cancellation date and original appointment date). In these measures, “all appointments” is the sum of arrivals, cancellations, reschedules, and no-shows.
Assessing Financial Impact
In the US health care market, physicians bill for care rendered during an office visit using evaluation and management (E/M) codes, which are assigned relative value units (RVUs) that form the basis for payment. The total RVUs is the sum of three components: malpractice RVU, practice expense RVU, and physician work RVU. Work RVU is a consistent measurement of productivity that has been used in previous studies; it is independent of differences in payer mix, geographic adjustment, or specialty.46 – 51 We excluded malpractice and practice expense RVUs because they vary by location, and thus estimates generated using these figures would not be generalizable. We collected data on all professional services claims reimbursed to the practice for patients in the study during the study period. We used the 2013 Physician Fee Schedule to ascertain the work RVUs for each professional fee claim (identified by revenue center code 0983).52
For the main analysis, we reported the mean work RVUs per patient. Since there are multiple ways of assessing the financial impact, we performed two sensitivity analyses to validate our findings. First, we estimated total revenue per patient by arm using the percent-of-charge method based on all bills (technical and professional) originating from the practice during the study period.53 Using this method, charges on outgoing claims are multiplied by a constant that represents a practice’s best estimate of the revenue that will be collected from the submitted charge. Second, we modeled revenue per patient by arm assuming each of the permutations of the following conditions: all visits were evaluation and management (E&M) subsequent level 3 (99213), all visits were E&M subsequent level 4 (99214), all visits were conducted in a hospital-based clinic, and all visits were conducted in an office-based clinic. This second method generated estimates assuming all visits were reimbursed according to the CMS Physician Fee Schedule.
Statistical Analysis
We analyzed the effect of the intervention on the primary outcome, the no-show rate, by comparing the rates between the two arms to calculate an absolute risk difference. Because some patients had multiple appointments during the study period, we calculated confidence intervals and p values accounting for repeated measurements. Specifically, we used the generalized estimating equations approach to take into account correlations between observations from the same patient. We calculated the effect of the intervention on arrival, cancellation, and reschedule rates using the same methodology. We analyzed the effect of the intervention on the time to cancellation using a linear model accounting for repeated measures. Reimbursements were assessed at the patient level; consequently, we used the two-sample Student t test to determine whether differences in reimbursement between the study arms were significant.
RESULTS
Study Participants
Over a 24-week period, we screened 20,955 patients, and 2,247 (10.7 %) patients with a 15 % or greater predicted risk of no-show for an appointment in 7 days were enrolled in the study. We randomized patients to the intervention (n = 1129) or control (n = 1118). Of those assigned to the intervention group 144 (12.8 %) did not receive phone calls prior to any appointments and 162 (14.3 %) received at least one phone call before one visit but did not receive phone calls prior to all visits (Fig. 1).
Fig. 1.
Study design and allocation.
Baseline characteristics such as clinical comorbidities, health care utilization, and measures of population health, as well as risk factors for appointment no-show, were equally distributed between the treatment and control groups (Table 1). The mean age of participants was 51.4 years, and 51.9 % were women. Within the study population, 61.9 % identified as white, and 87.0 % spoke English as their preferred language. The median number of wait days, the number of days between when the appointment was made and the day of the appointment, was 35 days. Resident physicians were the primary care physicians for 39.5 % of patients, and 53.7 % of patients had commercial insurance.
Table 1.
Baseline Characteristics of the Participants
| Intervention (n = 1129) | Control (n = 1118) | |
|---|---|---|
| DEMOGRAPHICS | ||
| Age, mean years (SD) | 51.4 (16.4) | 51.4 (18.9) |
| Female (%) | 588 (52.1) | 578 (51.7) |
| Race/Ethnicity (%) | ||
| White | 702 (62.2) | 688 (61.5) |
| Black | 231 (20.5) | 214 (19.1) |
| Hispanic | 115 (10.2) | 129 (11.5) |
| Language (%) | ||
| English | 995 (88.1) | 961 (86.0) |
| Spanish | 58 (5.1) | 73 (6.5) |
| Arabic | 12 (1.1) | 20 (1.8) |
| Time to appt, median days (25th to 75th percentile) | 34 (19–75) | 35 (20–77) |
| Patients for whom the PCP is a resident physicians (%) | 452 (40.0) | 436 (39.0) |
| Insurance Status (%) | ||
| Commercial | 596 (53.36) | 611 (55.50) |
| Medicare | 246 (22.02) | 234 (21.25) |
| Medicaid | 205 (18.35) | 200 (18.17) |
| Free care or self-pay | 70 (6.27) | 56 (5.09) |
| COMORBIDITIES | ||
| Depression (%) | 233 (20.6) | 273 (24.4) |
| Alcohol-related diagnosis (%) | 98 (8.7) | 76 (6.8) |
| Diabetes (%) | 289 (25.6) | 252 (22.6) |
| Mean Charlson score (SD) | 3.67 (2.75) | 3.7 (2.94) |
| HEALTH CARE UTILIZATION | ||
| Mean number of outpatient appointments over 5 years (SD) | 7.97 (6.11) | 7.65 (5.15) |
| Hospitalizations per 100 patients in 2012 | 17.4 | 21.8 |
| Emergency department visits per 100 patients in 2012 | 49.3 | 54.3 |
| POPULATION HEALTH | ||
| Cancer Screening | ||
| Incomplete colorectal cancer screening (% eligible) | 133 (30.2) | 114 (29.3) |
| Incomplete cervical cancer screening (% eligible) | 95 (25.1) | 83 (21.5) |
| Incomplete breast cancer screening (% eligible) | 78 (23.7) | 57 (18.8) |
| Chronic Disease Management | ||
| HbA1c > 9 % in patients with diabetes (% eligible) | 63 (25.2) | 52 (24.8) |
| LDL > 130, patients with DM or vascular disease (% eligible) | 32 (9.2) | 34 (10.6) |
Chronic conditions such as diabetes and depression were common, affecting 24.1 % and 22.5 % of patients, respectively. In 2012, for every 100 patients in the study, there were 51.8 emergency department visits and 19.6 inpatient hospitalizations. Among those eligible for cancer screening, 29.8 % of patients had incomplete colorectal cancer screening, 23.3 % had incomplete cervical cancer screening, and 21.4 % had incomplete breast cancer screening. Of the patients with diabetes, 25.0 % had glycated hemoglobin (Hb-A1c) greater than 9 %.
Appointment Outcomes
The no-show rate was 22.8 % in the intervention arm compared to 29.2 % in the control arm (absolute risk difference [ARD] −6.4 %, p < 0.001, 95 % confidence interval [CI] −3.0 % to −9.8 %) (Table 2). Arrival rates (54.3 % and 51.9 %; ARD 2.4 %, p = 0.15, 95 % CI −0.9 % to 5.8 %), cancellation rates (13.1 % and 11.5 %; ARD 1.6 %, p = 0.15, 95 % CI −3.7 % to 0.6 %), and reschedule rates (14.2 % and 12.2 %; ARD 2.0 %, p = 0.09, 95 % CI −0.4 % to 4.7 %) were higher in the intervention group than in the control group, but the differences were not statistically significant.
Table 2.
Appointment Outcomes by Study Arm
| Measure | Intervention (n = 2014) | Control (n = 1837) | Absolute risk reduction (95 % CI) | P value |
|---|---|---|---|---|
| No-shows* | 323 (22.8 %) | 393 (29.2 %) | 6.40 % (2.98 % to 9.82 %) | <0.001 |
| Arrivals | 1094 (54.3 %) | 953 (51.9 %) | −2.44 % (−0.88 % to 5.76 %) | 0.15 |
| Cancellations | 264 (13.1 %) | 212 (11.5 %) | −1.57 % (0.55 % to −3.68 %) | 0.15 |
| Rescheduled | 286 (14.2 %) | 224 (12.2 %) | −2.01 % (−0.42 % to 4.36 %) | 0.09 |
| Bumped | 44 (2.2 %) | 54 (2.9 %) | −0.76 % (−1.78 % to 0.27 %) | 0.15 |
| Unknown | 3 (0.1 %) | 1 (0.1 %) |
*No-show rate calculated using arrivals and no-shows. Other measures include all appointment statuses
Time to Cancellation
Rescheduled and canceled appointments occurred further in advance of the appointment in the intervention group compared to the control group (1.94s vs. 1.59 days, mean difference 0.35 days; 95 % CI 0.07–0.64; p = 0.01) (Fig. 2).
Fig. 2.
Time to cancellation by study arm.
Reimbursement
All outpatient bills were aggregated by study arm to assess the impact on work RVU billing. Among 1129 patients in the intervention arm, there were 1037 arrivals that resulted in 2220 work RVUs. For the 1118 patients in the control arm, there were 953 arrivals, resulting in 2055 work RVUs. When comparing the two groups, there were 1.97 work RVUs per patient generated in the intervention arm compared with 1.84 work RVUs per patient generated in the control group. This difference was not significantly different (mean difference 0.13 95 % CI −0.02 to 0.28, p = 0.10) (Table 3).
Table 3.
Work RVUs billed and estimate of return on phone calls
| Description | Intervention | Control | Difference (95 % CI) | P value |
|---|---|---|---|---|
| Patients | 1129 | 1118 | ||
| Arrived appointments | 1037 | 953 | ||
| Work RVUs based on claims paid | 2220 | 2055 | ||
| Mean work RVU per patient (SD) | 1.97 (1.94) | 1.84 (1.74) | 0.13 (−0.02 to 0.28) | 0.10 |
DISCUSSION
This trial demonstrated that a telephone call from a patient care coordinator 7 days prior to a scheduled clinic appointment, targeted to patients predicted to be at high risk of no-show, led to a 22 % relative reduction in the no-show rate compared to control patients.
Prior studies have demonstrated that phone calls are an effective intervention for reducing no-show rates. However, generalizability has been limited, since prior interventions have focused on clinics with high no-show rates at baseline. Moreover, these studies have not assessed the financial impact on practices with low no-show rates at baseline. By focusing on patients at high risk of no-show and by using detailed billing data, we have attempted to address both of these limitations. Identifying patients at high risk was accomplished using basic demographic data (age, insurance, wait days, and prior history of appointment adherence) available through administrative data. This parsimonious predictive model was developed specifically to facilitate replication. By using this predictive modeling approach, we targeted the intervention to patients at the highest risk of no-show. Utilizing this method, we found a meaningful reduction in no-show rates in a practice with low no-show rates at baseline. In addition, arrivals, cancellations, and reschedules all occurred at a greater rate in the intervention arm. These findings were not statistically significant, but the study was not powered to detect a difference in these outcomes; this may be an area for further research. Finally, the observed increase in work RVU billing suggests that the intervention is cost effective.
The results from this study also have clear operational implications for provider organizations taking on increasing accountability for population health outcomes, in two domains. First, this intervention represents an approach for improving access to primary care, which is a principal performance measure of ACO quality.54 In addition, as the population ages and insurance coverage expands through full implementation of the Affordable Care Act, the Health Resources and Service Administration projects a shortage of 20,400 primary care physicians in 2020.55 Faced with this shortage in physician supply, the intervention described here is one of many that can be used to make use of existing capacity.
Second, this intervention attempted to engage patients who perform poorly on measures of population health quality in primary care. Prior work from our group revealed that a patient’s likelihood of no-show for a clinic appointment was an independent risk factor for incomplete cancer screening, as well as for poor performance on measures of chronic disease management.56 In this study, baseline characteristics reflect that patients identified as high risk of no-show had high rates of incomplete cancer screening (colorectal and breast) and poor performance on measures of chronic disease management (LDL ≥ 130 mg/dl among patients with diabetes and/or vascular disease, and HbA1c ≥ 9 % among patients with diabetes). Together, these metrics represent five of the 33 quality measures that ACOs are responsible for through the Centers for Medicare & Medicaid Services Pioneer ACO program.54 Since cancer screening and chronic disease management are core to the practice of primary care, it stands to reason that fewer no-shows to primary care clinics may improve these measures of quality. Additional study is needed to assess the impact of reduced no-show rates on these and other measures of health care quality.
The results of this study should be interpreted within the context of the study design. First, the study was conducted at a single hospital-based primary care practice, and the findings may not be generalizable to other practice settings. Second, while the use of predictive analytics was a strength of the study, to implement this intervention, interested sites would need to access appointment data, calibrate the published model, and create a calling queue of patients at high risk of no-show. Small and medium-sized practices tend to be at a relative disadvantage when implementing interventions with fixed costs, as was demonstrated in the PCMH transformation process.57 , 58 Nevertheless, although smaller practices may not be able to implement the full prediction model, they may be able to target pre-appointment outreach to patients based on strong predictors that have been previously described. For instance, the strongest predictor of a future no-show is a prior no-show.38
Third, because of operational limitations, only 72.9 % of patients in the intervention group received the complete intervention (i.e. phone calls before all visits). As a result, the reported results reflect programmatic efficacy and may underestimate the effectiveness of the intervention.
Finally, we presented the financial impact of this study in terms of work RVUs. Limited assessment of financial impact has been cited by systematic reviews as a major limitation of studies examining interventions designed to improve adherence.59 A major hurdle in such analyses is that there are multiple ways that medical practices are structured financially. Specifically, payer mix and accounting practices vary from practice to practice. While the use of work RVUs addressed these issues to provide a generalizable measure of productivity, it does not represent a true estimate of revenue. For instance, to enhance generalizability, we did not include practice expense and malpractice RVUs in this analysis. Their inclusion would have increased the estimate of revenue generated from the intervention. Given multiple methods of measuring the financial impact, we performed two sensitivity analyses. We calculated an increase in per-patient billing of 8.8 % when examining total billing, and 7.8 % when modeling revenue, using standard Medicare charges. These estimates are comparable to the 7.0 % increase in billing reported here. For the reasons outlined above, the figure presented represents an accurate relative (and conservative absolute) measure of the financial impact of the intervention. We did not track, calculate, or report the fixed costs of developing the intervention; this limits the ability to determine the cost-effectiveness of the intervention.
In conclusion, this study demonstrated that a phone call 7 days prior to an appointment led to a significant reduction in no-shows among patients predicted to be at high risk of no-show for a scheduled clinic appointment. The use of a targeted intervention to reduce no-shows among high-risk patients may be of interest to practices taking on increased accountability for population health.
Electronic supplementary material
Below is the link to the electronic supplementary material.
(DOCX 267 kb)
(GIF 121 kb)
Acknowledgments
Sachin J. Shah and Patrick Cronin had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. This study was funded internally by the Massachusetts General Hospital Physician Organization and the Internal Medicine Associates. Partial results of the study were published in abstract and poster form at the Society for General Internal Medicine national conference in 2014. Patrick Cronin has a financial stake in SRG Technology as of October 4, 2015. He did not have a financial stake while executing the study or analysis. All other authors declare that they do not have a conflict of interest.
Footnotes
Electronic supplementary material
The online version of this article (doi:10.1007/s11606-016-3813-0) contains supplementary material, which is available to authorized users.
References
- 1.McClellan M, McKethan AN, Lewis JL, Roski J, Fisher ES. A national strategy to put accountable care into practice. Health Aff (Millwood) 2010;29(5):982–90. doi: 10.1377/hlthaff.2010.0194. [DOI] [PubMed] [Google Scholar]
- 2.Shortell SM, Casalino LP. Health care reform requires accountable care systems. JAMA. 2008;300(1):95–7. doi: 10.1001/jama.300.1.95. [DOI] [PubMed] [Google Scholar]
- 3.Scholle S, Torda P, Peikes D, Han E, Genevro J. Engaging Patients and Families in the Medical Home. (Prepared by Mathematica Policy Research under Contract No. HHSA290200900019I TO2.) AHRQ Publication No. 10-0083-EF. Rockville, Maryland: Agency for Healthcare Research and Quality; 2010. https://pcmh.ahrq.gov/page/engaging-patients-and-families-medical-home. Accessed June 17, 2016.
- 4.Milford CE, Ferris TG. A modified “golden rule” for health care organizations. Mayo Clin Proc. 2012;87(8):717–20. doi: 10.1016/j.mayocp.2012.05.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Rittenhouse DR, Shortell SM, Fisher ES. Primary care and accountable care—two essential elements of delivery-system reform. N Engl J Med. 2009;361(24):2301–3. doi: 10.1056/NEJMp0909327. [DOI] [PubMed] [Google Scholar]
- 6.Berwick DM. Launching accountable care organizations—the proposed rule for the medicare shared savings program. N Engl J Med. 2011;364(16) doi: 10.1056/NEJMp1103602. [DOI] [PubMed] [Google Scholar]
- 7.Blumenthal D. Performance improvement in health care—seizing the moment. N Engl J Med. 2012;366(21):1953–5. doi: 10.1056/NEJMp1203427. [DOI] [PubMed] [Google Scholar]
- 8.Bech M. The economics of non-attendance and the expected effect of charging a fine on non-attendees. Health Policy. 2005;74(2):181–91. doi: 10.1016/j.healthpol.2005.01.001. [DOI] [PubMed] [Google Scholar]
- 9.Daggy J, Lawley M, Willis D, et al. Using no-show modeling to improve clinic performance. Health Informatics J. 2010;16(4):246–59. doi: 10.1177/1460458210380521. [DOI] [PubMed] [Google Scholar]
- 10.McLean S, Gee M, Booth A, et al. Targeting the Use of Reminders and Notifications for Uptake by Populations (TURNUP): a systematic review and evidence synthesis. Health Serv Deliv Res. 2014;2(34):1–184. doi: 10.3310/hsdr02340. [DOI] [PubMed] [Google Scholar]
- 11.Moore CG, Wilson-Witherspoon P, Probst JC. Time and money: effects of no-shows at a family practice residency clinic. Fam Med. 2001;33(7):522–7. [PubMed] [Google Scholar]
- 12.Karter AJ, Parker MM, Moffet HH, et al. Missed appointments and poor glycemic control: an opportunity to identify high-risk diabetic patients. Med Care. 2004;42(2):110–5. doi: 10.1097/01.mlr.0000109023.64650.73. [DOI] [PubMed] [Google Scholar]
- 13.George A, Rubin G. Non-attendance in general practice: a systematic review and its implications for access to primary health care. Fam Pract. 2003;20(2):178–84. doi: 10.1093/fampra/20.2.178. [DOI] [PubMed] [Google Scholar]
- 14.Horstmann E, Brown J, Islam F, Buck J, Agins BD. Retaining HIV-infected patients in care: where are we? Where do we go from here? Clin Infect Dis. 2010;50(5):752–61. doi: 10.1086/649933. [DOI] [PubMed] [Google Scholar]
- 15.Brookes C. Loss of treatment time due to non-attendance for physiotherapy out-patient appointments in a district general hospital: pilot study. Physiotherapy. 1992;78(5):349–52. doi: 10.1016/S0031-9406(10)61485-X. [DOI] [Google Scholar]
- 16.Sharp DJ, Hamilton W. Non-attendance at general practices and outpatient clinics. BMJ. 2001;323(7321):1081–2. doi: 10.1136/bmj.323.7321.1081. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Macharia WM, Leon G, Rowe BH, Stephenson BJ, Haynes R. AN overview of interventions to improve compliance with appointment keeping for medical services. JAMA. 1992;267(13):1813–7. doi: 10.1001/jama.1992.03480130129038. [DOI] [PubMed] [Google Scholar]
- 18.Hashim MJ, Franks P, Fiscella K. Effectiveness of telephone reminders in improving rate of appointments kept at an outpatient clinic: a randomized controlled trial. J Am Board Fam Pract. 2001;14(3):193–6. [PubMed] [Google Scholar]
- 19.Perron NJ, Dao MD, Righini NC, et al. Text-messaging versus telephone reminders to reduce missed appointments in an academic primary care clinic: a randomized controlled trial. BMC Health Serv Res. 2013;13(1):125. doi: 10.1186/1472-6963-13-125. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Parikh A, Gupta K, Wilson AC, Fields K, Cosgrove NM, Kostis JB. The effectiveness of outpatient appointment reminder systems in reducing no-show rates. Am J Med. 2010;123(6):542–8. doi: 10.1016/j.amjmed.2009.11.022. [DOI] [PubMed] [Google Scholar]
- 21.Hasvold PE, Wootton R. Use of telephone and SMS reminders to improve attendance at hospital appointments: a systematic review. J Telemed Telecare. 2011;17(7):358–64. doi: 10.1258/jtt.2011.110707. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Woods R. Perspectives in ambulatory care. The effectiveness of reminder phone calls on reducing no-show rates in ambulatory care. Nurs Econ. 2011;29(5):278–82. [PubMed] [Google Scholar]
- 23.Oladipo A, Ogden S, Pugh S. Preclinic appointment telephone contact: an effective intervention for colposcopy clinic nonattendance. J Low Genit Tract Dis. 2007;11(1):35–8. doi: 10.1097/01.lgt.0000236970.35125.4b. [DOI] [PubMed] [Google Scholar]
- 24.Reti S. Improving outpatient department efficiency: a randomized controlled trial comparing hospital and general-practice telephone reminders. N Z Med J. 2003;116(1175):U458. [PubMed] [Google Scholar]
- 25.Ritchie PD, Jenkins M, Cameron PA. A telephone call reminder to improve outpatient attendance in patients referred from the emergency department: a randomised controlled trial. Aust N Z J Med. 2000;30(5):585–92. doi: 10.1111/j.1445-5994.2000.tb00860.x. [DOI] [PubMed] [Google Scholar]
- 26.Roberts N, Meade K, Partridge M. The effect of telephone reminders on attendance in respiratory outpatient clinics. J Health Serv Res Policy. 2007;12(2):69–72. doi: 10.1258/135581907780279567. [DOI] [PubMed] [Google Scholar]
- 27.Sawyer S, Zalan A, Bond L. Telephone reminders improve adolescent clinic attendance: a randomized controlled trial. J Paediatr Child Health. 2002;38(1):79–83. doi: 10.1046/j.1440-1754.2002.00766.x. [DOI] [PubMed] [Google Scholar]
- 28.Booth PG, Bennett HE. Factors associated with attendance for first appointments at an alcohol clinic and the effects of telephone prompting. J Subst Use. 2004;9(6):269–79. doi: 10.1080/14659890410001711715. [DOI] [Google Scholar]
- 29.Watt BD, Hoyland M, Best D, Dadds MR. Treatment participation among children with conduct problems and the role of telephone reminders. J Child Fam Stud. 2007;16(4):522–30. doi: 10.1007/s10826-006-9103-4. [DOI] [Google Scholar]
- 30.Szilagyi PG, Bordley C, Vann JC, et al. Effect of patient reminder/recall interventions on immunization rates: a review. JAMA. 2000;284(14):1820–7. doi: 10.1001/jama.284.14.1820. [DOI] [PubMed] [Google Scholar]
- 31.Chen Z-W, Fang L-Z, Chen L-Y, Dai H-L. Comparison of an SMS text messaging and phone reminder to improve attendance at a health promotion center: a randomized controlled trial. J Zhejiang Univ Sci B. 2008;9(1):34–8. doi: 10.1631/jzus.B071464. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Chariatte V, Berchtold A, Akré C, Michaud P-A, Suris J-C. Missed appointments in an outpatient clinic for adolescents, an approach to predict the risk of missing. J Adolesc Health. 2008;43(1):38–45. doi: 10.1016/j.jadohealth.2007.12.017. [DOI] [PubMed] [Google Scholar]
- 33.Ramm C, Robinson S, Sharpe N. Factors determining non-attendance at a cardiac rehabilitation programme following myocardial infarction. N Z Med J. 2001;114(1132):227–9. [PubMed] [Google Scholar]
- 34.Conduit T, Byrne S, Court J, Stefanovic S. Non-attendance at a university-based psychology clinic: telephone appointment reminders versus no reminders. Aust Psychol. 2004;39(1):68–75. doi: 10.1080/00050060410001660362. [DOI] [Google Scholar]
- 35.Alaeddini A, Yang K, Reddy C, Yu S. A probabilistic model for predicting the probability of no-show in hospital appointments. Health Care Manag Sci. 2011;14(2):146–57. doi: 10.1007/s10729-011-9148-9. [DOI] [PubMed] [Google Scholar]
- 36.Goldman L, Freidin R, Cook E, Eigner J, Grich P. A multivariate approach to the prediction of no-show behavior in a primary care center. Arch Intern Med. 1982;142(3):563–7. doi: 10.1001/archinte.1982.00340160143026. [DOI] [PubMed] [Google Scholar]
- 37.Zeng B, Turkcan A, Lin J, Lawley M. Clinic scheduling models with overbooking for patients with heterogeneous no-show probabilities. Ann Oper Res. 2010;178(1):121–44. doi: 10.1007/s10479-009-0569-5. [DOI] [Google Scholar]
- 38.Percac-Lima S, Cronin PR, Ryan DP, Chabner BA, Daly EA, Kimball AB. Patient navigation based on predictive modeling decreases no-show rates in cancer care. Cancer. 2015 doi: 10.1002/cncr.29236. [DOI] [PubMed] [Google Scholar]
- 39.Cronin PR, Kimball AB. Success of automated algorithmic scheduling in an outpatient setting. Am J Manag Care. 2014;20(7):570–6. [PubMed] [Google Scholar]
- 40.Bigby J, Giblin J, Pappius EM, Goldman L. Appointment reminders to reduce no-show rates: a stratified analysis of their cost-effectiveness. JAMA. 1983;250(13):1742–5. doi: 10.1001/jama.1983.03340130060033. [DOI] [PubMed] [Google Scholar]
- 41.Zai AH, Kim S, Kamis A, et al. Applying operations research to optimize a novel population management system for cancer screening. J Am Med Inform Assoc JAMIA. 2014;21(e1):e129–35. doi: 10.1136/amiajnl-2013-001681. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Milkman KL, Beshears J, Choi JJ, Laibson D, Madrian BC. Using implementation intentions prompts to enhance influenza vaccination rates. Proc Natl Acad Sci U S A. 2011;108(26):10415–20. doi: 10.1073/pnas.1103170108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Milkman KL, Beshears J, Choi JJ, Laibson D, Madrian BC. Planning prompts as a means of increasing preventive screening rates. Prev Med. 2013;56(1):92–3. doi: 10.1016/j.ypmed.2012.10.021. [DOI] [PubMed] [Google Scholar]
- 44.Nickerson DW, Rogers T. Do you have a voting plan? Implementation intentions, voter turnout, and organic plan making. Psychol Sci. 2010;21(2):194–9. doi: 10.1177/0956797609359326. [DOI] [PubMed] [Google Scholar]
- 45.Steadman L, Field S, Rutter DR, Quine L. An implementation intentions intervention to increase uptake of mammography. Ann Behav Med. 2006;32(2):127–34. doi: 10.1207/s15324796abm3202_10. [DOI] [PubMed] [Google Scholar]
- 46.Sinsky CA, Dugdale DC. Medicare payment for cognitive vs procedural care: minding the gap. JAMA Int Med. 2013;173(18):1733–7. doi: 10.1001/jamainternmed.2013.9257. [DOI] [PubMed] [Google Scholar]
- 47.Zuvekas SH, Cohen JW. Fee-for-service, while much maligned, remains the dominant payment method for physician visits. Health Aff (Millwood) 2016;35(3):411–4. doi: 10.1377/hlthaff.2015.1291. [DOI] [PubMed] [Google Scholar]
- 48.Beck DE, Margolin DA. Physician coding and reimbursement. Ochsner J. 2007;7(1):8–15. [PMC free article] [PubMed] [Google Scholar]
- 49.Akl EA, Meerpohl JJ, Raad D, et al. Effects of assessing the productivity of faculty in academic medical centres: a systematic review. Can Med Assoc J. 2012:cmaj - 111123. [DOI] [PMC free article] [PubMed]
- 50.Albritton TA, Miller MD, Johnson MH, Rahn DW. Using relative value units to measure faculty clinical productivity. J Gen Intern Med. 1997;12(11):715–7. doi: 10.1046/j.1525-1497.1997.07146.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Kairouz VF, Raad D, Fudyma J, Curtis AB, Schünemann HJ, Akl EA. Assessment of faculty productivity in academic departments of medicine in the United States: a national survey. BMC Med Educ. 2014;14:205. doi: 10.1186/1472-6920-14-205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Physician Fee Schedule - Centers for Medicare & Medicaid Services. November 2012. https://www.cms.gov/Medicare/Medicare-Fee-for-Service-Payment/PhysicianFeeSched/index.html. Accessed June 17, 2016.
- 53.Riley GF. Administrative and claims records as sources of health care cost data. Med Care. 2009;47(Supplement):S51–5. doi: 10.1097/MLR.0b013e31819c95aa. [DOI] [PubMed] [Google Scholar]
- 54.Table: 33 ACO Quality Measures. http://www.cms.gov/Medicare/Medicare-Fee-for-Service-Payment/sharedsavingsprogram/Downloads/ACO-Shared-Savings-Program-Quality-Measures.pdf. Accessed June 17, 2016.
- 55.Projecting the Supply and Demand for Primary Care Practitioners Through 2020. Rockville, Maryland: U.S. Department of Health and Human Services, Health Resources and Services Administration, National Center for Health Workforce Analysis; 2013. http://bhpr.hrsa.gov/healthworkforce/supplydemand/usworkforce/primarycare/projectingprimarycare.pdf. Accessed June 17, 2016.
- 56.Hwang AS, Atlas SJ, Cronin P, et al. Appointment “no-shows” are an independent predictor of subsequent quality of care and resource utilization outcomes. J Gen Intern Med. March 2015:1–8. doi:10.1007/s11606-015-3252-3 [DOI] [PMC free article] [PubMed]
- 57.Rittenhouse DR, Casalino LP, Shortell SM, et al. Small and medium-size physician practices use few patient-centered medical home processes. Health Aff (Millwood) 2011;30(8):1575–84. doi: 10.1377/hlthaff.2010.1210. [DOI] [PubMed] [Google Scholar]
- 58.Han E, Scholle SH, Morton S, Bechtel C, Kessler R. Survey shows that fewer than a third of patient-centered medical home practices engage patients in quality improvement. Health Aff (Millwood) 2013;32(2):368–75. doi: 10.1377/hlthaff.2012.1183. [DOI] [PubMed] [Google Scholar]
- 59.Gurol-Urganci I, de Jongh T, Vodopivec-Jamsek V, Atun R, Car J. Mobile phone messaging reminders for attendance at healthcare appointments. Cochrane Database Syst Rev. 2013;12 doi: 10.1002/14651858.CD007458.pub3. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
(DOCX 267 kb)
(GIF 121 kb)