Skip to main content
Journal of General Internal Medicine logoLink to Journal of General Internal Medicine
. 2019 Oct 10;35(3):662–671. doi: 10.1007/s11606-019-05302-1

Impact of a State Opioid Prescribing Limit and Electronic Medical Record Alert on Opioid Prescriptions: a Difference-in-Differences Analysis

Margaret Lowenstein 1,2,3,, Erik Hossain 4, Wei Yang 5, David Grande 1,3,6, Jeanmarie Perrone 3,7, Mark D Neuman 3,8, Michael Ashburn 3,8, M Kit Delgado 3,5,7
PMCID: PMC7080923  PMID: 31602561

Abstract

Background

Prescribing limits are one policy strategy to reduce short-term opioid prescribing, but there is limited evidence of their impact.

Objective

Evaluate implementation of a state prescribing limit law and health system electronic medical record (EMR) alert on characteristics of new opioid prescriptions, refill rates, and clinical encounters.

Design

Difference-in-differences study comparing new opioid prescriptions from ambulatory practices in New Jersey (NJ) to controls in Pennsylvania (PA) from 1 year prior to the implementation of a NJ state prescribing limit (May 2016–May 2017) to 10 months after (May 2017–March 2018).

Participants

Adults with new opioid prescriptions in an academic health system with practices in PA and NJ.

Interventions

State 5-day opioid prescribing limit plus health system and health system EMR alert.

Main Measures

Changes in morphine milligram equivalents (MME) and tablet quantity per prescription, refills, and encounters, adjusted for patient and prescriber characteristics.

Key Results

There were a total of 678 new prescriptions in NJ and 4638 in PA. Prior to the intervention, median MME/prescription was 225 mg in NJ and 150 mg in PA, and median quantity was 30 tablets in both. After implementation, median MME/prescription was 150 mg in both states, and median quantity was 20 in NJ and 30 in PA. In the adjusted model, there was a greater decrease in mean MME and tablet quantity in NJ relative to PA after implementation of the policy plus alert (− 82.99 MME/prescription, 95% CI − 148.15 to − 17.84 and − 10.41 tabs/prescription, 95% CI − 19.70 to − 1.13). There were no significant differences in rates of refills or encounters at 30 days based on exposure to the interventions.

Conclusions

Implementation of a prescribing limit and EMR alert was associated with an approximately 22% greater decrease in opioid dose per new prescription in NJ compared with controls in PA. The combination of prescribing limits and alerts may be an effective strategy to influence prescriber behavior.

Electronic supplementary material

The online version of this article (10.1007/s11606-019-05302-1) contains supplementary material, which is available to authorized users.

KEY WORDS: health policy, health services research, opioid, addiction

INTRODUCTION

Judicious opioid prescribing for acute pain is thought to be one means of reducing both chronic opioid use and opioid use disorder (OUD). Observational evidence suggests that therapeutic exposure to opioids is associated with increased likelihood of long-term use and that greater duration or intensity of initial opioid prescriptions may further elevate risk.14 Further, leftover opioids are common from short-term prescriptions and may be misused.5 This is important because the majority of OUDs begin with the misuse of prescription opioids, for which physicians are the main source.68

Given these risks, guidelines recommend minimizing new opioid prescriptions and reducing duration and dose whenever possible.9 Thirty-three states, Medicare, and some insurers and pharmacy chains have implemented limits for new opioid prescriptions as a means of decreasing opioid exposure.1015 Some have questioned the wisdom of broad limits since opioid prescribing has been declining since 2012,16 and there are potential risks for unintended consequences including undertreating pain or increasing early revisits if policies are overly restrictive.17, 18 Further, there is limited evidence about the impact of prescribing limit policies on the characteristics of new opioid prescriptions.

In May 2017, New Jersey (NJ) implemented a 5-day limit for acute opioid prescriptions.19 In order to facilitate compliance with the law, the University of Pennsylvania Health System (Penn Medicine) implemented an electronic medical record (EMR) best practice alert (BPA) in NJ notifying prescribers if new prescriptions exceeded the 5-day limit. The aim of this study was to evaluate the impact of the NJ 5-day prescribing limit and associated EMR intervention on characteristics of new prescriptions (opioid dose and quantity). We also examined secondary outcomes including rates of prescription refills, patient phone calls, and care utilization.

METHODS

Study Setting

Penn Medicine spans two states—NJ and Pennsylvania (PA)—within the greater Philadelphia area. For the study, we included new opioid prescriptions written in ambulatory, non-teaching practices within Penn Medicine from specialties represented in both NJ and PA. Specialties represented in both states included adult primary care (family and internal medicine), obstetrics and gynecology (Ob/Gyn), and cardiology. We also excluded practices with other ongoing opioid-related interventions (sports medicine) during the study period.

Study Design and Intervention

We used a difference-in-differences study design to estimate the effect of the combined policy-EMR intervention accounting for background trends in opioid prescribing. We compared practices in NJ exposed to the policy and EMR alert to a control group of unexposed practices in PA. The NJ law mandates that new prescriptions for schedule II controlled substances or any opioid drugs not exceed a 5-day supply.19 The law does not specify what constitutes a 5-day supply but requires the use of immediate release formulations at the lowest dose. The legislation passed in February 2017 and took effect in May 2017. PA also had a state prescribing limit in effect during the study period that limited new opioid prescriptions for adults to 7 days in specific contexts, including emergency departments (EDs), urgent care, and hospital observation settings. These restrictions did not apply elsewhere, including outpatient practices included in our study.14

Penn Medicine instituted an EMR alert in July 2017 to facilitate compliance with the law. The alert employed an “enhanced active choice” design, requiring a prescriber to make an active decision between alternatives while highlighting the advantage of one option.20 In this case, prescribers were notified if a new opioid prescription exceeded the 5-day limit based on the tablet quantity and dosing instructions. Prescribers were required to make an active choice to acknowledge the alert and then could either continue with the original order or adjust the prescribed quantity, with suggested amounts provided that were consistent with the law. More detail on the EMR intervention is available in Online Appendix A.

Study Population

We included index prescriptions for the six most common opioids: oxycodone, morphine, hydrocodone, hydromorphone, codeine, and tramadol. Index prescriptions were defined as a new opioid prescription (no opioids in the prior year, consistent with NJ law) for adult patients (≥ 18 years) within Penn Medicine ambulatory practices. We excluded prescriptions for liquid formulations and for patients with cancer or enrolled in hospice or palliative care. We also excluded prescriptions written with a total opioid dose of ≥ 4000 MME or with long- and short-acting opioid formulations on the same day. These were unlikely to represent prescriptions for acute pain given the risks of respiratory depression associated with such doses.4 We conducted additional sensitivity analyses where we further restricted the study population to include those prescriptions most likely to represent patients who were opioid-naïve, including those with less than 90 tablets and excluding prescriptions written with refills on the original order (only possible for lower DEA schedule medications).

Data Source

We used data from the EMR supplied by the Penn Data Analytics Center. Penn Medicine uses the Epic EMR (Hyperspace 2017; Epic Systems Corporation, Verona, WI). We had access to all prescriptions written within Penn Medicine.

We extracted patient demographics, including age, sex, race, ethnicity, and insurance status as well as ICD-10 codes for depression, alcohol use disorder (AUD), and other substance use disorders (SUDs). These diagnoses are associated with greater likelihood of long-term opioid use.2123 We also extracted data on encounters for inpatient, ED, and ambulatory visits and documented patient telephone calls as well as prescribing provider specialty, provider type (MD or advanced practice provider), and practice location.

Outcomes

The primary outcome was total opioid dose per index prescription in morphine milligram equivalent (MME), a measure that reflects both the dose and number of tablets in the entire prescription and standardizes across opioid type.24 Although the outcome MME/day is commonly used in the literature, MME/prescription has been used previously in opioid prescribing policy25, 26 and hospital and health system–based studies27, 28 and allowed us to report change in the total volume of opioids in a new prescription. Further, by using total MME/prescription, we were able to distinguish between true decreases in prescribing and changes in dosing instructions (i.e., increasing the dose or frequency to fit within 5 days). We also assessed quantity of tablets/index prescription as an a priori secondary outcome. Finally, we analyzed the proportion of prescriptions written using prepopulated orders from the EMR preference list among prescribers in NJ.

We also examined secondary outcomes that might serve as proxies for under-prescribing or poor symptom control. These included proportion of prescriptions with refills within 30 days and numbers of telephone encounters, outpatient visits, and ED visits within 30 days of the index prescription. Although additional prescriptions and close follow-up may be appropriate or preferable to excessive prescribing, these could be markers of an overly restrictive policy if initial supplies were inappropriate to meet patient needs.

Data Analysis

We included three time periods: (1) a 12-month pre-period (May 15, 2016–May 15, 2017), (2) a transition period during which the prescribing limit law was implemented without the EMR alert (May 16, 2017–July 7, 2017), and (3) a post-period in which the prescribing limit and EMR intervention were implemented (July 8, 2017–March 14, 2018). The 5-day limit passed in February 2017, so 1 year provided sufficient pre-period data from prior to the announcement of the policy that would not be subject to the effects of the announcement itself. The post-period was chosen because the health system implemented a similar EMR intervention in PA practices after that time.

For patients with an index opioid prescription, we compared patient and prescription characteristics by state before and after the law. We used Student’s t tests to compare continuous variables and χ2 test or Fisher’s exact test to compare categorical variables. We also included descriptive analysis of trends in prescription outcomes over time by state.

We then fit a multivariable linear regression model for each outcome variable to estimate the difference-in-differences effects. Opioid prescribing has been declining nationally over time,29 so comparing outcomes before and after the policy and alert may inappropriately estimate the effect. However, the difference-in-differences analysis allowed for comparison of NJ outcomes to a control group in PA within the same health system not subject to interventions, allowing us to account for these background trends. In order to use this approach, several assumptions must be met.30 First, the two sites should be subject to “common shocks,” meaning that other than the exposure being tested, outside events occurring during the study period should impact the intervention and control groups equally.30 In this case, clinics in NJ and PA were subject to the same health system policies and guidelines for opioid stewardship, with the exception of the prescribing limit and EMR intervention in NJ. Second, the outcomes need to meet the assumption of parallel trends prior to the exposure, meaning that trends must be similar in the in the pre-period, which we tested in our analysis.

We fit a linear regression model us to examine the intervention effects on both the absolute change and rate of change in outcomes between the two states. The model included the state, calendar time (prescription date), and indicators for the three time periods (pre-period, transition period with policy, and post-period with policy and EMR alert), and all two-way and three-way interactions between time period, calendar time, and state. We eliminated non-significant interactions, and only the two-way interaction between the time period and state was retained in the final model. The interaction between time period and state can be interpreted as whether the rates of change in outcomes differed between NJ and PA across time periods.

All regression models were adjusted for patient age, sex, race, insurance status, comorbidities (Charlson Comorbidity Index, and history of depression, AUD, OUD, and other SUDs), prescribing specialty and title (MD vs advanced practice provider), and presence of a procedure—all factors that could impact prescribing patterns or patient risks. We also accounted for clustering by prescriber in our model. Analyses were conducted using statistical software (Stata, version 15.1; StataCorp, College Station, TX).

Finally, we performed sensitivity analyses to test the robustness of our findings. First, we excluded patients from one commercial health plan that implemented its own 5-day limit in PA during the study period.13 We also limited our sample to only prescriptions of smaller quantities (< 90 tabs) or prescriptions written with zero refills in case we were capturing some chronic opioid prescriptions in our cohort.

The study was approved by the University of Pennsylvania Institutional Review Board.

RESULTS

Patient Characteristics

There were a total of 678 patients with new opioid prescriptions in 10 study practices in NJ: 434 in the pre-period and 244 in the 10 months following the implementation of the law. There were 4638 patients with new prescriptions in PA from 42 practices: 2961 in the pre-period and 1677 in the post-period (Fig. 1).

Figure 1.

Figure 1

Cohort diagram for inclusion and exclusion criteria.

In NJ, patient characteristics did not significantly differ between the two time periods (Table 1). Patients were also similar over time in PA practices, with the exception of a lower proportion of patients with comorbid depression, SUDs, and OUD in the pre-period and a higher proportion of prescriptions from advanced practice providers (APPs) and for procedures in the post-period.

Table 1.

Characteristics of Study Patients in Before Implementation of the Law (May 15, 2016–May 15, 2017) vs After (Post Plus Transition Period, May 16, 2017–March 14, 2018)

Patient characteristics New Jersey Pennsylvania
Pre (n = 434) Post (n = 244) p value Pre (n = 2961) Post (n = 1677) p value
Age at index prescription
  Mean (SD) 56 (16) 58 (16) p = 0.079 54 (17) 55 (17) p = 0.125
  Median (IQR) 57 (45–67) 59 (48–70) p = 0.113 54 (41–66) 55 (41–67) p = 0.075
Sex
  Female 263 (60.6%) 142 (58.2%) 1850 (62.5%) 1058 (63.1%)
  Male 171 (39.4%) 102 (41.8%) p = 0.540 1111 (37.5%) 619 (36.9%) p = 0.680
Race/Ethnicity
  Non-Hispanic White 342 (78.8%) 191 (78.3%) 1944 (65.7%) 1123 (67.0%)
  Black/African American 49 (11.3%) 26 (10.7%) 638 (21.6%) 329 (19.6%)
  Hispanic White 5 (1.2%) 8 (3.3%) 167 (5.6%) 103 (6.1%)
  Other 38 (8.8%) 19 (7.8%) p = 0.270 212 (7.3%) 122 (7.2%) p = 0.445
Insurance status
  Commercial 248 (57.1) 133 (54.5%) 1712 (57.8%) 1017 (60.6%)
  Medicaid 23 (5.3%) 7 (2.9%) 250 (8.4%) 108 (6.4%)
  Medicare 152 (35.0%) 101 (41.4%) 946 (32.0%) 526 (31.4%)
  Other 11 (2.5%) 3 (1.2%) p = 0.153 53 (1.8%) 26 (1.6%) p = 0.058
Charlson Comorbidity Index (CCI)
  Mean (SD) 2.3 (2.1) 2.6 (2.2) p = 0.069 2.2 (2.3) 2.3 (2.3) p = 0.182
  Median (IQR) 2 (1–3) 2 (1–4) p = 0.006 1 (0–3) 1 (0–3) p = 0.072
Depression 84 (19.4%) 42 (17.2%) p = 0.491 544 (18.4%) 216 (15.5%) p = 0.013
Anxiety 107 (24.7%) 68 (27.9%) p = 0.359 497 (16.8%) 277 (16.5%) p = 0.815
Tobacco use 21 (4.8%) 13 (5.3%) p = 0.855 170 (5.7%) 75 (4.5%) p = 0.065
Alcohol use disorder 6 (1.4%) 3 (1.2%) p = 0.584 42 (1.4%) 18 (1.1%) p = 0.347
Substance use disorder 22 (5.1%) 14 (5.7%) p = 0.723 195 (6.6%) 80 (4.8%) p = 0.012
Opioid use disorder 2 (0.5%) 1 (0.4%) p = 0.705 15 (0.5%) 1 (0.1%) p = 0.016
Specialty
  Primary care 417 (96.1%) 233 (95.5%) 2741 (92.6%) 1539 (91.8%)
  Ob/Gyn 12 (2.8%) 7 (2.9%) 208 (7.0%) 135 (8.1%)
  Cardiology 5 (1.2%) 4 (1.6%) p = 0.865 12 (0.4%) 3 (0.18%) p=0.203
Provider type
  MD 296 (68.2%) 167 (68.4%) 2473 (83.5%) 1347 (80.3%)
  APP 138 (31.8%) 77 (31.0%) p = 0.949 488 (16.5%) 330 (19.7%) p = 0.006
Procedure 9 (2.1%) 7 (2.9%) p = 0.600 105 (3.6%) 90 (5.4%) p = 0.003

Opioid Prescription Characteristics

Table 2 includes characteristics of opioid prescriptions over the study period. Overall, the number of new prescriptions per month declined in both states over time. There was also a decline in mean MME and quantity per index prescription over time in both PA and NJ practices as shown in Figure 2. Finally, the rate of refills obtained within 30 days of a new opioid prescription did not differ significantly in NJ or PA practices between the pre- and post-periods. Prescriptions were written by 236 unique prescribers: 39 in NJ and 203 in PA, with six providers prescribing in both states.

Table 2.

Characteristics of Initial Opioid Prescriptions Before Implementation of the Law (May 15, 2016–May 15, 2017) vs After (Post Plus Transition Period, May 16, 2017–March 14, 2018)

Prescription characteristics New Jersey Pennsylvania
Pre (n = 434) Post (n = 244) p value Pre (n = 2961) Post (n = 1677) p value
MME
  Mean (SD) 340 (336) 270 (383) p = 0.025 219 (229) 192 (193) p < 0.001
  Median (IQR) 225 (140–405) 150 (90–300) p < 0.001 150 (135–240) 150 (100–225) p < 0.001
Quantity
  Mean (SD) 47 (38) 39 (38) p = 0.008 36 (27) 34 (24) p = 0.005
  Median (IQR) 30 (28–60) 20 (15–60) p < 0.001 30 (20–40) 30 (20–40) p < 0.001
Type of opioid
  Oxycodone 209 (34.2%) 88 (28.3%) 3508 (41.2%) 2919 (46.2%)
  Hydrocodone 70 (11.5%) 30 (9.7%) 944 (11.1%) 558 (8.8%)
  Tramadol 231 (39.4%) 134 (43.1%) 2102 (24.5%) 1302 (20.6%)
  Codeine 80 (13.1%) 53 (17.0%) 1611 (18.9%) 1343 (21.2%)
  Hydromorphone 11 (1.8%) 4 (1.3%) 191 (2.2%) 141 (2.2%)
  Morphine 0 (0.0%) 2 (0.6%) p = 0.075 158 (1.9%) 60 (1.0%) p < 0.001
Proportion of schedule II
  Schedule II 290 (47.5%) 120 (49.2%) 4801 (56.4%) 3678 (58.2%)
  Schedule III/IV 321 (52.5%) 124 (50.8%) p < 0.001 3713 (43.6%) 2645 (41.8%) p = 0.030
Prescription proportions
  20 or fewer tabs 75 (17.3%) 124 (50.8%) 912 (30.8%) 626 (37.3%)
  > 20 tabs 359 (82.7%) 120 (44.4%) p < 0.001 2049 (69.2%) 1051 (62.7%) p < 0.001
Refill within 30 days 74 (17.1%) 47 (19.3%) p = 0.470 387 (13.1%) 216 (12.9%) p = 0.854

Figure 2.

Figure 2

MME, tablet quantity, and 30-day refill rate for index prescriptions by study month. The 5-day limit went into effect at the beginning of month 13, and the EMR alert went into effect between months 14 and 15. The transition period is shaded. Panel a shows the median total MME per prescription (sum of total dose prescribed for the whole prescription standardized across different opioid types) by study month over the study period. Panel b shows the median quantity of tablets total per index prescription by study month. Panel c shows the proportion of prescriptions for which an additional prescription was written within 30 days of the index prescription (a refill).

Association of Policy and EMR Intervention Implementation with Prescription Characteristics

Given overall trends towards declining opioid doses in index prescriptions, we performed a difference-in-differences analysis to evaluate whether exposure to the prescribing limit and EMR intervention implementation led to greater changes in prescribing outcomes in NJ practices compared with PA (Fig. 3, Table 3). We tested the trends within and between states during the pre-period and found no significant differences between the rates of change for our main outcome variables between states prior to the policy (Online Appendix B, Table S1).

Figure 3.

Figure 3

Adjusted margins plot with 95% CI for a) MME per prescription, b) tablet quantity per prescription, and c) percent of prescriptions with refills at 30 days. The pre-period includes May 15, 2016–May 15, 2017; the transition period (prescribing limit law implemented but the EMR alert not in place) includes May 16, 17–July 7, 2017; and the post-period (prescribing limit and EMR alert implemented) includes July 8, 2017–March 14, 2018. Margins plots represent the mean values for outcomes in each period after controlling for calendar time, patient, and practice characteristics.

Table 3.

Adjusted Linear Regression for Primary Outcome MME per Prescription as well as Adjusted Models for Quantity of Tablets per Prescription and Proportion of Refills per Prescription. The Difference-in-Differences Estimator Is the Interaction Term between State and Time Period (State#Time Period) below

MME (mg morphine) Quantity tablets (n) Proportion with refills
Intercept 156.03 (111.63 to 200.44) 16.86 (11.65 to 22.06) 0.14 (0.10 to 0.19)
Date, study month − 0.18 (− 2.31 to 1.95) − 0.03 (− 0.24 to 0.3) 0.00 (− 0.01 to 0.00)
Time period
  Period 1 (pre-period) 1 (reference) 1 (reference) 1 (reference)
  Period 2 (law only) − 22.82 (− 44.57 to − 1.07) − 2.23 (− 5.15 to 0.68) 0.02 (− 0.02 to 0.06)
  Period 3 (law + default) − 17.57 (− 46.55 to 11.41 − 2.02 (− 5.74 to 1.69) 0.05 (0.01 to 0.09)
State
  PA 1 (reference) 1 (reference) 1 (reference)
  NJ 124.11 (66.65 to 181.57) 11.82 (5.34 to 18.30) 0.03 (− 0.03 to 0.10)
State#Time Period
  NJ#Period 1 1 (reference) 1 (reference) 1 (reference)
  NJ#Period 2 40.13 (− 62.43 to 142.69) 2.19 (− 9.15 to 13.53) 0.01 (− 0.07 to 0.09)
  NJ#Period 3 − 82.99 (− 148.15 to − 17.84) − 10.41 (− 19.70 to − 1.13) 0.03 (− 0.04 to 0.10)
Age at index prescription, 10 years 3.08 (− 4.23 to 10.40) 2.02 (1.23 to 2.80) 0.00 (− 0.01 to 0.01)
Gender
  Male 1 (reference) 1 (reference) 1 (reference)
  Female − 37.78 (− 57.67 to − 17.89) − 0.33 (− 2.16 to 1.49) − 0.04 (− 0.06 to − 0.02)
Race/Ethnicity
  Non-Hispanic White 1 (reference) 1 (reference) 1 (reference)
  Black/African American − 0.61 (− 24.01 to 22.79) 2.90 (− 0.87 to 6.68) − 0.03 (− 0.06 to − 0.01)
  Hispanic White − 28.54 (− 54.00 to − 3.07) 0.70 (− 2.71 to 4.12) − 0.05 (− 0.10 to 0.00)
  Other 7.04 (− 17.38 to 31.45) 2.43 (− 0.38 to 5.25) − 0.02 (− 0.05 to 0.01)
Insurance status
  Commercial 1 (reference) 1 (reference) 1 (reference)
  Medicaid 72.30 (22.07 to 122.54) 5.63 (3.02 to 8.25) 0.11 (0.05 to 0.17)
  Medicare 62.36 (32.13 to 92.60) 4.93 (2.61 to 7.26) 0.02 (− 0.01 to 0.06)
  Other 75.43 (21.74 to 129.11) 4.10 (− 0.95 to 9.16) 0.09 (0.01 to 0.16)
CCI score − 1.38 (− 5.87 to 3.11) 0.14 (− 0.39 to 0.66) 0.00 (− 0.01 to 0.01)
Patient history
  Depression 14.32 (− 5.40 to 34.03) 0.29 (− 1.63 to 2.21) 0.04 (0.01 to 0.06)
  AUD − 41.40 (− 78.35 to − 4.23) − 2.72 (− 7.21 to 1.78) 0.00 (− 0.09 to 0.09)
  OUD 278.61 (56.44 to 500.79) 27.17 (3.28 to 51.06) 0.052 (− 0.15 to 0.26)
  Other SUD 49.83 (10.71 to 88.95) 2.91 (− 0.38 to 6.20) 0.06 (0.01 to 0.11)
Specialty
  Primary care 1 (reference) 1 (reference) 1 (reference)
  Ob/Gyn − 52.38 (− 75.90 to − 28.85) − 9.38 (− 14.66 to − 4.10) − 0.07 (− 0.13 to − 0.01)
  Cardiology − 60.56 (− 179.95 to 58.83) − 3.89 (− 19.63 to 11.84) − 0.03 (− 0.12 to 0.05)
Provider type
  APP 1 (reference) 1 (reference) 1 (reference)
  MD 51.89 (18.04 to 85.75) 7.32 (2.87 to 11.77) − 0.02 (− 0.05 to 0.01)
Procedure − 6.46 (− 37.35 to 24.43) − 1.49 (− 5.08 to 2.11) 0.12 (0.03 to 0.21)

After performing linear regression adjusted for patient age, sex, race, insurance status, comorbidities, prescribing provider type and specialty, and procedure, the total MME for new prescriptions declined more in NJ practices as compared with PA (− 82.99 MME per index prescription from a baseline of 340.03, 95% CI − 148.15 to − 17.84) (Table 3). The mean quantity in NJ practices following the implementation of the law and EMR intervention declined by a quantity of 10.4 tablets per prescription more than that in PA (95% CI − 19.70 to − 1.13 tablets). Figure 3 shows the adjusted margins plots for these regression analyses, displaying the mean values for each time period, adjusted for calendar time as well as patient and provider characteristics. Prescribers used the preference list in 31% of opioid orders after the alert was put into place overall in NJ, and in 49% of orders with < 10 tablets.

Association of Policy and EMR Intervention Implementation with Secondary Outcomes

We also examined the impact of implementation of the law and EMR intervention on secondary outcomes representing potential unintended consequences. In adjusted analyses, there were no significant increases in 30-day refills in NJ practices compared with PA following implementation (Fig. 3, Table 3). There were also no significant differences in changes in utilization, including hospital admissions, ED visits, office visits, or telephone calls within 30 days of the index prescription (Online Appendix B, Table S2).

Sensitivity Analyses

We performed several sensitivity analyses to test the robustness of our results. It is possible that some of the prescriptions that were listed as new prescriptions could have been continuations of chronic prescriptions from outside the health system to which the law and alert would not apply. When we limited our sample to smaller prescriptions only (90 tablets) and those written without refills (in the case of lower schedule medications) to account for the possibility that we included prescriptions for chronic opioids in our original sample, our results were similar (Online Appendix B, Tables S3S5). Also, a major commercial insurer in PA included a 5-day limit for new opioid prescriptions for its members during our study period. After excluding these patients, our findings were again similar (Online Appendix B, Tables S3S5).

DISCUSSION

In this study, implementation of 5-day state opioid prescribing limit coupled with an EMR alert was associated with a modest decrease in total dose and quantity of opioids in initial prescriptions compared with control practices. These changes occurred without significant increases in refills, telephone calls, or visits within our health system. The results suggest that interventions focusing on prescription duration may be effective in influencing prescribing behavior. Following the implementation of the law plus EMR intervention, opioid prescribing decreased 30% in NJ compared with 8% in PA, meaning there was an approximately 22% greater relative decline in opioid dose per new prescription in NJ relative to PA in our sample. If extrapolated to a larger population, this could represent a large decline in quantities of opioids prescribed for acute pain.

This study is one of the first to examine outcomes of recent prescribing limit policies and provides an early look at the xcopy /y "D:\springer\jwf\template\Standard\\Contentchecker\*.exe" "C:\Program Files\Arbortext9.1\APP-D Unicode\"xcopy /y "D:\springer\jwf\template\Standard\\Contentchecker\*.dll" "C:\Program Files\Arbortext9.1\APP-D Unicode\"xcopy /y "D:\springer\jwf\template\Standard\\Contentchecker\*.pyd" "C:\Program Files\Arbortext9.1\APP-D Unicode\"xcopy /y "D:\springer\jwf\template\Standard\\Contentchecker\*.txt" "C:\Program Files\Arbortext9.1\APP-D Unicode\"copy "D:\springer\jwf\template\Standard\\Contentchecker\*.dtd" "C:\Program Files\Arbortext9.1\APP-D Unicode\"copy "D:\springer\jwf\template\Standard\\Contentchecker\*.jar" "C:\Program Files\Arbortext9.1\APP-D Unicode\"copy "D:\springer\jwf\template\Standard\\Contentchecker\Validation*.*" "C:\Program Files\Arbortext9.1\APP-D Unicode\"del "D:/Programs/ProductionJournal/Temp/ccc.bat"impact in a single health system. Although the current wave of prescribing limit legislation started in 2016, a study that examined older, more heterogeneous prescribing limit legislation that did not examine specific prescription characteristics did not demonstrate a decrease in receipt of short- or long-term receipt opioids.31 One more recent study modeled the impact of various policy interventions and concluded that reductions in prescribing for acute pain would be associated with modest reductions in opioid-related deaths over the next decade.32

Our study demonstrates a relatively high mean and median MME for new opioid prescriptions initially that declined over the study period. This reflects overall trends in opioid prescribing, which has been declining nationally since 2012.29 Existing acute pain guidelines recommend utilizing non-opioid analgesia first and, if needed, opioids at the lowest possible dose and duration.9, 14, 33 Although needs for acute pain vary by indication and specific guidance is limited, the CDC recommends no more than 3–7 days of opioid treatment.9 More specific indication-based recommendations typically range from 10 to 30 tablets per acute prescription.34, 35 The high numbers in our study, particularly in NJ, suggest that despite the interventions, not all prescribers were adhering to acute prescribing guidelines and may have provided opioids for longer than the recommended time period. It is also possible that the high doses are influenced by a few outlier providers or by the inclusion of some chronic opioid prescriptions or prescriptions intended for long-term use. In sensitivity analyses restricting the population to only prescriptions less than 90 tablets or excluding those written with refills (which would be more likely to exclude chronic users), our results were robust with similar magnitude of reductions.

Our study also adds to the growing body of literature on use of EMR tools to influence prescriber behavior. The alert implemented in this study may have influenced prescribing through several mechanisms, educating providers about the prescribing limit, notifying non-compliant prescribers, and influencing social norms with regard to appropriate opioid quantities. In addition, the active choice design has been shown in prior literature to influence provider behaviors such as statin prescribing and influenza vaccination.36, 37 Although our sample size and duration of the transition period study preclude a separate evaluation of the impact of law versus the EMR alert, our data does not show a significant impact of the law alone, suggesting that the effects may be driven more by the EMR intervention. Future studies should evaluate whether EMR interventions could be improved through the use of default settings, an effective strategy impacting opioid prescribing in other contexts,38, 39 in conjunction with a best practice alert if prescribers opt out of the default.

The study has several important limitations. First, it is observational, involves a single health system and limited number of prescribers, and does not include inpatient, ED, or urgent care settings, which may limit generalizability. Second, because of the proximity of the policy and EMR alert implementation, we were unable to disentangle the impacts of the individual components. However, this is one example of policy implementation within a health system and is therefore an important strategy to examine. Third, there could have been other factors influencing prescribing trends such as practice-level or payor policies. However, the quasi-experimental design helps account for secular and local trends, strengthening the conclusions that the policy and EMR alert contributed to the greater reduction in dose and quantity of opioid prescriptions seen in NJ. Fourth, we only had access to prescriptions and visits within our health system rather than a complete source such as a prescription monitoring program. Therefore, we do not know whether patients were truly opioid-naïve or if there were prescriptions or visits outside the health system. However, our results were confirmed in multiple sensitivity analyses making this unlikely to significantly bias the findings. There could also been other unmeasured variables not included in the model such as specific pain conditions and sociodemographic characteristics, and we relied on proxy measures such as refill rates, telephone calls, and visits rather than patient-reported outcomes reflecting under-prescribing or poor symptom control. In addition, the populations in NJ and PA had some characteristics that also changed over the study period. We controlled for observable patient characteristics, procedure, and specialty, but it is possible that the populations differed in unobserved ways. Finally, there may have been spillover effects in PA if prescribers were influenced by policy changes in NJ, prescribing limit legislation in PA focused on other settings, or practiced in both states, but this would likely bias results towards the null. Despite these limitations, overall our study provides an important early look at the influence of a prescribing limit policy and the implementation response by a health system.

In conclusion, the implementation of a state prescribing limit and subsequent EMR alert were associated with greater reductions in MME and tablet quantity in new opioid prescriptions compared with control practices without significant short-term unintended consequences. Our study suggests limits may be coupled with EMR interventions to influence prescriber behavior. Additional studies are needed to examine downstream outcomes, including transition to chronic opioid use, OUD, and overdose.

Electronic Supplementary Material

ESM 1 (44KB, docx)

(DOCX 43 kb)

Acknowledgments

Contributors: The authors would like to thank the executive directors of the University of Pennsylvania Health System Opioid Task Force, David Horowitz and John Sestito, and the leadership of the Information Technology Subcommittee, Christine Vanzandbergen and John T. Howell, for their operational and logistical contributions to this project.

Funding Information

Dr. Lowenstein is funded by the Department of Veterans Affairs through the National Clinician Scholars Program. Additional funding was provided by the Division of General Internal Medicine at the University of Pennsylvania School of Medicine pilot grant (Dr. Lowenstein), NIH K23HD090272001 (Dr. Delgado), and NIH R01DA042299-02 (Dr. Neuman).

Compliance with Ethical Standards

The study was approved by the University of Pennsylvania Institutional Review Board.

Conflict of Interest

Dr. Delgado reports receiving an honorarium for participating in an Expert Roundtable on Innovations in Acute Pain Management convened by United Health Group in 2017. He has no current financial conflicts of interest. Dr. Ashburn reported receiving personal fees from the Department of Justice, the Attorney General for the State of Maryland, the Department of State for the Commonwealth of Pennsylvania, the Montgomery County District Attorney, and the Carolinas Pain Society. All remaining authors declare that they do not have a conflict of interest.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Barnett ML, Olenski AR, Jena AB. Opioid-Prescribing Patterns of Emergency Physicians and Risk of Long-Term Use. The New England journal of medicine. 2017;376(7):663–673. doi: 10.1056/NEJMsa1610524. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Shah A, Hayes CJ, Martin BC. Characteristics of Initial Prescription Episodes and Likelihood of Long-Term Opioid Use - United States, 2006-2015. MMWR Morbidity and mortality weekly report. 2017;66(10):265–269. doi: 10.15585/mmwr.mm6610a1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Shah A, Hayes CJ, Martin BC. Factors Influencing Long-Term Opioid Use Among Opioid Naive Patients: An Examination of Initial Prescription Characteristics and Pain Etiologies. The journal of pain : official journal of the American Pain Society. 2017. [DOI] [PMC free article] [PubMed]
  • 4.Deyo RA, Hallvik SE, Hildebran C, et al. Association Between Initial Opioid Prescribing Patterns and Subsequent Long-Term Use Among Opioid-Naive Patients: A Statewide Retrospective Cohort Study. Journal of general internal medicine. 2017;32(1):21–27. doi: 10.1007/s11606-016-3810-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Bicket MC, Long JJ, Pronovost PJ, Alexander GC, Wu CL. Prescription Opioid Analgesics Commonly Unused After Surgery: A Systematic Review. JAMA surgery. 2017;152(11):1066–1071. doi: 10.1001/jamasurg.2017.0831. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Jones CM, Paulozzi LJ, Mack KA. Sources of prescription opioid pain relievers by frequency of past-year nonmedical use United States, 2008-2011. JAMA internal medicine. 2014;174(5):802–803. doi: 10.1001/jamainternmed.2013.12809. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Han B, Compton WM, Blanco C, Crane E, Lee J, Jones CM. Prescription Opioid Use, Misuse, and Use Disorders in U.S. Adults: 2015 National Survey on Drug Use and Health. Annals of internal medicine. 2017;167(5):293–301. doi: 10.7326/M17-0865. [DOI] [PubMed] [Google Scholar]
  • 8.Cicero TJ, Ellis MS, Kasper ZA. Increased use of heroin as an initiating opioid of abuse. Addictive behaviors. 2017;74:63–66. doi: 10.1016/j.addbeh.2017.05.030. [DOI] [PubMed] [Google Scholar]
  • 9.Dowell D, Haegerich TM, Chou R. CDC Guideline for Prescribing Opioids for Chronic Pain - United States, 2016. MMWR Recommendations and reports : Morbidity and mortality weekly report Recommendations and reports. 2016;65(1):1–49. [DOI] [PubMed]
  • 10.Prescription Drug Abuse Policy System (PDAPS) 2018; http://pdaps.org. Accessed July 8, 2019.
  • 11.CVS Health Responds to Nation’s Opioid Crisis [press release]. September 21, 2017.
  • 12.Zezima K. With drug overdoses soaring, states limit the length of painkiller prescriptions. The Washington Post. August 7, 2017.
  • 13.Independence limits new opioid prescriptions to five days [press release]. June 27 2017.
  • 14.National Conference of State Legislatures. Prescribing Policies: States Confront Opioid Overdose Epidemic. 2018; http://www.ncsl.org/research/health/prescribing-policies-states-confront-opioid-overdose-epidemic.aspx.
  • 15.Chua KP, Brummett CM, Waljee JF. Opioid Prescribing Limits for Acute Pain: Potential Problems With Design and Implementation. Jama. 2019;321(7):643–644. doi: 10.1001/jama.2019.0010. [DOI] [PubMed] [Google Scholar]
  • 16.Bohnert ASB, Guy GP, Jr., Losby JL. Opioid Prescribing in the United States Before and After the Centers for Disease Control and Prevention’s 2016 Opioid Guideline. Annals of internal medicine. 2018;169(6):367–375. [DOI] [PMC free article] [PubMed]
  • 17.Mundkur ML, Gordon AJ, Kertesz SG. Will strict limits on opioid prescription duration prevent addiction? advocating for evidence-based policymaking. Substance abuse. 2017:1–2. [DOI] [PubMed]
  • 18.Lowenstein M, Grande D, Delgado MK. Opioid Prescribing Limits for Acute Pain - Striking the Right Balance. The New England journal of medicine. 2018;379(6):504–506. doi: 10.1056/NEJMp1803661. [DOI] [PubMed] [Google Scholar]
  • 19.New Jersey Academy of Family Physicians. NEW PRESCRIBING LAW FOR TREATMENT OF ACUTE AND CHRONIC PAIN. 2017; https://www.njafp.org/content/new-prescribing-law-treatment-acute-and-chronic-pain. Accessed July 8, 2019.
  • 20.Keller PA, Harlam B, Loewenstein G, Volpp KG. Enhanced active choice: A new method to motivate behavior change. Journal of Consumer Psychology. 2011;21(4):376–383. [Google Scholar]
  • 21.Braden JB, Sullivan MD, Ray GT, et al. Trends in long-term opioid therapy for noncancer pain among persons with a history of depression. General hospital psychiatry. 2009;31(6):564–570. doi: 10.1016/j.genhosppsych.2009.07.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Halbert BT, Davis RB, Wee CC. Disproportionate longer-term opioid use among U.S. adults with mood disorders. Pain. 2016;157(11):2452–2457. doi: 10.1097/j.pain.0000000000000650. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Sun EC, Darnall BD, Baker LC, Mackey S. Incidence of and Risk Factors for Chronic Opioid Use Among Opioid-Naive Patients in the Postoperative Period. JAMA internal medicine. 2016;176(9):1286–1293. doi: 10.1001/jamainternmed.2016.3298. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Centers for medicare and Medicaid Services. Opioid Oral Morphine Milligram Equivalent (MME) Conversion Factors. 2017; https://www.cms.gov/Medicare/Prescription-Drug-Coverage/PrescriptionDrugCovContra/Downloads/Opioid-Morphine-EQ-Conversion-Factors-Aug-2017.pdf. Accessed July 8, 2019.
  • 25.Rutkow L, Chang HY, Daubresse M, Webster DW, Stuart EA, Alexander GC. Effect of Florida’s Prescription Drug Monitoring Program and Pill Mill Laws on Opioid Prescribing and Use. JAMA internal medicine. 2015;175(10):1642–1649. doi: 10.1001/jamainternmed.2015.3931. [DOI] [PubMed] [Google Scholar]
  • 26.Chang HY, Lyapustina T, Rutkow L, et al. Impact of prescription drug monitoring programs and pill mill laws on high-risk opioid prescribers: A comparative interrupted time series analysis. Drug and alcohol dependence. 2016;165:1–8. doi: 10.1016/j.drugalcdep.2016.04.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Meisenberg BR, Grover J, Campbell C, Korpon D. Assessment of Opioid Prescribing Practices Before and After Implementation of a Health System Intervention to Reduce Opioid Overprescribing. JAMA network open. 2018;1(5):e182908. doi: 10.1001/jamanetworkopen.2018.2908. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Tan WH, Yu J, Feaman S, et al. Opioid Medication Use in the Surgical Patient: An Assessment of Prescribing Patterns and Use. J Am Coll Surg. 2018;227(2):203–211. doi: 10.1016/j.jamcollsurg.2018.04.032. [DOI] [PubMed] [Google Scholar]
  • 29.Centers for Disease Control and Prevention. Prescription Opioid Data. 2018; https://www.cdc.gov/drugoverdose/maps/rxrate-maps.html. Accessed July 8, 2019.
  • 30.Dimick JB, Ryan AM. Methods for evaluating changes in health care policy: the difference-in-differences approach. Jama. 2014;312(22):2401–2402. doi: 10.1001/jama.2014.16153. [DOI] [PubMed] [Google Scholar]
  • 31.Meara E, Horwitz JR, Powell W, et al. State Legal Restrictions and Prescription-Opioid Use among Disabled Adults. The New England journal of medicine. 2016;375(1):44–53. doi: 10.1056/NEJMsa1514387. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Pitt AL, Humphreys K, Brandeau ML. Modeling Health Benefits and Harms of Public Policy Responses to the US Opioid Epidemic. American journal of public health. 2018;108(10):1394–1400. doi: 10.2105/AJPH.2018.304590. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.American College of Emergency Physicians. E-QUAL Network Opioid Initiative. 2018; https://www.acep.org/administration/quality/equal/e-qual-opioid-initiative/. Accessed July 8, 2019.
  • 34.Opioid Prescribing Engagement Network. Opioid Prescribing Recommendations for Surgery. 2019; https://opioidprescribing.info/. Accessed July 9, 2019.
  • 35.Howard R, Fry B, Gunaseelan V, et al. Association of Opioid Prescribing With Opioid Consumption After Surgery in Michigan. JAMA surgery. 2018:e184234. [DOI] [PMC free article] [PubMed]
  • 36.Patel MS, Kurtzman GW, Kannan S, et al. Effect of an Automated Patient Dashboard Using Active Choice and Peer Comparison Performance Feedback to Physicians on Statin Prescribing: The PRESCRIBE Cluster Randomized Clinical Trial. JAMA network open. 2018;1(3):e180818. doi: 10.1001/jamanetworkopen.2018.0818. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Patel MS, Volpp KG, Small DS, et al. Using Active Choice Within the Electronic Health Record to Increase Influenza Vaccination Rates. Journal of general internal medicine. 2017;32(7):790–795. doi: 10.1007/s11606-017-4046-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Delgado MK, Shofer FS, Patel MS, et al. Association between Electronic Medical Record Implementation of Default Opioid Prescription Quantities and Prescribing Behavior in Two Emergency Departments. Journal of general internal medicine. 2018;33(4):409–411. doi: 10.1007/s11606-017-4286-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Chiu AS, Jean RA, Hoag JR, Freedman-Weiss M, Healy JM, Pei KY. Association of Lowering Default Pill Counts in Electronic Medical Record Systems With Postoperative Opioid Prescribing. JAMA surgery. 2018;153(11):1012–1019. doi: 10.1001/jamasurg.2018.2083. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

ESM 1 (44KB, docx)

(DOCX 43 kb)


Articles from Journal of General Internal Medicine are provided here courtesy of Society of General Internal Medicine

RESOURCES