Skip to main content
Journal of General Internal Medicine logoLink to Journal of General Internal Medicine
. 2020 Nov 3;35(Suppl 3):935–944. doi: 10.1007/s11606-020-06253-8

Benefits and Harms of Long-term Opioid Dose Reduction or Discontinuation in Patients with Chronic Pain: a Rapid Review

Katherine Mackey 1,, Johanna Anderson 1, Donald Bourne 1, Emilie Chen 1, Kim Peterson 1
PMCID: PMC7728933  PMID: 33145689

Abstract

Background

Many clinicians are reevaluating the use of long-term opioid therapy (LTOT) for chronic pain in response to the opioid crisis and calls from organizations including the Centers for Disease Control & Prevention to limit prescribing of high-dose opioids. However, this practice change is occurring largely in the absence of data regarding patient outcomes. A 2017 systematic review found inconclusive evidence on the impact of LTOT dose reduction and discontinuation on pain severity and function, quality of life, withdrawal symptoms, substance abuse, and adverse effects. This rapid systematic review provides an updated evidence synthesis of patient outcomes following LTOT dose reduction including serious harms such as overdose and suicide.

Methods

We systematically searched numerous bibliographic databases from January 2017 (the end search date of the 2017 systematic review) through May 2020. One reviewer used prespecified criteria to assess articles for inclusion, evaluate study quality, abstract data, and grade strength of evidence, with a second reviewer checking.

Results

We included 49 studies—1 systematic review, 34 studies included in that systematic review, and 14 new studies. We prioritized evidence synthesis of 19 studies with the most applicability to the Veteran population and outpatient settings. Among these studies, improvements in mean pain scores were common among patients tapering opioids while participating in intensive multimodal pain interventions and mostly unchanged with less intensive or nonspecific co-interventions. Our confidence in these findings is low due to methodological limitations of the studies. Observational data suggests that serious harms such as opioid overdose and suicidal ideation can occur following opioid dose reduction or discontinuation, but the incidence of these harms at the population level is unknown.

Discussion

The net balance of benefits and harms of LTOT dose reduction for patients with chronic pain is unclear. Clinicians should closely monitor patients during the tapering process given the potential for harm.

Electronic supplementary material

The online version of this article (10.1007/s11606-020-06253-8) contains supplementary material, which is available to authorized users.

KEY WORDS: chronic pain, opioids, tapering

BACKGROUND

In response to the evolving crisis of opioid-related morbidity, mortality, and misuse fueled initially by prescription opioids,1 many clinicians have changed their approach to long-term opioid therapy (LTOT) for chronic pain by prescribing lower opioids doses and fewer opioids overall.2 Publication of the 2016 Centers for Disease Control & Prevention (CDC) Guideline for Prescribing Opioids for Chronic Pain accelerated this change by highlighting opioid risks and a relative lack of evidence to support LTOT benefits. The CDC guideline urges clinicians to avoid or carefully justify prescribing opioid doses > 90 mg morphine equivalent daily dose (MEDD) and involve patients in shared decision-making regarding dose reductions if they are already prescribed doses > 90 mg MEDD.1 Similar approaches are recommended by the Veterans Affairs/Department of Defense (VA/DoD) and other groups.36

Although the association between high-dose opioid prescribing and increased risk of overdose is not in question,7 opioid dose reduction and discontinuation (also referred to as tapering when doses are reduced gradually) for patients with chronic pain on LTOT is occurring largely in the absence of data regarding patient outcomes. A good-quality 2017 systematic review of 40 mostly uncontrolled observational studies by Frank et al. found inconclusive evidence on the impact of LTOT tapers on pain severity, pain-related function, quality of life, withdrawal symptoms, substance abuse, and adverse effects.8 Meanwhile, as highlighted by the US Food and Drug Administration, anecdotal evidence is accumulating that patients may be at risk for serious harm when opioids are reduced too rapidly and without adequate provider communication or follow-up.9 The need to fill the evidence gap regarding patient outcomes after tapers is urgent amid growing concern that some clinicians, health systems, and payers have misapplied the guidelines, imposing opioid tapers or dosing thresholds on patients. In a 2019 editorial titled “No Shortcuts to Safer Opioid Prescribing,” authors of the CDC guideline acknowledged these concerns, clarified the intent of the guidelines, and criticized inflexible prescribing limits and abrupt opioid discontinuation.10

This manuscript summarizes findings of a rapid review11 and updated literature search conducted by the Department of Veterans Affairs Evidence Synthesis Program (VA ESP) on patient outcomes following opioid dose reduction and discontinuation in order to inform an August 2019 VA Health Services Research & Development (HSR&D) conference on opioid safety. Although we prioritized evidence synthesis of studies most applicable to Veterans Health Administration (VHA) populations and settings, this review is relevant to all clinicians caring for patients with chronic pain on LTOT. To the best of our knowledge, this is the most current review of opioid tapering outcomes and the most comprehensive in terms of evaluating harms.

METHODS

Our review was guided and reported by current standard systematic review methods and guidelines.12, 13 The complete description of our methods can be found on the PROSPERO international prospective register of systematic reviews (http://www.crd.york.ac.uk/PROSPERO/; registration number CRD42019129110), and in our full report.11 To accommodate a condensed timeline, we used sequential instead of independent dual review processes to minimize bias and error and prioritized evidence synthesis of studies most relevant to our population of interest (VHA patients).

Search Strategy

We searched MEDLINE® (Ovid), PsychInfo, Cochrane Register of Controlled Trials, Cochrane Database of Systematic Reviews, and Embase from January 1, 2017 (the end search date of the Frank et al. systematic review) through May 6, 2020, using terms for opioids, dose reduction, discontinuation, and pain (see Appendix A for full search strategies). Additional citations were identified from hand-searching reference lists and consultation with content experts. We limited the search to articles involving human subjects available in the English language.

Study Selection

Study selection was based on the eligibility criteria described in Figure 1.

Figure 1.

Figure 1

Eligibility criteria.

Data Abstraction and Quality Assessment

We abstracted data from all included studies on study design, patient characteristics, opioid use, interventions, and outcomes (see Appendix B for data abstraction results). For studies included in the systematic review by Frank et al., we relied on risk of bias ratings and abstracted data from that review (abstracting data on additional outcomes as needed). For subsequently published controlled studies, we used the Cochrane Risk of Bias Tools to rate the internal validity (see Appendix C for full quality assessment).14 All data abstraction and internal validity ratings were first completed by one reviewer and then checked by another. All disagreements were resolved by consensus or assessment by a third reviewer.

Strength of Evidence and Data Synthesis

We used the GRADE framework15 to evaluate the quality of the body of evidence. This framework considers study limitations (risk of bias), consistency of results, directness, and precision of the evidence. Ratings typically range from high to very low, reflecting our confidence that the evidence reflects the true effect. For this review, we applied the following general algorithm: evidence comprised of multiple observational studies with consistent findings received a rating of “low,” whereas the same type of evidence with few studies and/or indirectness and inconsistency was downgraded to “very low.” We synthesized evidence qualitatively and did not perform quantitative synthesis due to limited data or heterogeneity.

RESULTS

The literature flow diagram (Fig. 2) summarizes the results of the search and study selection processes. Among 3,155 potentially relevant citations, we included 49 studies—1 systematic review (Frank et al.),8 34 studies included in that systematic review,,1649 and 14 new studies identified in our literature search.5063 A total of 40,245 patients are included in the 14 new studies.

Figure 2.

Figure 2

Literature flow.

We prioritized evidence synthesis of: 1) studies conducted in a VHA setting or other outpatient settings; 2) studies that addressed serious harms such as overdose and suicide; and 3) studies that included enough detail regarding patient and tapering characteristics to evaluate the applicability of findings to VHA populations and settings. Nineteen studies (Table 1) (2 RCTs,18, 50 6 controlled observational studies,54, 56, 6063 and 11 uncontrolled observational studies)27, 30, 32, 34, 36, 40, 55, 5759, 65 met these criteria, which we refer to as “prioritized studies.” The remaining studies either had low applicability to VHA or outpatient settings or included patients or interventions that were not well-described. Also, unless they otherwise met our prioritization criteria, we do not discuss poor-quality studies included in Frank et al. in detail (see Table 1 for patient and taper characteristics of prioritized studies). Data tables for all included studies are available in online Appendix A and a list of all included and excluded studies are in our report’s supplemental materials.11 Table 2 provides an overview of results. Findings for specific patient outcomes are discussed below.

Table 1.

Characteristics of 19 Prioritized Studies

Author, Year
N,
Study Design
Setting
Follow-up
Patient
Age (mean)
% Male
% White
Most common pain type Chronic pain (yrs.) LTOT (yrs.) Mean MEDD:
Base/ % Discont.
Intervention Taper schedule Taper speed
RCTs

  Kurita, 2018*50

35

RCT

Multidisciplinary Pain Centre

University Hospital,

Denmark

6 mos.

53 yrs. 40% male Race NR

Neuropathic and nociceptive

somatic pain (49.3%)

>6 mos. >3 mos. 280mg/ 227mg Voluntary or patient-initiated; opioid dose stabilization followed by taper vs usual care Dose reduction 10% every 1-2 weeks Slow

  Sullivan, 201764

35

RCT

UW Medicine Center for Pain Relief

22 weeks

54 yrs.

29% male

85.7% white

NR 13.8 yrs. 10.2 yrs.

226mg

37% decreased dose

Voluntary; CBT and self-management skills building vs usual care 10% reduction per week Slow
Controlled Studies

  Demidenko, 2017*56

509

Case-control

VHA national sample

12 mos.

55 yrs. 94.3% male 70.7% white MSK (85.1%) NR NR

76mg

100% discont.

85% clinician-initiated; no specific intervention NR NR

  DiBenedetto, 201960*

778

Retrospective cohort

Community pain management practice

Unclear

53.2 yrs.

45.2% male

Race NR

Mixed/ central NR ≥ 3 mos.

125.1mg

31.2% dose decrease

No specific intervention NR NR

  James, 2019*61

572

Case-control

Academic primary care clinic

54.9 yrs.

54.4% male

52.3% white

NR NR NR

25.3%:120-359mg 10.7%: ≥

360mg

60.1% discont.

No specific intervention NR NR

  Nicholas, 201963*

140

Case-control

Outpatient pain management clinic

12 mos.

43 yrs.

47% male

Race NR

Lower back 6 yrs NR

47.1mg

72.5% discont.

Voluntary, 3-week outpatient pain management program with opioid discontinuation Individualized NR

  Perez, 2019*62

1,624

Case-control

Academic healthcare system

3 yrs.

51.5 yrs.

45.8% male

16.4% white

Back pain (63%); extremity pain (63%) NR NR

90 mg

12.7% with taper

No specific intervention NR NR

  Von Korff, 2019*54

31,142

Retrospective cohort

Group Health system, Washington

8 yrs.

Age NR

Sex NR Race NR

NR NR NR

76mg/

40mg

Clinician-initiated; no specific intervention NR NR
Uncontrolled Studies

  Darchuk, 201027

292

Pre-post

Mayo Clinic Pain Rehabilitation Center

6 mos.

45.8 yrs.

21.4% male

95.3% white

Low back pain (24.5%) 10.7 yrs. NR

112mg

94% discont.

Voluntary; 3-week intensive outpatient program Individualized Fast

  Darnall, 2018*55

82

Pre-post

Community pain clinics, California

4 mos.

51 yrs. 40% male Race NR NR NR 6 yrs. 288mg/ 150mg Voluntary; use of self-help book Individualized; up to 5% in month 1, up to 10% per week in mos. 2-4 Slow

  Harden, 201530

50

Pre-post

Philadelphia VA Medical Center

12 mos.

54 yrs.

88% male

60% white

Back (35%) NR 12 mos.

>200mg (64%)

94% decreased dose

Clinician-initiated with patient consent; no specific intervention Individualized Slow

  Hooten, 2007b33

66

Pre-post

Mayo Clinic Pain Rehabilitation Center

3 weeks

46.8 yrs.

50% male

90.6% white

Fibromyalgia (100%)

Men:

11.3 yrs.; Women

9.5 yrs.

NR

Men: 64mg, Women: 39 mg

95% discont.

Voluntary; 3-week intensive outpatient program Individualized Fast

  Hooten, 200932

1241

Pre-post

Mayo Clinic Pain Rehabilitation Center

3 weeks

46.5 yrs.

25.2% male

94.9% white

Low back (27%) 9.9 yrs. NR

118mg

96% discont.

Voluntary; 3-week intensive outpatient program Individualized Fast

  Huffman, 201736

1457

Pre-post

Cleveland Clinic Pain Rehabilitation

Outpatient Program

12 mos.

46.3 yrs.

35.6% male

Race: NR

NR NR >3 mos.

117mg

87% discont.

Voluntary or patient-initiated; 3-4 week intensive outpatient program Individualized Fast

  Hundley, 2018*57

43

Pre-post

North Florida/South Georgia Veterans Health System

5 yrs.

61 yrs. 95.3% male 83.7% White NR NR 7.8 yrs.

330mg

65% discont.

Mandated; no specific intervention Individualized Slow

  Mark, 2019*59

494

Uncontrolled cohort

Medicaid beneficiaries in Vermont

90 days

47 yrs.

51% male

Race NR

NR NR Mean 613 days

≥120 mg

100% discont.

No specific intervention

86% < 21 days

9% 21 to < 90 days

5% ≥ 90 days

Varied

  McPherson, 2018*58

551

Pre-post

VHA national sample

24 mos.

54.6 yrs. 95% male 71% white MSK (87%) NR NR

76mg

100% discont.

85% clinician-initiated; no specific intervention NR NR

  Murphy, 201340

705

Pre-post

VHA Chronic Pain Rehabilitation Program, Florida

3 weeks

49.08 yrs.

82.4% male

66.1 white

Back (60.2%) 12.69 yrs. NR

61mg

100% discont.

Voluntary; 3-week inpatient intensive multidisciplinary program Individualized Fast

  Townsend, 200846

373

Pre-post

Mayo Clinic Pain Rehabilitation Center

6 mos.

44.5 yrs.

20.9% male

95.7% white

Low back (24.4%) 9.4 yrs. 3.9 yrs.

99mg

93% discont.

Voluntary; 3-week intensive outpatient program Individualized Fast

*New since Frank 2017

MEDD morphine equivalent daily dose, Discont. discontinued, LTOT long-term opioid therapy, Fast taper < 1 month; Slow taper > 1 month; NR not reported, yrs. years, mos. months; MSK musculoskeletal, NCM nurse care management, CBT cognitive behavioral therapy

Table 2.

Outcomes of 19 Prioritized Studies18, 27, 30, 32, 34, 36, 40, 46, 50, 5459, 61, 63

graphic file with name 11606_2020_6253_Tab2_HTML.jpg

*New since Frank 2017; SUD substance use disorder, SSV suicidal self-directed violence; blank cells no data reported; no studies reported on opioid-related side effect outcomesInline graphicsymptoms improved;Inline graphicNo change in symptoms;Inline graphicReported with unclear effect or no comparator

Pain and Pain-Related Function

Studies reported mean changes in pain severity and intensity scores (as measured by tools such as the pain numerical rating scale, multidimensional pain inventory, and brief pain inventory). Most studies did not define clinically important changes on these scales or state whether opioid dose reduction resulted in severe pain requiring a change in management with a few exceptions.36, 63 Seven observational studies of opioid tapering in the context of intensive 3-4-week multimodal pain management programs requiring full-day participation Monday–Friday showed improvements in pain severity and intensity scores.27, 32, 34, 36, 40, 63, 65 Among studies reporting mean pain scores at baseline and endpoint, improvements were greatest (19-47%) in studies of patients on higher baseline MEDD (99-177 mg)27, 32, 36, 46 and more modest (8-10%) among studies of patients with lower baseline MEDD (47-61 mg).63, 66 Although these results are encouraging, studies of intensive multimodal pain management programs have limited applicability overall given that many patients lack access to or means to participate in such programs.

The best evidence of the impact of opioid tapering on pain severity with a moderate co-intervention is an RCT in which patients with chronic pain who wanted to taper opioids were randomized to usual care versus a tapering support intervention that included psychiatric consultation and 18 weekly meetings with a physician assistant to improve self-management skills. In both groups, patients had lower pain severity ratings at 22 weeks and patients in the intervention group also had improvements in pain interference and pain self-efficacy.18 Another RCT of a moderate-intensity intervention relied on voluntary opioid tapering and had a high drop-out rate, prompting the study authors to deem the intervention unsuccessful.50 The least intensive intervention was an observational study of 51 patients in a community pain clinic with high baseline MEDD (288 mg) who voluntarily participated in a slow individualized taper with the use of a self-help book and had mean improvements in pain scores of 10%. In another observational study of tapering, 50 VHA patients with high baseline MEDD (64% > 200 mg) who tapered opioids with usual care had less pain (40%) or unchanged pain (28%) at 6–12 months.30

Importantly, patients participated voluntarily in tapering interventions described above. Only 1 study that evaluated pain scores at baseline and endpoint provides information regarding patient outcomes after clinician-initiated or mandated tapers. In a retrospective study of 551 VHA patients with baseline MEDD 76 mg in which the majority (85%) underwent clinician-initiated tapers, pain scores improved by 3.8%.58 A limitation of this study is that it does not include patients who discontinued VA care or continued VA care but received pain management elsewhere.

Similar trends were noted for mean changes in pain-related function following opioid tapers. The most improvement was observed in a group of 1457 patients (baseline MEDD 117 mg) who participated in an intensive outpatient multimodal pain management program at the Cleveland Clinic.36 In this study, the mean score on the pain disability index (PDI) decreased from 42.95 at baseline to 18.29 at discharge (− 57.4%) and was 23.7 after 6–12 months of follow-up (− 44.8%).36 Similarly, in a VHA study of an intensive intervention in which 705 veterans (baseline MEDD 61 mg) voluntarily participated in a 3-week interdisciplinary pain program incorporating opioid cessation, scores on the VA Pain Outcomes Questionnaire-interference in Activities of Daily Living (POQ-ADL) decreased from 16 at baseline to 13 at 3-week discharge (− 18.8%).40 The smallest (and statistically nonsignificant) change came following the least intense intervention, in which an individualized taper was accompanied by a self-help book.55 While it is encouraging that mean pain scores and functional measures improved or did not significantly change for most patients who reduced or discontinued opioids, these types of outcome assessments may be of limited utility as they do not necessarily correlate with meaningful changes from the patient perspective.

We have low confidence in these findings (low quality per GRADE). The body of evidence has several limitations including a high proportion of uncontrolled observational studies (which introduce the potential for unmeasured confounders), unclear fidelity to interventions, and inadequate reporting of missing data and handling of missing data. Despite these limitations, within our subset of studies, findings regarding pain and pain-related function were consistent.

Serious Harms: Substance Use, Opioid Overdose, and Suicide

Evidence regarding the impact of opioid dose reduction and discontinuation on substance use, opioid overdose, and suicide is unclear and highlights the challenges of studying complex linkages among the problems of chronic pain, opioid dependence, opioid use disorder, suicidal ideation, and co-morbid mental health disorders. A 2019 retrospective study of Medicaid claims data in Vermont found that among a cohort of 694 Medicaid recipients who had a high prevalence of substance use disorders (60%) on ≥ 120 mg MEDD, almost half (49%) of 494 patients who discontinued opioids between 2013 and 2017 subsequently had an ED visit or hospitalization due to opioid poisoning or substance use disorder.59 In this study, opioids were most often discontinued without a gradual taper (median length of time to discontinuation was 1 day) and < 1% of patients were prescribed medication to treat substance use disorders. This study does not describe the circumstances regarding opioid discontinuation or exclude the potential for reverse causality (i.e., a diagnosis of substance use disorder was the reason prescription opioids were discontinued) but highlights a real-world pattern of abrupt opioid discontinuation as well as undertreatment of substance use disorders.

We identified 3 observational studies that examined overdose as an outcome of opioid dose reduction.54, 57, 61 Because opioid overdoses are rare events, larger population-level studies are more informative than small studies. The only large study of opioid overdose is a retrospective study of overdose rates following different phases of an opioid risk reduction initiative among patients in Washington’s Group Health practice (intervention group) compared to patients in Group Health’s contracted community clinics (control group).54 Both groups were subject to a change in Washington State’s opioid prescribing guidelines recommending against doses ≥ 120 mg MEDD, but providers in the intervention group also received “feedback and supervisory guidance by medical directors”. The within-group analysis demonstrated a significant decrease in overdose rates (relative annual change 0.83, 95% CI 0.70 to 0.99), but the between-groups analysis did not. Overall, the results of this study provide inconsistent support that reducing opioid doses leads to lower overdose rates.

The other 2 studies of overdose after opioid discontinuation are smaller. In a retrospective study of 572 patients in a primary care clinic on LTOT during 2010–2015, 17 (4.9%) patients who discontinued opioids died of an overdose and 4 (1.75%) patients who continued prescription opioids died of an overdose.61 LTOT discontinuation was associated with a hazard ratio for overdose death of 2.94 (1.01 to 8.61) after adjusting for age and race. In another retrospective study of 43 VHA patients who stopped opioids due to opioid agreement violations, no patients overdosed.57 A limitation of these 3 studies examining overdose is that they were not designed to evaluate causation (i.e., whether opioid overdoses occurred because patients had uncontrolled pain and sought illicit opioids when their prescription doses stopped or whether they had underlying opioid use disorder that was unmasked or worsened with a taper).

The best evidence on the association between opioid dose reduction and suicidal ideation and suicidal self-directed violence is a retrospective study of 509 VHA patients who underwent clinician-initiated tapers due mostly (75%) to aberrant behaviors. In this study, 47 (9.2%) patients had new-onset suicidal ideation and 12 patients (2.4%) had suicidal self-directed violence in the year following opioid discontinuation.56 Baseline PTSD (OR = 2.56, 95% CI 1.23 to 5.32) and psychotic disorders (OR = 3.19, 95% CI 1.14 to 8.89) were associated with suicidal ideation and suicidal self-direction violence, while other co-morbidities including substance use disorder and baseline MEDD were not. An important limitation of this study is that it excluded patients who had no VHA contact or who died in the year following opioid discontinuation, and therefore likely underestimates the actual proportion of patients who experienced suicidal ideation and suicidal self-directed violence.

Retention in Primary Care or Usual Source of Healthcare

The association between opioid dose reduction or discontinuation and retention in primary care or patients’ usual source of healthcare is unclear. The best evidence is a retrospective study of 1,624 patients on LTOT in an academic healthcare system in the Bronx, NY, which found that 78 of 207 patients who tapered opioids (4.8% of the total sample) terminated their care in the year following the taper (defined as no outpatient encounters in the healthcare system).62 In this study, opioid taper was significantly associated with termination of care (AOR 4.3, 95% CI 2.2 to 8.5) compared to continuing opioids.

Evidence on serious harms as well as the other outcomes that we examined in our full report including quality of life, resolution of opioid-related side effects, withdrawal symptoms, and patient satisfaction is unclear (very low quality per GRADE). Findings for these outcomes were supported by only a single or few observational studies with methodological weaknesses including lack of control groups and small sample sizes. Future studies of higher methodologic quality may have different findings for these outcomes.

DISCUSSION

Many clinicians are reevaluating their approach to LTOT for chronic pain in response to the evolving opioid crisis and calls from organizations such as the CDC to limit the use of high-dose opioids. In a pendulum swing from a decade ago, clinical practice norms and quality metrics now favor opioid dose reduction and discontinuation.67 While the intent of opioid dose reduction is to prevent opioid-related harms, the net balance of benefits and harms of tapering opioids among patients who have been prescribed LTOT for chronic pain is unclear. It is encouraging that pain severity and pain-related function may improve with more intensive tapering co-interventions and remain unchanged (i.e., not worsen) with less intensive interventions. Although compared to Frank et al. we have slightly more confidence in the findings for pain severity and pain-related function (low versus very low quality per GRADE) among our focused evidence synthesis of studies with the most relevance to VHA populations and settings, additional evidence is needed to have more confidence in these findings.

Perhaps most importantly, despite our inclusion of 14 new studies published since the 2017 review by Frank et al., we found that evidence regarding patient outcomes following tapers remains unclear for serious harms including substance use, opioid overdose, and suicide. Studies that have evaluated these harms are observational and do not establish causation between opioid tapers and serious harms yet support anecdotal reports that LTOT discontinuation can be associated with adverse events and should be further studied. An important discrepancy between the CDC, VA/DoD, and other guidelines and real-world practice is that opioid discontinuation is often occurring abruptly without shared decision-making as guidelines recommend and without linking patients to additional supports including treatment for opioid use disorder. This discrepancy further adds to the complexity of studying opioid tapering outcomes, as not only do we have low and very-low quality evidence regarding outcomes of LTOT tapers when implemented with shared decision-making and multimodal supports, we also have very-low quality evidence regarding outcomes when opioid discontinuation occurs rapidly and without patient buy-in.

These findings underscore the importance of individualized shared decision-making with patients regarding LTOT tapers and suggest that patients should be offered pain management supports when possible. The recent editorial by authors of the CDC guideline, “No Shortcuts to Safer Opioid Prescribing,” is aptly titled. In the face of inadequate evidence regarding the overall balance of benefits and harms of LTOT tapers, frontline clinicians should take time to engage patients in conversations about lowering opioid doses and this time should be protected by health system leaders and payers. Close monitoring of patients during and after LTOT tapers is warranted given the potential for harms including overdose and suicide, which have not been sufficiently studied. Given observational findings that VHA patients with PTSD and psychotic disorders may be at higher risk of suicidal ideation and suicidal self-directed violence following LTOT tapers, clinicians should approach opioid tapers with caution in these populations.

The evidence base included in this review has several important limitations. Many studies were uncontrolled, and therefore potentially subject to bias due to unmeasured confounders. Most studies were small and conducted in a single center, limiting their power and generalizability to other practice settings. Similarly, several studies were of patients with very high baseline MEDD (> 200 mg). At this stage of the opioid crisis, fewer patients may be prescribed high-dose opioids overall, and therefore results from studies of patients on higher doses may have limited applicability. Other changes in opioid prescribing practices (eg, short-acting vs long-acting or less use of specific opioids such as methadone) may also limit the applicability of studies to current practice. Length of follow-up was also too short (< 1 year in most studies) to evaluate the durability of treatment outcomes. Improved understanding of the impact of taper interventions over time, including longer-term impacts on pain and function and potential harms, as well as the percentage of patients who restart or increase opioids, would help inform clinical decision-making.

In terms of our review methods, limitations include our literature search start date of January 1, 2017 (the end search date of the Frank et al. review) and the possibility that we did not identify relevant studies published before that date, our use of 2nd reviewer checking in lieu of dual independent review, and our scope that focused on studies directly evaluating opioid tapers and not other chronic pain interventions that also may have led to reduced opioid doses. However, considering that our findings are similar to those in the systematic review by Frank et al., it is unlikely that changes in our review processes would have led to important changes in our conclusions.

Future studies of opioid tapering interventions should provide enough context regarding patient chronic pain and LTOT histories and tapering reasons (i.e., patient preference, persistent pain despite opioids, opioid side effects, or concern for misuse) to allow clinicians and other stakeholders to interpret study results and determine whether the results apply to a given patient or patient population. Two distinct patient groups with potentially different risks for LTOT tapering harms should be evaluated—those who voluntarily engage in a tapering plan and those who are tapering due to clinician concerns for LTOT safety and/or opioid misuse. An informative study intervention would include a taper aimed at reducing MEDD below a specified threshold and examine a broad range of outcomes including the proportion of patients with clinically important rebound pain and adverse events such as new or increased substance use, overdose, and suicide for which more evidence is urgently needed.

Electronic supplementary material

ESM 1 (409.3KB, docx)

(DOCX 409 kb)

Acknowledgments

The authors gratefully acknowledge Mark Helfand, MD, MPH, MS, for methodological and clinical input; Joseph Frank, MD, MPH, and Friedhelm Sandbrink, MD, for input on scope; and Payten Sonnen, BA, for editorial support.

Funding

This material is based upon work supported by the Department of Veterans Affairs, Veterans Health Administration, Office of Research and Development, Quality Enhancement Research Initiative (QUERI), Evidence Synthesis Program (ESP).

Compliance with Ethical Standards

Conflict of Interest

The authors declare that they do not have a conflict of interest.

Disclaimer

The views expressed in this article are those of the authors and do not necessarily represent the views of the Department of Veterans Affairs or the US government.

Footnotes

Prior Presentations

This work is based on a full report that is available on the ESP website at https://www.hsrd.research.va.gov/publications/esp/reports.cfm. The report was presented during an HSR&D Cyberseminar on August 27, 2019.

Protocol Registration

PROSPERO; CRD42019129110

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Centers for Disease Control and Prevention. Opioid Overdose: Understanding the Epidemic. https://www.cdc.gov/drugoverdose/epidemic/index.html. Published 2018. Accessed Jun, 2019.
  • 2.Guy G, Zhang K, Bohm M, et al. Vital Signs: Changes in Opioid Prescribing in the United States, 2006-2015. Morbid Mortal Wkly Rep. 2017;66(26):697–704. doi: 10.15585/mmwr.mm6626a4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Oregon Pain Guidance. Tapering - guidance and tools. https://www.oregonpainguidance.org/guideline/tapering/. Published 2018. Accessed Aug, 2019.
  • 4.American Academy of Family Physicians. Tapering Resource. https://www.aafp.org/dam/AAFP/documents/patient_care/pain_management/tapering-resource.pdf. Accessed Aug, 2019.
  • 5.Washington State Agency Medical Directors' Group. Interagency guideline on prescribing opioids for pain. http://www.agencymeddirectors.wa.gov/Files/2015AMDGOpioidGuideline.pdf. Published 2015. Accessed Aug, 2019.
  • 6.Department of Veterans Affairs, Department of Defense. VA/DoD Clinical Practice Guideline for Opioid Therapy for Chronic Pain. https://www.healthquality.va.gov/guidelines/Pain/cot/VADoDOTCPG022717.pdf. Published 2017. Accessed.
  • 7.Bohnert A, Logan J, Ganoczy D, Dowell D. A detailed exploration into the association of prescribed opioid dosage and overdose deathes among patients with chornic pain. Med Care. 2016;54(5):435–441. doi: 10.1097/MLR.0000000000000505. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Frank JW, Lovejoy TI, Becker WC, et al. Patient outcomes in dose reduction or discontinuation of long-term opioid therapy: a systematic review. Ann Intern Med. 2017;167(3):181–191. doi: 10.7326/M17-0598. [DOI] [PubMed] [Google Scholar]
  • 9.Throckmorton D. Statement by Douglas Throckmorton, MD, Deputy Center Director for Regulatory Programs in FDA's Center for Drug Evaluation and Research, on new Opioid Analgesic Labeling Changes. https://www.fda.gov/news-events/press-announcements/statement-douglas-throckmorton-md-deputy-center-director-regulatory-programs-fdas-center-drug-0. Published 2019. Accessed Jul, 2019.
  • 10.Dowell D, Haegerich T, Chou R. No Shortcuts to Safer Opioid Prescribing. N Engl J Med 2019. [DOI] [PMC free article] [PubMed]
  • 11.Mackey K, Anderson J, Bourne D, Chen E, Peterson K. Evidence Brief: Benefits and Harms of Long-term Opioid Dose Reduction or Discontinuation in Patients with Chronic Pain. Washington, DC: Evidence Synthesis Program, Health Services Research and Development Service, Office of Research and Development, Department of Veterans Affairs VA ESP Project #09-199. 2019. https://www.hsrd.research.va.gov/publications/esp/reports.cfm. [PubMed]
  • 12.Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ (Clinical Research Ed) 2009;339:b2535. doi: 10.1136/bmj.b2535. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Methods Guide for Effectiveness and Comparative Effectiveness Reviews. AHRQ Publication No. 10(14)-EHC063-EF. In. Rockville, MD: Agency for Healthcare Research and Quality; January 2014:Chapters available at: www.effectivehealthcare.ahrq.gov. [PubMed]
  • 14.Sterne JA, Hernan MA, Reeves BC, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. Bmj. 2016;355:i4919. doi: 10.1136/bmj.i4919. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Grading of Recommendations Assessment Development and Evaluation. Grade Working Group. https://www.gradeworkinggroup.org/. Published 2019. Accessed Jan, 2020.
  • 16.Blondell RD, Ashrafioun L, Dambra CM, Foschio EM, Zielinski AL, Salcedo DM. A clinical trial comparing tapering doses of buprenorphine with steady doses for chronic pain and co-existent opioid addiction. J Addict Med. 2010;4(3):140–146. doi: 10.1097/ADM.0b013e3181ba895d. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Cowan DT, Wilson-Barnett J, Griffiths P, Vaughan DJ, Gondhia A, Allan LG. A randomized, double-blind, placebo-controlled, cross-over pilot study to assess the effects of long-term opioid drug consumption and subsequent abstinence in chronic noncancer pain patients receiving controlled-release morphine. Pain Med. 2005;6(2):113–121. doi: 10.1111/j.1526-4637.2005.05020.x. [DOI] [PubMed] [Google Scholar]
  • 18.Sullivan MD, Turner JA, DiLodovico C, D'Appollonio A, Stephens K, Chan Y-F. Prescription opioid taper support for outpatients with chronic pain: A randomized controlled trial. J Pain. 2017;18(3):308–318. doi: 10.1016/j.jpain.2016.11.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Webster L, Harper J, Stambler N, Israel R. Analysis of impact of oral methylnaltrexone for opioid-induced constipation (OIC) on opioid analgesia and withdrawal symptoms in patients with chronic noncancer pain (CNCP) taking methadone. Pain Med (United States) 2017;18(3):620. [Google Scholar]
  • 20.Schwarzer A, Aichinger-Hinterhofer M, Maier C, Vollert J, Walther JW. Sleep-disordered breathing decreases after opioid withdrawal: results of a prospective controlled trial. Pain. 2015;156(11):2167–2174. doi: 10.1097/j.pain.0000000000000279. [DOI] [PubMed] [Google Scholar]
  • 21.Baron MJ, McDonald PW. Significant pain reduction in chronic pain patients after detoxification from high-dose opioids. J Opioid Manag. 2006;2(5):277–282. doi: 10.5055/jom.2006.0041. [DOI] [PubMed] [Google Scholar]
  • 22.Berland DW, Malinoff HL, Weiner MA, Przybylski R. When opioids fail in chronic pain management: the role for buprenorphine and hospitalization. Am J Ther. 2013;20(4):316–321. doi: 10.1097/MJT.0b013e31827ab599. [DOI] [PubMed] [Google Scholar]
  • 23.Crisostomo RA, Schmidt JE, Hooten WM, Kerkvliet JL, Townsend CO, Bruce BK. Withdrawal of analgesic medication for chronic low-back pain patients: improvement in outcomes of multidisciplinary rehabilitation regardless of surgical history. Am J Phys Med Rehabil. 2008;87(7):527–536. doi: 10.1097/PHM.0b013e31817c124f. [DOI] [PubMed] [Google Scholar]
  • 24.Cunningham JL, Evans MM, King SM, Gehin JM, Loukianova LL. Opioid tapering in fibromyalgia patients: experience from an interdisciplinary pain rehabilitation program. Pain Med. 2016;17(9):1676–1685. doi: 10.1093/pm/pnv079. [DOI] [PubMed] [Google Scholar]
  • 25.Daitch D, Daitch J, Novinson D, Frey M, Mitnick C, Pergolizzi J., Jr Conversion from high-dose full-opioid agonists to sublingual buprenorphine reduces pain scores and improves quality of life for chronic pain patients. Pain Med. 2014;15(12):2087–2094. doi: 10.1111/pme.12520. [DOI] [PubMed] [Google Scholar]
  • 26.Daitch J, Frey ME, Silver D, Mitnick C, Daitch D, Pergolizzi J., Jr Conversion of chronic pain patients from full-opioid agonists to sublingual buprenorphine. Pain Physician. 2012;15(3 Suppl):Es59-66. [PubMed] [Google Scholar]
  • 27.Darchuk KM, Townsend CO, Rome JD, Bruce BK, Hooten WM. Longitudinal treatment outcomes for geriatric patients with chronic non-cancer pain at an interdisciplinary pain rehabilitation program. Pain Med. 2010;11(9):1352–1364. doi: 10.1111/j.1526-4637.2010.00937.x. [DOI] [PubMed] [Google Scholar]
  • 28.Dersh J, Mayer TG, Gatchel RJ, Polatin PB, Theodore BR, Mayer EA. Prescription opioid dependence is associated with poorer outcomes in disabling spinal disorders. Spine. 2008;33(20):2219–2227. doi: 10.1097/BRS.0b013e31818096d1. [DOI] [PubMed] [Google Scholar]
  • 29.Drossman DA, Morris CB, Edwards H, et al. Diagnosis, characterization, and 3-month outcome after detoxification of 39 patients with narcotic bowel syndrome. Am J Gastroenterol. 2012;107(9):1426–1440. doi: 10.1038/ajg.2012.142. [DOI] [PubMed] [Google Scholar]
  • 30.Harden P, Ahmed S, Ang K, Wiedemer N. Clinical implications of tapering chronic opioids in a veteran population. Pain Med. 2015;16(10):1975–1981. doi: 10.1111/pme.12812. [DOI] [PubMed] [Google Scholar]
  • 31.Heiwe S, Lonnquist I, Kallmen H. Potential risk factors associated with risk for drop-out and relapse during and following withdrawal of opioid prescription medication. Eur J Pain. 2011;15(9):966–970. doi: 10.1016/j.ejpain.2011.03.006. [DOI] [PubMed] [Google Scholar]
  • 32.Hooten WM, Townsend CO, Bruce BK, Warner DO. The effects of smoking status on opioid tapering among patients with chronic pain. Anesth Analg. 2009;108(1):308–315. doi: 10.1213/ane.0b013e31818c7b99. [DOI] [PubMed] [Google Scholar]
  • 33.Hooten WM, Townsend CO, Sletten CD, Bruce BK, Rome JD. Treatment outcomes after multidisciplinary pain rehabilitation with analgesic medication withdrawal for patients with fibromyalgia. Pain Med. 2007;8(1):8–16. doi: 10.1111/j.1526-4637.2007.00253.x. [DOI] [PubMed] [Google Scholar]
  • 34.Hooten WM, Townsend CO, Decker PA. Gender differences among patients with fibromyalgia undergoing multidisciplinary pain rehabilitation. Pain Med. 2007;8(8):624–632. doi: 10.1111/j.1526-4637.2006.00202.x. [DOI] [PubMed] [Google Scholar]
  • 35.Hooten WM, Warner DO. Varenicline for opioid withdrawal in patients with chronic pain: a randomized, single-blinded, placebo controlled pilot trial. Addict Behav. 2015;42:69–72. doi: 10.1016/j.addbeh.2014.11.007. [DOI] [PubMed] [Google Scholar]
  • 36.Huffman KL, Rush TE, Fan Y, et al. Sustained improvements in pain, mood, function and opioid use post interdisciplinary pain rehabilitation in patients weaned from high and low dose chronic opioid therapy. Pain. 2017;158(7):1380–1394. doi: 10.1097/j.pain.0000000000000907. [DOI] [PubMed] [Google Scholar]
  • 37.Kidner CL, Mayer TG, Gatchel RJ. Higher opioid doses predict poorer functional outcome in patients with chronic disabling occupational musculoskeletal disorders. J Bone Joint Surg. 2009;91(4):919–927. doi: 10.2106/JBJS.H.00286. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Krumova EK, Bennemann P, Kindler D, Schwarzer A, Zenz M, Maier C. Low pain intensity after opioid withdrawal as a first step of a comprehensive pain rehabilitation program predicts long-term nonuse of opioids in chronic noncancer pain. Clin J Pain. 2013;29(9):760–769. doi: 10.1097/AJP.0b013e31827c7cf6. [DOI] [PubMed] [Google Scholar]
  • 39.Malinoff HL, Barkin RL, Wilson G. Sublingual buprenorphine is effective in the treatment of chronic pain syndrome. Am J Ther. 2005;12(5):379–384. doi: 10.1097/01.mjt.0000160935.62883.ff. [DOI] [PubMed] [Google Scholar]
  • 40.Murphy JL, Clark ME, Banou E. Opioid cessation and multidimensional outcomes after interdisciplinary chronic pain treatment. Clin J Pain. 2013;29(2):109–117. doi: 10.1097/AJP.0b013e3182579935. [DOI] [PubMed] [Google Scholar]
  • 41.Nilsen HK, Stiles TC, Landro NI, Fors EA, Kaasa S, Borchgrevink PC. Patients with problematic opioid use can be weaned from codeine without pain escalation. Acta Anaesthesiol Scand. 2010;54(5):571–579. doi: 10.1111/j.1399-6576.2009.02164.x. [DOI] [PubMed] [Google Scholar]
  • 42.Rome JD, Townsend CO, Bruce BK, Sletten CD, Luedtke CA, Hodgson JE. Chronic noncancer pain rehabilitation with opioid withdrawal: comparison of treatment outcomes based on opioid use status at admission. Mayo Clin Proc. 2004;79(6):759–768. doi: 10.4065/79.6.759. [DOI] [PubMed] [Google Scholar]
  • 43.Rosenblum A, Cruciani RA, Strain EC, et al. Sublingual buprenorphine/naloxone for chronic pain in at-risk patients: development and pilot test of a clinical protocol. J Opioid Manag. 2012;8(6):369–382. doi: 10.5055/jom.2012.0137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Roux P, Sullivan MA, Cohen J, et al. Buprenorphine/naloxone as a promising therapeutic option for opioid abusing patients with chronic pain: reduction of pain, opioid withdrawal symptoms, and abuse liability of oral oxycodone. Pain. 2013;154(8):1442–1448. doi: 10.1016/j.pain.2013.05.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Taylor CB, Zlutnick SI, Corley MJ, Flora J. The effects of detoxification, relaxation, and brief supportive therapy on chronic pain. Pain. 1980;8(3):319–329. doi: 10.1016/0304-3959(80)90077-9. [DOI] [PubMed] [Google Scholar]
  • 46.Townsend CO, Kerkvliet JL, Bruce BK, et al. A longitudinal study of the efficacy of a comprehensive pain rehabilitation program with opioid withdrawal: comparison of treatment outcomes based on opioid use status at admission. Pain. 2008;140(1):177–189. doi: 10.1016/j.pain.2008.08.005. [DOI] [PubMed] [Google Scholar]
  • 47.Wang H, Akbar M, Weinsheimer N, Gantz S, Schiltenwolf M. Longitudinal observation of changes in pain sensitivity during opioid tapering in patients with chronic low-back pain. Pain Med. 2011;12(12):1720–1726. doi: 10.1111/j.1526-4637.2011.01276.x. [DOI] [PubMed] [Google Scholar]
  • 48.Weimer MB, Hartung DM, Ahmed S, Nicolaidis C. A chronic opioid therapy dose reduction policy in primary care. Subst Abus. 2016;37(1):141–147. doi: 10.1080/08897077.2015.1129526. [DOI] [PubMed] [Google Scholar]
  • 49.Younger J, Barelka P, Carroll I, et al. Reduced cold pain tolerance in chronic pain patients following opioid detoxification. Pain Med. 2008;9(8):1158–1163. doi: 10.1111/j.1526-4637.2008.00475.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Kurita GP, Hojsted J, Sjogren P. Tapering off long-term opioid therapy in chronic non-cancer pain patients: A randomized clinical trial. Eur J Pain. 2018;22(8):1528–1543. doi: 10.1002/ejp.1241. [DOI] [PubMed] [Google Scholar]
  • 51.Bienek N, Maier C, Kaisler M, Michel-Lauter B, Schwarzer A, Meyer-Friesem CH. Intensity of withdrawal symptoms during opioid taper in patients with chronic pain-individualized or fixed starting dosage? Pain Med 2019;26. [DOI] [PubMed]
  • 52.Sharp AL, Shen E, Wu YL, et al. Satisfaction with care after reducing opioids for chronic pain. Am J Manag Care. 2018;24(6):e196–e199. [PubMed] [Google Scholar]
  • 53.Thakral M, Walker RL, Saunders K, et al. Impact of opioid dose reduction and risk mitigation initiatives on chronic opioid therapy patients at higher risk for opioid-related adverse outcomes. Pain Med. 2018;19(12):2450–2458. doi: 10.1093/pm/pnx293. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Von Korff M, Saunders K, Dublin S, et al. Impact of chronic opioid therapy risk reduction initiatives on opioid overdose. J Pain. 2019;20(1):108–117. doi: 10.1016/j.jpain.2018.08.003. [DOI] [PubMed] [Google Scholar]
  • 55.Darnall BD, Ziadni MS, Stieg RL, Mackey IG, Kao MC, Flood P. Patient-centered prescription opioid tapering in community outpatients with chronic pain. JAMA Intern Med. 2018;178(5):707–708. doi: 10.1001/jamainternmed.2017.8709. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Demidenko MI, Dobscha SK, Morasco BJ, Meath TH, Ilgen MA, Lovejoy TI. Suicidal ideation and suicidal self-directed violence following clinician-initiated prescription opioid discontinuation among long-term opioid users. Gen Hosp Psychiatry. 2017;47:29–35. doi: 10.1016/j.genhosppsych.2017.04.011. [DOI] [PubMed] [Google Scholar]
  • 57.Hundley L, Spradley S, Donelenko S. Assessment of outcomes following high-dose opioid tapering in a Veterans Healthcare System. J Opioid Manag. 2018;14(2):89–101. doi: 10.5055/jom.2018.0436. [DOI] [PubMed] [Google Scholar]
  • 58.McPherson S, Lederhos Smith C, Dobscha SK, et al. Changes in pain intensity after discontinuation of long-term opioid therapy for chronic noncancer pain. Pain. 2018;159(10):2097–2104. doi: 10.1097/j.pain.0000000000001315. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Mark T, Parish W. Opioid medication discontinuation and risk of adverse opioid-related health care events. J Subst Abus Treat 2019. [DOI] [PubMed]
  • 60.DiBenedetto DJ, Wawrzyniak KM, Finkelman M, et al. Relationships Between Opioid Dosing, Pain Severity, and Disability in a Community-Based Chronic Pain Population: An Exploratory Retrospective Analysis. Pain Med. 2019;17:17. doi: 10.1093/pm/pny240. [DOI] [PubMed] [Google Scholar]
  • 61.James JR, Scott JM, Klein JW, et al. Mortality After Discontinuation of Primary Care-Based Chronic Opioid Therapy for Pain: a Retrospective Cohort Study. J Gen Intern Med. 2019;34(12):2749–2755. doi: 10.1007/s11606-019-05301-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Perez HR, Buonora M, Cunningham CO, Heo M, Starrels JL. Opioid Taper Is Associated with Subsequent Termination of Care: a Retrospective Cohort Study. J Gen Intern Med. 2019;19:19. doi: 10.1007/s11606-019-05227-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Nicholas MK, Asghari A, Sharpe L, et al. Reducing the use of opioids by patients with chronic pain: an effectiveness study with long-term follow-up. Pain. 2019;19:19. doi: 10.1097/j.pain.0000000000001763. [DOI] [PubMed] [Google Scholar]
  • 64.Wang DY, Salem JE, Cohen JV, et al. Fatal Toxic Effects Associated With Immune Checkpoint Inhibitors: A Systematic Review and Meta-analysis. JAMA Oncol. 2018;4(12):1721–1728. doi: 10.1001/jamaoncol.2018.3923. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Townsend MJ, Kelly L, Ogur B. A group program for chronic pain patients on chronic opioids. J Gen Intern Med. 2018;33(2 Suppl 1):758–759. [Google Scholar]
  • 66.Murphy GSJ. Methadone provides a preventive analgesic effect in patients undergoing cardiac surgery. Anaesth Intensive Care.47(2):6-7.
  • 67.Kertesz SG. Outcomes after opioid dose reductions and stoppage: It's time to start counting. J Subst Abus Treat. 2019;103:64–65. doi: 10.1016/j.jsat.2019.05.010. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

ESM 1 (409.3KB, docx)

(DOCX 409 kb)


Articles from Journal of General Internal Medicine are provided here courtesy of Society of General Internal Medicine

RESOURCES