Skip to main content
PLOS One logoLink to PLOS One
. 2024 Oct 18;19(10):e0300954. doi: 10.1371/journal.pone.0300954

Interventions to reduce opioid use for patients with chronic non-cancer pain in primary care settings: A systematic review and meta-analysis

Qian Cai 1,*, Christos Grigoroglou 2, Thomas Allen 2, Teng-Chou Chen 3, Li-Chia Chen 3, Evangelos Kontopantelis 1,4
Editor: Ethan Moitra5
PMCID: PMC11488744  PMID: 39423192

Abstract

Objective

This systematic review and meta-analysis aimed to assess interventions to reduce opioid use for patients with chronic non-cancer pain (CNCP) versus usual care or active controls in primary care settings.

Methods

In this registered study (PROSPERO: CRD42022338458), we searched MEDLINE, Embase PsycInfo, CINAHL, and Cochrane Library from inception to December 28th 2021, and updated on Dec 14th 2023 for randomized controlled trials (RCTs) and cohort studies with no restrictions. Methodological quality was assessed using the Cochrane Risk of Bias tool for RCTs and Newcastle Ottawa Scale for cohort studies. Primary outcomes included mean reduction in morphine equivalent daily dose (reported as mean differences [MDs] mg/day; 95% confidence intervals [95%CIs]) and/or opioid cessation proportion. Secondary outcomes were mean changes in pain severity (reported as standardized mean difference [SMDs]; 95%CIs) and (serious) adverse events. Meta-analyses were performed using random-effects models.

Results

We identified 3,826 records, of which five RCTs (953 participants) and five cohort studies (901 participants) were included. Overall, opioid dosage was significantly reduced in intervention groups compared to controls (MD: -28.63 mg/day, 95%CI: -39.77 to -17.49; I2 = 31.25%; eight studies). Subgroup analyses revealed significant opioid dose reductions with mindfulness (MD: -29.36 mg/day 95%CI: -40.55 to -18.17; I2 = 0.00%; two trials) and CBT-based multimodalities (MD: -41.68 mg/day; 95%CI: -58.47 to -24.89; I2 = 0.00%; two cohort studies), respectively, compared to usual care. No significant differences were observed in opioid cessation (Odds ratio: 1.10, 95%CI: -0.48 to 2.67, I2 = 58.59%; two trials) or pain severity (SMD: -0.13, 95%CI: -0.37 to 0.11; I2 = 33.51%; three trials). Adverse events were infrequently examined, with withdrawal symptoms commonly reported.

Conclusions

The studied interventions were effective in reducing opioid dosage for people with CNCP in primary care. They highlighted the importance of multidisciplinary collaboration. Large-scale RCTs measuring the long-term effects and cost of these interventions are needed before their implementation.

Introduction

Opioids are primarily recommended by the World Health Organization pain ladder in treating acute pain, cancer pain, and palliative care [1]. During the last two decades, there has been a marked increase in opioid prescriptions issued for chronic non-cancer pain (CNCP), predominantly in the United States (US) [2], Canada [3], and several European countries [46] including the United Kingdom (UK) [7]. Despite the widespread utilization of opioids, findings from randomized controlled trials and systematic reviews suggest limited efficacy of these medications, yielding only modest effects in pain relief in the short to medium term (less than 12 weeks) [8]. While the evidence supporting the long-term use of opioids remains sparse, the associated harms of long-term opioid treatment (LTOT), including respiratory depression, bone fractures, and opioid-related mortality, are well documented [9]. Moreover, prolonged opioid use introduces risks of dependence, addiction, and abuse [10].

In response to these concerns, clinical guidelines [1113] have prompted healthcare providers (HCPs) to reassess their prescribing practices, emphasizing the need to reduce opioid use when potential risks outweigh perceived benefits. However, the endeavor to reduce opioid use encounters significant challenges, including patients’ fear of withdrawal symptoms, inadequate social and healthcare support, and limited availability of non-opioid methods for pain management [14, 15]. Currently, there is a lack of guidance and practical support to implement the reduction of LTOT. Therefore, there is an urgent need for an evidence-based evaluation of interventions to assess their effectiveness in reducing opioid utilization and evaluate their impact on clinical outcomes, particularly in primary care settings, where opioids are mostly prescribed.

Previous systematic reviews [1619] have provided valuable insights into interventions aimed at reducing opioid use for chronic pain patients. However, their inclusion criteria were broad, limiting their relevance to primary care settings. For example, these reviews analyzed interventions (e.g., spinal cord stimulation) that are not readily accessible in primary care settings, and they included studies that evaluated abrupt or gradual opioid tapering protocols without incorporating additional supportive therapies for patients. The provision of supplementary interventions is crucial, as patients often express reluctance to reduce or cease opioids when alternative treatments are not provided, given these medications constitute their primary method of pain management in real-world practices. Furthermore, the absence of additional interventions impedes the identification of the key components contributing to the dose reduction outcomes. Some prior systematic reviews also included potentially relevant studies. However, those studies focused on managing related symptoms, such as withdrawal symptoms [20], opioid overuse headache [21], or improving adherence to antidepressants to increase the likelihood of opioid cessation [22], rather than directly reducing opioid use, despite a decrease in opioid dosage or an improvement in pain severity was achieved. In view of these limitations and the emergence of new studies recently, there is a compelling need for an updated evaluation of the current evidence.

The present systematic review and meta-analysis aimed to evaluate the effectiveness of healthcare provider-directed interventions designed to reduce or discontinue opioid use for patients with CNCP, with a particular focus on primary care settings. Specifically, the objectives included comparing changes in morphine equivalent daily dose (MEDD), evaluating the proportion of patients discontinuing opioids, and assessing the change in pain severity and adverse events between interventions and usual care or active controls.

Methods

This registered systematic review and meta-analysis (PROSPERO: CRD42022338458) was conducted following the Cochrane Handbook [23] and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (S1 Appendix) [24].

Eligibility criteria

Eligible studies were full-scale randomized controlled trials (RCTs) and cohort studies that examined primary care provider-directed interventions, designed to reduce or discontinue opioids in adult patients (≥18 years) with CNCP (persists for ≥3 months). Studies exclusively focused on acute pain, cancer pain, surgical pain or palliative care were excluded. Pregnant or breastfeeding women, non-human participants and patients with substance use disorders (e.g. opioid use disorders) were not our target study population and were thus excluded. Studies that concurrently used opioids with other analgesics (e.g., non-steroidal anti-inflammatory drugs) were excluded, as distinguishing the analgesic effects of opioids from those analgesics were challenging. Interventions implemented in hospital settings or managed by patient themselves were not considered for inclusion. Studies that solely focused on reducing opioids without offering patients alternate treatments or replacements were excluded. Interventions were considered if they explicitly aiming to reduce or cease opioid use, whereas those with a spillover effect on opioid use were excluded. Any comparator was accepted, including usual care or active controls (either pharmacological or non-pharmacological).

The primary outcomes of interest included: 1) opioid dose reduction, measured by the mean changes in morphine milligram equivalent daily dose (MEDD) from pre- to post-treatment. The homogeneity of this outcome measure allowed us to examine our study objectives meta-analytically; 2) The proportion of participants for whom opioid use was either ceased or declined. Secondary outcomes included the mean change in pain severity (measured by pain rating scales on a range of 0–10, where 0 indicating no pain whilst 10 indicating severe pain) and the number of (serious) adverse events related to opioid reduction. Case reports, cross-sectional studies, case-control studies, pilot studies, reviews or meta-analyses were excluded.

Data sources and search strategies

We performed comprehensive searches in databases including MEDLINE, EMBASE, PsycINFO, CINAHL, and Cochrane Central Register of Controlled Trials. Searches were conducted from the inception of each database until December 28th 2021, and updated on December 14th 2023, using structured search strategies (S2 Appendix) that incorporated text words and medical subject headings related to “chronic pain”, “opioids”, and “reduce/discontinue/cease/deprescribe/”. No language and geographic restrictions were applied. Ongoing trials or unpublished studies were obtained from ClinicalTrials.gov. To ensure literature saturation, we manually retrieved additional studies from the reference lists of included studies and published systematic reviews.

Study selection

Two review authors (QC and CG) independently screened titles and abstracts of the retrieved citations against pre-determined inclusion/exclusion criteria. When necessary, full text of eligible records were reviewed for further eligibility assessment. Where discrepancies occurred and remained unresolved by discussion, a third party (EK, TA and LCC) was consulted for adjudication. The inter-rater agreement test demonstrated a high level of consistency (99.64%) between QC and CG with a Kappa coefficient equals to 0.7982 (p<0.001).

Data extraction and quality assessment

Data extraction was undertaken independently by one review author (QC) and verified by another reviewer (TCC) for accuracy. The study authors were also contacted by email to request any necessary missing information. The following key information was extracted:

  • Study: first author, publication year, country, study design, settings.

  • Patient characteristics: age, gender, sample size, pain duration and severity, opioid use status, comorbidities.

  • Intervention and comparator: key components, mode of administration, frequency, treatment duration.

  • Outcome: opioid dose, pain severity, adverse events.

Risk of bias assessment

The methodological quality of all included studies was independently appraised by QC. For RCTs, the Cohrane’s Risk of Bias Tool 2.0 (RoB 2) [25] was employed to assess the risk of bias, including 1. sequence generation; 2. allocation concealment; 3. masking of participants, staff and outcome assessors; 4. incomplete outcome data; and 5. selective outcome reporting. For cohort studies, a modified Newcastle-Ottawa Scale (NOS) [26] was used to evaluate bias risk, focusing on 1. the representativeness of the exposed cohort; 2. selection of the non-exposed cohort; 3. ascertainment of exposure; 4. absence of the outcome of interest at the start of the study; 5. comparable controls; 6. assessment of outcome; 7. sufficient follow-up length for outcomes to occur; and 8. adequacy of follow-up cohorts. For RCTs, high quality was defined as minimum 4 domains of low risk. As for cohort studies, the modified NOS adopted a star rating system. A study was deemed to be of good quality if it obtained ≥3 stars in selection domain (1–4), ≥1 star in comparability domain (5), and ≥2 stars in outcome/exposure domain (6–8).

Data synthesis and analysis

The study characteristics and details of opioid reduction interventions were presented descriptively. Effect sizes were reported using odds ratios (ORs) with their 95% confidence intervals (95%CIs) for opioid cessation, mean differences (MDs) with 95%CIs for opioid dose reduction, and standardized mean differences (SMDs) with 95%CIs for pain severity, given the utilization of different scales for this outcome measure. Magnitude of effect was defined as large (SMD > 0.8), medium (SMD 0.5–0.8), small (SMD 0.2–0.5) or trivial (SMD < 0.2) [27].

Where between- or within-group SDs were not reported, relevant data such as sample size, p values, t statistics, standard errors (SEs), or 95% CIs were used to derive SDs using the formula recommended by the Cochrane Handbook (6.5.2.3) [23] or the calculator embedded in Review Manager 5.4. Additionally, when outcomes were assessed at multiple time points during long-term follow-up, data from the last available time point were employed.

Heterogeneity was assessed using the I2 statistics, with values below 50% suggesting low heterogeneity, 50–75% moderate, above 75% substantial heterogeneity [28]. Random effects meta-analyses with a non-parametric bootstrap of DerSimonian Laird (DL) method were conducted for pooling the outcomes of interest [29, 30] even if I2 was low. Publication bias regarding the primary outcomes was not assessed due to the small number of included studies.

Sensitivity analyses were conducted by sequentially removing one study at a time and repeating the meta-analysis based on the remaining data to assess whether pooled estimates were unduly influenced by specific studies. Furthermore, multivariable random effects meta-regressions were conducted to explore potential sources of heterogeneity, including patient mean age; gender; study period; sample size; follow-up time point; intervention type and category. Subgroup analyses were undertaken based on intervention types, which included mindfulness techniques, and CBT-based multi-component strategies. All data analyses were conducted with Stata/MP 17.0.

Results

Study selection and patient characteristics

The initial search retrieved 3,826 potentially relevant records, of which 1,126 duplicates were removed, yielding 2,770 unique records for eligibility assessment. By screening titles and abstracts against our predefined inclusion/exclusion criteria, 2740 studies were excluded. Of the remaining 30 records, ten full-text articles including five RCTs (953 participants, female 557 [58.4%], mean age: 58.46±2.90) [3135] and five retrospective cohort studies (patients 901, female 188 [20.9%], mean age: 57.38±7.63) [3640] published between 2016 and 2023 were included in this systematic review and meta-analysis (Fig 1). All included studies reported the baseline opioid dosage (intervention group: mean 84.70±51.72 mg/day vs comparators: mean 100.63±64.24 mg/day), with three [34, 37, 39] indicating that participants consumed a mean MEDD of >120 mg/day. None of the studies specified the exact CNCP conditions. Studies were mainly conducted in the US (n = 10), with one in the UK [33]. Both RCTs and retrospective cohort studies had a small sample size ranging between 35 and 608 (Table 1).

Fig 1. Selection of included studies.

Fig 1

Table 1. Characteristics of included studies.

Author, year and country Study design Population interventions Comparators Outcomes of interest assessed Quality
Randomized controlled trials (n = 5)
Sandhu et al. 2023 [33], UK Non-blind, two-arm, RCT CNCP (n = 608) female 362 (60%) Skill-based learning integrating education and mindfulness (n = 305) Usual care (n = 303) • Opioid cessation
• Pain severity
• Adverse events
Good
Wartko et al. 2023 [35], USA Non-blind, two-arm, RCT CNCP (n = 153) female 98 (64%) CBT-based pain coping skills training, education and usual care (n = 79) Usual care (n = 74) • Opioid dose reduction
• Pain severity
• Adverse events
Good
Hudak et al. 2021 [32], USA Non-blind, two-arm, RCT CNCP (n = 62) female 9 (14.5%) The MORE protocol: Mindfulness (n = 34) The supportive care (n = 28) • Opioid dose reduction Good
Garland et al. 2020 [31], USA Non-blind, two-arm, RCT CNCP (n = 95) female 63 (66.3%) The MORE protocol: Mindfulness (n = 50) The supportive care (n = 45) • Opioid dose reduction Fair
Sullivan et al. 2017 [34], USA Non-blind, two-arm, RCT CNCP (n = 35) female 25 (71.4%) CBT-based multimodality & self-care & pain education (n = 18) Standard of care (n = 17) • Opioid dose reduction
• Opioid cessation
• Pain severity
Fair
Cohort studies (n = 5)
Montgomery et al. 2020 [36], USA Retrospective cohort study CNCP (n = 47) female 5 (10.6%) Acupuncture (n = 24) Standard of care (n = 23) • Opioid dose reduction
• Pain severity
Poor
Seal et al. 2019 [37], USA Retrospective cohort study CNCP (n = 294) female 30 (10.2%) Integrated multimodality including CBT, mindfulness, pain education, acupuncture and exercise (n = 147) Standard of care (n = 147) • Opioid dose reduction Good
Oldfield et al. 2018 [38], USA Retrospective cohort study CNCP (n = 105) female 7 (6.7%) Multimodality integrating CBT, exercise, and acupuncture (n = 66) Standard of care (n = 39) • Opioid dose reduction Good
Goodman et al. 2018 [39], USA Retrospective cohort study CNCP (n = 41) female 22 (53.7%) Opioid reduction program & consultation with GPs (n = 27) Usual care (n = 14) • Opioid dose reduction Fair
Mehl-Madrona et al. 2016 [40], USA Retrospective cohort study CNCP (n = 414) female 124 (59.9%) Medical care and physical exercise (n = 207) Standard of care (n = 207) • Opioid dose reduction Good

Note: CNCP = Chronic Non-Cancer Pain, MORE = Mindfulness-Oriented Recovery Enhancement, CBT = Cognitive Behavioral Therapy, GPs = general practitioner

Characteristics of interventions

The components, duration, frequency, and delivery mode of the interventions varied significantly across studies. Two studies focused on physical interventions, incorporating components such as yoga, Taichi, chiropractic therapy [40] and acupuncture [36]; Five studies involved psychological or behavioral changes, integreting key components such as cognitive behavior therapy (CBT), mindfulness techniques, patient education and pain coping skills training [3133, 35, 39]; Three studies [34, 37, 38] employed mixed multimodal approaches delivered by a multidisciplinary team comprising physicians, nurses, psychologists, pharmacists, and social workers. These multimodal care programs typically combined CBT, mindfulness, acupuncture, chiropractic care, exercise, pharmacotherapies are the core components.

The most common comparator was usual care, which unfortunately was not clearly defined in the included studies. Treatment durations ranged from eight weeks to 12 months. Follow-up periods (median 6 months) varied from short (≤3 months) [31, 32] to intermediate (6–9 months) [34, 3640], with three studies reporting long-term outcomes of opioid reduction (≥12 months). (See Table 2 for characteristics of interventions).

Table 2. The components and implementation procedures of each intervention.

Studies Interventions Duration Implemented by
Physical procedure (n = 2)
Montgomery et al. 2020 [36] Battlefield Acupuncture: 5-point auricular acupuncture procedure implemented 9 months Physicians
Mehl-Madrona et al. 2016 [40] Twice monthly GMV (12 sessions) & weekly physical activity (yoga, exercise class, chiropractic therapy, osteopathic treatment, tai chi, or qigong) 6 months Family doctor, nurse, and behavioral health specialist
Psychological or behavioral intervention (n = 5)
Sandhu et al. 2023 [33] Weekly skill-based learning and education including mindfulness, relaxation, opioid education, consultation and followed by an opioid taper (weekly 10% reduction) 12 months Nurse
Wartko et al. 2023 [35] CBT-based pain coping skill training: 18 sessions (30 min for each on average), mainly including pain education, goal setting, relaxation skills and motivational interviews, conducted over one year. 12 months Primary care provider, nurse, physician assistant
Hudak et al. 2021 [32] The MORE protocol: 2-hour weekly training sessions in mindfulness, reappraisal and savoring pleasant events & a 15-min CD-guided mindfulness practice at home and 3-minute breathing before taking opioids 4 months Clinical social workers
Garland et al. 2020 [31] The MORE protocol: 2-hour weekly training sessions in mindfulness, reappraisal and savoring pleasant events & a 15-min CD-guided mindfulness practice at home and 3-minute breathing before taking opioids 3 months Clinical social workers
Goodman et al. 2018 [39] Family physician-patient’s discussion of pain management guidelines and practice followed by an opioid tapering program (weekly 10% reduction to 25%-50% reduction every few days) 6 months Family physician
Multimodalities (n = 3)
Sullivan et al. 2017 [34] A weekly 10% reduction of the initial dose until 30% was reached. Then, a 10% was recalculated based on this dose and then proceeded by 10% of this new dose per week.) & 17 weekly 30-min consultations, CBT-modelled pain self-management, education & a book/CD-guided home practice 8.5 months Pain medicine/psychiatry physicians, psychologists and physician assistants
Oldfield et al. 2018 [38] Multidisciplinary ORC program including pharmacotherapy, CBT and other modalities (e.g., acupuncture, chiropractic, and yoga) 6 months Physicians, pain specialists, pain psychologists and chemical dependency counsellors
Seal et al. 2019 [37] Integrated Pain Team: an initial 60-min’s biopsychosocial model of pain management (including CBT, mindfulness, acupuncture, chiropractic care, and exercise) & a 30-min follow-up visits 6 months Medical provider, psychologist, and pharmacist

Note: MORE = Mindfulness-Oriented Recovery Enhancement, CBT = Cognitive Behavioral Therapy, ORC = Opioid Reassessment Clinic, GMV = Group Medical Visits

Risk of bias assessment

The Cochrane RoB-2 assessment indicated an overall risk of bias being low (n = 3) to moderate (n = 2) (Fig 2). Due to the impossibility of masking the interventions, participants and researchers were unblinded, which increased risk. The high dropout rate during follow-ups was another main reason contributing to the increased risk of bias. The NOS evaluation tool identified three cohort studies [37, 38, 40] with good quality, one [39] with fair and one [36] with poor quality (Table 3). Uncontrolled confounders and limited representativeness of the study population were the main reasons that reduced the quality of these studies.

Fig 2. Risk of Bias of included RCTs.

Fig 2

Table 3. Quality assessment outcomes of cohort studies.

Author and year Three domains of the Newcastle-Ottawa Scale Quality
Selection of participants Comparability of study groups Outcomes
Montgomery et al. 2020 [36] ★★★ Poor
Seal et al. 2019 [37] ★★★★ ★★ ★★★ Good
Oldfield et al. 2018 [38] ★★★ ★★ ★★★ Good
Goodman et al. 2018 [39] ★★★ ★★ Fair
Mehl-Madrona et al. 2016 [40] ★★★ ★★ ★★★ Good

Opioid dose reduction

Nine studies including four RCTs [31, 32, 34, 35] and five cohort studies [3640] reported the outcomes of opioid dose reduction. Opioid dosage was significantly decreased in the intervention groups compared to controls (MD: -34.82 mg/day, 95%CI: -52.24 to -17.39; nine studies; Fig 3). However, considerable heterogeneity was noted (I2 = 83.28%, 95%CI: 57.5% to 93.4%, p = 0.00; Fig 3). A sensitivity analysis was conducted to investigate the source of heterogeneity and the Mehl-Madrone et al. (2016)’s study [40] was identified as an outlier (Fig 4). Upon its removal, the heterogeneity decreased from high (I2 = 83.28%) to low (I2 = 31.25%), but the significance or direction of the pooled effects in our meta-analyses remained unchanged (MD: -28.63 mg; 95%CI: -39.77 to -17.49; eight studies; Fig 5). Additionally, a multivariable meta-regression analysis was conducted, revealing that heterogeneity could be partially explained by differences in the longest follow-up time across studies (p = 0.014).

Fig 3. Forest plot of interventions vs controls in opioid dose reduction in nine studies.

Fig 3

Fig 4. Sensitivity analysis of included studies.

Fig 4

Fig 5. Forest plot of interventions vs controls in opioid dose reduction in eight studies.

Fig 5

Within the four RCTs [31, 32, 34, 35] provided data that enabled the pooled calculation of change for opioid reduction among 181 participants receiving different interventions compared to 162 receiving usual care (MD: -24.40 mg; 95%CI: -36.32 to -12.47; I2 = 9.21%; Fig 6), a subgroup meta-analysis of two trials [31, 32] using the MORE protocol (mindfulness) found a significant reduction in opioid dosage in 84 patients receiving this intervention, compared to 77 having supportive care (MD: -29.36 mg; 95%CI: -40.55 to -18.17; I2 = 0.00%; Fig 6). Similar decreases in opioid dose were reported by Wartko et al. (2023) [35] and Sullivan et al. (2017) [34] using CBT-based multi-component interventions. However, no between-group statistical significance was attained (MD: -10.10 mg; 95%CI: -33.61 to 13.40; I2 = 0.00%; Fig 6).

Fig 6. Forest plot of interventions vs controls in opioid dose reduction in four RCTs.

Fig 6

Within the four cohort studies [3639], where various interventions were implemented, a significant decrease in the use of opioid medications was observed in the intervention groups (MD: -37.07 mg; 95%CI: -57.01 to -17.12; I2 = 47.58%; Fig 7). Subgroup analysis of Oldfield et al. (2018) and Seal et al. (2021) [37] using CBT-based interventions showed a significant reduction in opioid dose, compared to those in the control group. (MD: -41.68 mg; 95%CI: -58.47 to -24.89; I2 = 0.00%; Fig 7).

Fig 7. Forest plot of interventions vs controls in opioid reduction in four cohort studies.

Fig 7

Opioid cessation

No significant differences were observed in opioid cessation (Odds ratio: 1.52, 95%CI: 0.95 to 2.10; I2 = 0.00%; two trials; Fig 8) between intervention groups and controls. In the two RCTs [33, 34], although the interventions had slight variations, both studies implemented a weekly 10% dose reduction protocol combined with education and consultation as core components of the interventions. In the Sandhu et al. (2023) study [33], it was reported that patients undergoing skill-based learning and education had a significantly higher cessation rate than those receiving usual care (Odds radio [OR]: 5.55; 95% CI 2.80 to 10.99). However, our pooled meta-analysis showed no statistically significant change in opioid discontinuation (OR: 1.10; 95%CI -0.48 to 2.67; Fig 8). Moderate heterogeneity (I2 = 58.59%, 95% CI 0% to 86.2%) was observed, primarily attributed to the small sample size of the Sullivan et al. (2017) study [34].

Fig 8. Forest plot of interventions vs controls in opioid cessation.

Fig 8

Pain severity

Pain severity changes at different observation time points were reported in three trials [3335], all utilizing interventions grounded in behavior change and patient education. Due to the variations in pain severity measurements across studies, standard mean differences were used for pooling the estimates. While a decrease in pain severity was observed in all three trials, the between-group difference was small and non-significant (SMD -0.13; 95% CI -0.37 to 0.11, I2 = 33.51%; Fig 9). It is also worth noting that this 0.13-point reduction in pain score might not have meaningful clinical implications.

Fig 9. Forest plot of interventions vs controls in pain severity improvement.

Fig 9

One cohort study [36] reported the outcome of pain severity improvement. Acupuncture, as employed in the study, exhibited an immediate effect in alleviating pain (a reduction in pain intensity score of MD 1.3 on a scale of 0–10, p<0.01). However, there were no significant differences after 9 months (p = 0.15), indicating acupuncture’s short-term effects.

Adverse events

Adverse events (AEs) were infrequently examined in included studies, with the majority of reported AEs being associated with psychological and nervous system effects. In Wartko et al. (2023)’s study [35], which involved 79 participants receiving CBT-based pain coping skills training plus usual care, six cases of increased pain, one case of withdrawal symptoms, and one case of anxiety were noted. No serious adverse events (SAEs) were documented in this study. In Sandhu et al. (2023) [33], adverse events such as sleep disturbance, suicidal ideation, headache, withdrawal symptoms were reported by 22 of 305 participants (7%) and 8 of 303 participants (3%), in the intervention and usual care groups, respectively. SAEs occurred in 8% (25/305) of the participants in the intervention group and 5% (16/303) in the usual care group, with the most common SAEs being gastrointestinal disorder, metastatic cancer, hospitalization due to increased pain, and unknown cause of death.

Discussion

Summary of main findings

In this systematic review and meta-analysis, we examined ten studies (five RCTs and five cohort studies) assessing the effectiveness of opioid reduction interventions for patients with CNCP in primary healthcare settings. Despite methodological differences, both RCTs and observational studies yielded statistically similar results, allowing for the pooling of results across the full range of eligible studies. Overall, intervention groups exhibited significant reductions in opioid dosage compared to usual care. Subgroup analyses revealed both mindfulness and CBT-based multimodalities were superior to usual care. No significant differences were observed in opioid cessation or pain severity. Adverse events were infrequently examined, with withdrawal symptoms commonly reported. Medium heterogeneity was observed across all studies for each outcome, likely stemming from variability in interventions, follow-up durations, and healthcare providers involved. Nevertheless, the I2 values for subgroup analyses were low.

Comparison with existing literature

Our study’s conclusions generally aligns with previous systematic reviews [1619] which indicated that due to insufficient evidence strength and small sample sizes, recommending specific opioid reduction interventions is not feasible. However, our study extends these reviews by providing an updated and comprehensive assessment of the literature, adding one recent good-quality RCT. Supported by subgroup meta-analyses, we elucidated the effectiveness of mindfulness in reducing LTOT. Meanwhile, we highlighted key components such as CBT, patient education, mindfulness, exercise, which may contribute to the successful opioid reduction and thus merit consideration for future intervention development. Importantly, our study exclusively targeted primary care settings, distinguishing it from others that included secondary and tertiary care settings. Although de Kleijn et al. (2021) [17] solely focused on primary care settings, their results were narratively synthesized, and they included studies using simple opioid tapering protocols or interventions targeted at physicians.

Clinical guidelines [11, 12, 41] recommend an initial reduction of opioid dosage by 10% per week, with adjustments to a more tolerable 10% dose reduction per month for high-dose users (> MEDD 120 mg/day) or those on LTOT. In our study, we observed a pooled mean opioid reduction of 28.63 mg/day from a baseline of 84.7 mg/day over a median follow-up period of six months. According to these guidelines, the dosage should have been reduced to 45.01 mg/day over six months. Thus, our observed reduction to 28.63 mg/day appears somewhat aggressive. Despite exceeding the guideline-recommended reduction rate, it did yield a clinically meaningful decrease in opioid dosage without worsening pain severity. It is important to acknowledge that adherence to guideline recommendations does not necessarily guarantee optimal patient outcomes, as individual responses to opioid reduction strategies may vary. In fact, the primary goal of CNCP management is to maintain body function rather than achieve complete pain eradiation [42, 43]. Therefore, efforts should prioritize reducing opioids to minimize potential harms associated with LTOT. Meanwhile, although there was infrequent documentation of the adverse events in the original studies, we did analyze their occurrences (e.g., withdrawal symptoms, increased pain severity, suicides or all-cause mortality). Our findings align with existing evidence [44, 45], suggesting that opioid reduction may lead to these adverse outcomes. Therefore, close monitoring of patient responses to opioid reduction strategies is essential for optimizing treatment outcomes, while mitigating adverse effects.

Our findings highlighted the effectiveness of the MORE protocol, with mindfulness as its core component, in reducing opioid dose for CNCP patients in the short term (3 months). Additionally, meta-analytic results indicated a significant and strong association between mindfulness and pain reduction [46]. In another study [47] conducted by the same author using the MORE protocol, participants reported significantly greater improvements in psychological and physical function outcomes (e.g., general activity, mood, walking ability, normal work, relationships, sleep, and enjoyment of life.) compared to the support group during the three-month follow-up period. In view of this evidence, mindfulness could be considered a potential component in the development of opioid reduction strategies. However, before recommending widespread implementation of this intervention, further validation through replication in a second trial with a longer observation period (≥12 months) within primary care settings is necessary.

Contrary to expectations, CBT-based interventions did not show a significant reduction in opioid dosage in RCTs [34, 35]. This finding aligns with recent evidence from a recent cluster RCT, indicating that although CBT significantly reduced pain severity, it did not result in significant differences in opioid use between groups [43]. The reason for this non-significant result may be twofold. First, the small sample size and variations in interventions across studies may have contributed to the lack of statistical significance. Second, the study conducted by Sullivan et al. (2017) [34] involved high-dose users (207±245 mg/day), suggesting that behavior changes might not be superior to usual care in reducing opioids dosage for this population. However, the pain relief achieved through CBT may contribute to a subsequent decrease in opioid utilization, although this effect may take time to manifest. Two observational studies [37, 38] employing similar CBT-based interventions reported significant reductions in opioid dosage compared to usual care. This inconsistency with findings from RCTs may be attributed to the variations in interventions. Additionally, observational studies may yield more promising results due to unadjusted confounders. Further investigation with long-term follow-up and larger sample sizes is warranted to elucidate the effects of CBT on opioid reduction.

Current clinical guidelines from the UK NICE (National Institute for Health and Care Excellence) [13, 48] and NHS Oxford Hospital [12] advocate for a holistic approach beyond pharmacotherapy alone. Our research findings align with these recommendations, revealing that a combination of cognitive change strategies, acupuncture, exercise, patient education and pharmacotherapies, delivered by a multidisciplinary team were more effective in opioid reduction. Central to this success is the practice of shared decision making between patient and healthcare professionals. The collaboration among diverse healthcare professionals (GPs, nurses, therapists, pharmacists, etc) is crucial, as each contributes unique expertise and insights to the table. Nevertheless, challenges remain in accessing to multimodal cares, particularly for individuals unable to take time off work, those residing in regions with limited services, and individuals from culturally and linguistically diverse communities. Addressing these access barriers is essential to ensuring equitable healthcare delivery.

Strengths and limitations

To our knowledge, this is the first and most up-to-date systematic review and meta-analysis, to evaluate the effectiveness of interventions on opioid dose reduction and pain outcomes for patients with CNCP, with a particular emphasis on primary healthcare settings. By conducting a comprehensive literature search and including recently conducted studies in the UK, this research holds informative value for the potential implementation of interventions outside the US primary care settings. Moreover, several key subgroup analyses were conducted to identify which intervention (components) are effective in achieving opioid reduction purpose.

Our study also had several limitations. First, the relatively small number of included participants, short follow-up periods, and lack of blinding to interventions may have introduced biases and impacted the overall quality of the included studies. Second, data in observational studies were sourced from secondary databases or electronic medical records, which could cause information bias. Third, funnel plots and the Egger’s test were not performed due to the small number of studies included in the meta-analyses Fourth, the majority of the studies were conducted on white populations in the US, likely influenced by the opioid crisis in that country, thus limited the generalizability of our research findings to other ethnicities and regions. Fifth, the oversight of unprescribed use of opioids may overestimate the effectiveness of opioid reduction strategies, as patients might still be obtaining opioids from unauthorized sources. Conversely, it might also underestimate their effectiveness, since total opioid consumption could be higher than reported. Lastly, data was insufficient to support meta-analyses of quality of life or function.

Conclusion

Prior studies have not identified superior opioid reduction interventions for patients with CNCP in primary care. Our study highlighted those multidisciplinary strategies, incorporating CBT, pain education, mindfulness, exercise and acupuncture, which have shown promise in reducing opioids and improving pain outcomes for this population. Nevertheless, robust evidence is limited due to sub-optimally designed studies, short follow-up periods, and a lack of QoL-related outcomes. Future research should focus on identifying the effective components of these interventions and identifying which CNCP sub-populations benefit most. Additionally, it is essential to assess the cost-effectiveness and patient acceptability of these strategies, before their implementation in primary care contexts.

Supporting information

S1 Appendix. Search strategies on the five medical databases.

(DOCX)

pone.0300954.s001.docx (58.2KB, docx)
S2 Appendix. PRISMA 2009 checklist.

(DOC)

pone.0300954.s002.doc (64KB, doc)

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.Anekar AA, Cascella M. WHO analgesic ladder. 2020. [PubMed] [Google Scholar]
  • 2.Boudreau D, Von Korff M, Rutter CM, Saunders K, Ray GT, Sullivan MD, et al. Trends in long‐term opioid therapy for chronic non‐cancer pain. Pharmacoepidemiology and drug safety. 2009;18(12):1166–75. doi: 10.1002/pds.1833 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Smolina K, Gladstone EJ, Rutherford K, Morgan SG. Patterns and trends in long-term opioid use for non-cancer pain in British Columbia, 2005–2012. Canadian Journal of Public Health. 2016;107:e404–e9. doi: 10.17269/cjph.107.5413 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Werber A, Marschall U, Lhoest H, Hauser W, Moradi B, Schiltenwolf M. Opioid therapy in the treatment of chronic pain conditions in Germany. Pain Physician. 2015;18(3):E323. [PubMed] [Google Scholar]
  • 5.Kalkman G, Kramers C, van Dongen R, Schers H, van Boekel R, Bos J, et al. Practice variation in opioid prescribing for non-cancer pain in Dutch primary care: A retrospective database study. Plos one. 2023;18(2):e0282222. doi: 10.1371/journal.pone.0282222 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Hansen CA, Ernst MT, Smith CD, Abrahamsen B. Epidemiological Factors Associated with Prescription of Opioids for Chronic Non-Cancer Pain in Adults: A Country-Wide, Registry-Based Study in Denmark Spans 2004–2018. Journal of Pain Research. 2023:463–85. doi: 10.2147/JPR.S388674 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Jani M, Yimer BB, Sheppard T, Lunt M, Dixon WG. Time trends and prescribing patterns of opioid drugs in UK primary care patients with non-cancer pain: a retrospective cohort study. PLoS Medicine. 2020;17(10):e1003270. doi: 10.1371/journal.pmed.1003270 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Busse JW, Wang L, Kamaleldin M, Craigie S, Riva JJ, Montoya L, et al. Opioids for chronic noncancer pain: a systematic review and meta-analysis. Jama. 2018;320(23):2448–60. doi: 10.1001/jama.2018.18472 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Gomes T, Tadrous M, Mamdani MM, Paterson JM, Juurlink DN. The burden of opioid-related mortality in the United States. JAMA network open. 2018;1(2):e180217-e. doi: 10.1001/jamanetworkopen.2018.0217 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Edlund MJ, Martin BC, Fan M-Y, Devries A, Braden JB, Sullivan MD. Risks for opioid abuse and dependence among recipients of chronic opioid therapy: results from the TROUP study. Drug and alcohol dependence. 2010;112(1–2):90–8. doi: 10.1016/j.drugalcdep.2010.05.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Dowell D, Haegerich TM, Chou R. CDC guideline for prescribing opioids for chronic pain—United States, 2016. Jama. 2016;315(15):1624–45. doi: 10.1001/jama.2016.1464 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.NHS (National Health Service) Oxford University Hospital. Guidance for opioid reduction in primary care. Available from: https://www.ouh.nhs.uk/services/referrals/pain/documents/gp-guidance-opioid-reduction.pdf
  • 13.NICE (National Institute for Health and Care Excellence). Chronic Pain, management. 2021. Available from: https://cks.nice.org.uk/topics/chronic-pain/management/management/.
  • 14.Cross AJ, Buchbinder R, Mathieson S, Bourne A, Maher CG, Lin C-WC, et al. Barriers and enablers to monitoring and deprescribing opioid analgesics for chronic non-cancer pain: a systematic review with qualitative evidence synthesis using the Theoretical Domains Framework. BMJ Quality & Safety. 2022;31(5):387–400. [DOI] [PubMed] [Google Scholar]
  • 15.Frank JW, Levy C, Matlock DD, Calcaterra SL, Mueller SR, Koester S, et al. Patients’ perspectives on tapering of chronic opioid therapy: a qualitative study. Pain medicine. 2016;17(10):1838–47. doi: 10.1093/pm/pnw078 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Avery N, McNeilage AG, Stanaway F, Ashton-James CE, Blyth FM, Martin R, et al. Efficacy of interventions to reduce long term opioid treatment for chronic non-cancer pain: systematic review and meta-analysis. Bmj. 2022;377. doi: 10.1136/bmj-2021-066375 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.de Kleijn L, Pedersen J, Rijkels-Otters H, Chiarotto A, Koes B. Opioid reduction for patients with chronic pain in primary care: systematic review. British Journal of General Practice. 2022. doi: 10.3399/BJGP.2021.0537 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Frank JW, Lovejoy TI, Becker WC, Morasco BJ, Koenig CJ, Hoffecker L, et al. Patient outcomes in dose reduction or discontinuation of long-term opioid therapy: a systematic review. Annals of internal medicine. 2017;167(3):181–91. doi: 10.7326/M17-0598 [DOI] [PubMed] [Google Scholar]
  • 19.Mathieson S, Maher CG, Ferreira GE, Hamilton M, Jansen J, McLachlan AJ, et al. Deprescribing opioids in chronic non-cancer pain: systematic review of randomised trials. Drugs. 2020;80(15):1563–76. doi: 10.1007/s40265-020-01368-y [DOI] [PubMed] [Google Scholar]
  • 20.Hooten WM, Warner DO. Varenicline for opioid withdrawal in patients with chronic pain: a randomized, single-blinded, placebo controlled pilot trial. Addictive Behaviors. 2015;42:69–72. doi: 10.1016/j.addbeh.2014.11.007 [DOI] [PubMed] [Google Scholar]
  • 21.Johnson JL, Kwok YH, Sumracki NM, Swift JE, Hutchinson MR, Johnson K, et al. Glial attenuation with ibudilast in the treatment of medication overuse headache: a double‐blind, randomized, placebo‐controlled pilot trial of efficacy and safety. Headache: The Journal of Head and Face Pain. 2015;55(9):1192–208. [DOI] [PubMed] [Google Scholar]
  • 22.Scherrer JF, Salas J, Sullivan MD, Ahmedani BK, Copeland LA, Bucholz KK, et al. Impact of adherence to antidepressants on long-term prescription opioid use cessation. The British Journal of Psychiatry. 2018;212(2):103–11. doi: 10.1192/bjp.2017.25 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al. (editors). Cochrane Handbook for Systematic Reviews of Interventions version 6.3 (updated February 2022). Cochrane, 2022. Available from www.training.cochrane.org/handbook. [Google Scholar]
  • 24.Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. International Journal of Surgery. 2021;88:105906. doi: 10.1016/j.ijsu.2021.105906 [DOI] [PubMed] [Google Scholar]
  • 25.Sterne JA, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. bmj. 2019;366. doi: 10.1136/bmj.l4898 [DOI] [PubMed] [Google Scholar]
  • 26.Wells GA, Shea B, O’Connell D, Peterson J, Welch V, Losos M, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. Oxford; 2000. [Google Scholar]
  • 27.Borenstein M, Hedges LV, Higgins JP, Rothstein HR. A basic introduction to fixed‐effect and random‐effects models for meta‐analysis. Research synthesis methods. 2010;1(2):97–111. doi: 10.1002/jrsm.12 [DOI] [PubMed] [Google Scholar]
  • 28.Higgins JP, Green S. Cochrane handbook for systematic reviews of interventions. 2008. [Google Scholar]
  • 29.Kontopantelis E, Springate DA, Reeves D. A re-analysis of the Cochrane Library data: the dangers of unobserved heterogeneity in meta-analyses. PloS one. 2013;8(7):e69930. doi: 10.1371/journal.pone.0069930 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Petropoulou M, Mavridis D. A comparison of 20 heterogeneity variance estimators in statistical synthesis of results from studies: a simulation study. Statistics in medicine. 2017;36(27):4266–80. doi: 10.1002/sim.7431 [DOI] [PubMed] [Google Scholar]
  • 31.Garland EL, Hudak J, Hanley AW, Nakamura Y. Mindfulness-oriented recovery enhancement reduces opioid dose in primary care by strengthening autonomic regulation during meditation. American Psychologist. 2020;75(6):840. doi: 10.1037/amp0000638 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Hudak J, Hanley AW, Marchand WR, Nakamura Y, Yabko B, Garland EL. Endogenous theta stimulation during meditation predicts reduced opioid dosing following treatment with Mindfulness-Oriented Recovery Enhancement. Neuropsychopharmacology. 2021;46(4):836–43. doi: 10.1038/s41386-020-00831-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Sandhu HK, Booth K, Furlan AD, Shaw J, Carnes D, Taylor SJ, et al. Reducing opioid use for chronic pain with a group-based intervention: a randomized clinical trial. JAMA. 2023;329(20):1745–56. doi: 10.1001/jama.2023.6454 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Sullivan MD, Turner JA, DiLodovico C, D’Appollonio A, Stephens K, Chan Y-F. Prescription opioid taper support for outpatients with chronic pain: a randomized controlled trial. The journal of pain. 2017;18(3):308–18. doi: 10.1016/j.jpain.2016.11.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Wartko PD, Krakauer C, Turner JA, Cook AJ, Boudreau DM, Sullivan MD. STRategies to Improve Pain and Enjoy life (STRIPE): results of a pragmatic randomized trial of pain coping skills training and opioid medication taper guidance for patients on long-term opioid therapy. Pain. 2023. doi: 10.1097/j.pain.0000000000002982 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Montgomery AD, Ottenbacher R. Battlefield acupuncture for chronic pain management in patients on long-term opioid therapy. Medical Acupuncture. 2020;32(1):38–44. doi: 10.1089/acu.2019.1382 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Seal KH, Rife T, Li Y, Gibson C, Tighe J. Opioid reduction and risk mitigation in VA primary care: Outcomes from the integrated pain team initiative. Journal of general internal medicine. 2020;35:1238–44. doi: 10.1007/s11606-019-05572-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Oldfield BJ, Edens EL, Agnoli A, Bone CW, Cervone DJ, Edmond SN, et al. Multimodal treatment options, including rotating to buprenorphine, within a multidisciplinary pain clinic for patients on risky opioid regimens: A quality improvement study. Pain Medicine. 2018;19(suppl_1):S38–S45. doi: 10.1093/pm/pny086 [DOI] [PubMed] [Google Scholar]
  • 39.Goodman MW, Guck TP, Teply RM. Dialing back opioids for chronic pain one conversation at a time. J Fam Pract. 2018;67(12):753–7. [PubMed] [Google Scholar]
  • 40.Mehl-Madrona L, Mainguy B, Plummer J. Integration of complementary and alternative medicine therapies into primary-care pain management for opiate reduction in a rural setting. The Journal of Alternative and Complementary Medicine. 2016;22(8):621–6. doi: 10.1089/acm.2015.0212 [DOI] [PubMed] [Google Scholar]
  • 41.Chou R, Mariano ER, Dopp AL, Sullenger R, Burstin H, Guidelines PM, et al. Best practices, research gaps, and future priorities to support tapering patients on long-term opioid therapy for chronic non-cancer pain in outpatient settings. NAM perspectives. 2020;2020. doi: 10.31478/202008c [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Ashburn MA, Staats PS. Management of chronic pain. The lancet. 1999;353(9167):1865–9. doi: 10.1016/S0140-6736(99)04088-X [DOI] [PubMed] [Google Scholar]
  • 43.Roditi D, Robinson ME. The role of psychological interventions in the management of patients with chronic pain. Psychology research and behavior management. 2011:41–9. doi: 10.2147/PRBM.S15375 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Hallvik SE, El Ibrahimi S, Johnston K, Geddes J, Leichtling G, Korthuis PT, et al. Patient outcomes after opioid dose reduction among patients with chronic opioid therapy. Pain. 2022;163(1):83–90. doi: 10.1097/j.pain.0000000000002298 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Metz VE, Ray GT, Palzes V, Binswanger I, Altschuler A, Karmali RN, et al. Prescription opioid dose reductions and potential adverse events: a multi-site observational cohort study in diverse US health systems. Journal of general internal medicine. 2023:1–8. doi: 10.1007/s11606-023-08459-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Garland EL, Brintz CE, Hanley AW, Roseen EJ, Atchley RM, Gaylord SA, et al. Mind-body therapies for opioid-treated pain: A systematic review and meta-analysis. JAMA internal medicine. 2020;180(1):91–105. doi: 10.1001/jamainternmed.2019.4917 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Garland EL, Thomas E, Howard MO. Mindfulness-oriented recovery enhancement ameliorates the impact of pain on self-reported psychological and physical function among opioid-using chronic pain patients. Journal of pain and symptom management. 2014;48(6):1091–9. doi: 10.1016/j.jpainsymman.2014.03.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.NICE (National Institute for Health and Care Excellence). Analgesics. 2022. Available from: https://bnf.nice.org.uk/treatment-summaries/analgesics/.

Decision Letter 0

Ethan Moitra

12 Jun 2024

PONE-D-24-09355Interventions to reduce opioid use for patients with chronic non-cancer pain in primary care settings: a systematic review and meta-analysisPLOS ONE

Dear Dr. Cai,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

As you know based on our communication, we did have trouble securing reviewers for this manuscript. Fortunately, we secured one thoughtful and highly skilled reviewer who provided detailed feedback. I encourage you to address all of their comments as I believe they will lead to a much improved manuscript. If you choose to revise and resubmit, we will try to obtain additional feedback from other peers.

Please submit your revised manuscript by Jul 27 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Ethan Moitra

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. 

3. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for the chance to review this article, which I think accurately represents the limited but promising data around behavioral interventions which may have benefits for patients with CNCP. The following suggestions may help strengthen this paper further:

Introduction:

Lines 96-99:This is particularly common for studies using pharmacological substitution, where the primary aim was to address opioid withdrawal symptoms rather than reducing opioid dosage, despite achieving a decrease in opioid dosage or an improvement in pain severity

Add supporting citations. I found this surprising given my own awareness of the literature, which does not tend to focus on opioid withdrawal to the exclusion of dose reduction.

Results:

Lines 231-233: Rather than say "most" studies did not report type of CNCP, mention exact numbers, and the exception. Verify this is correct- as many studies do breakdown neuropathic pain vs msk pain, etc.

Were patients with substance use disorders, e.g. opioid use disorders, excluded? Was unprescribed use of opioids examined in some way? Include these in limitations later on as appropriate.

Table 1: Consider including what type of CNCP was investigated, if applicable.

Please justify inclusion of the study of medical cannabis if other potential analgesics were excluded in favor of behavioral interventions? The impact of cannabis on pain is a complex topic that seems beyond the scope of this study. I would consider excluding this study from analysis entirely, given that it is the only one involving cannabis, and also has a small sample size.

Was "usual care" defined in these studies, and if so, how?

Some interpretation is included in the Results section which might be more appropriate for the Discussion, e.g.:

Lines 284-85: Furthermore, a multivariable meta-regression analysis was conducted, revealing that heterogeneity could be partially explained by differences in the longest follow-up time across studies (p=0.014).

Lines 337-38:It is worth noting that this 0.13-point reduction in pain score might not have meaningful clinical implications.

Discussion:

Lines 381: Consider changing to "Comparison with existing literature"

Lines 382-383:Our study conclusion generally aligns with previous systematic reviews [16-19] that the strength of evidence was insufficient to draw conclusions.

This line is a bit confusing, as you are clearly drawing some conclusions and reporting them in this paper. Re-phrase- do you mean the sample sizes and quality of evidence were so low that your results do not challenge previous studies?

Lines 397-99:In our study, we observed a pooled mean opioid reduction of 24.88 mg/day from a baseline of 87.4 mg/day. Although this reduction was aggressive and exceeded the guideline-recommended reduction rate...

Reiterate the average and/or median timeframe over which this reduction occurred. Without this information, the following statement that "reduction was aggressive" doesn't make sense.

Lines 403-404: In fact, the primary goal of CNCP management is to maintain body function rather than achieve complete pain eradiation.

Add citation for this statement

Lines 406-408: in this study, our findings align with existing evidence [40, 41], suggesting that opioid reduction may lead to withdrawal symptoms, increased pain severity, suicides or all-cause mortality.

Clarify: since these were not reported in the studies you examined, do you mean that they may be of concern in larger populations followed for longer periods of time?

Lines 442-55: Cannabis section- examining the effects of cannabis on opioid utilization and pain seems beyond the scope of this paper, especially given the complexity of this issue, including variable effects of different cannabis products and cannabinoids on pain. I would consider excluding or limiting this section.

Lines 493-97:Although according to prior studies, no specific interventions can be recommended over one another, multidisciplinary opioid reduction strategies, incorporating components such as CBT, pain education, mindfulness, exercise and acupuncture, have demonstrated effectiveness and tolerability in reducing opioid doses and improving pain severity among patients with CNCP in primary care settings.

The way this is phrased is a bit confusing. Please rephrase and make more concise.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 Oct 18;19(10):e0300954. doi: 10.1371/journal.pone.0300954.r002

Author response to Decision Letter 0


29 Jun 2024

Response to academic editor and reviewer(s)

Journal: PLOS ONE

Title: Interventions to reduce opioid use for patients with chronic non-cancer pain in primary care settings: a systematic review and meta-analysis

Paper ID: PONE-D-24-09355

---------------------------------------------

Dear Ethan,

We appreciate your time and effort in securing reviewers for our study. Both your and the reviewer’s comments are helpful in improving our work. According to your suggestions, we have revised the manuscript. All issues are addressed point by point as follow.

Revision suggestions from Ethan (Academic Editor).

1. Please include the following items when submitting your revised manuscript:

• A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

• A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

• An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

These have been done.

2. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

We didn’t make any changes to the financial disclosure.

3. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future.

For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols.

Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

The research protocol is available with PROSPERO (CRD42022338458) and this is clearly stated in the manuscript.

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

The title page has been revised per instructions (i.e., corresponding authors’ phone number and physical address have been removed; the initial of the corresponding author’s name has been put into parentheses after the email).

The manuscript format has been revised to meet PLOS ONE’s style requirements (i.e., information including Contributors and Funding has been removed, and supporting information has been added right below References)

2. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

Captions of Supporting Information files have been included at the end of the manuscript right after the References

3. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

We have updated the reference list using the Vancouver style.

Comments from Reviewer #1:

1. Introduction:

Lines 96-99:This is particularly common for studies using pharmacological substitution, where the primary aim was to address opioid withdrawal symptoms rather than reducing opioid dosage, despite achieving a decrease in opioid dosage or an improvement in pain severity

Add supporting citations. I found this surprising given my own awareness of the literature, which does not tend to focus on opioid withdrawal to the exclusion of dose reduction.

Thank you for this comment. We carefully reviewed the studies included in prior published systematic reviews again, and found three articles using pharmacological interventions, but their primary purpose was not to reduce opioids, despite dose reduction outcomes occurred during the process. To clarify, we revised the statement in the Introduction section, in lines 92-96, as follows. (unless otherwise stated, all line numbers in this letter pertain to the revised manuscript without track changes)

“Some prior systematic reviews also included potentially relevant studies. However, those studies focused on managing related symptoms, such as withdrawal symptoms [20], opioid overuse headache [21], or improving adherence to antidepressants to increase the likelihood of opioid cessation [22], rather than directly reducing opioid use, despite a decrease in opioid dosage or an improvement in pain severity was achieved.”

Below, reference 20-22 have been added in the reference list.

20. Hooten WM, Warner DO. Varenicline for opioid withdrawal in patients with chronic pain: a randomized, single-blinded, placebo controlled pilot trial. Addictive Behaviors. 2015;42:69-72.

21. Johnson JL, Kwok YH, Sumracki NM, Swift JE, Hutchinson MR, Johnson K, et al. Glial attenuation with ibudilast in the treatment of medication overuse headache: a double‐blind, randomized, placebo‐controlled pilot trial of efficacy and safety. Headache: The Journal of Head and Face Pain. 2015;55(9):1192-208.

22. Scherrer JF, Salas J, Sullivan MD, Ahmedani BK, Copeland LA, Bucholz KK, et al. Impact of adherence to antidepressants on long-term prescription opioid use cessation. The British Journal of Psychiatry. 2018;212(2):103-11.

2. Results:

Lines 231-233: Rather than say "most" studies did not report type of CNCP, mention exact numbers, and the exception. Verify this is correct- as many studies do breakdown neuropathic pain vs msk pain, etc.

Thank you for raising this. We have revised the expression from "most studies" to "None of the studies specified the CNCP conditions." This adjustment reflects the exclusion of the study involving a medical cannabis substitution program, which was the only study explicitly mentioning chronic musculoskeletal pain conditions.

3. Were patients with substance use disorders, e.g. opioid use disorders, excluded? Was unprescribed use of opioids examined in some way? Include these in limitations later on as appropriate.

Indeed, cohorts of patients with substance use disorders were excluded. Thank you for the suggestion. To clarify the inclusion/exclusion criteria, we added below sentence in the Eligibility criteria section, lines 118-121.

“Studies exclusively focused on acute pain, cancer pain, surgical pain or palliative care were excluded. Pregnant or breastfeeding women, non-human participants and patients with substance use disorders (e.g. opioid use disorders) were not our target study population and were thus excluded.”

We understand that some opioids can be illegally acquired without prescriptions from healthcare providers. Unfortunately, none of the included studies examined this. According to your suggestion, we added the below, explaining this limitation in the Discussion section, lines 475-479.

“Fifth, the oversight of unprescribed use of opioids may overestimate the effectiveness of opioid reduction strategies, as patients might still be obtaining opioids from unauthorized sources. Conversely, it might also underestimate their effectiveness, since total opioid consumption could be higher than reported.”

4. Table 1: Consider including what type of CNCP was investigated, if applicable.

Thank you for this comment. We fully understand the importance of specifying the type of CNCP to better identify which patients are more likely to benefit from opioid reduction. Unfortunately, only one of the included studies specified musculoskeletal pain as the CNCP condition, and this study was excluded due to its cannabis intervention. The remaining studies only used the general term -- CNCP.

Considering this, we added the following sentence to the Conclusion section, lines 488-490. “Future research should focus on identifying the effective components of these interventions and specifying which CNCP conditions benefit most.”

5. Please justify inclusion of the study of medical cannabis if other potential analgesics were excluded in favor of behavioral interventions? The impact of cannabis on pain is a complex topic that seems beyond the scope of this study. I would consider excluding this study from analysis entirely, given that it is the only one involving cannabis, and also has a small sample size.

Thank you for this suggestion. After careful consideration, we have decided to exclude this study. Accordingly, analyses and discussions related to cannabis and pharmacological interventions were revised.

6. Was "usual care" defined in these studies, and if so, how?

We acknowledge the importance of having a clearly defined control group. Unfortunately, the included studies did not specify the components of usual care, which prevented us from providing a detailed description of it. To clarify this situation, we have added the following sentence to lines 252-253:

“The most common comparator was usual care, which unfortunately was not clearly defined in the included studies”

7. Some interpretation is included in the Results section which might be more appropriate for the Discussion, e.g.:

Lines 284-85: Furthermore, a multivariable meta-regression analysis was conducted, revealing that heterogeneity could be partially explained by differences in the longest follow-up time across studies (p=0.014).

Lines 337-38:It is worth noting that this 0.13-point reduction in pain score might not have meaningful clinical implications.

Thank you for your comment. We understand that traditionally, interpretations are placed in the Discussion section. However, we believe that by presenting the meta-regression findings within the Results section, we ensure that readers can directly see how differences in follow-up times contribute to the observed heterogeneity, thereby providing a more comprehensive understanding of the results. We briefly mention the interpretation of clinical implications of the -0.13 change in pain severity in the results section, so it is immediately accessible to readers. We hope that this is acceptable.

8. Discussion:

Lines 381: Consider changing to "Comparison with existing literature"

The heading has been changed into “Comparison with existing literature” from “Compare with existing literature”.

9. Lines 382-383:Our study conclusion generally aligns with previous systematic reviews [16-19] that the strength of evidence was insufficient to draw conclusions.

This line is a bit confusing, as you are clearly drawing some conclusions and reporting them in this paper. Re-phrase- do you mean the sample sizes and quality of evidence were so low that your results do not challenge previous studies?

Thank you for pointing out this. We revised to make this sentence clearer. See lines 378-380.

“Our study’s conclusions generally align with previous systematic reviews [16-19], which indicate that due to insufficient evidence strength and small sample sizes, recommending specific opioid reduction strategies is not feasible.”

10. Lines 397-99:In our study, we observed a pooled mean opioid reduction of 24.88 mg/day from a baseline of 87.4 mg/day. Although this reduction was aggressive and exceeded the guideline-recommended reduction rate...

Reiterate the average and/or median timeframe over which this reduction occurred. Without this information, the following statement that "reduction was aggressive" doesn't make sense.

Thank you very much. This is really a good point. We calculated a median follow-up duration of 6 months, during which the pooled mean opioid reduction was 28.63 mg/day from a baseline of 84.70 mg/day over a period of six months. According to the 2016 CDC guideline, a 10% dose reduction per month is more tolerable for patients on long-term opioids, suggesting a reduction to 45.01 mg/day over six months. Thus, our observed reduction to 28.63 mg/day appears somewhat aggressive.

We have made some revisions to the Comparison with existing literature section, in lines 392-400, as follows:

“Clinical guidelines [11, 12, 42] recommend an initial reduction of opioid dosage by 10% per week, with adjustments to a more tolerable 10% dose reduction per month for high-dose users (> MEDD 120 mg/day) or those on LTOT. In our study, we observed a pooled mean opioid reduction of 28.63 mg/day from a baseline of 84.70 mg/day over a median follow-up period of six months. According to these guidelines, the dosage should have been reduced to 45.01 mg/day over six months. Thus, our observed reduction to 28.63 mg/day appears somewhat aggressive. Despite exceeding the guideline-recommended reduction rate, it did yield a clinically meaningful decrease in opioid dosage without worsening pain severity.”

11. Lines 403-404: In fact, the primary goal of CNCP management is to maintain body function rather than achieve complete pain eradiation.

Add citation for this statement

Thank you for the reminder. We have added below two references to support this statement.

“In fact, the primary goal of CNCP management is to maintain body function rather than achieve complete pain eradiation [42, 43].”

42. Ashburn MA, Staats PS. Management of chronic pain. The lancet. 1999;353(9167):1865-9.

43. Roditi D, Robinson ME. The role of psychological interventions in the management of patients with chronic pain. Psychology research and behavior management. 2011:41-9.

12. Lines 406-408: in this study, our findings align with existing evidence [40, 41], suggesting that opioid reduction may lead to withdrawal symptoms, increased pain severity, suicides or all-cause mortality.

Clarify: since these were not reported in the studies you examined, do you mean that they may be of concern in larger populations followed for longer periods of time?

We apologize for not making the statement clear. Actually, withdrawal symptoms, increased pain severity, suicide and death were examined by the included studies and we reported the relevant proportions in the Adverse events section. To clarify, we have made the below revisions to the Comparison with existing literature in lines 405-411.

“Meanwhile, although there was infrequent documentation of the adverse events in the original studies, we did analyze their occurrences (e.g. withdrawal symptoms, increased pain severity, suicides, or all-cause mortality). Our findings align with existing evidence [44, 45], suggesting that opioid reduction may lead to these adverse outcomes. Therefore, close monitoring of patient responses to opioid reduction strategies is essential for optimizing treatment outcomes, while mitigating adverse effects.”

13. Lines 442-55: Cannabis section- examining the effects of cannabis on opioid utilization and pain seems beyond the scope of this paper, especially given the complexity of this issue, including variable effects of different cannabis products and cannabinoids on pain. I would consider excluding or limiting this section.

Thank you for this suggestion. Since the study involving medical cannabis has been removed, we have also deleted the related discussions accordingly as below:

Pharmacological interventions (cannabis-assisted opioid substitution) showed promising result,

Attachment

Submitted filename: Response to Reviewers.docx

pone.0300954.s003.docx (36.6KB, docx)

Decision Letter 1

Ethan Moitra

23 Jul 2024

Interventions to reduce opioid use for patients with chronic non-cancer pain in primary care settings: a systematic review and meta-analysis

PONE-D-24-09355R1

Dear Dr. Cai,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Ethan Moitra

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Ethan Moitra

25 Jul 2024

PONE-D-24-09355R1

PLOS ONE

Dear Dr. Cai,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Ethan Moitra

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. Search strategies on the five medical databases.

    (DOCX)

    pone.0300954.s001.docx (58.2KB, docx)
    S2 Appendix. PRISMA 2009 checklist.

    (DOC)

    pone.0300954.s002.doc (64KB, doc)
    Attachment

    Submitted filename: Response to Reviewers.docx

    pone.0300954.s003.docx (36.6KB, docx)

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES