Abstract
Background
Opioids are effective for acute and chronic pain conditions, but their use is associated with often difficult-to-manage constipation and other gastrointestinal (GI) effects due to effects on peripheral μ-opioid receptors in the gut. The mechanism of opioid-induced constipation (OIC) differs from that of functional constipation (FC), and OIC may not respond as well to most first-line treatments for FC. The impact of OIC on quality of life (QoL) induces some patients to decrease or stop their opioid therapy to relieve or avoid constipation.
Purpose
At a roundtable meeting on OIC, a working group developed a consensus definition for OIC diagnosis across disciplines and reviewed current OIC treatments and the potential of treatments in development. By consensus, OIC is defined as follows: ‘A change when initiating opioid therapy from baseline bowel habits that is characterized by any of the following: reduced bowel movement frequency, development or worsening of straining to pass bowel movements, a sense of incomplete rectal evacuation, or harder stool consistency’. The working group noted the prior validation of a patient response outcome and end point for clinical trials and recommended future efforts to create treatment guidelines and QoL measures specific for OIC. Details from the working group’s discussion and consensus recommendations for patient care and research are presented in this article.
Keywords: μ-opioid receptor, opioid-induced constipation, pain, palliative care, quality of life
Approximately 90% of patients who experience moderate to severe chronic pain are treated with opioids.1 This large population, which is estimated at about 5% of adults in the United States,2 includes patients with a wide variety of pain conditions, such as pain from degenerative joint diseases (including back and knee pain), other musculoskeletal pain, and neuropathic pain, collectively referred to as chronic non-cancer pain. Patients with chronic cancer pain are also treated with opioids, which are an essential component of palliative care. Moreover, opioids are also commonly used to treat acute pain syndromes that result from sprains and strains, fractures, dental procedures, and surgery, and they are sometimes used to treat migraine headaches.3
The use of opioid analgesics requires careful selection and monitoring of patients to achieve an optimal balance between the benefits and risks of these agents.4–8 Apart from the well-known inhibitory effects of opioids on gastrointestinal (GI) function (see below), a variety of other physiologic alterations are associated with their use. These effects include sedation,4 hormonal 4,6 and cognitive4,5 changes, pruritus,4 sweating,6 bladder dysfunction,6 respiratory depression,6 opioidinduced hyperalgesia,9 narcotic bowel syndrome (NBS),9 and myoclonus.4 The potential also exists for opioid dependence, abuse, addiction, and overdose.4–6 Despite these limitations, opioid analgesics remain a viable treatment option for patients with chronic pain,4 where efficacy has been established7,8 and therapy can be individualized for each patient from the variety of medications and formulations that are available.7,8
Opioids are effective for alleviating pain via their actions at opioid receptors in the central nervous system (CNS) and the peripheral nervous system10; however, a small proportion (about 5%) of patients treated with high or prolonged doses may paradoxically develop central hyperalgesia called NBS.9,11 In addition, opioid actions on μ-receptors throughout the GI tract often lead to impairment of motility and secretion and a variety of symptoms, including nausea, gastroparesis, secondary pseudo-obstruction, and constipation, which are called opioid bowel dysfunction (OBD). The focus of this article addresses the most prevalent of these conditions: opioid-induced constipation (OIC).
In January 2013, a working group of US and international basic science and clinical experts in pain medicine, palliative care, gastroenterology, and gut neurobiology conducted a roundtable meeting to discuss the definition, diagnosis, prophylaxis, and treatment of OIC as a first step toward addressing the current unmet needs in chronic OIC. This article summarizes the discussion and consensus reached at that meeting. The objectives of this article are to propose a consensus definition of OIC that can be used across disciplines for diagnosis, to raise awareness regarding the frequency and impact of OIC, to briefly review current treatments and drugs in development for OIC, and to outline the need for future efforts, including the creation of treatment guidelines and quality-of-life (QoL) measures specific for patients with OIC.
OPIOID RECEPTORS AND THE MECHANISM OF GASTROINTESTINAL DYSFUNCTION
There are three classes of opioid receptors involved in GI function: μ, κ, and δ. These receptors are also widely distributed in the CNS. The κ- and δ-receptors are expressed primarily in the stomach and proximal colon, whereas the μ-receptors are expressed widely throughout the GI tract. OIC develops predominantly as a result of activation of enteric μ-opioid receptors, which leads to a decrease in neurotransmitter release from enteric nerves. In contrast to opioid-associated nausea and vomiting, tolerance to OIC rarely develops 12; for example, in a mouse motility model, tolerance to morphine was shown to develop in the ileum but not in the colon.13 Because of their ubiquitous distribution in the GI tract, μ-opioid receptors mediate numerous effects on gut functions when activated by exogenous opioids, and these effects can produce a variety of symptoms known as OBD.14 For example, activation of μ-opioid receptors causes esophageal non-peristaltic contractions,15 decreases gastric motility and emptying and increases pyloric sphincter tone; decreases GI, biliary, and pancreatic secretions; inhibits propulsion in the small and large intestines; increases the amplitude of non-propulsive segmental contractions in the small intestine; increases water absorption from bowel contents; increases anal sphincter tone; and constricts the sphincter of Oddi.14 Thus, activation of μ-opioid receptors in the targeted area can induce dysphagia, gastroparesis, ileus or secondary intestinal pseudo-obstruction, and OIC. This defined mechanism causes the constipation of OIC, in contrast to functional constipation, which involves multiple contributing factors.16 This article focuses specifically on OIC, as discussed below.
PREVALENCE AND IMPACT OF OIC IN CHRONIC OPIOID USERS
In a systematic review of eight placebo-controlled studies in patients with chronic non-cancer pain, 41% of patients receiving World Health Organization (WHO) step 3 opioids (fentanyl, hydromorphone, methadone, morphine, oxycodone, and oxymorphone) reported constipation compared to 11% of patients receiving placebo.17 Among the patients receiving opioids, constipation was the most commonly reported adverse effect.17 In patients with cancer pain, the prevalence of OIC, as indicated by the use of laxatives (a commonly used surrogate parameter), was reported to be ~94%.18 In a population-based survey, 57% of individuals with chronic non-cancer pain using opioids experienced constipation that those individuals associated with opioid treatment; moreover, 33% reported constipation as their most bothersome symptom.19
The occurrence of OIC may vary according to the opioid used. Results of a survey of ~1000 adults in the United States treated with a single opioid (codeine, hydrocodone, propoxyphene, morphine, oxycodone, or tramadol) indicated that morphine was most commonly associated with constipation (67%).19 A systematic review of the literature found that transdermal preparations were associated with less OIC than modified-release oral morphine and that transdermal fentanyl was preferred by patients.20
Opioid-induced constipation compromises patient satisfaction with analgesic treatment. Pain symptoms increase when patients decrease or eliminate their opioid medication to relieve or avoid constipation, which also affects QoL. Thus, there was a significant difference in QoL between patients, depending on the degree of the ‘problem with OIC’.21 In the Patient Reports of Opioid-related Bothersome Effects (PROBE) 1 survey conducted in patients with chronic pain in the United States and Europe, 33% of the 322 patients responded that they missed doses, decreased the dose, or stopped using their opioid medication to relieve bowel-related side effects; 92% of those patients sub-sequently experienced increased pain, and 86% of those experiencing increased pain reported that it moderately to greatly reduced their QoL and activities of daily living.22,23 Patients reported abdominal discomfort, nausea, gas, loss of appetite, heartburn and reflux, bloating, straining, hard bowel movements, and incomplete evacuation.22 Other consequences include fecal impaction with overflow diarrhea and stool incontinence.23 These adverse effects limit opioid use.22 Despite such findings, QoL has not been studied extensively in patients with OIC, being limited to evaluations of constipation distress on a 5-point scale24 and to use of the Patient Assessment of Constipation-Quality of Life (PAC-QOL) questionnaire,25 which was not developed for OIC; no OIC-specific QoL assessment tools are available.
DIAGNOSIS OF OIC
Current methods for diagnosing OIC include both objective and subjective criteria. The methods of OIC diagnosis vary among disciplines and demonstrate the need for a consensus definition. A summary of assessment tools and outcome measures identified in a systematic review of 47 clinical trials assessing OIC published in the past 20 years is presented in Table 1.26 Of the 47 trials included, only 16 (34%) provided a definition. Those publications that provided a definition most frequently relied on (1) history of present or recent opioid therapy, (2) defecation frequency (most often: fewer than three spontaneous bowel movements per week), and (3) at least two of the following symptoms at least 25% of the time: straining, hard or lumpy stool, incomplete evacuation, and infrequent stools.27
Table 1.
Category | Assessment tool/outcome measure |
---|---|
Objective measures* | Bowel movement frequency/change in bowel movement frequency Time to laxation Laxation within 4 h Gastrointestinal (or short bowel) transit time Bristol Stool Form scale |
Patient-reported outcome measures† | Bowel Function Index Patient Assessment of Constipation – Symptoms Global Clinical Impression of Change |
Patient-reported burden measures of OIC‡ | Constipation distress Patient Assessment of Constipation – Quality of Life |
Objective measures: Could theoretically be collected by an investigator as well as by the patient (eg, defecation frequency).
Patient-reported outcome measures: ‘Reports coming directly from patients about how they feel or function in relation to a health condition and its therapy without interpretation by healthcare professionals or anyone else’.61
Patient-reported burden measures of OIC: Patient-reported outcome measures that directly relate to the patient’s distress and the impact on their daily activities or QoL and are most obviously caused by OIC. OIC, opioid-induced constipation.
Unfortunately, criteria used in clinical trials exclude many individuals who are constipated,28 and definitions used do not necessarily identify all patients who are experiencing constipation in a palliative care setting.29 Patients who develop OIC often have subjective definitions of constipation based on their own experiences, emphasizing the need for a consensus definition for OIC based on frequency, difficulty with evacuation, consistency of bowel movements, and change from previous bowel habits (functions). Ultimately, formal psychometric validation of any consensus definition will also be necessary.
Barriers to the diagnosis and treatment of OIC
The working group identified barriers in clinical practice that hinder the diagnosis and treatment of OIC. First, there is a lack of awareness among clinicians of the adverse consequences of OIC. With the recommendation from authoritative bodies such as the Joint Commission and the Veterans Health Administration that pain assessment should be considered the fifth vital sign and the need for ‘around-the-clock’ pain relief, as well as adjunctive approaches to calm fears and anxiety, clinicians generally focus on the efficacy of pain relief provided by the opioid and/or the disease causing the pain.2 Second, even though clinicians may be aware of the adverse effects of opioid use, they may not ask their patients whether they have developed constipation. Third, despite the negative impact of constipation, many patients may feel ashamed or uncomfortable initiating a discussion about their bowel habits with their healthcare provider. Fourth, there are no universal diagnostic criteria for OIC, and the symptoms are similar to other types of primary or secondary constipation. Furthermore, efforts to use standard criteria for functional constipation (e.g., Rome III) in clinical care or research may not capture the full spectrum of OIC, which occurs in a variety of clinical settings and is diagnosed by a variety of specialists in patients with or without a history of constipation. Fifth, because the mechanism of OIC is specifically due to opioid administration and differs from that of slow colonic transit constipation, 16,30–32 there are specific treatments for OIC that may be more effective than standard treatments for chronic idiopathic constipation.23 Finally, most of the currently available treatments specifically addressing the pharmacologic mechanisms inducing OIC, particularly naloxone, have limited efficacy, and agents that cross the blood-brain barrier interfere with opioid analgesia. Hence, the working group considered that the ultimate goal of OIC treatment is to alleviate the constipation while maintaining analgesia, which would require restriction of the μ-opioid receptor antagonist to the peripheral compartment without central action.
PROPOSED CONSENSUS ON SYMPTOMS OF OIC
Factors considered by the working group as content for developing a consensus definition of chronic OIC included the following: opioid treatment for more than 1 week, reduced bowel frequency to fewer than three spontaneous bowel movements per week, straining, sense of incomplete evacuation, and harder stool. However, patients may also experience acute OIC even after taking one dose of an opioid. In specialty practice, the definition of harder stool may be aided by use of a standard visual scale such as the Bristol Stool Form scale.33
DIAGNOSIS AND DIFFERENTIAL DIAGNOSIS
Because OIC is defined by symptoms rather than by pathophysiologic features or biomarkers, it mimics many other medical conditions. Therefore, it is first important to exclude comorbid conditions that may be responsible for or that may exacerbate the constipation. Commonly encountered medical conditions include chronic idiopathic constipation (functional constipation), obstructing colon cancer, Parkinson’s disease, diabetes, and constipating medications, such as antidepressants or iron supplements. Furthermore, it is also important to evaluate the patient for an underlying rectal evacuation disorder (e.g., dyssynergic defecation or large rectocele) that is aggravating the constipation. This is because ~15% of the general population without symptoms suggestive of colonic pain more than six times per year experience symptoms of excessive straining to evacuate or a sense of incomplete rectal evacuation.34 In addition, the highly prevalent dyssynergic defecation among patients with chronic constipation35 may be confused by patients and doctors as functional constipation. These comorbid disorders or underlying borderline disturbances of rectal emptying may be brought to clinical attention as a result of opioid use. Thus, the challenge to the clinician is to determine the degree to which constipation in the setting of opioid use is caused exclusively by the opioid (i.e., OIC) or reflects a combination of OIC and other constipating factors as above, or is due to causes other than OIC. It should be kept in mind that, on average, half of the patients given opioids will not develop OIC.36
The working group definition of OIC considers the change in bowel habits from baseline (before opioid initiation), recorded over ≥7 days, as opposed to a specific number of bowel movements per week. Based on variations in bowel habits and defecation patterns and what individuals would consider abnormal, the following definition of OIC was proposed by the working group as a starting point, acknowledging the need for future psychometric validation:
A change when initiating opioid therapy from baseline bowel habits that is characterized by any of the following:
reduced bowel movement frequency
development or worsening of straining to pass bowel movements
a sense of incomplete rectal evacuation
harder stool consistency
There are several operating factors that led to this definition:
the concept of a subjective change in bowel habit obviates the need for any quantitative standard (e.g., fewer than three bowel movements/week) because it reflects a true clinical situation
change from baseline takes into consideration that patients may have had pre-existing constipation or a prior normal bowel habit made worse by opioids and that patients have known variability in response to opioids based on genetic factors
it is applicable to patients seen in a variety of clinical settings: primary care, pain centers, or gastroenterology clinics
the absence of a required time frame allows for utilization of the definition even in patients who develop OIC after only one or a few doses of opioid
the simplicity of the items permits clinicians to use the definition as a screening measure in clinical practice.
In addition, it is also possible for the definition to be made more restrictive (e.g., requiring two or more items, quantifying stool frequency) for the purpose of developing inclusion criteria for subject selection in research. This definition permits the objective of appraising the ability of treatment to restore patients with OIC to what they believe is normal bowel function for them. Future studies are needed to validate these items and to develop criteria for research that reflect patient perceptions.
MECHANISMS OF ACTION AND LIMITATIONS OF CURRENT TREATMENTS FOR OIC
Laxatives
First-line treatment of OIC has involved the use of traditional stimulants and stool softeners.
Mechanisms of action
Predominant mechanisms of action are to soften the stool (detergents; e.g., docusate sodium; Colace®, Purdue Pharma L.P., Stamford, CT, USA), retain water in the GI tract (osmotic agents; e.g., polyethylene glycol solution; MiraLAX®, MSD Consumer Care, Inc., Memphis, TN, USA), increase GI contractility, and induce fluid secretion (stimulants; e.g., bisacodyl [Dulcolax®, Boehringer Ingelheim Pharmaceuticals, Inc., Ridgefield, CT, USA], senna [Senokot®, Purdue]).37
Current application and evidence of efficacy
Guidelines from the European Association for Palliative Care (EAPC) recommend laxatives for the prophylaxis or management of OIC in patients with cancer.38 There is no single laxative of choice. Laxatives have the advantage of being inexpensive; they are available in generic form or as over-the-counter preparations.
There are no randomized controlled trials to support the use of laxatives in the treatment of OIC; however, they are appropriately tried as first-line therapies in view of their safety and cost.
Thus, most have limited efficacy in OIC unless the patient was constipated before the initiation of opioid treatment.23 In a general population survey of patients with chronic pain who were taking laxatives before initiating treatment with oral opioids, it was demonstrated that at baseline 70% reported having at least three bowel movements per week, and 20% reported having fewer than three bowel movements per week, with the remaining 10% not providing information. After initiating oral opioid therapy, 55% reported having at least three bowel movements per week, and 45% reported having less than three bowel movements per week; 81% reported constipation as an opioid-induced side effect.22 Consequently, OIC is present even though patients are taking laxatives. Non-specific agents are effective in patients with OIC who had baseline constipation, and μ-opioid antagonists are not presently indicated for chronic constipation, even though there is evidence that a peripherally restricted μ-opioid receptor antagonist, alvimopan, is able to accelerate colonic transit in the absence of opioid treatment,3 reflecting the physiologic role of μ-opioid receptors, which may respond to endogenous ligands such as enkephalins or dynorphin. Concerns with longterm use of laxatives alone or in combination with stool softeners (e.g., Peri-Colace®, Purdue [a mixture of senna and docusate sodium]) include electrolyte imbalances and a small risk of damage to the colonic myenteric plexus, as seen when anthraquinone laxatives (e.g., sennosides) were administered to mice,39 although there were no abnormalities of GI neuropeptides in relation to mesenteric vessels or the plexuses in the cecum of rats in response to long-term senna administration.40 A mixture of danthron and a poloxamer called Co-danthramer (a combination of a softener and a stimulant) is marketed only in the United Kingdom for patients with terminal illness because excess danthron administration is associated with liver tumors in rodents. In contrast to the lack of effects of senna, levels of neuropeptide Y in the mesenteric vessels are significantly reduced in the danthron-fed rats, with no effects on vasoactive intestinal peptide (VIP), substance P (SP), calcitonin gene-related peptide (CGRP), and catecholamine nerves.40 When laxatives are ineffective, patients often undergo enemas, manual disimpaction, or use off-label preparations intended to cleanse the bowel before procedures such as barium enema x-ray examination and colonoscopy.
Chloride channel activator
Mechanisms of action
Lubiprostone (Amitiza®, Takeda Pharmaceuticals America, Inc., Deerfield, IL, USA) is a specific activator of intestinal epithelial CIC-2 chloride channels that also induces chloride secretion through the cystic fibrosis transmembrane conductance regulator to increase the transport of fluid into the intestine. CIC-2 channel activation counteracts the antisecretory effects of opioids in the intestine.
Current application and evidence of efficacy
Originally indicated for the treatment of chronic idiopathic constipation, lubiprostone was also approved by the US Food and Drug Administration in April 2013 for the treatment of OIC in adults with chronic non-cancer pain.41 Lubiprostone significantly improved treatment response in non-methadone OIC in patients with chronic non-cancer pain, with an approximate number needed to treat of 6 and median time to first bowel movement of 24 h, which was ~12 h superior to placebo.42 Methadone-treated patients were excluded from the trial because methadone, but not morphine, inhibits lubiprostone-stimulated Cl− secretion in enterocyte preparations in vitro.43
Selective 5-HT4 agonist prucalopride
Mechanisms of action
Prucalopride accelerates colonic transit and induces propagated contractions in the colon.25
Current application and evidence of efficacy
One randomized controlled trial demonstrated the efficacy of prucalopride 2 mg orally in the treatment of OIC.25 Prucalopride is approved in many countries (but not the United States) for the treatment of chronic idiopathic constipation but not for OIC.
By increasing the volume of luminal contents, all of the therapies described above probably work, at least in part, by stimulating GI propulsive motility and secretory functions. However, the activity of local enteric neuronal circuits is dramatically dampened downstream by the inhibitory actions of opioid therapy. Blocking the actions of opioids at peripheral opioid receptors would serve to restore the function of the enteric nervous system directly. As described below, this is the goal of the opioid receptor antagonists.
Opioid receptor antagonists
Mechanisms of action
Opioid receptor antagonists block opioid actions at peripheral opioid receptors that mediate decreased intestinal secretion and propulsive colonic motility.
Current application and evidence of efficacy
Centrally active agents
Opioid receptor antagonists that cross the blood-brain barrier act centrally and peripherally; although they may alleviate OIC, their CNS effects may antagonize the analgesic effects of the opioid.44,45 Examples are naloxone and nalbuphine. The CNS effects of these antagonists cause opioid withdrawal symptoms. A combination product, Targin®/ Targinact®/Targiniq® (Purdue; combination of an opioid antagonist [naloxone] and an opioid agonist [oxycodone]), is available in Europe and is approved for patients with severe pain. It is a fixed-dose combination, which may limit its usefulness. Its dosing is affected by the limited ability of the body to metabolize naloxone before it reaches the CNS.
Peripherally active agents
An agent that does not enter the CNS but blocks μ-opioid receptors in the gut would more specifically treat the constipation of OIC, providing a clinical advantage. By blocking μ-opioid receptors in the gut, there is restoration of the function of the enteric nervous system, and propulsive motility and secretory functions can be generated by local enteric neural circuits in response to physiologic stimuli such as meal ingestion, or sensation of a bolus to evoke normal peristalsis. Two peripherally acting μ-opioid receptor antagonists (PAMORAs) are currently available. Subcutaneous methylnaltrexone (Relistor®, Salix Pharmaceuticals, Inc., Raleigh, NC, USA) is approved for OIC, but only for patients with advanced illness receiving palliative care who have had an inadequate response to laxative therapy.46 The EAPC guidelines recommend subcutaneous methylnaltrexone as a secondline option for OIC in patients with chronic cancer pain when traditional laxatives are not effective.38 Alvimopan (Entereg®, Cubist Pharmaceuticals, Inc., Lexington, MA, USA), available in the United States but not in Europe, is a PAMORA indicated only for preventing or shortening the course of postoperative ileus after bowel resection and is therefore only for hospital use47 and not approved for use in OIC.
DRUGS IN DEVELOPMENT FOR THE TREATMENT OF OIC
Several PAMORA agents with the potential not to compromise pain relief by opioids48 are in development for OIC. An oral formulation of methylnaltrexone (Relistor®) is under investigation, and the currently available subcutaneous formulation of methylnaltrexone is under consideration for OIC in patients with chronic non-cancer pain. There are four other drugs currently in phase 2b or 3 development for OIC in patients with chronic non-cancer pain: naloxegol (AstraZeneca), which is an oral PEGylated derivative of naloxone; bevenopran (Cubist Pharmaceuticals); TD-1211 (Theravance, South San Francisco, CA, USA); and naldemedine (S-297995; Shionogi, Osaka, Japan). Thus, it is anticipated that the number of treatments available for OIC should increase in the next few years.
ACUTE OIC
Opioid-induced constipation can also occur when opioids are used to treat acute pain.3 Patients with acute OIC have special requirements for treatment of their constipation. In a recent study, more than half of almost 8000 outpatients with cancer pain starting WHO step II or III pain medications were not prescribed laxatives.49 There are no standard international guidelines for the treatment of patients with acute OIC, and the most common medications used appear to be docusate, senna alkaloids, bisacodyl, picosulfate, enemas, and in some cases, methylnaltrexone.50,51 In addition, doses of PAMORA agents required by opioid-naive patients are very different from those of chronic opioid users. For example, alvimopan 12 mg was effective in reversing the acute effects of codeine in opioid-naive healthy volunteers,52 whereas the dose tested in chronic OIC is 0.5 to 1 mg twice daily.53 Similarly, methylnaltrexone used at FDA-approved doses in opioid-naive healthy volunteers was ineffective at reversing the effects of codeine on the small bowel and colonic transit.54 Thus, there is a need for a separate regulatory path and dosing for medications required for relief of OIC in patients with acute painful conditions who use opioids. It should also be kept in mind that patients with a baseline history of chronic constipation who develop OIC may not be sufficiently treated solely with a PAMORA.
PROPOSED FUTURE EFFORTS IN OIC
Prophylaxis
The working group agreed that providing OIC prophylaxis at the initiation of opioid analgesic therapy may be desirable, analogous to providing gastroprotection at the initiation of non-steroidal anti-inflammatory drug (NSAID) therapy. Results of a recent retrospective study of patients with cancer pain given laxative prophylaxis before initiation of oral opioid analgesics suggested that laxative premedication significantly reduced the incidence of constipation compared with no premedication.55 Although laxatives are recommended as prophylaxis in adult patients with cancer pain by the National Comprehensive Cancer Network,56 they have been shown to be suboptimal for prophylaxis in other groups of patients.22 Use of an agent that targets the μ-opioid receptor to block the effects of the μ-agonist could provide an opportunity to change the way OIC is prevented and treated. Appropriate use of agents for prophylaxis must be defined. Elderly patients,57 who typically have comorbidities, are less physically active, and are taking other drugs, are particularly susceptible to constipation. Risk factors or positive predictors for the presence of OBD identified in an observational study of patients receiving opioids, NSAIDs, or other chronic pain therapies were female sex, age >70 years, cancer-related pain, and the use of fentanyl.58 Follow-up is necessary so that the laxative agent prescribed can be adjusted if not effective.
Treatment guidelines and outcomes tools
Treatment guidelines that can be used across disciplines by a variety of physicians, including primary care physicians, pain specialists, palliative care specialists, and gastroenterologists, are needed. A validated outcomes tool for OIC must be used to determine whether particular treatments improve the symptoms of OIC. Thus far, there are two validated instruments:
A 3-item, clinician-administered, bowel function index specific for OIC has been validated based on data from three multicenter, randomized, double-blind studies in patients with cancer and non-cancer pain being treated with oral opioids or usual care. With this index, patients rate their perception of ease of defecation, feeling of incomplete bowel evacuation, and personal judgment of constipation based on the previous 7 days. Each item is rated on a scale of 0 to 100, with 0 being the worst rating and 100 being the best rating.59
A bowel function diary to assess OIC was validated (including psychometric properties, intraclass correlation coefficient ≥0.71 for numbers of spontaneous bowel movements and complete spontaneous bowel movements and other bowel function symptoms except stool consistency, and evidence of responsiveness) in a multicenter observational study of patients with chronic non-cancer pain. It contained a 4-item module that patients completed after recording each bowel movement and time of occurrence, a 5-item module that patients completed each evening to capture symptoms they experienced in the previous 24 h, and a module in which the patient indicated any constipation treatments used in the previous 24 h to relieve constipation.60
QoL measures
Assessments of QoL and clinically meaningful effect in patients with OIC are also needed. A systematic review of 47 studies revealed that most studies relied predominantly on ‘objective’ measures such as stool frequency to evaluate OIC therapy. Many studies aimed to capture the patients’ experiences of OIC by also assessing patient-reported outcome measures. A minority of trials also assessed the global burden of OIC by measuring, for example, constipation distress (Table 1).26 Validation of the QoL measures will require acquisition of firsthand patient experiences specifically with OIC. After disease-specific QoL measures are developed, their inclusion in clinical trials will be necessary to demonstrate responsiveness of QoL measures that are established to be relevant to patients with OIC.
SUMMARY/CONCLUSIONS
A large population of patients receives acute and chronic opioid treatment for moderate to severe pain. OIC is an underrecognized but common and debilitating adverse effect of opioid therapy. OIC is primarily the result of μ-opioid receptor stimulation in the GI system. Conventional treatments for functional constipation do not address the OIC-specific mechanism. To treat OIC effectively, specific blockade of μ-opioid receptor stimulation in the GI tract must be achieved without compromising CNS opioid receptor stimulation to achieve desired analgesia. Indeed, the normalization of bowel function with a μ-opioid antagonist provides evidence that the cause of constipation was specifically OIC.
The proposed definition of OIC is intended to facilitate diagnosis, with the goal of establishing unified diagnostic criteria for this condition. Much work is needed in OIC to establish treatment guidelines and disease-specific efficacy and QoL outcome measures.
Key Messages.
The development of a consensus definition of opioid-induced constipation (OIC) is necessary for its accurate diagnosis.
A working group was established to evaluate the problem of OIC, assess current treatment approaches, and provide a consensus definition of OIC.
The mechanism of action of OIC, its prevalence and symptomatology, the current treatment options, and the available assessment tools and outcome measures were examined.
The working definition encompasses the key features of OIC in an attempt to standardize its diagnosis and provide the practitioner with guidelines for its detection.
Acknowledgments
This manuscript was sponsored by AstraZeneca and was developed based on input from expert advisors who attended a roundtable meeting in Coral Gables, Florida, in January 2013. The authors received an honorarium to participate in the meeting. All authors participated in the preparation of this manuscript, critical revision, and final approval for submission.
FUNDING
This manuscript was funded by AstraZeneca.
Footnotes
CONFLICTS OF INTEREST
MC has served as an advisory board member and a consultant for AstraZeneca and Theravance, and as an adjudication committee member for AstraZeneca. MC’s institution has received fees for his participation as an editorial board member for AstraZeneca and as a consultant for Theravance.
DAD has served as an advisory board member for Ironwood Pharmaceuticals, Lexicon Pharmaceuticals, and Synergy Pharmaceuticals; a consultant for AstraZeneca, Ironwood Pharmaceuticals, Ono Pharmaceuticals, and Takeda; has received grant support from AstraZeneca and Ironwood Pharmaceuticals; and currently is President of the Rome Foundation.
GB has served as an advisory board member for AstraZeneca, has received speaking fees from Cephalon, Grunenthal, Mundipharma, and Pfizer, and has received clinical research grants from Grunenthal, Mundipharma, Pfizer, and Roche. GB is supported by grants from the Federal Ministry of Education and Research in Germany, the German Cancer Aid and the Ministry of Science and Arts in the federal state of Baden-Wuerttemberg.
LRW has served as an advisory board member for AcelRx Pharmaceuticals, AstraZeneca, Boehringer Ingelheim, Collegium Pharmaceuticals, Inspirion Therapeutics, Insys Therapeutics, Iroko Pharmaceuticals, Mallinckrodt Pharmaceuticals, Nektar Therapeutics, Orexo Pharmaceuticals, Pfizer (formerly King), Salix Pharmaceuticals, and Teva; as a consultant for Acura Pharmaceuticals, AstraZeneca, Biodelivery Sciences International, Boston Scientific, CVS Caremark, Jazz Pharmaceuticals, Mallinckrodt Pharmaceuticals, Medtronic, Nektar Therapeutics, Neura Therapeutik, Nevro Corporation, Pharmacofore, Quintiles, Shionogi, and Theravance; and has received travel support from AcelRx Pharmaceuticals, Acura Pharmaceuticals, AstraZeneca, Biodelivery Sciences International, Boehringer Ingelheim, Boston Scientific, Collegium Pharmaceuticals, Inspirion Therapeutics, Insys Therapeutics, Iroko Pharmaceuticals, Mallinckrodt Pharmaceuticals, Medtronic, Nektar Therapeutics, Nevro Corporation, Orexo Pharmaceuticals, QRx Pharma, Teva, and Theravance.
AND has served as an advisory board member and has received speaking fees from AstraZeneca and Wyeth Pharmaceuticals.
GMM has served as an advisory board member for Shire Pharmaceuticals, and is supported by NIH grant DK62267.
Medical writing services were provided by Stephanie Leinbach, PhD, and Judy Fallon, PharmD, CMPP (Complete Healthcare Communications, Inc., Chadds Ford, PA), with funding from AstraZeneca LP (Wilmington, DE).
References
- 1.Benyamin R, Trescot AM, Datta S, Buenaventura R, Adlaka R, Sehgal N, Glaser SE, Vallejo R. Opioid complications and side effects. Pain Physician. 2008;11:S105–20. [PubMed] [Google Scholar]
- 2.Hewitt K, Lin H, Faraklas I, Morris S, Cochran A, Saffle J. Use of methyl-naltrexone to induce laxation in acutely injured patients with burns and necrotizing soft-tissue infections. J Burn Care Res. 2014;35:e106–11. doi: 10.1097/BCR.0b013e31829b399d. [DOI] [PubMed] [Google Scholar]
- 3.Gonenne J, Camilleri M, Ferber I, Burton D, Baxter K, Keyashian K, Foss J, Wallin B, et al. Effect of alvimopan and codeine on gastrointestinal transit: a randomized controlled study. Clin Gastroenterol Hepatol. 2005;3:784–91. doi: 10.1016/s1542-3565(05)00434-9. [DOI] [PubMed] [Google Scholar]
- 4.Chou R, Fanciullo GJ, Fine PG, Adler JA, Ballantyne JC, Davies P, Donovan MI, Fishbain DA, et al. Clinical guidelines for the use of chronic opioid therapy in chronic noncancer pain. J Pain. 2009;10:113–30. doi: 10.1016/j.jpain.2008.10.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Jamison RN, Edwards RR. Risk factor assessment for problematic use of opioids for chronic pain. Clin Neuro-psychol. 2013;27:60–80. doi: 10.1080/13854046.2012.715204. [DOI] [PubMed] [Google Scholar]
- 6.Warner EA. Opioids for the treatment of chronic noncancer pain. Am J Med. 2012;125:1155–61. doi: 10.1016/j.amjmed.2012.04.032. [DOI] [PubMed] [Google Scholar]
- 7.Argoff CE, Silvershein DI. A comparison of long- and short-acting opioids for the treatment of chronic noncancer pain: tailoring therapy to meet patient needs. Mayo Clin Proc. 2009;84:602–12. doi: 10.1016/S0025-6196(11)60749-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Fine PG, Mahajan G, McPherson ML. Long-acting opioids and short-acting opioids: appropriate use in chronic pain management. Pain Med. 2009;10(Suppl 2):S79–88. doi: 10.1111/j.1526-4637.2009.00666.x. [DOI] [PubMed] [Google Scholar]
- 9.Grunkemeier DM, Cassara JE, Dalton CB, Drossman DA. The narcotic bowel syndrome: clinical features, pathophysiology, and management. Clin Gastroenterol Hepatol. 2007;5:1126–39. doi: 10.1016/j.cgh.2007.06.013. quiz 1–2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Luo M, Li L, Lu CZ, Cao WK. Clinical efficacy and safety of lactulose for minimal hepatic encephalopathy: a meta-analysis. Eur J Gastroenterol Hepatol. 2011;23:1250–7. doi: 10.1097/MEG.0b013e32834d1938. [DOI] [PubMed] [Google Scholar]
- 11.Tuteja AK, Biskupiak J, Stoddard GJ, Lipman AG. Opioid-induced bowel disorders and narcotic bowel syndrome in patients with chronic non-cancer pain. Neurogastroenterol Motil. 2010;22:424–30. e96. doi: 10.1111/j.1365-2982.2009.01458.x. [DOI] [PubMed] [Google Scholar]
- 12.Swegle JM, Logemann C. Management of common opioid-induced adverse effects. Am Fam Physician. 2006;74:1347–54. [PubMed] [Google Scholar]
- 13.Thompson JR. Treatment guidelines for hepatic encephalopathy. Pharmacotherapy. 2010;30:4S–9S. doi: 10.1592/phco.30.pt2.4S. [DOI] [PubMed] [Google Scholar]
- 14.Pappagallo M. Incidence, prevalence, and management of opioid bowel dysfunction. Am J Surg. 2001;182:11S–8S. doi: 10.1016/s0002-9610(01)00782-6. [DOI] [PubMed] [Google Scholar]
- 15.Kraichely RE, Arora AS, Murray JA. Opiate-induced oesophageal dysmotility. Aliment Pharmacol Ther. 2010;31:601–6. doi: 10.1111/j.1365-2036.2009.04212.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Alame AM, Bahna H. Evaluation of constipation. Clin Colon Rectal Surg. 2012;25:5–11. doi: 10.1055/s-0032-1301753. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Kalso E, Edwards JE, Moore RA, McQuay HJ. Opioids in chronic noncancer pain: systematic review of efficacy and safety. Pain. 2004;112:372–80. doi: 10.1016/j.pain.2004.09.019. [DOI] [PubMed] [Google Scholar]
- 18.Sykes NP. The relationship between opioid use and laxative use in terminally ill cancer patients. Palliat Med. 1998;12:375–82. doi: 10.1191/026921698674125048. [DOI] [PubMed] [Google Scholar]
- 19.Cook SF, Lanza L, Zhou X, Sweeney CT, Goss D, Hollis K, Mangel AW, Fehnel SE. Gastrointestinal side effects in chronic opioid users: results from a population-based survey. Aliment Pharmacol Ther. 2008;27:1224–32. doi: 10.1111/j.1365-2036.2008.03689.x. [DOI] [PubMed] [Google Scholar]
- 20.Tassinari D, Sartori S, Tamburini E, Scarpi E, Raffaeli W, Tombesi P, Maltoni M. Adverse effects of trans-dermal opiates treating moderate-severe cancer pain in comparison to long-acting morphine: a meta-analysis and systematic review of the literature. J Palliat Med. 2008;11:492–501. doi: 10.1089/jpm.2007.0200. [DOI] [PubMed] [Google Scholar]
- 21.Hjalte F, Berggren AC, Bergendahl H, Hjortsberg C. The direct and indirect costs of opioid-induced constipation. J Pain Symptom Manage. 2010;40:696–703. doi: 10.1016/j.jpainsymman.2010.02.019. [DOI] [PubMed] [Google Scholar]
- 22.Bell TJ, Panchal SJ, Miaskowski C, Bolge SC, Milanova T, Williamson R. The prevalence, severity, and impact of opioid-induced bowel dysfunction: results of a US and European Patient Survey (PROBE 1) Pain Med. 2009;10:35–42. doi: 10.1111/j.1526-4637.2008.00495.x. [DOI] [PubMed] [Google Scholar]
- 23.Holzer P, Ahmedzai SH, Niederle N, Leyendecker P, Hopp M, Bosse B, Spohr I, Reimer K. Opioid-induced bowel dysfunction in cancer-related pain: causes, consequences, and a novel approach for its management. J Opioid Manag. 2009;5:145–51. doi: 10.5055/jom.2009.0015. [DOI] [PubMed] [Google Scholar]
- 24.Chamberlain BH, Cross K, Winston JL, Thomas J, Wang W, Su C, Israel RJ. Methylnaltrexone treatment of opioid-induced constipation in patients with advanced illness. J Pain Symptom Manage. 2009;38:683–90. doi: 10.1016/j.jpainsymman.2009.02.234. [DOI] [PubMed] [Google Scholar]
- 25.Sloots CE, Rykx A, Cools M, Kerstens R, De Pauw M. Efficacy and safety of prucalopride in patients with chronic noncancer pain suffering from opioidinduced constipation. Dig Dis Sci. 2010;55:2912–21. doi: 10.1007/s10620-010-1229-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Gaertner J, Siemens W, Camilleri M, Davies A, Drossman DA, Webster L, Becker G. Definitions, assessment tools and outcomemeasures of clinical trials regarding opioid-induced constipation: a systematic review. J Clin Gastroenterol. 2014 doi: 10.1097/MCG.0000000000000246. In press. [DOI] [PubMed] [Google Scholar]
- 27.Choung RS, Locke GR, 3rd, Schleck CD, Zinsmeister AR, Talley NJ. Cumulative incidence of chronic constipation: a population-based study 1988–2003. Aliment Pharmacol Ther. 2007;26:1521–8. doi: 10.1111/j.1365-2036.2007.03540.x. [DOI] [PubMed] [Google Scholar]
- 28.Webster L, Dhar S, Eldon M, Masuoka L, Lappalainen J, Sostek M. A phase 2, double-blind, randomized, placebo-controlled, dose-escalation study to evaluate the efficacy, safety, and tolerability of naloxegol in patients with opioid-induced constipation. Pain. 2013;154:1542–50. doi: 10.1016/j.pain.2013.04.024. [DOI] [PubMed] [Google Scholar]
- 29.Clark K, Currow DC. Constipation in palliative care: what do we use as definitions and outcome measures? J Pain Symptom Manage. 2013;45:753–62. doi: 10.1016/j.jpainsymman.2012.03.016. [DOI] [PubMed] [Google Scholar]
- 30.Camilleri M. Opioid-induced constipation: challenges and therapeutic opportunities. Am J Gastroenterol. 2011;106:835–42. doi: 10.1038/ajg.2011.30. [DOI] [PubMed] [Google Scholar]
- 31.Kaufman PN, Krevsky B, Malmud LS, Maurer AH, Somers MB, Siegel JA, Fisher RS. Role of opiate receptors in the regulation of colonic transit. Gastroenterology. 1988;94:1351–6. doi: 10.1016/0016-5085(88)90673-7. [DOI] [PubMed] [Google Scholar]
- 32.Maurer AH, Krevsky B, Knight LC, Brown K. Opioid and opioid-like drug effects on whole-gut transit measured by scintigraphy. J Nucl Med. 1996;37:818–22. [PubMed] [Google Scholar]
- 33.Heaton KW, Radvan J, Cripps H, Mountford RA, Braddon FE, Hughes AO. Defecation frequency and timing, and stool form in the general population: a prospective study. Gut. 1992;33:818–24. doi: 10.1136/gut.33.6.818. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Phongsamran PV, Kim JW, Cupo Abbott J, Rosenblatt A. Pharmacotherapy for hepatic encephalopathy. Drugs. 2010;70:1131–48. doi: 10.2165/10898630-000000000-00000. [DOI] [PubMed] [Google Scholar]
- 35.Nullens S, Nelsen T, Camilleri M, Burton D, Eckert D, Iturrino J, Vazquez-Roque M, Zinsmeister AR. Regional colon transit in patients with dys-synergic defaecation or slow transit in patients with constipation. Gut. 2012;61:1132–9. doi: 10.1136/gutjnl-2011-301181. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Panchal SJ, Müller-Schwefe P, Wurzelmann JI. Opioid-induced bowel dysfunction: prevalence, pathophysiology and burden. Int J Clin Pract. 2007;61:1181–7. doi: 10.1111/j.1742-1241.2007.01415.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Thomas JR, Cooney GA, Slatkin NE. Palliative care and pain: new strategies for managing opioid bowel dysfunction. J Palliat Med. 2008;11:S1–19. doi: 10.1089/jpm.2008.9839.supp. quiz S21–2. [DOI] [PubMed] [Google Scholar]
- 38.Caraceni A, Hanks G, Kaasa S, Bennett MI, Brunelli C, Cherny N, Dale O, De Conno F, et al. Use of opioid analgesics in the treatment of cancer pain: evidence-based recommendations from the EAPC. Lancet Oncol. 2012;13:e58–68. doi: 10.1016/S1470-2045(12)70040-2. [DOI] [PubMed] [Google Scholar]
- 39.Smith B. Effect of irritant purgatives on the myenteric plexus in man and the mouse. Gut. 1968;9:139–43. doi: 10.1136/gut.9.2.139. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Milner P, Belai A, Tomlinson A, Hoyle CH, Sarner S, Burnstock G. Effects of long-term laxative treatment on neuropeptides in rat mesenteric vessels and caecum. J Pharm Pharmacol. 1992;44:777–9. doi: 10.1111/j.2042-7158.1992.tb05520.x. [DOI] [PubMed] [Google Scholar]
- 41.Full Prescribing Information. Bethesda, MD: Sucampo Pharma Americas, LLC; Deerfield, IL: Takeda Pharmaceuticals America, Inc; 2013. Amitiza® (lubiprostone capsules) [Google Scholar]
- 42.Mazen Jamal M, Mareya SM, Woldegeorgis F, Joswick TR, Ueno Joswick R. Lubiprostone significantly improves treatment response in nonmethadone opioid-induced bowel dysfunction patients with chronic, non-cancer pain: results from a phase 3, randomized, double-blind, placebo-controlled clinical trial. Gastroenterology. 2012;142:S144–5. [Google Scholar]
- 43.Stein C, Clark JD, Oh U, Vasko MR, Wilcox GL, Overland AC, Vanderah TW, Spencer RH. Peripheral mechanisms of pain and analgesia. Brain Res Rev. 2009;60:90–113. doi: 10.1016/j.brainresrev.2008.12.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Liu M, Wittbrodt E. Low-dose oral naloxone reverses opioid-induced constipation and analgesia. J Pain Symptom Manage. 2002;23:48–53. doi: 10.1016/s0885-3924(01)00369-4. [DOI] [PubMed] [Google Scholar]
- 45.Sykes NP. An investigation of the ability of oral naloxone to correct opioid-related constipation in patients with advanced cancer. Palliat Med. 1996;10:135–44. doi: 10.1177/026921639601000208. [DOI] [PubMed] [Google Scholar]
- 46.Full Prescribing Information. Raleigh, NC: Salix Pharmaceuticals, Inc; 2012. Relistor® (methylnaltrexone bromide subcutaneous injection) [Google Scholar]
- 47.Full Prescribing Information. Lexington, MA: Cubist Pharmaceuticals, Inc; 2012. Entereg® (alvimopan) [Google Scholar]
- 48.Kraft MD. Emerging pharmacologic options for treating postoperative ileus. Am J Health Syst Pharm. 2007;64:S13–20. doi: 10.2146/ajhp070430. [DOI] [PubMed] [Google Scholar]
- 49.Talley NJ, Zinsmeister AR, Van Dyke C, Melton LJ., 3rd Epidemiology of colonic symptoms and the irritable bowel syndrome. Gastroenterology. 1991;101:927–34. doi: 10.1016/0016-5085(91)90717-y. [DOI] [PubMed] [Google Scholar]
- 50.Cuppoletti J, Chakrabarti J, Tewari K, Malinowska DH. Methadone but not morphine inhibits lubiprostone-stimulated Cl- currents in T84 intestinal cells and recombinant human ClC-2, but not CFTR Cl- currents. Cell Biochem Biophys. 2013;66:53–63. doi: 10.1007/s12013-012-9406-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Merkel IS, Locher J, Burgio K, Towers A, Wald A. Physiologic and psychologic characteristics of an elderly population with chronic constipation. Am J Gastroenterol. 1993;88:1854–9. [PubMed] [Google Scholar]
- 52.Skollerud LM, Fredheim OM, Svendsen K, Skurtveit S, Borchgrevink PC. Laxative prescriptions to cancer outpatients receiving opioids: a study from the Norwegian prescription database. Support Care Cancer. 2013;21:67–73. doi: 10.1007/s00520-012-1494-8. [DOI] [PubMed] [Google Scholar]
- 53.Webster L, Jansen JP, Peppin J, Lasko B, Irving G, Morlion B, Snidow J, Pierce A, et al. Alvimopan, a peripherally acting mu-opioid receptor (PAM-OR) antagonist for the treatment of opioidinduced bowel dysfunction: results from a randomized, double-blind, placebo- controlled, dose-finding study in subjects taking opioids for chronic non-cancer pain. Pain. 2008;137:428–40. doi: 10.1016/j.pain.2007.11.008. [DOI] [PubMed] [Google Scholar]
- 54.Larkin PJ, Sykes NP, Centeno C, Ellershaw JE, Elsner F, Eugene B, Gootjes JR, Nabal M, et al. The management of constipation in palliative care: clinical practice recommendations. Palliat Med. 2008;22:796–807. doi: 10.1177/0269216308096908. [DOI] [PubMed] [Google Scholar]
- 55.Ishihara M, Ikesue H, Matsunaga H, Suemaru K, Kitaichi K, Suetsugu K, Oishi R, Sendo T, et al. A multiinstitutional study analyzing effect of prophylactic medication for prevention of opioid-induced gastrointestinal dysfunction. Clin J Pain. 2012;28:373–81. doi: 10.1097/AJP.0b013e318237d626. [DOI] [PubMed] [Google Scholar]
- 56.National Comprehensive Care Network (NCCN) Clinical Practice Guidelines in Oncology v.2. 2013 Available at: http://www.nccn.org/professionals/physician_gls/pdf/pain.pdf.
- 57.Ross GR, Gabra BH, Dewey WL, Akbarali HI. Morphine tolerance in the mouse ileum and colon. J Pharmacol Exp Ther. 2008;327:561–72. doi: 10.1124/jpet.108.143438. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Rosti G, Gatti A, Costantini A, Sabato AF, Zucco F. Opioid-related bowel dysfunction: prevalence and identification of predictive factors in a large sample of Italian patients on chronic treatment. Eur Rev Med Pharmacol Sci. 2010;14:1045–50. [PubMed] [Google Scholar]
- 59.Rentz AM, Yu R, Muller-Lissner S, Leyendecker P. Validation of the Bowel Function Index to detect clinically meaningful changes in opioidinduced constipation. J Med Econ. 2009;12:371–83. doi: 10.3111/13696990903430481. [DOI] [PubMed] [Google Scholar]
- 60.Camilleri M, Rothman M, Ho KF, Etropolski M. Validation of a bowel function diary for assessing opioidinduced constipation. Am J Gastroenterol. 2011;106:497–506. doi: 10.1038/ajg.2010.431. [DOI] [PubMed] [Google Scholar]
- 61.Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011] The Cochrane Collaboration; 2011. Available at: www.cochrane-handbook.org. [Google Scholar]