ABSTRACT
BACKGROUND
Pain is the most common presenting problem in primary care. Opioid therapy (OT) for chronic pain has increased dramatically over the past decade, as have related negative outcomes. Despite the development and dissemination of policy and clinical practice guidelines for pain management and OT, adoption has been variable. The Veterans Health Administration (VHA) has established a Stepped Care Model of Pain Management (SCM-PM) as an evidence-based framework and single standard of pain care to promote guideline-concordant care, but to date its adoption and related outcomes have not been systematically examined.
OBJECTIVE
Our aim was to examine changes in care for Veterans receiving long-term OT for management of chronic pain over a four-year study period.
DESIGN
As part of a comprehensive implementation evaluation of performance improvements, the current evaluation reports performance improvement outcomes related to pain management and OT over a four-year period.
SUBJECTS
We studied Veterans receiving long-term (90+ consecutive days) OT through primary care.
INTERVENTIONS
We engaged an interdisciplinary clinical-research team to develop and implement a multifaceted performance improvement approach that included interactive educational strategies and other organizational initiatives.
MAIN MEASURES
We measured the proportion of patients receiving long-term OT; use of opioid risk mitigation strategies; referrals to pain-related specialty services; and use of non-opioid analgesics.
KEY RESULTS
The proportion of patients receiving high-dose opioids decreased over four years (27.7 % to 24.7 %). The use of opioid risk mitigation strategies increased significantly. Referrals to physical therapy and chiropractic care and prescriptions for topical analgesics increased significantly, while referrals to the pain medicine specialty clinic decreased.
CONCLUSIONS
We demonstrate improvements in the management of veterans receiving OT that are consistent with the SCM-PM and published practice guidelines. We highlight how partnerships among funders, researchers, clinicians, and administrators contributed to the project’s design and implementation, and to the dissemination strategy and future directions for improving opioid management and pain care.
KEY WORDS: pain, primary care, veterans
INTRODUCTION
Chronic non-cancer pain is one of the most common presenting problems in primary care.1–4 Within the United States, the number of individuals with chronic pain and the associated cost burden exceeds those of cancer, diabetes, and heart disease combined.5,6 Prevalence of pain among Veterans is high, with estimates ranging from 50 to 75 %.1,3,7 Within and outside of the Veterans Health Administration (VHA), rates of opioid prescribing for chronic pain management, as well as negative outcomes related to opioid use, including abuse and unintentional deaths, have increased significantly over time.8–10 Veterans with chronic pain seen in VHA primary care clinics have a high lifetime prevalence of mental health and substance use disorders, and a significant minority have a documented history of behaviors suggesting potential opioid abuse, including reports of lost or stolen opioids, repeated requests for early refills, or multiple providers prescribing opioids.2,11,12 While guidelines for managing chronic pain and mitigating risks of long-term opioid therapy (OT) have been developed and published,13–15 uptake has been variable, despite evidence demonstrating that guideline-concordant care is associated with reduced healthcare costs and improved outcomes.16–18
The Veterans Health Administration (VHA) has identified pain management as a high priority, with opioid safety as one of the primary foci of quality improvement efforts.19 Broadly speaking, the VHA’s approach has been two-pronged: increasing safe opioid prescribing practices and bolstering non-opioid, multi-modal pain care. The latter aspect is guided by the evidence-based Stepped Care Model of Pain Management (SCM-PM), where management of most common pain conditions occurs in the primary care setting with stepped support from pain specialty care services as needed.20
While addressing opioid safety issues and adoption of the SCM-PM has widespread support throughout the VHA, to date, uptake within the healthcare system has not been rigorously studied. In light of this gap, a public–private partnership involving the VHA Pain Management Program office, local facility clinical and administrative leaders, and two private foundations, the Donaghue Medical Research Foundation and the Mayday Fund, was established. This partnership supported a four-year study of opioid prescribing and the SCM-PM at VA Connecticut Healthcare System (VACHS). The vision of the project, referred to as “Project Step,” was to engage VACHS as a “learning organization,” to examine and facilitate local efforts to implement opioid safety practices, and the SCM-PM as an aid in national VHA implementation efforts.21
METHODS
Study Design
The primary objectives of Project Step were to develop and engage action-oriented interdisciplinary teams to foster collaborative, partnered initiatives to advance guideline-concordant care for patients with chronic pain, including those receiving OT, and to promote organizational improvements in pain care consistent with the SCM-PM. We employed mixed qualitative and quantitative methods to evaluate these quality improvement efforts on key processes and outcomes, and to inform the sustainable quality improvement approach.22 While results of the qualitative evaluations have been reported elsewhere,23–25 in this report, we focus on implementation efforts related to opioid safety, given the importance and timeliness of the topic with respect to public health and because this objective was prioritized by our VHA partners. Here we report solely on quantitative outcomes of primary care provider behavior based on the VHA electronic health record (EHR).
The study was approved by the VACHS Institutional Review Board and the Yale Human Investigation Committee.
Development of a Multifaceted Approach to Promote Organizational Improvements
Qualitative evaluations of narratives from primary care providers (PCPs), primary care nurses, and specialists regarding their experiences in caring for patients with pain, reported elsewhere, served as the impetus for initial discussions among Project Step team members and partners about organizational and educational initiatives.23–25 Consistent with published recommendations21,26, a multifaceted, partnered approach to promote organizational improvements was identified and enacted. Although a comprehensive discussion of the initiatives undertaken is beyond the scope of this paper, we summarize initiatives that are most relevant to improving care among patients receiving long-term OT for chronic pain.27
Engagement of a Clinical-research Team
Particularly important to the foundation funding partners was a project that not only addressed an important clinical issue, but that also explored the role of “team building” in promoting organizational change. Project Step involved development of an interdisciplinary clinical-research team at VACHS that collaborated to plan, implement, and analyze the process of adoption of the SCM-PM. This team consisted of the Project Step coordinator—a doctoral-level psychologist—and research staff, facility “pain champions” from primary care and specialty pain care settings, and representatives from the hospital quality management and hospital education services. The team met biweekly for the first three years of the project, and monthly during the final year. The agenda for each meeting included a review of progress on prior and ongoing interventions, including a consideration of relevant qualitative and quantitative data as described below; planning new interventions; brainstorming additional ideas for interventions; and reviewing inter-meeting assignments and the agenda for the next meeting. In this way, there was an explicit attempt to use data derived from Project Step to both inform the discussion about interventions and to monitor progress and outcomes.
As the qualitative data highlighted, the educational needs of PCPs and staff were prioritized. A number of interactive education and training sessions were provided on topics such as pain assessment and diagnosis, the biopsychosocial model and its application to treatment and assessment of chronic pain28, non-opioid pharmacological management of pain, and non-pharmacological approaches to pain management. Particular emphasis was placed on education regarding safe opioid prescribing—including information on dosing, guidelines, and risk mitigation strategies (i.e., use of opioid pain care agreements and frequent urine drug testing)—as well as effective communication with patients about opioids and pain care. In response to PCP reports of difficulty with determining when and to which specialty service to refer patients for additional pain management options, education was provided on pain specialty services available at VACHS and steps for referral to each service. Learning objectives, session content and structure, and evaluation methods were developed by the team, and several team members served as faculty.
In order to foster a supportive environment for providers, as well as to develop unified approaches to managing complex issues in chronic pain, both formal and informal peer support services were implemented. A primary care “Pain Champion” organized a small interdisciplinary group of primary care colleagues who served as a “Peer Support Team” and offered monthly case-based discussion sessions open to all primary care staff.
A package of progress note templates, termed the “Primary Care Pain Toolkit,” was developed and made available in the EHR. This package included note templates for assessing pain, safety and effectiveness of opioids prior to opioid renewal, and risk for aberrant opioid-related behaviors.29 In addition, a template of the opioid pain care agreement, a tool for promoting information exchange and shared decision makingbetween providers and patients about roles and responsibilities related to opioid therapy, was developed to aid in documentation. The routine use of opioid pain care agreements for all patients receiving OT was emphasized as a widely accepted standard of practice.
Engagement of Partners
Sustained engagement of partners was viewed as a particularly important goal of the project. The Project Step Principal Investigator (RDK), who was also the VHA National Program Director for Pain Management, met monthly via teleconference and yearly in person with a multidisciplinary VHA National Pain Management Strategy Coordinating Committee to discuss the project, its findings, and related policy implications. Input from this senior leadership team was particularly important in helping the local clinical research team stay abreast of a large and continually evolving list of policy and practice initiatives that were especially relevant to Project Step.
In addition, the Project Step team met yearly, in person, with senior representatives from both private foundations to review progress, plan next steps, and generate new ideas for implementation and dissemination initiatives. Two examples can be cited as evidence of the strength of the partnership and the role of partners in influencing performance improvement interventions. From the outset, foundation partners were particularly enthusiastic about our inclusion of qualitative data from providers and nurses to inform the selection and design of our interventions. Upon reviewing the earliest narrative data, these partners encouraged the development of a “Peer Support Team” to address providers’ and nurses’ reports of being frankly threatened by patients related to opioid prescribing. Similarly, discussion of both qualitative and quantitative data suggesting inefficiencies in processes of referring patients for specialty pain management services led to the development of a primary-care-based Integrated Pain Clinic to promote patient-centered plans of care, efficiencies in use of specialists, and care coordination. These sustained relationships assured a process of continued influence of the partners on the operational plan of Project Step, and supported a strong and continually evolving dissemination plan.
Participants
The sample consisted of all veterans who were prescribed at least 90 consecutive days of opioids by a VA PCP within a given year and who attended at least one primary care visit at VACHS during the study years (July 2008 to June 2012, N = 2,261 of 178,144). Receipt of opioids was based on one or more prescriptions in the EHR for VHA class CN101 drugs, which includes: codeine, fentanyl, hydrocodone, methadone, morphine, oxycodone, oxymorphone, and hydromorphone. We excluded buprenorphine. There were no patient exclusion criteria.
Clinical Outcome Evaluation
We evaluated whether level of opioids prescribed differed by year based on mutually exclusive categories of average daily morphine equivalent dose (MED) (< 20 MED, 20–119 MED, or ≥ 120 MED). These categories were used because high dose opioid prescribing has been associated with increased adverse events, including overdose deaths,30–35 and the criteria have been used in clinical guidelines.14,15 EHR information was also extracted to assess for documentation of an opioid pain care agreement and annual urine toxicology testing.
Pain intensity, assessed during primary care visits using the 0 (no pain) to 10 (worst pain imaginable) pain numerical rating scale and entered as a vital sign, was also extracted from the EHR. We used the highest pain intensity rating entered during each year for each patient in the sample. Information was also extracted to determine whether patients in the sample had an opioid pain care agreement documented in the EHR and whether urine drug testing had been completed within a one-year time frame.
We extracted information from the EHR on referrals from primary care providers (n = 60) to specialty services that were deemed to be particularly relevant to different aspects of pain care—specifically, physical therapy, pain medicine, chiropractic medicine, and mental health.
Prescriptions for other pain-related medications were also extracted, including topical analgesics, non-steroidal anti-inflammatory drugs, anticonvulsants, and antidepressants (specifically, selective serotonin and norepinephrine reuptake inhibitors and tricyclic antidepressants).
Statistical Analyses
We used generalized linear models with unstructured covariance matrices to estimate the association of patient demographic and clinical characteristics with receipt of evaluation metrics by year, and to account for the potential repeated measures on patients in each of the years of observation. Generalized estimating equations (GEE) with logit link were used for dichotomous outcomes. For instances in which the model failed to converge, we used an autoregressive (AR1) covariance matrix. Post-hoc follow-up tests used Bonferroni adjustment. All analyses were conducted in SAS 9.2 (SAS Institute Inc., Cary, NC).
RESULTS
The majority of the sample was male (95.4 %) and the proportion of males did not differ by year (p = 0.72). The mean age was 61.9 (SD = 23.4) and increased over the four study years from 60.1 in year 2008–09 to 63.1 in year 2011–12 (p < 0.0001).
The overall proportion of patients receiving long term OT in primary care remained consistent over time (1.3 %, p = 0.20). However, among patients receiving OT, the proportion of patients receiving the different dose levels varied over time (p =0.02; see Fig. 1). Follow-up comparisons from year 1 to year 4 (p =0.0079) indicated that the proportion of patients increased for lower doses (< 20 MED), and decreased for higher doses (≥ 20 MED).
Figure 1.
Percent of patients receiving low, moderate or high average daily morphine equivalent dose (MED) by Project Step year.
Table 1 presents study outcomes over each of the four Project Step years. The mean highest reported pain intensity rating was 6.52 and did not differ by year. Rates of opioid pain care agreements and yearly urine drug testing significantly increased over the four study years. Provider referrals to chiropractic care and physical therapy significantly increased over time. Referrals to the pain medicine service significantly decreased over time. There were no significant changes in mental health referrals. Prescriptions for non-opioid pain medications tended to increase over time, although only prescribing of topical analgesics increased significantly.
Table 1.
Pain, Opioid Safety, Pain Support Services and Alternative Prescription Outcomes by Project Step Year*
| Project Step Year | p value | ||||
|---|---|---|---|---|---|
| 2008–09 | 2009–10 | 2010–11 | 2011–12 | ||
| Maximum Pain Severity Rating, mean (SD) | 6.50 (2.78) | 6.54 (2.79) | 6.39 (2.87) | 6.65 (2.77) | 0.38 |
| Opioid Safety | |||||
| Opioid Agreement, % (n) | 27.9%a (154) | 71.5%b (426) | 76.5%c (442) | 81.1%c (434) | <0.0001 |
| Urine Toxicology Test, % (n) | 52.5%a (290) | 82.4%b (491) | 78.9%b (456) | 79.6%b (426) | <0.0001 |
| Pain Support Services | |||||
| Mental Health Referral, % (n) | 9.4 % (52) | 8.6 % (51) | 8.1 % (47) | 8.2 % (44) | 0.77 |
| Physical Therapy Referral, % (n) | 21.9%a (121) | 24.5 % (146) | 26.1 % (151) | 29.7%b (159) | 0.02 |
| Pain Management Referral,% (n) | 13.6 % (75) | 16.5%a (97) | 11.7%b (66) | 11.5%b (61) | 0.04 |
| Chiropractic Referral,% (n) | 1.8%a (10) | 2.5 % (15) | 2.1%a (12) | 5.2%b (28) | 0.02 |
| Alternative Prescriptions | |||||
| Topical Analgesic, % (n) | 3.3%a (17) | 4.9 % (29) | 6.9%b (41) | 5.4 % (29) | 0.02 |
| NSAID ,% (n) | 20.5 % (113) | 23.3 % (139) | 24.4 % (141) | 21.9 % (117) | 0.10 |
| Antidepressant/neuro, % (n) | 17.0 % (94) | 17.8 % (106) | 18.0 % (104) | 20.9 % (112) | 0.45 |
| Anticonvulsant, % (n) | 27.4 % (151) | 29.4 % (175) | 28.0 % (162) | 31.4 % (168) | 0.13 |
*Patients could be included in multiple cohort years
a, b, c Groups with different letter superscripts are significantly different from each other
DISCUSSION
This project addresses two widely recognized public health challenges, namely the need to improve care of persons with chronic pain and the opioid abuse crisis. This is the first study to investigate the SCM-PM over time in an integrated healthcare system, as opposed to a tightly controlled clinical trial. The VHA’s SCM-PM has been identified as an innovative model for efforts to transform pain care in the US, and represents a systematic, evidence-based approach to providing appropriate pain care in a timely, cost-effective manner consistent with the level of need. This project was driven by a desire among our partners not only to evaluate the SCM-PM, but also to improve opioid safety, given the significance of this area of study and improvement both within and outside of VHA. Although the design precludes a purely causal explanation, the findings are consistent with the idea that the organizational improvement efforts were effective. Evidence of improvements in the management of veterans receiving long term OT that are consistent with the SCM-PM and published practice guidelines are particularly promising and encourage transportability.
There were notable differences in degree of change among the metrics, suggesting that diffusion and uptake can vary a great deal, depending on both the metric as well as the method of diffusion or implementation. The most dramatic changes made were in the area of opioid risk mitigation, namely use of opioid pain care agreements and routine urine toxicology testing. These changes may have increased more dramatically because of specific guidance from the Pain Management program leadership and the prioritization of this issue among PCPs and nurses, as documented in the Project Step qualitative data. Further, decision and documentation support was easily available to providers through the use of note templates in the EHR, which also likely increased uptake of use. Smaller changes were observed for utilization of multimodal pain care, perhaps because recommendations regarding multimodal pain are much broader in nature. While use of opioid pain care agreements and urine toxicology have emerged as universal standards for all patients receiving long-term OT, expectations for multimodal pain care can be met via multiple pathways. An additional challenge relates to limitations of the EHR in reliably capturing a growing array of complementary health approaches to chronic pain management, including cognitive-behavioral therapy, yoga, and acupuncture, among others. It is possible that if a more comprehensive composite measure of engagement in multimodal pain care was developed and assessed, observed changes would be greater and consistent with a larger clinical and public health impact.
It is important to note limitations of the current findings. First, the study was conducted only in VACHS. Despite the diversity of VACHS, there are many unevaluated factors that may affect implementation and adaptability to other settings.36 Second, the study used only VHA EHR data. Third, information collected about providers is limited. Demographic information about providers was not collected, and likely changed over the course of the four years, given staff turnover. Information on “dose” is also limited, given that, while generally well-attended, provider education meetings were not mandatory and data on the number of providers attending each session were not collected. Data on the use of additional resources developed by the Project Step team, such as progress note templates and clinical decision support tools, are also not available. Further, our analytic approach did not permit examination of individual provider behavior, so it is possible that observed changes are largely attributable to a subgroup of providers rather than more broadly distributed. Finally, we assessed changes related only to the behavior of providers. However, patient engagement in these services is also necessary in order to achieve benefit. Future studies could examine factors that predict patient engagement in services and effective utilization of non-opioid pharmacological pain treatments, as well as the role of providers in facilitating patient engagement and treatment adherence.
Project Step is currently in its fifth year due to a no cost extension of the project. Sustainment of continuous performance improvement efforts related to pain management is ensured by the elevated status of similar initiatives nationally and regionally in VHA to promote successful implementation of the SCM-PM. Several members of the Project Step team now serve in key leadership roles at VACHS, including a restructured facility pain committee that is chaired by and includes additional members of the Project Step team who continue to promote adoption of the project’s core principles, metrics, and processes. New funding from VHA and from the National Institutes of Health also promise to support a positive legacy and continued advancement of Project Step’s aims and objectives.
CONCLUSION
Findings provide evidence of significant improvements in guideline-concordant pain care for veterans receiving long-term OT in a VHA primary care setting. A significant decrease in referrals to pain medicine specialists was observed, suggesting enhanced competencies of primary care providers and decreased reliance on pain medicine specialists to address issues related to problematic OT, consistent with the goals of the SCM-PM. Importantly, in addition to declines in the proportion of veterans receiving high dose OT, we observed substantial increases in OT risk mitigation strategies and referral to several pain specialty care services. Given the focus on opioid safety in recent years, our findings seem promising from a public health perspective. Our experience encourages engagement of interdisciplinary teams, including key stakeholder groups and partnerships to promote organizational improvements to promote increased use of risk mitigation strategies and integrated, multimodal care for patients receiving OT for chronic pain.
Acknowledgements
Contributors
The authors wish to thank the large number of individuals who have contributed to Project Step. These include members of the Project Step research team and our clinical partners at VACHS: Daren Anderson, Wendy Bellmore, Lucile Burgo, Wesley Gilliam, Gerald Grass, Allison Lee, Forrest Levin, Lesiley Lincoln, Linda Pellico, and Christopher Ruser.
Funders
Drs. Becker, Dorflinger, Goulet, Moore and Kerns were supported by a Program for Research Leadership Award from the Patrick and Catherine Weldon Donaghue Medical Research Foundation and Mayday Fund. Dr. Becker was supported by a Veterans Health Administration Health Services Research & Development Career Development Award (08–276). Drs. Kerns and Heapy were supported by the Veterans Health Administration Health Services Research and Development Service Center of Innovation (CIN 13–407).
Prior presentations
Portions of this paper were presented at the 19th Annual International Scientific Symposium on Improving the Quality and Value of Health Care, Orlando, FL, and will be presented at the 33rd annual scientific meeting of the American Pain Society, Tampa, FL.
Disclaimer
The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the United States government.
Conflict of Interest
The authors declare that they do not have a conflict of interest.
REFERENCES
- 1.Kerns RD, Otis J, Rosenberg R, Reid MC. Veterans’ reports of pain and associations with ratings of health, health-risk behaviors, affective distress, and use of the healthcare system. J Rehabil Res Dev. 2003;40(5):371–379. doi: 10.1682/JRRD.2003.09.0371. [DOI] [PubMed] [Google Scholar]
- 2.Reid MC, Engles-Horton LL, Weber MB, Kerns RD, Rogers EL, O’Connor PG. Use of opioid medications for chronic noncancer pain syndromes in primary care. J Gen Intern Med. 2002;17(3):173–179. doi: 10.1046/j.1525-1497.2002.10435.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Haskell SG, Heapy A, Reid MC, Papas RK, Kerns RD. The prevalence and age-related characteristics of pain in a sample of women veterans receiving primary care. J Wom Health. 2006;15(7):862–869. doi: 10.1089/jwh.2006.15.862. [DOI] [PubMed] [Google Scholar]
- 4.Upshur CC, Luckmann RS, Savageau JA. Primary care provider concerns about management of chronic pain in community clinic populations. J Gen Intern Med. 2006;21(6):652–655. doi: 10.1111/j.1525-1497.2006.00412.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Gaskin DJ, Richard P. The economic costs of pain in the United States. J Pain. 2012;13(8):715–724. doi: 10.1016/j.jpain.2012.03.009. [DOI] [PubMed] [Google Scholar]
- 6.Tsang A, Von Korff M, Lee S, Alonso J, Karam E, Angermeyer MC, et al. Common chronic pain conditions in developed and developing countries: gender and age differences and comorbidity with depression-anxiety disorders. J Pain. 2008;9(10):883–891. doi: 10.1016/j.jpain.2008.05.005. [DOI] [PubMed] [Google Scholar]
- 7.Gironda RJ, Clark ME, Massengale JP, Walker RL. Pain among veterans of Operations Enduring Freedom and Iraqi Freedom. Pain Med. 2006;7(4):339–343. doi: 10.1111/j.1526-4637.2006.00146.x. [DOI] [PubMed] [Google Scholar]
- 8.Sites BD, Beach ML, Davis MA. Increases in the use of prescription opioid analgesics and the lack of improvement in disability metrics among users. Reg Anesth Pain Med. 2014;39(1):6–12. doi: 10.1097/AAP.0000000000000022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Manchikanti L, Fellows B, Ailinani H, Pampati V. Therapeutic use, abuse, and nonmedical use of opioids: a ten-year perspective. Pain Physician. 2010;13(5):401–435. [PubMed] [Google Scholar]
- 10.Bohnert AS, Ilgen MA, Trafton JA, Kerns RD, Eisenberg A, Ganoczy D, et al. Trends and Regional Variation in Opioid Overdose Mortality Among Veterans Health Administration Patients, Fiscal Year 2001 to 2009. Clin J Pain. 2009 doi: 10.1097/AJP.0000000000000011. [DOI] [PubMed] [Google Scholar]
- 11.Seal KH, Shi Y, Cohen G, Cohen BE, Maguen S, Krebs EE, et al. Association of mental health disorders with prescription opioids and high-risk opioid use in US veterans of Iraq and Afghanistan. JAMA. 2012;307(9):940–947. doi: 10.1001/jama.2012.234. [DOI] [PubMed] [Google Scholar]
- 12.Sekhon R, Aminjavahery N, Davis CN, Jr., Roswarski MJ, Robinette C. Compliance with Opioid Treatment Guidelines for Chronic Non-Cancer Pain (CNCP) in Primary Care at a Veterans Affairs Medical Center (VAMC). Pain Med. 2013. doi:10.1111/pme.12164 [DOI] [PubMed]
- 13.Nuckols TK, Anderson L, Popescu I, Diamant AL, Doyle B. Di Capua P, et al. A Systematic Review and Critical Appraisal of Guidelines for Chronic Pain. Ann Intern Med: Opioid Prescribing; 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Franklin GM, Mai J, Turner J, Sullivan M, Wickizer T, Fulton-Kehoe D. Bending the prescription opioid dosing and mortality curves: impact of the Washington State opioid dosing guideline. Am J Ind Med. 2012;55(4):325–331. doi: 10.1002/ajim.21998. [DOI] [PubMed] [Google Scholar]
- 15.Agency Medical Directors’ Group . Interagency Guideline on Opioid Dosing for Chronic Non-cancer Pain. Olympia, WA: Washington State Agency Medical Directors’ Group; 2010. [Google Scholar]
- 16.Kirshbaum M. The development, implementation and evaluation of guidelines for the management of breast cancer related lymphoedema. Eur J Canc Care. 1996;5(4):246–251. doi: 10.1111/j.1365-2354.1996.tb00243.x. [DOI] [PubMed] [Google Scholar]
- 17.Aucott JN, Pelecanos E, Dombrowski R, Fuehrer SM, Laich J, Aron DC. Implementation of local guidelines for cost-effective management of hypertension. A trial of the firm system. J Gen Intern Med. 1996;11(3):139–146. doi: 10.1007/BF02600265. [DOI] [PubMed] [Google Scholar]
- 18.Nardella A, Farrell M, Pechet L, Snyder LM. Continuous improvement, quality control, and cost containment in clinical laboratory testing. Enhancement of physicians’ laboratory-ordering practices. Arch Pathol Lab Med. 1994;118(10):965–968. [PubMed] [Google Scholar]
- 19.Management of Opioid Therapy for Chronic Pain Working Group. VA/DoD clinical practice guideline for management of opioid therapy for chronic pain. Washington (DC): Department of Veterans Affairs, Department of Defense; 2010.
- 20.Rosenberger PH, Kerns R. Implementation of the Va Stepped Care Model of Pain Management. Ann Behav Med. 2012;43:S265-S.
- 21.Rubenstein LV, Pugh J. Strategies for promoting organizational and practice change by advancing implementation research. J Gen Intern Med. 2006;21(Suppl 2):S58–S64. doi: 10.1007/s11606-006-0276-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–226. doi: 10.1097/MLR.0b013e3182408812. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Kerns RD, Dorflinger L, Goulet J, Moore BA, Lee A, Pellico L, et al. The Veterans Health Administration Stepped Care Model: A mixed qualitative and quantitative approach to informing and evaluating implementation. Poster Presented at the 19th Annual International Scientific Symposium on Improving the Quality and Value of Health Care; Orlando, FL2013.
- 24.Lincoln LE, Pellico L, Kerns R, Anderson DK. Barriers and Facilitators to Chronic Non-cancer Pain Management in Primary Care: A Qualitative Analysis of Primary Care Providers’ Experiences and Attitudes. Palliative Care & Medicine. 2013;S3. doi: 10.4172/2165-7386.S3-001
- 25.Pellico LH, Gilliam WP, Lee AW, Kerns RD. Hearing new voices: Registered Nurses and Health Technicians experience caring for chronic pain patients in primary care clinics. The Open Nursing Journal. in press. [DOI] [PMC free article] [PubMed]
- 26.Prior M, Guerin M, Grimmer-Somers K. The effectiveness of clinical guideline implementation strategies—a synthesis of systematic review findings. J Eval Clin Pract. 2008;14(5):888–897. doi: 10.1111/j.1365-2753.2008.01014.x. [DOI] [PubMed] [Google Scholar]
- 27.Grimshaw J, Eccles M, Tetroe J. Implementing clinical guidelines: current evidence and future implications. The Journal of Continuing Education in the Health Professions. 2004;24(Suppl 1):S31–S37. doi: 10.1002/chp.1340240506. [DOI] [PubMed] [Google Scholar]
- 28.Gatchel RJ, Peng YB, Peters ML, Fuchs PN, Turk DC. The biopsychosocial approach to chronic pain: scientific advances and future directions. Psychol Bull. 2007;133(4):581–624. doi: 10.1037/0033-2909.133.4.581. [DOI] [PubMed] [Google Scholar]
- 29.Webster LR, Webster RM. Predicting aberrant behaviors in opioid-treated patients: preliminary validation of the Opioid Risk Tool. Pain Med. 2005;6(6):432–442. doi: 10.1111/j.1526-4637.2005.00072.x. [DOI] [PubMed] [Google Scholar]
- 30.Braden JB, Russo J, Fan MY, Edlund MJ, Martin BC, DeVries A, et al. Emergency department visits among recipients of chronic opioid therapy. Arch Intern Med. 2010;170(16):1425–1432. doi: 10.1001/archinternmed.2010.273. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Dunn KM, Saunders KW, Rutter CM, Banta-Green CJ, Merrill JO, Sullivan MD, et al. Opioid prescriptions for chronic pain and overdose: a cohort study. Ann Intern Med. 2010;152(2):85–92. doi: 10.7326/0003-4819-152-2-201001190-00006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Gomes T, Mamdani MM, Dhalla IA, Paterson JM, Juurlink DN. Opioid dose and drug-related mortality in patients with nonmalignant pain. Arch Intern Med. 2011;171(7):686–691. doi: 10.1001/archinternmed.2011.117. [DOI] [PubMed] [Google Scholar]
- 33.Kidner CL, Mayer TG, Gatchel RJ. Higher opioid doses predict poorer functional outcome in patients with chronic disabling occupational musculoskeletal disorders. J Bone Joint Surg. Am Vol. 2009;91(4):919–927. doi: 10.2106/JBJS.H.00286. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Saunders KW, Dunn KM, Merrill JO, Sullivan M, Weisner C, Braden JB, et al. Relationship of opioid use and dosage levels to fractures in older chronic pain patients. J Gen Intern Med. 2010;25(4):310–315. doi: 10.1007/s11606-009-1218-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Bohnert AS, Ilgen MA, Ignacio RV, McCarthy JF, Valenstein M, Blow FC. Risk of death from accidental overdose associated with psychiatric and substance use disorders. Am J Psychiatr. 2012;169(1):64–70. doi: 10.1176/appi.ajp.2011.10101476. [DOI] [PubMed] [Google Scholar]
- 36.Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4. Doi 10.1186/1748-5908-4-50 [DOI] [PMC free article] [PubMed]

