Abstract
Background
Chronic obstructive pulmonary disease (COPD) is among the most common medical diagnoses among Veterans. More than 50% of Veterans diagnosed with mild-to-moderate COPD are prescribed inhaled corticosteroids despite recommendations for use restricted to patients with frequent exacerbations.
Objective
We explored primary care providers’ experiences prescribing inhaled corticosteroids among patients with mild-to-moderate COPD as part of a quality improvement initiative.
Design
We used a sequential mixed-methods evaluation approach to understand factors influencing primary care providers’ inhaled corticosteroid prescribing for patients with mild-to-moderate COPD. Participants were recruited to participate in qualitative interviews and structured surveys.
Participants
We used a purposive sample of primary care providers from 13 primary care clinics affiliated with two urban Veteran Health Administration healthcare systems.
Main Measures
Interviews were transcribed and analyzed using content analysis. Qualitative findings informed a subsequent survey. Surveys were administered through REDCap and analyzed descriptively. Key qualitative and quantitative findings were compared.
Key Results
Participants reported they were unaware of current evidence and recommendations for prescribing inhaled corticosteroids; for example, 46% of providers reported they were unaware of risks of pneumonia. Providers reported they are generally unable to keep up with the current literature due to the broad scope of primary care practice. We also found primary care providers may be reluctant to change inherited prescriptions, even if they thought inhaled corticosteroid therapy might not be appropriate.
Conclusions
Inhaled corticosteroid prescribing in this patient population is partly due to primary care providers’ lack of knowledge about the potential harms and availability of alternative therapies. Our findings suggest that efforts to expand access by increasing the number of prescribing providers a patient potentially sees could make it more difficult to de-implement harmful prescriptions. Our findings also corroborate prior findings that awareness of current evidence-based guidelines is likely an important part of medical overuse.
Electronic supplementary material
The online version of this article (10.1007/s11606-019-05193-2) contains supplementary material, which is available to authorized users.
KEY WORDS: de-implementation, quality improvement, mixed methods, de-prescribing, COPD
INTRODUCTION
Inhaled corticosteroids are widely used for treatment of mild-to-moderate chronic obstructive pulmonary disease (COPD) in the United States (U.S.) despite recommendations for use restricted to patients with frequent exacerbations.1 These recommendations are based on evidence of harm, the availability of safer alternative medications, and the lack of evidence for benefit to patients with less severe disease.2–4 More than 50% of patients with mild-to-moderate COPD in the U.S. are prescribed inhaled corticosteroids.5
The greatest harm associated with inhaled corticosteroid therapy is an increased risk of severe pneumonia.6–8 For every 62 patients with mild COPD who are taken off an inhaled corticosteroid, we prevent one new case of severe pneumonia.4 Prolonged exposure to inhaled corticosteroids is also associated with higher fracture risk,9 cataracts,10, 11 and poor diabetes control.12 These risks drop precipitously once inhaled corticosteroid therapy is discontinued (adjusted rate ratio = 0.63).13
There are currently efforts underway to de-implement inhaled corticosteroids among patients with mild-to-moderate COPD.14 De-implementation is the process of discontinuing an inappropriate therapy under the supervision of a healthcare provider with the goal of improving the patient’s outcomes.15 This process is referred to as deprescribing when addressing medications.16
In terms of efforts to reduce low-value care, like inhaled corticosteroids in the U.S. Veteran patient population, we know that multifaceted interventions are more likely to be effective in reducing overuse than single interventions.17 However, we do not know if this is because multifaceted interventions are more likely to include an effective component (i.e., a single effective intervention), as opposed to interventions only being effective in combination. We know that systems of care that might be expected to inhibit overuse (i.e., capitated insurance structures) appear to deliver as much low-value care as fee-for-service systems.18 There is also some reason to believe that providers have a range of misperceptions related to overuse, including a belief that provision of care is generally superior to holding off; lack of awareness of harms of overuse; and misapprehending patient preferences.19
There are also important gaps in this literature. Most researches on interventions to reduce low-value care have occurred in hospital settings, and much has implicitly focused on either provider awareness or motivation, such as pay-for-performance incentives, report cards, and education.17 Less is known about providers’ experience of overuse and deprescribing. One of the few studies that explores this looked at deprescribing in older adults and found a key issue was simply understanding alternatives.20 Much of the literature that does exist on provider perspectives on overuse19 comes from assessments of overuse in general, which, divorced from specific clinical settings and decisions, might inadvertently reinforce conventional wisdom and miss important real-world factors.
COPD is among the most common medical diagnoses Veterans receive.21, 22 In the present paper, we explored Veterans Health Administration (VHA) primary care providers’ experiences with prescribing inhaled corticosteroids among patients with mild-to-moderate COPD to understand factors influencing providers’ prescribing which might inform efforts to improve care.
METHODS
We conducted this work as part of a larger ongoing evaluation of a U.S. Department of Veterans Affairs (VA) quality improvement program to discontinue inappropriate inhaled corticosteroid prescribing in patients with mild-to-moderate COPD.23 We used sequential mixed methods using qualitative interview findings to inform subsequent development of quantitative survey questions.24 Following survey data collection, we used convergent mixed methods25 to identify qualitative data that enhanced the understanding of the survey findings or indicated potential generalizability of the qualitative findings. This work was sanctioned as quality improvement and exempt from Institutional Review Board oversight in accordance with VHA Handbook 1058.05.26 Employee unions reviewed and approved the survey instrument and interview guide prior to administration.
Participants and Setting
We purposively sampled primary care providers from 13 primary care clinics affiliated with two urban Veteran Health Administration healthcare systems. Primary care providers were recruited to participate in interviews and complete surveys. Eligible primary care providers included medical doctors, doctors of osteopathic medicine, nurse practitioners, and physician assistants. Resident physicians were excluded.
Qualitative Interviews
We used VA email to contact 177 primary care providers from both medical center sites to participate in an anonymous telephone interview for quality improvement purposes. Providers were excluded if they left the VA, no longer practiced Primary Care, or relocated to a new VHA site. Interviews were conducted with primary care providers from both sites from May 2016 to October 2017. Interviewers used a semi-structured interview guide (Appendix A online) to explore provider’s experiences with prescribing inhaled corticosteroids for COPD, familiarity with evidence and guidelines for prescribing inhaled corticosteroids, and views on discontinuation. The interview guide was informed by key constructs derived from literature on implementation and de-implementation, and a conceptual model that guided this work19, 27–29; these included understanding of evidence for and against use of a clinical practice 27–30; psychological reactance,19, 30 or negative reaction to external efforts to change or limit a provider’s behavior; and organizational contexts that support clinical change.19, 27–29 The interview guide included open-ended questions and semi-structured probes to assure uniform data collection of key topics and allowed exploration of emerging unanticipated themes generated by participants. Grounded prompts using participants’ words and phrases were used to elicit details. The interview guide was updated iteratively, a standard practice in qualitative evaluations.31, 32 Interviews lasted approximately 20–30 min. Interviews, coding, and analyses were completed by the project’s qualitative team (C.G., G.S., K.S., S.W.) possessing backgrounds in psychology and sociology.
Interviews were audio-recorded and transcribed verbatim. ATLAS.ti 7 software (Scientific Software Development GmbH, Berlin, Germany) was used for data management and coding. We collected and analyzed data concurrently. Data analyses were conducted using iterative deductive and inductive content analysis methods.33 Deductive analysis involved application of a priori codes (Appendix B online) based on key construct definitions from de-implementation literature19, 27–29 and the interview guide questions. Inductive content analysis consisted of open and unstructured coding to capture data that did not fit into a priori categories. Emergent codes were added throughout the analysis, allowing us to identify emergent and previously unidentified or unexpected themes. Broad themes were identified based on representative interview responses and grouped to describe distinct aspects of participants’ experiences. The qualitative team met weekly to discuss data and reach consensus on interpretation of themes and findings. Findings informed the subsequent survey.
Surveys
Surveys were administered through REDCap34 to 134 primary care providers between July and August 2016 (first medical center sites) and December 2016 and January 2017 (second medical center sites). Site department leads notified providers in advance that survey invitations would be sent to the providers’ VA email accounts. Survey invitations were staggered by site.
Surveys (Appendix C online) evaluated provider experiences, perceptions of discontinuing inhaled corticosteroids in mild-to-moderate COPD, and intention in use of inhaled corticosteroids for treating patients with COPD. The survey also asked about leadership and management behaviors, job-related feelings, turnover intentions, and demographics. Select questions from Maslach Burnout Inventory35 were adopted. This variation in question content was included to assess trends and direct future quality improvement initiatives.
Survey responses were exported from REDCap to Microsoft Excel 2010 for descriptive analysis. We used chi-squared tests to analyze differences between physicians and nurse practitioner responses.
RESULTS
The two sites included a population of 8495 patients with COPD diagnoses at the time the evaluation began in August 2016. Of these patients diagnosed with COPD, 3527 (42%) diagnoses were confirmed with pulmonary function test, and 1299 (15%) patients were prescribed an inhaled corticosteroid. However, 792 (61%) of these prescriptions were not clinically indicated.
Interviews were completed with 15 primary care providers comprised of two nurse practitioners, both female, and 13 physicians (nine male and four female). Surveys were completed by 46 of 134 providers (34% response rate; 10 from one site, 36 from the other) and were included in the analytic sample. Respondents’ characteristics are presented in Table 1. Findings were aggregated across sites and respondent types. We report convergent and sequential exploratory findings.
Table 1.
Survey respondents (N = 46) | ||||
---|---|---|---|---|
Provider type | Female | Male | Age, M years | Tenure with VA, M years |
Physician | 17 (52%) | 16 (48%) | 48 | 9.3 |
Nurse practitioner | 10 (77%) | 3 (23%) | 54 | 8.5 |
All | 27 (59%) | 19 (41%) | 49.7 | 9.1 |
Knowledge of Evidence and Guidelines
Qualitative analysis revealed that primary care providers were generally unaware of current evidence and recommendations for prescribing inhaled corticosteroids; this finding is related to several of our a priori codes including knowledge of guidelines, evidence strength against prescribing inhaled corticosteroids, and medication side effects. Most providers described inhaled corticosteroids as benign. Providers reported an inability to keep up with the current literature due to the broad scope of primary care practice.
“I think it’s fair to say I have no idea what the guidelines say”
“…if things don’t appear in what you normally read to stay current, then you don’t get familiar with it. It’s not like ‘I’m going to prescribe ICS, let me go read the guidelines about that’. You just don’t do that. One, you don’t have time, and two, you can’t necessarily go find that all out... in a busy, day-to-day practice, it’s not something you’d look up.”
Survey results (Table 2) showed 65% of responding providers prescribed an inhaled corticosteroid for one or more patients with mild-to-moderate COPD in the prior month. Forty-six percent reported they were unaware of the association between inhaled corticosteroids and a higher risk of pneumonia, and 52% were unaware that long-acting muscarinic antagonists (LAMAs) and long-acting beta-agonists (LABAs) are as effective as inhaled corticosteroids in reducing breathing exacerbations. Fifty percent of respondents reported they would make an effort to make greater use of long-acting agents, and 52% reported they would make an effort to reduce the use of inhaled corticosteroids.
Table 2.
Statement derived from survey question | % agree* |
---|---|
Prescribed an inhaled corticosteroid to patient with COPD in the prior month | 65%30 |
Experience | |
Unlikely to take patients off an inhaled corticosteroid prescription placed by another provider | 39%18 |
Unaware that inhaled corticosteroids were associated with a higher risk of pneumonia | 46%21 |
Unaware that LAMAs/LABAs are as effective as inhaled corticosteroids in reducing breathing exacerbations | 52%24 |
Intention | |
Would make an effort to make greater use of long-acting agents | 50%23 |
Would make an effort to reduce the use of inhaled corticosteroids | 52%24 |
*The first statement’s response options were “Yes” and “No.” All other statements’ responses were collapsed so that only responses indicating agreement or disagreement (“Strongly Disagree,” “Disagree,” or “Agree,” “Strongly Agree”) were counted towards the total in “% agree”
“If Someone Is Doing Well, Why Rock the Boat?”
Some providers expressed reluctance to change or discontinue medications if the provider perceived the patient is doing well. This was an inductive finding.
“Generally, on one hand I’d like to say in someone who’s on medication they don’t need, you should try to stop it. But deep down there’s a little hesitation that if someone is doing well, why rock the boat?”
“I’ve got patients on drugs that I wouldn’t have them on, but they insist it works, so, unless it’s a hazard to the patient, oral inhaled corticosteroids are pretty benign. They’re obviously not cheap necessarily, but they also do have side effects. But they’re not terrible… if the patient is really insisting that they’re helpful, I would tend to continue them.”
The Impact of Multiple Prescribers
Two inductive themes related to the impact of multiple prescribers on de-implementing inhaled corticosteroids emerged: inherited prescriptions and deference to experts.
Inherited Prescriptions
Participants reported reluctance to discontinue inhaled corticosteroid prescriptions patients receive from other VA or non-VA providers.
“If someone came in on ICS [inhaled corticosteroids] or if someone sees a pulmonary provider who prescribed it, I would probably be reluctant to stop it. But, most likely I would not initiate it.”
“… if they come to me and they have no adverse event on them and they are already on it, I may just leave it.”
Reluctance to discontinue inherited prescriptions was an emergent qualitative finding which informed the survey question on this topic. Thirty-nine percent of survey respondents reported they were unlikely to take patients off an inhaled corticosteroid prescription placed by another provider. There was no significant difference between physician and nurse practitioner respondents.
Deference to Experts
When pulmonologists were involved in a patient’s care, some primary care providers perceived the specialist to be responsible for discontinuing inhaled corticosteroids. Providers reported reluctance to discontinue inhaled corticosteroids; even in cases they would otherwise discontinue inhaled corticosteroids.
“I definitely have counted on pulmonology colleagues to give that guidance.”
“Would I make a recommendation for a pulmonary medication to a pulmonologist? Probably not.”
DISCUSSION
Our findings are consistent with our hypothesis that inhaled corticosteroid prescribing by primary care providers in this patient population is due, in part, to lack of knowledge about the potential harms and availability of alternative therapies. However, we also found that even when primary care providers might not think an inhaled corticosteroid prescription is appropriate for their patient, they may be reluctant to make a change to the prescription when the patient presents without problems or because other providers are involved. Specifically, primary care providers reported reluctance to act when the inhaled corticosteroid prescription originated with another provider, and when they perceived the pulmonologist as having the responsibility to discontinue the patient’s medication. Although causality cannot be determined based on these findings, it is interesting to observe that deference to other providers and reluctance to discontinue inherited medications were concurrent with lack of knowledge about the harm of inhaled corticosteroids and availability of alternatives.
Our findings are consistent with and expand on previous studies that found multiple prescribing providers to have an impact on de-implementing medications. In their synthesis of qualitative studies of patient and provider perspectives on reducing medication overuse in the elderly, Bokhof and Junius-Walker36 identified deficient multidisciplinary cooperation as one of the key cross-study themes from the provider perspective; providers recognized poor cooperation as an obstacle to reducing overuse of prescriptions. This included both studies that reported dissent among providers over competing guidelines, and a preference among general practitioners that there be a clear hierarchy in terms of who was responsible for addressing patients being on too many medications. The latter appears similar to our finding of deference to experts, and a preference that the specialist takes responsibility for making changes to medications in their domain. Similarly, Ailabouni and colleagues20 reported British general practitioners are reluctant to take a patient off a medication prescribed by a specialist, e.g., a statin prescribed by a cardiologist. In our work, we found a general reluctance to de-implement an inhaled corticosteroid prescription made by another provider, without distinguishing whether that prescription came from another primary care provider or a specialist. Luymes and colleagues37 also found when specialists are perceived to disapprove, general practitioners are less willing to de-implement the medication. We found a different dynamic, in which the primary care providers felt it was the specialists’ responsibility to take action on de-implementation of inhaled corticosteroid as opposed to a fear of disapproval.
Our findings about awareness of evidence about harms and alternatives are also consistent with prior research on factors influencing over-prescribing.38 Given the scope of primary care practice, there may be variation and clear gaps in primary care providers’ awareness of evidence and current recommendations. While not a surprise, our findings are the first we know of that quantify the level of awareness about evidence related to inhaled corticosteroid use in a population of prescribing providers; approximately half of the primary care providers surveyed lacked awareness of harms from inhaled corticosteroids and the availability of alternatives. This is important in the context of efforts to decrease the use of inhaled corticosteroids for patients with mild-to-moderate COPD because in future data collection, we will assess changes over time in primary care provider awareness of harms related to inhaled corticosteroids and availability of LAMAs and LABAs.
We also wondered if nurse practitioners might be more likely to express reluctance to discontinue an inhaled corticosteroid prescribed by another provider, given the history of conflict over nurse practitioners’ prescribing authority.39 However, we found no difference in reluctance, nor in awareness of harms and alternatives treatments.
Limitations
This was an observational, self-report, cross-sectional mixed-methods approach, which limits our ability to draw causal inference. We do not know if any of the factors we identify are associated with actual prescribing and de-implementation of inhaled corticosteroids. However, this work is being conducted as part of an ongoing, randomized quality improvement effort, and future follow-up interviews and surveys will allow us to better understand how awareness of harms and alternatives change over time, and how proactive outreach by specialists influences inhaled corticosteroid prescription practices in this population.
Participation in the surveys and interviews was voluntary, and participants almost certainly differed from non-participants. Consequently, our findings may be colored by selection bias and may represent atypical views and awareness. Obtaining information on non-respondents was beyond the scope of this project, which was conducted as quality improvement, and therefore, we cannot characterize how respondents and non-respondents differed.
The provider represents only one, small—though essential—piece of the equation that leads to inappropriate inhaled corticosteroid therapy and influences de-implementation of inappropriate inhaled corticosteroid therapy. We have good reason to believe that patient knowledge and attitudes, medical culture, institutional policies, and reimbursement policies all play roles in over-prescribing and subsequent efforts at de-implementing inappropriate prescriptions.19
This work was conducted with primary care providers employed in the Veterans Health Administration, which differs in many respects from community outpatient settings, including how providers are paid and evaluated, the average severity of illness of patients being cared for, and access to specialist consultations. These differences may limit the generalizability of our findings. Nevertheless, the rate of prescriptions that were not clinically indicated that we observed in the participating clinics (61%) is similar to findings from the broader VA and the U.S.40
Conclusions
We found a broad lack of awareness of the harms of inhaled corticosteroids, and reluctance to change patients’ existing prescriptions, particularly when those prescriptions are made by another provider. Consequently, efforts to expand access by increasing the number of prescribing providers a patient potentially sees could make it more difficult to de-implement harmful prescriptions. By anticipating this, we might be able to build systematic methods for reviewing patient prescriptions. Our findings also corroborate prior findings that lack of awareness of current evidence-based guidelines, and harms related to low-value care, is likely an important contributor to medical overuse.
Electronic Supplementary Material
Acknowledgments
We are thankful to our project manager, Barbara Majerczyk, MPH, for her contributions that made this work possible. This work was supported by the United States Department of Veterans Affairs VA Quality Enhancement Research Initiative (QUERI) QUE 15-271 as part of VHA Health Care Operations in accordance with VHA Handbooks 1605.1 and 1605.2. We have previously presented a portion of these data as posters or oral presentations at the AcademyHealth Annual Conference on the Science of Dissemination & Implementation annual meetings (Washington, D.C., 2016, 2017, and 2018), the AcademyHealth Annual Research Meeting (New Orleans, LA, 2017), the Health Services Research & Development/Quality Enhancement Research Initiative National Conference (Washington, D.C., 2017), and 4th Biennial Society for Implementation Research Collaboration (Seattle, WA, 2017).
Compliance with Ethical Standards
Conflict of Interest
Dr. Feemster receives funding from NIH K23 HL111116. Dr. Au receives remuneration from Novartis Inc. for participation on a data safety monitoring board. He serves as a Deputy Editor for the Annals of the American Thoracic Society and is a member of the Exam Committee for the American Board of Internal Medicine Pulmonary Board, for which he receives remuneration. The remaining authors declare that they have no conflict of interest.
Disclaimer
The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the United States Government.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Global Initiative for Chronic Obstructive Lung Disease (GOLD). GOLD 2017 global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease, 2017 report. November 17, 2016.
- 2.Magnussen H, Disse B, Rodriguez-Roisin R, Kirsten A, Watz H, Tetzlaff K, et al. Withdrawal of inhaled glucocorticoids and exacerbations of COPD. N Engl J Med. 2014;371:1285–1294. doi: 10.1056/NEJMoa1407154. [DOI] [PubMed] [Google Scholar]
- 3.Singh S, Amin AV, Loke YK. Long-term use of inhaled corticosteroids and the risk of pneumonia in chronic obstructive pulmonary disease: a meta-analysis. Arch Intern Med. 2009;169:219–229. doi: 10.1001/archinternmed.2008.550. [DOI] [PubMed] [Google Scholar]
- 4.Wedzicha JA, Banerji D, Chapman KR, Vestbo J, Roche N, Ayers RT, et al. Indacaterol–glycopyrronium versus salmeterol–fluticasone for COPD. N Engl J Med. 2016;374:2222–2234. doi: 10.1056/NEJMoa1516385. [DOI] [PubMed] [Google Scholar]
- 5.Collins BF, Ramenofsky D, Au DH, Ma J, Uman JE, Feemster LC. The association of weight with the detection of airflow obstruction and inhaled treatment among patients with a clinical diagnosis of COPD. Chest. 2014;146:1513–1520. doi: 10.1378/chest.13-2759. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Kew KM, Seniukovich A. Inhaled steroids and risk of pneumonia for chronic obstructive pulmonary disease. Cochrane Database Syst Rev. 2014;3:CD010115. doi: 10.1002/14651858.CD010115.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Calverley Peter M.A., Anderson Julie A., Celli Bartolome, Ferguson Gary T., Jenkins Christine, Jones Paul W., Yates Julie C., Vestbo Jørgen. Salmeterol and Fluticasone Propionate and Survival in Chronic Obstructive Pulmonary Disease. New England Journal of Medicine. 2007;356(8):775–789. doi: 10.1056/NEJMoa063070. [DOI] [PubMed] [Google Scholar]
- 8.Wedzicha Jadwiga A., Calverley Peter M. A., Seemungal Terence A., Hagan Gerry, Ansari Zainab, Stockley Robert A. The Prevention of Chronic Obstructive Pulmonary Disease Exacerbations by Salmeterol/Fluticasone Propionate or Tiotropium Bromide. American Journal of Respiratory and Critical Care Medicine. 2008;177(1):19–26. doi: 10.1164/rccm.200707-973OC. [DOI] [PubMed] [Google Scholar]
- 9.Coombs C, Hislop D, Holland J, Bosley S, Manful E. Exploring types of individual unlearning by local health-care managers: an original empirical approach. Health Services and Delivery Research. 2013;1. [PubMed]
- 10.Voorn V, Marang-van de Mheen PJ, So-Osman C, Vlieland TP, Koopman-van Gemert AW, Nelissen RG, et al. Designing a strategy to implement cost-effective blood transfusion management in elective hip and knee arthroplasties: a study protocol. Implement Sci. 2012;7:58. doi: 10.1186/1748-5908-7-58. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Voorn VM, Marang-van de Mheen PJ, So-Osman C, Kaptein AA, van der Hout A, van den Akker-van Marle ME, et al. De-implementation of expensive blood saving measures in hip and knee arthroplasties: study protocol for the LISBOA-II cluster randomized trial. Implement Sci. 2014;9:48. doi: 10.1186/1748-5908-9-48. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Robert G, Harlock J, Williams I. Disentangling rhetoric and reality: an international Delphi study of factors and processes that facilitate the successful implementation of decisions to decommission healthcare services. Implement Sci. 2014;9:123. doi: 10.1186/s13012-014-0123-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Suissa S, Coulombe J, Ernst P. Discontinuation of inhaled corticosteroids in COPD and the risk reduction of pneumonia. Chest. 2015;148:1177–1183. doi: 10.1378/chest.15-0627. [DOI] [PubMed] [Google Scholar]
- 14.Wilkie M, Finch S, Schembri S. Inhaled corticosteroids for chronic obstructive pulmonary disease—the shifting treatment paradigm. COPD. 2015;12:582–590. doi: 10.3109/15412555.2014.995288. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Norton WE, Kennedy AE, Chambers DA. Studying de-implementation in health: an analysis of funded research grants. Implement Sci. 2017;12:144. doi: 10.1186/s13012-017-0655-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Reeve E, Gnjidic D, Long J, Hilmer S. A systematic review of the emerging definition of ‘deprescribing’ with network analysis: implications for future research and clinical practice. Br J Clin Pharmacol. 2015;80:1254–1268. doi: 10.1111/bcp.12732. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Colla CH, Mainor AJ, Hargreaves C, Sequist T, Morden N. Interventions aimed at reducing use of low-value health services: a systematic review. Med Care Res Rev. 2017;74:507–550. doi: 10.1177/1077558716656970. [DOI] [PubMed] [Google Scholar]
- 18.Keyhani S, Falk R, Howell EA, Bishop T, Korenstein D. Overuse and systems of care: a systematic review. Med Care. 2013;51:503–508. doi: 10.1097/MLR.0b013e31828dbafe. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Morgan DJ, Brownlee S, Leppin AL, Kressin N, Dhruva SS, Levin L, et al. Setting a research agenda for medical overuse. BMJ. 2015;351:h4534. doi: 10.1136/bmj.h4534. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Ailabouni NJ, Nishtala PS, Mangin D, Tordoff JM. Challenges and enablers of deprescribing: a general practitioner perspective. PloS one. 2016;11:e0151066. doi: 10.1371/journal.pone.0151066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Au DH, McDonell MB, Martin DC, Fihn SD. Regional variations in health status. Med Care. 2001;39:879–888. doi: 10.1097/00005650-200108000-00013. [DOI] [PubMed] [Google Scholar]
- 22.Fihn SD, McDonell MB, Diehr P, Anderson SM, Bradley KA, Aud DH, et al. Effects of sustained audit/feedback on self-reported health status of primary care patients. Am J Med. 2004;116:241–248. doi: 10.1016/j.amjmed.2003.10.026. [DOI] [PubMed] [Google Scholar]
- 23.Quality Enhancement Research Initiative (QUERI). Improving safety and quality through evidence-based de-implementation of ineffective diagnostics and therapeutics (safety & quality QUERI). Available at: https://www.queri.research.va.gov/programs/safety_quality.cfm. Accessed May 8, 2019.
- 24.Creswell JW, Fetters MD, Ivankova NV. Designing a mixed methods study in primary care. Ann Fam Med. 2004;2:7–12. doi: 10.1370/afm.104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Creswell JW, Clark VLP. Designing and conducting mixed methods research. Thousand Oaks: Sage Publications. 2017;2018:221–233. [Google Scholar]
- 26.Veterans Health Administration, Department of Veterans Affairs. VHA Handbook 1058.05 VHA operations activities that may constitute research. October 28, 2011.
- 27.Kitson AL, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008;3:1. doi: 10.1186/1748-5908-3-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Rycroft-Malone J, Seers K, Titchen A, Harvey G, Kitson A, McCormack B. What counts as evidence in evidence-based practice? J Adv Nurs. 2004;47:81–90. doi: 10.1111/j.1365-2648.2004.03068.x. [DOI] [PubMed] [Google Scholar]
- 29.McCormack B, Kitson A, Harvey G, Rycrosft-Malone J, Titchen A, Seers K. Getting evidence into practice: the meaning of ‘context’. J Adv Nurs. 2002;38:94–104. doi: 10.1046/j.1365-2648.2002.02150.x. [DOI] [PubMed] [Google Scholar]
- 30.Helfrich CD, Rose AJ, Hartmann CW, van Bodegom-Vos L, Graham ID, Wood SJ, et al. How the dual process model of human cognition can inform efforts to de-implement ineffective and harmful clinical practices: a preliminary model of unlearning and substitution. J Eval Clin Pract. 2018;24:198–205. doi: 10.1111/jep.12855. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Hill CE, Knox S, Thompson BJ, Williams EN, Hess SA, Ladany N. Consensual qualitative research: an update. J Couns Psychol. 2005;52:196–205. doi: 10.1037/0022-0167.52.2.196. [DOI] [Google Scholar]
- 32.Hill CE, Thompson BJ, Williams EN. A guide to conducting consensual qualitative research. The Counseling Psychologist. 1997;25:517–572. doi: 10.1177/0011000097254001. [DOI] [Google Scholar]
- 33.Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62:107–115. doi: 10.1111/j.1365-2648.2007.04569.x. [DOI] [PubMed] [Google Scholar]
- 34.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap) - a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42:377–81. doi: 10.1016/j.jbi.2008.08.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Maslach C, Jackson SE, Leiter MP. Maslach Burnout Inventory Manual. Third Edition. Mind Garden: Menlo Park; 2010. [Google Scholar]
- 36.Bokhof B, Junius-Walker U. Reducing polypharmacy from the perspectives of general practitioners and older patients: a synthesis of qualitative studies. Drugs Aging. 2016;33:249–266. doi: 10.1007/s40266-016-0354-5. [DOI] [PubMed] [Google Scholar]
- 37.Luymes CH, van der Kleij RM, Poortvliet RK, de Ruijter W, Reis R, Numans ME. Deprescribing potentially inappropriate preventive cardiovascular medication: barriers and enablers for patients and general practitioners. Ann Pharmacother. 2016;50:446–454. doi: 10.1177/1060028016637181. [DOI] [PubMed] [Google Scholar]
- 38.Voigt K, Gottschall M, Köberlein-Neu J, Schübel J, Quint N, Bergmann A. Why do family doctors prescribe potentially inappropriate medication to elderly patients? BMC Fam Pract. 2016;17:93. doi: 10.1186/s12875-016-0482-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Fairman J. Making Room in the Clinic: Nurse Practitioners and the Evolution of Modern Health Care. New Brunswick, NJ: Rutgers University Press; 2009. [Google Scholar]
- 40.Rinne ST, Wiener RS, Chen Y, Rise P, Udris E, Feemster LC, Au DH. Impact of guideline changes on indications for inhaled corticosteroids among veterans with chronic obstructive pulmonary disease. Am J Respir Crit Care Med. 2018;198:1226–1228. doi: 10.1164/rccm.201803-0554LE. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.