Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2026 Aug 3.
Published in final edited form as: J Am Geriatr Soc. 2015 May 6;63(5):1025–1029. doi: 10.1111/jgs.13404

Enhancing the Quality of Prescribing Practices for Older Veterans Discharged from the Emergency Department (EQUiPPED): Preliminary Results from Enhancing Quality of Prescribing Practices for Older Veterans Discharged from the Emergency Department, a Novel Multicomponent Interdisciplinary Quality Improvement Initiative

Melissa B Stevens a,b,c, Susan Nicole Hastings d,e,f,g, James Powers h,i,j, Ann E Vandenberg c, Katharina V Echt a,b,c, William E Bryan III f, Kiffany Peggs i,j, Alayne D Markland a,k, Ula Hwang l,m,n, William W Hung l,n, Anita J Schmidt b, Gerald McGwin a,o, Edidiong Ikpe-Ekpo b,p, Carolyn Clevenger a,b,q, Theodore M Johnson II a,b,c, Camille P Vaughan a,b,c
PMCID: PMC13428995  NIHMSID: NIHMS2196378  PMID: 25945692

Abstract

Suboptimal medication prescribing for older adults has been described in a number of emergency department (ED) studies. Despite this, few studies have examined ED-targeted interventions aimed at reducing the use of potentially inappropriate medications (PIMs). Enhancing Quality of Prescribing Practices for Older Veterans Discharged from the ED (EQUiPPED) is an ongoing multicomponent, interdisciplinary quality improvement initiative in eight Department of Veterans Affairs EDs. The project aims to decrease the use of PIMs, as identified by the Beers criteria, prescribed to veterans aged 65 and older at the time of ED discharge. Interventions include provider education; informatics-based clinical decision support with electronic medical record–embedded geriatric pharmacy order sets and links to online geriatric content; and individual provider education including academic detailing, audit and feedback, and peer benchmarking. Poisson regression was used to compare the number of PIMs that staff providers prescribed to veterans aged 65 and older discharged from the ED before and after the initiation of the EQUiPPED intervention. Initial data from the first implementation site show that the average monthly proportion of PIMs that staff providers prescribed was 9.4 ± 1.5% before the intervention and 4.6 ± 1.0% after the initiation of EQUiPPED (relative risk = 0.48, 95% confidence interval = 0.40–0.59, P < .001). Preliminary evaluation demonstrated a significant and sustained reduction of ED-prescribed PIMs in older veterans after implementation of EQUiPPED. Longer follow-up and replication at collaborating sites would allow for an assessment of the effect on health outcomes and costs.

Keywords: quality improvement, emergency department, inappropriate prescribing, aged 65 and older, veterans health


An increasing number of older adults are evaluated in emergency departments (EDs) annually.1 More than half are discharged without admission and receive a treatment plan, which frequently involves a new prescription medication.2 Suboptimal prescribing for older adults has been described in a number of ED-based studies over the past 3 decades.3,4 A study of veterans discharged from a Veterans Affairs (VA) Medical Center (VAMC) ED suggested that the use of potentially inappropriate medications (PIMs) was common and associated with a trend toward greater risk of repeat ED visits, hospitalization, or death.5

Newly released guidelines for geriatric ED care cite interventions to address prescribing quality as a specific goal for high-quality ED care.6 Previous studies in the ED and outpatient care settings suggest that electronic decision support and provider audit and feedback improve the quality of prescribing for specific high-risk medications.7,8 This article describes the design and implementation of Enhancing Quality of Prescribing Practices for Older Veterans Discharged from the Emergency Department (EQUiPPED), a quality improvement initiative9 aimed at implementing evidence-based strategies to reduce prescribing of PIMs, and presents preliminary results from the first of eight sites to implement the model.

METHODS

Setting

EQUiPPED is an ongoing quality improvement initiative in eight VA EDs. The design and implementation of EQUiPPED at the initial site, a large, urban VAMC with an average annual ED volume of 41,000 visits of which 40% represent veterans aged 65 and older are described. The ED employs a diverse group of staff providers, including board-certified physicians in emergency medicine (EM) (n = 7), internal medicine (IM) (n = 3), and family practice (n = 2); a dually board-certified EM/IM physician; advanced practice providers (n = 2); and a clinical pharmacist. The ED also uses more than 40 moonlighting physicians and midlevel providers who work from one to 20 shifts per month; these moonlighting providers did not participate in the initial phase of EQUiPPED.

Program Development and Goals

An interdisciplinary team comprising ED physicians, geriatricians, gerontologists, clinical pharmacists, quality improvement nurses, and clinical applications coordinators developed EQUiPPED using the Vision-Analysis-Team-Aim-Map-Measure-Change-Sustain model of process improvement, which was developed within the VA from Lean and Six Sigma principles.10 The primary goal of the project was to reduce ED prescribing of PIMs for veterans aged 65 and older at the time of ED discharge. PIMs were defined as American Geriatrics Society 2012 Beers Criteria Update11 Category 1 medications to avoid in all older adults. Chronic nonsteroidal anti-inflammatory drug (NSAID) prescriptions were defined as any dose for longer than 30 days. Research in various settings supports the Beers criteria, which are widely used as a marker of prescribing quality.12,13 Based on literature review and baseline data, the team set a goal of reducing PIM use to 5% or less.7

Intervention Components

Provider Education

A geriatrician presented a geriatric pharmacology lecture during three shifts over the course of a month for ED providers (November 2012, Figure 1). Twelve of 16 (75%) staff providers attended one of these sessions. ED staff also reviewed the 2012 Beers Criteria Update during a quarterly journal club held in January 2013. Finally, reminder cards identifying the top five most-frequently prescribed PIMs or PIM categories based on local prescribing trends were provided at computer stations in the ED.

Figure 1.

Figure 1.

Timeline for Enhancing Quality of Prescribing Practices for Older Veterans Discharged from the Emergency Department (EQUiPPED) implementation and evaluation.

Informatics-Based Clinical Decision Support

Mapping the computerized provider order entry (CPOE) process identified multiple steps that could increase prescribing of PIMs in older veterans at the time of ED discharge. Existing discharge order sets consisted of an alphabetized list of commonly used medications without consideration of dosage adjustments for age or renal function. Interviews revealed that providers preferentially used the existing list for prescribing because it streamlined order entry and not because they necessarily felt the listed medications were superior choices.

Subsequently, the EQUiPPED team developed geriatric outpatient pharmacy order sets grouped according to common discharge diagnoses with medication options preferred for use in older adults. These templates were placed alongside existing order sets in the electronic medical record (EMR) order menu for all veterans checked into the ED. Dose adjustments for renal impairment, point-of-prescribing education regarding medications to avoid, and links to synthesized geriatric content were embedded within the order sets. When providers prescribed medications using the order sets, the order entry process was streamlined with prepopulated fields including: “days supply,” “number of pills,” and method for prescription pick-up. Pharmacists, ED providers, and the local VA pharmacy and therapeutics committee reviewed template logic that the group developed before implementation. In addition to expediting the order entry process, the order sets simultaneously encouraged providers to choose safer medications.14 The order sets were activated in February 2013.

Individual Provider Feedback

All ED providers (n = 16) received at least one face-to-face feedback session using a process of individual practice pattern feedback (academic detailing), which has previously been demonstrated to be an effective method for changing provider prescribing practices alone or in combination with clinical decision support tools.8 Provider feedback included audit and feedback of individual prescribing patterns and peer benchmarking comparing individual performance with that of other ED providers at the same site.15,16 An ED staff physician colleague conducted feedback sessions over 3 months from February to April 2013. Each provider subsequently received standardized monthly reports that included total number of veterans aged 65 and older that they evaluated and discharged from the ED, total number of medications prescribed, and proportion of total medications that were PIMs. The reports also contained a breakdown of the drug classes for PIMs and peer benchmarking for the same time period.

Program Evaluation

As a quality improvement project, the Department of Veterans Affairs Office of Geriatrics and Extended Care deemed the analysis of the EQUiPPED outcomes to be a nonresearch evaluation. The primary outcome of interest was the monthly number of PIMs as defined according to the Beers criteria that ED staff providers prescribed to veterans aged 65 and older at the time of discharge from the ED. Poisson regression was used to compare the number of PIMs prescribed in the 8 months before the first EQUiPPED intervention with 17 months of data from after the initial EQUiPPED intervention. The total number of prescriptions served as the offset term in the model, and a piecewise, nonlinear regression model was used to evaluate the pattern of PIMs prescriptions over time. Analyses were conducted using SAS version 9.2 (SAS Institute, Inc., Cary, NC).

RESULTS

From April 2012 through April 2014, VA ED staff providers treated and discharged 4,042 veterans aged 65 and older. In the 8 months before the EQUiPPED intervention (April to November 2012), the average monthly proportion of PIMs prescribed was 9.4 ± 1.5%. This declined to 4.6 ± 1.0% after the initiation of the EQUiPPED interventions (relative risk = 0.48, 95% confidence interval = 0.40–0.59, P < .001). Figure 2 shows the percentage of PIMs prescribed monthly from April 2012 through April 2014 with the results of a piecewise, nonlinear regression model. The model indicated that the inflection point occurred in April 2013 and that the observed change was sustained for the remainder of the evaluation period.

Figure 2.

Figure 2.

Monthly percentage of potentially inappropriate medication (PIM) prescriptions by staff providers for veterans aged 65 years and older discharged from the emergency department (April 2012 to April 2014) (piecewise nonlinear regression).

At the facility, the top five most-frequently prescribed PIMs or categories as defined according to the Beers criteria were diphenhydramine, hydroxyzine, skeletal muscle relaxants, chronic NSAIDs, and promethazine. The proportion of prescriptions decreased for all of these except hydroxyzine and diphenhydramine. The greatest decrease occurred in the category of muscle relaxants, with a 60% relative reduction.

DISCUSSION

The EQUiPPED program used provider education, clinical decision support for improved workflow in a CPOE or EMR, and provider feedback with audit and peer benchmarking in a busy urban VAMC. This intervention achieved the target reduction in the proportion of PIMs prescribed to older adults discharged from the ED (<5%) and a greater than 50% total reduction in the prescribing of PIMs.

Given that there will be a growing number of older adults who will be seen in EDs, guideline committees have recommended models of care incorporating a multidisciplinary approach for improving ED care.6 Development of EQUiPPED involved a multidisciplinary group of providers with expertise in geriatrics, pharmacology, behavioral psychology, emergency medicine, and health services research. After seed funding from a university affiliate intramural award at the first site, VA funding provided support to expand the team and incorporate additional sites. Collaboration between Geriatric Research, Education, and Clinical Centers provided an infrastructure for rapid expansion within the VA.

Implementation of the EQUiPPED program was not designed to assess the effect of each intervention, but in keeping with a model for dissemination and implementation science, EQUiPPED addresses several potential leaks along the knowledge translation pipeline of “1) awareness—2) agreement—3) adoption—4) adherence.”17 EQUiPPED implementation increases awareness using a multipronged educational program, facilitates agreement and adoption through streamlined order entry, and encourages adherence with regular feedback to providers regarding prescribing patterns.

Feedback from providers was important in developing order sets that facilitated workflow and were not perceived as burdensome, which is a crucial characteristic of successful clinical decision support systems.14 Although the EQUiPPED order sets were designed to encompass common discharge diagnoses, providers wanted more-focused information on specific drugs to avoid. This type of reminder was added to the program in the form of a 3- by 5-inch card placed on the edge of provider workstation computer screens to serve as a point-of-prescribing reminder. In the top five medications or categories, significant reductions were noted in three (muscle relaxants, promethazine, chronic NSAIDs). The reduction in PIMs was sustained for 12 months, suggesting a culture change with respect to prescribing patterns for older adults discharged from the ED.

There are limitations to this initiative that merit acknowledgment. PIM use in this project was defined based on the 2012 update to the Beers criteria. Some have argued that Beers-defined PIMs divert focus from the smaller group of medications inappropriately dosed or monitored (antihyperglycemics, anticoagulants, pain medications) that account for the majority of ED visits or hospitalization in elderly adults.18,19 By framing prescribing organized according to discharge diagnoses, providers received information regarding appropriate dosing of antihyperglycemic medications, warnings and reminders about antibiotic interactions with anticoagulants, and alternative medications for pain. Others have questioned whether the Beers criteria apply to short-duration prescriptions of less than 1 week, which ED providers often prescribe.20 The Beers PIM framework appeared to be understood and manageable when a multidisciplinary team used it as part of a multicomponent intervention. The Beers criteria serve as a marker of prescribing quality to evaluate the effect of EQUiPPED on provider prescribing behavior,12 yet it is only known that the number of PIMs declined. Additional analyses of broader health outcomes will allow insights into the potential effect on other areas. A capitated-payment model, a fully integrated EMR with CPOE, and close pharmacy and medical center oversight make the VA setting unique. National implementation of meaningful-use criteria by the Centers for Medicare and Medicaid Services make these results potentially replicable outside a VA facility.

As an implementation project, the before-and-after design limits inferences about the EQUiPPED program’s effect on prescribing patterns, although the long-term outcomes presented are unlikely to have occurred by chance. It is likely that local factors related to facility and clinical leadership and staff dynamics affected the results, which may not be generalizable to all settings of care or other ED sites. For example, coincident interventions, such as the hiring of a clinical pharmacist in the ED, could have affected the results. Data from expansion sites will allow assessment of the potential for broader dissemination.

CONCLUSIONS

EQUiPPED, an initiative that combines provider education, clinical decision support for improved workflow in a CPOE or EMR, and provider feedback with audit and peer benchmarking, represents a unique quality improvement initiative within the ED setting to affect the care of older adults. EQUiPPED was successfully implemented in a busy, urban VAMC and was associated with a sustained reduction in PIM prescription to older veterans. Implementation is under way at seven additional VA sites to assess the potential for broader dissemination.

Supplementary Material

Appendices

SUPPORTING INFORMATION

Additional Supporting Information may be found in the online version of this article:

Appendix S1. ED pharmacy quick orders in place prior to EQUiPPED.

Appendix S2. EQUiPPED pharmacy quick order initial screen.

Appendix S3. Examples of EQUiPPED order sets.

ACKNOWLEDGMENTS

The investigators retained full independence in the conduct of this project.

Funding was provided by an Emory University Department of Medicine FAME grant to Dr. Stevens and the Department of Veterans Affairs Office of Geriatrics and Extended Care T-21 initiative (G508-1 & G521-5). Dr. Vaughan is supported by Rehabilitation Research and Development CDA-2 award (1 IK2 RX000747-01) from the Department of Veterans Affairs. Drs. Vaughan and Hwang have received a John A. Hartford Centers of Excellence Collaborative Pilot award for EQUiPPED.

Footnotes

Conflict of Interest: Dr. Powers has grant funds from Geriatric Education Centers (HRSA) and provides occasional expert witness testimony but does not feel that these represent a conflict of interest. Dr. Johnson has a consulting relationship with Astellas but does not feel this represents a conflict of interest.

Please note: Wiley-Blackwell is not responsible for the content, accuracy, errors, or functionality of any supporting materials supplied by the authors. Any queries (other than missing material) should be directed to the corresponding author for the article.

REFERENCES

  • 1.Pines JM, Mullins PM, Cooper JK et al. National trends in emergency department use, care patterns, and quality of care of older adults in the United States. J Am Geriatr Soc 2013;61:12–17. [DOI] [PubMed] [Google Scholar]
  • 2.Gruneir A, Silver MJ, Rochon PA. Review: Emergency department use by older adults: A literature review on trends, appropriateness, and consequences of unmet health care needs. Med Care Res Rev 2011;68:131–155. [DOI] [PubMed] [Google Scholar]
  • 3.Chin MH, Wang LC, Jin L et al. Appropriateness of medication selection for older persons in an urban academic emergency department. Acad Emerg Med 1999;6:1232–1241. [DOI] [PubMed] [Google Scholar]
  • 4.Hustey FM, Wallis N, Miller J. Inappropriate prescribing in an older ED population. Am J Emerg Med 2007;25:804–807. [DOI] [PubMed] [Google Scholar]
  • 5.Hastings SN, Schmader KE, Sloane RJ et al. Quality of pharmacotherapy and outcomes for older veterans discharged from the emergency department. J Am Geriatr Soc 2008;56:875–880. [DOI] [PubMed] [Google Scholar]
  • 6.Carpenter CR, Bromley M, Caterino JM et al. Optimal older adult emergency care: Introducing multidisciplinary geriatric emergency department guidelines from the American College of Emergency Physicians, American Geriatrics Society, Emergency Nurses Association, and Society for Academic Emergency Medicine. J Am Geriatr Soc 2014;62:1360–1363. [DOI] [PubMed] [Google Scholar]
  • 7.Terrell KM, Perkins AJ, Dexter PR et al. Computerized decision support to reduce potentially inappropriate prescribing to older emergency department patients: A randomized, controlled trial. J Am Geriatr Soc 2009;57:1388–1394. [DOI] [PubMed] [Google Scholar]
  • 8.O’Brien MA, Rogers S, Jamtvedt G et al. Educational outreach visits: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2007:CD000409. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Davidoff F, Batalden P, Stevens D et al. Publication guidelines for improvement studies in health care: Evolution of the SQUIRE Project. Ann Intern Med 2008;149:670–676. [DOI] [PubMed] [Google Scholar]
  • 10.George ML. Lean Six Sigma for Service. New York: McGraw-Hill, 2003. [Google Scholar]
  • 11.The American Geriatrics Society Beers Criteria Update Expert Panel. American geriatrics society updated beers criteria for potentially inappropriate medication use in older adults. J Am Geriatr Soc 2012;60:616–631. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Lund BC, Steinman MA, Chrischilles EA et al. Beers criteria as a proxy for inappropriate prescribing of other medications among older adults. Ann Pharmacother 2011;45:1363–1370. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Pharmacy Quality Alliance Measures [on-line]. Available at http://pqaalliance.org/measures/cms.asp Accessed September 3, 2014. [Google Scholar]
  • 14.Lobach DF, Sanders GD, Bright TJ et al. Enabling Health Care Decision-making Through Clinical Decision Support and Knowledge Management (AHRQ Publication No. 12-E001-EF). Rockville, MD: Agency for Healthcare Research and Quality, 2012. [Google Scholar]
  • 15.Ivers N, Jamtvedt G, Flottorp S et al. Audit and feedback: Effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2012;6:CD000259. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Kiefe CI, Allison JJ, Williams O et al. Improving quality improvement using achievable benchmarks for physician feedback: A randomized controlled trial. JAMA 2001;285:2871–2879. [DOI] [PubMed] [Google Scholar]
  • 17.Pathman DE, Konrad TR, Freed GL et al. The awareness-to-adherence model of the steps to clinical guideline compliance: The case of pediatric vaccine recommendations. Med Care 1996;34:873–889. [DOI] [PubMed] [Google Scholar]
  • 18.Budnitz DS, Shehab N, Kegler SR et al. Medication use leading to emergency department visits for adverse drug events in older adults. Ann Intern Med 2007;147:755–765. [DOI] [PubMed] [Google Scholar]
  • 19.Budnitz DS, Lovegrove MC, Shehab N et al. Emergency hospitalizations for adverse drug events in older Americans. N Engl J Med 2011;365:2002–2012. [DOI] [PubMed] [Google Scholar]
  • 20.Hustey FM. Beers criteria and the ED: An adequate standard for inappropriate prescribing? Am J Emerg Med 2008;26:695–696. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Appendices

RESOURCES