Abstract
Clinical decision support (CDS) embedded within the electronic health record (EHR) is a potential antibiotic stewardship strategy for hospitalized patients. Reduction in urine testing and treating asymptomatic bacteriuria (ASB) is an important strategy to promote antibiotic stewardship. We created an intervention focused on reducing urine testing for asymptomatic patients at a large tertiary care center. The objective of this study was to design an intervention to reduce unnecessary urinalysis and urine culture (UC) orders as well as the treatment of ASB. We performed a quasiexperimental study among adult inpatients at a single academic institution. We implemented a bundled intervention, including information broadcast in newsletters, hospital-wide screensavers, and passive CDS messages in the EHR. We investigated the impact of this strategy on urinalysis, UC orders, and on the treatment of ASB by using an interrupted time series analysis. Our intervention led to reduced UC order as well as reduced antibiotic orders in response to urinalysis orders and UC results. This easily implementable bundle may play an important role as an antibiotic stewardship strategy.
INTRODUCTION
Reducing the treatment of asymptomatic bacteriuria (ASB), or isolation of bacteria from a urine specimen in a patient without urinary tract infection (UTI) symptoms, is a key goal of antibiotic stewardship programs.1 Treatment of ASB has been associated with the emergence of resistant organisms and subsequent UTI risk among women with recurrent UTI.2,3 The Infectious Diseases Society of America and the American Board of Internal Medicine Foundation’s Choosing Wisely campaign recommend against treating ASB, with the exception of pregnant patients and urogenital surgical patients.1,4
Obtaining urinalyses and urine cultures (UC) in asymptomatic patients may contribute to the unnecessary treatment of ASB. In a study of hospitalized patients, 62% received urinalysis testing, even though 82% of these patients did not have UTI symptoms.5 Of the patients found to have ASB, 30% were given antibiotics.5 Therefore, interventions aimed at reducing urine testing may reduce ASB treatment.
Electronic passive clinical decision support (CDS) alerts and electronic education may be effective interventions to reduce urine testing.6 While CDS tools are recommended in antibiotic stewardship guidelines,7 they have led to only modest improvements in appropriate antibiotic prescribing and are typically bundled with time-intensive educational interventions.8 Furthermore, most in-hospital interventions to decrease ASB treatment have focused on intensive care units (ICUs).9 We hypothesized that CDS and electronic education would decrease (1) urinalysis and UC ordering and (2) antibiotic orders for urinalyses and UCs in hospitalized adult patients.
METHODS
Population
We conducted a prospective time series analysis (preintervention: September 2014 to June 2015; postintervention: September 2015 to June 2016) at a large tertiary medical center. All hospitalized patients ≥18 years old were eligible except those admitted to services requiring specialized ASB management (eg, leukemia and lymphoma, solid organ transplant, and obstetrics).1 The study was declared quality improvement by the Johns Hopkins Institutional Review Board.
Intervention
In August 2015, we implemented a multifaceted intervention that included provider education and passive electronic CDS (supplementary Appendix 1 and supplementary Appendix 2). Materials were disseminated through hospital-wide computer workstation screensavers and a 1-page e-mailed newsletter to department of medicine clinicians. The CDS tool included simple informational messages recommending against urine testing without symptoms and against treating ASB; these messages accompanied electronic health record (EHR; Allscripts Sunrise Clinical Manager, Chicago, IL) orders for urinalysis, UC, and antibiotics commonly used within our institution to treat UTI (cefazolin, cephalexin, ceftriaxone, trimethoprim-sulfamethoxazole, nitrofurantoin, and ciprofloxacin). The information was displayed automatically when orders for these tests and antibiotics were selected; provider acknowledgment was not required to proceed.
Data Collection
The services within our hospital are geographically located. We collected orders for urinalysis, UC, and the associated antibiotics for all units except those housing patients excluded from our study. As the CDS tool appeared only in the inpatient EHR, only postadmission orders were included, excluding emergency department orders. For admissions with multiple urinalyses, urinalysis orders placed ≥72 hours apart were eligible. Only antibiotics ordered for ≥24 hours were included, excluding on-call and 1-time antibiotic orders.
Our approach to data collection attempted to model a clinician’s decision-making pathway from (1) ordering a urinalysis, to (2) ordering a UC in response to a urinalysis result, to (3) ordering antibiotics in response to a urinalysis or UC result. We focused on order placement rather than results to prioritize avoiding testing in asymptomatic patients, as our institution does not require positive urinalyses for UC testing (reflex testing). Urinalyses resulted within 1 to 2 hours, allowing for clinicians to quickly order UCs after urinalysis result review. Urinalysis and UC orders per monthly admissions were defined as (1) urinalyses, (2) UCs, (3) simultaneous urinalysis and UC (within 1 hour of each other), and (4) UCs ordered 1 to 24 hours after urinalysis. We also analyzed the following antibiotic orders per monthly admissions: (1) simultaneous urinalysis and antibiotic orders, (2) antibiotics ordered 1 to 24 hours after urinalysis order, and (3) antibiotics ordered within 24 hours of the UC result.
Outcome Measures
All outcome measures were calculated as the change over time per total monthly admissions in the preintervention and postintervention periods. In addition to symptoms, urinalysis is a critical, measurable early step in determining the presence of ASB. Therefore, the primary outcome measure was the postintervention change in monthly urinalysis orders, and the secondary outcome measure was the postintervention change in monthly UC orders. Additional outcome measures included monthly postintervention changes in (1) UC ordered 1 to 24 hours after urinalyses, (2) urinalyses and antibiotics ordered simultaneously, (3) antibiotic orders within 1 to 24 hours of urinalyses, and (4) antibiotics ordered within 24 hours of UC result.
Statistical Analysis
Statistical analyses were performed by using Stata (version 14.2; StataCorp LLC, College Station, TX). An interrupted time series analysis was performed to compare the change in orders per 100 monthly admissions in preintervention and postintervention periods. To do this, we created 2 separate segmented linear regression models for each dependent variable, pre- and postintervention. Normality was assumed because of large numbers. Rate differences per 100 monthly admissions are also calculated as the total number of orders divided by the total number of admissions in postintervention and preintervention periods with Mantel-Haenszel estimators. Differences were considered statistically significant at P ≤ .05.
RESULTS
After the intervention, urinalysis orders did not decrease (−10.2%; P = .24), but UC orders decreased 6.3% (P < .001; Figure.; Table). There were fewer simultaneous urinalysis and UC orders after the intervention (−5.8%; P < .001). A decrease in UC following urinalyses within 1 to 24 hours did not reach statistical significance (−0.66%; P = .33).
TABLE.
Type of Urine Study | Percentage of Monthly Admissions, Preintervention | Percentage of Monthly Admissions, Postintervention | Absolute Rate Difference per 100 Monthly Admissions | Coefficient for Change in Trend over Time (95% CI) [P Value]a | Slope (Coefficient) of Linear Regression, Preinterventiona | Slope (Coefficient) of Linear Regression, Postinterventiona | Estimated Number per 100 Monthly Admissions in January 2016 (with Intervention)a | Estimated Number per Total Monthly Admissions in January 2016 (without Intervention)a |
---|---|---|---|---|---|---|---|---|
Total urinalyses | 70.5% | 60.3% | −10.2% | 0.043 (−0.030 to 0.12) [=.24] | −0.016 (0.78) | −0.013 (0.79) | 59.7 | 53.4 |
Total UC | 18.2% | 11.8% | −6.3% | −0.030 (−0.041 to 0.019) [<.001] | −0.0031 (0.20) | −0.0052 (0.19) | 11.6 | 14.9 |
Simultaneous urinalyses and UC | 14.9% | 9.1% | −5.8% | −0.039 (−0.052 to 0.025) [<.001] | −0.0018 (0.16) | −0.0037 (0.14) | 8.9 | 13.1 |
UC following urinalyses within 1–24 hours | 2.5% | 2.1% | −0.66% | −0.0027 (−0.0084 to 0.0030) [=.33] | −0.00038 (0.029) | −0.00055 (0.029) | 2.1 | 2.3 |
Urinalyses and antibiotics ordered simultaneously | 0.9% | 0.8% | −0.24% | −0.0032 (−0.0066 to 0.00033) [=.073] | 0.00033 (0.0089) | −0.00031 (0.013) | 13.9 | 17.2 |
Urinalyses followed by antibiotic within 1–24 hours | 4.4% | 3.9% | −0.56% | −0.0087 (−0.015 to 0.0015) [=.021] | 0.00078 (0.041) | −0.00060 (0.048) | 3.8 | 5.3 |
UC results followed by antibiotic order within 24 hours | 1.7% | 1.5% | −0.24% | −0.0069 (−0.013 to 0.00051) [=.036] | 0.0011 (0.012) | −0.00049 (0.022) | 1.4 | 2.9 |
Estimate from interrupted time series analysis.
NOTE: Abbreviations: CI, confidence interval; UC, urine culture.
There was a decrease in urinalysis orders followed by antibiotic orders within 1 to 24 hours (−0.56%; P = .021) and in UC results followed by an antibiotic order within 24 hours (−0.24%; P = .036). However, a decrease in urinalyses and antibiotics ordered simultaneously did not reach statistical significance (−0.24%; P = .073).
DISCUSSION
A multifaceted but simple bundle of CDS and provider education reduced UC testing but not urinalyses in a large tertiary care hospital. The bundle also reduced antibiotic ordering in response to urinalyses as well as antibiotic ordering in response to UC results.
Other in-hospital CDS tools to decrease ASB treatment have focused only on ICUs.9,10 Our intervention was evaluated hospital-wide and included urinalyses and UCs. Our intervention was clinician directed and not laboratory directed, such as a positive urinalysis reflexing to a UC. Simultaneous urinalysis and UC testing may lead to ASB treatment, as clinicians treat the positive UC and ignore the negative urinalysis.11,12 Therefore, we focused on UCs being sent in response to urinalyses.
We chose to focus on laboratory testing data instead of administrative diagnoses for UTI. The sensitivity of administrative data to determine similar conditions such as catheter-associated UTIs is low (0%).13
Our single-center study may not be generalizable to other settings. We did not include emergency department patients, as this location used a different EHR. In addition, given the 600,000 yearly hospital admissions, it was impractical to assess the appropriateness of each antibiotic-based documentation of symptoms. Instead of focusing on symptoms of ASB or UTI diagnoses, we focused on ordering urinalysis, UC, and antibiotics. In investigating the antibiotics most frequently used to treat UTI in our hospital, we may have both missed some patients who were treated with other antibiotics for ASB (eg, 4th generation cephalosporins, penicillins, carbapenems, etc) and captured patients receiving antibiotics for indications other than UTI (eg, pneumonia). In our focus on overall ordering practices across a hospital, we did not capture data on bladder catheterization status or the predominant organism seen in UC. At the time of the intervention, the laboratory did not have the resources for urinalysis testing reflexing to UC. However, our intervention did not prevent ordering simultaneous urinalysis and UC in symptomatic patients in general or urosepsis in particular. With only 12 total time points, the interrupted time series analysis may have been underpowered.14 We also do not know if the intervention’s effect would decay over time.
Although the intervention took very little staff time and resources, alert fatigue was a risk.15 We attempted to mitigate this alert fatigue by making the CDS passive (in the form of a brief informational message) with no provider action required. In conversations with providers in our institution, there has been dissatisfaction with alerts requiring action, as these are thought to be overly intrusive. We are also not clear on which element of the intervention bundle (ie, the CDS or the educational intervention) may have had more of an impact, as the elements of the intervention bundle were rolled out simultaneously. It is possible and even probable that both elements are needed to raise awareness of the problem. Also, as our EHR required all interventions to be rolled out hospital-wide simultaneously, we were unable to randomize certain floors or providers to the CDS portion of the intervention bundle. Other analyses including the type of hospital unit were beyond the scope of this brief report.
Our intervention bundle was associated with reduced UC orders and reduced antibiotics ordered after urinalyses. If a provider does not know there is bacteriuria, then the provider will not be tempted to order antibiotics. This easily implementable bundle may play an important role as an antimicrobial stewardship strategy for ASB.
Supplementary Material
Acknowledgments
The authors acknowledge the support of Erin Fanning, BS, and Angel Florentin, BS, in providing data for analysis. SCK received funding from the Johns Hopkins Institute for Clinical and Translational Research (ICTR), which is funded in part by grant number KL2TR001077 from the National Center for Advancing Translational Sciences (NCATS), a component of the National Institutes of Health (NIH), and the NIH Roadmap for Medical Research. These contents are solely the responsibility of the authors and do not necessarily represent the official view of the Johns Hopkins ICTR, NCATS, or NIH. We also acknowledge support from the Centers for Disease Control and Prevention’s Prevention Epicenter Program Q8377 (collaborative agreement U54 CK000447 to SEC). SEC has received support for consulting from Novartis and Theravance, and her institution has received a grant from Pfizer Grants for Learning and Change/The Joint Commission. This work was supported by the NIH T32 HL116275 to NC. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.
Footnotes
Disclosure: No conflicts of interest have been reported by any author.
Additional Supporting Information may be found in the online version of this article.
References
- 1.Nicolle LE, Bradley S, Colgan R, et al. Infectious Diseases Society of America guidelines for the diagnosis and treatment of asymptomatic bacteriuria in adults. Clin Infect Dis. 2005;40(5):643–654. [DOI] [PubMed] [Google Scholar]
- 2.Cai T, Mazzoli S, Mondaini N, et al. The role of asymptomatic bacteriuria in young women with recurrent urinary tract infections: to treat or not to treat? Clin Infect Dis. 2012;55(6):771–777. [DOI] [PubMed] [Google Scholar]
- 3.Cai T, Nesi G, Mazzoli S, et al. Asymptomatic bacteriuria treatment is associated with a higher prevalence of antibiotic resistant strains in women with urinary tract infections. Clin Infect Dis. 2015;61(11):1655–1661. [DOI] [PubMed] [Google Scholar]
- 4.Infectious Diseases Society of America. Choosing Wisely: Five Things Physicians and Patients Should Question. 2015. http://www.choosingwisely.org/societies/infectious-diseases-society-of-america/. Accessed on September 11, 2016.
- 5.Yin P, Kiss A, Leis JA. Urinalysis Orders Among Patients Admitted to the General Medicine Service. JAMA Intern Med. 2015;175(10):1711–1713. [DOI] [PubMed] [Google Scholar]
- 6.McGregor JC, Weekes E, Forrest GN, et al. Impact of a computerized clinical decision support system on reducing inappropriate antimicrobial use: a randomized controlled trial. J Am Med Inform Assoc. 2006;13(4):378–384. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Barlam TF, Cosgrove SE, Abbo LM, et al. Implementing an Antibiotic Stewardship Program: Guidelines by the Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America. Clin Infect Dis. 2016;62(10):e51–e77. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Gonzales R, Anderer T, McCulloch CE, et al. A cluster randomized trial of decision support strategies for reducing antibiotic use in acute bronchitis. JAMA Intern Med. 2013;173(4):267–273. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Sarg M, Waldrop GE, Beier MA, et al. Impact of Changes in Urine Culture Ordering Practice on Antimicrobial Utilization in Intensive Care Units at an Academic Medical Center. Infect Control Hosp Epidemiol. 2016;37(4): 448–454. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Mehrotra A, Linder JA. Tipping the Balance Toward Fewer Antibiotics. JAMA Intern Med. 2016;176(11):1649–1650. [DOI] [PubMed] [Google Scholar]
- 11.Leis JA, Gold WL, Daneman N, Shojania K, McGeer A. Downstream impact of urine cultures ordered without indication at two acute care teaching hospitals. Infect Control Hosp Epidemiol. 2013;34(10):1113–1114. [DOI] [PubMed] [Google Scholar]
- 12.Stagg A, Lutz H, Kirpalaney S, et al. Impact of two-step urine culture ordering in the emergency department: a time series analysis. BMJ Qual Saf. 2017. doi: 10.1136/bmjqs-2016-006250. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Cass AL, Kelly JW, Probst JC, Addy CL, McKeown RE. Identification of device-associated infections utilizing administrative data. Am J Infect Control. 2013;41(12):1195–1199. [DOI] [PubMed] [Google Scholar]
- 14.Zhang F, Wagner AK, Ross-Degnan D. Simulation-based power calculation for designing interrupted time series analyses of health policy interventions. J Clin Epidemiol. 2011;64(11):1252–1261. [DOI] [PubMed] [Google Scholar]
- 15.Embi PJ, Leonard AC. Evaluating alert fatigue over time to EHR-based clinical trial alerts: findings from a randomized controlled study. J Am Med Inform Assoc. 2012;19(e1):e145–e148. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.