Two recent, high-impact publications of pragmatic, cluster-randomized clinical trials highlight the risks of normal saline administration in hospitalized patients [1, 2]. For clinical informaticians and clinical trialists, they raise larger questions about how clinical trials should be conducted in the future.
Randomized, prospective, clinical trials have long been considered a gold standard for assessing causality in the medical literature. There are significant limitations to traditional clinical trials, such as high cost, delays in obtaining funding, large numbers of exclusion criteria, and inability to randomize and intervene in a timely manner in instances of delayed consent. By focusing interventions on highly-selected patients undergoing care delivered by expert clinicians, they may suffer from limited generalizability [3]. Given these longstanding concerns there has been increased interest in recent years in conducting more pragmatic clinical trials, which are designed to specifically address these issues [4–6]. Many of the features of pragmatic clinical trials are outlined at length in the Pragmatic-Explanatory Continuum Indicator Summary (PRECIS) and PRECIS-2 tools [7, 8].
A major challenge, even in pragmatic clinical trials, has been data collection and validation, including assessment of clinically-relevant clinical outcomes [9]. In the SALT-ED and SMART trials, data were collected and validated through extensive leverage of the electronic health record (EHR)— at significantly decreased cost and effort, compared to comparable studies.
Critical care medicine is practiced in a high-acuity and high-cost environment. Given these factors, proposed interventions and changes to clinical practice are often thoroughly vetted, in many instances in multiple studies, prior to achieving broad clinical implementation. Success stories have included lung protective ventilation, changes in sedation regimens to address intensive care unit delirium, among many others [10–12]. Conducting multiple, high-quality prospective, randomized clinical trials, often at multiple centers, may be a technically challenging and expensive process.
As more health systems transition to large, enterprise EHRs, clinical informaticians are presented with the opportunity to leverage tools that can be easily integrated in the EHR to facilitate clinical trials. Multi-center observational data sharing with EHR integration has been successfully performed in numerous fields, including, notably, perioperative outcomes research, via endeavors such as the Multi-Center Perioperative Outcomes Group and the Duke Clinical Research Institute [13–15]. These lessons and tools can be embedded within intensive care units, thereby enabling robust, multi-center clinical trials. As the SALT-ED and SMART studies have shown, these trials have the potential to drastically improve clinical practice. We would propose that efforts are urgently needed to create new, multi-center data sharing networks to leverage EHR data to facilitate pragmatic clinical trials in critical care.
Acknowledgments
Funding Dr. Freundlich receives ongoing support from the Vanderbilt Faculty Research Scholars.
Footnotes
Compliance with Ethical Standards
Conflict of interest None.
References
- 1.Semler MW, Self WH, Wanderer JP, Ehrenfeld JM, Wang L, Byrne DW, Stollings JL, Kumar AB, Hughes CG, Hernandez A, Guillamondegui OD, May AK, Weavind L, Casey JD, Siew ED, Shaw AD, Bernard GR, and Rice TW, Investigators S, the Pragmatic Critical Care Research G: Balanced Crystalloids versus Saline in Critically Ill Adults. N. Engl. J. Med 378:829–839, 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Self WH, Semler MW, Wanderer JP, Wang L, Byrne DW, Collins SP, Slovis CM, Lindsell CJ, Ehrenfeld JM, Siew ED, Shaw AD, Bernard GR, Rice TW, and Investigators S-E, Balanced Crystalloids versus Saline in Noncritically Ill Adults. N. Engl. J. Med 378:819–828, 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Schwartz D, and Lellouch J, Explanatory and pragmatic attitudes in therapeutical trials. J. Chronic Dis 20:637–648, 1967. [DOI] [PubMed] [Google Scholar]
- 4.Rosenthal GE, The role of pragmatic clinical trials in the evolution of learning health systems. Trans. Am. Clin. Climatol. Assoc 125:204–216, 2014. discussion 217-8. [PMC free article] [PubMed] [Google Scholar]
- 5.Activity ALHS, Roundtable on V, Science-Driven Health C, Institute of M, Observational Studies in a Learning Health System: Workshop Summary. Washington (DC): National Academies Press; (US) Copyright 2013 by the National Academy of Sciences. All rights reserved., 2013. [Google Scholar]
- 6.Ford I, and Norrie J, Pragmatic Trials. N. Engl. J. Med 375:454–463, 2016. [DOI] [PubMed] [Google Scholar]
- 7.Lipman PD, Loudon K, Dluzak L, Moloney R, Messner D, and Stoney CM, Framing the conversation: use of PRECIS-2 ratings to advance understanding of pragmatic trial design domains. Trials 18:532, 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, Tunis S, Bergel E, Harvey I, Magid DJ., and Chalkidou K, A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J. Clin. Epidemiol 62:464–475, 2009. [DOI] [PubMed] [Google Scholar]
- 9.Lauer MS, Gordon D, Wei G, and Pearson G, Efficient design of clinical trials and epidemiological research: is it possible? Nat. Rev. Cardiol 14:493–501, 2017. [DOI] [PubMed] [Google Scholar]
- 10.Sakr Y, Vincent JL, Reinhart K, Groeneveld J, Michalopoulos A, Sprung CL, Artigas A, and Ranieri VM, Sepsis Occurence in Acutely Ill Patients I: High tidal volume and positive fluid balance are associated with worse outcome in acute lung injury. Chest 128:3098–3108, 2005. [DOI] [PubMed] [Google Scholar]
- 11.Pandharipande PP, Pun BT, Herr DL, Maze M, Girard TD, Miller RR, Shintani AK, Thompson JL, Jackson JC, Deppen SA, Stiles RA, Dittus RS, Bernard GR, and Ely EW, Effect of sedation with dexmedetomidine vs lorazepam on acute brain dysfunction in mechanically ventilated patients: the MENDS randomized controlled trial. JAMA 298:2644–2653, 2007. [DOI] [PubMed] [Google Scholar]
- 12.Pandharipande PP, Girard TD, Jackson JC, Morandi A, Thompson JL, Pun BT, Brummel NE, Hughes CG, Vasilevskis EE, Shintani AK, Moons KG, Geevarghese SK, Canonico A, Hopkins RO, Bernard GR, Dittus RS, and Ely EW, Investigators B-IS: Long-term cognitive impairment after critical illness. N. Engl. J. Med 369:1306–1316, 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Freundlich RE, and Kheterpal S, Perioperative effectiveness research using large databases. Best Pract. Res. Clin. Anaesthesiol 25:489–498, 2011. [DOI] [PubMed] [Google Scholar]
- 14.Berman MF, Iyer N, Freudzon L, Wang S, Freundlich RE, Housey M, and Kheterpal S, Multicenter Perioperative Outcomes Group Perioperative Clinical Research C: Alarm Limits for Intraoperative Drug Infusions: A Report From the Multicenter Perioperative Outcomes Group. Anesth. Analg 125:1203–1211, 2017. [DOI] [PubMed] [Google Scholar]
- 15.Pencina MJ, Louzao DM, McCourt BJ, Adams MR, Tayyabkhan RH, Ronco P, and Peterson ED, Supporting open access to clinical trial data for researchers: The Duke Clinical Research Institute-Bristol-Myers Squibb Supporting Open Access to Researchers Initiative. Am. Heart J 172:64–69, 2016. [DOI] [PubMed] [Google Scholar]
