Critical care patients generate an enormous volume of data; physicians are tasked with making sense of the data and with making timely, congruous decisions regarding their care. Many of these decisions are made during patient rounds – approximately 9 per patient (1) – based on the premise that the data that inform the decisions are accurate and complete. The study by Artis et al. in this issue of Critical Care Medicine (2) challenges this premise.
Artis et al. examined the rate of “misrepresented” laboratory values during interprofessional patient rounds in a 26-bed medical ICU. Misrepresentations included labs that were obsolete, misinterpreted (described incorrectly, e.g., “WBC is stable” when in fact WBC has increased), incorrectly described as pending, erroneous, or omitted altogether. Twenty-six lab tests, representing a mix of common and infrequent orders, were selected that are relevant to the care of critically ill patients. Two senior critical care fellows audited 34 rounds, for a total of 301 patients and 4945 lab values. They found a high rate of misrepresented labs: nearly 39% of values were inaccurately communicated. 96% of patient presentations included at least one misrepresentation, with a mean of 6.3 per patient. Omissions comprised nearly 80% of the misrepresentations, with old data and data incorrectly described as pending accounting for an additional 14%. Only about 8% of misrepresentations were detected by someone on the rounding team, usually the attending physician.
In 94% of cases, presenters (medical students and residents) prepared a paper document including lab values and other information prior to rounds. Usually, these documents were printouts generated from the electronic health record (EHR), but some documents were manually created, and labs reported from them were no less accurate than the printouts. Not all labs were included – those that are more commonly ordered were more likely to appear on the paper document. Labs that were included were, not surprisingly, more likely to be communicated correctly.
EHRs don’t always support clinicians’ workflows, leading to reliance on paper-based workarounds (3). Artis et al.’s study demonstrates this well. The EHR at their institution does not have a list of recent lab results that can be easily printed (or viewed on a shared display) for rounds, so presenters resorted to printing different EHR pages, like the progress note template, sign-out document, or a combination of both, and then wrote additional labs and notes on the margins. Even when using these methods, only 78% of audited labs appeared on the paper documents, highlighting the need for an up-to-date, consolidated, comprehensive labs summary in the EHR that can be easily shared among care providers. Novel methods for presenting lab values are promising (4,5), but their utility in supporting data gathering and reporting for rounds (and other episodes of patient-related communication, e.g., handovers) has yet to be established.
Lab results are critical to decision-making (6), but they are not always available during rounds (7,8). Artis et al. studied the misrepresentation of lab values because lab values are among the most frequently accessed information during rounds (6,9,10) and because it is simple to verify their accuracy using the EHR. The problem is not unique to lab results, however. Other studies have demonstrated poor communication of additional patient information during ICU rounds, including medications and care goals (11,12).
Artis et al. showed that even when they are available, lab results are not always reported. They did not assess whether omissions were deliberate or unintentional, which could have been useful information for designing solutions to this problem. It is possible that many unreported labs were intentionally left out to expedite rounds, which can be lengthy (13). It is arguable whether every lab value is important, but allowing inexperienced trainees to make this determination is an unsafe practice. Additional omissions may have been a result of presenters’ reliance on EHR templates that did not display less frequently ordered labs.
Artis et al. are to be commended for their novel approach to an important problem. Their study, however, has some significant limitations. The magnitude of erroneously reported lab values was not reported and the judgment of which labs were misinterpreted was subjective. The reader is therefore unable to determine the impact of these misrepresentations on patient care. A creatinine of 2.3 that is reported to be 2.2, for example, would be considered an erroneous report, but whether this error is clinically meaningful is questionable. More importantly, as acknowledged by the authors, the study did not assess the impact of these misrepresentations on decision-making and, ultimately, on patient outcomes. The idea that incomplete or incorrect lab values can potentially affect patient care nevertheless has face validity; studies have demonstrated that as more patient information is reviewed during rounds, length of stay and the incidence of preventable complications decrease (11,12).
There are several factors that likely contribute to information loss during rounds, including the amount of data that ICU patients generate (14), the lack of experience of those who gather, analyze, and present these data (15), inadequate support from EHRs for this process (16,17), and the presence of distractors like noise and interruptions (6). It is imperative to develop tools that can overcome these issues and better support information exchange. The study by Artis et al. is an important first step toward quantifying the extent of the problem.
Acknowledgments
Copyright form disclosure: Dr. Segall’s institution received funding from Agency for Healthcare Research and Quality and from the National Library of Medicine, NIH. She disclosed other support from Anesthesia Patient Safety Foundation, CHE Trinity Health Venzke Grant.
Footnotes
Dr. Bennett-Guerrero has disclosed that he does not have any potential conflicts of interest.
Contributor Information
Noa Segall, Duke University Medical Center, Department of Anesthesiology, Durham, NC.
Elliott Bennett-Guerrero, Stony Brook Medicine, Department of Anesthesiology, Health Science Tower, Level 4 (Rm 060), Stony Brook, NY 11794.
References
- 1.McKenzie MS, Auriemma CL, Olenik J, Cooney E, Gabler NB, Halpern SD. An Observational Study of Decision Making by Medical Intensivists. Critical Care Medicine. 2015;43(8):1660–1668. doi: 10.1097/CCM.0000000000001084. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Artis KA, Dyer E, Mohan V, Gold JA. Accuracy of lab data communication on intensive care unit daily rounds using an electronic health record. Critical Care Medicine. 2016 doi: 10.1097/CCM.0000000000002060. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Saleem JJ, Russ AL, Justice CF, Hagg H, Ebright PR, Woodbridge PA, et al. Exploring the persistence of paper with the electronic health record. International Journal of Medical Informatics. 2009;78(9):618–628. doi: 10.1016/j.ijmedinf.2009.04.001. [DOI] [PubMed] [Google Scholar]
- 4.Bauer DT, Guerlain S, Brown PJ. The design and evaluation of a graphical display for laboratory data. Journal of the American Medical Informatics Association. 2010;17(4):416–424. doi: 10.1136/jamia.2009.000505. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Ahmed A, Chandra S, Herasevich V, Gajic O, Pickering BW. The effect of two different electronic health record user interfaces on intensive care provider task load, errors of cognition, and performance. Critical Care Medicine. 2011;39(7):1626–1634. doi: 10.1097/CCM.0b013e31821858a0. [DOI] [PubMed] [Google Scholar]
- 6.Gurses AP, Xiao Y. A Systematic Review of the Literature on Multidisciplinary Rounds to Design Information Technology. 2006;13(3):267–276. doi: 10.1197/jamia.M1992. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Montague M-L, Lee MSW, Hussain SSM. Staff attitudes to a daily otolaryngology ward round. J Laryngol Otol. 2004;118(12):963–971. doi: 10.1258/0022215042790682. [DOI] [PubMed] [Google Scholar]
- 8.Giella P, Hargett BE, Wood CV. Aligning availability of morning laboratory results with physician rounding patterns. Journal of Clinical Outcomes Management. 2004;11(9):577–582. [Google Scholar]
- 9.Friesdorf W, Konichezky S, Gross-Alltag F, Federolf G, Schwilk B, Wiedeck H. System ergonomic analysis of the morning ward round in an intensive care unit. J Clin Monit. 1994;10(3):201–209. doi: 10.1007/BF02908862. [DOI] [PubMed] [Google Scholar]
- 10.Collins S, Hurley AC, Chang FY, Illa AR, Benoit A, Laperle S, et al. Content and functional specifications for a standards-based multidisciplinary rounding tool to maintain continuity across acute and critical care. Journal of the American Medical Informatics Association. 2014;21(3):438–447. doi: 10.1136/amiajnl-2013-001949. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Pucher PH, Aggarwal R, Darzi A. Surgical Ward Round Quality and Impact on Variable Patient Outcomes. Annals of Surgery. 2014;259(2):222–226. doi: 10.1097/SLA.0000000000000376. [DOI] [PubMed] [Google Scholar]
- 12.Pronovost P, Berenholtz S, Dorman T, Lipsett PA, Simmonds T, Haraden C. Improving communication in the ICU using daily goals. Journal of Critical Care. 2003;18(2):71–75. doi: 10.1053/jcrc.2003.50008. [DOI] [PubMed] [Google Scholar]
- 13.Vats A, Goin KH, Villarreal MC, Yilmaz T, Fortenberry JD, Keskinocak P. The impact of a lean rounding process in a pediatric intensive care unit. Critical Care Medicine. 2012;40(2):608–617. doi: 10.1097/CCM.0b013e318232e2fc. [DOI] [PubMed] [Google Scholar]
- 14.Manor-Shulman O, Beyene J, Frndova H, Parshuram CS. Quantifying the volume of documented clinical information in critical illness. Journal of Critical Care. 2008;23(2):245–250. doi: 10.1016/j.jcrc.2007.06.003. [DOI] [PubMed] [Google Scholar]
- 15.March CA, Steiger D, Scholl G, Mohan V, Hersh WR, Gold JA. Use of simulation to assess electronic health record safety in the intensive care unit: a pilot study. BMJ Open. 2013;3(4) doi: 10.1136/bmjopen-2013-002549. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Zahabi M, Kaber DB, Swangnetr M. Usability and Safety in Electronic Medical Records Interface Design: A Review of Recent Literature and Guideline Formulation. Hum Factors. 2015;57(5):805–834. doi: 10.1177/0018720815576827. [DOI] [PubMed] [Google Scholar]
- 17.Morrison C, Fitzpatrick G, Blackwell A. Multi-disciplinary collaboration during ward rounds: embodied aspects of electronic medical record usage. International Journal of Medical Informatics. 2011;80(8):e96–e111. doi: 10.1016/j.ijmedinf.2011.01.007. [DOI] [PubMed] [Google Scholar]