Skip to main content
Resuscitation Plus logoLink to Resuscitation Plus
. 2023 Jun 8;14:100410. doi: 10.1016/j.resplu.2023.100410

In-situ simulations to detect patient safety threats during in-hospital cardiac arrest

Mathilde Stærk a,b,c,d, Kasper G Lauridsen b,d,e, Josephine Johnsen d,f, Bo Løfgren b,d,g,, Kristian Krogh d,h
PMCID: PMC10323216  PMID: 37424767

Abstract

Introduction

Errors during treatment may affect patient outcomes and can include errors in treatment algorithms, teamwork, and system errors. In-hospital cardiac arrests (IHCA) require immediate and effective treatment, and delays are known to reduce survival. In-situ simulation is a tool that can be used to study emergency responses, including IHCA. We investigated system errors discovered during unannounced in-situ simulated IHCA.

Method

This multicenter cohort study included unannounced, full-scale IHCA in-situ simulations followed by a debriefing based on PEARLS with plus-delta used in the analysis phase. Simulations and debriefings were video-recorded for subsequent analysis. System errors observed were categorized by thematic analysis and analyzed for clinical implications. Errors related to treatment algorithm and clinical performance were excluded.

Results

We conducted 36 in-situ simulations across 4 hospitals with a total discovery of 30 system errors. On average, we discovered 0.8 system errors per simulation within the categories: human, organizational, hardware, or software errors. Of these, 25 errors (83%) had direct treatment consequences. System errors caused treatment delays in 15 cases, a need for alternative actions in 6 cases, omission of actions in 4 cases, and other consequences in 5 cases.

Conclusion

Using unannounced in-situ simulations, we identified almost one system error per simulation, and most of these errors were deemed to impact treatment negatively. The errors affected treatment by either causing delays, need for alternative treatment options, or omitting treatment actions. We suggest that hospitals focus on the need for regular testing of the emergency response by conducting full-scale unannounced in-situ simulations. This should be a priority to improve patient safety and care.

Introduction

Handling a medical emergency is a stressful situation with a risk of errors. In the USA, it is estimated that nearly 100.000 people/year die due to medical errors, where many could have been prevented.1 Errors frequently occur during in-hospital cardiac arrest (IHCA), and are associated with worse survival outcomes.2 IHCA calls for effective and immediate treatment, and delays lower the chance of survival.3, 4, 5

Errors can relate to many aspects of resuscitation, such as the treatment algorithm, communication, teamwork, and the overall system. While errors related to the treatment algorithm, communication, and teamwork can be limited by continuous education and training of the staff, system errors require solutions on an organizational level. Today, most research on errors during resuscitation focuses on human errors affecting treatment algorithms and teamwork.6, 7, 8 However, a well-functioning organization with a minimum of system errors is also needed.

In-situ simulations can serve as a tool to investigate emergency responses, improve workflow, and test the organization.9, 10, 11, 12 Thus, in-situ simulations provide the possibility to adjust the procedures and rectify errors discovered during in-situ simulations by identifying hazardous and latent safety threats to avoid errors from happening in real situations.11, 13, 14, 15, 16, 17 In this study, we investigate system errors discovered during unannounced in-situ simulated IHCA conducted in four Danish hospitals.

Methods

Study design

This is a post-hoc analysis of a prospective, multicenter simulation-based study consisting of full-scale unannounced in-situ simulated IHCA conducted at four hospitals.18 The method is described in detail elsewhere.18, 19

Setting

We conducted full-scale in-situ simulations at one university hospital and three regional hospitals in departments (in-patient and out-patient clinical areas) with an automated external defibrillator (AED) during workdays, weekends, day shifts, and night shifts. We excluded intensive care units, cardiology, pediatric, and psychiatric departments. The nurse manager on the specific ward assigned a patient room for the simulation on the day of simulation. The location, time, and content of the simulation were unknown to all other staff. During the study period, all hospital staff that could be involved in the in-situ simulations were provided with written information about the possible occurrence of an in-situ simulation and instructed to act as in real life in case of a simulation.

A full-body manikin (Resusci Anne QCPR AED with Airway Head, Laerdal Medical, Stavanger, Norway) was placed in a hospital bed, and a normal patient call was activated in the room. A nurse/nurse assistant responded and was briefed with a short patient history. The nurse/nurse assistant was instructed to assess the patient, that presented as unresponsive and without breathing. The simulation consisted of a shockable scenario and continued until the third rhythm analysis by the cardiac arrest team where return of spontaneous circulation was obtained. It was possible to conduct actions as in real life, e.g., activate the hospital’s cardiac arrest team, retrieve information from the patient record (including e.g., blood samples, an electrocardiogram, chest x-ray), administer intravenous medication, perform intubation, and use the hospital defibrillators. Participants needed to retrieve and use their normal equipment and did not receive any feedback nor help during the simulations. All simulations were followed by a debriefing based on PEARLS with plus-delta included in all debriefings. Debriefers were experienced and certified simulation instructors and did not probe for systems errors unless brought up by participating staff members.20, 21

Data collection

We video-recorded the in-situ simulations and debriefings using two cameras capable of capturing 180-degree video (GoPro Hero 5 Black, San Mateo, CA, USA). An additional camera was used during the debriefings. The videos were reviewed by two independent researchers following a predetermined template with an included note field for other observations including system errors. Videos were re-reviewed if any disagreement. These data were the source of the latent system errors along with the debriefing transcripts. We conducted a thematic analysis of the errors to identify overall themes. Errors with an urgent risk to patient safety were reported to the department management within 24 hours of the simulation to be rectified immediately.

Ethics

The study was approved by the Danish Data Protection Agency (j.no. 1-16-02-367-18) and deemed exempt from ethical committee approval and individual consent (j.no. 141/2017). Hospital administrations gave permission, and hospital departments were informed about the study. Safety precautions were taken to secure patient safety during simulations.18, 19

Results

We conducted 36 in-situ simulations across four different hospitals evenly distributed on wards that had an AED with an average of 4 simulations per department July 2018 to December 2020. In total, 30 in-situ simulations were complete, whereas 6 in-situ simulations were interrupted due to emergency calls/acute patients. We identified 30 system errors, equal to 0.8 system error per simulation, related to the categories: human errors (n = 6, 20%), organizational errors (n = 3, 10%), hardware errors (n = 5, 17%), and software errors (n = 16%, 53%) (Table 1). Overall, 15 (50%) errors resulted in delayed actions, e.g., the AED did not have defibrillation electrodes attached, causing delayed defibrillation, 6 (20%) errors resulted in an alternative action conducted, e.g., the emergency alert system did not work, and the staff had to leave the patient room to alert colleagues, 4 (13%) errors resulted in actions having to be omitted, e.g., the laryngoscope could not be located, and intubation was therefore not performed, and 5 (17%) errors had other consequences. All errors, but one (wrongful rhythm analysis by AED), were preventable at a hospital level. Errors related to the treatment algorithm and clinical performance are reported elsewhere.18, 19

Table 1.

Errors discovered during in-situ simulations and how they affected treatment.

Foot note: ‘Code call’: a notification of a cardiac arrest and location to the cardiac arrest team members. ‘Emergency alerting call’: a prioritized telephone call to all nursing telephones in the department, making it possible to talk to all nursing staff at once. ‘Local emergency alert system’: panels in the patient room with the possibility to send a notification of an emergency/acute situation to all nursing staff at the specific department.

Error category Consequence
Human errors
Step stool for providing chest compressions was misplaced and could not be found Alternative action
‘Code call’ for the cardiac arrest team was sent with the wrong location and the cardiac arrest team therefore arrived at wrongful site Delayed action
Anesthetist equipment was not fully stocked despite equipment being sealed Action omitted
Pressure bags were missing in the resuscitation trolley Alternative action
Emergency medicine box was expired Other
The AED did not have defibrillation electrodes Delayed action
Organizational errors
The laryngoscope could not be located in the resuscitation trolley due to the resuscitation trolley being unorganized and filled with too many items Action omitted
Potassium was not available neither in the emergency equipment nor in the department Action omitted
Staff did not have telephones, nor was a telephone available in the patient room, which delayed the process of calling the cardiac arrest team. Delayed action
Hardware errors
Therapy cable on defibrillator had a loose connection Delayed action
Therapy cable on defibrillator had a loose connection Delayed action
Defibrillator batteries were old and could not provide sufficient power for defibrillation. Defibrillator needed connection to a power outlet to defibrillate Delayed action
The mechanical chest compression device’s claw locks were jammed, and the device, therefore, was difficult to attach Delayed action
AED was in full-automatic mode instead of semi-automatic mode Other
Software errors
The ‘emergency alerting call’ did not overrule regular phone calls Delayed action
The ‘emergency alerting call’ was not received on all telephones Delayed action
A telephone could not accept a received ‘emergency alerting call’ Delayed action
The local emergency alert was not received on all pagers/telephones Delayed action
The switchboard operator system did not register that the internal medicine specialist had accepted the cardiac arrest code call despite having accepted this on the telephone system Other
Code call was not received by the orderly and the anesthetist Delayed action
The anesthetist could not accept the code call on the telephone Other
The anesthetist, nurse anesthetist, and orderly could not report ‘arrived’ on the telephone but only accept the code call Other
The local emergency alert system at the specific bed site did not work Alternative action
The local emergency alert system at the specific bed site did not work Alternative action
The local emergency alert system in the patient room did not work Alternative action
The local emergency alert system in the patient room did not work Alternative action
Prioritization system for elevators in case of emergencies did not function. The elevator instead stayed stock at one floor Delayed action
Prioritization system for elevators in case of emergencies did not function. The elevator went down despite being directed upwards Delayed action
Prioritization system for elevators did not function. This delayed both the orderly, the anesthetist, and nurse anesthetist Delayed action
AED recommended ‘no shock’ despite analyzing on a shockable rhythm (ventricular fibrillation) Action omitted

Discussion

During in-situ simulations, we found errors causing delays in treatment, need for alternative actions, omitted actions, or other consequences. Most system errors influenced the treatment and could potentially have affected clinical patient outcomes. On average, we identified one system error per in-situ simulation. This is less than previous studies that have identified up to 2.1 latent safety threats per simulation.11, 12, 22 However, these studies also report errors related to the treatment algorithm and teamwork. We have reported errors related to the initial treatment algorithm, and defibrillation elsewhere.18, 19 If all errors were reported together, our study would also have identified more errors per simulation. Importantly, the system errors we identified are similar to those reported in other studies such as cardiac arrest calling procedures, equipment malfunctions, or delays in locating the equipment during resuscitation.23, 24 Unannounced in-situ simulations may therefore be an important method to identify errors that may threaten patient safety.

The system errors mainly resulted in delays of treatment. This may be critical for the survival of the patient, as survival depends on many time-sensitive factors, e.g., time to first chest compression, defibrillation, cardiac arrest team arrival, adrenaline administration, etc.3, 5, 25, 26, 27, 28 Many of the errors we discovered related to the process of alerting relevant staff. Some of these errors resulted in the delayed arrival of relevant staff, whilst others caused the need for staff at site to leave the patient room to retrieve help as the alarm system in the room could not be activated. This resulted in delayed initiation of basic life support and increased chest compression pauses which negatively affects patient outcomes.3, 5, 29

The system errors could almost all be rectified at a hospital level and therefore may mitigate potential patient harm in case of a real IHCA. For example, some of the system errors relating to equipment being misplaced or difficult to find may be solved by providing knowledge about where the equipment is located, and the importance of the equipment being correctly replaced after use. Other system errors related to software issues could be solved by adjusting the software or implementing other software solutions, e.g., one hospital struggled with the alarm system on the telephones, which other hospitals did not experience as they used a newer software solution for telephone alerts.

The process of identifying errors is a challenging task, which may often be divided into smaller “parts”, e.g., only testing the telephone alerting system and not the alerting system in the patient rooms. Current training in the emergency response is most often conducted in a simulation center, thereby excluding the possibility of discovering system errors by only focusing on finding and adjusting treatment errors, teamwork, communication, etc. The system errors discovered in our study would not have been identified if the simulations were conducted at a simulation center, as many system errors related to the alerting process and staff transportation to the location. In-situ simulation can be used as a practical and important tool to test the organizational response, either in full or partwise and can be used to study and train the treatment algorithm and knowledge and skills among responders. Especially, unannounced in-situ simulations can mimic the clinical setting to an extent that provides the ultimate “pressure-test” of the system. Previously, it has been reported how in-situ simulations have contributed to the discovery of errors, improvement of processes, and general training of staff’s knowledge and skills.11, 12, 13, 14, 22, 30

Limitations

This study was not designed to look for system errors or latent safety threats specifically but rather to document resuscitation from the initial patient contact in a standardized, unannounced shockable cardiac arrest scenario. Despite the participant-focused approach using plus-delta debriefing, we identified many system errors and safety issues. This highlights the potential for identifying latent safety threats using in-situ simulations that ideally should be preceded by an assessment of the clinical workspace and with a scenario designed to highlight potential risks or issues.

Conclusion

Using unannounced in-situ simulations, we identified almost one system error per simulation, and most of these errors were deemed to impact treatment negatively. The errors affected treatment by either causing delays, need for alternative treatment options, or omitting treatment actions. We suggest that hospitals utilize full-scale unannounced in-situ simulations to minimize system errors and improve patient safety.

CRediT authorship contribution statement

Mathilde Stærk: Conceptualization, Methodology, Resources, Investigation, Writing – original draft, Writing – review & editing, Project administration. Kasper G. Lauridsen: Conceptualization, Methodology, Investigation, Writing – review & editing, Supervision. Josephine Johnsen: Investigation, Writing – review & editing. Bo Løfgren: Conceptualization, Methodology, Resources, Writing – review & editing, Supervision. Kristian Krogh: Conceptualization, Methodology, Investigation, Writing – review & editing, Supervision.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgments

Acknowledgement

We thank all participating hospitals, departments, and staff. A special thanks to Rikke Højbjerg, RN, Mette Qvortrup, RN, and Rasmus Philip Nielsen, MD, for contributing to include departments and conducting simulations. We thank Julie Niklassen, MD, Dung Nguyen Riis, MD, Camilla Thomsen, MD, Signe Hedebo, MB, Christian Gansted, MD, Cecilie Budolfsen, MD, Kathrine Mackenhauer, MB, Marlice Zwanenburg, MD, Maria Høybye, MD, Stine Holst Bjerre Pedersen, RN, Marine Sølling Ramsing, MB, Alexandra Amalie Uglebjerg Pedersen, MD, Sophie Fromholt, Martin Thomsen, MB, Isabella Hangaard Rüdiger, MD, Ida Norup, MD, Marie Egebjerg Jensen, MD, Louise Bentzen, MD, Kenneth Lavrsen, Reshaabi Srinanthalogen, MD, Amalie Nicolaisen, and Mette Vold Hansen, MD for their assistance in conducting simulations.

We thank Randers Regional Hospital, Aarhus University, Laerdal Foundation, the A.P. Møller Foundation for the Advancement of Medical Science (Fonden til Lægevidenskabens Fremme), the Health Foundation (Helsefonden), and Health Research Foundation of Central Denmark Region (Region Midtjyllands Sundhedsvidenskabelige Forskningsfond) for financial support. We thank Physio-Control for providing defibrillation electrodes for the study.

References

  • 1.Kohn L.T., Corrigan J.M., Donaldson M.S., editors. To Err is Human: Building a Safer Health System. National Academies Press; Washington (DC): 2000. https://doi.org/10.17226/9728. [PubMed] [Google Scholar]
  • 2.Ornato J.P., Peberdy M.A., Reid R.D., Feeser V.R., Dhindsa H.S. Impact of resuscitation system errors on survival from in-hospital cardiac arrest. Resuscitation. 2012;83:63–69. doi: 10.1016/j.resuscitation.2011.09.009. [DOI] [PubMed] [Google Scholar]
  • 3.Nolan J., Soar J., Eikeland H. The chain of survival. Resuscitation. 2006;71:270–271. doi: 10.1016/j.resuscitation.2006.09.001. [DOI] [PubMed] [Google Scholar]
  • 4.Semeraro F., Greif R., Böttiger B.W., et al. European Resuscitation Council Guidelines 2021: systems saving lives. Resuscitation. 2021;161:80–97. doi: 10.1016/j.resuscitation.2021.02.008. [DOI] [PubMed] [Google Scholar]
  • 5.Sandroni C., Ferro G., Santangelo S., et al. In-hospital cardiac arrest: Survival depends mainly on the effectiveness of the emergency response. Resuscitation. 2004;62:291–297. doi: 10.1016/j.resuscitation.2004.03.020. [DOI] [PubMed] [Google Scholar]
  • 6.Abella B.S., Alvarado J.P., Myklebust H., et al. Mechanical cardiopulmonary resuscitation during in-hospital cardiac arrest. J Am Heart Assoc. 2023;12 doi: 10.1161/JAHA.122.027726. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Sutton R.M., Wolfe H., Nishisaki A., et al. Pushing harder, pushing faster, minimizing interruptions… but falling short of 2010 cardiopulmonary resuscitation targets during in-hospital pediatric and adolescent resuscitation. Resuscitation. 2010;2013:1–12. doi: 10.1016/j.resuscitation.2013.07.029.Pushing. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Hunziker S., Tschan F., Semmer N.K., et al. Hands-on time during cardiopulmonary resuscitation is affected by the process of teambuilding: a prospective randomised simulator-based trial. BMC Emerg Med. 2009;9:1–10. doi: 10.1186/1471-227X-9-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Barbeito A., Bonifacio A., Holtschneider M., Segall N., Schroeder R., Mark J. In situ simulated cardiac arrest exercises to detect system vulnerabilities. Simul Healthc. 2015;10:154–162. doi: 10.1097/SIH.0000000000000087. [DOI] [PubMed] [Google Scholar]
  • 10.Sørensen J.L., Østergaard D., LeBlanc V., et al. Design of simulation-based medical education and advantages and disadvantages of in situ simulation versus off-site simulation. BMC Med Educ. 2017;17:1–9. doi: 10.1186/s12909-016-0838-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Lighthall G.K., Poon T., Harrison T.K. Using in situ simulation to improve in-hospital cardiopulmonary resuscitation. Jt Comm J Qual Patient Saf. 2010;36:209–216. doi: 10.1016/S1553-7250(10)36034-X. [DOI] [PubMed] [Google Scholar]
  • 12.Wheeler D.S., Geis G., Mack E.H., LeMaster T., Patterson M.D. High-reliability emergency response teams in the hospital: improving quality and safety using in situ simulation training. BMJ Qual Saf. 2013;22:507–514. doi: 10.1136/bmjqs-2012-000931. [DOI] [PubMed] [Google Scholar]
  • 13.Patterson M.D., Geis G.L., Falcone R.A., LeMaster T., Wears R.L. In situ simulation: detection of safety threats and teamwork training in a high risk emergency department. BMJ Qual Saf. 2013;22:468–477. doi: 10.1136/bmjqs-2012-000942. [DOI] [PubMed] [Google Scholar]
  • 14.Petrosoniak A., Fan M., Hicks C.M., et al. Trauma Resuscitation Using in situ Simulation Team Training (TRUST) study: latent safety threat evaluation using framework analysis and video review. BMJ Qual Saf. 2021;30:739–746. doi: 10.1136/bmjqs-2020-011363. [DOI] [PubMed] [Google Scholar]
  • 15.Couto T.B., Barreto J.K.S., Marcon F.C., Mafra A.C.C.N., Accorsi T.A.D. Detecting latent safety threats in an interprofessional training that combines in situ simulation with task training in an emergency department. Adv Simul. 2018;3:1–7. doi: 10.1186/s41077-018-0083-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Porter E., Barcega B., Kim T.Y. Analysis of medication errors in simulated pediatric resuscitation by residents. West J Emerg Med. 2014;15:486–490. doi: 10.5811/westjem.2014.2.17922. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Dochartaigh O.D., Ying L., Simard K., et al. Identifying and managing latent safety threats though a zone-wide emergency department in-situ multidiscipline simulation program: a quality improvement project. Can J Emerg Nurs. 2022;45:37–46. doi: 10.29173/cjen157. [DOI] [Google Scholar]
  • 18.Stærk M., Lauridsen K.G., Niklassen J., Nielsen R.P., Krogh K., Løfgren B. Barriers and facilitators for successful AED usage during in-situ simulated in-hospital cardiac arrest. Resusc Plus. 2022:10. doi: 10.1016/j.resplu.2022.100257. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Stærk M., Lauridsen K.G., Støtt C.T., Riis D.N., Løfgren B., Krogh K. Inhospital cardiac arrest—the crucial first 5 min: a simulation study. Adv Simul. 2022;7:1–12. doi: 10.1186/s41077-022-00225-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Fanning R.M., Gaba D.M. The role of debriefing in simulation-based learning. Simul Healthc. 2007;2:115–125. doi: 10.1097/SIH.0b013e3180315539. [DOI] [PubMed] [Google Scholar]
  • 21.Eppich W., Cheng A. Promoting Excellence and Reflective Learning in Simulation (PEARLS) Simul Healthc. 2015;00:1–10. doi: 10.1097/SIH.0000000000000072. [DOI] [PubMed] [Google Scholar]
  • 22.Hunt E., Walker A.R., Shaffner D.H., Miller M.R., Pronovost P.J. Simulation of in-hospital pediatric medical emergencies and cardiopulmonary arrests: highlighting the importance of the first 5 minutes. Pediatrics. 2008;121:e34–e43. doi: 10.1542/peds.2007-0029. [DOI] [PubMed] [Google Scholar]
  • 23.Madsen J.L., Lauridsen K.G., Løfgren B. In-hospital cardiac arrest call procedures and delays of the cardiac arrest team: A nationwide study. Resusc Plus. 2021;5 doi: 10.1016/j.resplu.2021.100087. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Lauridsen K.G., Krogh K., Müller S.D., et al. Barriers and facilitators for in-hospital resuscitation: A prospective clinical study. Resuscitation. 2021;164:70–78. doi: 10.1016/j.resuscitation.2021.05.007. [DOI] [PubMed] [Google Scholar]
  • 25.Holmberg M., Holmberg S., Herlitz J. Incidence, duration and survival of ventricular fibrillation in out-of-hospital cardiac arrest patients in Sweden. Resuscitation. 2000;44:7–17. doi: 10.1016/S0300-9572(99)00155-0. [DOI] [PubMed] [Google Scholar]
  • 26.Gold L.S., Fahrenbruch C.E., Rea T.D., Eisenberg M.S. The relationship between time to arrival of emergency medical services (EMS) and survival from out-of-hospital ventricular fibrillation cardiac arrest. Resuscitation. 2010;81:622–625. doi: 10.1016/j.resuscitation.2010.02.004. [DOI] [PubMed] [Google Scholar]
  • 27.Stærk M., Lauridsen K.G., Krogh K., Løfgren B. Distribution and use of automated external defibrillators and their effect on return of spontaneous circulation in Danish hospitals. Resusc Plus. 2022:9. doi: 10.1016/j.resplu.2022.100211. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Holmberg M.J., Issa M.S., Moskowitz A., et al. Vasopressors during adult cardiac arrest: a systematic review and meta-analysis. Resuscitation. 2019;139:106–121. doi: 10.1016/j.resuscitation.2019.04.008. [DOI] [PubMed] [Google Scholar]
  • 29.Christenson J., Andrusiek D., Everson-Stewart S., et al. Chest compression fraction determines survival in patients with out-of-hospital ventricular fibrillation. Circulation. 2009;120:1241–1247. doi: 10.1161/CIRCULATIONAHA.109.852202. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Ullman E., Kennedy M., Di Delupis F.D., et al. The Tuscan Mobile Simulation Program: a description of a program for the delivery of in situ simulation training. Intern Emerg Med. 2016;11:837–841. doi: 10.1007/s11739-016-1401-2. [DOI] [PubMed] [Google Scholar]

Articles from Resuscitation Plus are provided here courtesy of Elsevier

RESOURCES