Skip to main content
Springer logoLink to Springer
. 2024 Sep 23;183(11):4981–4990. doi: 10.1007/s00431-024-05781-3

Impact of in situ simulation training on quality of postnatal stabilization and resuscitation—a before-and-after, non-controlled quality improvement study

Lukas P Mileder 1,2,, Nariae Baik-Schneditz 1,2, Jasmin Pansy 1,2, Bernhard Schwaberger 1,2, Wolfgang Raith 1,2, Alexander Avian 3, Georg M Schmölzer 4,5, Peter Wöckinger 6, Gerhard Pichler 1, Berndt Urlesberger 1
PMCID: PMC11473610  PMID: 39311967

Abstract

This study aimed to evaluate the impact of in situ simulation-based training on quality indicators of patient care at a level IV neonatal intensive care unit. A before-and-after, non-controlled quality improvement study was performed at the Division of Neonatology, Medical University of Graz. The educational intervention comprised a period of 4 months, with structured in situ simulation training delivered regularly for neonatal providers and nurses in interprofessional teams. The primary study outcome was the quality of non-technical skills and team interaction during actual postnatal stabilization and resuscitation. This was assessed using video recording during two 2-month observational phases before (pre-training) and after the educational intervention (post-training). Delivery room video recordings were assessed by two external, blinded neonatologists using the Anaesthetists’ Non-Technical Skills (ANTS) score. Furthermore, we collected clinical patient data from video-recorded neonates during the pre- and post-training periods, and training participants’ individual knowledge of neonatal resuscitation guidelines was assessed using a before- and after-questionnaire. A total of 48 healthcare professionals participated in 41 in situ simulation trainings. The level of non-technical skills and team interaction was already high in the pre-training period, and it did not further improve afterwards. Nonetheless, we observed a significant increase in the teamwork event “evaluation of plans” (0.5 [IQR 0.0–1.0] versus 1.0 [1.0–2.0], p = 0.049). Following the educational intervention, training participants’ knowledge of neonatal resuscitation guidelines significantly improved, although there were no differences in secondary clinical outcome parameters.

Conclusion: We have successfully implemented a neonatal in situ simulation training programme. The observed improvement in one teamwork event category in the post-training period demonstrates the effectiveness of the training curriculum, while also showing the potential of in situ simulation training for improving postnatal care and, ultimately, patient outcome.

What is Known:

In situ simulation-based training is conducted in the real healthcare environment, thus promoting experiential learning which is closely aligned with providers’ actual work.

In situ simulation-based training may offer an additional benefit for patient outcomes in comparison to other instructional methodologies.

What is New:

This observational study investigated translational patient outcomes in preterm neonates before and after delivery of high-frequency in situ simulation-based training at a level IV neonatal intensive care unit.

There was a significant increase in the frequency of one major teamwork event following the delivery of in situ simulation-based training, indicating a notable improvement in the non-technical skills domain, which is closely linked to actual team performance.

Keywords: Neonate, Preterm, Postnatal stabilization, Resuscitation, Video recording, Non-technical skills, Simulation training, In situ training

Introduction

Simulation-based training (SBT) is ideally suited for “dynamic domains involving high hazard and invasive intervention”, including, but not limited to, anaesthesia, critical care, and emergency medicine [1]. Due to the challenges and risks associated with the care for depressed or non-vigorous neonates, particularly immediately after birth, neonatal-perinatal medicine is recognized as a discipline with substantial potential for SBT. SBT offers a safe “arena” for structured learning tailored to participants’ needs, facilitating active experimentation which is fundamental for adult learning. It also integrates the practice of cognitive, technical, and behavioural, non-technical skills, which are essential for interdisciplinary and interprofessional training [24]. Recognized as a “promising tool to improve patient safety, team performance, and ultimately patient outcomes” [5], simulation-based educational techniques have developed into an integral element of neonatal-perinatal training in many institutions [6, 7]. Hence, current neonatal resuscitation guidelines explicitly recommend SBT as well as team and leadership training as part of educational programmes [8].

SBT delivered in the real healthcare environment, with on-duty providers as training participants, has been coined in situ simulation [9]. It offers advantages over centre-based training, by promoting experiential learning closely aligned with healthcare providers’ actual work and improving training efficiency for institutions and participants [9]. In situ SBT can also be used to analyze and improve the quality of patient care, to identify latent safety threats in actual healthcare environments, and to test new facilities [1012]. In addition to these benefits, a recent systematic review and meta-analysis reported an improvement in patient mortality and morbidity when comparing in situ SBT with current educational practices [13]. However, so far only a few studies have investigated the stringent use of in situ SBT and its impact on the quality of postnatal stabilization and resuscitation, which was the aim of the present study.

Materials and methods

We performed a before-and-after, non-controlled quality improvement study at the Division of Neonatology, Department of Paediatrics and Adolescent Medicine, Medical University of Graz, Austria, a level IV neonatal intensive care unit [14] covering approximately 3500 inborn births per year. The study was approved by our university’s Ethics Committee (27–014 ex 14/15). Physicians (residents, fellows, and consultants) and nurses at the Division of Neonatology were invited to participate on a voluntary basis and informed consent was obtained prior to study participation.

In situ SBT

Unannounced in situ SBT was delivered over a period of 4 months, aiming at three to five training sessions every week. Trainings were delivered based on clinical workload to ensure dedicated, uninterrupted participation. A high-fidelity neonatal simulator (Gaumard Newborn HAL S3010, Gaumard Scientific Company Inc., Miami, United States of America) was used for SBT in the resuscitation room and clinical area of the Division of Neonatology. The training sessions were delivered by one simulation trainer (LPM) and scenarios focused on key challenges and typical clinical situations encountered during postnatal care. Each training session comprised 30 to 50 minutes, with 15–20 minutes of interprofessional SBT followed by 15–30 minutes of structured debriefing [15].

Outcome measures

The primary outcome was the quality of non-technical skills and team interaction during actual postnatal stabilization and resuscitation. This was assessed using the Anaesthetists’ Non-Technical Skills (ANTS) score, which comprises four main categories (Task Management, Team Working, Situation Awareness, Decision Making) and a total of 15 individual elements, with scores ranging from 1 to 4 (1 = poor, 2 = marginal, 3 = acceptable, 4 = good, n = not observed) [16]. A recent systematic review found a substantial interrater reliability in the majority of studies that employed the ANTS score [17]. As a further outcome measure, the number of five specific teamwork events (sharing information, inquiry, assertion, teaching/advising, and evaluation of plans) was also determined from video review [18].

Assessments took place during two 2-month observational phases before (pre-training) and after delivery of in situ SBT (post-training). During these phases, postnatal stabilization and resuscitation of preterm and term neonates, without major congenital cardio-pulmonary malformations who required respiratory and/or cardio-circulatory support after birth, was video-recorded after parental consent. For video recordings, one installed camera targeted the neonate on the resuscitation table or in the incubator, while a second mobile camera recorded the healthcare team during the provision of postnatal care. To analyze the primary outcome, two external neonatologists (GMS, PW) reviewed all the recordings independently and in random order using the ANTS score, focussing on team performance rather than on individual performance.

Furthermore, demographic and clinical data of the video-recorded neonates were collected as secondary outcome measures either from video recordings, our unit’s polygraphic data management system (Alpha-Trace digital MM, B.E.S.T. Medical Systems, Vienna, Austria) or patient charts. Among those were as follows:

  • time from neonate’s arrival at the resuscitation table to heart rate (HR) auscultation (seconds)

  • time from neonate’s arrival at the resuscitation table to first ventilation breath (if required) (seconds)

  • number of endotracheal intubation attempts (if required) during postnatal stabilization and resuscitation

  • arterial oxygen saturation (SpO2) and HR 5 min after the neonate’s arrival at the resuscitation table (% and beats per minute, respectively)

  • rectal body temperature during/immediately after postnatal stabilization and resuscitation (°C)

  • Apgar scores at minutes 1, 5, and 10 after birth

  • development of pneumothorax requiring chest tube insertion within 24 h after birth

  • length of hospitalization (days)

  • in-hospital mortality

Finally, training participants’ individual knowledge of neonatal resuscitation guidelines was assessed before and after in situ SBT. For this purpose, participants individually completed a standardized, 20-question paper-and-pencil knowledge test on neonatal resuscitation guidelines, developed by the European Resuscitation Council for its Newborn Life Support provider courses.

Sample size calculation and statistical analyses

Sample size calculation was based on the study by Thomas et al. [18], in which adding additional teamwork training to standard Neonatal Resuscitation Program training resulted in a mean of 3.8 more teamwork events (i.e. sharing information, inquiry, assertion, teaching/advising, evaluation of plans) in the intervention group. According to our previous experiences, we assumed that approximately 30 neonates could be recorded during the pre- and post-training periods. Assuming comparable differences between the pre- and post-training periods as mentioned above and using the same standard deviation (SD: 3.4), a similar effect could be detected in a study with 30 pre- and post-training period events of postnatal stabilization and resuscitation, when using a t-test for independent samples with a power of 98%.

Data are presented as frequencies, absolute and relative values, mean ± SD, or median (IQR), as appropriate. Shapiro–Wilk and Kolmogorov–Smirnov tests were used to test for normal distribution. Since it was not possible to record the names of all team members of each event of postnatal stabilization and resuscitation, tests for independent data were used to compare pre- and post-training periods. Sex, administration of prenatal steroids, clinical signs of chorioamnionitis, the need for respiratory support after birth, frequency of hypothermia, and development of pneumothorax were compared between the pre- and post-training periods using either Chi-square test or Fisher’s exact test. Results of the pre- and post-cognitive knowledge tests were compared using the Wilcoxon signed-rank test. Depending on data distribution, the t-test for independent samples or the Mann–Whitney U test was used to compare the remaining outcome measures, including the primary study outcome. A p-value of < 0.05 was considered statistically significant. Statistical analyses were performed using IBM SPSS Statistics 28 (Armonk, United States of America).

Results

Forty-one in situ simulation trainings were delivered over the study period of 4 months, corresponding to a mean of 2.6 trainings per week, excluding the 2 weeks of the Christmas holidays. Twenty-one physicians and 27 nurses participated in the study, with a median of two physicians (1–3) and two neonatal nurses (2–3) in each training session. Simulation scenarios covered peri- and postnatal asphyxia (n = 11), meconium aspiration syndrome (n = 9), respiratory distress and postnatal management of preterm neonates (n = 8), early-onset bacterial infection or sepsis (n = 4), congenital cardiac defect (n = 3), neonatal seizures (n = 3), difficult airway (n = 2), and pneumothorax (n = 1).

Patients (pre- and post-training periods)

Twenty preterm neonates participated in a clinical study at the Division of Neonatology Graz during the pre-training period. Of those, 15 neonates (75.0%) required medical support after birth. During the post-training period, 13 of 25 video-recorded neonates (52.0%) were in need of medical support after birth and, thus, were included in this study.

Demographic data of these 28 neonates, who were all delivered by Caesarean section, are presented in Table 1. Birth weight was lower in the post-training period, but gestational age and sex did not differ between the groups.

Table 1.

Demographic data of the included 28 neonates (absolute [relative] numbers or mean ± SD, as appropriate) (* = p < 0.05)

All neonates (n = 28) Pre-training (n = 15) Post-training (n = 13) p-value
Gestational age (weeks) 30.4 ± 3.6 31.5 ± 3.7 29.2 ± 3.3 0.101
Male sex (%) 16 (57.1) 9 (60) 7 (53.8) 0.743
Birth weight (grams) 1441 ± 672 1678 ± 744 1168 ± 469 0.043*
Prenatal steroids (%) 23 (82.1) 13 (86.7) 10 (76.9) 0.502
Clinical signs of chorioamnionitis (%) 3 (10.7) 2 (13.3) 1 (7.7) 0.630
Caesarean section (%) 28 (100) 15 (100%) 13 (100%) -

All 28 neonates required respiratory support after birth. There were no differences in either oropharyngeal suctioning (80.0% versus 76.9%, p = 1.000), oxygen supplementation (93.3% versus 84.6%, p = 0.583), mask continuous positive airway pressure (100% versus 100%), mask positive pressure ventilation (60.0% versus 76.9%, p = 0.435), or the need for intubation (26.7% versus 53.8%, p = 0.142) between the pre- and post-training period.

Primary study outcome

Video recordings were available from 12 of 15 neonates (80.0%) and from 13 of 13 neonates (100%) during the pre- and post-training periods, respectively. The median duration of video recordings did not differ between the pre- and post-training periods (15 [10.25–15.0] versus 15 [15.0–15.0] min, p = 0.393).

According to both video evaluators, there were no differences in either the four main ANTS categories (Fig. 1) or in any of the 15 ANTS elements (Table 2). In general, the level of non-technical skills and team interaction was already high in the pre-training period, with three of the four main ANTS categories having a “good” evaluation before implementation of in situ SBT, as rated by both evaluators (Fig. 1).

Fig. 1.

Fig. 1

Anaesthetists’ Non-Technical Skills (ANTS) categories for the pre- (left columns) and post-training periods (right columns), according to the first (upper figure) and second (lower figure) video evaluator (4 = good, 3 = acceptable, 2 = marginal, 1 = poor)

Table 2.

Individual Anaesthetists’ Non-Technical Skills (ANTS) elements (median scores [IQR]) for pre- and post-training periods, according to first (left) and second video evaluator (4 = good, 3 = acceptable, 2 = marginal, 1 = poor)

ANTS elements First video evaluator Second video evaluator
Pre-training Post-training p-value Pre-training Post-training p-value
Planning and preparing 2.5 (2.0–3.0) (No scoring) - 4.0 (2.25–4.0) 3.0 (2.0–4.0) 0.695
Prioritizing 3.0 (2.75–4.0) 4.0 (2.0–4.0) p = 0.832 4.0 (3.0–4.0) 4.0 (2.0–4.0) 0.400
Providing and maintaining standards 4.0 (4.0–4.0) 4.0 (3.0–4.0) p = 0.207 4.0 (3.0–4.0) 4.0 (2.0–4.0) 0.743
Identifying and utilizing resources 3.0 (2.0–3.0) 4.0 (2.0–4.0) p = 0.392 4.0 (3.5–4.0) 4.0 (2.0–4.0) 0.731
Co-ordinating activities with team members 3.0 (2.0–4.0) 4.0 (2.0–4.0) p = 0.494 4.0 (3.0–4.0) 4.0 (2.5–4.0) 0.303
Exchanging information 2.0 (2.0–3.0) 4.0 (2.0–4.0) p = 0.093 4.0 (3.0–4.0) 4.0 (3.0–4.0) 0.605
Using authority and assertiveness 3.0 (1.0–4.0) 3.0 (2.5–4.0) p = 0.649 4.0 (3.0–4.0) 4.0 (3.0–4.0) 1.000
Assessing capabilities 3.0 (2.0–4.0) 3.0 (2.5–4.0) p = 0.531 4.0 (4.0–4.0) 4.0 (3.5–4.0) 0.481
Supporting others 3.0 (1.0–4.0) 3.0 (1.0–4.0) p = 0.865 4.0 (3.0–4.0) 4.0 (4.0–4.0) 0.691
Gathering information 3.0 (1.0–3.0) 3.0 (2.0–4.0) p = 0.531 4.0 (3.5–4.0) 4.0 (4.0–4.0) 0.602
Recognizing and understanding 3.0 (2.0–4.0) 3.0 (2.0–4.0) p = 0.820 4.0 (3.0–4.0) 4.0 (3.25–4.0) 0.422
Anticipating 2.5 (1.75–4.0) 2.0 (2.0–4.0) p = 0.738 4.0 (3.25–4.0) 4.0 (3.75–4.0) 0.897
Identifying options 3.0 (1.75–3.0) 3.0 (2.0–4.0) p = 0.376 4.0 (4.0–4.0) 4.0 (3.5–4.0) 0.529
Balancing risks and selecting options 2.0 (2.0–3.0) 3.0 (2.0–4.0) p = 0.303 4.0 (3.25–4.0) 4.0 (4.0–4.0) 0.686
Re-evaluating 3.0 (2.0–4.0) 3.0 (3.0–4.0) p = 0.733 4.0 (4.0–4.0) 4.0 (3.25–4.0) 0.524

There was a significant increase in the frequency of the teamwork event “evaluation of plans” (0.5 [0.0–1.0] versus 1.0 [1.0–2.0], p = 0.049) during the post-training period, while the incidence of the other four teamwork events did not increase significantly (Fig. 2). The total number of all five teamwork events increased from 15.0 (10.0–24.3) to 18.0 (13.5–30.5) after the delivery of in situ SBT, but without reaching statistical significance (p = 0.056; Fig. 2).

Fig. 2.

Fig. 2

Teamwork events per neonate (median) during the pre- and post-training periods (sharing information, p = 0.102; inquiry, p = 0.088; assertion, p = 0.129; teaching/advising, p = 0.911; evaluation of plans, p = 0.049)

Secondary study outcomes

When comparing the clinical outcome parameters, there were no differences between the pre- and post-training period, except for significantly lower 5-minute Apgar scores (9 [8–9] versus 8 [8–9], p = 0.045). However, after removing the three deceased neonates (one in the pre-training period and two in the post-training period) from the analysis, 5-minute Apgar scores did not differ significantly (9 [8–9] versus 8 [8–9], p = 0.191). Secondary outcome parameters are detailed in Table 3.

Table 3.

Secondary study outcomes for the pre- and post-training periods (absolute values, mean ± SD or median (IQR), as appropriate) (* = p < 0.05)

Pre-training Post-training p-value
Time from arrival at the resuscitation table to HR auscultation (seconds) 9.5 (3.0–22.75) 10.0 (5.25–21.75) 0.715
Time from arrival at the resuscitation table to first ventilation breath (seconds) 27.0 (16.5–43.0) 30.0 (14.0–49.0) 0.871
Number of endotracheal intubation attempts (n) 2 (1.25–2.75) 2 (1–3) 0.920
SpO2 5 minutes after arrival at the resuscitation table (%) 78.5 (72.25–86.25) 76 (62–84) 0.406
HR 5 minutes after arrival at the resuscitation table (beats per minute) 137.5 (128.5–147.0) 144 (93–152) 0.732
Rectal body temperature (°C) 36.8 ± 0.2 36.6 ± 0.7 0.394
Apgar at 1 minute 7 (6–8) 6 (4.5–8) 0.421
Apgar at 5 minutes 9 (8–9) 8 (7–9) 0.045*
Apgar at 10 minutes 9 (9–9) 9 (9–9) 0.697
Pneumothorax within 24 h after birth (n) 1/15 0/13 1.000
Length of hospitalization (days) 28 (16–57) 41 (15–75.5) 0.447
Mortality (n) 1/15 2/13 0.583

HR heart rate, SpO2 arterial oxygen saturation

Twenty-nine of the 48 training participants (60.4%) answered the standardized cognitive knowledge test before and after in situ SBT, showing a significant increase in correctly answered questions between the pre- and post-training periods (15 [13–15.5] versus 18 [17–19], p < 0.001).

Discussion

This study is among the first investigating the impact of a dedicated in situ simulation training programme on neonatal short-term outcome, including the length of hospitalization and in-hospital mortality. In the context of translational science [19], this study assessed T2 outcomes (“evidence of clinical effectiveness at the level of the patient”) and T3 outcomes (“health care delivery …and preventive services that yield measureable improvements in the health of individuals and society”) [19], which is important to inform best educational practices.

During the intervention period, we aimed at delivering three to five training sessions every week. Although we did not achieve this ambitious goal, we managed to deliver an average of 2.6 trainings per week over the 4-month period. Patient care responsibilities and clinical obligations, which have also been reported by other in situ SBT programmes [20, 21], were observed as the main obstacles for training delivery and staff participation.

Neither of the two video evaluators identified differences in the four ANTS categories (Task Management, Team Working, Situation Awareness, and Decision Making) or in any of their 15 individual elements. However, when interpreting the results, one must bear in mind the already high level of non-technical skills and team interaction observed during the pre-training period, which offered only little room for further improvement. This high level before the delivery of our educational intervention is even more remarkable, as there was no dedicated team training curriculum in place at our institution before this project. Still, there was a significant improvement in the teamwork event “evaluation of plans” during the post-training period. Although a causal link cannot be established, this improvement could be attributed to the delivered in situ SBT, which mainly targeted interprofessional and interdisciplinary teamwork and communication. Regular re-evaluation of the clinical situation and the diagnostic and therapeutic plan is essential to avoid fixation errors and is recognized as a key element of situational awareness, a common attribute of high-performing healthcare teams [22, 23]. Our finding of an improvement in the teamwork domain could actually result in improved patient care practices. Studies across different disciplines have shown that teamwork training is associated with improved protocol adherence and reduced activation times of extracorporeal cardiopulmonary resuscitation teams [24], shortened door-to-needle time in stroke patients requiring thrombolysis [25], and fewer maternal blood transfusions and postpartum bleeding events [26]. Accordingly, Brogaard et al. [27] reported a 5.5-fold increase of the likelihood of high clinical performance during postnatal stabilization and resuscitation in case of excellent non-technical skills execution.

Following the delivery of in situ SBT, the combined number of all five targeted teamwork events was increased, which almost reached statistical significance in our study. Higher teamwork event rates have been shown to be associated with faster, more efficient performance of simulated neonatal resuscitation [18], again emphasizing the potential relevance of this finding for postnatal care.

We did not find any differences in clinical secondary outcome parameters when comparing the pre- and post-training periods. Both time to HR assessment by auscultation and time to first ventilation breath were within the recommended time frames [8]. SpO2 and HR, assessed 5 minutes after arrival at the resuscitation table, did not show any differences between the pre- and post-training periods. Yet, during both observation periods, the median SpO2 was below the recommended value of 85% [8], which could be associated with higher odds of intraventricular haemorrhage [28]. While this finding illustrates the general challenge of SpO2 targeting, SpO2 values at 10 minutes were within recommended ranges during both observational phases (pre-training: 89.5% [83.00–91.25]; post-training: 90% [81–94]).

A total of 93.3% and 61.5% of preterm neonates in the pre- and post-training periods, respectively, maintained a normal body temperature (i.e. 36.5–37.5°C) during or immediately after postnatal stabilization and resuscitation. Although the insignificantly higher incidence of mild to moderate hypothermia in the post-training group requires attention, this finding is likely attributable to the significantly lower birth weight, which is inversely correlated with the frequency of postnatal hypothermia [29].

The finding of significantly lower 5-minute Apgar scores during the post-training period must be interpreted with caution. First, 1- and 10-minute Apgar scores did not differ between the two observational phases. Second, there is a positive correlation between birth weight and the 5-minute Apgar score in low- and very-low-birth-weight infants [30]. Third, the Apgar score exhibits poor interobserver reliability, especially in preterm neonates [31, 32]. And finally, after correcting for the three deceased neonates, no significant difference in 5-minute Apgar scores was observed.

Despite the lower birth weights of preterm neonates in the post-training period, there were no differences in the incidence of pneumothoraces, length of hospitalization, and in-hospital mortality. Even after adjusting the statistical analysis for the three extremely preterm neonates who had died within the first 9 days after birth, the duration of hospitalization did not differ between the two observational phases. In contrast, Theilen and colleagues [33] found an association between in situ SBT and fewer admissions to and shorter stays in a paediatric intensive care unit. Regarding patient survival, paediatric studies were able to show an association between simulation-based mock code training and a significant increase in survival after cardiopulmonary arrest [34] as well as between SBT combined with a debriefing of actual cardiac arrest events and improved in-hospital cardiopulmonary resuscitation [35].

Training participants’ knowledge of neonatal resuscitation guidelines significantly improved after the delivery of in situ SBT. Many studies have reported enhancements in the cognitive domain following simulation-based education [36, 37]. However, when comparing SBT to non-simulation-based educational interventions, there seems to be no additional benefit regarding knowledge acquisition [38], emphasizing the primary focus of SBT, i.e. acquisition and practice of technical and non-technical skills [2].

Limitations

We must acknowledge several limitations of this study. First, we were unable to achieve the target of 30 events of postnatal stabilization and resuscitation during each period, as determined by the sample size calculation. The main reasons for this were parental refusal to participate and a below-average number of neonates requiring postnatal stabilization and resuscitation during the study period. Second, we performed an uncontrolled before-after study and were, therefore, not able to rule out any selection bias [39]. A controlled before-after study design, an interrupted time series, or a repeated measurement study could have helped mitigate this potential bias [39]. However, we performed our educational intervention over a rather short period of time and aimed at including all neonates requiring postnatal stabilization and resuscitation during the pre- and post-training periods, thus reducing the potential of selection bias. Third, video-recording may have influenced participants’ actual clinical behaviour [40]. Fourth, the video evaluators could not sufficiently assess the ANTS element “planning and preparing” in every video, because in some high-acuity deliveries team briefings were not fully video-recorded. Fifth, the ANTS score has not been developed or validated specifically for postnatal stabilization and resuscitation, in contrast to other more recently developed teamwork assessment tools such as the Global Assessment of Team Performance checklist [27]. Finally, we cannot rule out that the significantly lower birth weight of the preterm neonates in the post-training period interfered with our finding of a higher incidence of the teamwork event “evaluation of plans”, as these more vulnerable patients may have required a higher number of medical interventions.

Conclusions

We have successfully conceptualized, implemented, and delivered an in situ simulation training programme with almost three training sessions per week over a 4-month period at our institution. Although we did not find an improvement in the quality of non-technical skills and team interaction following the delivery of in situ SBT, we observed an already high level during the pre-training period. Still, the frequency of the teamwork event “evaluation of plans” was significantly higher after our educational intervention, as was training participants’ knowledge of neonatal resuscitation guidelines. While these improvements could have a positive impact on the quality and effectiveness of postnatal care, controlled studies are still needed to strengthen the scientific foundation supporting simulation-based neonatal team trainings.

Acknowledgements

This study was performed as part of Dr. Lukas Mileder’s dissertation in the Doctoral Degree Program in Medical Science at the Medical University of Graz.

Abbreviations

ANTS

Anaesthetists’ Non-Technical Skills

IQR

Interquartile range

HR

Heart rate

SD

Standard deviation

SBT

Simulation-based training

SpO2

Arterial oxygen saturation

Authors’ contributions

L.P.M., A.A., G.M.S. and B.U. conceptualized and designed the study. Material preparations and simulation trainings were performed by L.P.M., J.P. and W.R. Data collection was performed by L.P.M., N.B.-S., B.S. and G.P. Data analyses were performed by L.P.M., A.A., G.M.S. and P.W. The first draft of the manuscript was written by L.P.M. and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Funding

Open access funding provided by Medical University of Graz.

Data availability

The data that support the findings of this study are not openly available due to reasons of sensitivity and are available from the corresponding author upon reasonable request.

Declarations

Ethics approval

This study was performed in line with the principles of the Declaration of Helsinki. Approval was granted by the Ethics Committee of the Medical University of Graz (27–014 ex 14/15).

Consent to participate

Informed consent was obtained from all individual participants included in the study.

Competing interests

The authors declare no competing interests.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Gaba DM (2004) The future vision of simulation in health care. Qual Saf Health Care 13(Suppl 1):i2–i10. 10.1136/qhc.13.suppl_1.i2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Halamek LP (2008) The simulated delivery-room environment as the future modality for acquiring and maintaining skills in fetal and neonatal resuscitation. Semin Fetal Neonatal Med 13(6):448–453. 10.1016/j.siny.2008.04.015 [DOI] [PubMed] [Google Scholar]
  • 3.Knowland VCP, Thomas MSC (2014) Educating the adult brain: how the neuroscience of learning can inform educational policy. Int Rev Educ 60(1):99–122. 10.1007/s11159-014-9412-6 [Google Scholar]
  • 4.Zigmont JJ, Kappus LJ, Sudikoff SN (2011) Theoretical foundations of learning through simulation. Semin Perinatol 35(2):47–51. 10.1053/j.semperi.2011.01.002 [DOI] [PubMed] [Google Scholar]
  • 5.Yousef N, Moreau R, Soghier L (2022) Simulation in neonatal care: towards a change in traditional training? Eur J Pediatr 181(4):1429–1436. 10.1007/s00431-022-04373-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Wagner M, Heimberg E, Mileder LP, Staffler A, Paulun A, Löllgen RM, German-speaking Research Association for Simulation in Pediatrics (GRASP) (2018) Status Quo in pediatric and neonatal simulation in four central European regions: the DACHS survey. Simul Healthc 13(4):247–252. 10.1097/SIH.0000000000000296 [DOI] [PubMed] [Google Scholar]
  • 7.Sawyer T, Stavroudis TA, Ades A, Dadiz R, Dammann CEL, Halamek LP, Moussa A, Soghier L, Gupta A, Aliaga S, Umoren R, French H, Organization of Neonatal-Perinatal Training Program Directors Task Force on Simulation (2020) Simulation in neonatal-perinatal medicine fellowship programs. Am J Perinatol 37(12):1258–1263. 10.1055/s-0039-1693465 [DOI] [PubMed] [Google Scholar]
  • 8.Madar J, Roehr CC, Ainsworth S, Ersdal H, Morley C, Rüdiger M, Skåre C, Szczapa T, Te Pas A, Trevisanuto D, Urlesberger B, Wilkinson D, Wyllie JP (2021) European Resuscitation Council Guidelines 2021: newborn resuscitation and support of transition of infants at birth. Resuscitation 161:291–326. 10.1016/j.resuscitation.2021.02.014 [DOI] [PubMed] [Google Scholar]
  • 9.Patterson MD, Blike GT, Nadkarni VM (2008) In situ simulation: challenges and results. In: Henriksen K, Battles JB, Keyes MA, Grady ML (eds) Advances in patient safety: new directions and alternative approaches (Vol. 3: Performance and Tools). Agency for Healthcare Research and Quality, Rockville, United States of America. http://www.ncbi.nlm.nih.gov/books/NBK43682 Accessed 13 June 2024
  • 10.O’Leary F, McGarvey K, Christoff A, Major J, Lockie F, Chayen G, Vassiliadis J, Wharton S (2014) Identifying incidents of suboptimal care during paediatric emergencies-an observational study utilising in situ and simulation centre scenarios. Resuscitation 85(3):431–436. 10.1016/j.resuscitation.2013.12.001 [DOI] [PubMed] [Google Scholar]
  • 11.Mileder LP, Schwaberger B, Baik-Schneditz N, Ribitsch M, Pansy J, Raith W, Rohrleitner A, Mesaric G, Urlesberger B (2023) Sustained decrease in latent safety threats through regular interprofessional in situ simulation training of neonatal emergencies. BMJ Open Qual 12(4):e002567. 10.1136/bmjoq-2023-002567 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Große Lordemann A, Sommerfeldt D, Mileder L (2024) [Latent safety threats in a pediatric emergency department: using in situ simulation to test a new trauma room concept]. Z Evid Fortbild Qual Gesundhwes:S1865–9217(24)00053–9. 10.1016/j.zefq.2024.03.005. Online ahead of print. [DOI] [PubMed]
  • 13.Calhoun AW, Cook DA, Genova G, Motamedi SMK, Waseem M, Carey R, Hanson A, Chan JCK, Camacho C, Harwayne-Gidansky I, Walsh B, White M, Geis G, Monachino AM, Maa T, Posner G, Li DL, Lin Y (2024) Educational and patient care impacts of in situ simulation in healthcare: a systematic review. Simul Healthc 19(1S):S23–S31. 10.1097/SIH.0000000000000773 [DOI] [PubMed] [Google Scholar]
  • 14.Stark AR, Pursley DM, Papile LA, Eichenwald EC, Hankins CT, Buck RK, Wallace TJ, Bondurant PG, Faster NE (2023) Standards for levels of neonatal care: II, III, and IV. Pediatrics 151(6):e2023061957. 10.1542/peds.2023-061957 [DOI] [PubMed] [Google Scholar]
  • 15.Eppich W, Cheng A (2015) Promoting Excellence and Reflective Learning in Simulation (PEARLS): development and rationale for a blended approach to health care simulation debriefing. Simul Healthc 10(2):106–115. 10.1097/SIH.0000000000000072 [DOI] [PubMed] [Google Scholar]
  • 16.Fletcher G, Flin R, McGeorge P, Glavin R, Maran N, Patey R (2003) Anaesthetists’ Non-Technical Skills (ANTS): evaluation of a behavioural marker system. Br J Anaesth 90(5):580–588. 10.1093/bja/aeg112 [DOI] [PubMed] [Google Scholar]
  • 17.Kang J, Hu J, Yan C, Xing X, Tu S, Zhou F (2024) Development and applications of the Anaesthetists’ Non-Technical Skills behavioural marker system: a systematic review. BMJ Open 14(3):e075019. 10.1136/bmjopen-2023-075019 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Thomas EJ, Williams AL, Reichman EF, Lasky RE, Crandell S, Taggart WR (2010) Team training in the neonatal resuscitation program for interns: teamwork and quality of resuscitations. Pediatrics 125(3):539–546. 10.1542/peds.2009-1635 [DOI] [PubMed] [Google Scholar]
  • 19.McGaghie WC, Draycott TJ, Dunn WF, Lopez CM, Stefanidis D (2011) Evaluating the impact of simulation on translational patient outcomes. Simul Healthc 6 Suppl(Suppl):S42-S47. 10.1097/SIH.0b013e318222fde9 [DOI] [PMC free article] [PubMed]
  • 20.Eckels M, Zeilinger T, Lee HC, Bergin J, Halamek LP, Yamada N, Fuerch J, Chitkara R, Quinn J (2020) A neonatal intensive care unit’s experience with implementing an in-situ simulation and debriefing patient safety program in the setting of a quality improvement collaborative. Children (Basel) 7(11):202. 10.3390/children7110202 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Rivera EK, Siple LM, Wicks EJ, Johnson HS, Skov CM (2020) In situ neonatal mock codes: assessing the impact. Neonatal Netw 39(1):29–34. 10.1891/0730-0832.39.1.29 [DOI] [PubMed] [Google Scholar]
  • 22.Johnsen BH, Westli HK, Espevik R, Wisborg T, Brattebø G (2017) High-performing trauma teams: frequency of behavioral markers of a shared mental model displayed by team leaders and quality of medical performance. Scand J Trauma Resusc Emerg Med 25(1):109. 10.1186/s13049-017-0452-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Weller JM, Mahajan R, Fahey-Williams K, Webster CS (2024) Teamwork matters: team situation awareness to build high-performing healthcare teams, a narrative review. Br J Anaesth 132(4):771–778. 10.1016/j.bja.2023.12.035 [DOI] [PubMed] [Google Scholar]
  • 24.Sawyer T, Burke C, McMullan DM, Chan T, Valdivia H, Yalon L, Roberts J (2019) Impacts of a pediatric extracorporeal cardiopulmonary resuscitation (ECPR) simulation training program. Acad Pediatr 19(5):566–571. 10.1016/j.acap.2019.01.005 [DOI] [PubMed] [Google Scholar]
  • 25.Ajmi SC, Advani R, Fjetland L, Dehli Kurz K, Lindner T, Qvindesland SA, Ersdal H, Goyal M, Kvaløy JT, Kurz M (2019) Reducing door-to-needle times in stroke thrombolysis to 13 min through protocol revision and simulation training: a quality improvement project in a Norwegian stroke centre. BMJ Qual Saf 28(11):939–948. 10.1136/bmjqs-2018-009117 [DOI] [PubMed] [Google Scholar]
  • 26.Bogne Kamdem V, Daelemans C, Englert Y, Morin F, Sansregret A (2021) Using simulation team training with human’s factors components in obstetrics to improve patient outcome: a review of the literature. Eur J Obstet Gynecol Reprod Biol 260:159–165. 10.1016/j.ejogrb.2021.03.015 [DOI] [PubMed] [Google Scholar]
  • 27.Brogaard L, Hvidman L, Esberg G, Finer N, Hjorth-Hansen KR, Manser T, Kierkegaard O, Uldbjerg N, Henriksen TB (2022) Teamwork and adherence to guideline on newborn resuscitation-video review of neonatal interdisciplinary teams. Front Pediatr 10:828297. 10.3389/fped.2022.828297 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Oei JL, Finer NN, Saugstad OD, Wright IM, Rabi Y, Tarnow-Mordi W, Rich W, Kapadia V, Rook D, Smyth JP, Lui K, Vento M (2018) Outcomes of oxygen saturation targeting during delivery room stabilisation of preterm infants. Arch Dis Child Fetal Neonatal Ed 103(5):F446–F454. 10.1136/archdischild-2016-312366 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Bruckner M, Mileder LP, Richter A, Baik-Schneditz N, Schwaberger B, Binder-Heschl C, Urlesberger B, Pichler G (2020) Association between regional tissue oxygenation and body temperature in term and preterm infants born by caesarean section. Children (Basel) 7(11):205. 10.3390/children7110205 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Stark CF, Gibbs RS, Freedman WL (1990) Comparison of umbilical artery pH and 5-minute Apgar score in the low-birth-weight and very-low-birth-weight infant. Am J Obstet Gynecol 163(3):818–823. 10.1016/0002-9378(90)91075-n [DOI] [PubMed] [Google Scholar]
  • 31.O’Donnell CP, Kamlin CO, Davis PG, Carlin JB, Morley CJ (2006) Interobserver variability of the 5-minute Apgar score. J Pediatr 149(4):486–489. 10.1016/j.jpeds.2006.05.040 [DOI] [PubMed] [Google Scholar]
  • 32.Niemuth M, Küster H, Simma B, Rozycki H, Rüdiger M; European Society for Paediatric Research (ESPR) Neonatal Resuscitation Section Writing Group; Solevåg AL (2021) A critical appraisal of tools for delivery room assessment of the newborn infant. Pediatr Res. 10.1038/s41390-021-01896-7. Online ahead of print. [DOI] [PubMed]
  • 33.Theilen U, Fraser L, Jones P, Leonard P, Simpson D (2017) Regular in-situ simulation training of paediatric Medical Emergency Team leads to sustained improvements in hospital response to deteriorating patients, improved outcomes in intensive care and financial savings. Resuscitation 115:61–67. 10.1016/j.resuscitation.2017.03.031 [DOI] [PubMed] [Google Scholar]
  • 34.Andreatta P, Saxton E, Thompson M, Annich G (2011) Simulation-based mock codes significantly correlate with improved pediatric patient cardiopulmonary arrest survival rates. Pediatr Crit Care Med 12(1):33–38. 10.1097/PCC.0b013e3181e89270 [DOI] [PubMed] [Google Scholar]
  • 35.Awadhare P, Barot K, Frydson I, Balakumar N, Doerr D, Bhalala U (2023) Impact of quality improvement bundle on compliance with resuscitation guidelines during in-hospital cardiac arrest in children. Crit Care Res Pract 6875754. 10.1155/2023/6875754 [DOI] [PMC free article] [PubMed]
  • 36.Cheng A, Lang TR, Starr SR, Pusic M, Cook DA (2014) Technology-enhanced simulation and pediatric education: a meta-analysis. Pediatrics 133(5):e1313–e1323. 10.1542/peds.2013-2139 [DOI] [PubMed] [Google Scholar]
  • 37.Mileder LP, Urlesberger B, Szyld EG, Roehr CC, Schmölzer GM (2014) Simulation-based neonatal and infant resuscitation teaching: a systematic review of randomized controlled trials. Klin Padiatr 226(5):259–267. 10.1055/s-0034-1372621 [DOI] [PubMed] [Google Scholar]
  • 38.Kennedy CC, Cannon EK, Warner DO, Cook DA (2014) Advanced airway management simulation training in medical education: a systematic review and meta-analysis. Crit Care Med 42(1):169–178. 10.1097/CCM.0b013e31829a721f [DOI] [PubMed] [Google Scholar]
  • 39.Goodacre S (2015) Uncontrolled before-after studies: discouraged by Cochrane and the EMJ. Emerg Med J 32(7):507–508. 10.1136/emermed-2015-204761 [DOI] [PubMed] [Google Scholar]
  • 40.Gordon L, Reed C, Sorensen JL, Schulthess P, Strandbygaard J, Mcloone M, Grantcharov T, Shore EM (2022) Perceptions of safety culture and recording in the operating room: understanding barriers to video data capture. Surg Endosc 36(6):3789–3797. 10.1007/s00464-021-08695-5 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The data that support the findings of this study are not openly available due to reasons of sensitivity and are available from the corresponding author upon reasonable request.


Articles from European Journal of Pediatrics are provided here courtesy of Springer

RESOURCES