Impact of Physician Training Level on Neonatal Tracheal Intubation Success Rates and Adverse Events—A report from National Emergency Airway Registry for Neonates (NEAR4NEOS)

Abstract

Introduction:

Neonatal tracheal intubation (TI) outcomes have been assessed by role, but training level may impact TI success and safety. Effect of physician training level (PTL) on first-attempt success, adverse TI associated events (TIAEs), and oxygen desaturation was assessed.

Methods:

Prospective cohort study in 11 international NEAR4NEOS sites between Oct 2014-Dec 2017. Primary TIs performed by pediatric/ neonatal physicians were included. Univariable analysis evaluated association between PTL, patient/ practice characteristics, and outcomes. Multivariable analysis with generalized estimating equation assessed for independent association between PTL and outcomes (first attempt success, TIAEs, oxygen desaturation ≥20%; attending as reference).

Results:

Of 2,608 primary TIs, 1,298 were first attempted by pediatric/neonatal physicians. PTL was associated with patient age, weight, comorbidities, TI indication, difficult airway history, premedication, and device. First-attempt success rate differed across PTL [resident 23%, fellow 53%, attending 60%; p<0.001]. There was no statistically significant difference in TIAEs (resident 22%, fellow 20%, attending 25%; p=0.34). Desaturation occurred more frequently with residents (60%), compared to fellows and attendings (46%, 53%; p<0.001). In multivariable analysis, adjusted odds ratio of first-attempt success was 0.18 (95% CI 0.11–0.30) for residents and 0.80 (95% CI: 0.51–1.24) for fellows. PTL was not independently associated with adjusted odds of TIAEs or severe oxygen desaturation.

Conclusion:

Higher PTL was associated with increased first-attempt success but not TIAE/oxygen desaturation. Identifying strategies to decrease adverse events during neonatal TI remains critical.

Introduction

Proficiency in neonatal tracheal intubation (TI) is critically important for providers in delivery rooms and neonatal intensive care units (NICU). Sub-optimal TI technique has been associated with direct airway injury, patient deterioration, intraventricular hemorrhage [1,2], neurodevelopmental impairment [3], and death [4–6].

Reported neonatal TI success rates range from 20–60% [7–9]. Pediatric resident TI competency is particularly concerning, as success rates appear to be declining [7–13]. Numerous factors likely contribute, including limited work hours and NICU rotations [14], increased presence of advanced pediatric providers (APPs) [15], and clinical practice changes, including care of infants born through meconium-stained amniotic fluid [16] and utilization of non-invasive ventilation strategies [17,18]. There is great concern that changes in the practice environment have negatively impacted current physician trainees’ neonatal TI competency.

Physicians’ TI competency is critical to avoid short- and long-term adverse events and ensure patient safety. Considering the current practice environment offers limited TI opportunities, there may be increased risk to patients intubated by physician trainees if not selected deliberately and supervised closely. Additionally, many residents may not be competent to safely perform TI after graduation, although this skill remains important for pediatricians [19,20] in rural settings [21,22] or entering critical care subspecialty fellowships [23].

Since most studies classify providers according to role, a knowledge gap exists in understanding how trainee TI skills improve throughout residency (post-graduate year (PGY) 1–3) and fellowship (PGY 4–6), specifically related to success rates and outcomes. The aim of the present study was to evaluate TI performed by physicians across the continuum of pediatric post-graduate medical training (including each specific year of residency/ fellowship training) and attending physicians to assess for differences in success rates, adverse TI associated events (TIAEs), and severe oxygen desaturation (oxygen desaturation ≥ 20%). We hypothesized that intubations performed by junior trainees would have lower success rates and higher rates of adverse outcomes.

Methods

Setting and Design

This retrospective cohort study was conducted using prospectively collected data from 11 international neonatal intensive care units (NICUs) from North America, Europe and Asia participating in the National Emergency Airway Registry for Neonates (NEAR4NEOS) quality improvement registry between October 2014-December 2017 [24–28]. All NEAR4NEOS sites were granted Institutional Review Board approval or deemed exempt as quality improvement initiatives. Informed consent was waived. Primary TIs performed by pediatric/neonatal physicians across the physician training spectrum [residents, neonatal-perinatal medicine (NPM) fellows, neonatology attendings] were included. Intubations performed outside the NICU (i.e., delivery room), performed for tube exchanges, and performed by non-physician clinicians (including physician assistants, nurse practitioners, and respiratory therapists) and non-NICU based clinicians (including pediatric surgeons, otolaryngologists, and anesthesiologists) were excluded from this analysis. Participating NICUs did not have a protocol to specify the intubating clinician’s discipline or training level; this selection was left to the discretion of the bedside team.

Study Exposure and Outcomes

The exposure of interest was the training level of the physician performing the initial TI attempt.

Outcomes

The primary outcome was first-attempt success rate. Secondary outcomes included adverse TIAEs and severe oxygen desaturation.

NEAR4NEOS Definitions

Operational definitions utilized in this study were developed a priori in NEAR4NEOS, as previously described [24]. Briefly, a course refers to a single approach to airway management, including device and premedication. An intubation attempt begins with device (i.e., laryngoscope) placement into the patient’s oropharynx, and ends with either device removal or tracheal tube placement. A successful course of airway management was defined as an endotracheal tube placed into the trachea, with confirmation by chest rise, auscultation, carbon dioxide detection, laryngoscopic assessment (using videolaryngoscopy (VL) or secondary independent laryngoscopy), and/ or chest radiography. First-attempt success was defined as a successful intubation by the first provider in the first attempt of the first course.

Safety outcomes included adverse TIAEs, and severe oxygen desaturations. Adverse TIAEs were categorized into severe and non-severe, as previously described [24]. Severe oxygen desaturation was designated as ≥ 20% decrease in oxygen saturation from the highest level immediately before the procedure to the lowest oxygen saturation during the course.

Statistical Analysis

Analyses were conducted using Stata 15.0 (Stata Corp, College Station, TX, USA). Univariable analysis was performed to assess for association between physician training levels (PTL) and patient factors, practice factors, and outcomes using Chi-square test or Fischer’s exact test for categorical variables and Wilcoxon rank-sum test for non-parametric variables. Multivariable analysis was performed with generalized estimating equation to assess for independent association between PTL and TI outcomes while controlling for potential confounders. All analyses were a priori specified and approved by the NEAR4NEOS manuscript oversight committee. P-value <0.05 was considered statistically significant.

Results

Patient and practice characteristics

Of 2,608 qualifying primary TIs, 1,298 (49.8%) were first attempted by pediatric/neonatal physicians. Initial TI attempts were performed most often by fellows (61.6%), followed by residents (30.1%), Table 1. PTL was significantly associated with patient age and weight at TI. The gestational age (GA) among infants intubated by fellows was significantly lower (median 27 weeks, IQR: 25–34 weeks) than in infants intubated by residents or attendings (P<0.001). Residents often performed TI for ventilation failure (41%), surfactant administration (14%), or electively for a planned procedure (28%). Conversely, attending physicians were more likely to perform TI in infants with history of difficult airway (DA) (26%); airway/ craniofacial anomaly (14%), or congenital heart disease (14%). TIs performed by attending physicians more frequently had indications of unstable hemodynamics (7%) or unplanned extubation (23%).

Table 1.

Patient characteristics associated with physician training level

	Resident N=391	Fellow N=799	Attending N=108	P-value
Age after birth (day, median, IQR)	6 (1–43)	11 (1–43)	48 (8–104)	0.0001
Gestational age at birth (week, median, IQR)	30 (26–35)	27 (25–34)	28 (25–34)	0.0001
Weight (g, median, IQR)	2070 (1280–2930)	1500 (870–2900)	2452 (1445–3500)	0.0001
Weight <1500g (n, %)	134 (34%)	399 (50%)	28 (26%)	<0.001
Comorbidities (n, %)
Heart disease	27 (7%)	47 (6%)	15 (14%)	0.008
Airway/craniofacial anomaly	14 (4%)	54 (7%)	15 (14%)	<0.001
Acute respiratory failure	228 (58%)	467 (58%)	36 (33%)	<0.001
Chronic respiratory failure	91 (23%)	204 (26%)	50 (46%)	<0.001
TI indication
Oxygenation failure	107 (27%)	261 (33%)	38 (35%)	0.118
Ventilation failure	160 (41%)	272 (34%)	39 (36%)	0.068
Apnea and Bradycardia	90 (23%)	167 (21%)	17 (16%)	0.253
Upper Airway Obstruction	17 (4%)	49 (6%)	14 (13%)	0.004
Procedure	54 (14%)	53 (7%)	11 (10%)	<0.001
Unstable hemodynamics (shock)	4 (1%)	24 (3%)	8 (7%)	0.002
Surfactant administration	108 (28%)	138 (17%)	7 (6%)	<0.001
Unplanned extubation	17 (4%)	132 (17%)	25 (23%)	<0.001
Difficult airway
Difficult airway history	23 (6%)	76 (10%)	28 (26%)	<0.001
Difficult airway feature on exam	72 (18%)	196 (25%)	27 (25%)	0.051

TI: tracheal intubation. IQR: Interquartile range.

Table 2 details practice-related factors. VL was similarly utilized across PTL (22% in residents, 24% in fellows, 27% in attendings, p=0.419). Sedation and paralysis were utilized in slightly less than half of attempts across provider groups. Attendings were most likely to perform TI without sedation or paralysis (24% in residents, 34% in fellows, 43% in attending, p<0.001).

Table 2.

Practice characteristics associated with physician training level

	Resident N=391	Fellow N=799	Attending N=108	P-value
Device ^				0.491
Direct laryngoscopy	306 (78%)	606 (76%)	78 (72%)
Video laryngoscopy	84(22%)	192 (24%)	29 (27%)
Medication *				<0.001
Sedation+Paralysis	192 (49%)	379 (47%)	50 (46%)
Sedation only	103 (26%)	144 (18%)	12 (11%)
No medication	95 (24%)	271 (34%)	46 (43%)
Approach #				0.002
Oral	384 (98%)	782 (98%)	100 (93%)
Nasal	4 (1%)	11 (1%)	7 (6%)

^{^}Device information was missing in 1 tracheal intubation by Fellow, and other device was used in 1 tracheal intubation by Attending.

^*6 tracheal intubations were performed with paralysis alone.

^#10 patients had other approaches (i.e., supraglottic airway).

Tracheal Intubation Outcomes

First-attempt success rates were significantly different among PTL: 23% in residents, 53% in fellows, 60% in attendings; p<0.001, Table 3. First-attempt success rates gradually increased with PTL: 16% in PGY-1 residents, 19% in PGY-2 residents, 34% in PGY-3 residents, 51% in PGY-4 fellows, 55% in PGY-5 fellows, and 60% in attendings; p<0.001, non-parametric chi-square for trends, Figure 1. Among provider groups, there was no difference in the frequency of any TIAEs (22% in residents, 20% in fellows, 25% in attendings; p=0.344) or severe TIAEs (5% in residents, 5% in fellows, and 8% in attendings; p=0.354), Figure 1, Supplemental Table A. Supplemental table B demonstrates a breakdown for each TIAE. Severe oxygen desaturation occurred more frequently with residents (65%), compared to fellows (52%) and attendings (58%); p<0.001.

Table 3.

Tracheal Intubation Outcomes across the physician training levels: Univariate analyses (n, %)

Outcome	Resident N=391	Fellow N=799	Attending N=108	P-value
First attempt success	89 (23%)	424 (53%)	65 (60%)	<0.001
Any TIAEs*	87 (22%)	158 (20%)	27 (25%)	0.344
Severe TIAEs	19 (5%)	42 (5%)	9 (8%)	0.354
Non-severe TIAEs	79 (20%)	134 (17%)	20 (19%)	0.345
Oxygen desaturation ≥20%	249 (65%)	401 (52%)	60 (58%)	<0.001

TIAE denotes Tracheal Intubation Associated Events.

More than one severe or non-severe TIAE may occur in each TI, therefore the count for any TIAE is fewer than the sum or severe and non-severe TIAEs.

For details of each TIAE, please refer to Supplemental Table A.

Figure 1.

First attempt success, any adverse tracheal intubation associated events (TIAEs) and oxygen desaturation ≥20% across physician training levels. The detailed data are presented in Supplemental Table A.

Table 4 summarizes results after controlling for patient and practice factors associated with provider levels in the multivariable analysis. The adjusted odds ratio (OR) for first-attempt success for residents was 0.18 (95% CI: 0.11–0.30; P<0.001) and for fellows was 0.80 (95% CI: 0.51–1.24; P=0.328) using attending performance as reference.

Table 4.

Multivariable analysis: Physician training level and first attempt success

	Odds ratio	95% confidence interval	p-value
Physician training level
Resident	0.18	0.11–0.30	<0.001
Fellow	0.80	0.51–1.25	0.328
Attending	1 (reference)
Patient characteristics
Weight≥1500g	1.29	0.98–1.69	0.065
Comorbidity
Heart disease	0.99	0.60–1.63	0.967
Airway/Craniofacial anomaly	0.81	0.46–1.43	0.476
Acute respiratory failure	1.10	0.76–1.59	0.609
Chronic respiratory failure	0.78	0.53–1.13	0.189
Tracheal intubation indication
Ventilation failure	1.05	0.80–1.38	0.737
Upper airway obstruction	2.07	1.21–3.56	0.008
Procedure	1.73	1.08–2.76	0.023
Unstable hemodynamics (shock)	1.26	0.63–2.53	0.519
Surfactant administration	0.98	0.69–1.40	0.930
Unplanned extubation	1.55	1.05–2.29	0.027
Difficult Airway
Difficult airway history	0.90	0.58–1.38	0.616
Difficult airway feature on examination	0.76	0.57–1.03	0.075
Device
Direct Laryngoscopy	1 (reference)
Video Laryngoscopy	1.25	0.91–1.70	0.165
Medication
Sedation+paralysis	1.92	1.42–2.59	<0.001
Sedation only	0.76	0.53–1.89	0.135
No medication	1 (reference)
Approach
Oral	1 (reference)
Nasal	0.82	0.32–2.07	0.672

Total number=1,281. First attempt success data were available in 1,297 tracheal intubations. This model excluded tracheal intubation with paralytic only (n=6), and non-oral, nasal approach (i.e., Laryngeal mask airway, emergent tracheostomy), n=10.

PTL was not independently associated with occurrence of any TIAE (adjusted OR for residents: 0.91, 95% CI 0.52–1.59, p=0.732; adjusted OR for fellows: 0.69, 95% CI 0.41–1.16, p=0.163 with attending as reference; Supplemental Table C) nor with rates of severe oxygen desaturation (adjusted OR for residents: 1.56, 95% CI 0.96–2.53, p=0.073; adjusted OR for fellows: 0.82, 95% CI 0.52–1.28, p=0.384 with attending as reference; supplemental Table D).

Discussion:

This retrospective cohort study demonstrated significant differences in first-attempt success rates in neonatal TI across PTL (resident, fellow, attending), and provides granular information on incremental improvement with each physician training year. Despite improved first-attempt success rates, there was no significant difference in secondary outcomes, including occurrence of adverse TIAE or severe oxygen desaturation.

To our knowledge, this is the first multi-center study to evaluate neonatal TI success and safety outcomes using discrete 1-year increments in pediatric physicians across residency, NPM fellowship, and ultimately, as attending neonatologists [11]. These findings are important to elucidate due to tremendous learning curves encountered early in a post-graduate training program, as well as the need to evaluate performance more precisely for summative assessment of trainees preparing for the next step in training, or entry into unsupervised practice. Differences in TI success and safety across PTL may impact individual provider’s educational opportunities, highlight the need for alternative airway management strategies (such as laryngeal mask airways), and inform development of observational assessment tools for TI training [29]. These findings may aid supervising educators in selecting appropriate TI attempts for trainees at a given level, considering factors such as patient size, indications for intubation, existing comorbidities and hemodynamic stability. Supervisors should also optimize intubation conditions, such as use of premedication when appropriate.

We observed improvement in first-attempt success rate across the continuum of physician post-graduate training. Compared to attending neonatologists, residents had significantly lower first-attempt success rates, especially earlier in their training. These findings are consistent with findings in pediatric ICUs [30], and may impact discussions on whether it is feasible for all graduating pediatric residents to demonstrate competency in TI. This situation has been challenged by decreased TI opportunities due to practice changes, such as more conservative management of infants born through meconium-stained amniotic fluid [16], widespread use of non-invasive ventilation in the neonatal/ pediatric ICU settings [8,11,31], and increasing utilization of APPs [15]. This raises concerns for technical proficiency of new NPM fellows at the beginning of training.

Our attending success rates are lower than what might be considered ideal. Attendings, in this study, were often intubating patients with challenging anatomy or unstable hemodynamics suggesting stressful clinical situations, or where other providers had failed. We hypothesize that attending success rates would be much higher if attendings were intubating on the first attempt in patients with less challenging characteristics and more stable physiologic status, allowing better optimization of intubating conditions. These factors may explain differences in success rates between our study and operating room (OR) intubations [32]. Another possibility for this suboptimal success rate is that current-day attendings have had fewer opportunities to refine their intubation skills during training than their predecessors [8,11,15,16,31], coupled with infrequent opportunities to refresh their skills clinically while supervising their team (given the decreased procedural frequency overall, as well as the need for trainees and other providers to achieve and maintain proficiency)[10]. As such, it remains critically important to identify robust assessment methods to ensure fellows are competent in intubation prior to completion of training (ideally through observational assessment of psychomotor skills, or a learning curve analysis, such as cumulative sum [33–36]), and to provide ongoing procedural exposure for experienced intubators.

It is notable that there was no significant association between PTL and occurrence of adverse TIAE or severe oxygen desaturations in the multivariable analysis. We hypothesize that this may be due to close supervision of junior trainees in the NICU, with intubation attempts only permitted in patients with hemodynamic stability and less likelihood of DA anatomy. Conversely, the lack in difference in adverse safety outcomes across PTL may also be related to increased physiological instability and anatomic difficulty in the patients being intubated by attendings. While these patient factors were adjusted as covariates in the multivariable analysis, it is likely that there were unmeasured confounders associated with higher rates of adverse TIAEs and preference for a physician of higher training level to perform TI in a given situation. These factors may also be reflected in the “U-shaped” pattern of severe oxygen desaturation outcomes (with higher rates of desaturation noted in both novice and experienced intubators). Junior providers may have required additional time to complete the procedure while experienced providers may have encountered patient instability or anatomic challenges.

In our multivariable model, several factors were associated with higher first-attempt success rates. Factors such as use of sedation/paralysis and indication for TI procedure make sense with regard to facilitating first-attempt success [27], however, TI indication for upper airway obstruction and unplanned extubation were associated with higher first-attempt success rates without clear reasons. We speculate these indications may be potentially associated with more stable patient status and provide suitable intubation conditions.

Conversely, additional factors which may be suspected to confer decreased first-attempt success rate, including history or examination suggestive of a DA, did not demonstrate statistical significance in this study. This may be a dilutional effect due to the overall relatively low first-attempt success across TIs, with or without DA. Sawyer et al published an analysis of NEAR4NEOS data where “difficult intubation” was defined specifically as an intubation requiring 3 or more attempts by a fellow/attending [26]. Not surprisingly, patients with difficult intubation had higher risk for TIAE (OR 4.9) and severe oxygen desaturation (OR 4.2). In our study, while it was unusual for attending physicians to perform initial intubation attempts (n=108 out of 1,298 courses), approximately 25% of these were performed in infants with either history or clinical exam suggestive of DA.

Notably, use of VL in this analysis was not associated with a significant difference in TI outcomes. Previous authors have demonstrated improvement in clinical TI first attempt success rates (although without a reduction in duration, number of required attempts, or adverse events) with VL, particularly for junior trainees [24,37–40]. Additionally, a recently published randomized control study demonstrated that use of VL in infants was associated with higher first-attempt success in the OR [32]. Our multivariable analysis, however, indicated that there was not a significant association between VL use and first-attempt success in this cohort. This difference may be due to the fact that our patients are much smaller than those in the OR study, or that intubation conditions may be different (for example, a TI occurring in the OR or selected for a trainee to perform may be more controlled), contributing to higher success rates in other settings.

There are limitations to this study. First, data on intubation success rates and adverse outcomes was collected by self-report. Despite extensive training on operational definitions at each site, and rigorous local protocols to capture data on all TI courses, it is possible that reporting bias exists. Most institutions participating in NEAR4NEOS are academic centers with residency and fellowship training programs. However, results may not be representative of all centers with respect to local practice or physician training structure. Additionally, trainee TI proficiency may differ depending on presence of other trainees or clinicians (i.e., pediatric residents may have more opportunities for TI in institutions without a neonatology fellowship). We did not collect data on existing center-specific educational curricula for TI, which may impact success and safety outcomes. Importantly, our study did not follow individual physician trainees over time, and the analyses did not consider individual learning curves. A different type of learning curve analysis such as cumulative sum (CUSUM) would be appropriate for such an analysis [33–36]. Finally, we do not have data on duration of intubation attempts, which may significantly impact first-attempt success rates, adverse TIAEs, and oxygen desaturation. Future studies using video recording carts will facilitate such data collection [41,42].

Conclusion:

First-attempt success rates increased with advancing PTL, but training level was not independently associated with TIAE or severe oxygen desaturation. Future efforts should focus on identifying strategies to improve intubation safety, having experienced providers intubate high-risk babies, and by examining methods to avoid adverse events and desaturation.

Abbreviations:

NICU

neonatal intensive care unit

NPM

neonatal-perinatal medicine

TI

neonatal intubation

TIAE

tracheal intubation adverse events

PTL

physician training level

DA

difficult airway

OR

operating room