Abstract
Objective:
Can a comprehensive, explicitly directive evidence-based guideline for all therapies that might affect the major morbidities of very low-birth-weight (VLBW) infants help a neonatal intensive care unit (NICU) further improve generally favorable morbidity rates? Can Antifragility principles of provider adaptive growth from stressors, enhanced infant risk assessment and adherence to effective therapies minimize unproven treatments and reduce all morbidities?
Study Design:
Prospectively planned observational trial in VLBW infants: control group born October 2011 to September 2013 and study group October 2013 to September 2015. Multi-disciplinary evidence-based review assigned all NICU treatments into one of four distinct categories: (1) always employ this therapy for VLBW infants, (2) never use this therapy, (3) employ this questionable therapy thoughtfully, only in certain circumstances and (4) this therapy has insufficient evidence of efficacy and safety. Extensive staff education emphasized evidence-based potentially better practice (PBP) selection with compliance checks, appreciation of intertwined co-morbidities and prioritizing infant risk reduction strategies.
Results:
Control included 221 infants, mean (s.d.) age 29 (2.6) weeks, birth weight 1129 (257) g and Study included 197 infants, 29 (2.7) weeks, 1093 (292) g. One hundred and four distinct therapies were placed into categories 1 to 4, with 32 specific compliance checks. Overall mean compliance with the process checks during the second era was 70%, high: 100% (exclusive breast milk use), low: 24% (correct pulse oximetry alarm settings). Morbidity and mortality rates did not significantly change during the second era.
Conclusions:
In our NICU with favorable morbidity rates, an expanded effort using a comprehensive therapy guideline for VLBW infants did not further improve outcomes. We need deeper understanding of continuous quality improvement (CQI) fundamentals, therapy compliance, co-morbidity relationships and enhanced sensitivity of risk assessment. Our innovative Antifragility PBP guideline could be useful to other NICUs seeking improvement in VLBW infant morbidities, as we offer a reasoned and concise template of a broad array of therapies categorized efficiently for transparency and review, designed to enhance responsible CQI decision-making.
Introduction
Open sharing of continuous quality improvement (CQI) experience is crucial, even when projects are not successful, because learning accelerates at the intersection of careful documentation and transparency. The reduction of certain neonatal intensive care unit (NICU) morbidities driven by evidence-based principles of CQI is encouraging.1, 2 The Vermont Oxford Network (VON) has championed multidisciplinary collaboration and potentially better practice (PBP) sharing within its membership achieving significant reductions over the past 25 years in any late infection and retinopathy of prematurity in very low-birth-weight (VLBW) infants.1 VON CQI tools are particularly enticing for NICUs with comparatively high morbidity rates, because adopting fundamental CQI techniques reliably reduces unfavorable rates to at least average percentiles. Our next challenge is to develop dependable CQI blueprints that guide sustained multiple morbidity reduction to top quartile percentiles, thus far an elusive goal.3, 4
What about NICUs experienced with traditional evidence-based medicine (EBM) and CQI techniques that already have favorably low morbidity rates? How can these NICUs sustain progress and how can the intricate relationships among potentially competing co-morbidities be better understood? For example, which NICUs reliably minimize chronic lung disease and retinopathy of prematurity, while also consistently reducing the burden of any late infection, necrotizing enterocolitis and intraventricular hemorrhage, and how exactly is this done? Despite impressive progress in NICU CQI, there is currently no published detailed CQI instructional guideline that reliably leads to sustained, multiple morbidity reduction.
Antifragility is the ability of adaptive individuals or organizations to absorb, integrate and not just withstand stressors but actually improve from challenge—hormesis. As described by Taleb5, a wide swath of human endeavors throughout history strongly suggests that successful people and groups share a common feature—the adroit ability to weigh the upside and downside of critical decisions, with an embedded appreciation of the highly nonlinear relationship of many cause-and-effect connections. The conception of ‘Black Swan' events by Taleb5 (unpredicted, rare cataclysms that immediately alter accepted paradigms) and the pivotal moral nature of Antifragility, that is, if I have skin-in-the-game, and cannot transfer that risk to you, then we make adaptive decisions together thoughtfully, are valuable insights we think are relevant to EBM and NICU CQI.
The purpose of this study is to share how our NICU, an experienced 20-year participant in formal local and national CQI activities, but puzzled and frustrated by a lack of sustained improvement, has attempted to excel by understanding Antifragility and infusing its principles into our daily EBM decision-making. We provide for scrutiny the following: (a) an unusually detailed template of PBP classification for all the major VLBW infant morbidities, (b) specific bedside compliance measurements for each morbidity typically scarce in CQI reports, (c) a comprehensive morbidity rate report and (d) speculation regarding the challenges and possible limitations inherent to current CQI methodology.
Methods
The Providence Health System institutional review board approved this investigation. Providence St. Vincent Medical Center (PSVMC) has a Level 3 NICU and this was a prospectively planned observational trial using a historical control group. Our population included all inborn VLBW infants 401 to 1500 g, delivered 1 October 2011 to 30 September 2013 (Era 1 Control Group), compared with those delivered 1 October 2013 to 30 September 2015 (Era 2 Antifragility Group). The PSVMC NICU has been a member of the VON since 1995 and has participated in many organized CQI activities related to the VON NICQ collaborative.6
In January 2013, we began an ambitious project: (a) review our history of CQI activities and the year-to-year VLBW infant mortality and morbidity rates so that everyone understood our early success (‘low-hanging fruit') followed by variable morbidity improvement stagnation (‘high or hidden fruit'); (b) introduce the principles of Antifragility, hormesis, risk assessment and complex cause-and-effect relationships; (c) carefully review every possible therapy that might be used in our NICU to prevent or treat one or more of the nine major morbidities of prematurity and conduct comprehensive literature reviews. We then (d) assigned by consensus every therapy to one of four ‘Antifragility Categories'—(1) do this virtually every time for every VLBW infant; (2) never do this; (3) apply this therapy in certain circumstances, but thoughtfully with careful upside/downside considerations; and (4) this therapy is of uncertain efficacy and safety so optimal use is unknown—(e) selected two or more compliance checks for each of the nine morbidities; and (f) committed to an every 3-month review for 2 years of VLBW infant outcomes, adherence with the compliance checks and feedback to all NICU staff. A PBP was defined as an Antifragility category 1 or category 3.
Evidence-based review of NICU therapies was facilitated by subdividing into the nine major VLBW infant morbidities (chronic lung disease, any late infection, grade 3 to 4 intraventricular hemorrhage, periventricular leukomalacia, stage 3 to 4 retinopathy of prematurity, necrotizing enterocolitis, focal intestinal perforation, patent ductus arteriosus and discharge weight <10th percentile) using the VON definitions.7 Each of the nine morbidities was assigned to one PSVMC neonatologist who led a comprehensive review of the published literature and categorized all potential therapies into the antifragility categories described in ‘c' and ‘d'. Our anchor—‘Has this therapy been rigorously shown to safely and effectively prevent or treat Morbidity X?' If not, is it unsafe and ineffective, or was there an exceptional, reasoned indication for the practice, or do we simply not know? This Antifragility consensus PBP guideline was also circulated to six national experts in NICU CQI for review and comments.
For 2 months before our ‘go-live' date of 1 October 2013, we thoroughly discussed the Antifragility project with our NICU staff using multiple forums (bedside rounds, conferences, email alerts and posters). Multi-pronged CQI projects often have inexact implementation dates and we were aware that our NICU historically did not have comprehensive compliance data for many of our common therapies. To address this issue we underscored that detailed, formal PBP compliance data would begin 1 October 2013, and that this exact start date would motivate staff to follow the Antifragility PBP guidelines. We emphasized the complex nature of intertwined co-morbidities, the limited number of truly safe, effective therapies, the need for constant process and outcomes review, the largely unmeasured cultural and human factors that affect CQI, the acceptance of personal and group responsibility for the risk and uncertainty of NICU care and transparent decision-making.
For between era comparisons, χ2- or Fisher's exact test were used for categorical variables and t-test or Wilcoxon's rank-sum test were used for continuous variables. The 2014 entire VON outcomes were used as benchmarks to evaluate the results of the Era 2 Antifragility Group, so the exact binomial test was used for categorical variables and t-test for the length of stay. Statistical analysis was performed using R 3.1.0 statistical program (R Foundation for Statistical Computing, Vienna, Austria).
Results
Table 1 shows no significant differences in the demographic descriptors comparing the two eras (except fewer Era 2 multiple births). Our NICU's VON risk adjusters in Table 1, as well as gestational age and birth weight distribution are similar to the entire VON (data available at Nightingale Electronic Reporting System). Table 2 summarizes the ‘Antifragility Potentially Better Practice Schema'. The nine major morbidities and all 104 therapies PSVMC considered as possible treatments were placed into one of four distinct categories. Table 3 lists our 32 consensus choices for detailed compliance checks, at least two for each morbidity, acknowledging that limitations of time, resources and understanding of cause-and-effect necessarily led to practical measurements.
Table 1. Demographic descriptors of the Era 1 Control Group and the Era 2 Antifragility Group.
| Era 1 Control Group Oct 2011–Sept 2013 | Era 2 Antifragility Group Oct 2013–Sept 2015 | P-value | |
|---|---|---|---|
| Number | 221 | 197 | |
| Gestational age, weeks, mean (s.d.) | 29.2 (2.6) | 29.0 (2.7) | 0.44 |
| Birth weight, g mean (s.d.) | 1129 (257) | 1093 (292) | 0.18 |
| Male gender | 109/221 (49%) | 96/197 (49%) | 0.98 |
| Multiple birth | 91/221 (41%) | 57/197 (29%) | 0.01 |
| Major birth defect | 2/221 (1%) | 4/197 (2%) | 0.43 |
| Antenatal steroids | 208/221 (94%) | 190/197 (96%) | 0.38 |
| Vaginal birth | 54/221 (24%) | 45/197 (23%) | 0.79 |
| 1 Min APGAR <4 | 41/221 (19%) | 45/197 (23%) | 0.34 |
| Chorioamnionitis | 61/221 (28%) | 59/197 (30%) | 0.67 |
| Maternal hypertension | 78/221 (35%) | 71/197 (36%) | 0.95 |
Table 2. The Antifragility Potentially Better Practices Schema to improve outcomes in VLBW infants.
| Morbidity | Category 1 practices | Category 2 practices | Category 3 practices | Category 4 practices |
|---|---|---|---|---|
| Virtually always | Virtually never | Apply thoughtfully, sometimes | Unknown efficacy and safety | |
| Chronic lung disease | Antenatal corticosteroids NCPAP before mechanical ventilationa Minimize ventilator usea Surfactant for significantly worsening or severe RDSa Caffeine day 1a Saturation targets 88–95%a Saturation alarms 84% and 96%a Avoid PCO2 <40 or >69 | Early corticosteroids (<7 days old) Routine surfactant for mild RDS Routine high frequency ventilation Routine diuretics | Gentle ventilation (tidal volume 4–5 cc kg−1, permissive hypercarbia)a PDA guidelinesa High flow nasal cannulaa NIPPVa High frequency ventilation Late corticosteroids (⩾7–14 days old)a Late surfactant VAP prevention Vitamin A | Ventilator weaning protocols NCPAP weaning protocols to room air, high flow nasal cannula or low flow nasal cannula Surfactant type, no. of doses or optimal delivery route Fluid restriction Gastro-esophageal reflux management Anti-oxidants Omega 3 fatty acids |
| Any late infection | Hand hygiene every encounter Breast milk Central line care bundlea 48 h hard-stop for antibiotics in rule out sepsis work-upsa Pharmacy sterile prep procedures Minimize postnatal corticosteroids Appropriate pre-incision antibiotics | Prolonged or broad spectrum antibiotic courses without a specific indication Routine antacids Intravenous immune globulin for suspected or proven sepsis | Reduce blood draws and venipunctures Antibiotic stewardship Skin integrity protocols VAP prevention Probioticsa Debriefing nosocomial infection cases Isolation for specific pathogens | Granulocyte colony-stimulating factor Lactoferrin Gown and glove protocols De-colonization procedures for specific pathogens |
| Grade 3–4 intracranial hemorrhage | Antenatal corticosteroids Delayed umbilical cord clampinga | Routine sedation, airway suctioning, fluid boluses, NaHCO3 and/or pro-coagulants | Small baby guidelinesa: head and body positioning, with pain, light, sound stimuli reduction Cardiovascular instability: treatment of significant hypotension and poor perfusion with pressors and volume expanders | Cesarean section vs. vaginal delivery Prophylactic PSI Synchronized ventilation Optimal sedation Optimal airway suctioning practice High frequency ventilation Optimal management of CV instability |
| Periventricular leukomalacia | Avoid hypocarbia PCO2 <35 with assisted ventilation | Cardiovascular instability: treatment of significant hypotension, poor perfusion Minimize hypoxic episodes | Anti-inflammatory agents Early delivery for prolonged ruptured membranes | |
| Stage 3–4 retinopathy of prematurity | Saturation targetsa If <30 weeks at birth 88-95% until 32 weeks CGA then 94-98% at >/= 32 weeks corrected gestational age Breast milk | 100% FiO2 resuscitation Saturations >98% while receiving supplemental oxygen | Vitamin E Breast milk Insulin-like growth factor-1 Hyperglycemia and insulin use reduction Bevacizumab Omega 3 fatty acids | Optimal saturation target and alarms Light shield Erythropoietin Penicillamine Inositol, statins |
| Necrotizing enterocolitis | Antenatal corticosteroids Breast milk Donor breast milk instead of cow's milk formula Probioticsa A feeding guidelinea Human milk-based fortifier (Prolacta)a | Milk thickeners Prolonged or broad spectrum antibiotic courses without a specific indication Routine antacids Routine cow's milk formula | Optimal feeding guideline RBC transfusions and feeding Withholding all cow's milk products Gastric residual checks Optimal PSI use Lactoferrin, growth factors, EPO, O3 FA Umbilical line placement and duration Hyperosmolar feeds | |
| Focal intestinal perforation | Early and/or concurrent use of indomethacin and corticosteroids | Trophic breast milk feeds | Optimal PSI use Enteral sterile water Umbilical line placement and duration | |
| Patent ductus arteriosus | Antenatal corticosteroids | Indomethacin or any PSI for an asymptomatic or early PDA Not treating a large, symptomatic PDAa | PDA Guidelinesa Indomethacin or acetaminophen or ibuprofen or a combination of drugs Oral vs. Intravenous PSI | Timing and selection of PDA ligation Optimal respiratory support Fluid restriction Diuretics Drugs that may increase a PDA (e.g., lasix, gentamicin) |
| Discharge weight<10th percentile | Day 1 TPN/IL with early calorie, protein, and fat goals met within 1 weeka Early breast milk feedsa Fortifiers to BRM to enhance calorie, protein and fat requirementsa | Improper feeding pump and tubing usea | Protein intake >3.5 g kg−1 per day TPN calculator Insulin for hyperglycemiaa | Nutrition laboratory monitoringa Optimal growth rate and growth chart Optimal fortifier Optimal protein and calorie intake Prokinetics Q2h v. Q3h v. continuous feeds Nippling skills teaching and aids |
Abbreviations: BRM, breast milk; CV, cardiovascular; EPO, erythropoietin; HFNC, high flow nasal cannula; NICU, neonatal intensive care unit; NCPAP, nasal continuous positive airway pressure; NIPPV, non-invasive positive pressure ventilation; O3 FA, omega 3 fatty acids; PDA, patent ductus arteriosus; PSI, prostaglandin synthase inhibitor; RBC, red blood cell; RDS, respiratory distress syndrome; TPN/IL, total parenteral nutrition and intralipid; VAP, ventilator-associated pneumonia; VLBW, very low birth weight.
Category 1 practice: Always, this should be done virtually every time for every VLBW infant in the appropriate scenario. Strong published evidence exists to support its effectiveness and safety.
Category 2 practice: Never, this should virtually never be done, strong evidence suggests it is ineffective, unsafe and/or wasteful.
Category 3 practice: Sometimes, this may be effective in certain VLBW infants in particular clinical situations. More studies and evidence are needed before we adopt, refine or reject this as a therapy. As there is questionable and variable overall effectiveness and safety, these practices should be thoughtfully applied with careful measurement and review of its application.
Category 4 practice: Unknown, there is insufficient evidence to determine whether this is helpful or ineffective, safe or harmful. Optimal use is unknown; we should generally minimize use and, when employed, measure and review its application.
Detailed guidelines and explanation accessible at the Providence St. Vincent Medical Center NICU intranet website.
Table 3. PBP process measures and compliance checks during the Era 2 Antifragility Group.
| Morbidity | PBP process check | Compliance | Comments |
|---|---|---|---|
| Chronic lung disease | Antenatal corticosteroids | 96% | |
| Bubble nasal NCPAP before intubation and mechanical ventilation | 54% | Full NCPAP set-up before ventilator was employed | |
| Any mechanical ventilation | 36% | During entire NICU stay | |
| Caffeine within 24 h of birth | 95% | If needing any respiratory support | |
| Oxygen saturation pulse oximetry reading within the target range | 63% Within target 21% Above upper 17% Below lower | 88–95% was the target 94–98% after 32 weeks CGA if born at <30 weeks 1584 audits | |
| Oxygen saturation pulse oximeter alarms set correctly | 1584 random audits | ||
| High alarm setting | 30% Correct 67% Too high 3% Too low | 88-95% target Alarm set 1% above the upper target | |
| Low alarm setting | 24% Correct 47% Too high 28% Too low | Alarm set 4% below the lower target | |
| PCO2 <40 mm Hg PCO2 <30 mm Hg PCO2 >69 mm Hg | 16% 3% 12% | Blood gas values first 48 h of life if mechanically ventilated | |
| Any late infection | Hand washing audits | 97% | ‘Secret spy' 1202 random audits |
| Hard stop antibiotics at 48 h of age for ‘Rule Out Sepsis' work-up initiated at birth | 72% | Blood culture negative infants | |
| Hard stop antibiotics at 48 hours for – ‘Rule Out Sepsis' work-up initiated after Day 3 of life | 34% | Blood culture negative infants | |
| Avoid postnatal corticosteroid use | 95% | 5% of infants were exposed | |
| Breast milk only until 33 weeks corrected gestational age | 100% | ||
| No intravenous immunoglobulin for suspected or proven sepsis | 99% | ||
| Grade 3–4 intraventricular hemorrhage | Antenatal corticosteroids | 96% | |
| Head of bed elevated first 72 h of life | 100% | ||
| Head midline first 72 h of life | 86% | ||
| No sodium bicarbonate first week of life | 99% | ||
| Periventricular leukomalacia | PCO2 <40 mm Hg PCO2 <30 mm Hg | 16% 3% | Blood gas values first 48 h of life if mechanically ventilated |
| Stage 3–4 retinopathy of prematurity | See oxygen saturation pulse oximetry alarms and targets with Chronic lung disease | See Chronic lung disease | |
| Breast milk only until 33 weeks corrected gestational age | 100% | ||
| Necrotizing enterocolitis | Antenatal corticosteroids | 96% | |
| Breast milk only until 33 weeks corrected gestational age | 100% | ||
| Human milk fortifier (Prolacta) not cow's milk based | 82% | ||
| Feeding guideline adherence first 3 weeks of life | 85% | ||
| No milk thickeners | 100% | ||
| Focal intestinal perforation | No concurrent use of indomethacin or ibuprofen and corticosteroids | 100% | |
| Patent ductus arteriosus | Antenatal corticosteroids | 96% | |
| No PDA pharmacologic therapy during the first week of life | 65% | 35% Received prostaglandin synthase inhibitors first week | |
| Avoid surgical ligation | 95% | 5% ligation rate | |
| Discharge weight less than 10th percentile | Total parenteral nutrition started Day 1 | 96% | |
| Intralipid started Day 1 | 82% | ||
| Intravenous kcal goal met | Day 4 | Median | |
| Intravenous protein goal met | Day 3 | Median | |
| Enteral kcal goal met | Day 13 | Median | |
| Enteral protein goal met | Day 16 | Median | |
| Feeding guideline adherence first 3 weeks of life | 85% | ||
| Own mother's breast milk at discharge | 77% | ||
| Computerized TPN calculator used daily | 100% |
Abbreviations: CGA, corrected gestational age; NCPAP, nasal continuous positive airway pressure; PBP, potentially better practice; PDA, patent ductus arteriosus; TPN, total parenteral nutrition.
Overall compliance with the process checks (averaged within each of the 32 categories, then each category weighted equally) was 70%, from a high of 100% (exclusive breast milk use, no milk thickeners, head of bed elevated, no concurrent use of prostaglandin synthase inhibitors and corticosteroids, and daily use of total parenteral nutrition calculator), to a low of 24% (correct pulse oximeter alarm settings). Table 4 lists the PSVMC mortality and morbidity rates in our two study eras and, for comparison, the 2014 entire VON. Eight of the nine major morbidity rates trended lower in our Era 2 Antifragility Group compared with the VON, three of them significantly. Mortality also trended lower at PSVMC and our total length of stay in survivors was significantly shorter than the VON. There were no significant changes in any outcome comparing the PSVMC Era 1 Control Group with the Era 2 Antifragility Group.
Table 4. Morbidity and mortality comparisons.
| Control Oct 2011–Sept 2013 | Antifragility Oct 2013–Sept 2015 | P-valuea | Vermont Oxford Network mean (interquartile) 2014 | P-valueb | |
|---|---|---|---|---|---|
| Chronic lung disease | 46/221 (21%) | 50/197 (25%) | 0.32 | 24% (11, 30) | 0.68 |
| Any late infection | 8/215 (4%) | 8/195 (4%) | >0.999 | 12% (4, 15) | <0.001 |
| Grade 3–4 intraventricular hemorrhage | 5/211 (2%) | 9/190 (5%) | 0.31 | 7% (2, 9) | 0.26 |
| Periventricular leukomalacia | 5/211 (2%) | 2/190 (1%) | 0.45 | 3% (0, 4) | 0.14 |
| Stage 3–4 retinopathy of prematurity | 8/191 (4%) | 8/155 (5%) | 0.86 | 6% (0, 8) | 0.87 |
| Necrotizing enterocolitis (NEC) | 9/221 (4%) | 3/197 (1.5%) | 0.15 | 5% (0, 6) | 0.02 |
| Focal intestinal perforation | 3/221 (1%) | 2/197 (1%) | >0.999 | 2% (0, 2) | 0.45 |
| Patent ductus arteriosus | 43/221 (20%) | 49/197 (25%) | 0.22 | 28% (14, 37) | 0.78 |
| Avoid pharmacologic therapy during week 1 | 32/49 (65%) | ||||
| Ligation | 8/221 (4%) | 10/197 (5%) | 0.62 | 4% (0, 5) | 0.95 |
| Discharge weight <10th percentile | 74/196 (38%) | 79/179 (44%) | 0.25 | 53% (42, 66) | 0.02 |
| Mortality excluding early death | 18/216 (8%) | 12/195 (6%) | 0.51 | 9% (5, 13) | 0.21 |
| Length of stay, mean (s.d.) (total hospital stay in days in survivors) | 59 (26) | 56 (26) | 0.31 | 68 (58, 73) | <0.001 |
Vermont Oxford Network data accessed at the Nightingale Electronic Reporting System.
Comparing Providence St. Vincent Medical Center Era 1 Control Group and Era 2 Antifragility Group.
Comparing Providence St. Vincent Medical Center Era 2 Antifragility Group with the Vermont Oxford Network averages for 401–1500 g inborn infants in 2014.
Discussion
Proven EBM methodology that reduces all major VLBW infant morbidities to sustained low rates has proven elusive for the vast majority of NICUs.1, 2, 3, 4 We have provided a transparent, concise yet broad, EBM guideline that contains most potential therapies thought to reduce the burden of the nine major VLBW infant morbidities. A succinct four category PBP classification schema (Table 2 and updated in Supplementary Table S1) and detailed compliance checks (Table 3 and updated in Supplementary Table S2) has, to our knowledge, never been published. Even when CQI projects are disappointing, publishing well-documented experience disseminates valuable experience, an essential goal encouraged by EBM experts.8, 9, 10, 11
We believe the principles of Antifragility—an interpretation of human cognition and behavior broadly evident in modern history—adds insight to how neonatologists and NICU staff make decisions, for better or worse.5 Antifragility emphasizes hormesis (adapting and improving from stressors) and appreciating the difference between uncertainty and risk. Uncertainty means you do not know what will happen, risk is the product of harm and the chance it will happen. Unlike families, NICU providers may conflate uncertainty and risk, too easily transferring risk (our vulnerability and responsibility) to the group and inevitably to the infant.12 Table 3 (compliance data that is scarce in many CQI reports) suggests the poorest adherence with PBPs largely resided among those activities in which risk could be transferred from the individual provider to the group and/or the baby.
Table 3 lists examples of possible risk transfer that undermine NICU CQI as follows: (a) it may be easier for a neonatologist to intubate a premature infant rather than try nasal continuous positive airway pressure with all the attendant patience, skill and serial exams required, (b) nurses widen saturation targets to lessen annoying and disruptive pulse oximeter alarms, or to ‘keep the baby pink', (c) to stabilize newborns' immediate respiratory needs neonatologists may mechanically over-ventilate, (d) antibiotics are started and maintained beyond 48 h despite negative cultures, and (e) the patent ductus arteriosus is treated early without objective evidence of shunt harm.
We did not demonstrate significant reduction in the major VLBW infant morbidities; thus, why should our proposed CQI model be reasonable to consider? First, we acknowledge the limitations of our CQI efforts as follows: (a) most NICU therapies are not supported by the strong Level 1 evidence of randomized, controlled trials (Table 2) so we would not necessarily expect sustained morbidity reduction to low rates, (b) there was variable compliance with our PBPs, just 70% overall, range 24 to 100% (Table 3), (c) time and resource constraints, and (d) uneven understanding of EBM and CQI principles.11 In addition, our NICU morbidity rates in the Era 1 Control Group were generally favorable (Table 4), for example, any late infection (4%) and grade 3 to 4 intraventricular hemorrhage (2%); thus, further improvement is not easily guided by customary means.
It may be unrealistic to think we can reduce certain morbidities similar to stage 3 to 4 retinopathy of prematurity, any late infection or periventricular leukomalacia from recent low rates to near zero. So much pathophysiology is unclear with these morbidities that it is unlikely traditional CQI methodology alone will be successful. Nevertheless, there are multiple sensible strategies to reduce some major morbidities, PBPs of little risk to the NICU provider, for example, hand washing, breast milk, fewer ventilator days and limiting unnecessary medications.1, 2, 3, 4
Although we categorized 104 distinct NICU VLBW infant therapies into the four Antifragility PBP categories, creating a user-friendly EBM guideline (Table 2), there are possibly other effective therapies not listed and any PBP prioritization needs to be updated as more evidence accumulates (see Supplementary Table 1). We selected 32 distinct compliance checks by consensus and practicality; not only was compliance considerably <100% with some PBPs (Table 3), but others were not formally monitored, for example, effects of placental transfusion.13 Many PBPs are proposed for VLBW infants, but the variable application and effects are often not rigorously quantified, making it exceedingly difficult for NICUs to confidently know why they are improving (or not). An observational trial similar to ours is limited by possible unmeasured practice changes and unforeseen differences in the VLBW infants between the two eras.14, 15
Our CQI experience also suggests a ‘tragedy of the commons' embedded within group dynamics—individual providers acting independently can repeatedly make decisions that reduce their own risk or inconvenience at the expense of group goals and the infant's best interests. Many modern day problems not only resist purely technical approaches, but are exacerbated by short-term quasi-solutions to complexities that inevitably create even more perplexing residual difficulties, which are exceedingly recalcitrant and costly to solve.16, 17, 18, 19, 20 Recognizing this, authorities such as Davidoff21 believe CQI is fundamentally a moral activity; improvement science should be on par with beneficence, non-maleficence, autonomy and justice. This is congruent with Antifragility principles: how do we foster a moral CQI symbiosis of (a) knowing what to do, (b) how to do it reliably, (c) family preference and (d) societal priorities.22, 23, 24, 25
We continue our study in a third 2-year era (2016–17) with both an updated PBP guideline and an expanded compliance checklist (Supplementary Tables S1 and S2). Perceptively evaluating the favorable versus unfavorable asymmetry inherent in virtually every NICU decision embodies Antifragility; every medical intervention is an amalgam of uncertainty, risk, preference and cost—variables exceedingly challenging to measure.
Acknowledgments
This investigation was supported by the Providence Health and Services Foundation (Portland, OR) and Northwest Newborn Specialists, PC (Portland, OR). The sponsors had no role in the design or conduct of the study. We thank the entire PSVMC Antifragility Team including Jody Bellant, Sara Clark, Kati Knudsen, Jennifer Niemeyer, Yvette Rice-Rosenthal, Kandace Ryan and Melissa Stawarz for their many contributions to this team effort.
Author contributions
The principal investigator JWK, MD, had full access to the data in the study and takes responsibility for the integrity and accuracy of the data analysis. The source of the data was our PSVMC comprehensive NICU database (NICPOP) and collection tools, as well as the Vermont Oxford Database accessible at the Nightingale Electronic Internet Reporting System. JWK was responsible for the original conception and design of the study and drafted the first and final versions of the manuscript. Co-authors NMS, SR, CN, MF, LW and NT assisted in implementation of the project, critical review of the manuscript at each step, all data analysis and participated in the manuscript formulation and final revision.
Footnotes
Supplementary Information accompanies the paper on the Journal of Perinatology website (http://www.nature.com/jp)
The authors declare no conflict of interest.
Supplementary Material
References
- Horbar JD, Carpenter JH, Badger GJ, Kenny MJ, Soll RF, Morrow KA et al. Mortality and neonatal morbidity among infants 501 to 1500 grams from 2000 to 2009. Pediatrics 2012; 129: 1019–1026. [DOI] [PubMed] [Google Scholar]
- Ellsbury DL, Clark RH, Ursprung R, Handler DL, Dodd ED, Spitzer AR. A multifaceted approach to improving outcomes in the NICU: the Pediatrix 100,000 babies campaign. Pediatrics 2016; 137(4): e20150389. [DOI] [PubMed] [Google Scholar]
- Kaempf JW, Zupancic JAF, Wang L, Grunkemeier GL. A risk-adjusted, composite outcomes score and resource utilization metrics for very low-birth-weight infants. JAMA Pediatrics 2015; 169(5): 459–465. [DOI] [PubMed] [Google Scholar]
- Dukhovny D, Pursley DM, Kirpalani HM, Horbar JH, Zupancic JAF. Evidence, quality, and waste: solving the value equation in neonatology. Pediatrics 2016; 137(3): e20150312. [DOI] [PubMed] [Google Scholar]
- Taleb N. Antifragile: Things That Gain from Disorder. Random House: New York, 2012. [Google Scholar]
- Horbar JD, Soll RF, Edwards WH. The Vermont Oxford Network: a community of practice. Clin Perinatol 2010; 37(1): 29–47. [DOI] [PubMed] [Google Scholar]
- Vermont Oxford Network Database Manual of Operations. Release 19.0. Vermont Oxford Network: Burlington, 2014. [Google Scholar]
- Berwick DM. The science of improvement. JAMA 2008; 299(10): 1182–1184. [DOI] [PubMed] [Google Scholar]
- Van Cleave J, Dougherty D, Perrin JM. Strategies for addressing barriers to publishing pediatric quality improvement research. Pediatrics 2011; 128(3): e678–e686. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chassin MR, Loeb JM, Schmaltz SP, Wachter RM. Accountability measures – using measurement to promote quality improvement. N Engl J Med 2010; 363(7): 683–688. [DOI] [PubMed] [Google Scholar]
- Casarett D. The science of choosing wisely – overcoming the therapeutic illusion. N Engl J Med 2016; 374(13): 1203–1205. [DOI] [PubMed] [Google Scholar]
- Ralston SL, Schroeder AR. Doing more vs doing good: aligning our ethical principles from the personal to the societal. JAMA Pediatrics 2015; 169(12): 1085–1086. [DOI] [PubMed] [Google Scholar]
- Kaempf JW, Tomlinson MW, Kaempf AJ, YingXing Wu, Wang L, Tipping N et al. Delayed umbilical cord clamping in premature infants. Ob Gyn 2012; 120(2): 325–330. [DOI] [PubMed] [Google Scholar]
- Profit J, Gould JB, Bennett M, Goldstein BA, Draper D, Phibbs CS et al. The association of level of care with NICU quality. Pediatrics 2016; 137(3): e20144210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Blumenthal D. Better health care: a way forward. JAMA 2016; 315(3): 1333–1334. [DOI] [PubMed] [Google Scholar]
- Hardin G. The tragedy of the commons. Science 1968; 162(3859): 1243–1248. [DOI] [PubMed] [Google Scholar]
- Schwartz E. Overskill: The Decline of Technology in Modern Civilization. Quadrangle Books: Chicago, 1971. [Google Scholar]
- Callahan D. False Hopes: Overcoming the Obstacles to a Sustainable, Affordable Medicine. Rutgers University Press: New Brunswick, New Jersey, 1999. [Google Scholar]
- Silverman WA. Human Experimentation: A Guided Step into the Unknown. Oxford University Press: Oxford, England, 1985. [Google Scholar]
- Gray J. Straw Dogs. Granta Publications: London, England, 2002. [Google Scholar]
- Davidoff F. Systems of service: reflections on the moral foundations of improvement. BMJ Qual Saf 2011; 20: i5–i10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kaempf JW, Tomlinson MW, Tuohey J. Extremely premature birth and the choice of neonatal intensive care versus palliative comfort care: an 18-year single-center experience. J Perinatol 2016; 36: 190–195. [DOI] [PubMed] [Google Scholar]
- Kelly MP, Heath I, Howick J, Greenhalgh T. The importance of values in evidence-based medicine. BMC Med Ethics 2015; 16(69): 1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wilkinson D, Chalmers I, Cruz M, Tarnow-Mordi W. Dealing with the unknown: reducing the proportion of unvalidated treatments offered to children. Arch Dis Child Fetal Neonatal Ed 2015; 100(3): F190–F192. [DOI] [PubMed] [Google Scholar]
- Lefkowitz W, Jefferson TC. Medicine at the limits of evidence: the fundamental limitation of the randomized clinical trial and the end of equipoise. J Perinatol 2014; 34: 249–251. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
