Abstract
Purpose
Although overall paediatric septic shock mortality is decreasing, refractory septic shock (RSS) is still associated with high mortality. A definition for RSS is urgently needed to facilitate earlier identification and treatment. We aim to establish a European society of paediatric and neonatal intensive care (ESPNIC) experts’ definition of paediatric RSS.
Methods
We conducted a two-round Delphi study followed by an observational multicentre retrospective study. One hundred and fourteen paediatric intensivists answered a clinical case-based, two-round Delphi survey, identifying clinical items consistent with RSS. Multivariate analysis of these items in a development single-centre cohort (70 patients, 30 % mortality) facilitated development of RSS definitions based on either a bedside or computed severity score. Both scores were subsequently tested in a validation cohort (six centres, 424 patients, 11.6 % mortality).
Results
From the Delphi process, the draft definition included evidence of myocardial dysfunction and high blood lactate levels despite high vasopressor treatment. When assessed in the development population, each item was independently associated with the need for extracorporeal life support (ECLS) or death. Resultant bedside and computed septic shock scores had high discriminative power against the need for ECLS or death, with areas under the receiver operating characteristics curve of 0.920 (95 % CI 0.89–0.94), and 0.956 (95 % CI 0.93–0.97), respectively. RSS defined by a bedside score equal to or higher than 2 and a computed score equal to or higher than 3.5 was associated with a significant increase in mortality.
Conclusions
This ESPNIC definition of RSS accurately identifies children with the most severe form of septic shock.
Electronic supplementary material
The online version of this article (doi:10.1007/s00134-016-4574-2) contains supplementary material, which is available to authorized users.
Keywords: Shock, Septic, Paediatrics, Acidosis, Lactic, Resuscitation, Failure, Cardiac
Introduction
Infection remains the leading cause of paediatric mortality worldwide [1]. In most high-income countries, access to care, vaccination campaigns and improvement in intensive care have drastically decreased deaths from infection. Similar to adults, recent paediatric studies have shown an increase in the incidence of invasive infection and septic shock and a relative decrease in mortality [2–4].
Recently, sepsis and septic shock definitions in adults were revised [4–7]. The aim of the Sepsis-3 definition was to help the clinician in the detection of septic shock patients and to treat them according to their risk of death. The sepsis-related organ failure assessment (SOFA) [8] has a prominent place in this definition, but is neither adapted nor validated in paediatric patients. The clinical course of septic shock is affected by the age and immune state of the patient, the virulence of the pathogen, and the haemodynamic adaptation to circulatory failure. Paediatric logistic organ dysfunction (PELOD) is a paediatric organ dysfunction score validated in the severity classification of patients with sepsis [9]. However, similar to the SOFA score, it does not impact patient management at the bedside.
The Surviving Sepsis Campaign [10] and the American College of Critical Care Medicine (ACCM) guidelines for hemodynamic support in neonates and children [11] remain the most recognized standards of care. Specific therapies such as activated protein C [12, 13] or early goal-directed therapy [14, 15] have not been associated with a consistent decrease in mortality. The term septic shock encompasses various aetiologies and immune states for which specific interventions may have variable results [16]. However, the subset of patients who are unresponsive to standard resuscitation are often labelled as having ‘refractory septic shock’ (RSS). RSS is typified by circulatory failure due to septic cardiomyopathy [17–19] with or without vasoplegia [19]. Importantly, effective short-term support of the circulation with newer vasoactive agents or extracorporeal life support (ECLS) [20] means that RSS is potentially reversible [21, 22]. To maximise the impact of these rescue therapies, a robust tool for early identification of RSS is required,
The Infection, Systemic Inflammation and Sepsis section of the European Society of Paediatric and Neonatal Intensive Care (ESPNIC) designated a taskforce to define paediatric RSS [23]. We performed a study linking a two-round Delphi survey with the development of septic shock scores. These scores aimed at an early indentification of RSS patients with a high risk of mortality at any moment during clinical care. The scores were subsequently validated in a multicentre international retrospective cohort.
Materials and methods
Definition drafting
The first part of the Delphi study was a clinical case-based questionnaire. Two members (L.M. and P.T.) of the Infection, Systemic Inflammation and Sepsis section of ESPNIC were assigned to create four clinical cases of septic shock patients with varying levels of shock and organ dysfunction.
The characteristics of the clinical cases were set following a review of the literature on septic shock and a case analysis of septic shock patients, and covered the whole clinical spectrum of disease severity. Five members from the taskforce (G.M., S.N., M.P., M.K., N.J.G.J.) reviewed the cases for consistency and objectivity. All clinical cases were composed of vignettes with specific clinical and biological parameters (later described as criteria and corresponding cut-offs), encompassing the evolution of sepsis. For each vignette, responders were asked to grade the occurrence of RSS (0 = no RSS to 10 = yes) (see supplementary file 1). The questionnaire was then sent to all ESPNIC members via an Internet survey supplier (SurveyMonkey Inc., Palo Alto, CA, USA).
Criteria extracted from the clinical vignettes were ranged according to the distribution of their strength of association with RSS. Criteria graded A (first quartile) and B (second quartile) were selected and compiled in four draft definitions constituted by a minimal definition alone or with up to three additional organ failures. Preliminary definitions were then tested in the second part of the Delphi study. Participants of this second part had access to the results of the first study. They were asked to choose one of the four definitions and to re-score the definition cut-off values issued from the first part’s results. Based on this second round, criteria graded A or B were incorporated into the selected RSS draft definition. (See supplementary file 2 for additional information on methodology).
Development population application and definition adjustment
The RSS draft definition was first tested in a development population. All patients less than 18 years old admitted to the Paediatric Intensive Care Unit (PICU) at Centre A for septic shock, according to consensus definition [24], and requiring vasopressor or inotrope therapy between January 1, 2010 and December 31, 2013 were analysed. Exclusion criteria were: (1) the presence of limitations of life support at septic shock onset; (2) postmenstrual corrected age <37 weeks; and (3) perinatal sepsis defined as sepsis occurring in the first 7 days of life.
Protocols for clinical care of septic shock patients did not change during the 3-year study period. Patients were retrospectively identified using hospital records and data collected. The French Intensive Care Society ethics committee approved this study (CE SRLF 14-38). Clinical variables included in the definition or used to describe the populations or outcomes, and occurring before the occurrence of the composite endpoint PICU mortality and/or ECLS, were recorded (see supplementary file 2). Draft definition criteria identified in the Delphi study were evaluated against two outcomes: PICU mortality, and the composite endpoint PICU mortality and/or ECLS. Multivariable Cox regression was performed to study the association between the variables used in the definition and these two outcomes, to define two RSS scores. An easy to calculate score was named “bedside RSS score” and a more complex one was named “computed RSS score”.
RSS definition assessment in a validation population
Both bedside and computed RSS scores were tested to evaluate their association with mortality and the composite endpoint mortality/need for ECLS. This was done on a validation population consisting of a cohort of PICU-admitted patients, retrospectively enrolled in 6 PICUs in four countries (Australia, France, Netherlands and United Kingdom; Table 1). Inclusion and exclusion criteria were identical in the development and validation population. Data were collected retrospectively (C.W., E.J., L.J.S., L.M., M.K., M.P., N.J.G.J., S.N., S.R., S.R.). L.M. independently reviewed the consistency of the collected data. All six centres obtained local ethical approval for the retrospective analysis of the patient data and waiver of informed consent from legal representatives.
Table 1.
Hospitals and patients
| Hospitals | Type of PICU | PICU admissions and mortality | Number of septic shock cases and mortality | Weight in the cohort (cases/deaths) |
|---|---|---|---|---|
| Development population | ||||
| Centre A | M, S, ECLS | 3109 (4.2 %) | 70 (30 %) | 100 %/100 % |
| Validation population | ||||
| Centre B | M, S, ECLS | 4608 (3.4 %) | 40 (7.5 %) | 9.4 %/6.1 % |
| Centre C | M, S | 3875 (7.1 %) | 165 (13.9 %) | 38.9 %/46.9 % |
| Centre D | M | 1288 (5.6 %) | 101 (6.9 %) | 23.8 %/14.3 % |
| Centre E | M, S, C | 3145 (2.7 %) | 18 (33.3 %) | 4.2 %/12.2 % |
| Centre F | M, S, C, ECLS | 3117 (4.7 %) | 57 (3.5 %) | 13.4 %/4.1 % |
| Centre G | M, S | 3150 (1.9 %) | 44 (18.2 %) | 10.4 %/16.3 % |
PICU paediatric intensive care unit, M Medical, S Surgical, ECLS Extra-Corporeal Life Support, C Cardiac
Statistical analysis
Continuous variables were tested for normality with Kolmogorov–Smirnov test and compared with Student’s t test or Mann–Whitney test, as appropriate. Non-continuous variables were tested with Chi-squared test or Fisher’s exact test, as appropriate. Data were described as frequencies and percentages, means and standard deviations or median and interquartile range, as appropriate. Multivariable Cox’s regression with backward-stepwise method was performed having as outcomes mortality or the composite endpoint mortality/need for ECLS. Covariates inserted in the models were the variables identified through the Delphi process and the patients’ age [3]. Adjusted hazard ratios were used to weight covariates and included in the scores. The model goodness of fit was evaluated with Omnibus test. Receiver operating characteristics (ROC) analysis was then performed with the validation population for both scores and areas under the curves (AUC) were calculated to assess for the discriminative power of these scores. The best thresholds for these scores were obtained with the calculation of sensitivity, specificity, positive and negative predictive values and the Youden’s index (sensitivity + specificity – 1). The DeLong test was used to compare the AUC of both scores [25]. Survival of RSS patients according to both scores have been evaluated by Kaplan–Meier curves and these latter have been tested using Logrank test. A p value of less than 0.05 was considered statistically significant. Statistical analyses were performed with SPSS for Macintosh, v.22.0 (SPSS, Chicago, IL, USA) and GraphPad Prism®, v. 5.0a (GraphPad Software, La Jolla, CA, USA) softwares.
Results
Draft of the definition
From April 9 to July 2 2014, 114/170 (67 %) physicians members of the ESPNIC representing 27 countries and 75 PICUs answered the first round of the Delphi study. The physicians PICU experience was less than 10 years for 35.6 %, 10–20 years for 44.1 % and more than 20 years for 20.3 %. Results from this first round are presented in Table 2. Items graded A (first quartile of association with diagnosis of RSS) or B (second quartile) were selected for the second round. They were condensed into a minimal definition (lactic acidosis with vaso-inotrope dependency and myocardial dysfunction) with additional organ failures graded A or B [hepatic insufficiency, severe acute respiratory distress syndrome (ARDS) with the Berlin definition [26] or failure to achieve effective continuous renal replacement therapy (CRRT)]. The vaso-inotrope dependency was assessed with the use of the vaso-inotrope score [VIS = (epinephrine + norepinephrine in mcg/kg min) × 100 + (dobutamine + dopamine in mcg/kg min) + (vasopressin in mcg/kg min) × 10,000 + (milrinone in mcg/kg min) × 20] [27]. In the second round of the Delphi study, from September 23 to November 21 2014, 61 physicians answered the survey and 37 (60.6 %) selected the minimal definition without additional organ failure. They validated six items determined in the first round as important with a grade A or B for the diagnosis of RSS. The draft definition for RSS was the association of: (1) blood lactate >8 mmol/L or a 1 mmol/L lactate increase after 6 h of resuscitation, (2) vaso-inotrope dependency (VIS >200 mcg/kg min), and (3) myocardial dysfunction, defined as the occurrence of a resuscitation-responsive cardiac arrest in PICU or cardiac ultrasound findings with left ventricle ejection fraction (LVEF) <25 % or a cardiac index <2.2 L/min m2.
Table 2.
Results of the first round of the Delphi study: association of clinical criteria with refractory septic shock diagnosis
| Criteria and cut-offs | Scoresb | Number of iteration | Gradec |
|---|---|---|---|
| Blood lactates | |||
| >4 mmol/L | 8 (7–9.5) | 11 | C |
| >6 mmol/L | 9 (8–10) | 9 | B |
| >8 mmol/L | 9.5 (9–10) | 6 | A |
| >10 mmol/L | 9.5 (9–10) | 4 | A |
| Stablea | 9 (8.5–9.5) | 2 | B |
| Increasea | 8 (6.5–8.8) | 3 | B |
| ScvO2 < 70 % | 8 (6.5–8.8) | 6 | C |
| Vaso-inotrope score (mcg/kg min) | |||
| >50 | 8 (6–8) | 11 | C |
| >100 | 8 (7.5–8.5) | 8 | C |
| >125 | 8 (8–9) | 7 | C |
| >150 | 8 (8–9.5) | 6 | C |
| >175 | 9 (8–10) | 4 | B |
| >200 | 9 (8.5–9.5) | 2 | B |
| Vaso-inotrope association bitherapy | 8 (8–8.5) | 6 | C |
| Vaso-inotrope association tritherapy | 9 (8.5–9.5) | 2 | B |
| ARDS | |||
| Mild (P/F 200–299) | 8 (6.8–8.5) | 8 | C |
| Moderate (P/F 100–199) | 8 (7.3–9.5) | 6 | C |
| Severe (P/F < 100) | 8.5 (7.8–9.3) | 2 | B |
| Arterial hypotension | 8 (8–9.8) | 10 | C |
| Cardiac index (L/min m2) | |||
| <6 | 8 (6–9) | 13 | C |
| <4.5 | 8 (6–9.3) | 12 | C |
| <3.3 | 8 (8–9.8) | 10 | C |
| <2.2 | 10 (9–10) | 3 | A |
| Cardio circulatory arrest | 10 (10–10) | 1 | A |
| Left ventricle ejection fraction (%) | |||
| <45 | 8 (5.3–8.3) | 12 | C |
| <35 | 8 (8–9.2) | 8 | C |
| <25 | 9.5 (9.3–9.8) | 2 | A |
| Cardiac arrest | |||
| Prior PICU admission | 9 (9–9) | 1 | B |
| In PICU | 10 (10–10) | 1 | A |
| Hepatic insufficiency (prothrombin time/factor V <50 % or INRe >2) | 10 (10–10) | 1 | A |
| Need for CRRT | 6 (6–8) | 5 | D |
| CRRT dysfunction | 10 (10) | 1 | A |
| Procalcitonin at admission (ng/mL) | |||
| >50 | 8 (4.5–9) | 3 | D |
| >200 | 6 (4.5–8) | 3 | D |
| Time since PICU admission (h) | |||
| >6 | 8 (4.5–9) | 7 | C |
| >24 | 6 (4.5–8) | 3 | D |
Scores are expressed as medians and interquartile
ScvO2 central venous saturation of oxygen, ARDS acute respiratory distress syndrome graded with the Berlin definition, PICU paediatric intensive care unit, INR international normalized ratio, CRRT continuous renal replacement therapy
aBlood lactates: stable defined as less than 1 mmol/L change between two consecutive samples, increase defined as more than 1 mmol/L increase between two samples
bScores represents the association of each criteria with the clinical diagnosis of RSS (0 = no RSS to 10 = RSS)
cEach criteria was graded from A (first quartile—most associated with diagnosis of refractory septic shock) to D (fourth quartile—least associated with diagnosis of refractory septic shock)
Development population application and definition adjustment
During a 4-year period between January 1, 2010 and December 31, 2013, 78 patients were admitted at the Centre A PICU for septic shock requiring inotropes or vasopressors. Eight were excluded because of limitations of life support on admission. Of the remaining 70 patients, 21 (30 %) died during PICU stay, of whom 11 (15.7 %) were classified in RSS by the draft definition with a mortality rate of 100 % (sensitivity = 52.4 %, specificity = 100 %) and a median delay from shock onset to death of 19 (12–72) h. No comorbidity was found in 47.1 % of the patients while 22 patients (31.4 %) were immunocompromised.
In the multivariable analysis, the model goodness of fit was satisfying for each step (p = 0.577 and p = 0.717 at the first and second steps, respectively). Data from the last step were selected and used to create septic shock scores. Mortality or the need for ECLS was independently associated with the worst VIS [HR = 1.001 (95 % CI: 1.0009–1.0011) p = 0.01], worst arterial lactate [HR = 1.1 (95 % CI: 1.01–1.23), p = 0.032] and presence of myocardial dysfunction [HR = 18, (95 % CI: 3.4–95.4), p = 0.001]. Lactates and VIS (ρ = 0.34; p = 0.008) as well as LVEF and lactates (ρ = –0.67; p < 0.001) were correlated. Age was not significantly associated with the outcome [HR = 0.99, (95 % CI: 0.98–1.01), p = 0.50]. Following this, two septic shock scores (SSS) were constituted:
Computed SSS calculated as follows, (cSSS) = 1.001VIS in mcg/kg min + 1.1arterial lactate in mmol/L + 18 (in the presence of myocardial dysfunction).
Bedside SSS (bSSS) based on 5 points with coefficient ranked and rounded to have a user-friendly score:
VIS > 200 mcg/kg min = 1 point
Arterial lactate >8 mmol/L or its increase of 1 mmol/L after 6 h of care = 1 point
Myocardial dysfunction as defined above = 3 points.
Validation population
The validation population consisted of 456 patients admitted for septic shock requiring inotropes or vasopressors, with a mortality rate of 17.8 % (Fig. 1). Thirty-two of these patients had limitations of life support on admission and were excluded from analysis. The mortality for the remaining 424 patients was 11.6 %. The main characteristics of both development and validation populations are compared in Table 3. The two studied populations differed significantly in terms of prognostic factors and outcomes. The paediatric index of mortality score (PIM2) [17 (11–21) vs. 7.6 (3–15), p < 0.001], peak blood lactates [4.7 (2.3–7.8) vs. 2.6 (1.6–5.2), p < 0.01] and mortality (30 vs. 11.6 %, p < 0.001) were significantly higher in the development cohort. No comorbidity was found in 52 % of the patients while 60 patients (16.3 %) were immunocompromised. The origin of infection was nosocomial in 27.6 % and community-acquired in 72.4 % of the patients in the validation cohort. A microbiological diagnosis was positive for 317 patients (74.8 %; bacterial in 83.9 %, viral in 12.9 %, fungal in 2.5 % and parasitic in 0.6 %). The most prevalent pathogens were Neisseria meningitidis in 70 patients (22.4 %), Group-A Streptococcus in 38 patients (12 %), Streptococcus pneumoniae in 16 patients (5 %) and Staphylococcus aureus in 29 patients (9.1 %). The pathogen was a Gram-negative bacillus in 73 patients (23 %), including E. coli for 34 patients (10.7 %). Patients intubated for septic shock reached 87 %, and severe ARDS was present in 27.8 % of all patients.
Fig. 1.
Flow chart of the validation cohort
Table 3.
Patient characteristics in the development and validation populations
| Development population (n = 70) | Validation population (n = 424) | p value | |
|---|---|---|---|
| Age (months) | 28 (8–76) | 32 (10–87.8) | 0.60 |
| Sex ratio M/F | 1.92 | 1.27 | 0.16 |
| PIM2 score | 17 (11–21) | 7.6 (3–15) | <0.001 |
| Nosocomial infection | 25 (35.7 %) | 117 (27.6 %) | 0.21 |
| Absence of comorbidity | 33 (47.1 %) | 220 (52 %) | 0.53 |
| Immunocompromised patients | 22 (31.4 %) | 69 (16.3 %) | <0.001 |
| Use of mechanical ventilation | 54 (77.1 %) | 369 (87 %) | 0.04 |
| Severe ARDS | 14 (20 %) | 118 (27.8 %) | 0.22 |
| Cardiac arrest | 14 (20 %) | 48 (11.3 %) | 0.06 |
| Use of CRRT | 11 (15.7 %) | 47 (11.1 %) | 0.36 |
| Maximal blood lactates (mmol/L) | 4.7 (2.3–7.8) | 2.6 (1.6–5.2) | <0.01 |
| Lactate increasea | 25 (35.7 %) | 100 (23.6 %) | 0.06 |
| ScvO2 <70 % | 25 (35.7 %) | 141 (33.2 %) | 0.84 |
| Use of ECLS | 2 (2.9 %) | 2 (0.6 %) | 0.15 |
| PICU mortality | 21 (30.0 %) | 49 (11.6 %) | <0.01 |
| Number of days in PICU | 6 (2–11) | 4 (1.4–8.3) | 0.02 |
| Delay from septic shock onset to death (days) | 2 (0.6–4.5) | 1 (0.5–4) | 0.61 |
All characteristics are during PICU stay. Continuous data are expressed as medians (interquartile). Categorial data are expressed as number (percent)
PIM2 paediatric index of mortality 2, ARDS acute respiratory distress syndrome graded with the Berlin definition, CRRT continuous renal replacement therapy, ScvO2 central venous saturation of oxygen, ECLS extra-corporeal life support, PICU paediatric intensive care unit
aBlood lactates: stable defined as less than 1 mmol/L change between two consecutive samples, increase defined as more than 1 mmol/L increase between two samples
Both scores were calculated for all patients and performance analysed with ROC curves (Fig. 2). The discriminative power for association with mortality or need for ECLS was calculated for computed and bedside scores, with AUC = 0.956 (95 % CI: 0.93–0.97) and 0.920 (95 % CI: 0.89–0.94), respectively. The computed score had a higher AUC as compared to the bedside score (p = 0.0092). The performances of both scores for association with death or use of ECLS are presented in Table 4. The bedside SSS with a cut-off at 2 was associated with a positive predictive value of 60.3 % and a negative predictive value of 97.8 % (positive likelihood ratio = 11.6, Youden’s index = 0.765). The computed SSS with a cut-off at 3.5 was associated with a positive predictive value of 55 % and a negative predictive value of 98.5 % (positive likelihood ratio = 9.4, Youden’s index = 0.802). Mortality rate were compared for RSS populations defined by the bedside and the computed scores, with, respectively, 41 deaths among 68 RSS patients (mortality 60.3 %) versus 8 deaths among 356 non-RSS patients (mortality 2.2 %) for the bedside score and 44 deaths among 80 RSS patients (mortality 55 %) versus 5 deaths among 344 non-RSS patients (mortality 1.5 %). Survival curves for each score are presented in Fig. 3 and mortality is significantly higher in RSS patients for both scores (p < 0.001 and p < 0.001).
Fig. 2.
Receiver operating characteristics curves for the computed septic shock score (cSSS) and the bedside septic shock score (bSSS). Area under the ROC curve in the validation population was 0.956 (95 % CI = 0.93–0.97, p < 0.01) for the cSSS and 0.920 (95 % CI = 0.89–0.94, p < 0.01) for the bSSS
Table 4.
Predictive performance of septic shock scores and their best threshold values
| Sensitivity (%) | Specificity (%) | Positive predictive value (%) | Negative predictive value (%) | Likelihood ratio | |
|---|---|---|---|---|---|
| Bedside septic shock score (bSSS) | |||||
| ≥1 | 91.8 | 78.9 | 36.3 | 98.7 | 4.4 |
| ≥2 | 83.7 | 92.8 | 60.3 | 97.8 | 11.6 |
| ≥3 | 63.3 | 95.2 | 63.3 | 95.2 | 13.2 |
| ≥4 | 59.2 | 98.1 | 80.6 | 94.8 | 31.7 |
| Computed septic shock score (cSSS) | |||||
| ≥2.5 | 98 | 71.7 | 31.2 | 99.6 | 3.5 |
| ≥3.5 | 89.8 | 90.4 | 55 | 98.5 | 9.4 |
| ≥5.0 | 81.6 | 94.7 | 66.7 | 97.5 | 15.3 |
| ≥21 | 57.1 | 98.7 | 84.8 | 94.6 | 42.9 |
Fig. 3.
Survival curve of refractory septic shock defined by a a bedside septic shock score ≥2.5, and b a computed septic shock score ≥3.5
Discussion
The septic shock scores (bedside and computed) are the first scores that aim at diagnosing refractory septic shock in paediatric patients admitted in PICU for septic shock. The scores were effective to identify the most severely ill patients. A bedside score ≥2 or computed score ≥3.5 defined RSS with a mortality higher than 55 %. Although statistically different, the diagnostic accuracy of both scores seems clinically equivalent with an absolute difference of 0.035 in the AUC. The clinical utility for each score is different. The bSSS is a bedside tool potentially useful for stratifying the severity and assessing the imminent risk of death, helping clinicians to implement rescue therapies. Its simplicity to use may counter-balance the small loss in accuracy. The cSSS is a potentially powerful and discriminating epidemiological tool and its calculation needs a computer or a smartphone application.
Defining a study population has implications on trials outcomes and may explain contradictory outcomes from historical large-scale randomized trials [12, 13, 28]. Recently, the sepsis-3 adult definition has refined the identification of septic shock patients [7]. However, although focusing exclusively on adults, the main advance of the sepsis-3 definition is the stratification of patients into two categories: sepsis and septic shock. In adults, the SOFA score assesses organ failures after sepsis with good correlation to mortality [8]. This adult score is not adapted for paediatric patients. The paediatric index of mortality (PIM2) [29] and the PELOD-2 [30] score are paediatric scores that can be used to compare population of patients but are not specific for sepsis. In our study, the two scores were built with arterial lactate, vaso-inotrope score and septic cardiomyopathy and were associated with poor outcome. Each of those criteria was independently associated with mortality or the need for ECLS. Blood lactate is a widely used biomarker in septic shock patients. The highest value during the first 24 h of PICU was associated with mortality in paediatric septic shock patients [31]. Dynamic values, such as lactime [32] or lactate clearance [33], are better predictors of mortality in adult patients, but they are not used routinely. Interestingly, the best predictor of survival to ECLS therapy in children with septic shock was a low pre-ECLS arterial lactate value [22].
Use of vasopressors or inotropes to treat fluid-unresponsive shock is still the first line of treatment [10, 11]. The VIS is a score used to assess the responsiveness and dependency to vasopressor in cardiac ICUs [27], with a VIS >200 being associated with mortality or need for ECLS in post-operative paediatric cardiac patients with low cardiac output syndrome [34]. In our study, norepinephrine was used in 77.2 % of the patients and an inotrope (dobutamine, dopamine, epinephrine or milrinone) added in 80.2 %. The cut-off chosen in the definition by the two-round survey is higher than the VIS scores found in the literature in patients under ECLS therapy for other indications [22, 35, 36] or alternative vasopressors [37], but similar to calculated inotrope scores in adult patients needing ECLS support for septic shock [21].
The presence of a septic cardiomyopathy was independently associated with increased mortality or need for ECLS in the development population [OR = 18, (95 % CI: 3.4–95.4)]. Septic cardiomyopathy is the component carrying the highest weight in the septic shock scores. Although the pathogenesis of septic cardiomyopathy is multifactorial, it is known to be reversible [36, 37, 38]. LVEF has proven to be sufficient for the diagnosis of low cardiac output with a LVEF <40 % [39]. Diastolic dysfunction and right ventricle dysfunction in sepsis are less studied but their role in septic cardiomyopathy seems to precede systolic left ventricular dysfunction [39]. Cardiac arrest is the ultimate evolution of septic shock. In our study, in both cohorts, 59.7 % of the deceased patients had a resuscitated cardiac arrest in the course of the septic shock. Patients in cardiac arrest due to septic shock can benefit from ECLS therapy with an overall survival of 75 % in one series [22], compared to 32.7 % in our cohort. Improved assessment of septic cardiomyopathy before cardiac arrest occurs is mandatory. Regular evaluation of cardiac output and function can be based on invasive and non-invasive criteria. Non-invasive quantification relies mostly on continuous oesophageal or supra-sternal Doppler or cardiac ultrasound. Importantly, it is well recognized that children with septic shock without apparent need for inotropes can subsequently develop septic cardiomyopathy and low cardiac output [19]. This haemodynamic pattern can be explained by the unmasking of septic cardiomyopathy by restoration of vasomotor tone in resuscitated shock after norepinephrine infusions, as well as over-enthusiastic fluid resuscitation [17].
This study has some limitations. First, the data collection was retrospective and thus is at risk of missing data and information bias. Second, data were collected during the whole septic shock care period with selection of a unique worst value for each item. Thus, the maximal values could be at varying time points in the clinical course. Calculation of the score was based on worst values for each criterion that may not be synchronous. This could have increased the estimated risk of death for patients in the validation population as well as overestimating the AUCROC. However, most patients died shortly after admission (median time to death = 1 day) and the highest values were mostly collected within the first 24 h after admission. Similarly, a delay to death of less than 24 h was also shown in more than 13,000 paediatric sepsis admissions in the North Thames, UK, region [40]. Other scores used similar methodology during their creation, including SOFA and PELOD [8, 30]. Evaluating the kinetics of both scores as well as its composing criteria in the course of the disease is important and needs prospective evaluation. Third, there were significant baseline differences in the characteristics of the two populations (development and validation) and between centres included in the validation cohort. These may be explained by differences in patients’ recruitment and severity. Some of them were known prognostic factors in septic shock such as PIM2 scores and immunosuppression or were part of either the definition (blood lactates) or the outcome (mortality), outlining the patients’ recruitment and severity difference between both cohorts. The high mortality rate in the development cohort ensured the high power of this study to select the criteria associated with refractory septic shock. Meanwhile, the scores have an excellent discriminative value in the validation cohort. This reinforces the quality of the scores in various patients. Finally, this definition is based on a draft definition that has been developed using fictitious clinical cases and an international PICU physician opinion survey. The risk of opinion bias has been adjusted with the modification of this definition and the constitution of the septic shock scores tailored to an actual patient population. This definition is very coherent in real life, shown by the excellent discriminative power of both scores in the validation cohort. In regard of these limitations, a prospective study is warranted for refinement and external validation of this definition.
Conclusion
In conclusion, we have defined refractory septic shock in children as the association of high blood lactate with high vaso-inotrope doses associated with myocardial dysfunction. This definition is based on two septic shock scores showing excellent discriminative power in a multicentre validation population. The RSS Computed Score is a powerful and potentially useful tool to compare patients in future interventional randomized multicenter studies on septic shock. The RSS Bedside Score is easy to calculate and may assist in determining patients who would be suitable for inclusion in clinical trials of rescue therapies.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Acknowledgments
We acknowledge Ella Nkanagu from the ESPNIC secretariat for her assistance. We would like to thank Anthony Slater, Tara Williams, and Katie Moynihan, Children`s Health Queensland, for their support and help in data extraction.
Compliance with ethical standards
Funding
None.
Conflicts of interest
Dr. Javouhey reports grants from CSL Behring, personal fees from Gambro-Baxter, outside the submitted work. Dr. Tissieres reports grants from Merieux Foundation, non-financial support from Chiesi Inc, outside the submitted work. All other authors declare that they have no conflict of interest.
Footnotes
Take-home message: The absence of a reliable definition for refractory septic shock in children represents a barrier to planning and interpretation of clinical trials of the use of specific and targeted therapeutics. The ESPNIC definition comprising lactic acidosis, vaso-inotrope dependency and septic cardiomyopathy is a highly discriminating definition and was validated on a large multicenter international cohort of patients in septic shock.
References
- 1.Liu L, Johnson HL, Cousens S, Perin J, Scott S, Lawn JE, Rudan I, Campbell H, Cibulskis R, Li M, Mathers C, Black RE. Child health epidemiology reference group of WHO and UNICEF global, regional, and national causes of child mortality: an updated systematic analysis for 2010 with time trends since 2000. Lancet. 2012;379:2151–2161. doi: 10.1016/S0140-6736(12)60560-1. [DOI] [PubMed] [Google Scholar]
- 2.Schlapbach LJ, Straney L, Alexander J, MacLaren G, Festa M, Schibler A, Slater A, ANZICS Paediatric Study Group Mortality related to invasive infections, sepsis, and septic shock in critically ill children in Australia and New Zealand, 2002–13: a multicentre retrospective cohort study. Lancet Infect Dis. 2015;15:46–54. doi: 10.1016/S1473-3099(14)71003-5. [DOI] [PubMed] [Google Scholar]
- 3.Watson RS, Carcillo JA, Linde-Zwirble WT, Clermont G, Lidicker J, Angus DC. The epidemiology of severe sepsis in children in the United States. Am J Respir Crit Care Med. 2003;167:695–701. doi: 10.1164/rccm.200207-682OC. [DOI] [PubMed] [Google Scholar]
- 4.Kaukonen K-M, Bailey M, Suzuki S, Pilcher D, Bellomo R. Mortality related to severe sepsis and septic shock among critically ill patients in Australia and New Zealand, 2000–2012. JAMA. 2014;311:1308–1316. doi: 10.1001/jama.2014.2637. [DOI] [PubMed] [Google Scholar]
- 5.Bone RC, Fisher CJ, Clemmer TP, Slotman GJ, Metz CA, Balk RA. Sepsis syndrome: a valid clinical entity. Methylprednisolone Severe Sepsis Study Group. Crit Care Med. 1989;17:389–393. doi: 10.1097/00003246-198905000-00002. [DOI] [PubMed] [Google Scholar]
- 6.Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, Cohen J, Opal SM, Vincent JL, Ramsay G, SCCM, ESICM, ACCP, ATS, SIS 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Crit Care Med. 2003;31:1250–1256. doi: 10.1097/01.CCM.0000050454.01978.3B. [DOI] [PubMed] [Google Scholar]
- 7.Singer M, Deutschman CS, Seymour C, Shankar-Hari M, Annane D, Bauer M, Bellomo R, Bernard GR, Chiche JD, Coopersmith CM, Hotchkiss RS, Levy MM, Marshall JC, Martin GS, Opal SM, Rubenfeld GD, van der Poll T, Vincent JL, Angus DC. The third international consensus definitions for sepsis and septic shock (sepsis-3) JAMA. 2016;315:801–810. doi: 10.1001/jama.2016.0287. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Vincent JL, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H, Reinhart CK, Suter PM, Thijs LG. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996;22:707–710. doi: 10.1007/BF01709751. [DOI] [PubMed] [Google Scholar]
- 9.Leclerc F, Leteurtre S, Duhamel A, Grandbastien B, Proulx F, Martinot A, Gauvin F, Hubert P, Lacroix J. Cumulative influence of organ dysfunctions and septic state on mortality of critically ill children. Am J Respir Crit Care Med. 2005;171:348–353. doi: 10.1164/rccm.200405-630OC. [DOI] [PubMed] [Google Scholar]
- 10.Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, Sevransky JE, Sprung CL, Douglas IS, Jaeschke R, Osborn TM, Nunnally ME, Townsend SR, Reinhart K, Kleinpell RM, Angus DC, Deutschman CS, Machado FR, Rubenfeld GD, Webb S, Beale RJ, Vincent JL, Moreno R (2013) Surviving sepsis campaign guidelines committee including The pediatric subgroup surviving sepsis campaign: international guidelines for management of severe sepsis and septic shock: 2012. Intensive Care Med 39:165–228 [DOI] [PMC free article] [PubMed]
- 11.Brierley J, Carcillo JA, Choong K, Cornell T, Decaen A, Deymann A, Doctor A, Davis A, Duff J, Dugas MA, Duncan A, Evans B, Feldman J, Felmet K, Fisher G, Frankel L, Jeffries H, Greenwald B, Gutierrez J, Hall M, Han YY, Hanson J, Hazelzet J, Hernan L, Kiff J, Kissoon N, Kon A, Irazuzta J, Lin J, Lorts A, Mariscalco M, Mehta R, Nadel S, Nguyen T, Nicholson C, Peters M, Okhuysen-Cawley R, Poulton T, Relves M, Rodriguez A, Rozenfeld R, Schnitzler E, Shanley T, Kache S, Skippen P, Torres A, von Dessauer B, Weingarten J, Yeh T, Zaritsky A, Stojadinovic B, Zimmerman J, Zuckerberg A. Clinical practice parameters for hemodynamic support of pediatric and neonatal septic shock: 2007 update from the American College of Critical Care Medicine. Crit Care Med. 2009;37:666–688. doi: 10.1097/CCM.0b013e31819323c6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Ranieri VM, Thompson BT, Barie PS, Dhainaut JF, Douglas IS, Finfer S, Gårdlund B, Marshall JC, Rhodes A, Artigas A, Payen D, Tenhunen J, Al-Khalidi HR, Thompson V, Janes J, Macias WL, Vangerow B, Williams MD, PROWESS-SHOCK Study Group Drotrecogin alfa (activated) in adults with septic shock. N Engl J Med. 2012;366:2055–2064. doi: 10.1056/NEJMoa1202290. [DOI] [PubMed] [Google Scholar]
- 13.Nadel S, Goldstein B, Williams MD, Dalton H, Peters M, Macias WL, Abd-Allah SA, Levy H, Angle R, Wang D, Sundin DP, Giroir B, REsearching severe Sepsis and Organ dysfunction in children: a gLobal perspective (RESOLVE) study group Drotrecogin alfa (activated) in children with severe sepsis: a multicentre phase III randomised controlled trial. Lancet. 2007;369:836–843. doi: 10.1016/S0140-6736(07)60411-5. [DOI] [PubMed] [Google Scholar]
- 14.Investigators ProCESS, Yealy DM, Kellum JA, Huang DT, Barnato AE, Weissfeld LA, Pike F, Terndrup T, Wang HE, Hou PC, LoVecchio F, Filbin MR, Shapiro NI, Angus DC. A randomized trial of protocol-based care for early septic shock. N Engl J Med. 2014;370:1683–1693. doi: 10.1056/NEJMoa1401602. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Peake SL, Bailey M, Bellomo R, Cameron PA, Cross A, Delaney A, Finfer S, Higgins A, Jones DA, Myburgh JA, Syres GA, Webb SA, Williams P, ARISE Investigators, for the Australian and New Zealand Intensive Care Society Clinical Trials Group Australasian resuscitation of sepsis evaluation (ARISE): a multi-centre, prospective, inception cohort study. Resuscitation. 2009;80:811–818. doi: 10.1016/j.resuscitation.2009.03.008. [DOI] [PubMed] [Google Scholar]
- 16.Daviaud F, Grimaldi D, Dechartres A, Charpentier J, Geri G, Marin N, Chiche JD, Cariou A, Mira JP, Pène F. Timing and causes of death in septic shock. Ann Intensive Care. 2015;5:58. doi: 10.1186/s13613-015-0058-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Parker MM, Shelhamer JH, Natanson C, Alling DW, Parrillo JE. Serial cardiovascular variables in survivors and nonsurvivors of human septic shock: heart rate as an early predictor of prognosis. Crit Care Med. 1987;15:923–929. doi: 10.1097/00003246-198710000-00006. [DOI] [PubMed] [Google Scholar]
- 18.Pathan N, Hemingway CA, Alizadeh AA, Stephens AC, Boldrick JC, Oragui EE, McCabe C, Welch SB, Whitney A, O’Gara P, Nadel S, Relman DA, Harding SE, Levin M. Role of interleukin 6 in myocardial dysfunction of meningococcal septic shock. Lancet. 2004;363:203–209. doi: 10.1016/S0140-6736(03)15326-3. [DOI] [PubMed] [Google Scholar]
- 19.Deep A, Goonasekera CDA, Wang Y, Brierley J. Evolution of haemodynamics and outcome of fluid-refractory septic shock in children. Intensive Care Med. 2013;39:1602–1609. doi: 10.1007/s00134-013-3003-z. [DOI] [PubMed] [Google Scholar]
- 20.Hotchkiss RS, Monneret G, Payen D. Sepsis-induced immunosuppression: from cellular dysfunctions to immunotherapy. Nat Rev Immunol. 2013;13:862–874. doi: 10.1038/nri3552. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Bréchot N, Luyt C-E, Schmidt M, Leprince P, Trouillet JL, Léger P, Pavie A, Chastre J, Combes A. Venoarterial extracorporeal membrane oxygenation support for refractory cardiovascular dysfunction during severe bacterial septic shock. Crit Care Med. 2013;41:1616–1626. doi: 10.1097/CCM.0b013e31828a2370. [DOI] [PubMed] [Google Scholar]
- 22.MacLaren G, Butt W, Best D, Donath S. Central extracorporeal membrane oxygenation for refractory pediatric septic shock. Pediatr Crit Care Med. 2011;12:133–136. doi: 10.1097/PCC.0b013e3181e2a4a1. [DOI] [PubMed] [Google Scholar]
- 23.French Intensive Care Society, International congress- Réanimation 2016 (2016) Ann Intensive Care 6 (Suppl1):S50 [DOI] [PMC free article] [PubMed]
- 24.Goldstein B, Giroir B, Randolph A, International pediatric sepsis consensus conference: definitions for sepsis and organ dysfunction in pediatrics International pediatric sepsis consensus conference: definitions for sepsis and organ dysfunction in pediatrics. Pediatr Crit Care Med. 2005;6:2–8. doi: 10.1097/01.PCC.0000149131.72248.E6. [DOI] [PubMed] [Google Scholar]
- 25.DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837–845. doi: 10.2307/2531595. [DOI] [PubMed] [Google Scholar]
- 26.De Luca D, Piastra M, Chidini G, Tissieres P, Calderini E, Essouri S, Medina Villanueva A, Vivanco Allende A, Pons-Odena M, Perez-Baena L, Hermon M, Tridente A, Conti G, Antonelli M, Kneyber M, Respiratory Section of the European Society for Pediatric Neonatal Intensive Care (ESPNIC) The use of the Berlin definition for acute respiratory distress syndrome during infancy and early childhood: multicenter evaluation and expert consensus. Intensive Care Med. 2013;39:2083–2091. doi: 10.1007/s00134-013-3110-x. [DOI] [PubMed] [Google Scholar]
- 27.Davidson J, Tong S, Hancock H, Hauck A, da Cruz E, Kaufman J. Prospective validation of the vasoactive-inotropic score and correlation to short-term outcomes in neonates and infants after cardiothoracic surgery. Intensive Care Med. 2012;38:1184–1190. doi: 10.1007/s00134-012-2544-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Kalil AC, Florescu DF. Severe sepsis: are PROWESS and PROWESS-SHOCK trials comparable? a clinical and statistical heterogeneity analysis. Crit Care. 2013;17:167. doi: 10.1186/cc12752. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Slater A, Shann F, Pearson G, Paediatric Index of Mortality (PIM) Study Group PIM2: a revised version of the paediatric index of mortality. Intensive Care Med. 2003;29:278–285. doi: 10.1007/s00134-002-1601-2. [DOI] [PubMed] [Google Scholar]
- 30.Leteurtre S, Duhamel A, Salleron J, Grandbastien B, Lacroix J, Leclerc F, Groupe Francophone de Réanimation et d’Urgences Pédiatriques (GFRUP) PELOD-2: an update of the PEdiatric logistic organ dysfunction score. Crit Care Med. 2013;41:1761–1773. doi: 10.1097/CCM.0b013e31828a2bbd. [DOI] [PubMed] [Google Scholar]
- 31.Jhamb U, Jat K, Gupta V. Serum lactate levels as the predictor of outcome in pediatric septic shock. Indian J Crit Care Med. 2011;15:102. doi: 10.4103/0972-5229.83017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Bakker J, Gris P, Coffernils M, Kahn RJ, Vincent JL. Serial blood lactate levels can predict the development of multiple organ failure following septic shock. Am J Surg. 1996;171:221–226. doi: 10.1016/S0002-9610(97)89552-9. [DOI] [PubMed] [Google Scholar]
- 33.Levraut J, Ichai C, Petit I, Ciebiera JP, Perus O, Grimaud D. Low exogenous lactate clearance as an early predictor of mortality in normolactatemic critically ill septic patients. Crit Care Med. 2003;31:705–710. doi: 10.1097/01.CCM.0000045561.85810.45. [DOI] [PubMed] [Google Scholar]
- 34.Gaies MG, Gurney JG, Yen AH, Napoli ML, Gajarski RJ, Ohye RG, Charpie JR, Hirsch JC. Vasoactive-inotropic score as a predictor of morbidity and mortality in infants after cardiopulmonary bypass. Pediatr Crit Care Med. 2010;11:234–238. doi: 10.1097/PCC.0b013e3181b806fc. [DOI] [PubMed] [Google Scholar]
- 35.Horton S, d’Udekem Y, Shann F, Butt W, Bennett M, Best D, Brizard C. Extracorporeal membrane oxygenation via sternotomy for circulatory shock. J Thorac Cardiovasc Surg. 2010;139:e12–e13. doi: 10.1016/j.jtcvs.2008.07.029. [DOI] [PubMed] [Google Scholar]
- 36.Goldman AP, Kerr SJ, Butt W, Marsh MJ, Murdoch IA, Paul T, Firmin RK, Tasker RC, Macrae DJ. Extracorporeal support for intractable cardiorespiratory failure due to meningococcal disease. Lancet. 1997;349:466–469. doi: 10.1016/S0140-6736(96)12106-1. [DOI] [PubMed] [Google Scholar]
- 37.Torgersen C, Dünser MW, Wenzel V, Jochberger S, Mayr V, Schmittinger CA, Lorenz I, Schmid S, Westphal M, Grander W, Luckner G. Comparing two different arginine vasopressin doses in advanced vasodilatory shock: a randomized, controlled, open-label trial. Intensive Care Med. 2010;36:57–65. doi: 10.1007/s00134-009-1630-1. [DOI] [PubMed] [Google Scholar]
- 38.Takasu O, Gaut JP, Watanabe E, To K, Fagley RE, Sato B, Jarman S, Efimov IR, Janks DL, Srivastava A, Bhayani SB, Drewry A, Swanson PE, Hotchkiss RS. Mechanisms of cardiac and renal dysfunction in patients dying of sepsis. Am J Respir Crit Care Med. 2013;187:509–517. doi: 10.1164/rccm.201211-1983OC. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Vieillard-Baron A, Prin S, Chergui K, Dubourg O, Jardin F. Hemodynamic instability in sepsis: bedside assessment by Doppler echocardiography. Am J Respir Crit Care Med. 2003;168:1270–1276. doi: 10.1164/rccm.200306-816CC. [DOI] [PubMed] [Google Scholar]
- 40.Cvetkovic M, Lutman D, Ramnarayan P, Pathan N, Inwald DP, Peters MJ. Timing of death in children referred for intensive care with severe sepsis: implications for interventional studies. Pediatr Crit Care Med. 2015;1:410–417. doi: 10.1097/PCC.0000000000000385. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.