Skip to main content
Scientific Reports logoLink to Scientific Reports
. 2018 Nov 9;8:16606. doi: 10.1038/s41598-018-35000-7

Biomarker Phenotype for Early Diagnosis and Triage of Sepsis to the Pediatric Intensive Care Unit

Beata Mickiewicz 1, Graham C Thompson 2, Jaime Blackwood 2, Craig N Jenne 3, Brent W Winston 4, Hans J Vogel 1, Ari R Joffe 5,
PMCID: PMC6226431  PMID: 30413795

Abstract

Early diagnosis and triage of sepsis improves outcomes. We aimed to identify biomarkers that may advance diagnosis and triage of pediatric sepsis. Serum and plasma samples were collected from young children (1–23 months old) with sepsis on presentation to the Pediatric Intensive Care Unit (PICU-sepsis, n = 46) or Pediatric Emergency Department (PED-sepsis, n = 58) and PED-non-sepsis patients (n = 19). Multivariate analysis was applied to distinguish between patient groups. Results were compared to our results for older children (2–17 years old). Common metabolites and protein-mediators were validated as potential biomarkers for a sepsis-triage model to differentiate PICU-sepsis from PED-sepsis in children age 1 month-17 years. Metabolomics in young children clearly separated the PICU-sepsis and PED-sepsis cohorts: sensitivity 0.71, specificity 0.93, and AUROC = 0.90 ± 0.03. Adding protein-mediators to the model did not improve performance. The seven metabolites common to the young and older children were used to create the sepsis-triage model. Validation of the sepsis-triage model resulted in sensitivity: 0.83 ± 0.02, specificity: 0.88 ± 0.05 and AUROC 0.93 ± 0.02. The metabolic-based biomarkers predicted which sepsis patients required care in a PICU versus those that could be safely cared for outside of a PICU. This has potential to inform appropriate triage of pediatric sepsis, particularly in EDs with less experience evaluating children.

Introduction

Sepsis is defined as life-threating organ dysfunction caused by a dysregulated host response to infection1. If the diagnosis of sepsis is missed due to nonspecific presentations, sepsis may deteriorate to septic shock in which underlying circulatory and cellular/metabolic abnormalities substantially increase patient mortality2. It has been estimated that infections account for almost 60% of all deaths in children younger than 5 years old3. In the U.S.A. sepsis causes over 75,000 hospitalizations and nearly 10,000 deaths every year in children4. Moreover, the prevalence of sepsis and sepsis-associated mortality have been significantly higher in neonates and infants than in any other subgroup of pediatric (age < 20 years) patients4,5. Despite advances in methods for detecting microbial pathogens, the underlying cause of pediatric sepsis cannot be clearly identified in over 75% of cases6. The proper diagnosis of sepsis remains a priority for the health care system; thus, it is necessary to develop new techniques and identify reliable biomarkers to improve sepsis diagnosis and prognosis. Early diagnosis of sepsis followed by correct triage of patients (i.e. patient admission to a hospital ward for observation or to a pediatric intensive care unit (PICU)) and initiation of appropriate treatment are associated with improved patient outcome7,8. Frequently, these initial important decisions are left to physician judgement7,9. Physician choices may significantly differ between pediatric emergency departments (PED) with extensive experience with sepsis in children and smaller centers without such knowledge10,11.

In our previous study we found that in children 2–17 years old, who are likely to have a mature immune system, metabolic and inflammatory protein-mediator profiling could be utilized to differentiate children with sepsis requiring care in a PICU from children with and without sepsis safely cared for outside of a PICU12. Integrating these two sources of biomarker data may improve prediction by increasing the information available describing the state of the organism. This systems biology-based approach may realistically lead to development of a point-of-care test aiding sepsis triage decisions, but in addition needs to be examined in a younger pediatric cohort (under 2 years old) who may have a less mature or developing immune response to sepsis. Therefore, here we have investigated whether metabolomics and inflammatory protein-mediator profiling can be applied for early diagnosis and triage of sepsis in infants (1–23 months old). Next, we selected the most significant metabolites and inflammatory protein-mediators responsible for sepsis triage and we validated these potential biomarkers in the entire pediatric cohort (children age 1 month-17 years). Specifically, we hypothesized that a biopattern can be identified that differentiates between children with sepsis that require care in a PICU versus those that can be safely cared for outside of a PICU.

Methods

Patients and sample collection

The study was approved by the Conjoint Health Research Ethics Board of the University of Calgary (Ethics ID 23426), and the Health Research Ethics Board of the University of Alberta (Pro00008797), and all patients, or their next of kin, provided written informed consent for participating in this study. All samples were collected in accordance with the Tri-Council policy statement. The sample collection protocol has previously been described in detail12. Briefly, samples were obtained from an existing arterial or central venous catheter (PICU-sepsis cohort) or with intravenous insertion or blood culture draw (PED-cohorts). Blood was drawn as soon as possible (within 24 hours of meeting eligibility).

PICU-sepsis cohort

All eligible children admitted to the only two PICUs in Alberta with a diagnosis of sepsis were prospectively enrolled (04/2010–10/2013). Sepsis was defined as systemic inflammatory response syndrome (SIRS), caused by a suspected/proven bacterial/fungal infection, with antibiotics ordered, and an arterial and/or central venous line in place. Patients were excluded if: expected survival ≤24 h, decision for palliation, or having severe sepsis for ≥48 h (in order to exclude those with late presentation of severe-sepsis to the PICU). Patients with microbiologically confirmed sepsis (positive culture from a normally sterile site, including blood, cerebrospinal fluid, peritoneal fluid, or tissue) or pneumonia without microbiological confirmation (SIRS with chest infiltrate suggesting pneumonia) had specimens analyzed. Site of infection was defined as that diagnosed by the attending medical team. Blood was drawn as soon as possible upon PICU admission using a deferred consent model, except for the few patients that had blood drawn in the PED (2/46 (4%) and 3/94 (3%) of the PICU-sepsis cohort age 1–23 months and 2–17 years respectively).

PED-sepsis cohort

Children admitted to one PED in Alberta with a diagnosis of sepsis were prospectively enrolled. Sepsis was defined as SIRS caused by a suspected or proven bacterial or fungal infection, with antibiotics and blood culture ordered. If a patient was admitted to the PICU from the PED, they were only included in the PICU-sepsis cohort. The definition of PICU-sepsis was more stringent (excluding those without clear bacterial sepsis, e.g., with unknown, viral, or other causes of systemic inflammatory response syndrome) than in the PED-sepsis cohort. This was for both operational reasons (inability to follow the PED-sepsis cohort throughout their hospital [n = 35] or outpatient management), and to identify the PICU-sepsis cohort as those with serious infection requiring care in a PICU.

PED-control cohort

In the same PED, previously healthy children were prospectively enrolled if they were admitted for a procedure requiring intravenous sedation/analgesia, and without an infection (no history of fever within 2 weeks, and no clinical evidence of infection).

Sample preparation and data collection

1H Nuclear magnetic resonance (NMR) spectroscopy

The sample preparation protocol and NMR spectral acquisition are presented in the Supplementary Methods and have previously been described in detail1214. Briefly, high resolution one-dimensional 1H NMR spectra of filtered serum samples were obtained on a 600 MHz Bruker Ultrashield Plus NMR spectrometer (Bruker BioSpin Ltd., Canada). The spectra were profiled in Chenomx NMR Suite 7.5 software (Chenomx Inc., Edmonton, AB, Canada)15. The concentration of internal standard (0.5 mM) was used to determine the concentrations of detected metabolites. All samples and 1H NMR spectra were randomized prior to analysis to avoid progressive bias.

Inflammatory protein-mediators

Quantification of targeted inflammatory protein-mediators (cytokines, chemokines and acute-phase proteins that are involved in inflammation) was done using validated Luminex bead-based multiplexing assays according to the manufacturer’s instructions, as described previously12,16.

Statistical analysis

For detailed information about data pre-processing and statistical data analysis see the Supplementary Methods. Briefly, multivariate statistical analysis was performed using SIMCA-P+ 12.0.1 software (Umetrics, Sweden) and consisted of principal component analysis (PCA) and orthogonal partial least squares discriminant analysis (OPLS-DA). For each OPLS-DA model the R2Y (the percentage of variation explained by the model), Q2 (the predictive ability of the model) and CV-ANOVA (Cross-Validated Analysis Of Variance) p-value17,18 were calculated based on sevenfold cross-validation (CV)19. The significant metabolites and protein-mediators were selected from the OPLS-DA regression coefficients (p < 0.05; jackknife technique)20.

To confirm potential biomarkers for sepsis triage the results for infants were compared to our previously published results for older children (2–17 years old)12. Based on the common biopattern for both pediatric cohorts alternative OPLS-DA models were created for each age group and for the combined group. The receiver operating characteristic (ROC) analysis21 was performed for each single potential biomarker, and for the multivariate OPLS-DA model biopatterns. To validate the sepsis triage model based on the common potential biomarkers, the OPLS-DA model which consisted of 2/3 of all available pediatric samples was used as a training set and the remaining samples comprised a test set. The model was validated 3 times and for each training set the samples were randomly selected.

Results

Patient cohort

The demographics, sites of infection, and severity-of-illness measures for each cohort are provided in Table 1. Eligible children were prospectively registered into the database after deferred consent was obtained; the consent rate was 78%. Of 63 patients age <24 months, those without clear bacterial sepsis (unknown, viral, or other causes of systemic inflammatory response syndrome) were excluded from the PICU-sepsis nested cohort. Most (>90%) of the PICU-sepsis cohort developed sepsis and were enrolled on the day of PICU admission (median PICU length of stay at enrollment 0 [IQR 1.0] days; 4 (8.7%) enrolled after day 1 of PICU stay; Table 1), with the large majority (>90%) admitted directly from an ED to PICU (only 2 (4%) had study labwork sent while in the PED)22. The first lactate on the day of enrolment was 1.9 (SD 1.4) mmol/L, suggesting early enrolment. On the day of enrolment, the PICU-sepsis cohort patients (n = 46) had PEdiatric Logistic Organ Dysfunction scores and Pediatric RISk of Mortality III scores comparable to other PICU sepsis trial patients23,24. Most (90%) PICU-sepsis patients were ventilated (for a median of 8 days) during the index sepsis episode, and 50% received vasoactive infusions on the first day of sepsis. The median PICU length of stay after sepsis was 10 days, with only 4% staying in PICU <2 days after enrolment (Table 1). There were no statistically significant differences between the two hospital’s PICU-sepsis cohorts in day of enrolment mechanical ventilation, WBC count, lactate, PRISM score, or PELOD score, or in the duration of ventilation or PICU stay after inclusion [data not shown]. In addition, we found no statistically significant difference between the two PICU-sepsis cohorts in a combined metabolic and protein-mediator model [data not shown]. The PED-sepsis cohort showed comparable demographics, except for having fewer comorbidities and better values for platelet count and systolic blood pressure. No patient in the PED-sepsis cohort was admitted to a PICU within 7 days of enrolment.

Table 1.

Description of the pediatric patient cohorts.

Descriptive variable PICU-sepsis cohort PED-sepsis cohort PED-control cohort
Number of patients n = 45a n = 58 n = 19
Age (months) 9.8 (7.4) 11.2 (6.7) 11.7 (9.5)
Gender: male 28 (61%) 31 (53%) 11 (58%)
Weight (kg) 8.1 (3.2) 9.1 (2.6) 11.1 (1.6)
Underlying co-morbidity 0 (0%)
 -Neuromuscular 6 (13%) 1 (2%)
 -Cardiac 10 (22%) 1 (2%)
 -Respiratory 9 (20%) 1 (2%)
 -Chromosomal abnormality 3 (7%) 2 (3%)
PRISM III score 8.6 (6.8); 6 [3,14] N/A N/A
PELOD score 15.0 (9.0); 12 [11,21] N/A N/A
WBC 12.6 (7.4) 12.3 (7.2); n = 55 N/A
Platelet count 239 (161) 314 (132); n = 54 N/A
Creatinine (μmol/L) 30 (19) 26 (21); n = 45 N/A
Lactate (mmol/L) 1.9 (1.4) 1.7 (0.4);n = 9 N/A
Lowest SBP (mmHg) 76 (14) 95 (14) 110 (13)
Lowest MAP (mmHg) 52 (10)
pH 7.3 (0.1) 7.39 (0.13); n = 13
Sepsis developed after first PICU day 4 (9%) N/A N/A
Site of infection N/Ad
 -Pneumonia without microbiological confirmation 21 (46%) 11 (19%)
 -Microbiologically confirmed (culture positive) 23 (50%)b 21 (36%)c
 -Clinically diagnosed 0 (0%) 26 (45%)c
Mechanical ventilation on first day 35 (76%) N/A N/A
Inotrope/vasopressor infusion on first day 23 (50%) N/A N/A
Duration of mechanical ventilation after enrolment (days) n = 40 (90%);
8 [4, 11]
N/A N/A
PICU length of stay after enrolment (days) <2 days: 2 (4%)
10 [6, 14]
Hospital stay
4 [3, 5]; n = 35
N/A
RRT 3 (7%) 0 (0%) N/A
ECLS therapy 2 (4%) 0 (0%) N/A
PICU Mortality 2 (4%) 0 (0%) 0 (0%)

Results given as n (%) or mean (SD) or median [IQR].

ECLS: extracorporeal life support; MAP: mean arterial pressure; N/A: not applicable; PED: pediatric emergency department; PELOD: pediatric logistic organ dysfunction score; PICU: pediatric intensive care unit; PRISM: pediatric risk of mortality score; RRT: renal replacement therapy; SBP: systolic blood pressure.

aOne patient withdrew consent to use their demographic and clinical data.

bSites of infection included: meningitis (9; 3 with bacteremia); empyema (1); bacteremia (8; 1 with pneumonia, 2 from central venous line source); peritonitis (2; both from gut ischemia); fasciitis (1, of abdominal wall); mediastinitis (1), parapharyngeal abscess from Streptococcus pyogenes (1).

cSites of infection included: a. Microbiologically confirmed- meningitis (2, both with bacteremia); bacteremia (9; 2 with pneumonia, 1 with UTI, 1 with cervical adenitis); urinary tract infection (11); MRSA skin abscess (1). b. Clinically diagnosed: retropharyngeal cellulitis (2), otitis media (1), cervical adenitis (1), neutropenia with fever (1), presumed viral febrile illness (8; 4 confirmed as RSV-2, Influenza-1, HSV stomatitis-1), and unknown source of fever (13).

dProcedures for: orthopedic reduction 4; laceration repair 10; foreign body removal 1; other 4 (amputation revision 1, casting 2, plastibell removal from penis 1).

Metabolic profiling dataset

A total of 59 metabolites were detected, assigned and quantified in each serum sample. Acetaminophen and propylene glycol were excluded from the statistical analysis as they are related to medication and treatment25, and glycerol, a potential contaminant from the microcentrifuge filters, was also excluded. Additionally, the ethanol concentration could not be determined in more than half of samples as its metabolite peaks were in the noise level in the NMR spectra (i.e., below the threshold for reliable detection). Consequently, the 1H NMR dataset used for statistical analysis consisted of 55 metabolites (Supplementary Table S1) and 3.1% of missing values which were randomly distributed.

The PCA model was based on three principal components which in total summarized 36.2% of variation in the dataset (Fig. 1A). Four PICU-sepsis samples were detected as outliers (1/8 (13%) of the venous samples, and 3/38 (8%) of the arterial samples) and were further excluded from analyses; outliers can potentially bias the results of supervised analysis18.

Figure 1.

Figure 1

Principal Component Analysis results for the 1–23 month old cohorts. (A) Metabolic data profiling, (B) inflammatory protein-mediator data profiling, and (C) combined biomarker profiling data. Red dots: PICU-sepsis patients; blue dots: PED-sepsis cohort; green dots: PED-control. The sphere describes the 95% confidence interval of the Hotelling’s T-squared distribution.

To better reveal metabolic differences between two specific patient cohorts OPLS-DA analysis was carried out (Fig. 2A). The OPLS-DA score scatter plots demonstrated clear separation between patient cohorts with high values of R2Y and Q2 metrics and significant CV-ANOAVA p-values (Fig. 2A and Table 2). The ROC analysis (Table 2) revealed high AUROC values: AUROC = 0.90 ± 0.03 for PICU-sepsis versus PED-sepsis, AUROC = 0.99 ± 0.01 for PED-sepsis versus PED-controls and AUROC = 1.0 for PICU-sepsis versus PED-controls.

Figure 2.

Figure 2

Orthogonal Partial Least Squares Discriminant Analysis for the 1–23 month old cohorts. (A) Metabolic data profiling, (B) inflammatory protein-mediator data profiling, and (C) combined biomarker profiling data. Red dots: PICU-sepsis cohort; blue dots: PED-sepsis cohort; green dots: PED-control cohort.

Table 2.

Results of orthogonal partial least squares discriminant analysis for the 1–23 month old cohorts.

Patient cohort Data R2Y Q2 CV-ANOVA p-value Sensitivity: Specificity PPV:NPV Accuracy AUROC ± standard error
PICU-sepsis versus
PED-sepsis
Metabolites 0.48 0.44 8.5 × 10−13 0.71:0.93 0.88:0.82 0.84 0.90 ± 0.03
Mediators 0.37 0.32 3.0 × 10−8 0.56:0.87 0.76:0.73 0.74 0.84 ± 0.04
Combined 0.45 0.39 2.5 × 10−10 0.70:0.91 0.84:0.82 0.83 0.87 ± 0.04
PED-sepsis versus
PED-controls
Metabolites 0.72 0.61 7.8 × 10−9 0.91:1.0 1.0:0.86 0.94 0.99 ± 0.01
Mediators 0.77 0.75 1.2 × 10−14 0.97:0.94 0.97:0.94 0.96 0.99 ± 0.003
Combined 0.80 0.70 1.6 × 10−11 1.0:0.94 0.97:1.0 0.98 0.99 ± 0.02
PICU-sepsis versus
PED-controls
Metabolites 0.93 0.88 1.9 × 10−14 1.0:1.0 1.0:1.0 1.0 1.0
Mediators 0.86 0.67 2.7 × 10−7 0.89:0.94 0.94:0.89 0.92 0.99 ± 0.01
Combined 0.94 0.90 7.6 × 10−15 1.0:1.0 1.0:1.0 1.0 1.0

AUROC: area under the receiver operating characteristic curve; PICU: pediatric intensive care unit; PED: emergency department; R2Y: percentage of variation explained by the model; Q2: predictive ability of the model; CV-ANOVA: cross-validated analysis of variance; PPV:NPV: positive predictive value: negative predictive value.

Inflammatory protein-mediator profiling dataset

Overall, 57 inflammatory protein-mediators were recognized and quantified in the plasma samples (Supplementary Table S2). Fibrinogen, serum amyloid A, haptoglobin and C-reactive protein were excluded from the statistical analysis as they were showing “out-of-range” values (above upper limit of detection) for more than 50% of the samples. The final dataset consisted of 53 protein-mediators and 3.1% of missing values (randomly distributed).

Three principal components were calculated for the PCA model and the total variation summarized by the model was 46.7% (Fig. 1B). Eleven samples were detected as outliers: 7 PICU-sepsis samples and 4 PED-sepsis samples. Similar to the 1H NMR dataset these outliers were excluded in further statistical models as is recommended for this type of analysis18.

The OPLS-DA models for the PED-sepsis cohort versus PED-controls and the PICU-sepsis cohort versus PED-controls demonstrated very good separation between the patient groups with high values of validation parameters and significant CV-ANOVA p-values (Fig. 2B and Table 2). However, the OPLS-DA model for the PICU-sepsis cohort versus PED-sepsis patients had lower values of R2Y, Q2 and AUROC parameters when compared to the other OPLS-DA models: R2Y = 0.37, Q2 = 0.32, AUROC = 0.84 ± 0.04 (Fig. 2B and Table 2).

Combined metabolic and protein-mediator profiling dataset

Three principal components explained 38.3% of the total variation in the combined metabolic and inflammatory protein-mediators profiling dataset (Fig. 1C). There were 12 outliers: 9 PICU-sepsis samples and 3 PED-sepsis samples. All outlying samples were excluded in subsequent supervised analyses. Of note, only 1 patient was an outlier in all three analyses; on review there were no obvious clinical reasons for this.

The OPLS-DA score scatter plots clearly distinguished between the patient groups and were associated with high values of R2Y and Q2 parameters, and significant CV-ANOVA p-values (Fig. 2C and Table 2). The most powerful combined metabolites/protein-mediators OPLS-DA model was constructed for the PICU-sepsis patients versus the PED-controls: R2Y = 0.94, Q2 = 0.90 and AUROC = 1.0. Interestingly, the PICU-sepsis versus PED-sepsis OPLS-DA model for the 1H NMR-based data was superior when considering all implemented approaches, while the OPLS-DA model for PED-sepsis versus PED-controls showed very similar results for the metabolomics, protein mediators and combined datasets (Table 2).

Supervised models without outliers excluded

To confirm that excluding the outliers from the supervised analyses did not bias the results, we recalculated the OPLS-DA models including all outlying samples which were detected in the PCA models. Leaving the outliers out from the supervised analyses only had a minor influence on the discriminative and predictive ability of the models (Supplementary Table S3). Of note, the subsequent combined age 1 month to 17 years old models were analysed without any outliers excluded.

Potential biomarkers and model validation

Overall, 21 metabolites and 15 inflammatory protein-mediators were responsible for the separation between the PICU-sepsis patients and the PED-sepsis cohort (Supplementary Table S4; Supplementary Fig. S1). After comparing these results to the previously published outcomes of metabolite and protein-mediator profiling for 2–17 year old children (Supplementary Table S5 and Supplementary Fig. S1)12 we found that 7 metabolites and their concentration changes were common to infants and older children: increased level of dimethylamine, mannose, 3-methyl-2-oxovalerate and 3-hydroxyisovalerate, and decreased concentrations of alanine, O-acetylcholine and acetate. None of the inflammatory protein-mediators detected in the OPLS-DA model (combined dataset) for infants PICU-sepsis versus PED-sepsis was common to the same type of model for the older children.

Based on these 7 metabolites alternative OPLS-DA models for PICU-sepsis versus PED-sepsis were constructed for infants (n = 104) and older children (n = 175) respectively, without excluding outliers. Both models revealed highly significant values of validation parameters (Table 3). The ROC analysis performed for a single potential biomarker and the 7 metabolites taken together demonstrated that the highest AUROC values were obtained for the multivariate biopatterns (Table 4): AUROC = 0.91 ± 0.03 for infants, and AUROC = 0.93 ± 0.02 for the 2–17 year old cohort.

Table 3.

Results of orthogonal partial least squares discriminant analysis based on 7 potential biomarkers.

PICU-sepsis versus PED-sepsis R2Y Q2 CV-ANOVA p-value Sensitivity: Specificity PPV:NPV Accuracy AUROC ± standard error
1–23 month old cohort 0.46 0.44 1.8 × 10−13 0.80:0.88 0.84:0.85 0.85 0.90 ± 0.03
2–17 year old cohort 0.60 0.58 2.7 × 10−33 0.87:0.93 0.93:0.86 0.90 0.95 ± 0.02
1 month-17 year old cohort 0.53 0.52 2.3 × 10−22 0.84:0.89 0.89:0.84 0.86 0.93 ± 0.02

AUROC: area under the receiver operating characteristic curve; PICU: pediatric intensive care unit; PED: emergency department; R2Y: percentage of variation explained by the model; Q2: predictive ability of the model; CV-ANOVA: cross-validated analysis of variance; PPV:NPV: positive predictive value: negative predictive value.

Table 4.

Results of receiver operating characteristic analysis for each single potential biomarker and the multivariate biopattern for differentiating sepsis requiring care in pediatric intensive care from sepsis cared for in the emergency department.

Potential biomarkers AUROC ± standard error
1–23 month old cohort 2–17 year old cohort
3-Hydroxyisovalerate 0.65 ± 0.05 0.71 ± 0.04
3-Methyl-2-oxovalerate 0.64 ± 0.06 0.62 ± 0.04
Acetate 0.73 ± 0.05 0.86 ± 0.03
Alanine 0.84 ± 0.04 0.75 ± 0.04
Dimethylamine 0.79 ± 0.04 0.77 ± 0.04
Mannose 0.75 ± 0.05 0.80 ± 0.03
O-Acetylcholine 0.76 ± 0.05 0.75 ± 0.04
Multivariate biopattern 0.91 ± 0.03 0.93 ± 0.02

Finally, the OPLS-DA model for all pediatric patients (1 month-17 years old, n = 279) PICU-sepsis versus PED-sepsis, which was based on the multivariate biopattern (7 potential biomarkers), was created: R2Y = 0.53, Q2 = 0.52, and AUROC = 0.93 ± 0.02 (Table 3). The model was validated 3 times using 186 randomly selected pediatric samples as a training set and the remaining samples (n = 93) as a test set (Table 5). The mean of the predicted response values for PICU-sepsis samples in the test sets was 0.8 ± 0.2 and for PED-sepsis was 0.2 ± 0.1. The average sensitivity, specificity, accuracy and AUROC in these test sets were 0.83 ± 0.02, 0.88 ± 0.05, 0.85 ± 0.01 and 0.93 ± 0.02 respectively.

Table 5.

Validation results for the orthogonal partial least squares discriminant analysis model for differentiating sepsis requiring care in pediatric intensive care from sepsis cared for in the emergency department based on the multivariate biopattern in children age 1 month-17 years.

Validation Training set
(n = 186)
Test set
(n = 93)
Predicted response value ± standard deviation Sensitivity: Specificity Accuracy AUROC
± standard error
#1 PICU-sepsis n = 90 n = 50 0.78 ± 0.27 0.84:0.86 0.85 0.94 ± 0.02
PED-sepsis n = 96 n = 43 0.24 ± 0.21
#2 PICU-sepsis n = 93 n = 47 0.78 ± 0.34 0.85:0.85 0.85 0.92 ± 0.03
PED-sepsis n = 93 n = 46 0.21 ± 0.28
#3 PICU-sepsis n = 83 n = 57 0.74 ± 0.27 0.81:0.94 0.86 0.93 ± 0.03
PED-sepsis n = 103 n = 36 0.23 ± 0.22

AUROC: area under the receiver operating characteristic curve; PICU: pediatric intensive care unit; PED: emergency department.

Discussion

Sepsis remains a significant cause of morbidity and mortality for pediatric patients worldwide3,5,7, hence identifying improved diagnostic and prognostic tools remains a priority. Here we have utilized metabolomics and inflammatory protein-mediator profiling approaches to investigate whether these methods and/or their combination could be used for the diagnosis and triage of sepsis in infants. Through multivariate statistical analysis we were able to identify specific biopatterns in infants (1–23 months old) associated with early differentiation of PED-sepsis patients from PICU-sepsis patients requiring care in the PICU (Table 2). Moreover, by comparing and integrating the results with our previously published findings for older children we defined and validated potential biomarkers responsible for distinguishing a PICU-sepsis cohort from a PED-sepsis cohort for children 1 month-17 years old. We have identified 7 metabolites that can be described as a biopattern for triage of sepsis in children (Table 4).

Metabolomics examines the end result of interactions among the environment and gene expression on metabolism in the organism; as such, if levels of certain metabolites are either increased or decreased, this reflects modulation of the pathways involved in producing those metabolites. The pediatric sepsis triage model based on the 7 potential biomarkers and their concentration changes was submitted for topological metabolic pathway analysis in MetaboAnalyst 3.0 software26. This revealed a number of impacted metabolic pathways (Table 6) within PICU-sepsis and PED-sepsis cohorts: energy metabolism (e.g. pyruvate metabolism) and amino acid metabolism (e.g. alanine, aspartate and glutamate metabolism; valine, leucine and isoleucine degradation) were the most perturbed pathways. Adult studies have reported similar impacted metabolic pathways in sepsis, including amino acid metabolism, and mitochondrial energy metabolism27.

Table 6.

The list of impaired metabolic pathways differentiating sepsis requiring care in pediatric intensive care from sepsis cared for in the emergency department.

Metabolic pathway p-value Impact Total Hits
Pyruvate metabolism 3.7 × 10−22 0.1 32 Acetate
Alanine, aspartate and glutamate metabolism 3.6 × 10−12 0.06 24 Alanine
Sulfur metabolism 3.7 × 10−22 0.03 18 Acetate
Taurine and hypotaurine metabolism 2.2 × 10−37 0.03 20 Acetate, alanine
Fructose and mannose metabolism 2.2 × 10−4 0.03 48 Mannose
Selenoamino acid metabolism 2.2 × 10−37 0.003 22 Acetate, alanine

The p-value was calculated during the pathway enrichment analysis and was adjusted by Holm-Bonferroni method. The pathway Impact value was calculated from the pathway topology analysis as the sum of the importance measures of the matched metabolites normalized by the sum of the importance measures of all metabolites in each pathway. The Total is the total number of compounds in the pathway and the Hits show the actually matched metabolites detected as potentially important compounds in our study. The analysis was performed using the MetaboAnalyst 3.0 software22.

The elevated level of dimethylamine may indicate impairment in renal function as well as an excessive production of asymmetric dimethylarginine (ADMA) in sepsis28,29. Dimethylamine is created through the metabolism of ADMA which is an important regulator of the L-arginine/nitric oxide (NO) pathway30. ADMA acts as an endogenous inhibitor of NO synthase and is responsible for reduced NO availability, development of oxidative stress and dysfunction of the immune system response31. The increased concentrations of 3-methyl-2-oxovalerate and 3-hydroxyisovalerate point to organic acidemia, ketosis and disruption in branched-chain amino acid (BCAA) metabolism32,33. 3-Methyl-2-oxovalerate is a product of isoleucine degradation while 3-hydroxyisovalerate is created during leucine metabolism. Enhanced amino acid catabolism is a common event during the progression of sepsis as the body utilizes energy by increased protein breakdown and oxidation of BCAAs34. A high level of mannose suggests a reduction in aerobic glycolysis and the existence of a carbohydrate metabolic disorder in hepatic glycogen catabolism35,36. Alanine is an important energy source as it is a precursor of glucose in gluconeogenesis while acetate is one of the major components in TCA cycle and pyruvate metabolism25. Changes in the concentrations of mannose, alanine and acetate indicate altered requirements for energy in the PICU-sepsis patients when compared to the PED-sepsis cohort and probably provide a relative indicator of disease severity. A drop of the O-acetylcholine level suggests disruption in glycerophospholipid metabolism25. Moreover, O-acetylcholine is an important neurotransmitter which modifies the systemic inflammatory response37. These metabolic changes are similar to those in adults with severe sepsis, where increased amino acid catabolism, ketosis, altered TCA cycle and glucose metabolism, increased ADMA, and altered glycerophospholipid metabolism are reported27,3840. Altogether, these results identify particular early metabolic changes induced by severe sepsis (Table 6 and Supplementary Fig. 1) that could become important indicators for PED staff to initiate appropriate and rapid treatment, and optimize patient stratification.

Another important finding in our study is that the supervised statistical analysis performed on the inflammatory protein-mediator profiling dataset was less able to clearly distinguish between PICU-sepsis patients and PED-sepsis patients in children aged 1–23 months compared to the metabolic profiling (AUC 0.84 ± 0.04 versus 0.90 ± 0.03). This is similar to our previous finding in older children (AUC 0.88 ± 0.03 versus 0.96 ± 0.01)12. In both age cohorts the combined metabolic and protein-mediator profiling did not seem to improve prediction significantly from the metabolic model alone. The response to sepsis cannot be easily classified as pro- or anti-inflammatory, as many regulatory processes are activated in exceedingly complex ways. From the innumerable genomic, transcriptomic, and proteomic (including inflammatory protein-mediators) interacting cascades occurring, a metabolic footprint of the organism’s metabolism may be found. Thus, it is possible that inflammatory protein-mediator data is redundant as these mediators act, in the end, to alter the metabolome of the organism. Interestingly, when we compared the metabolite/inflammatory protein-mediator patterns obtained for the OPLS-DA models PICU-sepsis versus PED-sepsis for infants and older children, only seven metabolites, and none of the protein-mediators were common for both pediatric age groups (Supplementary Tables S4, S5, and Fig. S1). This may reflect the gradual maturation of the immune system during early infancy, with differing responses to infection from older children41. Alternatively, and more in keeping with our hypothesis about the power of metabolomics, the different specific protein-mediators and metabolites identified in the two age cohorts may simply reflect differences in timing of presentation during the cascades occurring, while the common metabolites reflect the end-result of those cascades.

Limitations of this study should be recognized. First, the study included a modest cohort of 122 patients age 2–23 months and 175 children age 2–17 years from two centers in Alberta, with a consent rate of 78%. Although this study is the largest involving metabolomics in children with sepsis, is multicenter involving the only two PICUs in the province serving a population of over 4 million, and had a high consent rate, further prospective validation in a larger multicenter cohort would strengthen the findings. Second, our internal validation methodology of training and test data sets also requires prospective validation in an independent cohort. Third, the cohort definitions relied on the clinical triage decision and not a more objective method. For example, we did not require measurements of organ dysfunction in the PED-sepsis cohort, and thus cannot determine how a more objective organ dysfunction score compares to or adds information to the biopattern classifications. It is likely that the PED-sepsis cohort would have had lower PELOD scores than the PICU-sepsis cohort. However, the decision of whether to measure these laboratory indices of organ dysfunction is itself subjective (often based on clinician level of worry about triage to a PICU), and our aim was to determine an objective biopattern that tracks these real-world decisions. Moreover, if not measured these indices are assumed to be normal in calculating the scores. Since the goal was to track the decision to triage to PICU, comparing these scores between PICU- and PED-sepsis patients would have involved circular reasoning. Similarly, we did not use an ED serious infection prediction rule or Pediatric Early Warning Score (PEWS) because most of these scores include, in addition to vital signs, subjective descriptions of the level of consciousness, capillary refilling, work of breathing, and clinician ‘worry’, overall ‘concern’, or ‘gut feeling’ about clinical status4246. This may be why evaluations of the existing serious infection prediction rules and PEWS have concluded that they have inadequate discriminant ability for filling the ‘diagnostic gap’ (i.e., predicting PICU admission or serious infections in the ED)4246. We found that the clinical decisions and the discovered biopatterns differentiated a PICU cohort that had high need for ventilation and vasoactive infusions and a prolonged PICU length of stay, from a PED cohort that did not require the specialized and costly care of a PICU. Differentiating these cohorts may be particularly useful in hospitals without specialized PEDs and PICUs, which include most hospitals where children present for care. Fourth, the exact timing of onset of sepsis in patients is unclear, and the duration prior to having blood drawn was likely different between PED-sepsis (drawn with initial labwork done in the PED) and PICU-sepsis cohorts (done once in PICU for 96%). It is possible that the PICU-sepsis cohort biopatterns reflect illness management in the PICU (e.g., ventilation, vasoactive medications, and other resuscitation), rather than predicting these needs. An ideal study design would have been to have the blood drawn from all patients in the PED, prior to the triage decision being made. Our pragmatic deferred consent model in the PICU-sepsis cohort that ensured the blood was drawn on the day of eligibility, within 24 hours of presentation, may mitigate this concern.

In conclusion, in children age 1–23 months, metabolic and protein-mediator profiling early in presentation can differentiate infants with sepsis requiring care in a PICU from infants with and without sepsis safely cared for outside of a PICU. In children age 1 month-17 years, a biopattern for sepsis triage consisting of 7 metabolites found early in patient presentation was internally validated using development and test sets of children in our cohorts. This biopattern mostly reflects altered energy metabolism in more severely affected children with sepsis. This discovery systems-biology based approach identified a limited number of metabolites-of-interest that may realistically lead to the development of a point-of-care sepsis triage decision aid, which may be particularly useful in ED without pediatric expertise. This finding requires prospective validation in an independent cohort, ideally with comparison to and/or addition to clinical prediction scores..

Electronic supplementary material

Supplementary Information (258.3KB, docx)

Acknowledgements

We thank the following for their help with this project: Josee Wong and the Critical Care Epidemiologic and Biologic Tissue Resource for specimen handling; Derrice Knight for her organizational skills as the Project Manager for the Alberta Sepsis Network; Mandy Tse and the Snyder Translational Laboratory in Critical Care Medicine for inflammatory protein-mediators analysis; and the pediatric research coordinators who managed consent, and data collection and entry. This study was supported by the Alberta Innovates – Health Solutions team grant to the Alberta Sepsis Network.

Author Contributions

B.M., G.C.T., J.B., C.N.J., B.W.W., H.J.V. and A.R.J. contributed to conception and design of the study, and revising the manuscript critically for intellectual content. B.M. and A.R.J. drafted the paper. B.M. and H.J.V. acquired metabolomics data. C.N.J. acquired inflammatory protein-mediators data. B.M. and H.J.V. performed statistical analysis and data interpretation. All authors had final approval of the version to be published, and agree to be accountable for all aspects of the work. A.R.J. had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Data Availability

The datasets generated and analyzed during the current study are available from the corresponding author on reasonable request.

Competing Interests

Drs Beata Mickiewicz, Brent W. Winston, and Hans J. Vogel hold a patent US 8969017: Metabolite biomarkers for diagnosis and prognosis of pediatric septic shock. The other authors declare no potential conflict of interest.

Footnotes

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Supplementary information accompanies this paper at 10.1038/s41598-018-35000-7.

References

  • 1.Singer M, et al. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3) JAMA. 2016;315:801–810. doi: 10.1001/jama.2016.0287. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Shankar-Hari M, et al. Developing a New Definition and Assessing New Clinical Criteria for Septic Shock: For the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3) JAMA. 2016;315:775–787. doi: 10.1001/jama.2016.0289. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.World Health Organization. Causes of child mortality, http://www.who.int/gho/child_health/mortality/causes/en/ (2016).
  • 4.Hartman ME, Linde-Zwirble WT, Angus DC, Watson RS. Trends in the epidemiology of pediatric severe sepsis. Pediatr Crit Care Med. 2013;14:686–693. doi: 10.1097/PCC.0b013e3182917fad. [DOI] [PubMed] [Google Scholar]
  • 5.Randolph AG, McCulloh RJ. Pediatric sepsis: important considerations for diagnosing and managing severe infections in infants, children, and adolescents. Virulence. 2014;5:179–189. doi: 10.4161/viru.27045. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Gaines NN, Patel B, Williams EA, Cruz AT. Etiologies of septic shock in a pediatric emergency department population. Pediatr Infect Dis J. 2012;31:1203–5. doi: 10.1097/INF.0b013e3182678ca9. [DOI] [PubMed] [Google Scholar]
  • 7.Dellinger RP, et al. Surviving sepsis campaign: international guidelines for management of severe sepsis and septic shock: 2012. Crit Care Med. 2013;41:580–637. doi: 10.1097/CCM.0b013e31827e83af. [DOI] [PubMed] [Google Scholar]
  • 8.Weiss SL, et al. Delayed antimicrobial therapy increases mortality and organ dysfunction duration in pediatric sepsis. Crit Care Med. 2014;42:2409–2417. doi: 10.1097/CCM.0000000000000509. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Fischer JE. Physicians’ ability to diagnose sepsis in newborns and critically ill children. Pediatr Crit Care Med. 2005;6:S120–5. doi: 10.1097/01.PCC.0000161583.34305.A0. [DOI] [PubMed] [Google Scholar]
  • 10.Committee on the Future of Emergency Care in the United States Health System. Emergency Care for Children: Growing Pains. www.nap.edu (2007).
  • 11.Emergency departments and children in Ontario, Canadian Institute for Health Information (CIHI), 2008, https://secure.cihi.ca/free_products/aib_apr24_08_en.pdf (2008).
  • 12.Mickiewicz B, et al. Development of metabolic and inflammatory mediator biomarker phenotyping for early diagnosis and triage of pediatric sepsis. Crit Care. 2015;19:320. doi: 10.1186/s13054-015-1026-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Mickiewicz B, Vogel HJ, Wong HR, Winston BW. Metabolomics as a novel approach for early diagnosis of pediatric septic shock and its mortality. Am J Respir Crit Care Med. 2013;187:967–976. doi: 10.1164/rccm.201209-1726OC. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Mickiewicz B, et al. Metabolic profiling of serum samples by 1H nuclear magnetic resonance spectroscopy as a potential diagnostic approach for septic shock. Crit Care Med. 2014;42:1140–9. doi: 10.1097/CCM.0000000000000142. [DOI] [PubMed] [Google Scholar]
  • 15.Weljie AM, Newton J, Mercier P, Carlson E, Slupsky CM. Targeted profiling: quantitative analysis of 1H NMR metabolomics data. Anal Chem. 2006;78:4430–4442. doi: 10.1021/ac060209g. [DOI] [PubMed] [Google Scholar]
  • 16.Mickiewicz B, et al. Integration of metabolic and inflammatory mediator profiles as a potential prognostic approach for septic shock in the intensive care unit. Crit Care. 2015;19:11. doi: 10.1186/s13054-014-0729-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Eriksson L, Trygg J, Wold S. CV-ANOVA for significance testing of PLS and OPLS models. J Chemom. 2008;22:594–600. doi: 10.1002/cem.1187. [DOI] [Google Scholar]
  • 18.Eriksson, L. et al. Multi- and Megavariate Data Analysis Part I: Basic Principles and Applications (ed. Eriksson, L. et al.) (Umeå, Sweden: Umetrics AB, 2006).
  • 19.Picard RR, Cook DR. Cross-Validation of Regression Models. J Am Statl Assoc. 1984;79:575–583. doi: 10.1080/01621459.1984.10478083. [DOI] [Google Scholar]
  • 20.Trygg J, Holmes E, Lundstedt T. Chemometrics in metabonomics. J Proteome Res. 2007;6:469–479. doi: 10.1021/pr060594q. [DOI] [PubMed] [Google Scholar]
  • 21.Metz CE. Basic principles of ROC analysis. Semin Nucl Med. 1978;8:283–298. doi: 10.1016/S0001-2998(78)80014-2. [DOI] [PubMed] [Google Scholar]
  • 22.Van Paridon BM, Sheppard C, Garcia Guerra G, Joffe AR, Alberta Sepsis Network Timing of antibiotics, volume, and vasoactive infusions in children with sepsis admitted to intensive care. Crit Care. 2015;19:293. doi: 10.1186/s13054-015-1010-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Choong K, et al. Vasopressin in pediatric vasodilatory shock: a multicenter randomized controlled trial. Am J Respir Crit Care Med. 2009;180:632–9. doi: 10.1164/rccm.200902-0221OC. [DOI] [PubMed] [Google Scholar]
  • 24.Menon K, et al. A prospective multicenter study of adrenal function in critically ill children. Am J Respir Crit Care Med. 2010;182:246–251. doi: 10.1164/rccm.200911-1738OC. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Wishart DS, et al. HMDB 3.0–The Human Metabolome Database in 2013. Nucleic Acids Res. 2013;41:D801–7. doi: 10.1093/nar/gks1065. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Xia J, Sinelnikov IV, Han B, Wishart DS. MetaboAnalyst 3.0–making metabolomics more meaningful. Nucleic Acids Res. 2015;43:W251–7. doi: 10.1093/nar/gkv380. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Eckerle M, et al. Metabolomics as a driver in advancing precision medicine in sepsis. Pharmacotherapy. 2017;37(9):1023–1032. doi: 10.1002/phar.1974. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Wills MR, Savory J. Biochemistry of renal failure. Ann Clin Lab Sci. 1981;11:292–9. [PubMed] [Google Scholar]
  • 29.O’Dwyer MJ, et al. Septic shock is correlated with asymmetrical dimethyl arginine levels, which may be influenced by a polymorphism in the dimethylarginine dimethylaminohydrolase II gene: a prospective observational study. Crit Care. 2006;10:R139. doi: 10.1186/cc5053. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Teerlink T. ADMA metabolism and clearance. Vasc Med. 2005;10(Suppl 1):S73–81. doi: 10.1177/1358836X0501000111. [DOI] [PubMed] [Google Scholar]
  • 31.Vallance P, Leone A, Calver A, Collier J, Moncada S. Accumulation of an endogenous inhibitor of nitric oxide synthesis in chronic renal failure. Lancet. 1992;339:572–5. doi: 10.1016/0140-6736(92)90865-Z. [DOI] [PubMed] [Google Scholar]
  • 32.Vockley, J., Zschocke, J., Knerr, I., Vockley, C. W. & Gibson, K. M. Branched Chain Organic Acidurias. In The Online Metabolic and Molecular Bases of Inherited Disease (eds Valle, D., Beaudet, A., Vogelstein, B. & Kinzler, K.W.) (New York, NY, USA: McGraw-Hill, 2012).
  • 33.Hoffmann, G. F., Zschocke, J. & Nyhan, W. L. Inherited MetabolicDiseases: A Clinical Approach. (1st edition, Springer Science & Business Media, 2009).
  • 34.Karnovsky A, et al. Metscape 2 bioinformatics tool for the analysis and visualization of metabolomics and gene expression data. Bioinformatics. 2012;28:373–380. doi: 10.1093/bioinformatics/btr661. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Sharma V, Ichikawa M, Freeze HH. Mannose metabolism: more than meets the eye. Biochem Biophys Res Commun. 2014;453:220–8. doi: 10.1016/j.bbrc.2014.06.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Taguchi T, et al. Hepatic glycogen breakdown is implicated in the maintenance of plasma mannose concentration. Am J Physiol Endocrinol Metab. 2005;288:E534–540. doi: 10.1152/ajpendo.00451.2004. [DOI] [PubMed] [Google Scholar]
  • 37.Borovikova LV, et al. Vagus nerve stimulation attenuates the systemic inflammatory response to endotoxin. Nature. 2000;405:458–462. doi: 10.1038/35013070. [DOI] [PubMed] [Google Scholar]
  • 38.Tesfai A, et al. Metabolomic profiling of amines in sepsis predicts changes in NOS canonical pathways. Plos One. 2017;12(8):e0183025. doi: 10.1371/journal.pone.0183025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.To KKW, et al. Lipid mediators of inflammation as novel plasma biomarkers to identify patients with bacteremia. Journal of Infection. 2015;70:433–444. doi: 10.1016/j.jinf.2015.02.011. [DOI] [PubMed] [Google Scholar]
  • 40.Neugebauer S, et al. Metabolite profiles in sepsis: developing prognostic tools based on the type of infection. Crit Care Med. 2016;44:1649–1662. doi: 10.1097/CCM.0000000000001740. [DOI] [PubMed] [Google Scholar]
  • 41.Ygberg S, Nilsson A. The developing immune system - from foetus to toddler. Acta Paediatr. 2012;101:120–7. doi: 10.1111/j.1651-2227.2011.02494.x. [DOI] [PubMed] [Google Scholar]
  • 42.Seiger N, Maconochie I, Oostenbrink R, Moll HA. Validity of different pediatric early warning scores in the emergency department. Pediatrics. 2013;132:e841–850. doi: 10.1542/peds.2012-3594. [DOI] [PubMed] [Google Scholar]
  • 43.Gold DL, Mihalov LK, Cohen DM. Evaluating the Pediatric Early Warning Score (PEWS) system for admitted patients in the pediatric emergency department. Acad Emerg Med. 2014;21:1249–1256. doi: 10.1111/acem.12514. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Breslin K, Marx J, Hoffman H, McBeth R, Pavuluri P. Pediatric Early Warning Score at time of emergency department disposition is associated with level of care. Pediatr Emer Care. 2014;30:97–103. doi: 10.1097/PEC.0000000000000063. [DOI] [PubMed] [Google Scholar]
  • 45.Bradman K, Borland M, Pascoe E. Predicting patient disposition in a paediatric emergency department. J Paediatr Child Health. 2014;50:E39–44. doi: 10.1111/jpc.12011. [DOI] [PubMed] [Google Scholar]
  • 46.Thompson M, et al. Systematic review and validation of prediction rules for identifying children with serious infections in emergency departments and urgent-access primary care. Health Technol Assess. 2012;16(15):1–100. doi: 10.3310/hta16150. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Information (258.3KB, docx)

Data Availability Statement

The datasets generated and analyzed during the current study are available from the corresponding author on reasonable request.


Articles from Scientific Reports are provided here courtesy of Nature Publishing Group

RESOURCES