Skip to main content
BMC Emergency Medicine logoLink to BMC Emergency Medicine
. 2021 Jun 13;21:70. doi: 10.1186/s12873-021-00461-z

Predicting mortality in adult patients with sepsis in the emergency department by using combinations of biomarkers and clinical scoring systems: a systematic review

Kirby Tong-Minh 1,, Iris Welten 1, Henrik Endeman 2, Tjebbe Hagenaars 1, Christian Ramakers 3, Diederik Gommers 2, Eric van Gorp 4,5, Yuri van der Does 1
PMCID: PMC8201689  PMID: 34120605

Abstract

Background

Sepsis can be detected in an early stage in the emergency department (ED) by biomarkers and clinical scoring systems. A combination of multiple biomarkers or biomarker with clinical scoring system might result in a higher predictive value on mortality. The goal of this systematic review is to evaluate the available literature on combinations of biomarkers and clinical scoring systems on 1-month mortality in patients with sepsis in the ED.

Methods

We performed a systematic search using MEDLINE, EMBASE and Google Scholar. Articles were included if they evaluated at least one biomarker combined with another biomarker or clinical scoring system and reported the prognostic accuracy on 28 or 30 day mortality by area under the curve (AUC) in patients with sepsis. We did not define biomarker cut-off values in advance.

Results

We included 18 articles in which a total of 35 combinations of biomarkers and clinical scoring systems were studied, of which 33 unique combinations. In total, seven different clinical scoring systems and 21 different biomarkers were investigated. The combination of procalcitonin (PCT), lactate, interleukin-6 (IL-6) and Simplified Acute Physiology Score-2 (SAPS-2) resulted in the highest AUC on 1-month mortality.

Conclusion

The studies we found in this systematic review were too heterogeneous to conclude that a certain combination it should be used in the ED to predict 1-month mortality in patients with sepsis. Future studies should focus on clinical scoring systems which require a limited amount of clinical parameters, such as the qSOFA score in combination with a biomarker that is already routinely available in the ED.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12873-021-00461-z.

Keywords: Sepsis, Biomarkers, Emergency department, Prediction model

Background

Sepsis is a life threatening condition, and is the leading cause of in-hospital mortality in Europe [1]. Early detection of sepsis is essential to timely start appropriate treatment [2, 3]. Early stage sepsis, in patients with a suspected infection, is often undiagnosed, causing a delay in treatment and increased mortality [4, 5]. The emergency department (ED) is often the first setting during hospital stay where patients with a suspected infection are systematically evaluated, where early stages of sepsis can be detected. However, there is a limited timeframe in the ED in which decisions about treatment and patient disposition must be made. Identifying patients in the ED with a high risk of mortality is important, not only to start antibiotic treatment early, but also to decide if patients require admission, high level care and monitoring.

Multiple organ systems and pathways are involved in the pathophysiology of sepsis [6]. After a microorganism infects the body, multiple immune responses are activated [7]. Different immune cells are activated, which express a series of membrane receptors, endothelial and tissue factors are released, and the complement system is activated [8]. In sepsis, this immune response is dysregulated and excessive, ultimately resulting in multi-organ failure [9]. This response involves dysregulation by both hyperinflammation and immune suppression [10, 11]. In these different stages of sepsis, different cytokines, peptides and other signaling molecules are elevated and can be detected in the bloodstream as biomarkers.

Clinical scoring systems, which are often used to detect sepsis, rely on vital parameters. Clinical scoring systems should require only a limited amount of clinical parameters to be useful in the ED to rapidly assess the severity of disease. Different clinical scoring systems have been validated for use in the ED, including the Quick Sequential Organ Failure Assessment (qSOFA) [9], the Mortality in Emergency Department Sepsis (MEDS) [12] score and National Early Warning Score (NEWS) [13]. (Supplemental Table 1) These clinical scoring systems mostly rely on the use of abnormal vital parameters. However, when vital parameters are abnormal, the patient might already be in an advanced stage of sepsis. Using biomarkers to detect sepsis, early stages of sepsis could be detected before vital signs turn abnormal. Adding biomarkers to clinical scoring systems might therefore improve these clinical scoring systems. A large variety of biomarkers in patients with sepsis have been studied. Pierrakos et al. reviewed the literature on biomarkers in sepsis in 2010 and in 2020 and found that there are over 100 different biomarkers studied, of which none have made it to clinical practice except C-reactive protein (CRP) and procalcitonin (PCT) [14, 15]. Even 10 years after their initial study, no specific other biomarker was identified as “most promising” biomarker [15]. The authors concluded that a combination of several biomarkers may be more effective. Several studies support this claim and show that combining biomarkers with clinical scoring systems or combining multiple biomarkers result in a more accurate prediction of mortality in patients with infectious diseases in the ED. [16, 17]

With the large number of biomarkers already studied, the potential number of combinations of biomarkers and clinical scoring systems is even greater.

The goal of this review is to systematically assess the available literature on combinations of biomarkers and clinical scorings systems in patients with sepsis in the ED to predict 1-month mortality.

Methods

We conducted this systematic review and reported this following the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines [18]. The study was registered on PROSPERO, the register for systematic reviews under reference number 165580.

Literature search

We performed a systematic search of literature by an information specialist using MEDLINE, EMBASE and Google Scholar. The search included articles in English published up to June 2020. We started with a broad search using both infectious diseases and sepsis in the initial search in combination with biomarkers and ED. The full search strategy can be found in the Appendix.

Outcome definitions

Biomarkers were considered as any laboratory blood test performed in the ED. A clinical scoring system was defined as any scoring system using a combination of patient characteristic with or without laboratory testing used for prognostic purpose. We did not use a single definition of sepsis in this review. Sepsis criteria changed multiple times in the previous decades and we did not want to miss any potential useful article in our initial search strategy We used 1-month mortality as outcome, which was defined as either 28 or 30-day mortality.

Study selection

After the initial search, two reviewers independently screened the studies by title and abstract from each other. The results were compared and discrepancies were resolved by discussion. If no consensus was achieved, a third reviewer acted as referee. The remaining studies were screened on inclusion and exclusion criteria using the full text (Fig. 1).

Fig. 1.

Fig. 1

Flow chart of included articles

Selection criteria

During title and abstract screening, articles were included if they evaluated at least one biomarker or clinical scoring system in any infectious disease. During full text screening, articles were included if they evaluated at least one biomarker combined with another biomarker or clinical scoring system and reported the prognostic accuracy on 28 or 30 day mortality by AUC in patients with sepsis. Other measurements of the studied prediction models were recorded, such as sensitivity, specificity and Hosmer-Lemeshow test statistic, if they were reported by the authors. However, articles were not excluded if these values were missing.

Studies in children and studies of which the full text was not available in English were excluded.

Data collection and quality assessment

Data was extracted in a predefined spreadsheet, which included the biomarkers and clinical scoring system used, AUC of the combination of biomarkers and clinical scoring system, age, inclusion and exclusion criteria and moment of blood collection. The quality of each study was assessed using Prediction model Risk Of Bias ASsessment Tool (PROBAST) [19]. This risk of bias was assessed and reported during the PROBAST assessment.

Results

We found 5826 articles after conducting our search in PubMed, EMBASE, Medline Ovid, Web of Science, Cochrane Central and Google Scholar. After removal of duplicates, 3771 articles remained. These articles were screened on title and abstract, after which 83 articles were included for full text screening. After full text screening, 65 articles were excluded. This resulted in 18 articles included for final data synthesis. (Fig. 1).

In the 18 articles that were included in this systematic review, a total of 35 combinations of biomarkers and clinical scoring systems were studied of which 33 unique combinations. In total, seven different clinical scoring systems and 21 different biomarkers were investigated. (Table 1).

Table 1.

Overview of included studies

Author, year Sepsis criterion Number of patients Number of deaths Biomarker 1 Biomarker 2 Biomarker 3 Clinical score 1 Clinical score 2 AUC Hosmer-Lemeshow Sensitivity Specificity PPV NPV
Yu, 2019 [20] Signs of systemic infection 1318 178 PCT qSOFA 0.73
CRP qSOFA 0.69
Yamamoto, 2015 [21] Blood cultures drawn as surrogate marker of suspected sepsis 1262 106 CRP CURB65 0.77 0.607
Liu, 2013 [22] Sepsis-2 859 Unknown Presepsin MEDS 0.731
Presepsin APACHE-2 0.734
Zhang, 2014 [23] Sepsis-2 680 137 Copeptin MEDS 0.851
Cortisol MEDS 0.833
PCT Cortisol Copeptin MEDS 0.891
Chen, 2014 [24] Sepsis-2 680 178 Lactate MEDS 0.81
Lactate APACHE-2 0.81
Lactate SOFA 0.82
Yin, 2013 [25] Sepsis-2 680 225 sTM MEDS 0.805 74.2 71.9 56.6 84.9
Zhao, 2018 [26] Sepsis-2 655 126 PCT sPD-1 MEDS 0.843 0.824 81.6 83.4 71.7 89.8
PCT MEDS 0.792 0.631
sPD-1 MEDS 0.829 0.892
Niño, 2017 [27] Sepsis-2 563 68 TIMP1 MMP9 CHARLSON SOFA 0.838 0.2449
Zhao, 2013 [28] Sepsis-2 501 134 PCT MEDS 0.813 67.2 81.2 56.6 87.1
Zhang, 2016 [29] Sepsis-2 480 183 IgE APACHE-2 0.8
IgE SOFA 0.781
IgE MEDS 0.89
Wang, 2014 [30] Sepsis-2 480 137 NGAL MEDS 0.858
TIMP-1 MEDS 0.882
PCT MEDS 0.782
Henning, 2019 [31] Sepsis-2 314 31 Angiopoientin-2 IL-6 0.72
Chen, 2014 [32] Sepsis-2 295 78 H-FABP MEDS 0.853
H-FABP APACHE-2 0.826
Troponine-I APACHE-2 0.811
Troponine-I MEDS 0.825
Duplessis, 2018 [33] Sepsis-2 203 13 Nucleosomes APACHE-2 0.84
Cell free DNA APACHE-2 0.81
Kofoed, 2008 [34] Sepsis-2 161 9 suPAR sTREM-1 SAPS-2 0.89
suPAR SAPS-2 0.93
Viallon, 2008 [35] Sepsis-2 131 23 PCT IL-6 Lactate SAPS-2 0.939
Carpio, 2015 [36] Sepsis-2 114 48 Presepsin MEDS 0.878
Song, 2019 [37] Sepsis-3 113 13 IL-6 PTX3 0.637 82.7 71.1

Scoring systems. qSOFA quick Sequential Organ Failure Assessment, MEDS Mortality in Emergency Department Sepsis, APACHE-2 Acute Physiologic Assessment and Chronic Health Evaluation II, SOFA Sequential Organ Failure Assessment, SAPS-2 Simplified Acute Physiology Score 2

PCT Procalcitonin, CRP C-reactive protein, sTM soluble thrombomodulin, sPD-1 soluble programmed death 1, TIMP-1 Tissue inhibitor of metalloproteinase-1, MMP9 Matrix metallopeptidase 9, NGAL Neutrophil gelatinase-associated lipocalin, IL-6 interleukin-6, H-FABT heart fatty acid binding protein, suPAR soluble urokinase-type plasminogen activator receptor, PTX3 Pentraxin 3

The Mortality in Emergency Department Sepsis (MEDS) score was the most used clinical scoring system, which was studied in 9 articles. The second most commonly used scoring system was the Acute Physiology and Chronic Health Evaluation II (APACHE II) score, which was studied in 6 articles. The most commonly studied biomarker was PCT, which was studied in 7 articles. The combination of PCT with the MEDS score was the most studied combination of biomarker and clinical score and was studied in 3 different articles. There were no other combinations of biomarkers that were used by more than a single article.

The number of patients included in the studies ranged from 114 to 1318. The AUC of the combinations of biomarkers and clinical scoring systems ranged from 0.637 to 0.939. The highest AUC was achieved by the combination of Simplified Acute Physiology Score (SAPS II), PCT, lactate and interleukine-6 (IL-6), which yielded an AUC of 0.939 by Viallon et al. [35], followed by the combination of SAPS-2 and soluble urokinase-type plasminogen activator receptor (suPAR) with an AUC 0.930 by Kofoed et al. [34]

Different inclusion criteria were used to classify patients as having sepsis. The most common criteria used were two SIRS criteria in combination with an infection, used by eight articles [25, 28, 3136]. The second most used inclusion criterion was the 2001 International Sepsis Definitions [38], which was used by seven articles [2224, 27, 29, 30, 32]. One article used the sampling of blood cultures as inclusion criterion [21]. One article included patients with symptoms of systemic infection in which PCT or blood cultures were taken within 24 h of admission [20]. One article used the Sepsis-3 definition [9] as inclusion criterion [37].

Eight studies reported other characteristics of the studied prediction models besides the AUC. The Hosmer-Lemeshow statistic was reported in five studies and ranged from 0.245 to 0.892. Four studies reported sensitivity, specificity, negative predictive value or positive predictive value and preselected cut-off values.

PROBAST quality assessment

The quality assessment using the PROBAST criteria can be found in Table 2 and the extended checklist with the signaling questions used in Supplemental Table 2 and 3. The majority of the studies were at risk of bias: 12 out of 18 studies [22, 23, 2528, 30, 31, 3337] scored high at any of the items of the PROBAST checklist.

Table 2.

PROBAST assessment

Author, year Domain 1: participants DOMAIN 2: Predictors DOMAIN 3: Outcome DOMAIN 4: Analysis Overal risk of bias
Yu, 2019 Low Low Low Low Low
Yamamoto, 2015 Low Low Low Low Low
Liu, 2013 Low Low Low High High
Zhang, 2014 Low Low Low High High
Chen, 2014 Low Low Low Low Low
Yin, 2013 Low Low Low High High
Zhao, 2018 High Low Low Low High
Niño, 2017 Low Low Low High High
Zhao, 2013 High Low Low Low High
Zhang, 2016 Low Low Low Low Low
Wang, 2014 Low Low Low High High
Henning, 2019 Low Low Low High High
Chen, 2019 Low Low Low Low Low
Duplessis, 2018 Low Low Low High High
Kofoed, 2008 Low Low Low High High
Viallon, 2008 Low Low Low High High
Carpio, 2015 Low Low Low High High
Song, 2019 Low Low Low High High

One study [26] was at risk of bias in the participant domain due to multiple exclusion criteria, leading to only a selected group of patients with sepsis enrolled in the study. There was no risk of bias in any of the studies in the domains predictors and outcome. In the domain analysis, 11 studies were considered at high risk of bias [22, 23, 25, 27, 28, 30, 31, 3337]. The number of fatal cases was low in seven studies, leading to risk of overfitting of the studied prediction model [30, 31, 3337]. Eleven studies did not report any missing data or did not report how missing data was handled [22, 23, 25, 27, 29, 30, 32, 3437]. These items were not scored as high risk of bias, because all enrolled patients were included in the final analysis.

Discussion

Biomarkers and clinical scoring systems help physicians to detect sepsis in an early stage in the ED. In this systematic review we investigated the combinations of both biomarkers and clinical scoring systems with biomarkers to predict 1-month mortality in patients with sepsis. We found 18 different studies in which 33 combinations of biomarkers and clinical scoring system were investigated. The combination of PCT, lactate, IL-6 and SAPS-2 resulted in the highest AUC on 1-month mortality [35]. Despite the high AUC found in this study, this specific combination has not been adopted in the latest guidelines for surviving sepsis [2]. The SAPS-2 score is a clinical scoring system, using four vital parameters, seven laboratory tests and four other patient characteristics and was originally developed for patients in the ICU or general wards to predict in-hospital mortality. Combining this clinical scoring system with another three biomarkers results in a total of 18 variables used to predict 30-day mortality in this study. This large amount of data needed for this combination results in only limited usefulness for clinical practice. Furthermore, this study enrolled 131 subjects, of which 23 died. Therefore, the high AUC found in this study may possibly be due to overfitting by using too many predictors in the multivariate logistic regression analysis [39, 40].

To introduce a new combination of biomarkers and clinical scoring system to clinical practice, the biomarker should be available as routine test in the clinical laboratory and available together with the standard laboratory tests. Furthermore, the clinical scoring system should require only a limited amount of variables, because of the limited timeframe in which patients stay in the ED. In our study, only a limited amount of articles met those criteria. Many articles investigated experimental biomarkers such as NGAL, cell free DNA or sPD-1, making these combinations less feasible for clinical practice. Following these criteria, only a few articles we found would qualify for potential use in clinical practice. Yamamoto et al. combined the CURB-65 score with CRP. CURB-65 was originally developed for disposition decisions in patients with pneumonia, but was in this study used in suspected sepsis patients. This resulted in an AUC of 0.77 on 1-month mortality. However, the authors concluded that adding CRP to the CURB-65 only had limited clinical value, because the CURB-65 score alone showed a similar predictive value. Yu et al. investigated the combination of PCT and the qSOFA and showed that adding PCT improved the performance of the qSOFA score. This was the only study using the most recent Sepsis-3 criteria and incorporating the qSOFA score. The qSOFA score is validated for early detection of adverse outcomes in patients with infectious diseases and requires only 3 vital parameters. Combining it with PCT, a biomarker that is already available as routine measurement in many ED, makes this combination practical to use in the ED.

We found four studies using PCT combined with another biomarker or clinical scoring system. PCT has been studied as biomarker for bacterial infections and disease severity in infectious diseases. PCT is the precursor of calcitonin and physiologically produced by thyroid cells. In bacterial infections it is also synthesized outside of the thyroid, and rises rapidly in systemic infections. It is often referred to as the biomarker with most potential of replacing or substituting CRP [41]. However, PCT has yet to establish a role in routine care in the ED. [42] Combining PCT with other biomarkers or clinical scoring systems, we found an increase in predictive value on 30-day mortality. From all available sepsis biomarkers, PCT is probably the most well-known among physicians in the ED. Combining PCT with clinical scoring systems, as done in many studies, might therefore be the key in being adopted as part of regular care.

Lactate is a product of anaerobic glycolysis and is often elevated in patients with sepsis. It has been adopted as criterion for septic shock in the Sepsis-3 definitions [9]. We found two studies using lactate in combination with other biomarkers or clinical scoring system, both with a high predictive value on 1-month mortality [32, 35]. Unlike many novel biomarkers, lactate is widely available as a standard measurement during the workup in the ED. Therefore, lactate is an important biomarker in assessing the severity of sepsis in the ED. IL-6 is an inflammatory cytokine and plays an important role in the early phase of sepsis [43]. However, the prognostic values of IL-6 are controversial due to the short window in which IL-6 rises and falls during inflammation and infection [44].

The SAPS-2 score was also used in combination with suPAR by Kofoed et al. [34], resulting in an AUC of 0.930, which was the second highest AUC we found in our study. These findings suggest that the SAPS-2 is a clinical scoring system with a high prognostic accuracy on 30-day mortality, although it has not been validated for assessing severity of disease in the ED. However, the limitation of an overfitted prediction model in a relatively small cohort is also present in the study of Kofoed et al., with only 161 patients enrolled of which 9 patients died. suPAR is a biomarker which has been investigated as general disease severity biomarker, mostly in the ED. A large study showed that suPAR is an accurate predictor of mortality, but does not influence disposition or clinical outcome when it was used in the ED. [45] In a meta-analysis, suPAR showed similar results as PCT in diagnosing sepsis [46].

The MEDS score was the most used clinical scoring system used in combination with biomarkers. The MEDS score is a risk prediction score specifically for patients with suspected sepsis in the ED. [12] It consists of nine items which can easily be scored in the ED setting and results in a total score, categorized in 5 groups, which corresponds to a certain mortality risk. The AUC of the MEDS score combined with different biomarkers ranged from 0.731 to 0.891, indicating a moderate to good predictive value on 30-day mortality. Other clinical scoring systems we found in combination with biomarkers were the APACHE-2 and SAPS-2 score. These clinical scoring systems are mainly developed for use in the ICU and general wards. Despite being accurate predictors of disease severity, these clinical scoring systems may be less feasible for use in the ED, due to their complexity and large number of clinical parameters needed. In a prospective study comparing different clinical scoring systems individually in the ED, the MEDS score resulted in an AUC of 0.94 on 30-day mortality, which was higher than the SOFA or PIRO score [47]. However, another study which also compares different clinical scoring systems concluded that the APACHE-2 score is superior to the MEDS and SOFA score [48].

Three studies investigated biomarkers which are otherwise known as hormones and other functional circulating peptides, including IgE, cortisol, cell free DNA and nucleosomes [23, 29, 33]. Zhang et al. [29] studied IgE in combination with the MEDS score and found that adding IgE to the MEDS score resulted in a higher AUC than the MEDS score alone. This study emphasizes the multifactorial entity of sepsis, hypothesizing that IgE either plays a role in general immune activation during sepsis or is a marker of cytokine regulation/dysregulation. Another study by Zhang et al. [23] investigated hormones and biomarkers from the hypothalamic–pituitary–adrenal axis and showed that cortisol and copeptin are associated with 30-day mortality and that combining these biomarkers with the MEDS score resulted in added value over using each biomarker individually. Cortisol has been identified as essential hormone in the immune response in sepsis and elevated levels of cortisol are associated with severity of sepsis [49]. Extracellular cell free DNA and nucleosomes, basic units of DNA packaging, reflect cellular apoptosis and are therefore tested as predictors of severity of sepsis in the study of Duplessis et al. [33] In this study the authors show that adding nucleosomes to the APACHE-2 score improved the AUC on predicting mortality. Adding cell free DNA to the APACHE-2 score did not result in a better predictive value. These studies emphasize that biomarkers originating from different pathways in sepsis can be used as predictor of disease severity.

Limitations

Our study has several limitations. We acknowledge that there are many studies available in a similar setting and research field, which were not included in this review because these articles did not exactly match our inclusion criteria. We included articles that investigated the predictive value of biomarkers combined with clinical scoring systems on disease severity in sepsis. We used 1-month mortality as endpoint for severity of sepsis as this is the most commonly used endpoint in these kind of studies. However, there are many more biomarkers that have been investigated using other endpoints as marker of disease severity of sepsis. These endpoints to define severity of sepsis range from ICU admission to long term mortality. Despite the fact that these endpoints also are a surrogate marker of disease severity, these articles were not included because a comparison of these endpoints would not be possible.

The definition of sepsis has changed over time, which is also reflected by the different inclusion criteria used by the studies we found. Most studies used the sepsis criteria as defined in 2001 [38], and only a few studies used the latest Sepsis-3 criteria [9]. The majority of the studies we analyzed in this systematic review were published before 2016 and do not use the latest sepsis criteria. However, even after 2016, multiple studies still used the old sepsis criteria. These studies may have been designed and conducted before 2016, but this also emphasizes that it takes much time before new criteria are adopted in clinical practice.

All but three studies did not use predefined cut-off values for the biomarkers. This makes translating these results to clinical practice challenging. Using a predefined cutoff, categorizing the biomarker or clinical scoring system in a high or low risk category, is preferred when using such a system in practice.

In the PROBAST quality assessment, we considered the majority of included studies of high risk of bias. This was mainly due to the high risk of overfitting. The study population size of the included studies ranged from 114 to 1318. When there are less than 10 fatal cases per predictor, the risk of overfitting of prediction models is high, resulting in an unrealistically high AUC [40]. When also including clinical scoring systems, this problem is even bigger, since the clinical scoring system already consists of multiple predictors. The findings of our study can therefore not directly be translated into clinical practice and need to be validated in larger and external cohorts.

Conducting a meta-analysis to compare the outcomes of different studies would be preferred, but was not feasible. The variety in biomarkers and clinical scoring systems used was too large to compare one to another. We selected the use of an AUC as indicator of performance of the prediction models as inclusion criterion. Only a limited number of studies reported other qualities such as Hosmer-Lemshow statistic. Furthermore, the disease severity may have differed between the different studies at time of presentation at the ED. We did not systematically collect data on triage scores nor exact time or moment of biomarker measurement in the ED, because these details are often not reported. This would further limit comparison between different prediction models.

Conclusion

The studies we found in this systematic review were too heterogeneous to conclude that a certain combination it should be used in the ED to predict 1-month mortality in patients with sepsis. The combination of PCT, IL-6, lactate and the SAPS-2 score had the highest AUC on 1-month mortality in patients with sepsis in the ED, but this finding may be overfitted and requires external validation. Future studies should focus on clinical scoring systems which require a limited amount of clinical parameters, such as the qSOFA score in combination with a biomarker that is already routinely available in the ED.

Supplementary Information

12873_2021_461_MOESM1_ESM.docx (40.2KB, docx)

Additional file 1: Supplemental Table 1: overview of commonly used clinical scoring systems for mortality prediction. Supplemental table 2: Extended PROBAST checklist. Supplemental table 3: Signaling questions used in PROBAST checklist.

Acknowledgements

The authors wish to thank Wichor Bramer and Sabrina Meertens-Gunput from the Erasmus MC Medical Library for developing and updating the search strategies.

Abbreviations

APACHE-2

Acute Physiologic Assessment and Chronic Health Evaluation II

SOFA

Sequential Organ Failure Assessment

AUC

Area under the curve

CRP

C-reactive protein

ED

Emergency department

H-FABT

Heart fatty acid binding protein

IL-6

Interleukin-6

MEDS

Mortality in Emergency Department Sepsis

MMP9

Matrix metallopeptidase 9

NEWS

National Early Warning Score

NGAL

Neutrophil gelatinase-associated lipocalin

PCT

Procalcitonin

PRISMA

Preferred Reporting Items for Systematic Reviews and Meta-analyses

PROBAST

Prediction model Risk Of Bias Assessment Tool

PTX3

Pentraxin 3

qSOFA

Quick Sequential Organ Failure Assessment

SAPS-2

Simplified Acute Physiology Score 2

sPD-1

Soluble programmed death 1

sTM

Soluble thrombomodulin

suPAR

Soluble urokinase-type plasminogen activator receptor

TIMP-1

Tissue inhibitor of metalloproteinase-1

Appendix A

Complete search strategy.

embase.com

(‘sepsis’/exp. OR ‘infection’/exp. OR pneumonia/exp. OR (sepsis OR septic* OR Bacteremia OR Bacteraemia OR fungemia OR fungaemia OR urosepsis OR infection* OR pneumonia* OR meningitis* OR meningoencephalitis*):ab,ti) AND (‘emergency ward’/exp. OR ‘emergency patient’/de OR ‘emergency health service’/de OR ‘hospital emergency service’/de OR ‘emergency care’/de OR ‘emergency physician’/de OR ‘emergency medicine’/de OR (((emergency) NEAR/6 (ward* OR department* OR room OR unit OR cent* OR patient* OR care OR healthcare OR physician* OR medicine)) OR ‘acute care’ OR ed):ab,ti) AND (‘biological marker’/exp. OR ‘marker’/de OR ‘molecular marker’/de OR ‘disease marker’/de OR ‘blood level’/de OR ‘lactate blood level’/de OR ‘protein blood level’/de OR (((biological* OR bio* OR inflammat* OR diagnos* OR molecul* OR disease) NEAR/3 marker*) OR biomarker* OR ((serum OR blood) NEAR/6 (concentrate* OR level* OR marker* OR lactate OR protein* OR elevat*))):ab,ti) NOT (‘case report’/de OR (case-report*):ti) NOT ([Conference Abstract]/lim) AND [English]/lim NOT ((juvenile/exp. OR pediatrics/exp. OR ‘newborn sepsis’/de OR ‘pediatric emergency medicine’/de OR (child* OR adolescen* OR infan* OR newborn* OR neonat*):ti) NOT (adult/exp. OR (adult*):ti)) NOT ([animals]/lim NOT [humans]/lim)

Medline Ovid.

(exp Sepsis/ OR exp. Infection/ OR exp. Pneumonia/ OR (sepsis OR septic* OR Bacteremia OR Bacteraemia OR fungemia OR fungaemia OR urosepsis OR infection* OR pneumonia* OR meningitis* OR meningoencephalitis*).ab,ti.) AND (Emergency Medical Services/ OR Emergency Service, Hospital/ OR Emergency Medicine/ OR (((emergency) ADJ6 (ward* OR department* OR room OR unit OR cent* OR patient* OR care OR healthcare OR physician* OR medicine)) OR acute care OR ed).ab,ti.) AND (exp Biomarkers/ OR blood.fs. OR (((biological* OR bio* OR inflammat* OR diagnos* OR molecul* OR disease) ADJ3 marker*) OR biomarker* OR ((serum OR blood) ADJ6 (concentrate* OR level* OR marker* OR lactate OR protein* OR elevat*))).ab,ti.) NOT (case reports/ OR (case-report*).ti.) AND english.la. NOT ((exp child/ OR exp. infant/ OR Pediatrics/ OR Neonatal Sepsis/ OR Pediatric Emergency Medicine/ OR (child* OR adolescen* OR infan* OR newborn* OR neonat*).ti.) NOT (exp adult/ OR (adult*).ti.)) NOT (exp animals/ NOT humans/)

Web of science.

TS = (((sepsis OR septic* OR Bacteremia OR Bacteraemia OR fungemia OR fungaemia OR urosepsis OR infection* OR pneumonia* OR meningitis* OR meningoencephalitis*)) AND ((((emergency) NEAR/5 (ward* OR department* OR room OR unit OR cent* OR patient* OR care OR healthcare OR physician* OR medicine)) OR “acute care” OR ed)) AND ((((biological* OR bio* OR inflammat* OR diagnos* OR molecul* OR disease) NEAR/2 marker*) OR biomarker* OR ((serum OR blood) NEAR/5 (concentrate* OR level* OR marker* OR lactate OR protein* OR elevat*))))) NOT TI = (((child* OR adolescen* OR infan* ORnewborn* OR neonat*)) NOT ((adult*))) AND DT = (article) AND LA = (english).

Cochrane CENTRAL.

((sepsis OR septic* OR Bacteremia OR Bacteraemia OR fungemia OR fungaemia OR urosepsis OR infection* OR pneumonia* OR meningitis* OR meningoencephalitis*):ab,ti) AND ((((emergency) NEAR/6 (ward* OR department* OR room OR unit OR cent* OR patient* OR care OR healthcare OR physician* OR medicine)) OR ‘acute care’ OR ed):ab,ti) AND ((((biological* OR bio* OR inflammat* OR diagnos* OR molecul* OR disease) NEAR/3 marker*) OR biomarker* OR ((serum OR blood) NEAR/6 (concentrate* OR level* OR marker* OR lactate OR protein* OR elevat*))):ab,ti) NOT (((child* OR adolescen* OR infan* OR newborn* OR neonat*):ti) NOT ((adult*):ti))

Google scholar.

sepsis|septic|Bacteremia|Bacteraemia|fungemia|fungaemia|urosepsis|infection|pneumonia|meningitis|meningoencephalitis “emergency ward|department|room”|"acute care” “biological|bio|inflammatory marker|markers”|biomarker|biomarkers -child -infant –newborn.

Authors’ contributions

KTM, IW, and YD were involved in the conception or design of the manuscript. KTM and IW did the screening of the articles and YD acted as referee. KTM and YD did the analysis and interpretation of the data. KTM drafted the manuscript. KTM, IW, HE, TH, CR, DG, EG and YD were involved in the critical revision of the manuscript and final approval of the manuscript. The authors read and approved the final manuscript.

Funding

This manuscript was not funded by any funding body.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Vincent JL, Jones G, David S, Olariu E, Cadwell KK. Frequency and mortality of septic shock in Europe and North America: a systematic review and meta-analysis. Crit Care. 2019;23(1):196. doi: 10.1186/s13054-019-2478-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.De Backer D, Dorman T. Surviving Sepsis guidelines: a continuous move toward better Care of Patients with Sepsis. JAMA. 2017;317(8):807–808. doi: 10.1001/jama.2017.0059. [DOI] [PubMed] [Google Scholar]
  • 3.Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, Peterson E, Tomlanovich M. Early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med. 2001;345(19):1368–1377. doi: 10.1056/NEJMoa010307. [DOI] [PubMed] [Google Scholar]
  • 4.Hayden GE, Tuuri RE, Scott R, Losek JD, Blackshaw AM, Schoenling AJ, Nietert PJ, Hall GA. Triage sepsis alert and sepsis protocol lower times to fluids and antibiotics in the ED. Am J Emerg Med. 2016;34(1):1–9. doi: 10.1016/j.ajem.2015.08.039. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Husabo G, Nilsen RM, Flaatten H, Solligard E, Frich JC, Bondevik GT, et al. Early diagnosis of sepsis in emergency departments, time to treatment, and association with mortality: an observational study. PLoS One. 2020;15(1):e0227652. doi: 10.1371/journal.pone.0227652. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Angus DC, van der Poll T. Severe sepsis and septic shock. N Engl J Med. 2013;369(9):840–851. doi: 10.1056/NEJMra1208623. [DOI] [PubMed] [Google Scholar]
  • 7.Wiersinga WJ, Leopold SJ, Cranendonk DR, van der Poll T. Host innate immune responses to sepsis. Virulence. 2014;5(1):36–44. doi: 10.4161/viru.25436. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Remick DG. Pathophysiology of sepsis. Am J Pathol. 2007;170(5):1435–1444. doi: 10.2353/ajpath.2007.060872. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, Bellomo R, Bernard GR, Chiche JD, Coopersmith CM, Hotchkiss RS, Levy MM, Marshall JC, Martin GS, Opal SM, Rubenfeld GD, van der Poll T, Vincent JL, Angus DC. The third international consensus definitions for Sepsis and septic shock (Sepsis-3) JAMA. 2016;315(8):801–810. doi: 10.1001/jama.2016.0287. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Hotchkiss RS, Karl IE. The pathophysiology and treatment of sepsis. N Engl J Med. 2003;348(2):138–150. doi: 10.1056/NEJMra021333. [DOI] [PubMed] [Google Scholar]
  • 11.Tsirigotis P, Chondropoulos S, Gkirkas K, Meletiadis J, Dimopoulou I. Balanced control of both hyper and hypo-inflammatory phases as a new treatment paradigm in sepsis. J Thorac Dis. 2016;8(5):E312–E316. doi: 10.21037/jtd.2016.03.47. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Sankoff JD, Goyal M, Gaieski DF, Deitch K, Davis CB, Sabel AL, Haukoos JS. Validation of the mortality in emergency department Sepsis (MEDS) score in patients with the systemic inflammatory response syndrome (SIRS) Crit Care Med. 2008;36(2):421–426. doi: 10.1097/01.CCM.0B013E3181611F6A0. [DOI] [PubMed] [Google Scholar]
  • 13.Smith GB, Prytherch DR, Meredith P, Schmidt PE, Featherstone PI. The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. Resuscitation. 2013;84(4):465–470. doi: 10.1016/j.resuscitation.2012.12.016. [DOI] [PubMed] [Google Scholar]
  • 14.Pierrakos C, Vincent JL. Sepsis biomarkers: a review. Crit Care. 2010;14(1):R15. doi: 10.1186/cc8872. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Pierrakos C, Velissaris D, Bisdorff M, Marshall JC, Vincent JL. Biomarkers of sepsis: time for a reappraisal. Crit Care. 2020;24(1):287. doi: 10.1186/s13054-020-02993-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Schuetz P, Hausfater P, Amin D, Amin A, Haubitz S, Faessler L, et al. Biomarkers from distinct biological pathways improve early risk stratification in medical emergency patients: the multinational, prospective, observational TRIAGE study. Crit Care. 2015;19(1):377. doi: 10.1186/s13054-015-1098-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Travaglino F, De Berardinis B, Magrini L, Bongiovanni C, Candelli M, Silveri NG, et al. Utility of Procalcitonin (PCT) and mid regional pro-Adrenomedullin (MR-proADM) in risk stratification of critically ill febrile patients in emergency department (ED). A comparison with APACHE II score. BMC Infect Dis. 2012;12:184. doi: 10.1186/1471-2334-12-184. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1. doi: 10.1186/2046-4053-4-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Wolff RF, Moons KGM, Riley RD, Whiting PF, Westwood M, Collins GS, Reitsma JB, Kleijnen J, Mallett S, for the PROBAST Group† PROBAST: a tool to assess the risk of Bias and applicability of prediction model studies. Ann Intern Med. 2019;170(1):51–58. doi: 10.7326/M18-1376. [DOI] [PubMed] [Google Scholar]
  • 20.Yu H, Nie L, Liu A, Wu K, Hsein YC, Yen DW, Lee MTG, Lee CC. Combining procalcitonin with the qSOFA and sepsis mortality prediction. Medicine (Baltimore) 2019;98(23):e15981. doi: 10.1097/MD.0000000000015981. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Yamamoto S, Yamazaki S, Shimizu T, Takeshima T, Fukuma S, Yamamoto Y, Tochitani K, Tsuchido Y, Shinohara K, Fukuhara S. Prognostic utility of serum CRP levels in combination with CURB-65 in patients with clinically suspected sepsis: a decision curve analysis. BMJ Open. 2015;5(4):e007049. doi: 10.1136/bmjopen-2014-007049. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Liu B, Chen YX, Yin Q, Zhao YZ, Li CS. Diagnostic value and prognostic evaluation of Presepsin for sepsis in an emergency department. Crit Care. 2013;17(5):R244. doi: 10.1186/cc13070. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Zhang Q, Dong G, Zhao X, Wang M, Li CS. Prognostic significance of hypothalamic-pituitary-adrenal axis hormones in early sepsis: a study performed in the emergency department. Intensive Care Med. 2014;40(10):1499–1508. doi: 10.1007/s00134-014-3468-4. [DOI] [PubMed] [Google Scholar]
  • 24.Chen YX, Li CS. Arterial lactate improves the prognostic performance of severity score systems in septic patients in the ED. Am J Emerg Med. 2014;32(9):982–986. doi: 10.1016/j.ajem.2014.05.025. [DOI] [PubMed] [Google Scholar]
  • 25.Yin Q, Liu B, Chen Y, Zhao Y, Li C. The role of soluble thrombomodulin in the risk stratification and prognosis evaluation of septic patients in the emergency department. Thromb Res. 2013;132(4):471–476. doi: 10.1016/j.thromres.2013.08.011. [DOI] [PubMed] [Google Scholar]
  • 26.Zhao Y, Jia Y, Li C, Fang Y, Shao R. The risk stratification and prognostic evaluation of soluble programmed death-1 on patients with sepsis in emergency department. Am J Emerg Med. 2018;36(1):43–48. doi: 10.1016/j.ajem.2017.07.002. [DOI] [PubMed] [Google Scholar]
  • 27.Nino ME, Serrano SE, Nino DC, McCosham DM, Cardenas ME, Villareal VP, et al. TIMP1 and MMP9 are predictors of mortality in septic patients in the emergency department and intensive care unit unlike MMP9/TIMP1 ratio: multivariate model. PLoS One. 2017;12(2):e0171191. doi: 10.1371/journal.pone.0171191. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Zhao Y, Li C, Jia Y. Evaluation of the mortality in emergency department Sepsis score combined with procalcitonin in septic patients. Am J Emerg Med. 2013;31(7):1086–1091. doi: 10.1016/j.ajem.2013.04.008. [DOI] [PubMed] [Google Scholar]
  • 29.Zhang Q, Dong G, Zhao X, Li CS. High immunoglobulin E values at admission predict mortality in ED patients with sepsis. Am J Emerg Med. 2016;34(8):1589–1594. doi: 10.1016/j.ajem.2016.05.062. [DOI] [PubMed] [Google Scholar]
  • 30.Wang M, Zhang Q, Zhao X, Dong G, Li C. Diagnostic and prognostic value of neutrophil gelatinase-associated lipocalin, matrix metalloproteinase-9, and tissue inhibitor of matrix metalloproteinases-1 for sepsis in the emergency department: an observational study. Crit Care. 2014;18(6):634. doi: 10.1186/s13054-014-0634-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Henning DJ, Bhatraju PK, Johnson NJ, Kosamo S, Shapiro NI, Zelnick LR, Liles WC, Wurfel MM. Physician judgment and circulating biomarkers predict 28-day mortality in emergency department patients. Crit Care Med. 2019;47(11):1513–1521. doi: 10.1097/CCM.0000000000003899. [DOI] [PubMed] [Google Scholar]
  • 32.Chen YX, Li CS. The prognostic and risk-stratified value of heart-type fatty acid-binding protein in septic patients in the emergency department. J Crit Care. 2014;29(4):512–516. doi: 10.1016/j.jcrc.2014.03.026. [DOI] [PubMed] [Google Scholar]
  • 33.Duplessis C, Gregory M, Frey K, Bell M, Truong L, Schully K, Lawler J, Langley RJ, Kingsmore SF, Woods CW, Rivers EP, Jaehne AK, Quackenbush EB, Fowler VG, Tsalik EL, Clark D. Evaluating the discriminating capacity of cell death (apoptotic) biomarkers in sepsis. J Intensive Care. 2018;6(1):72. doi: 10.1186/s40560-018-0341-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Kofoed K, Eugen-Olsen J, Petersen J, Larsen K, Andersen O. Predicting mortality in patients with systemic inflammatory response syndrome: an evaluation of two prognostic models, two soluble receptors, and a macrophage migration inhibitory factor. Eur J Clin Microbiol Infect Dis. 2008;27(5):375–383. doi: 10.1007/s10096-007-0447-5. [DOI] [PubMed] [Google Scholar]
  • 35.Viallon A, Guyomarc'h S, Marjollet O, Berger C, Carricajo A, Robert F, et al. Can emergency physicians identify a high mortality subgroup of patients with sepsis: role of procalcitonin. Eur J Emerg Med. 2008;15(1):26–33. doi: 10.1097/MEJ.0b013e3280ec539b. [DOI] [PubMed] [Google Scholar]
  • 36.Carpio R, Zapata J, Spanuth E, Hess G. Utility of presepsin (sCD14-ST) as a diagnostic and prognostic marker of sepsis in the emergency department. Clin Chim Acta. 2015;450:169–175. doi: 10.1016/j.cca.2015.08.013. [DOI] [PubMed] [Google Scholar]
  • 37.Song J, Park DW, Moon S, Cho HJ, Park JH, Seok H, Choi WS. Diagnostic and prognostic value of interleukin-6, pentraxin 3, and procalcitonin levels among sepsis and septic shock patients: a prospective controlled study according to the Sepsis-3 definitions. BMC Infect Dis. 2019;19(1):968. doi: 10.1186/s12879-019-4618-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, Cohen J, Opal SM, Vincent JL, Ramsay G, SCCM/ESICM/ACCP/ATS/SIS 2001 SCCM/ESICM/ACCP/ATS/SIS international Sepsis definitions conference. Crit Care Med. 2003;31(4):1250–1256. doi: 10.1097/01.CCM.0000050454.01978.3B. [DOI] [PubMed] [Google Scholar]
  • 39.Ranganathan P, Pramesh CS, Aggarwal R. Common pitfalls in statistical analysis: logistic regression. Perspect Clin Res. 2017;8(3):148–151. doi: 10.4103/picr.PICR_87_17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49(12):1373–1379. doi: 10.1016/S0895-4356(96)00236-3. [DOI] [PubMed] [Google Scholar]
  • 41.Vijayan AL, Vanimaya, Ravindran S, Saikant R, Lakshmi S, Kartik R, et al. Procalcitonin: a promising diagnostic marker for sepsis and antibiotic therapy. J Intensive Care. 2017;5:51. doi: 10.1186/s40560-017-0246-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.van der Does Y, Limper M, Jie KE, Schuit SCE, Jansen H, Pernot N, van Rosmalen J, Poley MJ, Ramakers C, Patka P, van Gorp ECM, Rood PPM. Procalcitonin-guided antibiotic therapy in patients with fever in a general emergency department population: a multicentre non-inferiority randomized clinical trial (HiTEMP study) Clin Microbiol Infect. 2018;24(12):1282–1289. doi: 10.1016/j.cmi.2018.05.011. [DOI] [PubMed] [Google Scholar]
  • 43.Spittler A, Razenberger M, Kupper H, Kaul M, Hackl W, Boltz-Nitulescu G, Függer R, Roth E. Relationship between interleukin-6 plasma concentration in patients with sepsis, monocyte phenotype, monocyte phagocytic properties, and cytokine production. Clin Infect Dis. 2000;31(6):1338–1342. doi: 10.1086/317499. [DOI] [PubMed] [Google Scholar]
  • 44.Ma L, Zhang H, Yin YL, Guo WZ, Ma YQ, Wang YB, Shu C, Dong LQ. Role of interleukin-6 to differentiate sepsis from non-infectious systemic inflammatory response syndrome. Cytokine. 2016;88:126–135. doi: 10.1016/j.cyto.2016.08.033. [DOI] [PubMed] [Google Scholar]
  • 45.Schultz M, Rasmussen LJH, Andersen MH, Stefansson JS, Falkentoft AC, Alstrup M, Sandø A, Holle SLK, Meyer J, Törnkvist PBS, Høi-Hansen T, Kjøller E, Jensen BN, Lind M, Ravn L, Kallemose T, Lange T, Køber L, Rasmussen LS, Eugen-Olsen J, Iversen KK. Use of the prognostic biomarker suPAR in the emergency department improves risk stratification but has no effect on mortality: a cluster-randomized clinical trial (TRIAGE III) Scand J Trauma Resusc Emerg Med. 2018;26(1):69. doi: 10.1186/s13049-018-0539-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Huang Q, Xiong H, Yan P, Shuai T, Liu J, Zhu L, Lu J, Yang K, Liu J. The diagnostic and prognostic value of suPAR in patients with Sepsis: a systematic review and meta-analysis. Shock. 2020;53(4):416–425. doi: 10.1097/SHK.0000000000001434. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Vafaei A, Heydari K, Hashemi-Nazari SS, Izadi N, Hassan ZH. PIRO, SOFA and MEDS scores in predicting one-month mortality of Sepsis patients; a diagnostic accuracy study. Arch Acad Emerg Med. 2019;7(1):e59. [PMC free article] [PubMed] [Google Scholar]
  • 48.Badrinath K, Shekhar M, Sreelakshmi M, Srinivasan M, Thunga G, Nair S, Nileshwar K, Balakrishnan A, Kunhikatta V. Comparison of various severity assessment scoring Systems in Patients with Sepsis in a tertiary care teaching hospital. Indian J Crit Care Med. 2018;22(12):842–845. doi: 10.4103/ijccm.IJCCM_322_18. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Sam S, Corbridge TC, Mokhlesi B, Comellas AP, Molitch ME. Cortisol levels and mortality in severe sepsis. Clin Endocrinol. 2004;60(1):29–35. 10.1111/j.1365-2265.2004.01923.x. [DOI] [PubMed]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

12873_2021_461_MOESM1_ESM.docx (40.2KB, docx)

Additional file 1: Supplemental Table 1: overview of commonly used clinical scoring systems for mortality prediction. Supplemental table 2: Extended PROBAST checklist. Supplemental table 3: Signaling questions used in PROBAST checklist.

Data Availability Statement

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.


Articles from BMC Emergency Medicine are provided here courtesy of BMC

RESOURCES