Abstract
Background
Melioidosis, infection caused by Burkholderia pseudomallei, is a common cause of sepsis with high associated mortality in Southeast Asia. Identification of patients at high likelihood of clinical deterioration is important for guiding decisions about resource allocation and management. We sought to develop a biomarker-based model for 28-day mortality prediction in melioidosis.
Methods
In a derivation set (N = 113) of prospectively enrolled, hospitalized Thai patients with melioidosis, we measured concentrations of interferon-γ, interleukin-1β, interleukin-6, interleukin-8, interleukin-10, tumor necrosis factor-ɑ, granulocyte-colony stimulating factor, and interleukin-17A. We used least absolute shrinkage and selection operator (LASSO) regression to identify a subset of predictive biomarkers and performed logistic regression and receiver operating characteristic curve analysis to evaluate biomarker-based prediction of 28-day mortality compared with clinical variables. We repeated select analyses in an internal validation set (N = 78) and in a prospectively enrolled external validation set (N = 161) of hospitalized adults with melioidosis.
Results
All 8 cytokines were positively associated with 28-day mortality. Of these, interleukin-6 and interleukin-8 were selected by LASSO regression. A model consisting of interleukin-6, interleukin-8, and clinical variables significantly improved 28-day mortality prediction over a model of only clinical variables [AUC (95% confidence interval [CI]): 0.86 (.79–.92) vs 0.78 (.69–.87); P = .01]. In both the internal validation set (0.91 [0.84–0.97]) and the external validation set (0.81 [0.74–0.88]), the combined model including biomarkers significantly improved 28-day mortality prediction over a model limited to clinical variables.
Conclusions
A 2-biomarker model augments clinical prediction of 28-day mortality in melioidosis.
Keywords: biomarkers, melioidosis, sepsis, IL-6, IL-8
Melioidosis is increasingly recognized as a cause of sepsis in tropical regions with high associated mortality. We developed and subsequently validated an inflammatory biomarker-based model for 28-day mortality prediction in melioidosis.
Melioidosis is an often-severe infectious disease caused by the gram-negative bacterium Burkholderia pseudomallei. A Centers for Disease Control and Prevention Tier 1 select agent found in tropical soil and water, B. pseudomallei is endemic to parts of Southeast Asia as well as northern Australia, yet is increasingly identified throughout the tropics [1–3]. Although the manifestations of infection are highly variable, melioidosis is frequently characterized by a profound systemic inflammatory response resulting in sepsis and septic shock [4–7]. Despite appropriate antibiotic treatment, mortality ranges from 10% to 40%, with estimated average global mortality in 1 modeling study exceeding 50% [8].
Given the high mortality associated with melioidosis as well as the challenges of tertiary center referral in some endemic areas, the development of early-prediction tools for melioidosis outcome is paramount. Such tools could inform resource allocation and clinical management. Clinical scores, such as the Sequential Organ Failure Assessment (SOFA), reasonably predict sepsis-related mortality in multiple studies and are associated with mortality in Southeast Asian cohorts of patients with infection [9, 10]. However, improving on the predictive capacity of these scores is desirable. Furthermore, obtaining the clinical data that comprise such scores may be challenging in low- and middle-income countries [11]. Biomarkers may therefore be useful in overcoming existing limitations in mortality prediction in melioidosis.
A robust inflammatory response is a hallmark of severe sepsis, including severe melioidosis [12]. Elevations in levels of circulating inflammatory cytokines and other inflammatory pathway proteins have been used to predict mortality in critical illness, including septic shock and severe melioidosis [13–16]. However, broad investigations of the predictive capacity of inflammatory cytokines for mortality in melioidosis are limited. We hypothesized that a plasma biomarker model could predict mortality in patients with melioidosis. Moreover, we hypothesized that a biomarker model could augment or supercede clinical estimates of likely mortality. Deployed in a point-of-care fashion at the bedside, such biomarkers could potentially assist clinicians in decision making, including in resource-limited settings.
METHODS
Melioidosis Patient Cohorts
Derivation and Internal Validation Sets
Subjects aged 18 years or older admitted to Sunpasittiprasong Hospital, Ubon Rachathani, Thailand, from 2013 through 2017 with suspected infection and 3 systemic manifestations of infection, as proposed by the 2012 Surviving Sepsis Campaign, were prospectively enrolled within the first 24 hours of admission [17]. This cohort, and subsets of it, have previously been described [11, 18, 19]. One hundred and ninety-one individuals with any culture of a clinical specimen positive for B. pseudomallei were considered for inclusion in the derivation and internal validation sets of this study. Plasma samples were obtained at the time of enrollment. Clinical data were assessed by the study team or extracted from the medical record and recorded in a case report form. We estimated that analysis of 110 patients would yield 85% power to detect improvement in the area under the receiver operating curve (AUC) relative to an AUC of 0.75, assuming 50% nonsurvivors, log mean cytokine (variance) of 2.5 (0.8) in nonsurvivors, and log mean cytokine (variance) of 1.5 (0.5) in survivors, setting an ɑ equal to .05 [20]. Of the 191 subjects, the first 113 consecutively enrolled subjects were selected for the derivation set and the remaining 78 subjects comprised the internal validation set.
External Validation Set
The external validation set was a prospectively enrolled cohort of 161 subjects aged 15 years or older admitted to Udon Thani Hospital, Udon Thani, and Mukdahan Hospital, Mukdahan, Thailand, from 2015 through 2018, who had growth of B. pseudomallei in any cultured clinical specimen. Enrollment occurred at the time of pathogen identification. This cohort has been described previously [21]. Plasma samples were obtained at the time of enrollment and clinical data were obtained from patient interview, medical records, and telephone calls.
Clinical Definitions
In the derivation and internal validation sets, a modified SOFA score was calculated for subjects from presentation until the time of enrollment. The cardiovascular and respiratory components of the SOFA score were modified because vasopressor/inotrope dosages were not captured and because arterial blood gases were rarely performed, as reported previously [18, 22]. For the cardiovascular component of the SOFA score, 2 of 4 points were given for receipt of dobutamine or dopamine and 3 of 4 points were given for receipt of epinephrine or norepinephrine. For the respiratory component of the SOFA score, 2 of 4 points were given for advanced respiratory support (endotracheal intubation and mechanical ventilation) when no arterial blood gas result was available.
For the external validation set, the clinical data obtained at enrollment were insufficient to calculate either a standard SOFA score or a modified SOFA score. Therefore, where indicated, models were adjusted for cardiopulmonary organ failure at the time of enrollment. This was defined as respiratory failure requiring invasive mechanical ventilation or shock requiring an infusion of epinephrine, norepinephrine, dopamine, or dobutamine.
Biomarker Quantification
In the derivation set, plasma concentrations of interferon-γ (IFN-γ), interleukin (IL)-1β, IL-6, IL-8, IL-10, tumor necrosis factor-ɑ (TNF-ɑ), granulocyte-colony stimulating factor (G-CSF), and IL-17A were measured using an electrochemiluminescent multiplex assay (Meso Scale Discovery). Upper and lower limits of detection were determined by the manufacturer’s software. In the internal validation set, plasma concentrations of IL-6 and IL-8 were measured using the same platform.
In the external validation set, concentrations of IL-6 and IL-8 were determined in plasma using bead-based multiplex assays on Luminex technology (Milliplex MAP kit: HSTCMAG-28K-12 plex, Millipore). The limits of detection for IL-6 were 0.18–750 pg/mL and for IL-8 were 0.31–1250 pg/mL.
Biomarker concentrations are reported as median and interquartile range (IQR). Comparisons between patients who survived or died were performed with the Mann-Whitney U test.
Model Development
Candidate models of mortality prediction were initially developed in the derivation set using combinations of clinical variables such as age, sex, Charlson Comorbidity Index, a modified SOFA score, and selected biomarkers. All biomarkers were log10-transformed before analysis. To simplify the prediction model to the fewest number of biomarkers possible, all 8 biomarkers were subjected to logistic regression analysis by least absolute shrinkage and selection operator (LASSO) methodology in which lambda was selected by the Akaike Information Criterion; the selected biomarkers were confirmed using lambda selection based on 5-fold internal cross-validation [23, 24].
The LASSO-selected biomarkers and clinical variables were evaluated as predictors of 28-day mortality by creating logistic regression models. All models were assessed for goodness-of-fit using Hosmer-Lemeshow chi-square analysis, and models were compared using the likelihood ratio (LR) test [25]. Receiver operating characteristic curve analysis was performed to evaluate mortality discrimination. Discrimination ability was further assessed using integrated discrimination improvement analysis (IDI) [26, 27].
Candidate predictive models were subsequently analyzed in a similar manner in the internal validation set and in the external validation set using cardiopulmonary organ failure instead of modified SOFA score in the latter. Analyses were performed using Stata version 14.2 (StataCorp). Two-sided P values <.05 were considered significant.
Human Subjects
Written informed consent was obtained from study participants or their representatives prior to enrollment. The studies were approved by the Sunpasitthiprasong Hospital Ethics Committee (039/2556), the Udon Thani Hospital Ethics Committee (0032.102/318), the Mukdahan Hospital Ethics Committee (MEC 010/59), the Ethics Committee of the Faculty of Tropical Medicine, Mahidol University (MUTM2012-024-01 and MUTM2015-002-01), the University of Washington Institutional Review Board (42988), and the Oxford University Tropical Research Ethics Committee (OXTREC172-12).
RESULTS
Inflammatory Biomarkers Are Associated With 28-Day Mortality in a Derivation Set of Patients With Melioidosis
IFN-γ, IL-1β, IL-6, IL-8, IL-10, TNF-ɑ, G-CSF, and IL-17A were measured in plasma samples obtained on study enrollment in the derivation set of 113 patients with melioidosis. The demographics of this set are reported in Table 1. Of these patients, 72 of 113 (64%) were male and 50 of 113 (44%) had diabetes. Seventy-six percent of subjects had a modified SOFA score of 2 or higher and the 28-day mortality was 55%.
Table 1.
Derivation Set (n = 113) | Internal Validation Set (n = 78) | External Validation Set (n = 161) | |
---|---|---|---|
Baseline characteristics | |||
Age in years, median (IQR) | 54 (45–64) | 55.5 (46–66) | 54 (45–64) |
Male sex, n (%) | 72 (64) | 60 (77) | 114 (71) |
Pre-existing conditions | |||
Charlson Comorbidity Index, median (IQR) | 2 (1–3) | 2 (1–3) | 2 (1–3) |
Diabetes, n (%) | 50 (44) | 38 (49) | 119 (74) |
Chronic liver disease, n (%) | 3 (3) | 4 (5) | 3 (2) |
Chronic kidney disease, n (%) | 15 (13) | 11 (14) | 31 (19) |
Chronic cardiovascular disease, n (%) | 6 (5) | 5 (6) | 7 (4) |
Chronic lung disease, n (%) | 7 (6) | 8 (10) | 5 (3) |
Cancer, n (%) | 1 (1) | 2 (2) | 5 (3) |
Human immunodeficiency virus, n (%) | 0 | 0 | 4 (2) |
Chronic steroids, n (%) | 1 (1) | 0 | 7 (4) |
Transferred from another facility, n (%) | 99 (88) | 70 (89) | 90 (56) |
Day 1 modified SOFA score, median (IQR) | 4 (2–7) | 5 (2–8) | … |
Day 1 modified SOFA score ≥2, n (%) | 86 (76) | 62 (79) | … |
Bacteremia, n (%) | 93 (82) | 56 (72) | 131 (81) |
28-Day mortality, n (%) | 62 (55) | 36 (46) | 68 (42) |
Abbreviations: IQR, interquartile range; SOFA, Sequential Organ Failure Assessment.
Plasma cytokines were compared between those who died and those who survived to 28 days (Table 2). Concentrations of all 8 cytokines were significantly higher in nonsurvivors than in survivors (P < .001 for all).
Table 2.
Derivation Set, pg/mL | Internal Validation Set, pg/mL | |||||||
---|---|---|---|---|---|---|---|---|
Biomarkers | All (n = 113) | Survivors (n = 51) | Nonsurvivors (n = 62) | P a | All (n = 78) | Survivors (n = 42) | Nonsurvivors (n = 36) | P a |
IL-6 | 252 (33–1980) | 41 (16–239) | 1938 (132–1980) | <.001 | 109 (36–1305) | 44 (21–110) | 948 (118–2080) | <.001 |
IL-8 | 111 (11–479) | 14 (5–49) | 304 (78–1725) | <.001 | 41 (7–251) | 9 (3–41) | 181 (55–1729) | <.001 |
G-CSF | 169 (54–4165) | 59 (32–209) | 1680 (117–11388) | <.001 | … | … | … | |
IFN-γ | 1078 (350–3213) | 538 (188–1618) | 2027 (875–4780) | <.001 | … | … | … | |
IL-1β | 3.6 (2–12) | 2 (2–7) | 7 (2–25) | <.001 | … | … | … | |
TNF-ɑ | 27 (12–73) | 14 (6–37) | 50 (20–103) | <.001 | … | … | … | |
IL-17A | 57 (14–132) | 18 (12–74) | 75 (37–163) | <.001 | … | … | … | |
IL-10 | 23 (34–50) | 5 (2–28) | 34 (17–65) | <.001 | … | … | … |
Data are presented as median (IQR).
Abbreviations: G-CSF, granulocyte-colony stimulating factor; IFN-γ, interferon-γ; IL, interleukin; IQR, interquartile range; TNF-ɑ, tumor necrosis factor-ɑ.
a P values for Mann-Whitney U test of biomarker level between subjects alive and dead at 28 days.
The relationship between log10-transformed plasma cytokine concentration and 28-day mortality was analyzed using logistic regression (Table 3). All 8 cytokines were strongly positively associated with 28-day mortality in unadjusted models (P < .001 for all). These strong relationships persisted when the models were adjusted for age, sex, and Charlson Comorbidity Index. In order to account for clinically determined severity of illness, models were additionally adjusted for modified SOFA score. In these models, all cytokines remained significantly associated with 28-day mortality. IL-6 (odds ratio [OR], 3.62; 95% confidence interval [CI], 1.97–6.66), IL-8 (OR, 3.44; 95% CI, 1.87–6.32), and G-CSF (OR, 2.71; 95% CI, 1.64–4.49) were most significantly associated with mortality (P < .001) in the modified SOFA-adjusted model. These data indicated that even accounting for pre-existing risk factors and severity of illness, these cytokines were independent predictors of mortality in melioidosis.
Table 3.
Unadjusted | Adjusteda | Modified SOFA-Adjustedb | |||||||
---|---|---|---|---|---|---|---|---|---|
Biomarker (log10) | OR | 95% CI | P | OR | 95% CI | P | OR | 95% CI | P |
IL-6 | 4.43 | 2.55–7.70 | <.001 | 4.59 | 2.58–8.17 | <.001 | 3.62 | 1.97–6.66 | <.001 |
IL-8 | 4.09 | 2.40–6.97 | <.001 | 4.37 | 2.47–7.71 | <.001 | 3.44 | 1.87–6.32 | <.001 |
G-CSF | 2.95 | 1.86–4.67 | <.001 | 3.13 | 1.93–5.06 | <.001 | 2.71 | 1.64–4.49 | <.001 |
IFN-γ | 3.03 | 1.65–5.60 | <.001 | 2.93 | 1.58–5.41 | .001 | 2.29 | 1.20–4.31 | .01 |
IL-1β | 4.14 | 1.94–8.81 | <.001 | 4.77 | 2.12–10.75 | <.001 | 3.65 | 1.57–8.47 | .003 |
TNF-ɑ | 4.54 | 2.10–9.80 | <.001 | 4.45 | 2.02–9.79 | <.001 | 2.54 | 1.10–5.85 | .03 |
IL-17A | 4.39 | 2.02–9.52 | <.001 | 4.79 | 2.09–10.93 | <.001 | 2.74 | 1.13–6.68 | .03 |
IL-10 | 3.33 | 1.82–6.05 | <.001 | 3.34 | 1.81–6.18 | <.001 | 2.06 | 1.05–4.03 | .04 |
Abbreviations: CI, confidence interval; G-CSF, granulocyte-colony stimulating factor; IFN-γ, interferon-γ; IL, interleukin; OR, odds ratio; SOFA, Sequential Organ Failure Assessment; TNF-ɑ, tumor necrosis factor-ɑ.
aFor the adjusted model, P values were determined using logistic regression adjusted for age, sex, and Charlson Comorbidity Index.
b For the modified SOFA-adjusted model, P values were determined using logistic regression adjusted for age, sex, Charlson Comorbidity Index, and modified SOFA score.
Derivation Set Biomarker Model Development
To develop a parsimonious biomarker-based model to predict 28-day mortality in melioidosis, LASSO regression was performed on the 8 cytokines in the derivation set. This procedure selected IL-6 and IL-8. The 2 selected biomarkers had a high degree of collinearity (Pearson’s coefficient = 0.87). As our goal was to develop the most parsimonious model possible, we therefore analyzed IL-6 and IL-8 individually as well as in combination.
To determine the added value of IL-6 and IL-8 in the prediction of outcome, a logistic regression model of clinical assessment of severity of illness that included age, sex, Charlson Comorbidity Index, and modified SOFA score was first evaluated without the cytokines and then after the addition of each cytokine individually (Table 4). The addition of either IL-6 (LR P = 7.6 × 10−6) or IL-8 (LR P = 1.1 × 10−5) significantly improved the model.
Table 4.
Model and Variable | OR | 95% CI | P |
---|---|---|---|
Clinical variables | |||
Age | 0.99 | .95–1.04 | .88 |
Female sex | 2.47 | 1.01–6.04 | .05 |
Charlson Comorbidity Index | 1.12 | .75–1.66 | .55 |
Modified SOFA score | 1.32 | 1.16–1.51 | <.001 |
Clinical variables + IL-6a | |||
Age | 1.00 | .95–1.06 | .88 |
Female sex | 2.89 | 1.07–7.95 | .04 |
Charlson Comorbidity Index | 1.06 | .69–1.65 | .78 |
Modified SOFA score | 1.18 | 1.02–1.36 | .02 |
IL-6 | 3.62 | 1.97–6.66 | <.001 |
Clinical variables + IL-8b | |||
Age | 0.99 | .94–1.05 | .87 |
Female sex | 2.65 | .99–7.12 | .05 |
Charlson Comorbidity Index | 1.21 | .77–1.91 | .41 |
Modified SOFA | 1.16 | .99–1.35 | .05 |
IL-8 | 3.44 | 1.87–6.32 | <.001 |
Abbreviations: CI, confidence interval; IL, interleukin; OR, odds ratio; SOFA, Sequential Organ Failure Assessment.
aModel containing clinical variables and log10 IL-6 differed significantly by likelihood ratio test (P = 7.6 × 10−6) compared with the clinical variable model.
bModel containing clinical variables and log10 IL-8 differed significantly by likelihood ratio test (P = 1.1 × 10−5) compared with the clinical variable model.
To evaluate the discrimination of mortality using these biomarkers, receiver operating characteristic curve analysis was performed. The AUC was calculated first for a baseline risk model composed of age, sex, and Charlson Comorbidity Index, and then for models sequentially adding modified SOFA score followed by both IL-6 and IL-8 to the baseline risk model. The model composed of all clinical variables (age, sex, Charlson Comorbidity Index, and modified SOFA score) plus both IL-6 and IL-8 significantly increased mortality discrimination compared with the clinical variable model alone (AUC [95% CI], 0.86 [.79–.92] vs 0.78 [.69–.87]; P = .01) (Figure 1A and Supplementary Table 1). Additional discrimination analysis using IDI showed significant improvement in the clinical variable model when IL-6 and IL-8 were added (P < .0001) (Supplementary Table 2). The addition of either IL-6 or IL-8 individually to the clinical variable model also significantly improved the discrimination of mortality compared with the clinical variable model alone (Supplementary Figures 1A and 2A, Supplementary Table 1). Furthermore, a model consisting of both IL-6 and IL-8 without any clinical variables performed similarly to the clinical variable model (AUC, 0.83; 95% CI, .75–.91; P = .30) (Supplementary Table 1).
Internal Biomarker Model Validation
We next analyzed IL-6 and IL-8 as predictors of mortality in the internal validation set of 78 patients with melioidosis. Baseline characteristics of these patients are shown in Table 1. IL-6 and IL-8 were significantly higher in nonsurvivors at 28 days compared with survivors (Table 2) and were significantly associated with 28-day mortality (all P < .001) (Supplementary Table 3). The addition of IL-6 and IL-8 to a model of mortality prediction composed of clinical variables was highly significant (LR P = 2 × 10−6 and 1.5 × 10−5, respectively) (Supplementary Table 4). The addition of IL-6 and IL-8 to the clinical variable model significantly improved discrimination of mortality (AUC [95% CI], 0.91 [.84–.97] vs 0.81 [.72–.91], P = .03; IDI P < .0001) (Figure 1B, Supplementary Tables 1 and 2). The addition of IL-6 and IL-8 individually to the clinical variable model also significantly improved the discrimination of mortality compared with the clinical variable model alone (Supplementary Figures 1B and 2B, Supplementary Table 1). A model consisting only of IL-6 and IL-8 performed similarly to the clinical variable model (AUC, 0.88; 95% CI, .80–.96; P = .20) (Supplementary Table 1).
External Biomarker Model Validation
As an external validation of our findings, we analyzed the mortality prediction of IL-6 and IL-8 in an independent set of 161 patients with melioidosis enrolled at other sites in northeast Thailand (Table 1). As previously reported, the plasma concentrations of IL-6 and IL-8 were significantly higher in 28-day nonsurvivors than in survivors (median [IQR]: IL-6, 45 pg/mL [20–172] vs 14 pg/mL [7–30], P < .001; IL-8, 87 pg/mL [24–199] vs 14 pg/mL [6–36], P < .001) [21]. IL-6 and IL-8 each were associated with 28-day mortality in logistic regression models adjusted for age, sex, comorbidities, and cardiopulmonary organ failure (P = .003 and P = .001, respectively) (Supplementary Table 5). The addition of either IL-6 or IL-8 to a model composed of clinical variables (age, sex, comorbidities, and cardiopulmonary organ failure) significantly improved mortality prediction as determined by the LR (P = .002 and 8 × 10−4, respectively) (Supplementary Table 6). The addition of IL-6 and IL-8 to the clinical variable model significantly improved discrimination of mortality (AUC [95% CI], 0.81 [.74–.88] vs 0.76 [.68–.84], P = .02; IDI P = .001) (Figure 1C, Supplementary Tables 1 and 2). The addition of IL-8 but not IL-6 individually to the clinical variable model also significantly improved the discrimination of mortality compared to the clinical variable model alone (Supplementary Figures 1C and 2C, Supplementary Table 1). A model consisting of only IL-6 and IL-8 performed similarly to the clinical variable model (AUC, 0.78; 95% CI, .71–.85; P = .67) (Supplementary Table 1).
DISCUSSION
In this study of hospitalized patients with melioidosis, we develop and validate parsimonious mortality prediction models comprising plasma IL-6 and IL-8. We report that these biomarkers augment concurrent clinical assessments that include pre-existing comorbidities and markers of organ failure in predicting mortality from melioidosis. Moreover, by themselves, these biomarkers are comparable to clinical models of mortality prediction. Therefore, these biomarkers have the potential to be valuable for clinicians caring for patients with melioidosis in settings with or without the ability to clinically characterize organ failure.
Relatively few prior reports have evaluated the relationship of plasma cytokine concentrations and clinical outcome in melioidosis. In older analyses of patients with melioidosis, levels of IL-6, IL-10, TNF-ɑ but not IFN-γ were significantly elevated at enrollment in nonsurvivors compared with survivors [4, 16]. More recently, we have characterized the longitudinal plasma cytokine response in patients with melioidosis, including associations with survival and changes compared with uninfected controls [21]. In contrast, abundant data exist regarding the utility of IL-6 and IL-8 predicting sepsis outcomes. For example, IL-6 and IL-8 were, both individually and as part of a multibiomarker score, associated with 28-day nonsurvival in a small Spanish cohort of patients with severe sepsis or septic shock [28]. IL-8 has been included in multiple biomarker models shown to be predictive of death in both pediatric and adult patients with sepsis in North America [14, 29, 30]. Changes in IL-6 during the initial days of sepsis have also been associated with mortality in several distinct cohorts [31, 32]. IL-6 may predict organ failure in critical illness earlier than SOFA and may improve mortality discrimination of clinical judgment in patients with sepsis [33, 34]. Therefore, our findings that IL-6 and IL-8 bolster mortality prediction in patients with melioidosis are largely concordant with the published critical illness literature.
Many patients with melioidosis live in regions where resources may be limited [12]. Organ failure assessment using SOFA scores may be difficult to perform in underresourced areas, prompting evaluation using simpler clinical prediction tools [11, 35–37]. For example, calculation of the SOFA score as originally proposed requires measuring 4 blood parameters, the ability to mechanically ventilate, and the availability of vasopressor agents [38]. All of these parameters are associated with related infrastructure costs [10]. Procalcitonin and C-reactive protein, biomarkers increasingly utilized in sepsis triage, are widely available but have variable utility in Southeast Asia for infection prognosis [39, 40]. Our data suggest that a model based on plasma IL-6 and IL-8 concentrations, without clinical variables, may be a reasonable substitute for melioidosis mortality prediction models composed of clinical organ failure scores. Assays for these cytokines are not readily available in most clinical settings. However, our results may be highly relevant for the development of simple, cost-effective point-of-care assays to assist clinicians with varying expertise across a range of settings who are trying to judiciously allocate resources and optimally manage sick patients [41, 42].
Our study has several strengths. It is one of the first to include prospectively enrolled patients with melioidosis in independent cohorts from multiple sites. Culture-proven B. pseudomallei infection, a criterion for inclusion in this study, is the gold standard for diagnosis of melioidosis. Sample processing, tracking, and assaying were rigorously performed to reduce unmeasured confounding or batch effects. There were minimal missing data or loss to follow-up in these cohorts.
Our study also has several limitations. All subjects included were enrolled after admission to a regional medical center. Given the high patient transfer rate from outside facilities, the time of enrollment may reflect multiple days of symptoms. Our models also incorporated only a single time-point measurement, potentially limiting the utility of a SOFA score that was originally designed to be sequentially assessed [38]. Furthermore, changes in inflammatory cytokines during the first several days of illness may be more predictive of long-term outcomes than a single assessment [21, 32]. Our external validation set differed from our primary patient sets in several ways, including time of enrollment, the organ failure assessment, and the assay for cytokine concentration measurement. While bead-based multiplex and electrochemiluminescence assays differ in sensitivity ranges, comparable relative differences among samples have been previously reported [43]. However, these limitations likely contribute to the reduction in AUCs in the external validation set biomarker models. Quantifying the clinical utility of biomarker models is difficult outside of a randomized clinical trial [27]. While we used multiple methods to justify our conclusions, additional studies are needed to better define the clinical utility of our findings. Finally, future studies may consider biomarkers representiving alternative pathways to organ dysfunction [44, 45].
In summary, we developed and validated a 2-biomarker model for predicting 28-day mortality in melioidosis. By providing early information regarding clinical trajectory, this model potentially has widespread applicability in guiding management of patients with melioidosis.
Supplementary Data
Supplementary materials are available at Clinical Infectious Diseases online. Consisting of data provided by the authors to benefit the reader, the posted materials are not copyedited and are the sole responsibility of the authors, so questions or comments should be addressed to the corresponding author.
Notes
Acknowledgments. The authors thank the patients and staff at Sunpasithiprasong Hospital, Udon Thani Hospital, Mukdahan Hospital, and Mahidol-Oxford Tropical Medicine Research Unit, as well as Mark Wurfel and Carmen Mikacenic.
Financial support. This work was supported by the US National Institutes of Health (grant numbers T32GM086270, R01HL113382, R01AI137111, and U01AI115520) and the Wellcome Trust (grant numbers 090219/Z/09/Z and 101103/Z/13/Z).
Potential conflicts of interest. The authors: No reported conflicts of interest. All authors have submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Conflicts that the editors consider relevant to the content of the manuscript have been disclosed.
References
- 1. Limmathurotsakul D, Wongratanacheewin S, Teerawattanasook N, et al. Increasing incidence of human melioidosis in Northeast Thailand. Am J Trop Med Hyg 2010; 82:1113–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Chewapreecha C, Holden MTG, Vehkala M, et al. Global and regional dissemination and evolution of Burkholderia pseudomallei. Nat Microbiol 2017; 2:1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Hinjoy S, Hantrakun V, Kongyu S, et al. Melioidosis in Thailand: present and future. Trop Med Infect Dis 2018; 3:38. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Lauw FN, Simpson AJ, Prins JM, et al. Elevated plasma concentrations of interferon (IFN)-gamma and the IFN-gamma-inducing cytokines interleukin (IL)-18, IL-12, and IL-15 in severe melioidosis. J Infect Dis 1999; 180:1878–85. [DOI] [PubMed] [Google Scholar]
- 5. Friedland JS, Suputtamongkol Y, Remick DG, et al. Prolonged elevation of interleukin-8 and interleukin-6 concentrations in plasma and of leukocyte interleukin-8 mRNA levels during septicemic and localized Pseudomonas pseudomallei infection. Infect Immun 1992; 60:2402–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Krishnananthasivam S, Sathkumara H, Corea E, Natesan M, De Silva A. Gene expression profile of human cytokines in response to burkholderia pseudomallei infection. mSphere 2017; 2:e00121–17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Wiersinga WJ, Currie BJ, Peacock SJ. Melioidosis. N Engl J Med 2012; 367:1035–44. [DOI] [PubMed] [Google Scholar]
- 8. Limmathurotsakul D, Golding N, Dance DAB, et al. Predicted global distribution of Burkholderia pseudomallei and burden of melioidosis. Nat Microbiol 2016; 1:6–10. [DOI] [PubMed] [Google Scholar]
- 9. Minne L, Abu-Hanna A, de Jonge E. Evaluation of SOFA-based models for predicting mortality in the ICU: a systematic review. Crit Care 2008; 12:1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Lie KC, Lau CY, Van Vinh Chau N, et al. Utility of SOFA score, management and outcomes of sepsis in Southeast Asia: a multinational multicenter prospective observational study. J Intensive Care 2018; 6:1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Rudd KE, Seymour CW, Aluisio AR, et al. ; Sepsis Assessment and Identification in Low Resource Settings (SAILORS) Collaboration . Association of the quick sequential (sepsis-related) organ failure assessment (qSOFA) score with excess hospital mortality in adults with suspected infection in low- and middle-income countries. JAMA 2018; 319:2202–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Wiersinga WJ, Virk HS, Torres AG, et al. Melioidosis. Nat Rev Dis Prim 2018; 4:1–22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Mikacenic C, Hahn WO, Price BL, et al. Biomarkers of endothelial activation are associated with poor outcome in critical illness. PLoS One 2015; 10:1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Wong HR, Lindsell CJ, Pettilä V, et al. A multibiomarker-based outcome risk stratification model for adult septic shock. Crit Care Med 2014; 42:781–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Mat-Nor MB, MD Ralib A, Abdulah NZ, Pickering JW. The diagnostic ability of procalcitonin and interleukin-6 to differentiate infectious from noninfectious systemic inflammatory response syndrome and to predict mortality. J Crit Care 2016; 33:245–251. [DOI] [PubMed] [Google Scholar]
- 16. Simpson AJ, Smith MD, Weverling GJ, et al. Prognostic value of cytokine concentrations (tumor necrosis factor-alpha, interleukin-6, and interleukin-10) and clinical parameters in severe melioidosis. J Infect Dis 2000; 181:621–5. [DOI] [PubMed] [Google Scholar]
- 17. Seymour CW, Liu VX, Iwashyna TJ, et al. Assessment of clinical criteria for sepsis for the third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA 2016; 315:762–774. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Hantrakun V, Somayaji R, Teparrukkul P, et al. Clinical epidemiology and outcomes of community acquired infection and sepsis among hospitalized patients in a resource limited setting in Northeast Thailand: a prospective observational study (Ubon-sepsis). PLoS One 2018; 13:1–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Teparrukkul P, Hantrakun V, Day NPJ, West TE, Limmathurotsakul D. Management and outcomes of severe dengue patients presenting with sepsis in a tropical country. PLoS One 2017; 12:1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Pepe MS. The statistical evaluation of medical tests for classification and prediction. New York: Oxford University Press, 2003. [Google Scholar]
- 21. Kaewarpai T, Ekchariyawat P, Phunpang R, et al. Longitudinal profiling of plasma cytokines in melioidosis and their association with mortality: a prospective cohort study. Clin Microbiol Infect. In press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Teparrukkul P, Hantrakun V, Imwong M, et al. Utility of qSOFA and modified SOFA in severe malaria presenting as sepsis. PLoS One 2019; 14:1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Tibshirani R. Regression shrinkage and selection via the lasso. J R Stat Soc Ser B 1996; 58:267–88. [Google Scholar]
- 24. Pavlou M, Ambler G, Seaman S, De Iorio M, Omar RZ. Review and evaluation of penalised regression methods for risk prediction in low-dimensional data with few events. Stat Med 2016; 35:1159–77. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Hosmer DW, Hosmer T, Le Cessie S, Lemeshow S. A comparison of goodness-of-fit tests for the logistic regression model. Stat Med 1997; 16:965–80. [DOI] [PubMed] [Google Scholar]
- 26. Pencina MJ, D’Agostino Sr RB, D’Agostino Jr RB, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med 2008; 21:157–172. [DOI] [PubMed] [Google Scholar]
- 27. Cook NR. Quantifying the added value of new biomarkers: how and how not. Diagnostic Progn Res 2018; 2:1–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Andaluz-Ojeda D, Bobillo F, Iglesias V, et al. A combined score of pro- and anti-inflammatory interleukins improves mortality prediction in severe sepsis. Cytokine 2012; 57:332–6. [DOI] [PubMed] [Google Scholar]
- 29. Mikacenic C, Price BL, Harju-Baker S, et al. A two-biomarker model predicts mortality in the critically ill with sepsis. Am J Respir Crit Care Med 2017; 196:1004–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Wong HR, Cvijanovich N, Wheeler DS, et al. Interleukin-8 as a stratification tool for interventional trials involving pediatric septic shock. Am J Respir Crit Care Med 2008; 178:276–82. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Thao PTN, Tra TT, Son NT, Wada K. Reduction in the IL-6 level at 24 h after admission to the intensive care unit is a survival predictor for Vietnamese patients with sepsis and septic shock: a prospec tive study. BMC Emerg Med 2018; 18:1–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Ríos-Toro JJ, Márquez-Coello M, García-Álvarez JM, et al. Soluble membrane receptors, interleukin 6, procalcitonin and C reactive protein as prognostic markers in patients with severe sepsis and septic shock. PLoS One 2017; 12:1–18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Shimazui T, Matsumura Y, Nakada TA, Oda S. Serum levels of interleukin-6 may predict organ dysfunction earlier than SOFA score. Acute Med Surg 2017; 4:255–61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Henning DJ, Hall MK, Watsjold BK, et al. Interleukin-6 improves infection identification when added to physician judgment during evaluation of potentially septic patients. Am J Emerg Med . In press. [DOI] [PubMed] [Google Scholar]
- 35. Moore CC, Hazard R, Saulters KJ, et al. Derivation and validation of a universal vital assessment (UVA) score: a tool for predicting mortality in adult hospitalised patients in Sub-Saharan Africa. BMJ Glob Heal 2017; 2:1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Riviello ED, Kiviri W, Fowler RA, et al. Predicting mortality in low-income country icus: the Rwanda mortality probability model (R-MPM). PLoS One 2016; 11:1–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Haniffa R, Mukaka M, Munasinghe SB, et al. Simplified prognostic model for critically ill patients in resource limited settings in South Asia. Crit Care 2017; 21:1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Vincent JL, Moreno R, Takala J, et al. Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. Intensive Care Med 1996; 22:707–10. [DOI] [PubMed] [Google Scholar]
- 39. van Engelen TSR, Wiersinga WJ, Scicluna BP, van der Poll T. Biomarkers in sepsis. Crit Care Clin 2018; 34:139–52. [DOI] [PubMed] [Google Scholar]
- 40. Lubell Y, Blacksell SD, Dunachie S, et al. Performance of C-reactive protein and procalcitonin to distinguish viral from bacterial and malarial causes of fever in Southeast Asia. BMC Infect Dis 2015; 15:1–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Drain PK, Hyle EP, Noubary F, et al. Diagnostic point-of-care tests in resource-limited settings. Lancet Infect Dis 2014; 14:239–49. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Semret M, Ndao M, Jacobs J, Yansouni CP. Point-of-care and point-of-“can”: leveraging reference-laboratory capacity for integrated diagnosis of fever syndromes in the tropics. Clin Microbiol Infect 2018; 24:836–44. [DOI] [PubMed] [Google Scholar]
- 43. Chowdhury F, Williams A, Johnson P. Validation and comparison of two multiplex technologies, Luminex and Mesoscale Discovery, for human cytokine profiling. J Immunol Methods 2009; 340:55–64. [DOI] [PubMed] [Google Scholar]
- 44. Su L, Liu D, Chai W, Liu D, Long Y. Role of sTREM-1 in predicting mortality of infection: a systematic review and meta-analysis. BMJ Open 2016; 6:1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Ricciuto DR, dos Santos CC, Hawkes M, et al. Angiopoietin-1 and angiopoietin-2 as clinically informative prognostic biomarkers of morbidity and mortality in severe sepsis. Crit Care Med 2011; 39:702–10. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.