Abstract
Objective
The Sequential Organ Failure Assessment (SOFA) score has been recommended for triage during a mass influx of critically-ill patients, but requires laboratory measurement of four parameters which may be impractical with constrained resources. We hypothesized that a modified SOFA (MSOFA) score that requires only one laboratory measurement would predict patient outcome as well as the SOFA score.
Methods
After a retrospective derivation, in a prospective observational study in a 24-bed medical, surgical, and trauma intensive care unit, we determined serial SOFA and MSOFA scores on all patients admitted during calendar year 2008 and compared ability to predict mortality and need for mechanical ventilation.
Results
1,770 patients (56% male) with a 30-day mortality of 10.5% were included in the study. Day 1 SOFA and MSOFA scores performed equally well at predicting mortality with an area under the receiver operating curve (AUC) of 0.83 (95% CI: 0.81-0.85) and 0.84 (95% CI 0.82-0.85) respectively (p=0.33 for comparison). Day 3 SOFA and MSOFA predicted mortality for the 828 patients remaining in the ICU with an AUC of 0.78 and 0.79 respectively. Day 5 scores performed less well at predicting mortality. Day 1 SOFA and MSOFA predicted need for mechanical ventilation on Day 3 with an AUC of 0.83 and 0.82 respectively. Mortality for the highest category of SOFA and MSOFA score (>11 points) was 53% and 58% respectively.
Conclusions
The MSOFA predicts mortality as well as the SOFA and is easier to implement in resource-constrained settings, but using either score as a triage tool would exclude many patients who would otherwise survive.
Keywords: Critical care triage, Intensive care unit, Pandemic, Disaster
Introduction
In an influenza pandemic, natural disaster, or man-made disaster a mass influx of critically ill patients could overwhelm existing intensive care unit (ICU) resources. In this setting it would be helpful to predict which patients in the ICU will not survive despite full care as well as those who require ongoing critical care resources, such as mechanical ventilators, so that equipment and personnel needs are anticipated. It may also be necessary to triage patients already in the ICU to reserve resources for those most likely to benefit from them. Useful triage tools would predict which patients have the greatest chance of survival, which patients are likely to die, and which patients will require mechanical ventilation. These are important issues not only for initial allocation of resources, but also for reallocation of resources over time to support ongoing needs of survivors of critical illness. The goals of this study are to evaluate the Sequential Organ Failure Assessment (SOFA) score, and a simpler Modified Sequential Organ Failure Assessment Score (MSOFA), for their ability to predict mortality and the need for mechanical ventilation in critically ill patients after admission to the ICU.
The SOFA score is a validated measure of organ failure over time and a predictor of mortality in critically ill patients1-3 that has been incorporated into triage protocols for critical care in the event of an influenza pandemic or a mass influx of patients during a disaster.4-7 The SOFA score combines a clinical assessment of two organ systems, cardiovascular and central nervous system, with laboratory measurements for evaluation of four other organ systems: respiratory, hematologic, liver, and renal (Table 1). The requirement for arterial and venous blood specimens from each patient in order to calculate a SOFA score may prove impractical with a large number of patients and constrained resources. Given this limitation, we created a simpler Modified Sequential Organ Failure Assessment (MSOFA) score8 (Table 2) to minimize reliance on laboratory resources. The MSOFA score eliminates the platelet count, replaces partial pressure of arterial oxygen (PaO2) with arterial oxygen saturation measured by a pulse oximeter (SpO2), and replaces serum bilirubin with clinical assessment of scleral icterus or jaundice (Table 3). The only laboratory value required for the MSOFA is creatinine, which can be measured using a bedside point-of-care testing device.
TABLE 1.
Sequential Organ Failure Assessment (SOFA) Score 1-2
Organ System | 0 | 1 | 2 | 3 | 4 |
---|---|---|---|---|---|
Respiratory PaO2/FiO2, mmHg |
>400 | ≤400 | ≤300 | ≤200 | ≤100 |
Coagulation Platelets x103/μL |
>150 | ≤150 | ≤100 | ≤50 | ≤20 |
Liver Bilirubin, mg/dL |
<1.2 | 1.2-1.9 | 2.0-5.9 | 6.0-11.9 | >12.0 |
Cardiovascular, hypotension |
No hypo- tension |
MAP <70 mm Hg |
dopamine≤5 or dobutamine any dose |
dopamine>5 epinephrine≤0.1 norepinephrine≤0.1 |
dopamine>15 epinephrine>0.1 norepinephrine>0.1 |
CNS, Glasgow Coma Score |
15 | 13-14 | 10-12 | 6-9 | <6 |
Renal, Creatinine mg/dL urine output mL/d |
<1.2 | 1.2-1.9 | 2.0-3.4 | 3.5-4.9 or urine <500 mL/d |
>5.0 or urine<200 mL/d |
MAP=mean arterial pressure
dopamine, dobutamine, epinephrine, and norepinephrine doses in micrograms per kilogram per minute
CNS=central nervous system
TABLE 2.
Modified Sequential Organ Failure Assessment (MSOFA) Score
Organ System | 0 | 1 | 2 | 3 | 4 |
---|---|---|---|---|---|
Respiratory SpO2/FiO2 |
>400 | ≤400 | ≤315 | ≤235 | ≤150 |
Liver | No scleral icterus or jaundice |
Scleral icterus or jaundice |
|||
Cardiovascular, hypotension |
No hypo- tension |
MAP <70 mm Hg |
dopamine≤5 or dobutamine any dose |
dopamine>5 epinephrine≤0.1 norepinephrine≤0.1 |
dopamine>15 epinephrine>0.1 norepinephrine>0.1 |
CNS, Glasgow Coma Score |
15 | 13-14 | 10-12 | 6-9 | <6 |
Renal, Creatinine mg/dL |
<1.2 | 1.2-1.9 | 2.0-3.4 | 3.5-4.9 | >5.0 |
MAP=mean arterial pressure
dopamine, dobutamine, epinephrine, and norepinephrine doses in micrograms per kilogram per minute
CNS=central nervous system
Table 3.
Comparison of the SOFA and M-SOFA scores
Organ System | SOFA score | MSOFA score |
---|---|---|
Respiratory | PaO2/FIO2 ratio | SpO2/FIO2 ratio |
Coagulation | Platelet Count x103/μL | Not scored |
Liver | Bilirubin level, mg/dL | Scleral icterus or jaundice |
Cardiovascular | Hypotension or vasopressors | Same as SOFA score |
Central Nervous System (CNS) | Glasgow Coma Score (GCS) | Same as SOFA score |
Renal | Creatinine mg/dl or urine output | Same as SOFA score |
PaO2/FIO2 ratio: partial pressure of arterial oxygen divided by the fraction of inspired oxygen
SpO2/FIO2 ratio : arterial oxygen saturation measured by a pulse oximeter divided by the fraction of inspired oxygen
We hypothesized that the MSOFA score would predict mortality and need for mechanical ventilation as well as the SOFA score and thus could be utilized in triage protocols in resource-constrained critical care environments during a disaster or pandemic. We initially compared the MSOFA to the SOFA in a preliminary study using retrospective data from patients admitted to a 12-bed medical, surgical, and trauma ICU at LDS Hospital in Salt Lake City, Utah, during calendar year 2006. Based on this analysis, we then prospectively compared the MSOFA with the SOFA in patients admitted to a 24-bed medical, surgical, and trauma ICU at Intermountain Medical Center in Murray, Utah, during calendar year 2008.
Methods
In developing the MSOFA score we identified bedside clinical parameters and electronic medical record data that could function as surrogates for evaluation of respiratory and liver system organ function in the SOFA score. The cardiovascular, central nervous system (CNS), and renal scores for the MSOFA score remained the same as the SOFA score (Tables 1 - 3). We eliminated the hematologic system from the MSOFA score so 5 organ systems are scored on a 0 to 4 scale according to specified criteria indicating severity, with a maximum score of 19 (Table 2). For the SOFA score 6 organ systems are scored with a maximum score of 24 (Table 1).
To calculate the respiratory component of the MSOFA score, the SpO2 is divided by the fraction of inspired oxygen (FIO2) to calculate a SpO2/FIO2 ratio. For patients on nasal flow oxygen, we estimated FIO2 by multiplying the liter flow per minute by 0.03 and adding that to 0.21. The SpO2/FIO2 ratio has been validated separately as a surrogate for the PaO2/FIO2 ratio employed by the SOFA score.9-10The liver portion of the MSOFA score requires observation of scleral icterus or jaundice documented by the bedside nurse.
MSOFA and SOFA scores were determined from parameters at the end of 24-hour time periods relative to ICU admission. For Day 1 the time period was 6 hours before ICU admission to 18 hours after, for Day 3 the time period was 48-72 hours after ICU admission, and for Day 5 the time period was 96120 hours after ICU admission. Scores were only calculated for patients who were alive and in the ICU for the entire duration of the Day 1, Day 3, or Day 5 scoring period. The SOFA and MSOFA score on Day 1 included only those patients who had survived the entire initial 18 hours in the ICU. The SOFA and MSOFA score on Day 3 and 5 included only those patients who had survived at least 72 hours and 120 hours respectively and remained in the ICU at the end of the scoring period. We used only laboratory measurements that were obtained for the care of the patient during the specified time periods for the calculation of the MSOFA or SOFA scores. We selected the worst values for each parameter in the specified time period except for the GCS as was done in the primary studies on the SOFA score.1 For the GCS we selected the maximum score in the 24 hour period. In the primary study on the SOFA, the presumed GCS was used for sedated patients.1 Our standard is to chart the actual GCS determined regardless of sedation or paralysis, and therefore to evaluate the contribution of the GCS to the SOFA score, we also analyzed our data using the minimum GCS in 24 hours for comparison. For a missing value, we used the closest available value up to 4 hours before the 24 hour scoring interval. Where no value was available, the predictor was assumed to be normal and given a score of 0.
The LDS Hospital and Intermountain Medical Center are both Intermountain Healthcare Hospitals and have mature electronic clinical information systems that include electronic charting of scleral icterus and jaundice, which allowed us to retrospectively determine the MSOFA and SOFA scores on ICU admission for every patient admitted to the LDS Hospital Shock Trauma Respiratory ICU in 2006. For the prospective study of the MSOFA and SOFA scores in the Shock Trauma ICU at Intermountain Medical Center, we instructed clinical nursing staff of the study and specifically trained them to document jaundice consistently within the electronic medical record. All other components of the MSOFA and SOFA score that required clinical evaluation were part of standard nursing bedside charting. The Institutional Review Board of LDS Hospital and Intermountain Medical Center, Intermountain Healthcare, Utah, USA, approved this observational study with waiver of informed consent.
Endpoints used for validation of the SOFA and MSOFA sore were 30-day all cause mortality and need for mechanical ventilation on Day 3 and Day 5. Mechanical ventilation was prospectively recorded on all patients and need for ventilation was defined as any receipt of mechanical ventilation on the relevant study day.
Statistical Methods
We compared MSOFA score mortality prediction to the SOFA score by areas under the receiver operating characteristic curve (AUC) using the technique of DeLong11 and calculated an exact binomial confidence interval for the AUC. In the 2006 retrospective study, the MSOFA score performed well, but the evaluation revealed the need to standardize charting of jaundice by the nursing staff when they identified a patient with jaundice. This was done in 2007 and the prospective evaluation began in 2008.
In order to investigate the relevance of the evolution of organ dysfunction to mortality prediction for patients with scores on Day 1, 3, and 5 during their ICU stay, we evaluated several summarization and trending transformations in a logistic regression model for both MSOFA and SOFA. For the Day 3 model, we evaluated quantitative and qualitative change, summed scores, maximum score, and a linear prediction of the Day 5 score. For the Day 5 model, we included everything from the Day 3 model (incorporating the Day 1 and Day 3 scores only, the Day 3 and Day 5 scores only, and all three days’ scores). Additionally, we fitted a non-linear prediction model for Day 5 to the available scores. The utility of adding additional terms to the model was evaluated within a forward stepwise bootstrap procedure. The “out of bag” sample was used to avoid a biased estimate of AUC due to over fitting.12-13 The most recent MSOFA was always selected first. Additional predictors were maintained in the model only if they significantly increased the AUC. A subsequent 1,000 bootstrap sample estimate was used to confirm these findings.
In a secondary analysis we evaluated the Day 1 scores as predictors of receipt of mechanical ventilation on Day 3 and Day 5, comparing AUCs using the technique of DeLong11 and calculating exact binomial confidence intervals for the AUC.
Analyses were performed using the R statistical package, version 2.9.114 and MedCalc statistical software, version 11.3.8 (MedCalc Software, Belgium).
Results
The retrospective derivation cohort in 2006 included 718 patients (58% male) with a 30-day inpatient mortality of 17.3%. In the 2006 cohort, Day 1 SOFA and MSOFA scores predicted 30-day mortality with an AUC of 0.78 (95% CI: 0.74-0.82) and 0.77 (95% CI: 0.73-0.82) respectively (p>0.2 for comparison).
In 2008 1,803 patients (56% male) were admitted to the STICU with a mortality of 12.1%. Of those 1,803 patients, 33 patients died during the Day 1 scoring period and were excluded from the analysis. The prospective study cohort in 2008 included 1,770 patients (56% male) with a 30-day mortality of 10.5%. Comparison of the 2006 preliminary study retrospective cohort and the 2008 prospective cohort is made in Table 4. Figure 1 shows flow of patients admitted to the STICU in 2008 and the number of patients included in the 2008 prospective Day 1, 3, and 5 analyses. Table 5 shows the percent missing values for parameters collected for organ system scoring in calculating the SOFA and MSOFA scores during each scoring period. Table 6 shows characteristics of survivors versus non-survivors in the 2008 prospective study including differences in SOFA and MSOFA scores.
Table 4.
Comparison of 2006 and 2008 Groups
Year | 2006 Retrospective | 2008 Prospective |
---|---|---|
Number of intensive care unit beds | 12 | 24 |
Total number of patients | 718 | 1770 |
male, No. (%) | 415 (58) | 985 (56) |
age, mean (SD), years | 50 ±20 | 53 ±20 |
30-day mortality, No. (%) | 124 (17) | 185 (10.5) |
Patients requiring mechanical ventilation, No. (%) | 457 (64) | 567 (32) |
Medical patients, No. (%) | 292 (41) | 991 (56) |
Post-operative surgical patients, No. (%) | 95 (13) | 244 (14) |
Trauma and traumatic brain injury patients, No. (%) | 238 (33) | 495 (28) |
Neurologic critical care patients, No. (%) | 93 (13) | 40 (2) |
Figure 1.
Flow chart showing the number of patients included in each scoring period.
Table 5.
Missing Values for Parameters Used in Organ System Score for SOFA and MSOFA
Parameter | Used in Scoring SOFA or MSOFA |
Day 1 % Missing Values |
Day 3 % Missing Values |
Day 5 % Missing Values |
---|---|---|---|---|
Respiraotry PaO2/FiO2 |
SOFA only | 56 | 70 | 58 |
Respiratory SpO2/FiO2 |
MSOFA only | 0.01 | 4 | 3 |
Hematology - platelet count |
SOFA only | 0.02 | 7 | 5 |
Liver – bilirubin | SOFA only | 14 | 56 | 56 |
Liver – jaundice or scleral icterus |
MSOFA only | 0 (only abnormal findings charted) |
0 (only abnormal findings charted) |
0 (only abnormal findings charted) |
Cardiovascular – blood pressure and vasopressors |
SOFA and MSOFA | 0 | 1 | 0.5 |
CNS - Glasgow Coma Score |
SOFA and MSOFA | 0 | 2 | 2 |
Renal - creatinine | SOFA and MSOFA | 0.06 | 5 | 3 |
Table 6.
Comparison of Survivors and Non-Survivors in the 2008 Prospective Study
Survivors | Non-Survivors | |
---|---|---|
Total number of patients | 1585 | 185 |
male, No. (%) | 56% | 52% |
age, mean (SD), years | 52.4 ±20 years | 62.6 ±18.5 years* |
Mean SOFA Score Day 1 | 3.8 ±3.2 | 8.9 ±4.2* |
Mean MSOFA Score Day 1 | 4.6 ±2.7 | 8.7 ±3.2* |
Respiratory MSOFA Score | 2.4 ±1.4 | 3.4 ±1.1* |
Liver MSOFA Score | 0.1 ±0.6 | 0.1 ±0.5 |
Cardiovascular MSOFA Score | 1.0 ±1.0 | 2.1 ±1.6* |
CNS MSOFA Score | 0.3 ±0.7 | 1.8 ±1.5* |
Renal MSOFA Score | 0.7 ±1.1 | 1.1 ±1.1* |
p<0.05 by unpaired t-test
In the 1,770 patients alive at the end of the Day 1 scoring period, the SOFA score calculated using the maximum GCS gave a greater AUC (0.83, 95% CI: 0.81-0.85) as compared to the SOFA score calculated using the minimum GCS (AUC 0.81, 95% CI: 0.79-0.83) (p<0.001). The Day 1 MSOFA score calculated using the maximum GCS gave a greater AUC (0.84, 95% CI: 0.82-0.85) as compared to the MSOFA score calculated using the minimum GCS (AUC 0.82, 95% CI: 0.80-0.84) (p<0.001). Because the SOFA and MSOFA calculated using the maximum GCS on Day 1 performed better than the SOFA and MSOFA calculated using the minimum GCS, we used the SOFA and MSOFA scores calculated using the maximum GCS in all further analyses.
There was no difference between the Day 1 SOFA and MSOFA scores (p=0.33) for predicting mortality (Figure 2). For Day 3, SOFA and MSOFA scores performed similarly well at predicting mortality for the 828 patients remaining in the ICU, with an AUC of 0.78 (95% CI: 0.75-0.81) and 0.79 (95% CI: 0.76-0.82) respectively (p=0.45). For Day 5, SOFA and MSOFA scores performed less well at predicting mortality on the 369 patients remaining in the ICU, with an AUC of 0.72 (95% CI: 0.67-0.76) and 0.74 (95% CI: 0.70-0.79) respectively (p=0.21). None of the novel predictors added significantly to the AUC for the Days 1, 3, or 5 prediction.
Figure 2.
Panel a Mortality by Day 1 SOFA and MSOFA score for prospectively collected data of patients admitted to the Shock Trauma ICU at Intermountain Medical Center during calendar year 2008.
Panel b Analysis of area under the receiver operating curve (AUC) for Day 1 SOFA and MSOFA prediction of mortality in the 2008 cohort.
The Day 1 SOFA and MSOFA scores predicted the need for mechanical ventilation on Day 3 with an AUC of 0.83 (95% CI: 0.81-0.84) and 0.82 (95% CI: 0.80-0.84) respectively (p=0.43). Of the 828 patients remaining in the ICU on Day 3, 208 (25.1%) were receiving mechanical ventilation. The Day 1 SOFA and MSOFA scores predicted the need for mechanical ventilation on Day 5 with an AUC of 0.76 (95% CI: 0.74-0.78) for both (p=0.81). Of the 369 patients remaining in the ICU on Day 5, 146 (40.0%) were receiving mechanical ventilation.
Previously published pandemic influenza triage protocols use threshold values of SOFA scores >11 for exclusion from ICU admission, 8-11 for intermediate priority, and <8 for high priority for ICU admission.4-6 Mortality for threshold levels of MSOFA and SOFA scores are shown in Figure 1, Panel A. Day 1 SOFA scores in the 2008 study had 1,450 patients with a score of 0-7 and mortality of 5% (70 patients), 216 patients with a score of 8-11 and a mortality of 28% (60 patients), and 104 patients with a score of >11 and a mortality of 53% (55 patients). Day 1 MSOFA scores in the 2008 study had 1,440 patients with a score of 0-7 and mortality of 4% (64 patients), 259 patients with a score of 8-11 and a mortality of 31% (80 patients), and 71 patients with a score of >11 and a mortality of 58% (41 patients).
We performed sub group analysis for prediction of mortality from Day 1 SOFA or MSOFA score for medical patients (Table 4, n=991, 13% mortality), post-operative surgical patients (n=244, 4% mortality), and trauma patients (n=495, 8% mortality). Among the medical patients Day 1 SOFA and MSOFA score predicted mortality with an AUC of 0.82 (95% CI: 0.0.79-0.84) and 0.82 (95% CI: 0.80-0.85) respectively (p=0.59). In the post-operative surgical patients Day 1 SOFA and MSOFA score predicted mortality with an AUC of 0.70 (95% CI: 0.64-0.76) and 0.84 (95% CI: 0.79-0.88) respectively (p=0.024). In the trauma patients Day 1 SOFA and MSOFA score predicted mortality with an AUC of 0.87 (95% CI: 0.0.84-0.90) and 0.84 (95% CI: 0.80-0.87) respectively (p=0.03).
Discussion
Future H1N1 influenza pandemics15-16, outbreaks of avian influenza17-20, natural disasters7, or man-made disasters may overwhelm critical care capacities. The number of available mechanical ventilators and ICU beds may not be sufficient for the number of affected persons.21-23 Understanding which patients are most likely to benefit from receiving critical care resources may allow for triage of patients in a manner that provides the highest likelihood of survival for the most people. Complex mortality prediction models are labor- and resource- intensive and would be difficult to apply in a mass patient influx.24-25 Algorithms specific to mass casualty trauma triage26 are not generalizable for a mass influx of influenza patients or for the general population of non-trauma critically ill patients that will compete for critical care resources during a pandemic. A simple triage scoring system focusing on age, respiratory failure, and shock index for use during epidemics has been validated in a cohort of emergency department patients admitted to the hospital with non-surgical infection and performed moderately well at predicting mortality (AUC 0.73) or need for mechanical ventilation (AUC 0.68)22, but restriction of the cohort to infected patients limits generalizability to triage of acutely injured patients.
The SOFA score has been recommended as a tool in critical care triage4-7, 27 because of ease of calculation if the required laboratory tests are available and validation in a wide variety of critically ill patients.1-3 Reliance on multiple laboratory values, however, may make application impractical during mass critical care triage. We showed that an equivalent mortality prediction can be performed with an MSOFA score using variables easily collected at the bedside. A much smaller study of 144 surgical ICU patients in Indonesia suggested the utility of the MSOFA with an equivalent mortality prediction to the SOFA score.28 In our prospective study, the MSOFA score predicted mortality with a high AUC of 0.84 that was equivalent to that of SOFA. The MSOFA score also performed well in predicting mortality after 3 days of ICU stay with an AUC of 0.79, again equivalent to the SOFA score. Prediction of mortality at day 5 of ICU stay in 369 critically ill patients was less robust for both the MSOFA and SOFA scores, which is a limitation for application of the SOFA and MSOFA to predict outcomes during the ICU stay. Both the SOFA and MSOFA scores have been proposed as tools to re-triage patients during their ICU course and the degradation of predictive utility over time may have implications for published protocols.4-5, 7-8Beyond mortality, the initial SOFA and MSOFA scores both predicted ongoing requirements for mechanical ventilation with no clear difference between them.
In the sub-group analysis separating medical, surgical, and trauma patients the SOFA and MSOFA performed equally well at predicting mortality in medical patients (AUC 0.82 for both). The MSOFA (AUC 0.84) performed much better at predicting mortality than the SOFA (AUC 0.70) in the post-operative surgical patients (p=0.024), but the mortality was low (4%) and the number of patients (244) was small, so the significance is unclear. In the larger group of trauma patients (n=495) with an 8% mortality both the SOFA and MSOFA performed well with an AUC of 0.87 and 0.84 respectively (p=0.03). Medical and trauma patients are those most relevant to mass casualty and triage.
A convenient result of our study is that the MSOFA and SOFA scores directly correlate in the range of the thresholds used in pandemic influenza triage plans where a score of >11 excludes a patient from critical care, while a score of 8-11 is an intermediate priority, and <8 a high priority for critical care.4-5 The MSOFA score predicts mortality in these categories equally as well as the SOFA score at the relevant thresholds of 8 and 11 (Figure 1). The SOFA and MSOFA, however, have different scoring ranges (0 to 24 for SOFA and 0 to 19 for MSOFA) and it will require further study to confirm that they can be used interchangeably. The threshold MSOFA and SOFA score of >11 used to exclude patients from critical care includes only about 6% of total patients in our cohort and up to 40% of the excluded patients would survive in a setting where ample critical care resources were available. This emphasizes that these scoring systems can only be one part of an overall system of triage. We specifically did not evaluate the effect of significant co-morbidities on triage which is included in published triage protocols that use SOFA or MSOFA.5, 8, 27
A recent study emphasizes that the practical implementation of a triage system that includes a SOFA score requires training for those who will act as triage officers, and protocol modification to minimize the exclusion from critical care of patients who may in fact benefit.29 Findings in that same study suggested that application of a SOFA score based critical care triage protocol could direct scarce resources to patients who are most likely to benefit from them while increasing resource availability.29Two other recent studies, however, have raised concern about using a SOFA score based critical care triage. One small study evaluating application of the SOFA score retrospectively for critical care triage to 8 patients with H1N1 influenza found that 5 survivors would have been candidates for withdrawal of life support according to a SOFA score triage at 48 hours.30 A larger study applying SOFA score triage criteria to a mix of 255 patients admitted to an ICU found that 116 patients with 39% survival would have been denied admission.31 The results of these studies and our study suggest that further evaluation and public discussion is necessary to refine a plan for allocation of scarce resources and life-sustaining treatments during a public health emergency with a mass influx of critically ill or injured patients.32-34
The results from our study and others29-31 suggests that a large number of critically-ill patients who have SOFA or MSOFA scores >11 might survive in a mass critical care patient influx, such as an influenza pandemic, and require ongoing care and the need for resource re-allocation. For example, patients critically-ill with pandemic influenza and SOFA scores >11 might be delegated in a triage system to receive a free-standing continuous positive airway pressure (CPAP) system with an FIO2 of 1.0, rather than positive pressure mechanical ventilation, in order to conserve mechanical ventilators for those who have the greatest chance of survival. Some of those patients delegated to CPAP will survive and may have SOFA or MSOFA scores that improve and put them ahead of other critically-ill patients for allocation of resources. Scenarios such as this not only include resource allocation, but also resource re-allocation, and will require further study and careful planning.
A limitation of our study is the focus on triage of patients after admission to the ICU, rather than prior to ICU admission. Determination of which critically ill patients should be admitted to an ICU is an important component of mass critical care triage. The SOFA score has been applied to initial critical care triage in some published triage protocols4-7, even though the SOFA score has only been validated as a severity of illness score for patients in the ICU.1-2 The MSOFA score performed similarly to the SOFA score in our study, suggesting that the MSOFA may also be useful for initial triage for admission to the ICU from the emergency department. The Day 1 data in our study reflect the acute presentation of critically ill patients because the majority of admissions to our ICU come through the emergency department (75%), and the time spent in the emergency department for patients admitted to the STICU during 2008 was brief, 3.7 ±2.0 hours. Further study is warranted to determine the utility of the SOFA or MSOFA scores for triage of critically ill patients in the emergency department for admission to the ICU.
Conclusion
The MSOFA score predicts mortality in critically ill patients as well as the SOFA score and is easier to implement in resource-constrained or pandemic settings. The mortality in the highest scoring group with an SOFA or MSOFA of >11 was only 53-58%, which means that implementation of either the MSOFA or SOFA score as a triage tool during a mass influx of critically ill patients would exclude a significant number of patients who would survive with usual critical care resources. Our findings are consistent with recommendations that a triage tool including the SOFA or MSOFA score should only be applied when critical care resources are overwhelmed and all efforts to obtain additional resources have been instituted7, 27, and should be combined with criteria that exclude patients based on co-morbid conditions that increase mortality5, 8. These are serious issues for consideration and warrant further study and careful ethical and social discussion.
Acknowledgments
The authors thank the Shock Trauma Intensive Care unit attending staff at Intermountain Medical Center for their support of this study: Dr. Don VanBoerum, Dr. Tom White, Dr. Steve Granger, Dr. Frank Thomas, Dr. Ellie Hirshberg, and Dr. Nathan Dean; and the authors thank the members of the Utah Hospital Association Pandemic Influenza Triage Committee chaired by Dr. Brent Wallace, Chief Medical Officer of Intermountain Healthcare.
This work was supported by The Heart and Lung Foundation and the Easton Family Fund of the Deseret Foundation, Intermountain Medical Center, Murray, Utah, USA.
References
- 1.Ferreira FL, Bota DP, et al. Serial evaluation of the SOFA score to predict outcome in critically ill patients. JAMA. 2001;286:1754–1758. doi: 10.1001/jama.286.14.1754. [DOI] [PubMed] [Google Scholar]
- 2.Vincent JL, Moreno R, Takala J, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996;22:707–710. doi: 10.1007/BF01709751. [DOI] [PubMed] [Google Scholar]
- 3.Cabre L, Mancebo J, et al. Multicenter study of the multiple organ dysfunction syndrome in intensive care units: the usefulness of Sequential Organ Failure Assessment scores in decision making. Intensive Care Med. 2005;31:927–933. doi: 10.1007/s00134-005-2640-2. [DOI] [PubMed] [Google Scholar]
- 4.Hick JL. O'Laughlin DT. Concept of operations for triage of mechanical ventilation in an epidemic. Acad Emerg Med. 2006;13:223–229. doi: 10.1197/j.aem.2005.07.037. [DOI] [PubMed] [Google Scholar]
- 5.Christian MD, Hawryluck L, Wax RS, et al. Development of a triage protocol for critical care during an influenza pandemic. CMAJ. 2006;175:1377–1381. doi: 10.1503/cmaj.060911. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Powell T, Christ KC, Birkhead GS. Allocation of ventilators in a public health disaster. Disaster Med Public Health Prep. 2008;2:20–26. doi: 10.1097/DMP.0b013e3181620794. [DOI] [PubMed] [Google Scholar]
- 7.Devereaux AV, Dichter JR, Christian MD, et al. Definitive care for the critically ill during a disaster: a framework for allocation of scarce resources in mass critical care: from a Task Force for Mass Critical Care summit meeting; Chicago, IL. Chest.. 2007. 2008. pp. 51S–66S. [DOI] [PubMed] [Google Scholar]
- 8.Utah Hospitals and Health Systems Association Utah Pandemic Influenza Hospital and ICU Triage Guidelines. [pdf file] Disaster Preparedness Resource Page. 2009 Available at: http://www.uha-utah.org/DisasterPrep.htm. Accessed September 4, 2009.
- 9.Rice TW, Wheeler AP, et al. Comparison of the SpO2/FIO2 ratio and the PaO2/FIO2 ratio in patients with acute lung injury or ARDS. Chest. 2007;132:410–417. doi: 10.1378/chest.07-0617. [DOI] [PubMed] [Google Scholar]
- 10.Pandharipande PP, Shintani AK, Hagerman HE, et al. Derivation and validation of Spo2/Fio2 ratio to impute for Pao2/Fio2 ratio in the respiratory component of the Sequential Organ Failure Assessment score. Crit Care Med. 2009;37:1317–1321. doi: 10.1097/CCM.0b013e31819cefa9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837–845. [PubMed] [Google Scholar]
- 12.Efron B, Tibshirani R. Improvements on cross-validation: The .632+ bootstrap method. Journal of the American Statistical Association. 1997;92:548–560. [Google Scholar]
- 13.Harrell FE. J. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. Springer; New York: 2001. [Google Scholar]
- 14.R: A language and environment for statistical computing. [computer program]. Version 2.9.1. R Foundation for Statistical Computing; Vienna, Austria: 2009. [Google Scholar]
- 15.Chowell G, Bertozzi SM, Colchero MA, et al. Severe respiratory disease concurrent with the circulation of H1N1 influenza. N Engl J Med. 2009;361:674–679. doi: 10.1056/NEJMoa0904023. [DOI] [PubMed] [Google Scholar]
- 16.Perez-Padilla R, de la Rosa-Zamboni D, Ponce de Leon S, et al. Pneumonia and respiratory failure from swine-origin influenza A (H1N1) in Mexico. N Engl J Med. 2009;361:680–689. doi: 10.1056/NEJMoa0904252. [DOI] [PubMed] [Google Scholar]
- 17.Abdel-Ghafar AN, Chotpitayasunondh T, Gao Z, et al. Update on avian influenza A (H5N1) virus infection in humans. N Engl J Med. 2008;358:261–273. doi: 10.1056/NEJMra0707279. [DOI] [PubMed] [Google Scholar]
- 18.Arabi Y, Gomersall CD, Ahmed QA, et al. The critically ill avian influenza A (H5N1) patient. Crit Care Med. 2007;35:1397–1403. doi: 10.1097/01.CCM.0000262940.34596.4B. [DOI] [PubMed] [Google Scholar]
- 19.Beigel JH, Farrar J, Han AM, et al. Avian influenza A (H5N1) infection in humans. N Engl J Med. 2005;353:1374–1385. doi: 10.1056/NEJMra052211. [DOI] [PubMed] [Google Scholar]
- 20.Gruber PC, Gomersall CD, Joynt GM. Avian influenza (H5N1): implications for intensive care. Intensive Care Med. 2006;32:823–829. doi: 10.1007/s00134-006-0148-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Bartlett JG. Planning for avian influenza. Ann Intern Med. 2006;145:141–144. doi: 10.7326/0003-4819-145-2-200607180-00133. [DOI] [PubMed] [Google Scholar]
- 22.Talmor D, Jones AE, Rubinson L, et al. Simple triage scoring system predicting death and the need for critical care resources for use during epidemics. Crit Care Med. 2007;35:1251–1256. doi: 10.1097/01.CCM.0000262385.95721.CC. [DOI] [PubMed] [Google Scholar]
- 23.Carr BG, Addyson DK, Kahn JM. Variation in critical care beds per capita in the United States: implications for pandemic and disaster planning. JAMA. 2010;303:1371–1372. doi: 10.1001/jama.2010.394. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Le Gall JR, Lemeshow S, Leleu G, et al. Customized probability models for early severe sepsis in adult intensive care patients. Intensive Care Unit Scoring Group. JAMA. 1995;273:644–650. [PubMed] [Google Scholar]
- 25.Lemeshow S, Le Gall JR. Modeling the severity of illness of ICU patients. A systems update. JAMA. 1994;272:1049–1055. [PubMed] [Google Scholar]
- 26.Garner A, Lee A, Harrison K, et al. Comparative analysis of multiple-casualty incident triage algorithms. Ann Emerg Med. 2001;38:541–548. doi: 10.1067/mem.2001.119053. [DOI] [PubMed] [Google Scholar]
- 27.Christian MD, Joynt GM, Hick JL, et al. Critical care triage. Recommendations and standard operating procedures for intensive care unit and hospital preparations for an influenza epidemic or mass disaster. Intensive Care Med. 2010;36(Suppl 1):S55–64. doi: 10.1007/s00134-010-1765-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Halim DA, Murni TW, Redjeki IS. Comparison of Apache II, SOFA, and Modified SOFA scores in predicting mortality of surgical patients in intensive care unit at Dr. Hasan Sadikin General Hospital. Crit Care & Shock. 2009;12:157–169. [Google Scholar]
- 29.Christian MD, Hamielec C, Lazar NM, et al. A retrospective cohort pilot study to evaluate a triage tool for use in a pandemic. Crit Care. 2009;13:R170. doi: 10.1186/cc8146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Khan Z, Hulme J, Sherwood N. An assessment of the validity of SOFA score based triage in H1N1 critically ill patients during an influenza pandemic. Anaesthesia. 2009;64:1283–1288. doi: 10.1111/j.1365-2044.2009.06135.x. [DOI] [PubMed] [Google Scholar]
- 31.Guest T, Tantam G, Donlin N, et al. An observational cohort study of triage for critical care provision during pandemic influenza: 'clipboard physicians' or 'evidenced based medicine'? Anaesthesia. 2009;64:1199–1206. doi: 10.1111/j.1365-2044.2009.06084.x. [DOI] [PubMed] [Google Scholar]
- 32.Christian MD, Sandrock CE, Devereaux A, et al. Ethical issues and the allocation of scarce resources during a public health emergency. Ann Intern Med. 2009;150:890–891. doi: 10.7326/0003-4819-150-12-200906160-00020. author reply 891-892. [DOI] [PubMed] [Google Scholar]
- 33.White DB, Katz MH, Luce JM, et al. Who should receive life support during a public health emergency? Using ethical principles to improve allocation decisions. Ann Intern Med. 2009;150:132–138. doi: 10.7326/0003-4819-150-2-200901200-00011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Fink SL. Worst case: rethinking tertiary triage protocols in pandemics and other health emergencies. Crit Care. 2010;14:103. doi: 10.1186/cc8216. [DOI] [PMC free article] [PubMed] [Google Scholar]