INTRODUCTION
The triage of patients during a mass casualty – disaster (MCD) event presents the emergency healthcare provider with a complex and difficult issue. The task of evaluating casualties rapidly, using primarily the skills of physical examination, while still accurately identifying casualties likely to have critical injury or illness, may be impossible to achieve in practice. Yet at the same time it is known that accurate triage under MCD conditions improves outcomes not only for the individual critically ill casualty, but also for the entire cohort of casualties presenting for care.1,2
To improve the accuracy of MCD triage, further scientific investigations must be conducted to determine what elements of the physical examination (determining specific anatomic and physiologic factors) correlate best with the probability of critical injury and illness. These investigations should be – when possible – carried out under conditions that closely approximate the MCD environment. In addition, studies must be carried out as to the utility of new technologies that may be applied to the MCD triage process to improve and extend the ability of the triage officer in rapidly determining the condition of the casualty. Some recent studies have reported on data collected under actual MCD conditions, as well as using computer simulation to approximate the conditions of the MCD environment.3,4 These studies are encouraging and hopefully represent an emerging area of research into this area of emergency healthcare.
One question frequently posed is that of the utility of vital signs, or specific physiologic parameters reflective of formal vital signs, in the performance of MCD triage. Study of this question has been hampered by multiple factors, including the difficulty in collecting such detailed data under actual MCD conditions.1 This paper provides an analysis of the potential impact of abnormal vital signs on clinical triage categorization in comparison to triage categorization derived from actual dispositions of casualties from two separate MCD events.
METHODS
This is a protocol-driven cohort study of data from two separate local institutional review board- (IRB) approved studies of casualties during mass casualty – disaster (MCD) conditions (a terrorist bombing and an F-5 tornado).5,6 Additional approval of a protocol to study the two anonymous database collections was granted from the local facility IRB. We queried the database collections for cases with complete data points to include: initial clinical triage category, initial vital sign documentation, emergency department (ED) diagnosis, and final patient disposition.
Clinical triage categorization is defined as the initial triage category assigned to the casualty by the triage officer at the level of the ED and documented in the medical record. To assess the agreement of the clinical triage categorization with a standard, we applied a revised triage category to each case. This revised category is termed disposition triage category, and is based on ED disposition as an indicator of the severity of injury/illness for the case as utilized in previous studies.5–7 This does not relate to the level of documentation found in the chart but rather to individual decisions of admission vs discharge. In addition, decisions as to where the casualty is admitted (taken to the operating room, intensive care unit, ward bed, etc.) are well preserved in most medical records after MCD event and are thought to relate directly with the level of casualty injury or illness. Under this protocol the ED disposition relates with disposition triage categorization as follows:
Category I (Immediate)-Operating Room or Critical Care Admission; Category II (Delayed)-Noncritical Care Admission; Category III (Minimal)-Discharge Home; Category IV (Expectant)-Excluded From Analysis.
The disposition triage category is used as a standard for calculation of overtriage (OT) and undertriage (UT) rates of the clinical triage category assignment.
Recorded vital signs are scored as normal or abnormal using the standard adult and age-adjusted vital signs for children as recommended in Steadman’s Medical Dictionary.8 The Glasgow Coma Score (GCS) is recorded in the database as a total score without scoring of the individual parameters. Any score less than 15 is considered abnormal.
Because the triage data thus obtained are ordinal (ranked) in nature, agreement between clinical and disposition triage categories is assessed using the weighted kappa test and is reported as raw agreement, κ with the 95% confidence interval and probability. In addition, agreement using the Kendall tau statistic is performed and reported as τ and probability. Linear regression is also performed using first the clinical triage categories as the dependent variable then the disposition-adjusted triage categories against the independent variables of Glasgow Coma Score, pulse, respiration, and systolic blood pressure. The results of correlation are reported as r with 95% confidence interval and probability. We performed statistical analysis with Microsoft Office Excel® (version 11.5612.5606) and the statistical add-on package Analyze-it® (version 2.05).
RESULTS
Out of a total of 535 cases in the two database sets (388 bombing, 147 tornadodo) 103 (19.25%) cases met case criteria; 46 male, 57 female; mean age 35yr (range 86 – 1 years). The clinical triage categories and event sources of cases are demonstrated in Figure 1. There are no significant differences between the cases meeting inclusion criteria and those excluded in age or sex, p=0.765. Three category IV (expectant) cases were excluded from further analysis (all 3 expectant casualties had no signs of life on presentation to the ED) leaving 100 cases fit for analysis, Category I; 23, Category II; 11, Category III; 66. Rates for Undertriage (UT) and Overtriage (OT) comparing the clinical triage categories to disposition triage categories are UT=35% and OT=1%.
Figure.

Distribution of mass casualty-disaster cases by clinical triage category and event type.
Evaluation of agreement between clinical and disposition triage categories provided a raw agreement of 0.540 and κ=0.33 (95% CI: 0.21 to 0.45) p<0.0001 indicating a “fair” level of agreement. Linear regression using the clinical triage categories as the dependent variable and GCS, heart rate, respiratory rate, and systolic blood pressure as the independent variables found a significant but small agreement with GCS: r=0.1425 (95% CI: 0.0937 to 0.1913) p<0.0001. Substitution of the disposition triage categories for y in the same regression demonstrated similar small agreement with both GCS [r=0.06994 (95% CI: 0.01829 to 0.12160) p=0.0085] and systolic blood pressure [r=0.00895 (95% CI: 0.00309 to 0.01481) p=0.0031]. The vital signs of abnormal pulse rate and abnormal respiratory rate are not noted to have significant levels of agreement with disposition triage categories.
DISCUSSION
In general small numbers of cases were found with documentation of clinical triage categorizations and initial vital signs in the two study databases. This is consistent with the usual level of documentation that occurs during MCD events.9 This is one of the issues making the study of the actual process of triage during MCD conditions so difficult. The low numbers can make the impact of any variable such as vital signs on triage categorization more difficult to resolve.
Undertriage, defined as the triage of a critical casualty as noncritical and overtriage, defined as the triage of a noncritical casualty as critical, are consistent problems encountered in MCD triage.1 Overtriage has been reported to have an adverse impact on the outcomes of critical casualty cohort due to a misdirection and dilution of critical care resources away from truly critical casualties.2,10 Undertriage primarily impacts the individual casualty by delaying his/her critical care interventions. Undertriage rates of 5% or less and overtriage rates of up to 50% have been generally agreed to be acceptable in prior publications.10–13 The difficulties of studying activities of triage during MCD conditions are multiple and persistent.1,14 The nature of these difficulties makes it even more challenging to evaluate the MCD triage process for the impacts of individual process elements (such as physiologic parameters). To our knowledge, this study includes some of the only data reported regarding a potential impact of vital signs on triage categorization collected under actual MCD conditions. As such, even with generally low numbers, there is value in their analysis, as long as that value is taken in the context of the study limitations.
Improvement of the MCD triage process is an important goal of emergency healthcare providers. The process of triage must obtain sufficient information regarding the anatomic and physiologic state of the casualty to avoid high levels of mistriage, which are known to adversely impact the entire cohort of injured/ill casualties.2 At the same time the triage evaluation itself must remain nimble and abbreviated to prevent a bogging down of the process. As such, any elements of evaluation included in a “standardized” triage process should be validated as much as possible scientifically.
The data of this study demonstrate a small but significant level of agreement with increasing severity of triage categorization for mental status (based on the GCS) and systolic blood pressure. This suggests that a rapid mental status evaluation (such as the Mental status Alert, responsive to Verbal or Painful Stimuli or Unresponsive method or GCS) as well as an evaluation for a radial pulse (as a surrogate for systolic blood pressure measurement) may be useful in improving the accuracy of MCD triage.
The presence of a radial pulse (as well as the strength and character of a radial pulse) has been associated with systolic blood pressure in previous studies.15,16 In addition, both mental status and systolic blood pressure have been studied in the context of trauma systems triage and have been incorporated into various trauma scoring systems in that context.17 An absent or weak radial pulse assessment by palpation may be considered an indicator of hypotension suggesting a level I (immediate) triage categorization. The data from this study suggest a link between these physiologic parameters and the patient dispositions under actual MCD triage conditions and should spur further prospective studies in this area.
LIMITATIONS
The reported overtriage and undertriage rates detected in this analysis are unusual, and thought to be a result of the process of case selection. The inclusion of only cases with complete sets of vital sign data points reduces the total case numbers considerably. Most of the cases removed from analysis for incomplete vital signs were also discharged home. As such, the large numbers of excluded cases represent “correct” triage decisions where clinical and disposition triage categories would agree. In addition, the cases most likely to have complete vital signs documented would logically be the more ill and injured casualties. For reasons discussed, such cases are more likely to have disagreement between clinical and disposition triage categories. This will skew the triage data towards the more critical cases in the numerator while eliminating less critical cases from the denominator. Therefore, as expected the undertriage rate will likely be falsely exaggerated and the overtriage rate falsely minimized. Estimation of triage sensitivity and specificity based on such potentially exaggerated rates has no real value. As such, sensitivity and specificity of triage categories correlated with vital signs are not calculated in this study. To do so would promote insensitive measure bias.18
In addition, the use of the disposition-adjusted triage category for a comparative standard makes OT and UT rates highly sensitive to the decision to admit casualties. In MCD events where medical resources are stressed but not completely overwhelmed (as was the case in both of the study events) physicians are more likely to admit casualties of lower acuity as a “safety measure” against missing injuries during the initial chaos of the event.19 Such practice will further falsely elevate the UT rate in this study.
Measurement of the reliability of the triage process is a difficult proposition. The reliability of any particular process can often be estimated by evaluation of agreement between two observers (inter-rater reliability) or of the same observer on different observations of the same issue (intra-rater reliability).20 The same statistic of agreement may be used to evaluate agreement between two measurements or outcomes on the same individual.21 In this study the initial clinical triage categorization may be compared with the actual disposition of the casualty–and the implied triage category associated with that disposition.
Measurement of raw agreement alone is unsatisfactory in this case due to the potential for some level of agreement from random chance. Therefore, a statistical approach must be used to determine any agreement not associated with chance. The most commonly used is the kappa statistic that reports a value between 0=no agreement and 1=perfect agreement.22 The kappa statistic, however, is based on the assumption that the data are nominal in nature. Triage data in the form of triage categories is ordinal (ranked). As such, either the weighted kappa statistic or the Kendell’s tau-b statistic must be used to evaluate agreement.22 Both of these values are provided in this study. Agreement in this case, when present to a sufficient degree, suggests a potential association, but it does not prove an association. The authors selected this method of analysis as sufficient for the robustness of the data and its level of bias.
CONCLUSION
Movement toward a standardization of MCD triage protocols intensifies the need for scientific analysis of the elements of that process. This study suggests a role of the physiologic parameters of mental status and systolic blood pressure in improving triage accuracy. These elements could be incorporated into a rapid triage evaluation formally or through a quick mental status examination and palpation for a radial pulse. The fact that any strong agreement between physiologic parameters and triage categorization was found suggests that further prospective data collection under MCD conditions should be performed to illuminate any potential association.
In a wider context however, researchers should consider what healthcare providers are being asked to do in MCD triage conditions. Given the temporal and physical limitations of the MCD triage examination and the limited type and nature of data those constraints allow one to collect, it may not be possible to achieve the levels of accuracy that emergency healthcare providers have set for themselves.
Footnotes
Supervising Section Editor: Christopher Kang, MD
Full text available through open access at http://escholarship.org/uc/uciem_westjem
Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. The authors disclosed none.
REFERENCES
- 1.Hogan DE, Lairet JR. Triage. In: Hogan DE, Burstein JL, editors. Disaster Medicine. 2nd Edition. Philadelphia: Lippincott Williams & Wilkins; 2007. [Google Scholar]
- 2.Frykberg ER, Tepas JJ, Alexander RH. The 1983 Beirut airport terrorist bombing. Injury patterns and implications for disaster management. Am Surg. 1989;55:134–141. [PubMed] [Google Scholar]
- 3.Kahn CA, Schultz CH, Miller KT, et al. Does START Triage work? An outcomes assessment after a disaster. Ann Emerg Med. 2009;54:424–430. doi: 10.1016/j.annemergmed.2008.12.035. [DOI] [PubMed] [Google Scholar]
- 4.Hirshberg A, Frykberg ER, Mattox KL, et al. Triage and trauma workload in mass casualty: a complex model. J Trauma. 2010 doi: 10.1097/TA.0b013e3181e50624. [DOI] [PubMed] [Google Scholar]
- 5.Hogan DE, Lillibridge SR, Waeckerle J, et al. Emergency department impact of the Oklahoma City terrorist bombing. Ann Emerg Med. 1999;34:160–167. doi: 10.1016/s0196-0644(99)70224-6. [DOI] [PubMed] [Google Scholar]
- 6.May BM, Hogan DE, Feighner K. Impact of a tornado on a community hospital. JAOA. 2002;102:225–228. [PubMed] [Google Scholar]
- 7.Mallonee S, Shariat S, Stennies G, et al. The epidemiology of physical injuries associated with the Oklahoma City bombing. JAMA. 1996;276:382–387. [PubMed] [Google Scholar]
- 8.Steadmans Medical Dictionary. 28th Edition. Baltimore: Lippincott, Williams and Wilikins; 2005. [Google Scholar]
- 9.Barnhart S, Cody PM, Hogan DE. Multiple information sources in the analysis of a disaster. Am J Disaster Med. 2009;4(1):41–47. [PubMed] [Google Scholar]
- 10.Frykberg ER, Tepas JJ. Terrorist bombings: lessons learned from Belfast to Beirut. Ann Surg. 1988;208:569–576. doi: 10.1097/00000658-198811000-00005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Wesson DE, Scorpio R. Field triage: help or hindrance? Can J Surg. 1992;35:19–21. [PubMed] [Google Scholar]
- 12.American College of Surgeons Committee on Trauma. Field Categorization of trauma victims. Bull Coll Surg. 1986;71:17–21. [Google Scholar]
- 13.IDFMC. Trauma Division Report, Terrorist Suicide Bombings in Israel: 1994–1996, Medical Summary. Tel Aviv, Israel: Israel Defense Forces Medical Corps; 1997. pp. 10–13. [Google Scholar]
- 14.Burkle FM, Orebaugh S, Barendse BR. Emergency medicine in the Persian Gulf War – Part 1: Preparations for triage and combat casualty care. Ann Emerg Med. 1994;23:742–747. doi: 10.1016/s0196-0644(94)70309-4. [DOI] [PubMed] [Google Scholar]
- 15.ACS. ATLS Advanced Trauma Life Support for Doctors: Faculty Course Manual. 8th Edition. Chicago, IL: American College of Surgeons; 2008. [Google Scholar]
- 16.Burkle FM, Newland C, Orebaugh S, et al. Emergency medicine in the Persian Gulf War – Part 2: Triage methodology and lessons learned. Ann Emerg Med. 1994;23:748–754. doi: 10.1016/s0196-0644(94)70310-8. [DOI] [PubMed] [Google Scholar]
- 17.Hardern RD. Critical appraisal of papers describing triage systems. Acad Emerg Med. 1999;6:1166–1171. doi: 10.1111/j.1553-2712.1999.tb00121.x. [DOI] [PubMed] [Google Scholar]
- 18.Hogan DE. Research for Emergency Medicine Residents. 3rd Edition. TeamHealth Emergency Medicine; Oklahoma City, Oklahoma: 2013. [Google Scholar]
- 19.Hogan DE. Environment of Care. Oakbrook Terrace, IL: Joint Commission on Hospital Accreditation Publication; 1997. The Oklahoma City Terrorist Blast: A case study in disaster; pp. 3–217. [Google Scholar]
- 20.Aschengrau A, Seage GR., III . Essentials of Epidemiology in Public Health. 2nd Edition. Boston: Jones and Bartlett Publishers; 2008. [Google Scholar]
- 21.Crichton NJ. Information point: Spearman’s rank correlation. J Clin Nurs. 1999;8:763. [PubMed] [Google Scholar]
- 22.Le CT. Health and Numbers: A Problems Based Introduction to Biostatistics. 2nd Edition. New York: Wiley-Liss; 2001. [Google Scholar]
