Abstract
Objective
To determine whether the Barell matrix (Inj Prev 2002;8:91–6) could effectively categorize injuries by severity.
Methods
Injury diagnoses of cases in the 2002 US Nationwide Inpatient Sample were classified according to the Barell matrix. For each cell of the matrix, the authors used ICDMAP‐90 to determine the predominant Abbreviated Injury Score (AIS) and body region, and calculated the weighted proportion surviving (bPScell) among patients with any diagnosis in that cell. These findings were used to estimate maximum AIS (bAISmax), ISS (bISS), and the minimum or product of bPScell (bPSmin, bPSprod) for injured patients in the 1996–2000 US National Hospital Discharge Surveys. Case survival was determined for different scores, and outcome models using age, sex, comorbidity, mechanism, and bISS or bPSmin were compared to models using ISS calculated from ICDMAP‐90 (mISS) or using ICISS.
Results
Case survival decreased with increasing bAISmax or bISS; survival was closely approximated by bPSmin, and also increased monotonically with bPSprod. Outcome models using bISS or bPSmin were similar to those using mISS or ICISS. An Abbreviated Barell Categorization, with only four groups, was also effective.
Conclusion
Barell matrix categorization of administrative data allows severity scoring similar to that obtainable with ICDMAP‐90 or ICISS.
Keywords: injury severity score, barell matrix, severity, mortality
Large administrative databases provide an inexpensive opportunity to analyze hospital outcomes and have been increasingly used for injury research. Specific injuries are usually described in these databases using the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD‐9‐CM), but clinically relevant aggregation of these thousands of diagnoses is required for meaningful analysis. The ability to stratify patients by injury severity is particularly important.
Sacco and colleagues1 tabulated the observed hospital mortality for patients with each diagnosis code, and assigned each patient an anatomic index (AI) equal to the maximum of the observed mortality probabilities for that patient's injury diagnoses. Levy and colleagues2 similarly tabulated the observed hospital survival for patients with each diagnosis code, and assigned each patient an estimated survival probability (ESP) equal to the product of the observed survival probabilities for that patient's injury diagnoses. A variation of the latter approach, the ICD‐9‐based Injury Severity Score (ICISS), was popularized years later by Osler and colleagues.3
The Abbreviated Injury Score (AIS)4 and Injury Severity Score (ISS)5 had been previously introduced for clinical studies, and have continued to be widely used. MacKenzie and colleagues6 have developed software (ICDMAP‐90, Tri‐Analytics, Baltimore, MD, USA) that maps ICD‐9‐CM diagnoses into AIS categories, thus allowing calculation of approximate AIS and/or ISS scores for administrative data.
More recently, Barell and an international group of colleagues7 developed a matrix of ICD‐9‐CM codes to classify injury diagnoses by type and anatomic region. Some of the original authors of the Barell matrix have subsequently demonstrated that “injury profiles” created by grouping cells of the matrix are associated with different mechanisms and outcomes.8 The purpose of our study was to use a large inpatient database to assign a probability of survival, AIS region, and AIS score to each cell of the Barell matrix. We wished to demonstrate that hospital outcomes in administrative data could then be predicted with reasonable accuracy by using this information to approximate the AI/ESP/ICISS or AIS/ISS methods.
Methods
Development of severity scores based upon the Barell matrix
After concluding the necessary data use agreement, Nationwide Inpatient Sample (NIS) data for 2002 were obtained from the US Agency for Healthcare Research and Quality.9 NIS contains inpatient data from about 1000 hospitals sampled to approximate a 20% stratified sample of US hospital discharges (potentially involving the same person more than once). Each record includes up to 15 ICD‐9‐CM diagnosis codes, age, sex, and hospital outcomes (including death and discharge to long term care). Each case is assigned a weight (Wi) essentially equal to the inverse of the probability that this case would be sampled, with further adjustments to account for missing data and other practical sampling problems. Summing the weights enables estimates that reflect the distribution of patients in US hospitals.
NIS cases were selected for this study if their principal ICD‐9‐CM diagnosis codes were in the range of injuries (800–959), excluding late effects of injury (905–909), foreign bodies (930–939), and complications (958). Cases received in transfer from other hospitals were included. Injury diagnoses from these cases were used to used to assign a predominant AIS score (bAIScell) and body region to each cell of the Barell matrix, as described in the online appendix (see http://www.injuryprevention.com/supplemental). The weighted proportion of patients who survived (bPScell) was calculated as
![]() |
Any bPScell of 1 was replaced with a bPScell of .999.
For each patient in the NIS sample, the largest bAIScell (bAISmax) was determined overall and for each body region. We calculated bISS for each patient as the sum of squares of bAISmax for the three body regions with the greatest bAISmax,5 and categorized bISS as recommended by Copes et al.10 The minimum of the bPScell for a given case will be referred to as that patient's Barell PS minimum (bPSmin); the product of all bPScell for each case was calculated, and will be referred to as that patient's Barell PS product (bPSprod).
ICDMAP‐90 mapped each patient's ICD‐9‐CM diagnoses to an ISS body region and AIS score, and calculated the maximum AIS in each body region, maximum AIS overall (mAISmax), and ISS (mISS).5,6 Categorizations of AISmax and ISS derived from ICDMAP‐90 (mAISmax and mISS) were compared to those derived from the Barell matrix (bAISmax and bISS). Weighted hospital mortality for cases in the sample was calculated by bAISmax, bISS, bPSmin, and bPSprod.
Validation of severity scores using a separate database
National Hospital Discharge Survey (NHDS) data for 1996–2000 had been obtained from the US Centers for Disease Control and Prevention (CDC) on a compact disc and/or from the internet for a previous study.11 NHDS is a national probability sample of discharge data from acute care general hospitals in the United States conducted annually by the CDC.12 Like NIS, NHDS includes age, sex, up to seven ICD‐9‐CM diagnosis codes, hospital outcomes, and weights to allow estimates of national totals.
NHDS cases were selected using the inclusion criteria specified above. For each patient, bAISmax, bISS, bPSmin, and bPSprod were calculated using the Barell matrix along with the bAIScell and bPScell values that had been derived from the NIS data. As with the NIS cases, bAISmax and bISS were compared to the scores derived from ICDMAP‐90 (mAISmax and mISS). Weighted hospital mortality for NHDS cases was likewise calculated by bAISmax, bISS, bPSmin, and bPSprod.
Codes for the mechanism of injury (E‐codes) were classified as recommended by CDC.13 Diagnosis codes potentially relating to pre‐existing medical conditions were used to construct a comorbidity score as described by Charlson et al14 and Romano et al.15
For cases with complete data (including an E‐code), logistic regression was used to develop predictive models for hospital mortality based upon bISS or bPSmin, mechanism, comorbidity, age, and sex. Modeling techniques (using Stata Version 7.0 SE, College Station TX) included allowance for the weighted survey data.16 “Model based” evaluation11,17 included minimizing the Hosmer‐Lemeshow (H‐L) goodness‐of‐fit statistic and maximizing the area under a receiver operating characteristic curve.
For patients surviving to hospital discharge, similar logistic regression models were constructed and compared to predict the discharge destination of “long term care” (LTC). In addition, following the example of Mackenzie et al,18 multiple linear regression was used to predict the logarithm of hospital length of stay (LOS) for survivors.
Results
Derivation of scores for Barell matrix cells
The 2002 NIS sample contained 306 303 cases meeting inclusion criteria, with weights ranging from 1.8 to 10.4 (mean 4.8). These cases thus represented about 1 470 000 (306 303×4.8) patients. Of these cases, 39.9% had more than one injury diagnosis, resulting in an average of 1.87 per case and a total diagnosis weight of about 2 749 000 (1 470 000×1.87). This weight was distributed as described in the online appendix (see http://www.injuryprevention.com/supplemental) to obtain the AIS scores given in table 1; 99.0% of the weight was distributed to cells of the Barell matrix for which AIS regions and scores could be assigned objectively using ICDMAP‐90, and only 1.0% of the weight was distributed to cells requiring assignment using the authors' judgment. Each cell of the Barell matrix was thus associated with a predominant body region and bAIScell, none of which was greater than 4. Weighted estimates of the proportions of patients who survived for each cell (bPScell) ranged from .643 to .999 and are also shown in table 1.
Table 1 Barell matrix,7 with each cell (of those containing one or more diagnosis codes) assigned an AIS body region (A, abdomen; C, chest; E, extremity/pelvis; F, face; G, general; H, head/neck) bAIScell, and bPScell. ).
| A. Fracture | B. Dislocation | C. Sprain/ strain | D. Internal | E. Wound | F. Amputation | G. Vascular | H. Superficial | I. Crush | J. Burn | K. Nerves | L. Unsp | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1. TBI Type I | H4 .838 | H4 .877 | H1 .999 | |||||||||
| 2. TBI Type II | H3 .992 | H2 .994 | ||||||||||
| 3. TBI Type III | H3 .992 | |||||||||||
| 4. Other head | G1 .962 | G1 .963 | H2 .999 | H1 .987 | ||||||||
| 5. Face | F1 .976 | F2 .970 | F1 .999 | G1 .980 | G1 .985 | |||||||
| 6. Eye | G1 .983 | F1 .986 | G1 .966 | H1 .969 | ||||||||
| 7. Neck | H4 .982 | H1 .999 | G1 .977 | G2 .999 | G1 .948 | H2 .999 | ||||||
| 8. Unsp head/neck | H2 .891 | G1 .985 | G2 .941 | G1 .934 | G2 .999 | G1 .978 | ||||||
| 9. Cervical SCI | H4 .856 | H4 .938 | ||||||||||
| 10. Thoracic SCI | C4 .951 | C4 .968 | ||||||||||
| 11. Lumbar SCI | A3 .982 | A3 .990 | ||||||||||
| 12. Sacral SCI | E3 .885 | A3 .999 | ||||||||||
| 13. Unsp SCI | A2 .999 | A3 .951 | ||||||||||
| 14. Cervical VCI | H2 .946 | H2 .948 | H1 .997 | |||||||||
| 15. Thoracic VCI | C2 .979 | C2 .981 | C1 .999 | |||||||||
| 16. Lumbar VCI | A2 .981 | A2 .999 | A1 .999 | |||||||||
| 17. Sacral VCI | E2 .964 | E2 .981 | E1 .999 | |||||||||
| 18. Unsp VCI | A2 .966 | A3 .658 | ||||||||||
| 19. Chest | C2 .961 | C2 .999 | C1 .999 | C3 .929 | G1 .973 | C3 .757 | G1 .991 | C2 .999 | G1 .954 | C2 .999 | ||
| 20. Abdomen | A2 .923 | G1 .986 | A3 .752 | G1 .985 | G1 .971 | A2 .999 | ||||||
| 21. Pelvis/urogenital | E3 .963 | E3 .972 | A1 .999 | A2 .941 | G1 .978 | A3 .693 | G1 .989 | A2 .999 | G1 .965 | A2 .999 | ||
| 22. Trunk | C2 .999 | G1 .973 | G1 .986 | C2 .856 | G1 .888 | A2 .999 | A1 .988 | |||||
| 23. Back/buttock | A1 .999 | G1 .983 | G1 .989 | A2 .999 | G1 .932 | |||||||
| 24. Shoulder/arm | E2 .980 | E2 .993 | E1 .999 | G1 .983 | E3 .971 | G1 .986 | E3 .999 | G1 .972 | E1 .996 | |||
| 25. Forearm/elbow | E2 .990 | E1 .988 | E1 .996 | G1 .983 | E3 .986 | G1 .981 | E3 .999 | G1 .988 | ||||
| 26. Wrist/hand | E2 .991 | E1 .996 | E1 .999 | G1 .991 | E2 .996 | G1 .987 | E2 .999 | G2 .978 | E1 .999 | |||
| 27. Unsp upper extr | E2 .643 | G1 .956 | E3 .833 | E1 .990 | G1 .987 | E3 .834 | G1 .929 | E1 .999 | E1 .974 | |||
| 28. Hip | E3 .967 | E2 .992 | E1 .996 | G1 .990 | E4 .999 | |||||||
| 29. Thigh | E3 .974 | E4 .929 | G1 .991 | E4 .999 | G1 .969 | |||||||
| 30. Knee | E2 .991 | E2 .998 | E2 .999 | G1 .991 | E3 .999 | G1 .973 | ||||||
| 31. Leg/ankle | E2 .992 | E2 .998 | E1 .998 | E3 .903 | G1 .993 | E2 .999 | G1 .979 | |||||
| 32. Foot | E2 .995 | E1 .998 | E1 .999 | G1 .989 | E2 .983 | G1 .997 | E2 .995 | G1 .979 | ||||
| 33. Unsp lower extr | E2 .887 | E2 .999 | G1 .986 | E3 .950 | E2 .972 | G1 .988 | E2 .813 | G1 .918 | E1 .990 | |||
| 34. Other/multiple | G2 .928 | G3 .855 | G3 .820 | E2 .995 | ||||||||
| 35. Unsp | G2 .952 | G2 .999 | G1 .999 | G3 .941 | G1 .954 | G3 .843 | G1 .986 | G2 .710 | G1 .967 | G2 .991 | G1 .973 |
TBI, traumatic brain injury; SCI, spinal cord injury; VCI, vertebral column injury; Unsp, unspecified.
Severity scores were easily calculated for individual patients using table 1. For example, consider a hypothetical patient with diagnosis codes 800.00, 801.00, 852.20, and 821.01 (fractures of skull vault and skull base, subdural hematoma, unspecified loss of consciousness, and fracture of the femoral shaft). The Barell matrix7 assigns the first two diagnoses to cell 2A, the third to cell 1D, and the last to cell 29A. From table 1, cell 2A is associated with the head/neck region, bAIS = 3, bPScell = .992; cell 1D is associated with the head/neck region, bAIS = 4, bPScell = .877; cell 29A is associated with the extremity region, bAIS = 3, bPScell = .974. Thus, bAISmax in the head/neck region is 4, bAISmax in the extremity region is 3, and bISS is 4×4 + 3×3 = 25. We see that bPSmin is .877, and calculate bPSprod as .992×.877×.974 = .847.
Evaluation of results in the development (NIS) sample
Calculated bISS ranged from 1 to 33. For lesser degrees of injury, categorization of individual NIS cases by bISS agreed closely with the mISS categorizations obtained using ICDMAP‐90 (table 2); for ISS above 15, the agreement was not as close but the great majority of cases were in the same or an adjacent category.
Table 2 Percentages of NIS (development) cases and NHDS (validation) cases (shown in italics) with the given ISS scores derived using the Barell matrix (bISS) compared to their ISS scores derived using ICDMAP‐90 (mISS).
| bISS 1‐3 | bISS 4‐8 | bISS 9‐15 | bISS 16‐24 | bISS 25‐75 | |
|---|---|---|---|---|---|
| NIS (development) sample | |||||
| (n = 50072) | (n = 114948) | (n = 109124) | (n = 28366) | (n = 5006) | |
| mISS 1‐3 | 75.5% | 4.3% | 0.1% | 1.4% | 0.0% |
| mISS 4‐8 | 15.5% | 82.4% | 4.4% | 4.0% | 0.2% |
| mISS 9‐15 | 2.4% | 10.8% | 91.2% | 36.6% | 8.7% |
| mISS 16‐24 | 0.3% | 1.4% | 3.1% | 44.2% | 37.3% |
| mISS 25‐75 | 0.2% | 0.8% | 1.1% | 13.2% | 53.8% |
| Not mapped | 6.1% | 0.4% | 0.2% | 0.5% | 0.0% |
| NHDS (validation) sample | |||||
| (n = 11613) | (n = 23083) | (n = 21177) | (n = 5634) | (n = 741) | |
| mISS 1‐3 | 76.3% | 4.4% | 0.1% | 5.8% | 0.4% |
| mISS 4‐8 | 15.0% | 84.7% | 5.2% | 12.3% | 0.9% |
| mISS 9‐15 | 1.2% | 8.6% | 90.4% | 32.6% | 20.9% |
| mISS 16‐24 | 0.1% | 0.9% | 3.0% | 35.7% | 34.1% |
| mISS 25‐75 | 0.3% | 0.7% | 1.0% | 12.1% | 43.6% |
| Not mapped | 7.1% | 0.8% | 0.2% | 1.5% | 0.0% |
Hospital mortality increased monotonically with increasing bAISmax or categorized bISS (fig 1) and decreased monotonically with increasing bPSmin or bPSprod (fig 2). There were few cases with bPSmin<.80 or bPSprod<.80; for the others, the expected line of (1 ‐ observed mortality) was more closely approximated by bPSmin than by bPSprod.
Figure 1 Hospital mortality for NIS (development) and NHDS (validation) samples, categorized by Barell Injury Severity Score (bISS) and Barell maximum AIS (bAISmax).
Figure 2 Hospital mortality for NIS (development) and NHDS (validation) samples, categorized by the minimum or product (bPSmin or bPSprod) of the estimated hospital survival for all cells of the Barell matrix containing one or more of the patient's diagnoses. The line of identity would be expected if the observed mortality were exactly equal to 1 minus the predicted survival.
To evaluate the effect on mortality of bAIS in different body regions, we determined the weighted proportion of patients who died for each bAISmax in each body region, where the patients had no bAIScell in any other region equal or greater (table 3). Mortality was not linearly or even monotonically related to bAIS and varied by body region: a bAIS of 4 in the head/neck region was associated with the highest mortality (12.5%), followed by a bAIS of 3 in the general or abdominal regions (11.0% and 8.8%, respectively); a bAIS of 3 or 4 in the chest or extremity regions was associated with significantly lower mortality, and a bAIS of 3 in the head/neck region still lower. Of NIS cases with overall bAISmax = 4, 97% had a bAIS of 4 in the head/neck region.
Table 3 Proportions of NIS (development) cases and NHDS (validation) cases (shown in italics) who died with the given regional bAISmax, and no bAIScell in any other body region that was equal or greater.
| bAIS = 1 | bAIS = 2 | bAIS = 3 | bAIS = 4 | |
|---|---|---|---|---|
| Head and neck | ||||
| NIS | 0.7% (0.4–1.1%) | 1.1% (0.9–1.3%) | 0.5% (0.3–0.8%) | 12.5% (12.1–12.8%) |
| NHDS | 0.9% (0–2.4%) | 0.5% (0.1–0.9%) | 0.4% (0–0.8%) | 10.5% (9.1–11.9%) |
| Face | ||||
| NIS | 0.3% (0.2–0.5%) | 0 | ||
| NHDS | 0.4% (0–0.9%) | 0 | ||
| Chest | ||||
| NIS | 0 | 1.2% (1.0–1.4%) | 3.9% (3.5–4.3%) | 2.9% (1.5–4.3%) |
| NHDS | 0 | 1.1% (0–2.2%) | 4.5% (3.0–6.0%) | 1.7% (0–4.3%) |
| Abdomen | ||||
| NIS | 0.2% (0–0.4%) | 2.0% (1.8–2.2%) | 8.8% (6.7–10.9%) | |
| NHDS | 0 | 1.3% (0.6–2.0%) | 10.2% (4.1–16.3%) | |
| Extremities | ||||
| NIS | 0.1% (0–0.2%) | 0.3% (0.3–0.3%) | 2.7% (2.6–2.8%) | 2.7% (0–6.4%) |
| NHDS | 0.0% (0–0.1%) | 0.2% (0.1–0.3%) | 2.5% (2.0–2.9%) | 0.3% (0–0.9%) |
| General | ||||
| NIS | 0.9% (0.8–1.0%) | 0.7% (0.3–1.1%) | 11.0% (5.9–16.1%) | |
| NHDS | 1.0% (0.7–1.3%) | 1.3% (0–2.9%) | 2.6% (0–5.2%) |
95% confidence limits are given in parentheses.
Evaluation of results in the validation (NHDS) sample
The 1996–2000 NHDS sample contained 62 248 cases meeting inclusion criteria, with weights ranging from 6 to 3507 (mean 126). Of these cases, 36.7% had more than one injury diagnosis, resulting in an average of 1.73 per case.
Hospital mortality in the NHDS sample increased monotonically with increasing categories of bAISmax or bISS (fig 1) and decreased monotonically with increasing categories of bPSmin or bPSprod (fig 2). There were few cases with bPSmin<.80 or bPSprod<.80; for the others, the expected line of (1 ‐ observed mortality) was again more closely approximated by bPSmin than by bPSprod.
Calculated bISS ranged from 1 to 36. Categorization of individual NHDS cases by bISS also corresponded well to the mISS categorizations obtained using ICDMAP‐90 (table 2), although not quite as closely as the development cases from NIS. For cases with bISS 25 or greater, 98.0% had a bAISmax of 4 in the head/neck region; for those with bISS 16–24, 91.5% had a bAISmax of 4 in the head/neck region. The effects of bAISmax in different body regions were similar to those seen with the NIS development sample (table 3).
Multivariate models using either bISS or bPSmin along with other factors (see online appendix at http://www.injuryprevention.com/supplemental) gave similar results to those reported previously using the same database and same data categorizations but grading anatomic severity using mISS or ICISS.11 Increased bISS or decreased bPSmin increased mortality, LTC, and LOS, as did age and comorbidity. Sex affected LTC and LOS but not mortality. Age was much more important than injury severity in determining LTC, and all these covariates had less effect on LOS than on other outcomes. Penetrating, burn, or vehicle mechanisms tended to increase mortality and decrease LTC, but these effects were not always significant.
Abbreviated Barell Categorization
Inspection of the variable effects of regional bAIS on mortality, using either NIS or NHDS data (table 3), showed that the calculated bISS depends mostly on the presence or absence of a diagnosis resulting in bAIS = 4 in the head/neck region, and to a lesser degree on the presence or absence of a diagnosis resulting in bAIS⩾3 in any other region. We therefore defined an Abbreviated Barell Categorization (ABC), as:
0 for head/neck bAIS<4 with all other bAIS<3;
1 for head/neck bAIS<4 with another regional bAIS⩾3;
2 for head/neck bAIS = 4 with all other bAIS<3; and
3 for head/neck bAIS = 4 with another regional bAIS⩾3.
To a large extent, ABC = 0 corresponds to patients with bISS less than 9, ABC = 1 corresponds to patients with bISS 9–15, ABC = 2 corresponds to patients with bISS 16–24, and ABC = 3 corresponds to patients with bISS 25 or more. ISS scores for these patients obtained using ICDMAP‐90 (mISS) are similar, and inpatient mortality is similar to that seen with categorized bISS or mISS (table 4). When ABC categories were substituted for the corresponding bISS categories in regression models using NHDS data, similar results were obtained (see online appendix).
Table 4 Abbreviated Barell Categorization (ABC), showing distributions of bISS and mISS, along with hospital mortality estimated from the development sample (NIS) and the validation sample (NHDS, shown in italics).
| ABC | Description using bAIS | Number of cases | bISS Median (IQR) | mISS Median (IQR) | % Mortality mean, 95% CI |
|---|---|---|---|---|---|
| 0 | Head/neck bAIS<4, | 175743 NIS | 4 (1–4) | 4 (2–5) | 0.7 (0.6–0.7) |
| Other bAIS<3 | 35877 NHDS | 4 (1–4) | 4 (1–4) | 0.5 (0.4–0.7) | |
| 1 | Head/neck bAIS<4, | 103379 NIS | 9 (9–9) | 9 (9–9) | 2.9 (2.8 –3.0) |
| Other bAIS⩾3 | 20488 NHDS | 9 (9–10) | 9 (9–9) | 2.9 (2.5 –3.3) | |
| 2 | Head/neck bAIS = 4, | 24163 NIS | 16 (16–17) | 16 (9–17) | 11.6 (11.2–12.0) |
| Other bAIS<3 | 5157 NHDS | 17 (16–17) | 13 (9–16) | 9.7 (8.3–11.1) | |
| 3 | Head/neck bAIS = 4, | 3018 NIS | 25 (25–25) | 25 (19–34) | 18.8 (17.3–20.2) |
| Other bAIS⩾3 | 726 NHDS | 25 (25–26) | 22 (17–32) | 17.1 (12.1–22.1) |
IQR, interquartile range; CI, confidence interval.
Discussion
Much has been written about injury severity scoring, and many scores have been proposed.19,20 However, there has been no agreement on a standard methodology, especially for administrative data.21 The AIS is now owned by the American Association for Automotive Medicine, which has updated the methods and changed the body regions from those traditionally used to calculate the ISS. ICDMAP‐90 also remains proprietary, and has not been updated to include ICD‐9‐CM diagnoses added since 1990. The developers of ICISS originally provided a table of survival statistics grouped by ICD‐9‐CM codes through an internet site,3 which is no longer available.
The development of the Barell matrix under the direction of an International Collaborative Effort (ICE) on Injury Statistics,7 and its placement in the public domain, therefore offer a new opportunity to make a severity scoring system available at no cost for administrative studies anywhere that data are coded using ICD‐9‐CM (or its successors). The original authors of the Barell matrix clearly did not intend it to be used for severity scoring, and the adaptations we describe may at first appear to be oversimplified. However, we believe our results show that these methods are adequate for most purposes, such as selecting the most serious of several injuries, stratifying patients for outcome studies, or comparing statistics among different countries or regions.
Administrative data are usually derived from records intended to justify hospital claims for reimbursement. Accordingly, any use of their diagnosis codes for other purposes must be undertaken with caution. Among other concerns, discharge data reflect an episode of care rather than an incident case. Patients transferred from another hospital may be counted twice if they were originally inpatients in another sampled hospital, but excluding such patients (assuming they can be identified) would falsely eliminate patients transferred from another hospital's outpatient (emergency) department as well as those transferred from hospitals outside the sample. Patients readmitted for complications or other follow up care may also be falsely included as incident cases.
In addition, outcome analysis using hospital records by definition ignores the large proportion of injury deaths that occur before hospital admission as well as the large proportion of deaths in older patients that occur after hospital discharge.22 A survival probability calculated from an individual diagnosis code may also give a false sense of accuracy if it is based on a small number of cases or identifies an injury (for example, hip fracture) for which the apparent mortality reflects host factors or the timing of discharge to LTC facilities more than anatomic damage.
If hospital survival given hospital admission is the only outcome of interest, a PSmin/PSprod/AI/ESP/ICISS type of statistic may logically be used, although there is no longer any standard reference database. Any rational subgrouping of the thousands of possible injury diagnoses would probably have some value, but it is appealing to build upon the longstanding efforts of the ICE to distinguish clinically meaningful anatomic categories. In their evaluation of the ICISS method, Kilgo and colleagues23 found that the survival probability for the single worst injury (like the PSmin or AI) predicted survival for a given patient better than a multiplicative model (like the PSprod, ESP, or ICISS). The present study confirms that a multiplicative model tends to overpredict mortality.
Key points
Although the Barell matrix was not originally intended as a method of injury severity scoring, the authors adapt it for this purpose, using the US Nationwide Inpatient Sample as a reference database.
Table 1 in this article associates each cell of the Barell matrix with an Abbreviated Injury Score and the proportion of patients surviving with a diagnosis in this cell.
The Barell matrix, along with table 1, can be used to calculate approximate regional or overall maximum AIS, ISS, or ICISS‐type severity scores for case records in administrative datasets.
The authors also propose an Abbreviated Barell Categorization as a simple way to approximate ISS in administrative data.
The usefulness of these methods is demonstrated by accurately predicting patient outcomes in another database (the US National Hospital Discharge Survey).
Further grouping of diagnoses using AIS incorporates prior expert opinion ranking severity ordinally by the amount of energy transferred, which may account for the continued popularity of ICDMAP‐90. Our findings suggest that the ICD‐9‐CM diagnoses it is unable to map are mostly minor injuries (table 2). However, previous evaluation of the relation of mortality to AIS (as assigned by ICDMAP‐90) has shown that this effect is non‐linear and varies by region;11 this variability is confirmed in the present study (tables 2 and 3). Gennarelli and colleagues24 have emphasized that neurological injuries are the most important contributors to hospital trauma mortality, and our analysis of bAIS also shows the dominant effect of severe injuries in the head/neck region.
For most applications, a theoretically continuous scale of injury severity is no more useful than classification into a few ranked strata.10 When dealing with large numbers of patients and data of marginal descriptive power, a simpler scale may be sufficient and preferable. Our table 1 uses the NIS as a large reference database, and may be applied to any large set of administrative data for which the diagnoses have been categorized using the Barell matrix. This approach is easier than using ICDMAP‐90 or an ICISS‐type score that assigns a score to every ICD‐9‐CM diagnosis code. The Abbreviated Barell Categorization we describe (table 4) is still easier and may be sufficient for many studies using administrative data.
Methods for predicting hospital mortality directly from ICD codes, as well as those incorporating AIS, can be adapted for use with the Barell matrix, with the advantages of simplicity, free access, and an internationally accepted nomenclature. Considering that any scoring system based on billing codes will have limited accuracy, these methods appear to stratify anatomic diagnoses adequately for most outcome studies, especially when used along with measures of comorbidity (including age) and other factors available in administrative data.
Acknowledgements
This work was funded in part by a grant #R49/CCR115279‐04 from the US National Center for Injury Prevention and Control. Its contents reflect the views of the authors, but not necessarily the NCIPC or CDC. The authors appreciate the many suggestions offered by anonymous reviewers.
Abbreviations
ABC - Abbreviated Barell Categorization
AI - anatomic index
AIS - Abbreviated Injury Score
bAIScell - predominant AIS for a cell of the Barell matrix
bAISmax - maximum AIS for a patient estimated using Barell matrix
bISS - ISS for a patient estimated using using Barell matrix
bPScell - proportion of patients surviving with a diagnosis in a cell
bPSmin - minimum bPScell for a patient
bPSprod - product of bPScell for a patient
CDC - Centers for Disease Control and Prevention
ESP - estimated survival probability
ICD‐9‐CM - International Classification of Diseases, Ninth Revision, Clinical Modification
ICE - International Collaborative Effort on Injury Statistics
ICISS - ICD‐9‐based Injury Severity Score
ISS - Injury Severity Score
LOS - length of stay
LTC - long term care
mAISmax - maximum AIS for a patient estimated using ICDMAP‐90
mISS - ISS for a patient estimated using using ICDMAP‐90
NHDS - National Hospital Discharge Survey
NIS - Nationwide Inpatient Sample
Footnotes
Competing interests none.
References
- 1.Champion H R, Sacco W J, Lepper R L.et al An anatomic index of injury severity. J Trauma 198020197–202. [DOI] [PubMed] [Google Scholar]
- 2.Levy P S, Mullner R, Goldberg J.et al The estimated survival probability index of trauma severity. Health Serv Res 19781328–35. [PMC free article] [PubMed] [Google Scholar]
- 3.Osler T, Rutledge R, Deis J.et al ICISS: An International Classification of Disease‐9 based injury severity score. J Trauma 199641380–386. [DOI] [PubMed] [Google Scholar]
- 4.AMA Committee on Medical Aspects of Automotive Safety Rating the severity of tissue damage. I. The abbreviated scale. JAMA 1971215277–280. [DOI] [PubMed] [Google Scholar]
- 5.Baker S P, O'Neill B, Haddon W J.et al The injury severity score: A method for describing patients with multiple injuries and evaluating emergency care. J Trauma 197414187–196. [PubMed] [Google Scholar]
- 6.MacKenzie E J, Steinwachs D M, Shankar B. Classifying trauma severity based on hospital discharge diagnoses. Validation of an ICD‐9CM to AIS‐85 conversion table. Med Care 198927412–422. [DOI] [PubMed] [Google Scholar]
- 7.Barell V, Aharonson‐Daniel L, Fingerhut L A.et al An introduction to the Barell body region by nature of injury diagnosis matrix. Inj Prev 2002891–96. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Aharonson‐Daniel L, Boyko V, Ziv A.et al A new approach to the analysis of multiple injuries using data from a national trauma registry. Inj Prev 20039156–162. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.US Agency for Healthcare Research and Quality National Inpatient Sample. Available at www.hcup‐us.ahrq.gov/nisoverview.jsp (accessed January 2006)
- 10.Copes W S, Champion H R, Sacco W J.et al The Injury Severity Score revisited. J Trauma 19882869–77. [DOI] [PubMed] [Google Scholar]
- 11.Clark D E, Winchell R J. Risk adjustment for injured patients using administrative data. J Trauma 200457130–140. [DOI] [PubMed] [Google Scholar]
- 12.US Centers for Disease Control and Prevention National Hospital Discharge Survey. Available at www.cdc.gov/nchs/about/major/hdasd/nhds.htm (accessed January 2006)
- 13.Recommended framework for presenting injury mortality data MMWR Morb Mortal Wkly Rep. 1997;46:1–30. [PubMed] [Google Scholar]
- 14.Charlson M E, Pompei P, Ales K L.et al A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation. J Chronic Dis 198740373–383. [DOI] [PubMed] [Google Scholar]
- 15.Romano P S, Roos L L, Jollis J G. Adapting a clinical comorbidity index for use with ICD‐9‐CM administrative data: Differing perspectives. J Clin Epidemiol 1993461075–1079. [DOI] [PubMed] [Google Scholar]
- 16.Levy P S, Lemeshow S.Sampling of populations: methods and applications. New York: John Wiley & Sons, 1999
- 17.Hosmer D W, Jr, Lemeshow S.Applied logistic regression, 2nd edition. New York: John Wiley & Sons, 2000
- 18.MacKenzie E J, Morris J A, Jr, Edelstein S L. Effect of pre‐existing disease on length of hospital stay in trauma patients. J Trauma 198929757–764. [DOI] [PubMed] [Google Scholar]
- 19.Osler T. Injury severity scoring: perspectives in development and future directions. Am J Surg 199316543S–51S. [DOI] [PubMed] [Google Scholar]
- 20.Senkowski C K, McKenney M G. Trauma scoring systems: A review. J Am Coll Surg 1999189491–503. [DOI] [PubMed] [Google Scholar]
- 21.Expert Group on Injury Severity Measurement, National Center for Health Statistics Discussion document on injury severity measurement in administrative datasets. Available at www.cdc.gov/nchs/injury.htm (accessed January 2006)
- 22.Mullins R J, Mann N C, Hedges J R.et al Adequacy of hospital discharge status as a measure of outcome among injured patients. JAMA 19982791727–1731. [DOI] [PubMed] [Google Scholar]
- 23.Kilgo P D, Osler T M, Meredith W. The worst injury predicts mortality outcome the best: Rethinking the role of multiple injuries in trauma outcome scoring. J Trauma 200355599–606. [DOI] [PubMed] [Google Scholar]
- 24.Gennarelli T A, Champion H R, Copes W S.et al Comparison of mortality, morbidity, and severity of 59,713 head injured patients with 114,447 patients with extracranial injuries. J Trauma 199437962–968. [DOI] [PubMed] [Google Scholar]



