Abstract
Objective: To assess the performance of the International Classification of Diseases (ICD) based injury severity score, ICISS, when applied to two versions of the 10th edition of ICD, ICD-10 and ICD-10-AM.
Design: ICISS was assessed on its ability to predict threat to life using logistic regression modelling. Models used ICISS and age as predictors and survival as the outcome.
Setting: Australia and New Zealand.
Patients or subjects: Hospitalisations with an ICD-10-AM principal diagnosis in the range S00–T89 from 1 July 1999 to 30 June 2001 (Australia) or 1 July 1999 to 31 December 2001 (New Zealand).
Interventions: None.
Main outcome measures: The models were assessed in terms of their discrimination, measured by the concordance score, and calibration, measured using calibration curves and the Hosmer-Lemeshow statistic.
Results: 523 633 Australian and 124 767 New Zealand hospitalisations were selected, including 7230 and 1565 deaths respectively. Discrimination was high in all the fitted models with concordance scores of 0.885 to 0.910. Calibration results were also promising with all calibration curves being close to linear, though ICISS appeared to underestimate mortality somewhat for cases with an ICISS score less than 0.6. Overall ICISS performed better when applied to the Australian than the New Zealand hospitalisations. Australian and New Zealand hospitalisations were very similar. ICISS was also only a little more successful when ICD-10-AM rather than mapped ICD-10 was used.
Conclusions: ICISS appears to be a reasonable way to estimate severity for databases using ICD-10 or ICD-10-AM. It is also likely to work well for other clinical variants of ICD-10.
Full Text
The Full Text of this article is available as a PDF (73.3 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Cryer C., Langley J. D., Stephenson S. C. R., Jarvis S. N., Edwards P. Measure for measure: the quest for valid indicators of non-fatal injury incidence. Public Health. 2002 Sep;116(5):257–262. doi: 10.1038/sj.ph.1900878. [DOI] [PubMed] [Google Scholar]
- Harrell F. E., Jr, Lee K. L., Mark D. B. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996 Feb 28;15(4):361–387. doi: 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4. [DOI] [PubMed] [Google Scholar]
- Hosmer D. W., Hosmer T., Le Cessie S., Lemeshow S. A comparison of goodness-of-fit tests for the logistic regression model. Stat Med. 1997 May 15;16(9):965–980. doi: 10.1002/(sici)1097-0258(19970515)16:9<965::aid-sim509>3.0.co;2-o. [DOI] [PubMed] [Google Scholar]
- Kim Y., Jung K. Y., Kim C. Y., Kim Y. I., Shin Y. Validation of the International Classification of Diseases 10th Edition-based Injury Severity Score (ICISS). J Trauma. 2000 Feb;48(2):280–285. doi: 10.1097/00005373-200002000-00014. [DOI] [PubMed] [Google Scholar]
- Langley J., Stephenson S., Cryer C., Borman B. Traps for the unwary in estimating person based injury incidence using hospital discharge data. Inj Prev. 2002 Dec;8(4):332–337. doi: 10.1136/ip.8.4.332. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Meredith J. Wayne, Evans Gregory, Kilgo Patrick D., MacKenzie Ellen, Osler Turner, McGwin Gerald, Cohn Stephen, Esposito Thomas, Gennarelli Thomas, Hawkins Michael. A comparison of the abilities of nine scoring algorithms in predicting mortality. J Trauma. 2002 Oct;53(4):621–629. doi: 10.1097/00005373-200210000-00001. [DOI] [PubMed] [Google Scholar]
- Osler T., Rutledge R., Deis J., Bedrick E. ICISS: an international classification of disease-9 based injury severity score. J Trauma. 1996 Sep;41(3):380–388. doi: 10.1097/00005373-199609000-00002. [DOI] [PubMed] [Google Scholar]
- Osler Turner M., Rogers Frederick B., Badger Gary J., Healey Mark, Vane Dennis W., Shackford Steven R. A simple mathematical modification of TRISS markedly improves calibration. J Trauma. 2002 Oct;53(4):630–634. doi: 10.1097/00005373-200210000-00002. [DOI] [PubMed] [Google Scholar]
- Rowan K. M., Kerr J. H., Major E., McPherson K., Short A., Vessey M. P. Intensive Care Society's APACHE II study in Britain and Ireland--II: Outcome comparisons of intensive care units after adjustment for case mix by the American APACHE II method. BMJ. 1993 Oct 16;307(6910):977–981. doi: 10.1136/bmj.307.6910.977. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sacco W. J., MacKenzie E. J., Champion H. R., Davis E. G., Buckman R. F. Comparison of alternative methods for assessing injury severity based on anatomic descriptors. J Trauma. 1999 Sep;47(3):441–447. doi: 10.1097/00005373-199909000-00001. [DOI] [PubMed] [Google Scholar]
- Stephenson Shaun C. R., Langley John D., Civil Ian D. Comparing measures of injury severity for use with large databases. J Trauma. 2002 Aug;53(2):326–332. doi: 10.1097/00005373-200208000-00023. [DOI] [PubMed] [Google Scholar]
- Steyerberg E. W., Harrell F. E., Jr, Borsboom G. J., Eijkemans M. J., Vergouwe Y., Habbema J. D. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol. 2001 Aug;54(8):774–781. doi: 10.1016/s0895-4356(01)00341-9. [DOI] [PubMed] [Google Scholar]
- West T. A., Rivara F. P., Cummings P., Jurkovich G. J., Maier R. V. Harborview assessment for risk of mortality: an improved measure of injury severity on the basis of ICD-9-CM. J Trauma. 2000 Sep;49(3):530–541. doi: 10.1097/00005373-200009000-00022. [DOI] [PubMed] [Google Scholar]