Skip to main content
NCBI home page
Archives of Disease in Childhood logoLink to Archives of Disease in Childhood
. 2005 Feb;90(2):211–214. doi: 10.1136/adc.2003.046722

Reliability of PRISM and PIM scores in paediatric intensive care

J G van Keulen 1, K Polderman 1, R Gemke 1
PMCID: PMC1720273  PMID: 15665184

Abstract

Aims: To assess the reliability of mortality risk assessment using the Paediatric Risk of Mortality (PRISM) score and the Paediatric Index of Mortality (PIM) in daily practice.

Methods: Twenty seven physicians from eight tertiary paediatric intensive care units (PICUs) were asked to assess the severity of illness of 10 representative patients using the PRISM and PIM scores. Physicians were divided into three levels of experience: intensivists (>3 years PICU experience, n = 12), PICU fellows (6–30 months of PICU experience, n = 6), and residents (<6 months PICU experience, n = 9). This represents all large PICUs and about half of the paediatric intensivists and PICU fellows working in the Netherlands.

Results: Individual scores and predicted mortality risks for each patient varied widely. For PRISM scores the average intraclass correlation (ICC) was 0.51 (range 0.32–0.78), and the average kappa score 0.6 (range 0.28–0.87). For PIM scores the average ICC was 0.18 (range 0.08–0.46) and the average kappa score 0.53 (range 0.32–0.88). This variability occurred in both experienced and inexperienced physicians. The percentage of exact agreement ranged from 30% to 82% for PRISM scores and from 28 to 84% for PIM scores.

Conclusion: In daily practice severity of illness scoring using the PRISM and PIM risk adjustment systems is associated with wide variability. These differences could not be explained by the physician's level of experience. Reliable assessment of PRISM and PIM scores requires rigorous specific training and strict adherence to guidelines. Consequently, assessment should probably be performed by a limited number of well trained professionals.

Full Text

The Full Text of this article is available as a PDF (63.0 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Gemke R. J., Bonsel G. J. Comparative assessment of pediatric intensive care: a national multicenter study. Pediatric Intensive Care Assessment of Outcome (PICASSO) Study Group. Crit Care Med. 1995 Feb;23(2):238–245. doi: 10.1097/00003246-199502000-00007. [DOI] [PubMed] [Google Scholar]
  2. Polderman K. H., Christiaans H. M., Wester J. P., Spijkstra J. J., Girbes A. R. Intra-observer variability in APACHE II scoring. Intensive Care Med. 2001 Sep;27(9):1550–1552. doi: 10.1007/s001340101033. [DOI] [PubMed] [Google Scholar]
  3. Polderman K. H., Girbes A. R., Thijs L. G., Strack van Schijndel R. J. Accuracy and reliability of APACHE II scoring in two intensive care units Problems and pitfalls in the use of APACHE II and suggestions for improvement. Anaesthesia. 2001 Jan;56(1):47–50. doi: 10.1046/j.1365-2044.2001.01763.x. [DOI] [PubMed] [Google Scholar]
  4. Polderman K. H., Girbes A. R., Thijs L. G., Strack van Schijndel R. J. Accuracy and reliability of APACHE II scoring in two intensive care units Problems and pitfalls in the use of APACHE II and suggestions for improvement. Anaesthesia. 2001 Jan;56(1):47–50. doi: 10.1046/j.1365-2044.2001.01763.x. [DOI] [PubMed] [Google Scholar]
  5. Polderman K. H., Jorna E. M., Girbes A. R. Inter-observer variability in APACHE II scoring: effect of strict guidelines and training. Intensive Care Med. 2001 Aug;27(8):1365–1369. doi: 10.1007/s001340101012. [DOI] [PubMed] [Google Scholar]
  6. Polderman K. H., Thijs L. G., Girbes A. R. Interobserver variability in the use of APACHE II scores. Lancet. 1999 Jan 30;353(9150):380–380. doi: 10.1016/S0140-6736(05)74953-9. [DOI] [PubMed] [Google Scholar]
  7. Pollack M. M., Patel K. M., Ruttimann U. E. The Pediatric Risk of Mortality III--Acute Physiology Score (PRISM III-APS): a method of assessing physiologic instability for pediatric intensive care unit patients. J Pediatr. 1997 Oct;131(4):575–581. doi: 10.1016/s0022-3476(97)70065-9. [DOI] [PubMed] [Google Scholar]
  8. Pollack M. M., Patel K. M., Ruttimann U., Cuerdon T. Frequency of variable measurement in 16 pediatric intensive care units: influence on accuracy and potential for bias in severity of illness assessment. Crit Care Med. 1996 Jan;24(1):74–77. doi: 10.1097/00003246-199601000-00013. [DOI] [PubMed] [Google Scholar]
  9. Pollack M. M., Ruttimann U. E., Getson P. R. Pediatric risk of mortality (PRISM) score. Crit Care Med. 1988 Nov;16(11):1110–1116. doi: 10.1097/00003246-198811000-00006. [DOI] [PubMed] [Google Scholar]
  10. Shann F., Pearson G., Slater A., Wilkinson K. Paediatric index of mortality (PIM): a mortality prediction model for children in intensive care. Intensive Care Med. 1997 Feb;23(2):201–207. doi: 10.1007/s001340050317. [DOI] [PubMed] [Google Scholar]
  11. Slater Anthony, Shann Frank, Pearson Gale, Paediatric Index of Mortality (PIM) Study Group PIM2: a revised version of the Paediatric Index of Mortality. Intensive Care Med. 2003 Jan 23;29(2):278–285. doi: 10.1007/s00134-002-1601-2. [DOI] [PubMed] [Google Scholar]

Articles from Archives of Disease in Childhood are provided here courtesy of BMJ Publishing Group

RESOURCES