Table 3.

Comparative Performance of Scoring Systems Using the Entire Test Set

Scoring System	ROC AUC (95% CI)	PR AUC (95% CI)
CEWS	0.838 (0.834–0.841)	0.031 (0.028–0.033)*
MEWS	0.836 (0.833–0.839)	0.031 (0.028–0.033)
NEWS	0.842 (0.839–0.845)	0.028 (0.025–0.030)
SEWS	0.791 (0.788–0.795)	0.026 (0.024–0.028)
NEWS:LDTEWS	0.860 (0.858–0.863)†	0.029 (0.026–0.031)
CART	0.700 (0.696–0.704)	0.023 (0.021–0.025)
eCART	0.796 (0.792–0.800)	0.026 (0.024–0.029)
LAPS-2	0.863 (0.860–0.865)†	0.031 (0.028–0.033)*
HAVEN	0.901 (0.898–0.903)†	0.080 (0.076–0.084)*

Definition of abbreviations: AUC = area under the curve; CART = cardiac arrest risk triage; CEWS = centile-based EWS; CI = confidence interval; eCART = electronic CART; EWS = early warning score; HAVEN = Hospital-wide Alerting via Electronic Noticeboard; LAPS-2 = laboratory-based acute physiology score 2; LDTEWS = Laboratory Decision Tree EWS; MEWS = modified EWS; NEWS = National EWS; PR = precision recall; ROC = receiver operating characteristic; SEWS = standardized EWS.

ROC AUC and PR AUC performance when predicting the risk of future composite adverse event (unplanned admission to ICU and cardiac arrest) within 24 hours.

^*Top 3 performing systems according to the PR AUC.

^†Top 3 performing systems according to the ROC AUC.