Table 4.

Detailed performance measures for InSight and competing scores on the complete Multiparameter Intelligent Monitoring in Intensive Care version III (MIMIC-III) data set, with operating points chosen to make sensitivities close to 0.80. Note that all of quick SOFA’s operating points produced sensitivities far from 0.80.

	InSight: 0 hours	InSight: 4 hours	SIRSa	quick SOFA	MEWSb	SAPS IIc	SOFAd
AUROCe	0.88 (SD 0.006)	0.74 (SD 0.010)	0.61	0.77	0.80	0.70	0.73
APRf	0.60 (SD 0.016)	0.28 (SD 0.013)	0.16	0.28	0.33	0.23	0.28
Sensitivity	0.80	0.80	0.72	0.56	0.70	0.75	0.80
Specificity	0.80	0.54	0.44	0.84	0.77	0.52	0.48
F1g	0.47	0.30	0.24	0.39	0.40	0.27	0.27
DORh	15.51	4.75	2.06	6.33	7.85	3.26	3.71
LR+i	3.90	1.75	1.30	3.37	3.05	1.57	1.55
LR-j	0.25	0.37	0.63	0.53	0.39	0.48	0.42
Accuracy	0.80	0.57	0.47	0.80	0.76	0.55	0.52

^aSIRS: systemic inflammatory response syndrome

^bMEWS: Modified Early Warning Score.

^cSAPS II: Simplified Acute Physiology Score II.

^dSOFA: Sequential (Sepsis-Related) Organ Failure Assessment.

^eAURUC: area under the receiver operating characteristic curve.

^fAPR: area under the precision-recall curve.

^gF1: harmonic mean of precision and recall.

^hDOR: diagnostic odds ratio.

ⁱLR+: positive likelihood ratio.

^jLR-: negative likelihood ratio.