Table 6.

Comparison between Physicians’ Initial and repeated absolute risk assessment after interaction with MySurgeryRisk Algorithm.

Postoperative complications	Physicians’ initial risk assessment AUC (95% CI)	Physicians’ risk re-assessment AUC (95% CI)	p-value for difference in AUC	Net reclassification improvement, % (95% CI)
Intensive care unit admission greater than 48 hours	0.69 (0.61, 0.77)	0.71 (0.62, 0.79)	0.452	16.0 (3.0, 29.6) †
Acute kidney injury	0.65 (0.56, 0.74)	0.69 (0.60, 0.77)	0.064	12.4 (1.0, 23.8) †
Mechanical ventilation greater than 48 hours	0.66 (0.57, 0.75)	0.70 (0.61, 0.80)	0.074	0.8 (−10.9, 9.3)
Cardiovascular complications	0.54 (0.44, 0.65)	0.59 (0.49, 0.69)	0.039*	5.1 (−2.9, 13.1)
Severe sepsis	0.54 (0.44, 0.64)	0.59 (0.50, 0.69)	0.063	7.8 (−5.9, 21.6)
30-day mortality	0.47 (0.36, 0.57)	0.49 (0.39, 0.60)	0.276	−1.0 (−11.6, 9.6)

MySurgeryRisk algorithm and physicians evaluated absolute risk for complications ranging from 0 (no risk) to 100 (complete certainty of risk).

Abbreviations: AUC, area under the receiver operator characteristic curve; CI, confidence interval.

^*p-value < 0.05. The change in AUC for repeated physicians' risk-assessment after interaction with MySurgeryRisk Algorithm was tested using the DeLong test.

^†p-value < 0.05 for testing null hypothesis of net improvement in reclassification being equal to 0 using chi-square distribution with 1 degree of freedom