Table 2.

Model performance (and 95% confidence interval) by updating strategy across the entire study period. Bold values indicate the best performance for a given metric.

Updating strategy	AUC	OE	ECI
Original model	0.684 [0.678, 0.69]	0.751 [0.737, 0.766]	0.152 [0.129, 0.169]
Annually retrained model	0.690 [0.685, 0.697]	0.940 [0.923, 0.959]	0.014 [0.005, 0.020]
Surveillance-based updating	0.690 [0.684, 0.695]	1.007 [0.988, 1.028]	0.005 [0, 0.008]

AUC: area under the receiver operator characteristic curve (ideal values of 1); OE: observed to expected outcome ratio (ideal value of 1); ECI: estimated calibration index (ideal value of 0).