TABLE 3.

Predictive Performance Before and After Retraining

Validation Step	Area Under the Receiver Operating Characteristic Curve	Calibration Intercept	Calibration Slope	Calibration Loss
External validation before retraining	0.72 (0.67–0.76)	–0.09 (–0.3 to 0.12)	1.0 (0.72–1.28)	0.01
Temporal validation 1	0.79 (0.76–0.82)	0.07 (–0.14 to 0.29)	0.95 (0.73–1.17)	0.01
Temporal validation 2	0.79 (0.76–0.83)	–0.0 (–0.22 to 0.21)	1.02 (0.78–1.26)	0.01
Validation after retraining	0.79 (0.75–0.82)	–0.03 (–0.24 to 0.19)	0.99 (0.77–1.21)	0.01