Table 2.

Performance of four models in Development and External cohorts.

Model	AUC	Accuracy	Sensitivity	Specificity	Brier.score
Development
LR	0.895	0.801	0.865	0.785	0.098
XGB	0.964	0.880	0.944	0.863	0.062
DT	0.915	0.885	0.798	0.907	0.089
SVM	0.892	0.811	0.831	0.805	0.098
NB	0.899	0.880	0.764	0.910	0.096
External
LR	0.825	0.723	0.674	0.743	0.162
XGB	0.808	0.742	0.652	0.780	0.176
DT	0.758	0.748	0.500	0.853	0.180
SVM	0.816	0.716	0.696	0.725	0.163
NB	0.821	0.723	0.500	0.817	0.157

AUC, Area Under the Curve; LR, Logistic Regression; XGB, eXtreme Gradient Boosting; DT, Decision Tree; SVM, Support Vector Machine; NB, naive Bayes.