Table 2.
Metrics | LR | eXGBM | DT | SVM | RF | LightGBM |
---|---|---|---|---|---|---|
AUC (95%CI) | 0.769 (0.727–0.804) | 0.949 (0.933–0.961) | 0.710, (0.670–0.756) | 0.771 (0.726–0.813) | 0.936 (0.912–0.956) | 0.953 (0.938–0.965) |
Accuracy | 0.707 | 0.871 | 0.636 | 0.709 | 0.866 | 0.890 |
Precise | 0.700 | 0.855 | 0.678 | 0.692 | 0.857 | 0.902 |
Recall | 0.724 | 0.892 | 0.517 | 0.754 | 0.879 | 0.875 |
F1 score | 0.712 | 0.873 | 0.587 | 0.722 | 0.868 | 0.888 |
Brier score | 0.198 | 0.088 | 0.224 | 0.198 | 0.116 | 0.094 |
Log loss | 0.580 | 0.291 | 0.646 | 0.580 | 0.389 | 0.427 |
Discrimination slope | 0.188 | 0.647 | 0.171 | 0.180 | 0.422 | 0.749 |
Calibration slope | 1.169 | 0.999 | 0.625 | 1.275 | 2.074 | 0.375 |
Intercept-in-large value | 0.049 | -0.108 | 0.047 | 0.037 | -0.112 | 0.100 |
Total score | 28 | 50 | 17 | 32 | 37 | 48 |
AUC, area under the curve; CI, confident interval