Table 3. Summary of the validation set results for the multimodel classification.

ML mode	AUC (95% CI)	Cutoff (95% CI)	Accuracy (95% CI)	Sensitivity (95% CI)	Specificity (95% CI)	PPV (95% CI)	NPV (95% CI)	F1 score (95% CI)	Kappa (95% CI)
XGBoost	0.959 (0.939–0.979)	0.294 (0.274–0.314)	0.920 (0.914–0.925)	0.871 (0.851–0.891)	0.963 (0.944–0.982)	0.875 (0.852–0.898)	0.941 (0.934–0.948)	0.872 (0.856–0.889)	0.814 (0.801–0.826)
Logistic regression	0.814 (0.778–0.850)	0.296 (0.272–0.319)	0.744 (0.731–0.757)	0.847 (0.813–0.881)	0.692 (0.654–0.730)	0.571 (0.552–0.589)	0.895 (0.880–0.910)	0.681 (0.662–0.701)	0.474 (0.454–0.494)
LightGBM	0.956 (0.935–0.976)	0.328 (0.304–0.352)	0.921 (0.911–0.931)	0.862 (0.844–0.881)	0.961 (0.944–0.978)	0.897 (0.874–0.919)	0.933 (0.927–0.938)	0.879 (0.860–0.897)	0.818 (0.796–0.840)
Random forest	0.956 (0.935–0.977)	0.340 (0.324–0.356)	0.916 (0.909–0.923)	0.869 (0.852–0.887)	0.951 (0.930–0.971)	0.876 (0.854–0.898)	0.935 (0.930–0.940)	0.872 (0.860–0.884)	0.806 (0.790–0.823)
SVM	0.813 (0.776–0.849)	0.197 (0.186–0.207)	0.693 (0.679–0.706)	0.878 (0.835–0.922)	0.634 (0.584–0.684)	0.511 (0.495–0.528)	0.925 (0.908–0.941)	0.645 (0.629–0.661)	0.410 (0.385–0.435)
KNN	0.899 (0.869–0.930)	0.400 (0.400–0.400)	0.871 (0.861–0.881)	0.773 (0.747–0.799)	0.911 (0.889–0.932)	0.840 (0.817–0.862)	0.884 (0.874–0.894)	0.804 (0.785–0.824)	0.692 (0.668–0.715)
MLP	0.849 (0.815–0.883)	0.297 (0.266–0.328)	0.737 (0.714–0.760)	0.786 (0.732–0.840)	0.782 (0.729–0.835)	0.555 (0.518–0.593)	0.921 (0.907–0.935)	0.646 (0.624–0.668)	0.471 (0.442–0.501)

ML, machine learning; AUC, area under the curve; CI, confidence interval; PPV, positive predictive value; NPV, negative predictive value; XGBoost, extreme gradient boosting; LightGBM, light gradient-boosting machine; SVM, support vector machine; KNN, K-nearest neighbors; MLP, multilayer perceptron.