Table 2. Performance of various models on train and test data sets (boot632 re-sampling, 10-fold cross validation repeated 10 times. Values are up to 2 significant points.).
Method | ROC | Accuracy | Sensitivity | Specificity | Precision | F1-score | MCC | Kappa | ||||
Train | Test | Train | Test | Train | Test | Train | Test | Test | Test | Test | Test | |
GLM | 0.82 | 0.82 | 0.75 | 0.75 | 0.74 | 0.74 | 0.76 | 0.76 | 0.76 | 0.75 | 0.5 | 0.5 |
RF | 0.92 | 0.88 | 0.87 | 0.8 | 0.86 | 0.79 | 0.88 | 0.82 | 0.82 | 0.8 | 0.61 | 0.61 |
C5.0 | 0.92 | 0.88 | 0.87 | 0.8 | 0.86 | 0.78 | 0.88 | 0.83 | 0.82 | 0.8 | 0.61 | 0.61 |
SVM | 0.9 | 0.88 | 0.83 | 0.81 | 0.82 | 0.8 | 0.84 | 0.82 | 0.82 | 0.81 | 0.63 | 0.63 |
KNN | 0.86 | 0.85 | 0.79 | 0.78 | 0.79 | 0.77 | 0.79 | 0.78 | 0.78 | 0.77 | 0.55 | 0.55 |