Table 2.
Classification report of individual and hybrid models.
| Model | Train | Validation | Test | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Accuracy | Kappa | precision | recall | F1 | support | Accuracy | Kappa | precision | recall | F1 | support | Accuracy | Kappa | precision | recall | F1 | support | |
| Logistic regression | 0.75 | 0.61 | 0.75 | 0.75 | 0.75 | 122 | 0.71 | 0.54 | 0.74 | 0.71 | 0.71 | 41 | 0.73 | 0.58 | 0.77 | 0.73 | 0.74 | 41 |
| LDA | 0.75 | 0.60 | 0.76 | 0.75 | 0.75 | 122 | 0.73 | 0.58 | 0.78 | 0.73 | 0.74 | 41 | 0.80 | 0.69 | 0.81 | 0.80 | 0.81 | 41 |
| Ridge classifier | 0.75 | 0.61 | 0.76 | 0.75 | 0.75 | 122 | 0.68 | 0.51 | 0.73 | 0.68 | 0.69 | 41 | 0.73 | 0.58 | 0.75 | 0.73 | 0.74 | 41 |
| KNN | 0.77 | 0.62 | 0.77 | 0.77 | 0.77 | 122 | 0.78 | 0.65 | 0.80 | 0.78 | 0.78 | 41 | 0.78 | 0.65 | 0.80 | 0.78 | 0.78 | 41 |
| Radius neighbors | 0.80 | 0.67 | 0.79 | 0.80 | 0.79 | 122 | 0.76 | 0.62 | 0.78 | 0.76 | 0.76 | 41 | 0.80 | 0.69 | 0.81 | 0.80 | 0.81 | 41 |
| SVC | 0.77 | 0.63 | 0.77 | 0.77 | 0.76 | 122 | 0.73 | 0.58 | 0.78 | 0.73 | 0.74 | 41 | 0.80 | 0.69 | 0.81 | 0.80 | 0.81 | 41 |
| NuSVC | 0.75 | 0.60 | 0.76 | 0.75 | 0.75 | 122 | 0.73 | 0.58 | 0.78 | 0.73 | 0.74 | 41 | 0.80 | 0.69 | 0.81 | 0.80 | 0.81 | 41 |
| DT | 0.78 | 0.64 | 0.78 | 0.78 | 0.78 | 122 | 0.76 | 0.62 | 0.78 | 0.76 | 0.76 | 41 | 0.78 | 0.65 | 0.80 | 0.78 | 0.78 | 41 |
| RF | 0.82 | 0.70 | 0.82 | 0.82 | 0.82 | 122 | 0.78 | 0.65 | 0.80 | 0.78 | 0.78 | 41 | 0.78 | 0.65 | 0.80 | 0.78 | 0.78 | 41 |
| GBM | 0.84 | 0.73 | 0.84 | 0.84 | 0.83 | 122 | 0.78 | 0.65 | 0.80 | 0.78 | 0.78 | 41 | 0.78 | 0.65 | 0.82 | 0.78 | 0.79 | 41 |
| GaussianNB | 0.75 | 0.60 | 0.76 | 0.75 | 0.75 | 122 | 0.73 | 0.58 | 0.78 | 0.73 | 0.74 | 41 | 0.80 | 0.69 | 0.81 | 0.80 | 0.81 | 41 |
| AdaBoost | 0.89 | 0.82 | 0.89 | 0.89 | 0.89 | 122 | 0.68 | 0.52 | 0.73 | 0.68 | 0.69 | 41 | 0.71 | 0.55 | 0.74 | 0.71 | 0.71 | 41 |
| LightGBM | 0.79 | 0.65 | 0.79 | 0.79 | 0.78 | 122 | 0.78 | 0.65 | 0.80 | 0.78 | 0.78 | 41 | 0.78 | 0.65 | 0.80 | 0.78 | 0.78 | 41 |
| XGBoost | 0.80 | 0.66 | 0.80 | 0.80 | 0.79 | 122 | 0.78 | 0.65 | 0.80 | 0.78 | 0.78 | 41 | 0.78 | 0.65 | 0.80 | 0.78 | 0.78 | 41 |
| CatBoost | 0.78 | 0.64 | 0.78 | 0.78 | 0.78 | 122 | 0.78 | 0.65 | 0.80 | 0.78 | 0.78 | 41 | 0.78 | 0.65 | 0.80 | 0.78 | 0.78 | 41 |
| Stacking | 0.73 | 0.57 | 0.73 | 0.73 | 0.72 | 122 | 0.78 | 0.66 | 0.83 | 0.78 | 0.79 | 41 | 0.80 | 0.69 | 0.81 | 0.80 | 0.81 | 41 |
| LDA+Stacking | 0.78 | 0.64 | 0.78 | 0.78 | 0.77 | 122 | 0.76 | 0.61 | 0.79 | 0.76 | 0.76 | 41 | 0.83 | 0.73 | 0.84 | 0.83 | 0.83 | 41 |
| NuSVC+Stacking | 0.78 | 0.64 | 0.78 | 0.78 | 0.77 | 122 | 0.76 | 0.61 | 0.79 | 0.76 | 0.76 | 41 | 0.83 | 0.73 | 0.84 | 0.83 | 0.83 | 41 |
| Radius neighbors+stacking | 0.80 | 0.67 | 0.80 | 0.80 | 0.79 | 122 | 0.76 | 0.61 | 0.78 | 0.76 | 0.76 | 41 | 0.83 | 0.73 | 0.83 | 0.83 | 0.83 | 41 |
| GaussianNB+stacking | 0.78 | 0.64 | 0.78 | 0.78 | 0.77 | 122 | 0.76 | 0.61 | 0.79 | 0.76 | 0.76 | 41 | 0.83 | 0.73 | 0.84 | 0.83 | 0.83 | 41 |
| KNN+stacking | 0.76 | 0.62 | 0.76 | 0.76 | 0.76 | 122 | 0.80 | 0.70 | 0.84 | 0.80 | 0.81 | 41 | 0.83 | 0.73 | 0.84 | 0.83 | 0.83 | 41 |
| CatBoost+stacking | 0.80 | 0.67 | 0.80 | 0.80 | 0.80 | 122 | 0.80 | 0.70 | 0.84 | 0.80 | 0.81 | 41 | 0.83 | 0.73 | 0.85 | 0.83 | 0.83 | 41 |