Table 12.
Good results obtained with ML/AI models.
| Model type | Preset | Accuracy % (Validation) | Accuracy % (Test) | Macro precision % (Validation) | Macro recall % (Validation) | Macro F1 score % (Validation) | Macro precision % (Test) | Macro recall % (Test) | Macro F1 score % (Test) |
|---|---|---|---|---|---|---|---|---|---|
| Tree | Fine tree | 99.92 | 99.81 | 99.92 | 99.92 | 99.92 | 99.81 | 99.81 | 99.81 |
| SVM | Quadratic SVM | 99.79 | 99.73 | 99.79 | 99.79 | 99.79 | 99.73 | 99.73 | 99.73 |
| Cubic SVM | 99.89 | 99.81 | 99.89 | 99.89 | 99.89 | 99.82 | 99.81 | 99.81 | |
| Fine Gaussian SVM | 99.81 | 99.65 | 99.81 | 99.81 | 99.81 | 99.65 | 99.65 | 99.65 | |
| Medium Gaussian SVM | 97.87 | 98.65 | 97.89 | 97.87 | 97.86 | 98.65 | 98.65 | 98.64 | |
| KNN | Fine KNN | 99.82 | 99.73 | 99.82 | 99.82 | 99.82 | 99.73 | 99.73 | 99.73 |
| Medium KNN | 99.66 | 99.68 | 99.66 | 99.66 | 99.66 | 99.68 | 99.68 | 99.68 | |
| Coarse KNN | 97.77 | 98.63 | 97.77 | 97.77 | 97.77 | 98.63 | 98.63 | 98.63 | |
| Cosine KNN | 99.69 | 99.71 | 99.69 | 99.69 | 99.69 | 99.71 | 99.71 | 99.71 | |
| Cubic KNN | 99.48 | 99.48 | 99.48 | 99.48 | 99.48 | 99.48 | 99.48 | 99.48 | |
| Weighted KNN | 99.75 | 99.73 | 99.75 | 99.75 | 99.75 | 99.73 | 99.73 | 99.73 | |
| Kernel | SVM Kernel | 99.77 | 99.66 | 99.77 | 99.77 | 99.77 | 99.67 | 99.66 | 99.66 |
| Logistic Regression Kernel | 99.05 | 99.34 | 99.05 | 99.05 | 99.04 | 99.34 | 99.34 | 99.34 | |
| Ensemble | Boosted Trees | 99.70 | 99.92 | 99.70 | 99.70 | 99.70 | 99.92 | 99.92 | 99.92 |
| Bagged Trees | 99.98 | 99.91 | 99.98 | 99.98 | 99.98 | 99.91 | 99.91 | 99.91 | |
| Neural network | Narrow Neural Network | 99.87 | 99.80 | 99.87 | 99.87 | 99.87 | 99.80 | 99.80 | 99.80 |