Table 6.
Robustness results on PBSIM data with 5 and 10 as read depth.
| Embed. method | ML algo. | Depth: 5 | Depth: 10 | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Acc. | Prec. | Recall | F1 weigh. | F1 macro | ROC-AUC | Train. runtime (s) | Acc. | Prec. | Recall | F1 weigh. | F1 macro | ROC-AUC | Train. runtime (s) | ||
| k-mers vector | SVM | 0.01 | 0.00 | 0.01 | 0.00 | 0.00 | 0.502 | 16.48 | 0.01 | 0.00 | 0.01 | 0.00 | 0.00 | 0.500 | 16.88 |
| NB | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.501 | 0.68 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.501 | 0.71 | |
| MLP | 0.282 | 0.083 | 0.285 | 0.123 | 0.01 | 0.505 | 23.65 | 0.02 | 0.00 | 0.02 | 0.00 | 0.00 | 0.507 | 16.86 | |
| KNN | 0.285 | 0.081 | 0.283 | 0.121 | 0.01 | 0.504 | 1.68 | 0.28 | 0.08 | 0.28 | 0.12 | 0.01 | 0.505 | 1.78 | |
| RF | 0.289 | 0.085 | 0.289 | 0.124 | 0.01 | 0.509 | 1.78 | 0.28 | 0.08 | 0.28 | 0.12 | 0.01 | 0.502 | 2.88 | |
| LR | 0.01 | 0.00 | 0.01 | 0.00 | 0.00 | 0.501 | 11.30 | 0.01 | 0.00 | 0.01 | 0.00 | 0.00 | 0.501 | 12.04 | |
| DT | 0.01 | 0.00 | 0.01 | 0.00 | 0.00 | 0.503 | 0.34 | 0.01 | 0.00 | 0.01 | 0.00 | 0.00 | 0.505 | 0.36 | |
| PSSM vector | SVM | 0.27 | 0.07 | 0.27 | 0.11 | 0.01 | 0.504 | 8.14 | 0.30 | 0.09 | 0.30 | 0.13 | 0.01 | 0.506 | 8.32 |
| NB | 0.27 | 0.07 | 0.27 | 0.11 | 0.01 | 0.501 | 0.34 | 0.30 | 0.09 | 0.30 | 0.13 | 0.01 | 0.508 | 0.36 | |
| MLP | 0.27 | 0.07 | 0.27 | 0.11 | 0.01 | 0.506 | 7.47 | 0.30 | 0.09 | 0.30 | 0.13 | 0.01 | 0.503 | 7.90 | |
| KNN | 0.27 | 0.07 | 0.27 | 0.11 | 0.01 | 0.502 | 0.51 | 0.01 | 0.05 | 0.01 | 0.00 | 0.00 | 0.502 | 0.52 | |
| RF | 0.27 | 0.07 | 0.27 | 0.11 | 0.01 | 0.507 | 1.17 | 0.302 | 0.096 | 0.302 | 0.130 | 0.012 | 0.505 | 0.98 | |
| LR | 0.27 | 0.07 | 0.27 | 0.11 | 0.01 | 0.503 | 3.76 | 0.301 | 0.095 | 0.301 | 0.131 | 0.016 | 0.501 | 3.62 | |
| DT | 0.27 | 0.07 | 0.27 | 0.11 | 0.01 | 0.501 | 0.02 | 0.304 | 0.099 | 0.304 | 0.136 | 0.017 | 0.509 | 0.02 | |
| Minimizer vector | SVM | 0.27 | 0.07 | 0.26 | 0.11 | 0.01 | 0.506 | 5.22 | 0.27 | 0.08 | 0.27 | 0.12 | 0.01 | 0.501 | 4.91 |
| NB | 0.26 | 0.07 | 0.27 | 0.11 | 0.265 | 0.502 | 0.43 | 0.27 | 0.08 | 0.27 | 0.12 | 0.01 | 0.504 | 0.34 | |
| MLP | 0.26 | 0.07 | 0.26 | 0.11 | 0.261 | 0.504 | 1.63 | 0.27 | 0.08 | 0.27 | 0.12 | 0.01 | 0.506 | 1.92 | |
| KNN | 0.26 | 0.07 | 0.26 | 0.11 | 0.263 | 0.506 | 0.62 | 0.08 | 0.01 | 0.08 | 0.01 | 0.00 | 0.503 | 0.69 | |
| RF | 0.26 | 0.07 | 0.26 | 0.11 | 0.268 | 0.501 | 0.67 | 0.27 | 0.08 | 0.27 | 0.12 | 0.01 | 0.502 | 0.77 | |
| LR | 0.26 | 0.07 | 0.26 | 0.11 | 0.267 | 0.502 | 0.69 | 0.27 | 0.08 | 0.27 | 0.12 | 0.01 | 0.504 | 0.67 | |
| DT | 0.26 | 0.07 | 0.26 | 0.11 | 0.266 | 0.505 | 0.17 | 0.27 | 0.08 | 0.27 | 0.12 | 0.01 | 0.501 | 0.26 | |
The best values are shown in bold.