Table 13.
Comparisons of binary results for precision, recall, F1-score and runtimes for RCNN, XCNN and generic algorithms.
| Dataset/Approach | Precision | Recall | F1-Score | Train Time | Predict Time | Total Runtime | |
|---|---|---|---|---|---|---|---|
| CCD-INID-V1/RCNN | 0 | 0.96 | 0.95 | 0.96 | 28.96 s | 3.32 s | 32.28 s |
| 1 | 0.95 | 0.96 | 0.96 | ||||
| CCD-INID-V1/XCNN | 0 | 0.99 | 0.99 | 0.99 | 42.32 s | 9.07 s | 51.39 s |
| 1 | 0.99 | 0.99 | 0.99 | ||||
| CCD-INID-V1/KNN | 0 | 1.00 | 1.00 | 1.00 | 26.1 ms | 7 min 53 s | 7 min 53 s |
| 1 | 1.00 | 1.00 | 1.00 | ||||
| CCD-INID-V1/LR | 0 | 0.60 | 0.71 | 0.65 | 8.57 s | 350 ms | 8.92 s |
| 1 | 0.67 | 0.55 | 0.60 | ||||
| CCD-INID-V1/NB | 0 | 0.60 | 0.71 | 0.65 | 19.9 ms | 18.2 ms | 38.1 ms |
| 1 | 0.67 | 0.55 | 0.60 | ||||
| CCD-INID-V1/SVM | 0 | 0.60 | 0.71 | 0.65 | 22.3 s | 34.9 ms | 22.33 s |
| 1 | 0.67 | 0.55 | 0.60 | ||||
| Balot/RCNN | 0 | 1.00 | 1.00 | 1.00 | 63.23 s | 8.24 s | 71.47 s |
| 1 | 1.00 | 1.00 | 1.00 | ||||
| Balot/XCNN | 0 | 0.99 | 0.99 | 0.99 | 60.03 s | 12.10 s | 72.13 s |
| 1 | 0.99 | 0.99 | 0.99 | ||||
| Balot/KNN | 0 | 0.99 | 0.99 | 0.99 | 5 min 21 s | 165 min 41 s | 171 min 2 s |
| 1 | 0.99 | 0.99 | 0.99 | ||||
| Balot/LR | 0 | 0.86 | 0.75 | 0.80 | 19 min 3 s | 2 min 14 s | 21 min 17 s |
| 1 | 0.84 | 0.92 | 0.88 | ||||
| Balot/NB | 0 | 0.60 | 0.71 | 0.65 | 4 min 32 s | 5 min 21 s | 9 min 53 s |
| 1 | 0.67 | 0.55 | 0.60 | ||||
| Balot/SVM | 0 | 0.84 | 0.57 | 0.68 | 25 min 6 s | 3 min 17 s | 28 min 23 s |
| 1 | 0.76 | 0.93 | 0.83 | ||||
| DoH20/RCNN | 0 | 0.98 | 0.99 | 0.99 | 24 s | 11.45 s | 35.45 s |
| 1 | 0.99 | 0.98 | 0.99 | ||||
| DoH20/XCNN | 0 | 1.00 | 1.00 | 1.00 | 67.45 s | 5.46 s | 72.91 s |
| 1 | 1.00 | 1.00 | 1.00 | ||||
| DoH20/KNN | 0 | 0.93 | 0.83 | 0.88 | 19 ms | 79 min 46 s | 79 min 46 s |
| 1 | 0.99 | 0.99 | 0.99 | ||||
| DoH20/LR | 0 | 0.87 | 0.70 | 0.78 | 16 min 44 s | 226 ms | 166 min 46 s |
| 1 | 0.98 | 0.99 | 0.98 | ||||
| DoH20/NB | 0 | 0.93 | 0.83 | 0.88 | 109 ms | 23.6 ms | 132.6 ms |
| 1 | 0.99 | 0.99 | 0.99 | ||||
| DoH20/SVM | 0 | 0.45 | 0.67 | 0.54 | 50.2 s | 36.3 ms | 50.24 s |
| 1 | 0.97 | 0.94 | 0.95 |