Table 4.
Training | Validation | Test | |||||
---|---|---|---|---|---|---|---|
Case Study | Model | Accuracy | Accuracy | False Healthy | False Degraded | Recall | F1-Score |
VRU Scrubber | SVM | 0.97 | 0.97 | 0.00 | 0.03 | 0.97 | 0.97 |
RF | 0.99 | 0.99 | 0.00 | 0.01 | 0.99 | 0.99 | |
NN | 0.99 | 0.99 | 0.00 | 0.01 | 0.99 | 0.99 | |
BNN | 0.97 | 0.97 | 0.02 | 0.01 | 0.96 | 0.96 | |
CMC Crusher | SVM | 0.72 | 0.73 | 0.03 | 0.21 | 0.97 | 0.97 |
RF | 0.99 | 0.96 | 0.01 | 0.02 | 0.95 | 0.95 | |
NN | 0.93 | 0.93 | 0.00 | 0.05 | 0.91 | 0.91 | |
BNN | 0.70 | 0.72 | 0.03 | 0.26 | 0.72 | 0.70 |