Table 3.
Models performance metrics statistics.
Model | Class | Precision (%) |
Recall without Airflow (%) |
F1 (%) |
mAP@.5 (%) |
mAP@[.5:.95] (%) |
Parameters (MB) | Inference (ms) |
---|---|---|---|---|---|---|---|---|
YOLOV3-tiny | All | 91.6 | 99.6 | 95.1 | 95.4 | 59.9 | 17.4 | 1.3 |
Construction machinery | 98.2 | 99.0 | 98.6 | 99.4 | 58.1 | |||
Manual excavation | 99.0 | 99.2 | 99.1 | 99.6 | 58.1 | |||
Walking | 99.4 | 100.0 | 99.7 | 99.5 | 75.2 | |||
Climbing fence | 99.5 | 100.0 | 99.7 | 99.6 | 69.4 | |||
Airflow | 62.0 | 95.7 | 75.2 | 78.8 | 38.9 | |||
YOLOV3 | All | 98.6 | 99.7 | 99.1 | 99.4 | 68.3 | 123.5 | 6.2 |
Construction machinery | 97.2 | 99.0 | 98.1 | 99.3 | 62.8 | |||
Manual excavation | 98.9 | 99.6 | 99.2 | 99.6 | 58.5 | |||
Walking | 99.4 | 100.0 | 99.7 | 99.5 | 81.4 | |||
Climbing fence | 99.3 | 100.0 | 99.6 | 99.5 | 71.1 | |||
Airflow | 98.2 | 100.0 | 99.1 | 99.2 | 67.4 | |||
YOLO-RP | All | 96.7 | 99.7 | 98.0 | 98.8 | 68.6 | 20 | 1.8 |
Construction machinery | 97.8 | 99.0 | 98.4 | 99.5 | 64.0 | |||
Manual excavation | 100.0 | 99.8 | 99.9 | 99.6 | 59.8 | |||
Walking | 99.4 | 100.0 | 99.7 | 99.5 | 82.3 | |||
Climbing fence | 99.9 | 100.0 | 99.9 | 99.6 | 73.2 | |||
Airflow | 86.4 | 98.1 | 91.9 | 95.8 | 63.5 | |||
YOLO-RCP | All | 97.0 | 99.8 | 98.1 | 98.9 | 68.2 | 17.8 | 1.7 |
Construction machinery | 97.6 | 99.4 | 98.5 | 99.5 | 63.5 | |||
Manual excavation | 99.6 | 99.8 | 99.7 | 99.5 | 60.5 | |||
Walking | 99.4 | 100.0 | 99.7 | 99.5 | 82.2 | |||
Climbing fence | 98.8 | 100.0 | 99.4 | 99.5 | 71.7 | |||
Airflow | 89.7 | 96.9 | 93.2 | 96.1 | 63.3 | |||
YOLO-A30 | All | 99.2 | 99.8 | 99.2 | 99.5 | 69.3 | 14.4 | 1.8 |
Construction machinery | 98.8 | 99.4 | 99.1 | 99.5 | 62.5 | |||
Manual excavation | 99.5 | 99.6 | 99.5 | 99.4 | 59.3 | |||
Walking | 99.6 | 100.0 | 99.8 | 99.5 | 83.5 | |||
Climbing fence | 99.6 | 100.0 | 99.8 | 99.6 | 71.7 | |||
Airflow | 98.7 | 96.9 | 97.8 | 99.4 | 69.6 | |||
YOLO-A78 | All | 98.8 | 99.7 | 99.1 | 99.5 | 69.4 | 16.4 | 2.3 |
Construction machinery | 98.6 | 99.7 | 99.1 | 99.6 | 61.6 | |||
Manual excavation | 99.0 | 99.2 | 99.1 | 99.5 | 59.6 | |||
Walking | 99.5 | 100.0 | 99.7 | 99.5 | 82.3 | |||
Climbing fence | 99.5 | 100.0 | 99.7 | 99.5 | 73.4 | |||
Airflow | 97.6 | 98.8 | 98.2 | 99.2 | 70.2 |
The key performance metrics with the best results are highlighted.