Skip to main content
. 2018 Jun 14;8:9145. doi: 10.1038/s41598-018-27272-w

Table 1.

Performance metrics of algorithm on spring 2016 test sets, which are the ‘less-cluttered’ 24 sets labeled {A1, …, A24} having 50 frames, ‘high-cluttered’ group containing 24 sets labeled {B1, …, B24} of 50 frames and the aggregate performance of all the total 2400 testing images.

Adapted metric Formulae ‘Less-cluttered’ group ‘High-cluttered’ group Aggregate
Average detection accuracy algorithmcounthumancount+errormargin 20362150=94.70% 459475=97.00% 24952625=95.05%
Average alarm-to-egg ratio excesscount(affectedsets)humancount+errormargin 162150=0.75% 21475=4.00% 372625=1.40%
Average miss-to-egg ratio undercounts(affectedsets)humancount+errormargin 132150=0.60% 3475=0.63% 162625=0.61%
Average precision algorithmcounthumancount+errormargin+excesscount 20362166=94.00 459496=93.00% 24952662=93.73%
F1- Score 2×Averageprecision×AveragedetectionaccuracyAverageprecision+AveragedetectionAccuracy 0.943 0.949 0.944

Error margin is found by taking 5% (i.e., the upper bound of the error bar) of the total human count for all image sets in each category.