Table 2.
Comparison between the Faster-RCNN model, expert observer (AFB), and naïve observers counts (raw counts, true positives: TP, false positives: FP, false negatives: FN, accuracy, precision, recall, and percentage difference: % diff.) of adults, calves, and ghosts caribou for each of the mosaics at 120 m and 75 m AGL in Wapusk National Park, Manitoba, Canada.
| Mosaic | Class | Raw counts | TP | FP | FN | Accuracy | Precision | Recall | % diff |
|---|---|---|---|---|---|---|---|---|---|
| Experienced observer | |||||||||
| Mosaic 1 (120 m) | Adults | 62 | |||||||
| Calves | 29 | ||||||||
| Ghosts | 4 | ||||||||
| Mosaic 2 (120 m) | Adults | 59 | |||||||
| Calves | 25 | ||||||||
| Ghosts | 25 | ||||||||
| Mosaic 3 (75 m) | Adults | 44 | |||||||
| Calves | 9 | ||||||||
| Ghosts | 10 | ||||||||
| Mosaic 4 (75 m) | Adults | 77 | |||||||
| Calves | 25 | ||||||||
| Ghosts | 34 | ||||||||
| Faster RCNN model | |||||||||
| Mosaic 1 (120 m) | Adults | 77 | 65 | 10 | 0 | 0.87 | 0.87 | 1.00 | + 19.5 |
| Calves | 27 | 24 | 1 | 2 | 0.89 | 0.96 | 0.92 | − 7.4 | |
| Ghosts | 10 | 6 | 5 | 1 | 0.50 | 0.55 | 0.86 | + 140.0 | |
| Mosaic 2 (120 m) | Adults | 70 | 51 | 13 | 5 | 0.74 | 0.80 | 0.91 | + 15.7 |
| Calves | 26 | 19 | 5 | 3 | 0.70 | 0.79 | 0.86 | + 3.8 | |
| Ghosts | 22 | 16 | 6 | 12 | 0.47 | 0.73 | 0.57 | − 12.0 | |
| Mosaic 3 (75 m) | Adults | 69 | 48 | 12 | 1 | 0.79 | 0.80 | 0.98 | + 36.2 |
| Calves | 19 | 11 | 6 | 0 | 0.65 | 0.65 | 1.00 | + 52.6 | |
| Ghosts | 15 | 12 | 4 | 0 | 0.75 | 0.75 | 1.00 | + 33.3 | |
| Mosaic 4 (75 m) | Adults | 102 | 78 | 17 | 0 | 0.82 | 0.82 | 1.00 | + 24.5 |
| Calves | 29 | 22 | 2 | 2 | 0.85 | 0.92 | 0.92 | + 13.8 | |
| Ghosts | 37 | 31 | 5 | 26 | 0.50 | 0.86 | 0.54 | + 8.1 | |
|
All observers (Avg ± S.D.) | |||||||||
| Mosaic 1 (120 m) | Adults | 56.6 ± 8.6 | 56.4 ± 8.7 | 3.2 ± 1.8 | 3.8 ± 3.8 | 0.89 | 0.94 | 0.93 | − 9.7 |
| Calves | 27.6 ± 3.0 | 24.8 ± 2.9 | 2.8 ± 2.4 | 2.6 ± 2.3 | 0.83 | 0.89 | 0.91 | − 6.9 | |
| Ghosts | 11.2 ± 7.9 | 5.8 ± 3.1 | 5.4 ± 6.5 | 1.2 ± 1.1 | 0.50 | 0.59 | 0.83 | + 63.6 | |
| Mosaic 2 (120 m) | Adults | 60.6 ± 5.9 | 55.0 ± 6.5 | 6.0 ± 1.9 | 2.4 ± 2.1 | 0.87 | 0.90 | 0.96 | + 1.6 |
| Calves | 25.0 ± 3.9 | 21.2 ± 2.7 | 3.8 ± 2.8 | 1.6 ± 1.3 | 0.81 | 0.85 | 0.93 | 0.0 | |
| Ghosts | 28.8 ± 10.1 | 25.6 ± 8.2 | 3.2 ± 4.5 | 2.4 ± 1.1 | 0.83 | 0.91 | 0.91 | + 13.7 | |
| Mosaic 3 (75 m) | Adults | 41.5 ± 4.4 | 39.8 ± 4.5 | 1.2 ± 0.8 | 1.4 ± 1.3 | 0.94 | 0.97 | 0.97 | − 6.8 |
| Calves | 11.4 ± 3.0 | 7.4 ± 1.5 | 4.0 ± 2.6 | 0.4 ± 0.5 | 0.64 | 0.67 | 0.95 | + 18.2 | |
| Ghosts | 9.2 ± 3.5 | 7.6 ± 2.5 | 1.6 ± 2.1 | 2.4 ± 2.3 | 0.67 | 0.86 | 0.76 | − 10.0 | |
| Mosaic 4 (75 m) | Adults | 66.8 ± 8.3 | 63.0 ± 7.6 | 3.8 ± 2.5 | 6.2 ± 6.5 | 0.86 | 0.94 | 0.91 | − 12.9 |
| Calves | 27.8 ± 3.9 | 24.6 ± 2.6 | 3.2 ± 2.9 | 1.0 ± 1.0 | 0.86 | 0.89 | 0.96 | + 10.7 | |
| Ghosts | 54.8 ± 16.6 | 47.8 ± 14.7 | 7.0 ± 4.8 | 3.8 ± 5.2 | 0.80 | 0.87 | 0.93 | + 38.2 | |