Table 9.
Confusion matrix of Dynamic World to Expert Simple Majority, i.e. valid where at least one expert labeled and all agreed in any case (n = 57,707,212).
| Expert Simple Majority | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Water | Trees | Grass | Flooded Vegetation | Crops | Shrub & Scrub | Built Area | Bare Ground | Snow/Ice | Precision/User’s: | ||
| Dynamic World | Water | 7203733 | 12969 | 9542 | 82175 | 422487 | 16660 | 15451 | 116578 | 57 | 91.40% |
| Trees | 51183 | 15906784 | 596718 | 512895 | 1728587 | 1589558 | 80497 | 50509 | 492 | 77.50% | |
| Grass | 1066 | 77515 | 1030113 | 72589 | 1451071 | 213904 | 13709 | 91378 | 0 | 34.90% | |
| Flooded Veg. | 12885 | 15142 | 18924 | 521553 | 91294 | 33735 | 600 | 10042 | 0 | 74.10% | |
| Crops | 3830 | 78317 | 153125 | 12494 | 9204745 | 469898 | 37157 | 127148 | 0 | 91.30% | |
| Shrub & Scrub | 3231 | 663092 | 248003 | 36709 | 958322 | 2969428 | 64467 | 389238 | 5807 | 55.60% | |
| Built Area | 2150 | 36312 | 6089 | 68 | 325235 | 24489 | 4931216 | 22913 | 0 | 92.20% | |
| Bare Ground | 142656 | 2294 | 15237 | 203 | 338099 | 732591 | 132422 | 2124769 | 9991 | 60.70% | |
| Snow & Ice | 53479 | 128014 | 9 | 0 | 49884 | 26204 | 12566 | 134024 | 978892 | 70.80% | |
| Recall/Producer’s: | 96.40% | 94.00% | 49.60% | 42.10% | 63.20% | 48.90% | 93.30% | 69.30% | 98.40% | 77.8% | |