((a): counting metrics, (b): multi-threshold metrics) related to poor metric selection [P2]. Pitfalls for semantic segmentation, object detection and instance segmentation are provided in Extended Data Tabs. 2–5 respectively. A warning sign indicates a potential pitfall for the metric in the corresponding column, in case the property represented by the respective row holds true. Comprehensive illustrations of pitfalls are available in Suppl. Note 2. A comprehensive list of pitfalls is provided separately for each metrics in the metrics cheat sheets (Suppl. Note 3). Note that we only list sources of pitfalls relevant to the considered metrics. Other sources of pitfalls are neglected for this table.
