Table 2.
Evaluation metrics and plots used by related works (the * indicates an adjustment of the metric or plot).
| Publications | Absolute Error | Signed Error | Visual Inspection | Correlation | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CDF | Boxplot | Mean | Median | Standard Deviation | CDF of Signed Error | Overestimation % | Overestimation Median | Underestimation Median | Q-Q Plot | Scatter vs. | Plot and | Pearson r | Pearson p-Value | Spearman | Spearman p-Value | Other | |
| Dearman et al. [6] | * | + | Custom Plots | ||||||||||||||
| Lemelson et al. [7] | * | + | + | + | + | ||||||||||||
| Beker et al. [27] | Error Heatmaps | ||||||||||||||||
| Moghtadaiee et al. [3] | Mean AE | ||||||||||||||||
| Marcus et al. [8] | + | ||||||||||||||||
| Zou et al. [4] | + | Est. selection | |||||||||||||||
| de la Osa et al. [28] | + | ||||||||||||||||
| Elbakly and Youssef [11] | + | + | + | + | + | + | |||||||||||
| Berkvens et al. [20] | + | ||||||||||||||||
| Berkvens et al. [21] | + | + | + | ||||||||||||||
| Nikitin at al. [5] | + | Custom Metric | |||||||||||||||
| Li et al. [10] | + | + | Hand-off Eval. | ||||||||||||||
| Khandker et al. [22] | * | Custom plots | |||||||||||||||
| Lemic, Hand., Fam. [16] | + | + | Stud. res. | ||||||||||||||
| Lemic et al. [9] | + | + | Stud. res. | ||||||||||||||
| Lemic and Famaey [17] | + | + | Stud. res. | ||||||||||||||