Table 5.
Shaffer's test for the ensemble approaches for the imbalance domain.
| Ensemble | AUC | Fm | Gmean | BalACC | ||||
|---|---|---|---|---|---|---|---|---|
| Original vs. DATABoost | – | 0.000 | – | 0.014 | 1.895 | 1.285 | ||
| Original vs. RUSBoost | 2.344 | 0.789 | – | 0.000 | – | 0.000 | ||
| Original vs. SMOTEBoost | 0.165 | 0.423 | 0.297 | – | 0.034 | |||
| Original vs. OVERBag | 0.555 | 1.285 | 0.106 | – | 0.005 | |||
| Original vs. SMOTEBag | – | 0.040 | – | 0.006 | 1.895 | 0.143 | ||
| Original vs. UNDERBag | 2.344 | – | 0.000 | – | 0.000 | – | 0.000 | |
| DATABoost vs. RUSBoost | + | 0.000 | 0.789 | – | 0.000 | – | 0.001 | |
| DATABoost vs. SMOTEBoost | 0.555 | 1.285 | 0.251 | 0.491 | ||||
| DATABoost vs. OVERBag | 0.218 | 0.372 | 0.078 | 0.199 | ||||
| DATABoost vs. SMOTEBag | 1.499 | 1.814 | 1.895 | 1.285 | ||||
| DATABoost vs. UNDERBag | + | 0.000 | 0.298 | – | 0.000 | – | 0.000 | |
| RUSBoost vs. SMOTEBoost | 0.165 | 1.814 | 0.297 | 0.205 | ||||
| RUSBoost vs. OVERBag | 0.555 | 1.814 | 0.549 | 0.549 | ||||
| RUSBoost vs. SMOTEBag | + | 0.040 | 0.701 | + | 0.005 | + | 0.049 | |
| RUSBoost vs. UNDERBag | 2.344 | – | 0.002 | 1.895 | 1.406 | |||
| SMOTEBoost vs. OVERBag | 2.344 | 1.516 | 1.895 | 1.406 | ||||
| SMOTEBoost vs. SMOTEBag | 2.344 | 1.031 | 0.974 | 1.406 | ||||
| SMOTEBoost vs. UNDERBag | – | 0.024 | – | 0.006 | 0.056 | – | 0.034 | |
| OVERBag vs. SMOTEBag | 1.663 | 0.298 | 0.491 | 1.285 | ||||
| OVERBag vs. UNDERBag | 0.091 | – | 0.000 | 0.143 | 0.143 | |||
| SMOTEBag vs. UNDERBag | – | 0.003 | 0.423 | – | 0.000 | – | 0.005 | |
Red color indicates the p-values with significant differences according to Shaffer's post-hoc (p <0.05); the sign “–” (respectively “+”) indicates that the first algorithm has a lower (higher) value than the second one.