Table 2.
Rank normalized score comparisons (Friedman (pairwise comparison) (A) or Kruskal-Wallis test (Independent comparison) (B) with Dunn’s multiple comparisons follow up tests).
| A. | |||||||
|---|---|---|---|---|---|---|---|
| Rank Normalized Score: Pairwise Comparison (Adjusted P-score) | |||||||
| Algorithm | Ada | Bnb | DL | Knn | RF | SVC | AC |
| Ada | N/A | >0.9999 (ns) | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** |
| Bnb | >0.9999 (ns) | N/A | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** |
| DL | <0.0001**** | <0.0001**** | N/A | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** |
| Knn | <0.0001**** | <0.0001**** | <0.0001**** | N/A | 0.0001*** | <0.0001**** | <0.0001**** |
| RF | <0.0001**** | <0.0001**** | <0.0001**** | 0.0001*** | N/A | <0.0001**** | <0.0001**** |
| SVC | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** | N/A | >0.9999 (ns) |
| AC | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** | >0.9999 (ns) | N/A |
| Rank Normalized Score: Pairwise Comparison (Mean Rank Difference) | |||||||
|
Winning Algorithm |
Ada | Bnb | DL | Knn | RF | SVC | AC |
| Ada | N/A | 198.5 (ns) | |||||
| Bnb | N/A | ||||||
| DL | 7585**** | 7784**** | N/A | ||||
| Knn | 9776**** | 9975**** | 2191**** | N/A | |||
| RF | 10763**** | 10961**** | 3178**** | 986.5*** | N/A | ||
| SVC | 16820**** | 17019**** | 9235**** | 7044**** | 6058**** | N/A | |
| AC | 17226**** | 17425**** | 9641**** | 7450**** | 6464**** | 406 (ns) | N/A |
| B. | |||||||
| Rank Normalized Score: Independent Comparison (Adjusted P-score) | |||||||
| Algorithm | Ada | Bnb | DL | Knn | RF | SVC | AC |
| Ada | N/A | 0.0011** | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** |
| Bnb | 0.0011** | N/A | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** |
| DL | <0.0001**** | <0.0001**** | N/A | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** |
| Knn | <0.0001**** | <0.0001**** | <0.0001**** | N/A | >0.9999 (ns) | <0.0001**** | <0.0001**** |
| RF | <0.0001**** | <0.0001**** | <0.0001**** | >0.9999 (ns) | N/A | <0.0001**** | <0.0001**** |
| SVC | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** | N/A | 0.6123 (ns) |
| AC | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** | <0.0001**** | 0.6123 (ns) | N/A |
| Rank Normalized Score: Independent Comparison (Mean Rank Difference) | |||||||
|
Winning Algorithm |
Ada | Bnb | DL | Knn | RF | SVC | AC |
| Ada | N/A | 825.8** | |||||
| Bnb | N/A | ||||||
| DL | 1996**** | 2822**** | N/A | ||||
| Knn | 3143**** | 3968**** | 1146**** | N/A | |||
| RF | 3390**** | 4216**** | 1394**** | 247.4 (ns) | N/A | ||
| SVC | 5008**** | 5834**** | 3011**** | 1865**** | 1618**** | N/A | |
| AC | 5453**** | 6278**** | 3456**** | 2310**** | 2062**** | 444.8 (ns) | N/A |
AC = Assay Central (Bayesian), rf = Random Forest, knn = k-Nearest Neighbors, svc = Support Vector Classification, bnb = Naïve Bayesian, ada = AdaBoosted Decision Trees, DL = Deep Learning.