Table 2.
Five-fold cross validation statistical significance (p-value) using different scores. A. Rank normalized score (pairwise; Wilcoxon matched-pairs signed rank test), B. Rank normalized score (Unpaired Comparison; Mann-Whitney U test), C. ΔRNS (Unpaired Comparison; Mann-Whitney U test). Assay Central (AC); AdaBoost (ada); Bernoulli Naïve-Bayes (bnb); k-nearest neighbors (knn); Random Forest (rf); support vector classification (svc); Deep Neural Networks (DL).
| A. | |||||||
|---|---|---|---|---|---|---|---|
| ada | bnb | DL | knn | rf | svc | AC | |
| ada | N/A | 0.0078** | 0.1094 | 0.0078** | 0.0078** | 0.0078** | 0.0156* |
| bnb | 0.0078** | N/A | 0.0391* | 0.0078** | 0.0078** | 0.0078** | 0.0078** |
| DL | 0.1094 | 0.0391* | N/A | 0.5469 | 0.6406 | 0.1953 | 0.6406 |
| knn | 0.0078** | 0.0078** | 0.5469 | N/A | 0.0781 | 0.5469 | 0.1953 |
| rf | 0.0078** | 0.0078** | 0.6406 | 0.0781 | N/A | 0.1953 | 0.9453 |
| svc | 0.0078** | 0.0078** | 0.1953 | 0.5469 | 0.1953 | N/A | 0.3125 |
| AC | 0.0156* | 0.0078** | 0.6406 | 0.1953 | 0.9453 | 0.3125 | N/A |
| B. | |||||||
| ada | bnb | DL | knn | rf | svc | AC | |
| ada | N/A | 0.1949 | 0.3281 | 0.1049 | 0.1605 | 0.1049 | 0.1605 |
| bnb | 0.1949 | N/A | 0.1304 | 0.0499* | 0.1304 | 0.0281* | 0.0830 |
| DL | 0.3281 | 0.1304 | N/A | 0.9591 | 0.7984 | 0.6454 | 0.7984 |
| knn | 0.1049 | 0.0499* | 0.9591 | N/A | 0.3823 | 0.7984 | 0.5737 |
| rf | 0.1605 | 0.1304 | 0.7984 | 0.3823 | N/A | 0.4418 | 0.9591 |
| svc | 0.1049 | 0.0281* | 0.6454 | 0.7984 | 0.4418 | N/A | 0.5737 |
| AC | 0.1605 | 0.0830 | 0.7984 | 0.5737 | 0.9591 | 0.5737 | N/A |
| C. | |||||||
| ada | bnb | DL | knn | rf | svc | AC | |
| ada | N/A | 0.1949 | 0.0207* | 0.0011** | 0.0281* | 0.0095** | 0.0626 |
| bnb | 0.1949 | N/A | 0.0047** | 0.0002*** | 0.0002*** | 0.0065** | 0.0068** |
| DL | 0.0207* | 0.0047** | N/A | 0.5526 | 0.4418 | 0.1183 | 0.8527 |
| knn | 0.0011** | 0.0002*** | 0.5526 | N/A | 0.0626 | 0.3579 | 0.1790 |
| rf | 0.0281* | 0.0002*** | 0.4418 | 0.0626 | N/A | 0.0443* | 0.8527 |
| svc | 0.0095** | 0.0065** | 0.1183 | 0.3579 | 0.0443* | N/A | 0.2171 |
| AC | 0.0626 | 0.0068** | 0.8527 | 0.1790 | 0.8527 | 0.2171 | N/A |