Table 1.
Results of statistical significance test of the difference in mean significant ranks. The results reported are those of the two-sample, one-tailed Mann-Whitney-Wilcoxon test of the mean significant ranks based on top-precision. For each entry, the upper triangle of the table reports the test p-values adjusted using the Benjamini, Hochberg, and Yekutieli method. Results significant at 95% confidence level are reported in boldface text. The lower triangular part reports, when significant at 95% confidence level, the comparison of the average significant rank with between the algorithm in the row and the one in the column.
| Global methods | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FBM | HRG | HYP | SBM | ALG1 | |||||||||||||
| FBM | 0.01 | 0.00 | 0.08 | 0.00 | |||||||||||||
| HRG | > | 0.00 | 0.00 | 0.00 | |||||||||||||
| HYP | > | > | 0.00 | 0.00 | |||||||||||||
| SBM | < | < | 0.21 | ||||||||||||||
| ALG1 | < | < | < | ||||||||||||||
| Local methods on real networks | Local methods on simulated networks | ||||||||||||||||
| Small networks | nPSO networks | ||||||||||||||||
| ADA | CNE | CH | HPI | JID | PAT | RAL | ALG1 | ADA | CNE | CH | HPI | JID | PAT | RAL | ALG1 | ||
| ADA | 0.00 | 0.26 | 0.00 | 0.00 | 0.09 | 0.05 | 0.00 | ADA | 0.00 | 0.29 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | ||
| CNE | > | 0.00 | 0.00 | 0.00 | 1.00 | 0.00 | 0.00 | CNE | > | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | ||
| CH | < | 0.00 | 0.00 | 0.40 | 0.00 | 0.00 | CH | < | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | ||||
| HPI | > | > | > | 0.59 | 0.00 | 0.00 | 0.00 | HPI | > | > | > | 0.00 | 0.00 | 0.00 | 0.00 | ||
| JID | > | > | > | 0.00 | 0.00 | 0.00 | JID | > | > | > | > | 0.00 | 0.00 | 0.00 | |||
| PAT | < | < | 0.02 | 0.00 | PAT | > | > | > | > | > | 0.00 | 0.00 | |||||
| RAL | < | < | < | < | < | < | 0.00 | RAL | < | < | < | < | < | < | 0.42 | ||
| ALG1 | < | < | < | < | < | < | < | ALG1 | < | < | < | < | < | < | |||
| Large networks | Watts-Strogatz networks | ||||||||||||||||
| ADA | CNE | CH | HPI | JID | PAT | RAL | ALG1 | ADA | CNE | CH | HPI | JID | PAT | RAL | ALG1 | ||
| ADA | 0.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.93 | 0.00 | ADA | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.08 | 0.00 | ||
| CNE | > | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | CNE | < | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | ||
| CH | < | 0.00 | 0.00 | 0.00 | 0.67 | 0.00 | CH | > | > | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | |||
| HPI | > | > | > | 0.00 | 0.30 | 0.00 | 0.00 | HPI | < | < | < | 0.30 | 0.00 | 0.00 | 0.00 | ||
| JID | > | > | > | > | 0.00 | 0.00 | 0.00 | JID | < | < | < | 0.00 | 0.00 | 0.00 | |||
| PAT | > | > | > | < | 0.00 | 0.00 | PAT | > | > | > | > | > | 0.00 | 0.00 | |||
| RAL | < | < | < | < | 0.00 | RAL | > | < | > | > | < | 0.00 | |||||
| ALG1 | < | < | < | < | < | < | < | ALG1 | > | > | > | > | > | < | > | ||
| Very large networks | Barabàsi-Albert networks | ||||||||||||||||
| ADA | CNE | CH | HPI | JID | PAT | RAL | ALG1 | ADA | CNE | CH | HPI | JID | PAT | RAL | ALG1 | ||
| ADA | 0.00 | 0.05 | 0.00 | 0.00 | 0.00 | 1.00 | 0.00 | ADA | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | ||
| CNE | > | 0.00 | 0.00 | 0.00 | 0.00 | 0.30 | 0.00 | CNE | < | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.53 | ||
| CH | < | 0.00 | 0.00 | 0.00 | 0.15 | 0.00 | CH | > | > | 0.00 | 0.00 | 0.00 | 1.00 | 0.00 | |||
| HPI | > | > | > | 0.18 | 1.00 | 0.00 | 0.00 | HPI | > | > | > | 0.00 | 0.00 | 0.00 | 0.00 | ||
| JID | > | > | > | 0.37 | 0.00 | 0.00 | JID | > | > | > | > | 0.00 | 0.00 | 0.00 | |||
| PAT | > | > | > | 0.00 | 0.00 | PAT | < | < | < | < | < | 0.00 | 0.00 | ||||
| RAL | < | < | < | 0.00 | RAL | > | > | < | < | > | 0.00 | ||||||
| ALG1 | < | < | < | < | < | < | < | ALG1 | < | < | < | < | > | < | |||
| CAIDA AS networks | |||||||||||||||||
| ADA | CNE | CH | HPI | JID | PAT | RAL | ALG1 | ||||||||||
| ADA | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | ||||||||||
| CNE | > | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | ||||||||||
| CH | < | < | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | ||||||||||
| HPI | > | > | > | 0.00 | 0.00 | 0.00 | 0.00 | ||||||||||
| JID | > | > | > | > | 0.00 | 0.00 | 0.00 | ||||||||||
| PAT | > | > | > | < | < | 0.00 | 0.00 | ||||||||||
| RAL | > | > | > | < | < | < | 0.00 | ||||||||||
| ALG1 | < | < | < | < | < | < | < | ||||||||||