Table 6.
ΔAUC relative to SA Tableau Search in the COPS benchmark data set.
| Method(s) | ΔAUC |
|---|---|
| DaliLite | - 0.0349 |
| SHEBA | - 0.0201 |
| YAKUSA | - 0.0180 |
| SARF2 | - 0.0140 |
| SA Tableau Search 4096, VAST, LOCK2 | 0.000 |
| SA Tableau Search 128 | 0.0064 |
| QP Tableau Search | 0.0325 |
| TOPS | 0.0764 |
| IR Tableau | 0.1120 |
| TableauSearch | 0.1172 |
Difference in AUC relative to SA Tableau Search (4096 restarts) methods on the COPS benchmark data set. The table is sorted by ΔAUC, so that methods with higher AUC than SA Tableau Search (ΔAUC < 0, with p-value < 0.05) are at the top of the table, and those with lower AUC than SA tableau search (ΔAUC > 0, with p-value < 0.05) are at the bottom of the table. Methods for which there is no statistically significant difference in AUC from SA Tableau Search (4096 restarts) at p-value 0.05 are shown in a single row with ΔAUC = 0.000.