Table 7.
Aggregate results for Precision, Recall, Accuracy, F-Measure, MCC, and AUC-PR without (i.e., “w/o HT”) and with (i.e., “w/ HT”) the hyper-parameter optimization by Random Search in the cross-project setting
| Precision | Recall | Accuracy | ||||
|---|---|---|---|---|---|---|
| Test smell | w/o HT | w/ HT | w/o HT | w/ HT | w/o HT | w/ HT |
| Eager test | 0.27 | 0.30 | 0.64 | 0.54 | 0.42 | 0.53 |
| Mystery guest | 0.44 | 0.44 | 0.37 | 0.37 | 0.82 | 0.82 |
| Resource opt. | 0.25 | 0.24 | 0.32 | 0.30 | 0.87 | 0.87 |
| Test red. | 0.004 | 0.01 | 0.97 | 0.97 | 0.05 | 0.03 |
| F-Measure | MCC | AUC-PR | ||||
| Eager test | 0.38 | 0.39 | -0.01 | 0.06 | 0.32 | 0.33 |
| Mystery guest | 0.40 | 0.40 | 0.30 | 0.30 | 0.46 | 0.41 |
| Resource opt. | 0.28 | 0.26 | 0.22 | 0.20 | 0.27 | 0.28 |
| Test red. | 0.01 | 0.01 | 0.01 | 0.00 | 0.41 | 0.13 |