Table 2. Threshold values and average MI2e value of the dataset from Speier et al. when optimizing on different evaluation metrics.
Metric | Threshold | p-value | Bit rate | p-value |
MI2e | 0.49 | 17.05 | ||
MI2 | 0.82 | 0.005 | 16.24 | 0.021 |
MI0 | 0.86 | 0.006 | 16.05 | 0.020 |
ACC | 0.98 | 0.001 | 13.14 | 0.007 |
SR | 0.12 | 0.003 | 15.25 | 0.008 |
ITR | 0.86 | 0.006 | 16.05 | 0.020 |
WSR | 0.93 | 0.001 | 15.31 | 0.005 |
PBR | 0.87 | 0.005 | 15.97 | 0.015 |
CPM | 0.87 | 0.005 | 15.97 | 0.015 |
OCM | * | * | * | * |
OCM was not computable because the system did not require all errors to be corrected. p-values are determined using paired t-tests between the given value and the results when optimizing on MI2e. Asterisks denote methods that cannot be computed for the target system.
method cannot be computed for the target system