Table 1.
Accuracy | Accuracy | Accuracy | Surrogate | Wilcoxon | |
---|---|---|---|---|---|
target (%) | decoy (%) | difference (%) | (p) | (p) | |
M1 | 55.5 | 41.3 | +14.2 | 0.008 | 0.029 |
M2 | 44.9 | 41.8 | +3.1 | ns | 0.004 |
M5 | 63.3 | 16.5 | +46.8 | <0.00005 | 0.00005 |
M6 | 45.1 | 39.5 | +5.6 | ns | ns |
It should be noted that absolute accuracy values for target and decoy ratings are subjective and depend on the judgment of the sitters. Some sitters may give generally higher scores to all items and some may give generally lower scores to all items. Calculating the differences between decoy and target reading scores (“Accuracy difference” column), rather than examining absolute target accuracy scores, addresses this bias.