Table 6.
Ability to discriminate between types of effect |
Accuracy |
||||||
---|---|---|---|---|---|---|---|
Technique | Hits | FA | A′ | B″ | EER | RMSE | PS |
Low within-trial noise and low between-subject variability | |||||||
SS 10% | 0.92 | 0.01 | 0.98 | 0.76 | 0.04 | 14.98 | 1.01 |
SS 30% | 1.00 | 0.00 | 1.00 | 0.00 | 0.01 | 19.71 | 1.00 |
SS 50% | 1.00 | 0.01 | 1.00 | –0.33 | 0.01 | 24.66 | 1.02 |
SS 70% | 1.00 | 0.01 | 1.00 | –0.33 | 0.01 | 30.37 | 1.01 |
SS 90% | 0.95 | 0.03 | 0.98 | 0.24 | 0.04 | 38.98 | 1.03 |
JK 10% | 0.76 | 0.01 | 0.94 | 0.90 | 0.12 | 15.48 | 0.99 |
JK 30% | 0.98 | 0.05 | 0.98 | –0.42 | 0.04 | 19.72 | 1.00 |
JK 50% | 1.00 | 0.09 | 0.98 | –0.89 | 0.05 | 24.48 | 1.01 |
JK 70% | 0.97 | 0.14 | 0.96 | –0.61 | 0.09 | 29.80 | 1.00 |
JK 90% | 0.48 | 0.22 | 0.72 | 0.19 | 0.37 | 37.96 | 1.02 |
SS 1df | 1.00 | 0.00 | 1.00 | 0.00 | 0.01 | 5.83 | 1.00 |
SS 2Rdf | 1.00 | 0.00 | 1.00 | 0.00 | 0.01 | 5.83 | 1.00 |
JK 1df | 0.98 | 0.00 | 0.99 | 0.59 | 0.01 | 4.78 | 0.99 |
JK 2Rdf | 0.98 | 0.00 | 0.99 | 0.59 | 0.01 | 4.78 | 0.99 |
High within-trial noise and high between-subject variability | |||||||
SS 10% | 0.14 | 0.07 | 0.64 | 0.30 | 0.46 | 19.66 | 0.65 |
SS 30% | 1.00 | 0.02 | 0.99 | –0.60 | 0.01 | 19.57 | 1.02 |
SS 50% | 1.00 | 0.03 | 0.99 | –0.71 | 0.02 | 24.66 | 1.02 |
SS 70% | 0.99 | 0.03 | 0.99 | –0.49 | 0.02 | 30.13 | 1.01 |
SS 90% | 0.53 | 0.02 | 0.87 | 0.85 | 0.25 | 39.28 | 1.05 |
JK 10% | 0.29 | 0.01 | 0.81 | 0.91 | 0.36 | 14.24 | 1.00 |
JK 30% | 0.71 | 0.03 | 0.91 | 0.75 | 0.16 | 20.04 | 1.02 |
JK 50% | 0.89 | 0.01 | 0.97 | 0.82 | 0.06 | 24.56 | 1.03 |
JK 70% | 0.77 | 0.01 | 0.94 | 0.89 | 0.12 | 29.36 | 1.00 |
JK 90% | 0.22 | 0.02 | 0.78 | 0.79 | 0.40 | 37.92 | 1.05 |
SS 1df | 1.00 | 0.03 | 0.99 | –0.71 | 0.02 | 7.60 | 1.01 |
SS 2Rdf | 1.00 | 0.03 | 0.99 | –0.71 | 0.02 | 7.60 | 1.01 |
JK 1df | 0.94 | 0.02 | 0.98 | 0.48 | 0.04 | 6.13 | 0.99 |
JK 2Rdf | 0.94 | 0.02 | 0.98 | 0.48 | 0.04 | 6.13 | 0.99 |
Note: SS = single-subject procedure; JK = jack-knife procedure; x% = relative-criterion method; and xdf = regression-based method.