Table 2.
Type I Error Rate and Power Based on the Dual-Criteria Method and the Visual Analysis of Two Raters
| Number of Tiers with Clear Change | |||
|---|---|---|---|
| 2 of 2 | At Least 2 of 3 | 3 of 3 | |
| Dual-Criteria Method | |||
| Type I Error Rate | .004 | .013 | 0 |
| Power | .587 | .813 | .473 |
| Rater 1 | |||
| Type I Error Rate | .004 | .013 | 0 |
| Power | .831 | .907 | .793 |
| Rater 2 | |||
| Type I Error Rate | 0 | 0 | 0 |
| Power | .518 | .753 | .400 |
Note. The highlighted numbers identify combinations of tiers that simultaneously achieved a Type I error rate lower than .05 and a power higher than .80