Table 6.
Average Correlations Between Estimates Based on Original and Modified Linking Set Sample Sizes (Average Across Replications).
| Rater sample size | Specified location within linking set | Specified model–data fit within linking set | Examinees |
Raters |
Tasks |
|||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
r
(NLink = 8, NLink = 6)
|
r
(NLink = 8, NLink = 3)
|
r
(NLink = 8, NLink = 6)
|
r
(NLink = 8, NLink = 3)
|
r
(NLink = 8, NLink = 6)
|
r
(NLink = 8, NLink = 3)
|
|||||||||
| M | SD | M | SD | M | SD | M | SD | M | SD | M | SD | |||
| 50 | Low | Acceptable | 0.99 | 0.01 | 0.96 | 0.03 | 0.94 | 0.23 | 0.93 | 0.23 | 1.00 | 0.00 | 1.00 | 0.00 |
| Noisy | 1.00 | 0.00 | 0.99 | 0.00 | 0.96 | 0.02 | 0.82 | 0.06 | 1.00 | 0.00 | 1.00 | 0.00 | ||
| Average | Acceptable | 0.99 | 0.00 | 0.96 | 0.01 | 1.00 | 0.00 | 0.99 | 0.01 | 1.00 | 0.00 | 1.00 | 0.00 | |
| Noisy | 1.00 | 0.00 | 1.00 | 0.00 | 0.96 | 0.01 | 0.83 | 0.05 | 1.00 | 0.00 | 1.00 | 0.00 | ||
| High | Acceptable | 0.99 | 0.01 | 0.96 | 0.02 | 1.00 | 0.00 | 0.98 | 0.01 | 1.00 | 0.00 | 1.00 | 0.00 | |
| Noisy | 1.00 | 0.00 | 0.99 | 0.00 | 0.95 | 0.02 | 0.80 | 0.08 | 1.00 | 0.00 | 1.00 | 0.00 | ||
| 250 | Low | Acceptable | 0.99 | 0.01 | 0.96 | 0.02 | 0.97 | 0.13 | 0.96 | 0.14 | 1.00 | 0.00 | 1.00 | 0.00 |
| Noisy | 1.00 | 0.00 | 0.99 | 0.00 | 0.89 | 0.25 | 0.80 | 0.23 | 1.00 | 0.00 | 1.00 | 0.00 | ||
| Average | Acceptable | 0.99 | 0.00 | 0.97 | 0.01 | 0.98 | 0.11 | 0.97 | 0.12 | 1.00 | 0.00 | 1.00 | 0.00 | |
| Noisy | 1.00 | 0.00 | 1.00 | 0.00 | 0.98 | 0.00 | 0.90 | 0.01 | 1.00 | 0.00 | 1.00 | 0.00 | ||
| High | Acceptable | 0.99 | 0.00 | 0.97 | 0.01 | 1.00 | 0.00 | 0.98 | 0.01 | 1.00 | 0.00 | 1.00 | 0.00 | |
| Noisy | 1.00 | 0.00 | 0.99 | 0.00 | 0.91 | 0.23 | 0.82 | 0.22 | 1.00 | 0.00 | 1.00 | 0.00 | ||
Note. M = mean; SD = standard deviation.