Table 2. Average agreement for different achievement tests at different cut points by varying levels of reliability.
Achievement < 85 | Achievement < 90 | ||||||
---|---|---|---|---|---|---|---|
|
|
||||||
Product of reliabilities | Selection N | POa | PA | NAb | POa | PA | NAb |
0.49 | 3875.8 (51.3) | 0.97 | 0.33 (0.11) | 0.99 | 0.96 | 0.37 (0.10) | 0.98 |
0.56 | 3784.0 (51.3) | 0.97 | 0.37 (0.11) | 0.98 | 0.96 | 0.40 (0.11) | 0.98 |
0.63 | 3688.8 (50.8) | 0.97 | 0.40 (0.11) | 0.98 | 0.96 | 0.43 (0.11) | 0.98 |
0.64 | 3675.3 (51.4) | 0.97 | 0.43 (0.11) | 0.99 | 0.96 | 0.46 (0.11) | 0.98 |
0.72 | 3560.3 (51.4) | 0.97 | 0.48 (0.11) | 0.99 | 0.96 | 0.50 (0.11) | 0.98 |
0.81 | 3417.8 (50.5) | 0.97 | 0.56 (0.10) | 0.99 | 0.96 | 0.59 (0.10) | 0.98 |
Note: Values in parentheses are standard deviations.
Standard deviations omitted, all values = 0.02;
Standard deviations omitted, all values = 0.01.
PO = Overall Agreement; PA = Positive Agreement; NA = Negative Agreement.