Table 4. Cognitive test scores at Time 1 and Time 2, and reliability statistics.
| Time 1 | Time 2 | Relative reliability indices | Absolute reliability indices | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| N | Mean (SD) | Mean (SD) | r | ICC (2,1) | P-value | F-value | P-value | Mean square residual | SEM | Smallest real difference | |
| Verbal-numerical reasoning | 4,523 | 6.95 (2.01) | 7.00 (2.01) | 0.65 | 0.65 | <0.001 | 5.32 | 0.021 | 1.42 | 1.19 | 3.30 |
| Log reaction time | 19,327 | 6.29 (0.17) | 6.30 (0.18) | 0.57 | 0.57 | <0.001 | 110.06 | <0.001 | 0.01 | 0.12 | 0.28 |
| (untransformed) | 548.36 (102.67) | 556.09 (109.34) | 0.54 | 0.54 | <0.001 | 111.79 | <0.001 | 5162.00 | 71.85 | 199.15 | |
| Log visual memory errors | 19,017 | 1.42 (0.64) | 1.38 (0.63) | 0.16 | 0.16 | <0.001 | 42.76 | <0.001 | 0.34 | 0.58 | 1.61 |
| (untransformed) | 5.00 (3.17) | 4.80 (3.05) | 0.19 | 0.19 | <0.001 | 51.80 | <0.001 | 7.82 | 2.80 | 7.75 | |
Notes: SD = standard deviation. ICC = intraclass correlation. SEM = standard error of measurement, equivalent to the square root of mean square residual[16]. Smallest real difference = ‘SEM * 1.96 * √2’. F-value = within participants ANOVA.