Table 5.
Intraclass correlations for designs with one repeated-measures factor (2 levels). The experiments of Zwaan et al. included more variables, but these did not affect the results much, so that the design could be reduced to a one-way design. The table shows the intraclass correlations, which mostly reach the desired level of ICC2 = .80 when it is calculated within conditions. The table also shows that the average reported effect size was dz = .76. If the experiments had been based on a single observation per condition, the average effect size would have been dz = .24, illustrating the gain that can be made by having multiple observations per participant per condition.
| Study | Dependent variable | N parts | N conditions | Nobs_per_ cond | Across the entire dataset | Average within condition | dN = 1 | dN = tot | ||
|---|---|---|---|---|---|---|---|---|---|---|
| ICC1 | ICC2 | ICC1 | ICC2 | |||||||
| Camerer et al. (2018) | ||||||||||
| Aviezer et al. (2012) | Valence ratings | 14 | 2 | 88 | 0.01 | 0.60 | 0.23 | 0.96 | 0.94 | 1.43 |
| Kovacs et al. (2010) | Reaction time to visual stimuli | 95 | 2 | 5 | 0.41 | 0.87 | 0.40 | 0.76 | 0.29 | 0.72 |
| Sparrow et al. (2011) | Reaction time to visual stimuli | 234 | 2 | 8 & 16 | 0.10 | 0.91 | 0.10 | 0.81 | 0.03 | 0.10 |
| Zwaan et al. (2018) | ||||||||||
| associative priming | Reaction time to visual stimuli (Session 1) | 160 | 2 × 2 × 2 | 30 | 0.28 | 0.96 | 0.31 | 0.93 | 0.17 | 0.81 |
| Reaction time to visual stimuli (Session 2) | 0.30 | 0.96 | 0.31 | 0.92 | 0.18 | 0.94 | ||||
| false memories | Correct related-unrelated lures (Session 1) | 160 | 2 × 2 × 2 | 9 | 0.02 | 0.29 | 0.27 | 0.77 | 0.20 | 0.97 |
| Correct related-unrelated lures (Session 2) | 0.06 | 0.54 | 0.26 | 0.75 | 0.31 | 1.17 | ||||
| flanker task | RT stimulus congruent incongruent (Session 1) | 160 | 2 × 2 × 2 | 32 | 0.40 | 0.98 | 0.41 | 0.96 | 0.15 | 0.70 |
| RT stimulus congruent incongruent (Session 2) | 0.29 | 0.96 | 0.29 | 0.92 | 0.13 | 0.52 | ||||
| shape simulation | RT to shape matching sentence (Seesion 1) | 160 | 2 × 2 × 2 | 15 | 0.42 | 0.93 | 0.42 | 0.91 | 0.08 | 0.27 |
| RT to shape matching sentence (Seesion 2) | 0.49 | 0.97 | 0.50 | 0.94 | 0.17 | 0.50 | ||||
| spacing effect | Memory of massed v. spaced items (Session 1) | 160 | 2 × 2 × 2 | 40 | 0.03 | 0.54 | 0.03 | 0.40 | 0.20 | 0.87 |
| Memory of massed v. spaced items (Session 1) | 0.06 | 0.84 | 0.07 | 0.75 | 0.21 | 0.92 | ||||