Skip to main content
. 2019 Jul 19;2(1):16. doi: 10.5334/joc.72

Table 5.

Intraclass correlations for designs with one repeated-measures factor (2 levels). The experiments of Zwaan et al. included more variables, but these did not affect the results much, so that the design could be reduced to a one-way design. The table shows the intraclass correlations, which mostly reach the desired level of ICC2 = .80 when it is calculated within conditions. The table also shows that the average reported effect size was dz = .76. If the experiments had been based on a single observation per condition, the average effect size would have been dz = .24, illustrating the gain that can be made by having multiple observations per participant per condition.

Study Dependent variable N parts N conditions Nobs_per_ cond Across the entire dataset Average within condition dN = 1 dN = tot

ICC1 ICC2 ICC1 ICC2

Camerer et al. (2018)
      Aviezer et al. (2012) Valence ratings 14 2 88 0.01 0.60 0.23 0.96 0.94 1.43
      Kovacs et al. (2010) Reaction time to visual stimuli 95 2 5 0.41 0.87 0.40 0.76 0.29 0.72
      Sparrow et al. (2011) Reaction time to visual stimuli 234 2 8 & 16 0.10 0.91 0.10 0.81 0.03 0.10
Zwaan et al. (2018)
      associative priming Reaction time to visual stimuli (Session 1) 160 2 × 2 × 2 30 0.28 0.96 0.31 0.93 0.17 0.81
Reaction time to visual stimuli (Session 2) 0.30 0.96 0.31 0.92 0.18 0.94
          false memories Correct related-unrelated lures (Session 1) 160 2 × 2 × 2 9 0.02 0.29 0.27 0.77 0.20 0.97
Correct related-unrelated lures (Session 2) 0.06 0.54 0.26 0.75 0.31 1.17
            flanker task RT stimulus congruent incongruent (Session 1) 160 2 × 2 × 2 32 0.40 0.98 0.41 0.96 0.15 0.70
RT stimulus congruent incongruent (Session 2) 0.29 0.96 0.29 0.92 0.13 0.52
          shape simulation RT to shape matching sentence (Seesion 1) 160 2 × 2 × 2 15 0.42 0.93 0.42 0.91 0.08 0.27
RT to shape matching sentence (Seesion 2) 0.49 0.97 0.50 0.94 0.17 0.50
            spacing effect Memory of massed v. spaced items (Session 1) 160 2 × 2 × 2 40 0.03 0.54 0.03 0.40 0.20 0.87
Memory of massed v. spaced items (Session 1) 0.06 0.84 0.07 0.75 0.21 0.92