Skip to main content
. Author manuscript; available in PMC: 2022 Apr 27.
Published in final edited form as: J Exp Psychol Gen. 2021 Sep 30;150(12):2525–2551. doi: 10.1037/xge0001048

Table A1.

Task Reliability Task Reliability

Data Set 1
Data Set 2
SymSpan .80 SymSpan .80
OSpan .63 OSpan .73
RotSpan .80 RotSpan .83
VA-orient-S .75 VA-orient-S .74
Antisaccade .92 Antisaccade .91
Flanker .69 Flanker .83
Stroop .72 Stroop .75

Data Set 3
Data Set 4
SymSpan .84 SymSpan .84
OSpan .86 OSpan .85
RotSpan .87 RunLetter .81
RunSpatial .84 RunDigit .88
RunDigit .90 VA-color .78
VA-color .84 VA-orient .74
VA-orient .73 VA-color-S .54
VA-orient-S .79 VA-orient-S .70
Antisaccade .81 Antisaccade .85
Flanker .66 Flanker .81
Stroop .60 Stroop .92

Note. VA = visual arrays. Reliabilities for Data Sets 3 and 4 are based on values reported in (Shipstead et al., 2014, 2015). The following methods were used to calculate reliabilities for Data Sets 1 and 2. For SymSpan, OSpan, and RotSpan, the total number of items recalled in the correct serial position on each trial was used to calculate cronbach’s α as an estimate of reliability. For the VA-orient-S task, within each set size (five and seven), half of the trials (even/odd split) were used to calculate k scores resulting in a total of four k score; even and odd k scores for each set size. The k scores from each set size were averaged to obtain two split-half k scores for the task to calculate a split-half reliability with a spearman-brown correction as an estimate of reliability. For the antisaccade task, accuracy on each trial was used to calculate a Cronbach’s α as an estimate of reliability. For the flanker and Stroop tasks, within each condition (congruent and incongruent), half of the trials (even/odd split) were used to calculate mean reaction time per condition. A difference score (incongruent – congruent) was calculated for even and odd trials resulting in two interference effects that were used to calculate a split-half reliability with a spearman-brown correction as an estimate of reliability.