Table 1.
Examples of data exclusion statistics reported for lab-based and web-based cognitive studies.
| Study type and citation | Task(s) | Data excluded | |
| Lab-based | |||
|
|
Kim et al [77] | Lab, psycholinguistic task | 5/42 (11.9%) participants excluded for high error rates or being outside demographic. Reaction time outlier removal=0.75% of total data |
|
|
Von Gunten et al [82] | Lab, inhibition tasks (antisaccade, go/no go, and Stop Signal) | 37/463 (7.99%) participants excluded |
|
|
Backx et al [34] | Lab, CANTABa tasksb | No exclusions, no distractions reported |
|
|
Hicks et al [79] | Lab (experiments 1 and 3), working memory tasks | Experiment 1: 0/58 (0%) participants excluded, although 10% of participants reported cheating; experiment 3: 10/112 (8.9%) participants excluded due to excessive missing data |
|
|
Ruiz et al [80] | Lab, working memoryc, nondeclarative/declarative memory tasks | (a) OSpand, 0% excluded; (b) MLAT5e, 0% excluded; (c) CVMTf, 1/50 (2%) participants excluded |
|
|
Baniqued et al [78] | Cognitive video training | 27/219 (12.3%) participants excluded or withdrew |
| Web-based | |||
|
|
Kim et al [77] | Online, psycholinguistic task | 3/39 (7.7%) participants excluded for high error rates or being outside demographic. Reaction time outlier removal=0.75% of total data |
|
|
Eisenberg et al [55] | Online (using Amazon Turk), inhibition tasks (go/no go, Stop Signal) | 102/662 (15.4%) participants excluded for noncompletion of task battery; 38/560 (6.8%) participants further excluded for failing 4 or more tasks |
|
|
Backx et al [34] | Online, CANTAB tasks | 2/18 (11.1%) participants excluded, high SWMg errors; distractions: 16/18 participants for PALh, ERTi, OTSj, and PRM-Ik; 17 participants for SWM, RVPl, PRM-Dm |
|
|
Hicks et al [79] | Online (experiments 2 and 4), working memory tasks | Experiment 2: 12/100 (12%) participants excluded for failure to complete test battery within 24 hours; Experiment 4: 28/112 (25%) participants excluded due to noncompletion of task battery |
|
|
Ruiz et al [80] | Online, working memory, nondeclarative/declarative memory tasks | (a) OSpan, 7/50 (14%) participants excluded; (b) MLAT5, 8/15 (16%) participants excluded; (c) CVMT, 10/50 (20%) participants excluded |
|
|
Buitenweg et al [81] | Cognitive flexibility training | 91/249 (36.5%) participants excluded for not meeting criteria (N=11) or withdrew from study (N=80) |
aCANTAB: Cambridge Neuropsychological Test Automated Battery
bCANTAB tasks include SWM, PAL, ERT, OTS, PRM-I, RVP, and PRM-D.
cMemory tasks include OSpan, MLAT, and CVMT.
dOSpan: automated operation span task.
eMLAT: modern language aptitude test.
fCVMT: continuous visual memory task.
gSWM: spatial working memory.
hPAL: paired associates learning.
iERT: emotion recognition task.
jOTS: one touch stockings of Cambridge.
kPRM-I: pattern recognition memory-immediate.
lRVP: rapid visual processing.
mPRM-D: pattern recognition memory-delayed.