Table 1.
Overview of Cognitive Psychology Studies Comparing MTurk or Prolific Data to Students or the Literature.
|
| |
|---|---|
| CROWDSOURCE VS. LITERATURE | MAIN OUTCOME |
|
| |
| Barnhoorn, Haasnoot, Bocanegra, Steenbergen, 2014 | Successful replication of effects from the domain of experimental psychology on MTurk: Stroop, attentional blink, masked priming. |
|
| |
| Bui, Myerson & Hale, 2015 | Successful replication of effects from the domain of cognitive aging on MTurk: age-related decline in processing speed, effect of practice on age differences, steeper decline in visuospatial processing, mediation of the link between age and working memory by processing speed. |
|
| |
| Crump, McDonnell, & Gureckis, 2013 | Successful replication of effects from the domain of experimental psychology on MTurk: Stroop, Switching, Flanker, Simon, Posner Cuing, attentional blink, subliminal priming, and category learning. |
|
| |
| Kochari, 2019 | Successful replication of effects from the domain of numerical cognition on Prolific: distance effect, congruity effect, priming effect. |
|
| |
| Simcox & Fiez, 2014 | Successful replication of effects from the domain of experimental psychology on MTurk: Flanker, lexical decision. |
|
| |
| Yang & Krajbich, 2021 | Successful replication of the effect of gaze duration in decision-making using an eye-tracking paradigm on MTurk. |
|
| |
| Zwaan & Pecher, 2012 | Partial replication of mental simulation effects in language comprehension on MTurk: orientation match, shape match, color match. |
|
| |
| CROWDSOURCE VS. LAB DATA | OUTCOME |
|
| |
| Armitage & Eerola, 2020 | Testing an experimental effect in domain of musical cognition in the lab and on MTurk: music valence priming. The effect was consistently present and data characteristics were similar between MTurk and the lab. |
|
| |
| Pauszek, Sztybel, & Gibson, 2017 | Successful replication of benchmark effects from the spatial cueing paradigm on MTurk: left/right advantage, cue type effect, cued axis effect, and cued endpoint effect. |
|
| |
| Lumsden, Skinner, Woods, Lawrence, & Munafò, 2016 | Testing a Go-No-Go task in the lab and on MTurk. Reaction times were longer for MTurk, and accuracy was lower, but data quality remained acceptable. |
|
| |