TABLE I.
A list of published studies conducted via remote testing since 2020. NA, Not available.
| Published study | Journal | Web-based vs take-home | Test environment | Researcher's vs bring-your-own (BYO) device | Platform for web-based testing | Calibrated stimulus or hardware | Validation with in-laboratory testing? | Compensation | Sample size |
|---|---|---|---|---|---|---|---|---|---|
| Mealings et al. (2020) | International Journal of Audiology | Take-home | Quiet rooms at the schools | Researcher's | Yes | No | Not described | 297 | |
| Whittico et al. (2020) | JASA Express Letters | Take-home | Subjects' daily environments | Researcher's | NA | No | Not described | 17 | |
| Chen et al. (2020) a | Otology and Neurotology | Take-home | Subjects' homes | Researcher's | Yes | No | Not described | 25 | |
| Steffman (2021) | JASA Express Letters | Web-based | Subjects' homes | BYO | Not described | No | No | Not described | 38 |
| Merchant et al. (2021) | JASA Express Letters | Web-based | Subjects' homes | BYO | Downloadable matlab script | No | Yes | $15 per hour | 39 |
| Milne et al. (2021) | Behavior Research Methods | Web-based | Subjects' homes | BYO | Gorilla.sc | No | No | Yes, amount not described | 242 |
| Mullin et al. (2021) | PLoS One | Web-based | Subjects' homes | BYO | Amazon Mechanical Turk; Sona Systems; Qualtrics for experiment | No | No | Yes, $0.25 for study completion | 641 |
| Jaggers and Baese-Berk (2020) | JASA Express Letters | Web-based | Subjects' homes | BYO | Amazon Mechanical Turk | No | No | Not described | 180 |
| Melguy and Johnson (2021) | JASA | Web-based | Subjects' homes | BYO | Amazon Mechanical Turk | No | No | Not described | 139 |
| Davidson (2020) | Language | Web-based | Subjects' homes | BYO | Amazon Mechanical Turk | No | No | Yes, $2.25 for 10-min study completion | 71 |
| Toscano and Toscano (2021) | PLoS One | Web-based | Subjects' homes | BYO | Amazon Mechanical Turk for recruitment; Qualtrics for experiment | No | No | Yes, amount not described | 181 |
| Nagle and Huensch (2020) | Journal of Second Language Pronunciation | Web-based | Subjects' homes | BYO | Amazon Mechanical Turk | No | No | Yes, $4 for 32-min study completion | 30 |
| Huang and Elhilali (2020) | eLife | Web-based | Subjects' homes | BYO | Amazon Mechanical Turk for recruitment; jsPsych and Psiturk for experiment | No | Yes | Yes, amount not described | 93 |
| Strori et al. (2020) | JASA | Web-based | Subjects' homes | BYO | Amazon Mechanical Turk | No | Yes | Yes, amount not described | 222 |
| Getz and Toscano (2021) | Attention, Perception, and Psychophysics | Web-based | Subjects' homes | BYO | Amazon Mechanical Turk | No | Yes | Yes, $3.63 for 30-min study completion | 238 |
| Lahdelma et al. 2022 | Musicae Scientiae | Web-based | Subjects' homes | BYO | Prolific.co for recruitment; PsyToolkit for experiment | No | No | Not described | 40 |
| Düvel et al. (2020) a | Music and Science | Web-based | Subjects' homes | BYO | SoSci Survey | No | No | Not described | 177 |
| Bottalico et al. (2020) a | JASA | Web-based | Subjects' homes | BYO | SurveyGizmo | No | No | Yes, $15 for 1-hr study completion | 40 |
| McPherson et al. (2020) a | Nature Communications | Web-based | Subjects' homes with examiner supervision for in-person experiment and no supervision for web-based experiment | Researcher's for in-person experiment; BYO for web-based experiment | Amazon Mechanical Turk | Yes for in-person experiment; no for web-based experiment | Yes | Yes, amount not described | 194 |
| Shafiro et al. (2020) | American Journal of Audiology | Web-based | Subjects' homes | BYO | iSpring for experiment on web-browser of subjects' choices | No | Yes | Not described | 67 |
| Giovannone and Theodore (2021) | Journal of Speech, Language, and Hearing Research | Web-based | Subjects' homes | BYO | Prolific.co for recruitment; Gorilla.sc for experiment | No | Yes | Yes, $5.33 for study completion | 190 |
| Cooke and Lecumberri (2021) | JASA | Web-based | Subjects' homes | BYO | Custom-built platform using Flask web framework | No | Yes | Yes, amount not described | 252 |
| Gijbels et al. (2021) | Frontiers in Psychology | Web-based and take-home | Subjects' homes | BYO and researcher's | Zoom | No | Yes | Yes, amount not described | 172 |
| Viswanathan et al. (2022) | Journal of Neuroscience | Web-based | Subjects' homes | BYO | Prolific for recruitment; custom web application | No | Yes | Not described | 191 |
| Viswanathan et al. (2021) | JASA | Web-based | Subjects' homes | BYO | Prolific for recruitment; custom web application | No | Yes | Not described | 286 |
| Tripp and Munson (2021) | JASA Express Letters | Web-based | Subjects' homes | BYO | Prolific for recruitment; Qualtrics for experiment | No | No | Not described | 162 |
| Mitchell et al. (2021) | JASA | Web-based | Subjects' homes | BYO | Gorilla.sc | Yes, participants matched level to reference sound | No | Not described | 86 |
| Mimani and Singh (2021) | JASA | Web-based | Subjects' homes | BYO | Google Form | NA | No | Not described | 1068 |
| Kothinti et al. (2021) | JASA | Web-based | Subjects' homes | BYO | Amazon Mechanical Turk for recruitment; jsPsych and Psiturk for experiment | Yes, participants adjusted level to comfort | Yes | Yes, amount not described | 325 |
| Armitage et al. (2021) | JASA | Web-based | Subjects' homes | BYO | Prolific for recruitment; Psytoolkit for experiment | No | No | Not described | 397 |
| Otčenášek et al. (2022) | JASA | Web-based | Subjects' homes and remote classroom | BYO and researcher's | Combination | No | Yes | Not described | 21 |
| Zhang et al. (2021) | JASA | Combination | Subjects' homes | BYO and researcher's | Zoom | NA | No | Not described | 7 |
| McLaughlin et al. (2022) | Attention, Perception, and Psychophysics | Web-based | Subjects' homes | BYO | Gorilla.sc | No | Yes | Prolific | 370 |
| van Brenk et al. (2021) | American Journal of Speech-Language Pathology | Web-based | Subjects' homes | BYO | Amazon Mechanical Turk | No | No | Payment on Amazon Mechanical Turk, $0.8–$1.2 | 885 |
| Perreau et al. (2021) | American Journal of Audiology | Take-home | Subjects' homes and in-laboratory | Researcher's | NA | Yes | No | Not described | 19 |
a
Articles identified during PP Remote Testing Wiki development.