Table 1.

Initial reliability data for brief cognitive tests, based on the data collected from the digital research platform TestMyBrain.org [21].

Outcome	TestMyBrain.org sample
	n	Mean (SD)	Reliability of the EMAa length testb
Brief TMBc Choice RTd—median RTc (ms)	12,939	961 (342)	0.93
Brief TMB DSMe—median Tc (ms)	7095	1005 (374)	0.81
Brief TMB Flicker—medianRTc (ms)	11,869	4873 (2461)	0.62
Brief TMB GradCPTf—d-prime	5039	2.92 (0.94)	0.82
Brief TMB MOTg—accuracy	10,703	69.4 (11.6)	0.67
Brief TMB PSATh—accuracy	9900	72.8 (18.8)	0.75

^aEMA: ecological momentary assessment.

^bTo calculate internal reliability, we fit unconditional multilevel mixed models predicting performance on each half of the test with a random effect of participants. The variance between and within participants was again entered into the same equation, with n=2 for the TestMyBrain.org sample (ie, the 2 halves of the single testing session). Note that for the TestMyBrain.org sample, this produces the same reliability value as the Spearman-Brown corrected split-half reliability of the even and odd trials.

^cTMB: TestMyBrain.org.

^dRT: Reaction Time.

^eDSM: Digit Symbol Matching.

^fGradCPT: Gradual Onset Continuous Performance Test.

^gMOT: Multiple Object Tracking.

^hPSAT: Paced Serial Addition Test.