Table 3.

The overall assessment of web-based outcome measures with regard to 3 criteria.

Outcome variable			Reliabilitya		Equivalenceb		Agreementc
Performance indices
	PALd total errors adjusted	✓e		✓		✓
	PAL first attempt memory score	xf		✓		x
	OTSg problems solved on first choice	x		✓		✓
	PRM-Ih percentage of correct trials	x		✓		—i
	SWMj between errors	✓		✓		—
	SWM strategy	x		✓		x
	ERTk total hits	x		✓		✓
	PRM-Dl percentage of correct trials	x		✓		—
	RVPm A’	✓		✓		✓
Reaction time measures
	OTS median latency to correct	x		✓		x
	PRM-I median latency	✓		x		x
	ERT median correct reaction time	✓		x		x
	PRM-D median latency	x		x		x
	RVP median latency	x		✓		x

^a: reliability criterion met where intraclass correlation coefficients ≥0.60.

^b: equivalence criteria met where there is no significant difference between performance levels across test settings in mixed effects models, and data supporting the null hypothesis for Bayesian paired t tests).

^c: agreement criteria met where ≥95% of data points lie within the limits of agreement on Bland-Altman plots, and there is no evidence of bias or proportional bias.

^dPAL: paired associate learning.

^e✓: criteria met.

^fx: criteria not met.

^gOTS: one touch stockings of Cambridge.

^hPRM-I: pattern recognition memory immediate.

ⁱ—: analyses not completed.

^jSWM: spatial working memory.

^kERT: emotion recognition task.

^lPRM-D: pattern recognition memory delayed.

^mRVP: rapid visual information processing.