Table 3.

ERP predictions and model fits: Predicted fERNs over the first (1) and second (2) halves of experiment blocks, model correlations, and rootmean square deviations (RMSD)

Traces	Algorithm	Unexpected Outcomes		Expected Outcomes		Cues		Fit
		1	2	1	2	1	2	R2	RMSD
Without	AC	−4.00	−4.61	−2.28	−1.69	−0.79	−1.45	.98	.254
	Q	−4.13	−4.52	−1.91	−1.54	−1.02	−1.45	.94	.420
	SARSA	−4.15	−4.53	−1.89	−1.52	−1.02	−1.46	.93	.430
With	AC	−3.90	−4.54	−2.80	−2.15	−0.37	−0.91	.98	.265
	Q	−4.15	−4.69	−2.16	−1.61	−0.82	−1.31	.97	.268
	SARSA	−4.13	−4.75	−2.21	−1.59	−0.79	−1.38	.98	.254