Table 3. Model parameters. Shown are parameters (mean ± SEM) of the full and three reduced models (model 1, sustained effect of actual reward only; model 2, sustained and transient effects of actual reward; model 3, sustained effects of actual and fictive rewards). AIC and BIC values are also shown. All models included three bias terms [constant increment of chosen value (V_q), stay bias (b_st,) and left-choice bias (b_L)].

	Model 1	Model 2	Model 3	Full model
αactual	0.227 ± 0.086	0.133 ± 0.006	0.454 ± 0.187	0.160 ± 0.009
αfictive	–	–	0.312 ± 0.173	0.037 ± 0.013
kactual	–	0.447 ± 0.095	–	0.461 ± 0.097
kfictive	–	–	–	0.323 ± 0.090
β	0.501 ± 0.051	0.138 ± 0.055	0.541 ± 0.067	0.076 ± 0.037
bst	−0.661 ± 0.137	−1.561 ± 0.147	−1.780 ± 1.067	−1.037 ± 0.151
bL	0.563 ± 0.274	0.485 ± 0.214	0.729 ± 0.330	0.493 ± 0.207
Vq	0.186 ± 0.119	0.353 ± 0.038	1.459 ± 1.129	0.439 ± 0.042
AIC	1782 ± 136	1751 ± 142	1752 ± 141	1723 ± 142
BIC	1809 ± 136	1784 ± 142	1784 ± 141	1767 ± 142
Number of parameters	5	6	6	8