Table 4. All learning models fitted (bold: winning model; AL - action-learning; SL - state-learning, F - variational Bayesian approximation to the model’s marginal likelihood, used for model comparison).
| Experiment 1 (Instrumental sessions) | |||
|---|---|---|---|
| Choice | F (n=19, sum [sem]) | SCR | F (n = 15, sum [sem]) |
| TD | -1330.920 [3.604] | RW - value | −1079.153 [8.024] |
| Hybrid (AL) | -1345.667 [3.664] | Hybrid (SL) - value | −1077.911 [8.059] |
| WSLS | -1486.723 [3.973] | Hybrid (SL) - associability | −1077.699 [8.003] |
| Experiment 1 (Pavlovian sessions) | |||
| Choice (not available) | SCR | F (n = 15, sum [sem]) | |
| N/A | RW - value | −1101.079 [7.132] | |
| Hybrid (SL) - value | −1096.250 [7.195] | ||
| Hybrid (SL) - associability | −1095.135 [7.106] | ||
| Experiment 2 (Instrumental sessions, Pavlovian not available) | |||
| Choice | F (n=23, sum [sem]) | SCR | F (n = 20, sum [sem]) |
| TD | -3572.476 [8.736] | RW - value | −7867.834 [60.668] |
| Hybrid (AL) | -3626.478 [8.946] | Hybrid (SL) - value | −7857.341 [60.643] |
| HMM | -3571.020 [9.067] | Hybrid (SL) - associability | −7841.864 [60.838] |
| Bayesian Hierarchical | -3784.372 [8.616] | ||