Table 1.
Model | Basic model | Forgetting | Default value | Free parameters | # | –LL | AIC |
---|---|---|---|---|---|---|---|
SARSA (λ) TD | Model-free | – | – | αL, β, π, ρ, λ | 5 | 4,661 | 9,612 |
P | Parallel | – | – | αL, β, π, ρ, w, λ | 6 | 3,435 | 7,219 |
P-F0 | Parallel | o | Fixed (μ = 0) | αL, β, π, ρ, w, λ, αF | 7 | 3,284 | 6,974 |
P-F05 | Parallel | o | Fixed (μ = 0.5) | αL, β, π, ρ, w, λ, αF | 7 | 3,048 | 6,503 |
P-FD | Parallel | o | o | αL, β, π, ρ, w, λ, αF, μ | 8 | 3,024 | 6,511 |
LA | Learning-rate adjustment | – | – | αL, β, π, ρ, w | 5 | 3,447 | 7,184 |
LA-F0 | Learning-rate adjustment | o | Fixed (μ = 0) | αL, β, π, ρ, w, αF | 6 | 3,292 | 6,931 |
LA-F05 | Learning-rate adjustment | o | Fixed (μ = 0.5) | αL, β, π, ρ, w, αF | 6 | 3,055 | 6,457 |
LA-FD | Learning-rate adjustment | o | o | αL, β, π, ρ, w, αF, μ | 7 | 3,032 | 6,469 |
This list provides information for the free parameters, negative log likelihood (–LL) and Akaike information criterion (AIC) summed over all participants (n = 29) for each model. The models differ regarding the basic model with parallel (P) or parsimonious learning-rate adjustment (LA). The models also differ regarding their forgetting-process assumptions: no forgetting, forgetting with a fixed default value (F0 or F05), or forgetting with a free default value parameter (FD).