Figure 3.

(A) Firing rates of dopamine neurons in monkeys to cues and rewards as a function of cue-reward interval duration. Adapted from Fiorillo et al. (2008) with permission from the publisher. (B) Prediction errors to the reward and cue as a function of the interval duration for the microstimulus model. The simulations of the microstimulus model were run for 100 trials and used the same parameters specified in Ludvig et al. (2008): λ = 0.95, α = 0.01, γ = 0.98, D = 50, σ = 0.08. We treated 20 time steps as a unit of 1 s, and each trial was separated by an interval of 500 time steps. Note the logarithmic scale on the x-axis.