Figure 14. (a) Learning curve for different values of the associativity parameter K if the agent, by external constraints, has only a finite time available to produce an action.

If the simulation takes longer than D_max, the agent will not be rewarded. In such a case, the asymptotic performance of the learning drops dramatically for large values of K. An ensemble average over 10000 games is shown.