Fig. 4.

Switching between exploitation and exploration. (A) An example of trajectories for $\epsilon =0.22$ with (red, $S^{\prime }=10^{-4}$; blue, $S^{\prime }=0.3$) and without (black) stimuli. The agents received the stimuli only at $t_p$ and $X\left(t_p\right)=\left(\mathrm{0,0}\right)$. We observed the position after $\tau$ (here $\tau =100$) and calculated the distance $G$ between $X\left(t_p\right)=\left(\mathrm{0,0}\right)$ and $X\left(t_p+\tau \right)$. (B) Relationship between stimuli parameters $S^{\prime }$ and $G$ for $\tau =100$. (C) Dynamic range ${\mathrm{\Delta }}_{S^{\prime }}$ and control parameter $\epsilon$. Inset represents the definition of ${\mathrm{\Delta }}_{S^{\prime }}$. (D) Response range ${\mathrm{\Delta }}_G$ and control parameter $\epsilon$. Inset represents the definition of ${\mathrm{\Delta }}_G$. These results represent values averaged over $10^3$ simulation runs with different initial conditions.