Figure 4.

Decision policies as a function of switching cost. (A) No switch-cost environment: (c, c_s, β) = (0.1, 0, 0.9). (B) Switch-cost environment: (c, c_s, β) = (0.1, 0.1, 0.9). Triangle represents the belief state space, (p¹, p²), under affine transform for visual symmetry. Color-coding denotes the action prescribed by each policy for different values of the belief state vector. Blue: stop and declare location 1 as target. Green: fixate location 1. Orange: fixate location 2. Brown: fixate location 3. All policies are deterministic (see Methods).