Fig. 2.

Policies. This schematic illustrates the alternative plans (or sequences of actions) that Jerry may choose to pursue. The five actions of Policy 1 are cartooned in the upper plot, which shows the following sequence: Jerry begins by (1) roaming/scanning his environment, continues on to (2) orienting, and finally, he engages in (3–5) a series of fight-or-flight actions. This sequence can be compared with the other six policies, indicated in the lower plot. To interpret this schematic, note the labels on the left that specify each action (which have been grouped into action types in the far left column). Each line is an alternative policy, with circles indicating the action at each time-step. The schematic acts as a key to interpret the labelling of the 7 alternative policies available to Jerry. This policy numbering will be adopted consistently in subsequent figures.