Table 1.
Reward schedules for safe patches and risky patches across the two environmental manipulations, standard and rich.
| Number of Turns | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | ||
| Standard Environment | Safe | 2 | 1.875 | 1.75 | 1.625 | 1.5 | 1.375 | 1.25 | 1.125 | 1 | 0.875 | 0.75 | 0.625 | 0.5 | 0.375 | 0.25 | 0.12 |
| Risky Win | 3 | 2.875 | 2.75 | 2.625 | 2.5 | 2.375 | 2.25 | 2.125 | 2 | 1.875 | 1.75 | 1.625 | 1.5 | 1.375 | 1.25 | 1.12 | |
| Risky Loss | 1 | 0.875 | 0.75 | 0.625 | 0.5 | 0.375 | 0.25 | 0.125 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| Rich Environment | Safe | 4 | 3.75 | 3.5 | 3.25 | 3 | 2.75 | 2.5 | 2.25 | 2 | 1.75 | 1.5 | 1.25 | 1 | 0.75 | 0.5 | 0.25 |
| Risky Win | 5 | 4.75 | 4.5 | 4.25 | 4 | 3.75 | 3.5 | 3.25 | 3 | 2.75 | 2.5 | 2.25 | 2 | 1.75 | 1.5 | 1.25 | |
| Risky Loss | 3 | 2.75 | 2.5 | 2.25 | 2 | 1.75 | 1.5 | 1.25 | 1 | 0.75 | 0.5 | 0.25 | 0 | 0 | 0 | 0 | |
The probability of winning or loosing at risky patches for both environments and across turns was held constant at 0.5. For all reward schedules responding after the 17th turn produced no reward.