Table 1. Variables and parameters used in the simulations.

Variables
	world model
	current world state
	current dwell time in
	probability of observing observation given state
	calculated from
	observation passed from world to macro-agent at time
	action passed from macro-agent to world at time
	discounting factor, for µAgent
	value-prediction-error for µAgent
	µAgent world model () for µAgent
	hypothesized state for µAgent
	hypothesized dwell time in for µAgent
	value function for µAgent