Table 1.

A list of tasks incorporating features of learning and decision-making that are relevant in natural environments. For all of these tasks, computational models have been proposed. The reader is referred to the text and relevant papers for further details. This list is meant to highlight some important examples but it is not an exhaustive list.

Learning
Sharot et al., Nature [252]	How strongly is the updating of people’s beliefs biased towards positive compared to negative information (‘optimism bias’)?
Behrens et al., Nat. Neurosci. [51] 2007; Mathys et al. [52] Fron Hum Neurosci., 2011	How do people flexibly adjust their speed of learning to the environment (thus providing a measure of the ability to learn that is not available when learning in stable environments)?
Jocham et al. [79], Neuron, 2016; Lee et al. [80] PLOS Biol., 2015; Leong et al. [61], Neuron, 2017	How do people attribute outcomes to causes and what are potential biases when making such attributions?
Scholl and Kolling et al., J. Neurosci. [102], 2015	How do people focus learning on what is important, ignoring irrelevant but salient reward information?
Lee et al., Neuron [97], 2014	How do people flexibly adjust, or arbitrate, between model-based and model-free learning systems?
Decision-making
Klein-Flügge et al, PLOS Comput. Biol. [247] 2015	How do people weigh up rewards and different kinds of costs (delays or effort)?
Huys et al., PLOS Comput. Biol. [169] 2011; Guitart-Masip et al. [165], NeuroImage, 2012; Bach et al., Curr. Biol. [176], 2014	How do reflexive Pavlovian and reflective goal-directed valuation systems interact?
Eldar et al. [182] Nat. Commun., 2015	How do emotional states induced by task-irrelevant wins or losses influence subsequent evaluations of stimuli?
Wilson et al. [224] J. Exp. Psychol., 2015; Blanco et al. [29], Cognition, 2013	How do people adjust the degree of exploration and exploitation given environmental constraints?
Kolling et al. [119] Science, 2012	How do people weigh up whether to take an immediately available option or to look for alternatives elsewhere?