Abstract
Self-control refers to the ability to deliberately reject tempting options and instead select ones that produce greater long-term benefits. Although some apparent failures of self-control are, on closer inspection, reward maximizing, at least some self-control failures are clearly disadvantageous and non-strategic. The existence of poor self-control presents an important evolutionary puzzle because there is no obvious reason why good self-control should be more costly than poor self-control. After all, a rock is infinitely patient. I propose that self-control failures result from cases in which well-learned (and thus routinized) decision-making strategies yield suboptimal choices. These mappings persist in the decision-makers’ repertoire because they result from learning processes that are adaptive in the broader context, either on the timescale of learning or of evolution. Self-control, then, is a form of cognitive control and the subjective feeling of effort likely reflects the true costs of cognitive control. Poor self-control, in this view, is ultimately a result of bounded optimality.
This article is part of the theme issue ‘Risk taking and impulsive behaviour: fundamental discoveries, theoretical perspectives and clinical implications.
Keywords: self-control, evolution, cognitive control, economic choice, intertemporal choice
1. Introduction
Poor self-control is inimical to mental and physical health and to life success; it is associated with poverty, obesity, loneliness and other unwanted states [1,2]. It is both a symptom and a cause of diseases that increase mortality, such as addiction, depression and obsessive–compulsive disorder (e.g. [3–5]). Because failures of self-control are costly, the ability to exert self-control can confer evolutionary benefits and ought to be subject to strongly negative selection pressure. The ubiquity of poor self-control, then, poses an important riddle: why has natural selection not endowed us with perfect self-control?
For present purposes, I define self-control as deliberately avoiding the choice of a tempting option so as to choose an alternative that produces greater long-term benefits. The main reason I use this definition is because it brings to the fore the evolutionarily puzzling aspects of self-control failure. This definition is not universally shared, but it is, from my reading of the literature, the closest to a consensus view available (e.g. [6–10]). Some other definitions include strategies that avoid tempting contexts; my definition treats these as outside the bounds of self-controlled behaviour [11,12]. Other scholars have considered that choices appearing to reflect poor self-control may have adaptive outcomes [13–17]. Such choices are interesting, as they provide insight into the evolution of cognitive faculties. However, they are not relevant to the central question I consider here, as they are reward-maximizing, and thus adaptive, and not evolutionarily puzzling. One important caveat in this definition is that to be called a test of self-control, the decision-maker must know the potential outcomes (or the range of outcomes in the case of stochastic decisions).
It is not obvious why perfect self-control would be difficult to evolve. Self-control decisions are, ostensibly, just like another mental operation. Consider, for comparison, the example of saccadic eye movements, which, like self-control decisions, are regulated by the brain (including the prefrontal cortex) and are subject to volitional control [18]. We make saccadic eye movements three to four times per second during our waking hours, without any sense of fatigue, throughout our lives. When something surprising appears in the visual field, we look at it without succumbing to the temptation to procrastinate for several days (as we might with more conventional self-control problems, such as paying a bill or reviewing a manuscript). We do not ever feel the temptation to cheat or cut corners; for example, we do not move our eyes only 80% of the way towards a target, as we might with a diet. Our oculomotor control systems, like our respiratory control systems, our form vision systems and many others, constantly function at a high level with rare failures. So what makes economic decisions different? Why are so many of our daily value-based decisions subject to large and small self-control failures?
2. Some well-known approaches to self-control do not help us understand why it fails
One view of self-control, dating back at least to William James in the late 1800s, sees it as the result of the competition between two systems [19–22]. These are often known as the hot and cold systems. The hot system advocates for impulsive choices and the cold system advocates for controlled ones [23]. These two systems have at least some affiliation with Freud's idea of the id and superego, respectively [24]. And in a more mathematical guise, this view has direct parallels to the beta and delta systems [25]. The hot versus cold idea is supported by neuroscientific results showing a regulatory system (often dorsal and lateral) inhibiting a basic value system (often ventral and medial, e.g. [25–27]). In this two-systems view, self-control failure reflects a failure of the cold system to overrule the hot system. Despite its appeals, this view does not provide any explanation for why the hot system would ever win. That is, it simply allows for a restatement of the core mystery of self-control.
Another important view sees self-control as an economic decision—a comparison between two differently valued options—that is not different in any substantial way from other economic decisions ([12]; see also [28–30]). While self-control decisions clearly are a type of economic decision, they are of a special type. The strict similarity view ignores the most important thing about self-control: it can fail. And those failures are not just owing to noise. Many cognitive processes (including economic choice) are susceptible to errors but these errors are owing to noise and are independent of choices. By contrast, self-control failures always go in the same direction: succumbing to temptation. This distinction is clearest in the case of intertemporal choice tasks. In standard implementations of these tasks, the preference for the shorter–sooner option most often indicates poor self-control [31]. But on trials in which the shorter–sooner option provides a higher long-term reward rate than the larger–later alternative, then the choice of the larger–later option will yield negative discount rates. This ‘negative self-control’ is much rarer than the alternative.
Another limitation of the economic model is that it does not readily explain the ego-dystonic nature of self-control failures. That is, it cannot explain why failure, or even the prospect of it, would evoke negative emotions (often severe ones), when economic mistakes do not (for a similar argument, see [32]).
Most critically for my concerns here, the economic view cannot explain the high prevalence of self-control failure if it is just a type of miscalculation. Evolution has finely honed our minds to make good decisions [33,34]. It has endowed us with abilities to do cost–benefit computations that are much more complicated than many self-control problems require. For example, our brains can simultaneously track multiple fluctuating variables at many timescales [35–37]; we can detect subtle changes in probability [38]; we can anticipate others' strategies several levels deep [39]. Time biases do not seem to be the problem either. In foraging tasks, at least, many animals, including humans, can optimize reward rate to within a few percentage points of optimal [34,40,41].
A third, not entirely distinct, view equates self-control directly with patience or with withholding a response [17,42–44]. Patience is a time-centric view of self-control, and it equates poor self-control with an unwillingness to wait extended periods of time to obtain better rewards. The patience perspective generally equates poor self-control with action and good self-control with inaction. Asking why patience fails involves asking how action (which would presumably be costly) accidently overcomes inaction. Prima facie, not moving one's muscles would seem to require very minimal amounts of energy. (This ignores the opportunity costs of time, which are excluded from conventional definitions of self-control failure). But why would patience be costly? This perspective is especially puzzling in light of the large number of examples of evolved patience. For example, a male rhesus macaque can wait months to gain weight in preparation for the fights associated with mating season [45,46]. There is no obvious reason to think these apparently lazy males are exerting months of difficult self-control.
3. Evaluating some theories about why self-control fails
Perhaps the most influential explanation for self-control failure is the idea that control relies on a limited internal resource [8,20,24,47]. In the influential strength model, or ego depletion model, self-control is demanding in the same way that muscular movement is [9,48]. That is, self-control requires effort, it depletes some central reserve and improves with practice [24,49,50]. Glucose was proposed as this energy store; perhaps self-control requires mental activity that is metabolically costly [50–52]. This theory has a natural evolutionary explanation because energy is an obvious limiting factor for any organism.
One limitation of this view is that there is no obvious neuroscientific reason why self-control is metabolically costly. Another is that the strength theory is not empirically supported. Meta-analyses and large replications indicate that small study bias and publication bias likely led to over-inflated estimates of depletion effects, which may not exist at all [53–57]. Likewise, the idea that glucose serves as the reservoir has been successfully challenged [55,58,59]. This is not to say that self-control does not vary systematically, or flag with fatigue, just that ego depletion cannot account for most of its effects [60]. In any case, the prominent failures of the ego depletion hypothesis are an important motivator for the questions I raise here.
Another idea is that more self-control requires a larger brain [15,61]. Failures, in this view, come from insufficient mental resources—associated with brain volume—and the tradeoffs in self-control are the same as those associated with brain size. Support for this view, for example, comes from a major study comparing self-control in thirty-six species showing that absolute (and not relative) brain size predicted self-control strength across species [61]. Likewise, Stevens examined intertemporal choice performance in 13 primate species ([15]; see also [62]). Among other variables, absolute brain size (and again, not relative brain size) predicted self-control. These findings suggest that something about larger brains allows us to wait longer.
However, the specific tasks used in both the studies have been challenged as measures of self-control [13,16,63,64]. Even if these tasks measure a combination of self-control and other processes, the evidence linking brain size to self-control may instead demonstrate a link to other factors. Indeed, brain size correlates with many other factors that may contribute to preferences in these tasks, such as metabolic rate and lifespan [15]. More fundamentally, these studies do not offer an explanation of why larger brains would lead to more self-control. While it seems reasonable that larger brains lead to complex mental abilities like general intelligence and social intelligence, self-control would seem to be computationally simple [65–67]. It just requires a computation and comparison of reward rates associated with each option. Animals, even ones with small brains, are highly adept at estimating and maximizing reward rates [34,68]. Even bees and ants, which have minimal nervous systems, can do it nimbly [69].
Yet another explanation for poor self-control has to do with the importance of prospection for self-control [70]. Specifically, it has been argued that episodic foresight—the ability to simulate the future and reason about it—is critical [71,72]. According to this view, failures of self-control result from failures to prospect. This viewpoint has several limitations, however. Most importantly, self-control is more widespread in the animal kingdom than prospection is [61]. For example, a rat can exhibit self-control but likely has no episodic foresight [65]. Moreover, while self-control may benefit from prospection, it is not essential [42,73,74]. Indeed, it may be that prospection is critical for flexible self-control, but not for successful simple self-control itself [70].
Finally, several scholars have focused on the adaptive benefits of poor self-control [16,17]. Thus, for example, patience entails both an interruption risk and a collection risk [13,14,75,76]. Both of these risks increase the opportunity cost of waiting relative to selecting the immediate option [14]. Likewise, self-control may be fit to the environment. For example, marmosets and tamarins have diverged relatively recently but have very different ecological niches. Insectivorous tamarins move quickly to catch their prey and discount time steeply (and thus ostensibly have poor self-control); marmosets, which specialize in tree-sap exudate, need to be patient to feed and are so, but they discount space steeply (but, by conventional definitions, have good self-control). This approach can explain variations in self-control observed across species, including primates [77–80].
This perspective is valid and is probably at least partially correct (but see [81]), but it does not help us with the evolutionary puzzle that interests us here. That is, if a smaller–sooner reward offers a larger expected rate of intake, then choosing it, by my definitions here, is good—not poor—self-control. In other words, if an idealized perfectly self-controlled decision-maker would make the same choices, we cannot—based on behaviour (which is all we can measure in animals)—call it a self-control failure. And in the case that self-control inarguably fails, as in a macaque that chooses smaller–sooner options more than interruption–collection risk indicates, the adaptive fit theory does not provide any explanation.
4. The intertemporal choice task
The intertemporal choice task has long occupied a central place in the self-control research programme [29,31,44,82–86]. This task, which is widely used in both humans and non-human animals, involves a series of choices between options that differ in delay and magnitude. Successful self-control is defined as the selection of a larger option with a greater delay or effort cost over a smaller but cheaper–sooner one. Non-human animals generally show discount factors with a half-life (i.e. discount factor, k) of a few seconds; humans show a wider range, from these short timescales to factors in the range of weeks to months, but are still impulsive [86–88].
The high discount factors typically observed in the intertemporal choice task strongly violate the principles of adaptedness [16,17,37,89,90]. That is, animal decision-makers that discount on the order of seconds could not possibly negotiate simple tradeoffs necessary to survive in the world. For a monkey with a very low (i.e. patient) discount rate of k = 0.05, the subjective value of an option that is only 20 s away would be reduced by half of its true value. An option that requires 2 min to obtain would have essentially no value. This animal obviously could not make good decisions and survive outside the laboratory. Indeed, strong arguments have been made that the intertemporal choice task is different in key ways from tasks animals are likely to have faced in their evolved histories [13,84,89,91,92]. Measures of time preferences in more naturalistic tasks produce order-of-magnitude improvements in measured self-control; that is, animals seem to have better self-control if it is measured differently [16,37,40–42,89,92–94].
At a minimum, these results challenge the external validity of the form of self-control measured by the intertemporal choice task [64]. Why would the task lack validity? Even decision-makers with perfect self-control will show apparent self-control failures if they misunderstand the task [16,89]. For example, most implementations of the intertemporal choice task use a post-reward buffering structure to avoid ‘cheating’ strategies of choosing the smaller–sooner reward to get to the next trial sooner. But this stratagem only works if the animal fully understands the structure of the task. Failure to correctly understand the buffering structure will produce apparently poor self-control in a maximizing forager [64,92]. Most animals likely either misunderstand or misapply this element of the task (e.g. [16,85,95–97]).
There is a second problem that limits the interpretability of the intertemporal choice task. The traditional definition of poor self-control holds, in essence, that poorly controlled decision-makers will overweight time relative to reward. But decision-makers with poor self-control may more readily overweight the reward dimension relative to the time dimension [63,98,99]. The presence of an option that produces a large amount of food is a strong tempter [100]. Indeed, the temptation to seek food and ignore costs would seem to be an archetypical self-control problem. Decision-makers who succumb to the temptation to choose the larger amount will, in a typical intertemporal choice task, have—by conventional definitions—a surfeit of self-control [101].
The human intertemporal choice task is not usually implemented with adjusting buffers and does not usually use primary rewards like food (but see [37,102,103]). As such, it does not have the same problems as the animal version does. Nonetheless, the relevance of the task to human self-control has been questioned. First, the external validity of the task is quite low, compared to other self-control tasks such as the BART [104]. Second, humans exhibit several anomalies that cannot be explained through the principle of discounting (reviewed in [86]). For example, in many cases, humans and animals prefer sequences of rewards in which value increases over time to sequences in which value declines [40,86,105–107]. Indeed, it appears that humans preferentially use heuristic strategies that result in discounting-like behaviour without discounting [108].
5. Towards a cognitive control-based theory: three examples
In moving towards considering the evolutionary causes of poor self-control, is it helpful to begin with a few concrete examples. The first comes in the form of drugs and alcohol. These are common sources of self-control problems, affect a large number of people and can have deadly consequences. They are clearly ego-dystonic in many cases and clearly resist even very serious and costly efforts to abstain. So, why have we not evolved the ability to resist? Notably, most drugs, at least in their potent modern forms, were not present in the environment of evolutionary adaptedness (EEA). Most addictive drugs (i.e. those that work on reward pathways) were first made available within the past few centuries. The industrial revolution has led to new techniques for purifying and delivering the drugs such that today's drugs of abuse are more potent and addictive than they have been at any previous point in our evolutionary history. For example, although alcoholic drinks were likely fermented several thousand years ago, until recently, they had a relatively low alcohol content. So addictive drugs work by taking advantage of brain communication networks that were evolved in an environment without them. From a necessarily slow evolutionary perspective, addictive drugs are simply a very novel danger to which we have not yet evolved a solution. Overcoming the temptation to consume drugs and alcohol then requires making use of general-purpose cognitive faculties. Drugs, then, constitute something of an edge case—we have not evolved mechanisms to overcome drugs and are forced to use—as an inferior backup—our non-specialized cognitive systems.
A second example comes from dieting. Consider that one of the more successful laboratory paradigms in humans has been the diet choice task, in which poor self-control is defined as choosing the tastier but less healthy item (e.g. [27]). Human food resources underwent major shifts at the time of the agricultural and then industrial revolutions—both too recent to have had major effects on the evolution of cognition. In other words, the diet available in the EEA was sufficiently limited that dieting was probably not necessary. Dieting, then, likely can only be implemented by the use of deliberate cognitive resources, which conflict with the canalized and inflexible processes that lead us to seek high-calorie food. Tempting food, then, works in some ways like drugs—we have not evolved specialized mechanisms to deal with it and must make use of a general cognitive system.
A third example comes from a trio of tasks that are often used in animal studies of self-control. In reverse contingency tasks, animals must point to one of two rewards in order to get the other [16,100,109–115]. This task is quite difficult but trainable in some animals. In accumulation tasks, a reward is available at any time but builds up the longer the animal waits. Gaining a larger reward involves inhibiting the taking of the reward, as that would end the accumulation process (e.g. [116–120]). Finally, exchange tasks require an animal to keep a small reward in their possession for a period of time before trading it back to the experimenter for a bigger reward [121,122]. One thing that unites these tasks is that they make use of food and not symbols that represent it. Moreover, to overcome self-control, the animal must do something that is normally inimical to food receipt. Thus, they involve overriding low-level programming aimed at maximizing caloric intake by the use of deliberative overriding systems.
In these three examples of self-control, animals must use general cognitive mechanisms to perform the controlled action and override strong tendencies. These tendencies may be learned through evolutionary time, as in the innate drive for sweet and fatty foods. Or they may reflect the need to override strongly learned action patterns, as in the case of exchange tasks. In any case, what unites these clear self-control examples is the competition between a general cognitive decision-making system and specialized (either learned or hard-wired) decision-making systems.
6. Defining self-control as a form of cognitive control
Self-control is the result of a conflict that arises when competing desires occur. The co-occurrence of both desires requires arbitration. Failure of self-control occurs when one desire—the one inconsistent with long-term goals—wins. The other desire—the one associated with poor self-control—wins because it has been given extra heft in the competition, either by evolution or by learning processes.
The brain uses sensory, visceral and learned information to guide the adaptive selection of actions [123]. I refer to this process as sensorimotor transformation. When a certain sensorimotor transformation is common, the brain processes it in a more efficient way. I will refer to this as automatization [7,8,124–126]. For example, the first time I follow a route across a new campus, it requires attention and dominates awareness. However, if I walk the same path every day, it rapidly becomes automated in my mind, leaving my awareness free to wander or perform other cognitively demanding activities.
Automatization carries several very useful benefits [7,126]. Automatic responses are faster. They are less variable and more accurate. They are less susceptible to interference from outside processes. Automating responses leaves room for cognitive control, which is evidently very limited (see below), to engage in other processes. Thus, while walking, I may successfully get to my office and even perform other complex automated behaviours, like avoiding collisions with other people, while having full capacity to mentally rehearse an important lecture.
But automatization is a double-edged sword. I can offload the processing of sensorimotor information to specialized sub-computations, but those computations are now less penetrable to modulatory influences. Thus, the efficiency that makes it beneficial means it is inaccessible to unexpected, unusual or rapidly changing goal states. These are precisely the situations that lead to self-control failure. Failure, then, can result from an automated sensorimotor mapping doing what it is supposed to do—but the context happens to be one where the sensorimotor mapping led to a bad outcome.
Failure may also result from an inability to overcome the automated sensorimotor mapping. That is, the two necessarily compete, and the automated one sometimes wins. (If it could not ever win, then it would not serve its purpose of reducing cognitive load.) And the ego dystonia associated with self-control failure comes from the fact that the brain contains specialized systems that can recognize and signal failures. The self-control failure is not selected for in the conventional sense, but it selected for indirectly, in the sense that it is the unavoidable price worth paying in exchange for the benefits of automatization. Self-control failures are a by-product of processes that produce more efficient but less flexible decisions [7].
It is worth noting that this argument applies even if automatization exists on a continuum rather than in two discrete states. If we are interested in two competing processes, then what matters is which is relatively more automatic; if we are interested in several, then what matters is if the one associated with poor self-control is more automatic. It is also notable that controlled processes can become automated and then produce poor control. Consider, for example, a child learning, with difficulty, to read; a few years later, that child is tested on the Stroop task and has difficulty performing accurately in the high conflict condition.
The processes that automate basic sensorimotor mappings operate on both long and short timescales—that is, both the evolutionary timescale and on a scale much shorter than the lifetime of an individual decision-maker. Both processes are, for my purposes here, similar. Self-control failure can result from suboptimal responses from either learned or evolved mappings. The only important difference is that evolved responses are likely even more ingrained, more canalized and less susceptible to changing priorities. They may require even larger exertion from the central executive to overcome. It is intriguing, in this view, that some of the most powerful cases of poor self-control (food and drugs) are ones that reflect an evolutionary, not just learning mismatch.
If self-control is just about cognitive control, why do we not just evolve a larger capacity for cognitive control? The answer to this question is not yet determined [7,29,126]. It does seem clear, however, that control is quite limited [7,125]. We have difficulty with sustained focus and task-switching [127–131]. Control seems to be qualitatively different from capacities like oculomotor control or form vision, which are excellent.
One possibility is that there are basic computational principles that limit the capacity of any such complex system. For example, there is good reason to think that the brain, especially the prefrontal cortex, has many properties in common with a certain neural network type known as attractor networks. These networks can be studied in simulations to give insight into their properties, which may reflect the properties of the real brain. There is evidence that the number of representations that can be kept separate within such networks is limited [7,132]. The limit on the number of representations then may impose a hard limit on processing capacity. Crucially, the problem cannot be solved by devoting more resources: the brain may not be able to increase the number of available representations because shared representations provide a critical benefit in the form of allowing generalization, insight and novel solutions to problems [133,134].
7. Implications
By this perspective, self-control is ‘just’ a type of economic choice (as argued by Berkman et al. [12]). But it is a special one: it is one in which (i) at least one of the options is associated with an intrinsic bias towards or against it. And that means (ii) overcoming that choice requires effort. And (iii) failure to do so is both costly and ego-dystonic. These are not features of conventional economic choices. Thus, while I agree with Berkman and colleagues, I think they bypass the most interesting part of self-control: its tendency to fail.
Do humans have more self-control than animals? This question, often asked, is poorly specified. The cognitive control framework lets us ask it more precisely. Do humans have a greater ability to let goals and changing task demands influence their choices—and rely less on automated mappings? The answer is likely yes, but we need more studies directly comparing the cognitive control abilities of humans and other animals (e.g. [61]). These tests will have to rely on an understanding of the foraging frameworks of animals, so that measures can be designed appropriately to allow comparison [135].
If self-control is a type of cognitive control, this suggests that much of the psychology and neuroscience of cognitive control may have direct benefits in helping us to understand self-control as well. Thus, for example, information about the neuroanatomy and neuronal mechanisms of cognitive control should be directly testable as theories of self-control. One important area for future research will be to see whether our understanding of cognitive control failure can shed insight into the mechanisms of self-control failure.
From the cognitive control perspective, poor self-control is the default and good self-control is more likely to require deliberate effort [22]. This does not mean that we will always perceive it as such. Our brains are highly practised at deploying cognitive control flexibly and adaptively, so the conflict between controlled and automatic processes may not rise to the level of consciousness. Or it may rise to the level of consciousness but may be perceived as effortful, difficult or just distracting. The phenomenology of self-control is poorly studied, but likely to be an important motivator for future research.
Recent work in the field of self-control and in cognition more broadly has challenged the two-systems view on empirical, theoretical and neuroscientific grounds [12,28,29,57,136,137]. Nonetheless, taking a cognitive control perspective on self-control suggests that this view has at least a few merits. Specifically, any given self-control decision reflects a competition between what can be thought of as distinct brain processes. (This is true whether these two types of processes are regionally or even anatomically differentiated). That does not mean there are two systems; but there are two tendencies: automatic and controlled. And these types may be relative, not absolute; we may have a spectrum of processes ranging from automatic to controlled. But in many specific situations, there will only be two relevant processes competing. In that sense, one could even meaningfully label them hot and cold.
8. Implications for the neuroscience of self-control
The idea that self-control is a type of cognitive control suggests that we do not have a special self-control system or self-control module in the brain. That is, if self-control is continuous with cognitive control, there is no region whose unique purpose (or even one of its purposes) is to drive self-control. Instead, controlled actions likely make use of a more general control architecture. This control architecture may be modular or may be distributed [124,126,138,139]. It likely includes dorsal prefrontal regions, such as the dorsolateral prefrontal cortex and dorsal anterior cingulate cortex [7,124,126,140,141]. This approach implies that neural signatures of self-control will be continuous with signatures of cognitive control. Thus, a critical test for this idea would be to compare networks involved in cognitive control with those involved in self-control. This could be done at both the neuronal level and at larger scales.
This idea also has implications about the relationship between self-control and economic choice. Our proposal, in essence, is that self-control is an economic choice in which one option is intrinsically favoured over the other, but the other is more consistent with long-term goals. Standard approaches to neuroeconomics are derived from economics and often involve binary choices, or choices between two goods or bundles of goods in which neither is default, or a priori favoured. By contrast, foraging-inspired models of economic choice take as their starting point the idea that choices are between accepting and rejecting single options [142–145]. These models, in turn, are inspired by ethological observations about the types of decisions that foragers make in natural environments [34,146]. One of the key differences between accept–reject decisions and binary choices is that we may have intrinsic tendencies to prefer accepting or rejecting, or, because they are computed differently, the two types of choices may have different psychological processes and different neural substrates [143].
This idea in turn relates to the idea of affordance competition [147,148]. Embodied theories of economic choice, going back to Gibson [149], emphasize that control of action is the ultimate evolutionary driving force in the brain. As such, it is not surprising that we see signatures of action even in supposedly abstract reward areas [150,151]. From this perspective, stimuli we encounter in the environment trigger affordances or plans for potential actions to take. The decision about whether to take that action depends on some thresholding process (whose exact nature remains to be delineated). But it is this process that determines the outcome of most self-control decisions.
9. Conclusion
Self-control is often taken as a given: we have poor self-control, but if we tried harder we would do better. From the psychological perspective, we are flawed. But from the evolutionary perspective, we are descended from a long line of successful foragers, and every element of our psychology has some potential explanation in our evolutionary history. Thus, each of our major flaws—our tendency to lower back pain, the weakness of our anterior cruciate ligaments, our tendency to get kidney stones, our inability to fly—demands an explanation. Our poor self-control is a major flaw as well. We can lament it and urge ourselves to do better in the future, but we can also be a bit more objective and ask why poor self-control is so universal. While the phylogenetic origins of self-control failure remain to be worked out, the weight of evidence suggests that the neural origins lie in the domain of cognitive control.
Acknowledgements
I thank Amitai Shenhav, Becket Ebitz and Habiba Azab for comments on a working version of this manuscript.
Data accessibility
This article has no additional data.
Competing interests
I declare I have no competing interests.
Funding
This work was supported by NIH R01 DA038615.
References
- 1.de Ridder DTD, Lensvelt-Mulders G, Finkenauer C, Stok FM, Baumeister RF. 2012. Taking stock of self-control: a meta-analysis of how trait self-control relates to a wide range of behaviors. Personal. Soc. Psychol. Rev. 16, 76–99. ( 10.1177/1088868311418749) [DOI] [PubMed] [Google Scholar]
- 2.Tangney JP, Baumeister RF, Boone AL. 2004. High self-control predicts good adjustment, less pathology, better grades, and interpersonal success. J. Pers. 72, 271–322. ( 10.1111/j.0022-3506.2004.00263.x) [DOI] [PubMed] [Google Scholar]
- 3.Duckworth AL, Seligman MEP. 2005. Self-discipline outdoes IQ in predicting academic performance of adolescents. Psychol. Sci. 16, 939–944. ( 10.1111/j.1467-9280.2005.01641.x) [DOI] [PubMed] [Google Scholar]
- 4.Quinn PD, Fromme K. 2010. Self-regulation as a protective factor against risky drinking and sexual behavior. Psychol. Addict. Behav. 24, 376–385. ( 10.1037/a0018547) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Dixon MR, Marley J, Jacobs EA. 2003. Delay discounting by pathological gamblers. J. Appl. Behav. Anal. 36, 449–458. ( 10.1901/jaba.2003.36-449) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Shenhav A. 2017. The perils of losing control: why self-control is not just another value-based decision. Psychol. Inq. 28, 148–152. ( 10.1080/1047840X.2017.1337407) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Shenhav A, Musslick S, Lieder F, Kool W, Griffiths TL, Cohen JD, Botvinick MM. 2017. Toward a rational and mechanistic account of mental effort. Annu. Rev. Neurosci. 40, 99–124. ( 10.1146/annurev-neuro-072116-031526) [DOI] [PubMed] [Google Scholar]
- 8.Muraven M, Baumeister RF. 2000. Self-regulation and depletion of limited resources: does self-control resemble a muscle? Psychol. Bull. 126, 247–259. ( 10.1037/0033-2909.126.2.247) [DOI] [PubMed] [Google Scholar]
- 9.Baumeister RF, Heatherton TF, Tice DM. 1994. Losing control: how and why people fail at self-regulation. New York, NY: Academic Press. [Google Scholar]
- 10.Mischel W, Cantor N, Feldman S. 1996. Principles of self-regulation: the nature of willpower and self-control. In Social psychology: handbook of basic principles (eds Higgins E, Kruglanski A), pp. 329–360. New York, NY: Guildford Press. [Google Scholar]
- 11.Fujita K. 2011. On conceptualizing self-control as more than the effortful inhibition of impulses. Personal. Soc. Psychol. Rev. 15, 352–366. ( 10.1177/1088868311411165) [DOI] [PubMed] [Google Scholar]
- 12.Berkman ET, Hutcherson CA, Livingston JL, Kahn LE, Inzlicht M. 2017. Self-control as value-based choice. Curr. Dir. Psychol. Sci. 26, 422–428. ( 10.1177/0963721417704394) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Fawcett TW, McNamara JM, Houston AI. 2012. When is it adaptive to be patient? A general framework for evaluating delayed rewards. Behav. Process. 89, 128–136. ( 10.1016/j.beproc.2011.08.015) [DOI] [PubMed] [Google Scholar]
- 14.Stephens DW. 2002. Discrimination, discounting and impulsivity: a role for an informational constraint. Phil. Trans. R. Soc. Lond. B 357, 1527–1537. ( 10.1098/rstb.2002.1062) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Stevens JR. 2014. Evolutionary pressures on primate intertemporal choice. Proc. R. Soc. B 281, 20140499 ( 10.1098/rspb.2014.0499) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Stephens DW, Anderson D. 2001. The adaptive value of preference for immediacy: when shortsighted rules have farsighted consequences. Behav. Ecol. 12, 330–339. ( 10.1093/beheco/12.3.330) [DOI] [Google Scholar]
- 17.Kacelnik A. 2003. The evolution of patience. In Time and decision: economic and psychological perspectives on intertemporal choice (eds Loewenstein G, Read D, Baumeister R), pp. 115–138. New York, NY: Russell Sage Foundation. [Google Scholar]
- 18.Yarbus A. 1967. Eye movements and vision, 1st edn New York, NY: Springer. [Google Scholar]
- 19.James W. 1950. The principles of psychology (Vol. 1). New York, NY: Dover; (Original work published 1890.) [Google Scholar]
- 20.Baumeister RF, Heatherton TF. 1996. Self-regulation failure: an overview. Psychological Inquiry 7, 1–15. ( 10.1207/s15327965pli0701_1) [DOI] [Google Scholar]
- 21.Carver CS. 2005. Impulse and constraint: perspectives from personality psychology, convergence with theory in other areas, and potential for integration. Pers. Soc. Psychol. Rev. 9, 312–333. ( 10.1207/s15327957pspr0904_2) [DOI] [PubMed] [Google Scholar]
- 22.Hofmann W, Friese M, Strack F. 2009. Impulse and self-control from a dual-systems perspective. Perspect. Psychol. Sci. 4, 162–176. ( 10.1111/j.1745-6924.2009.01116.x) [DOI] [PubMed] [Google Scholar]
- 23.Metcalfe J, Mischel W. 1999. A hot/cool-system analysis of delay of gratification: dynamics of willpower. Psychol. Rev. 106, 3–19. ( 10.1037/0033-295X.106.1.3) [DOI] [PubMed] [Google Scholar]
- 24.Baumeister RF, Bratslavsky E, Muraven M, Tice DM. 1998. Ego depletion: is the active self a limited resource? J. Pers. Soc. Psychol. 74, 1252–1265. ( 10.1037/0022-3514.74.5.1252) [DOI] [PubMed] [Google Scholar]
- 25.McClure SM, Laibson DI, Loewenstein G, Cohen JD. 2004. Separate neural systems value immediate and delayed monetary rewards. Science 306, 503–507. ( 10.1126/science.1100907) [DOI] [PubMed] [Google Scholar]
- 26.Figner B, Knoch D, Johnson EJ, Krosch AR, Lisanby SH, Fehr E, Weber EU. 2010. Lateral prefrontal cortex and self-control in intertemporal choice. Nat. Neurosci. 13, 538–539. ( 10.1038/nn.2516) [DOI] [PubMed] [Google Scholar]
- 27.Hare TA, Camerer CF, Rangel A. 2009. Self-control in decision-making involves modulation of the vmPFC valuation system. Science 324, 646–648. ( 10.1126/science.1168450) [DOI] [PubMed] [Google Scholar]
- 28.McGuire JT, Kable JW. 2015. Medial prefrontal cortical activity reflects dynamic re-evaluation during voluntary persistence. Nat. Neurosci. 18, 760–766. ( 10.1038/nn.3994) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Kurzban R, Duckworth A, Kable JW, Myers J. 2013. An opportunity cost model of subjective effort and task performance. Behav. Brain Sci. 36, 661–679. ( 10.1017/S0140525X12003196) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Becker GS, Murphy KM. 1988. A theory of rational addiction. J. Polit. Econ. 96, 675–700. ( 10.1086/261558) [DOI] [Google Scholar]
- 31.Kirby KN, Marakovic NN. 1996. Delay-discounting probabilistic rewards: rates decrease as amounts increase. Psychon. Bull. Rev. 3, 100–104. ( 10.3758/BF03210748) [DOI] [PubMed] [Google Scholar]
- 32.Rogeberg O. 2004. Taking absurd theories seriously: economics and the case of rational addiction theories. Philos. Sci. 71, 263–285. ( 10.1086/421535) [DOI] [Google Scholar]
- 33.Santos LR, Rosati AG. 2015. The evolutionary roots of human decision making. Annu. Rev. Psychol. 66, 321–347. ( 10.1146/annurev-psych-010814-015310) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Stephens DW, Krebs JR. 1986 Foraging theory. Princeton, NJ: Princeton University Press. [Google Scholar]
- 35.Farashahi S, Azab H, Hayden B, Soltani A. 2018. On the flexibility of basic risk attitudes in monkeys. J. Neurosci. 38, 4383–4398. ( 10.1523/jneurosci.2260-17.2018) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ. 2006. Cortical substrates for exploratory decisions in humans. Nature 441, 876–879. ( 10.1038/nature04766) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Pearson JM, Hayden BY, Platt ML. 2010. Explicit information reduces discounting behavior in monkeys. Front. Psychol. 1, 1–8. ( 10.3389/fpsyg.2010.00237) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Nassar MR, Wilson RC, Heasly B, Gold JI. 2010. An approximately Bayesian delta-rule model explains the dynamics of belief updating in a changing environment. J. Neurosci. 30, 12 366–12 378. ( 10.1523/JNEUROSCI.0822-10.2010) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Camerer C, Hua Ho T. 1999. Experience-weighted attraction learning in normal form games. Econometrica 67, 827–874. ( 10.1111/1468-0262.00054) [DOI] [Google Scholar]
- 40.Blanchard TC, Wilke A, Hayden BY. 2014. Hot-hand bias in rhesus monkeys. J. Exp. Psychol. Anim. Learn. Cogn. 40, 280–286. ( 10.1037/xan0000033) [DOI] [PubMed] [Google Scholar]
- 41.Schweighofer N, Shishida K, Han CE, Okamoto Y, Tanaka SC, Yamawaki S, Doya K. 2006. Humans can adopt optimal discounting strategy under real-time constraints. PLoS Comput. Biol. 2, e152 ( 10.1371/journal.pcbi.0020152) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Stevens JR, Stephens DW. 2008. Patience. Curr. Biol. 18, R11–R12. ( 10.1016/j.cub.2007.11.021) [DOI] [PubMed] [Google Scholar]
- 43.Mischel W, Ebbesen EB, Zeiss AR. 1972. Cognitive and attentional mechanisms in delay of gratification. J. Pers. Soc. Psychol. 21, 204–218. [DOI] [PubMed] [Google Scholar]
- 44.Rachlin H. 2000. The science of self-control. Cambridge, MA: Harvard University Press. [Google Scholar]
- 45.Strier KB. 2018. Primate behavioral ecology. Boston, USA: Allyn & Bacon. [Google Scholar]
- 46.Rawlins RG, Kessler MJ. 1986. The Cayo Santiago macaques: history, behavior, and biology. New York, NY: State University of New York Press. [Google Scholar]
- 47.Inzlicht M, Schmeichel BJ. 2012. What is ego depletion? Toward a mechanistic revision of the resource model of self-control. Perspect. Psychol. Sci. 7, 450–463. ( 10.1177/1745691612454134) [DOI] [PubMed] [Google Scholar]
- 48.Baumeister RF, Vohs KD, Tice DM. 2007. The strength model of self-control. Curr. Dir. Psychol. Sci. 16, 351–355. ( 10.1111/j.1467-8721.2007.00534.x) [DOI] [Google Scholar]
- 49.Muraven M, Tice DM, Baumeister RF. 1998. Self-control as limited resource: regulatory depletion patterns. J. Pers. Soc. Psychol. 74, 774–789. ( 10.1037/0022-3514.74.3.774) [DOI] [PubMed] [Google Scholar]
- 50.Baumeister RF, Gailliot M, DeWall CN, Oaten M. 2006. Self-regulation and personality: how interventions increase regulatory success, and how depletion moderates the effects of traits on behavior. J. Pers. 74, 1773–1802. ( 10.1111/j.1467-6494.2006.00428.x) [DOI] [PubMed] [Google Scholar]
- 51.Gailliot MT, Baumeister RF. 2007. The physiology of willpower: linking blood glucose to self-control. Pers. Soc. Psychol. Rev. 11, 303–327. ( 10.1177/1088868307303030) [DOI] [PubMed] [Google Scholar]
- 52.Dvorak RD, Simons JS. 2009. Moderation of resource depletion in the self-control strength model: differing effects of two modes of self-control. Pers. Soc. Psychol. Bull. 35, 572–583. ( 10.1177/0146167208330855) [DOI] [PubMed] [Google Scholar]
- 53.Carter EC, Kofler LM, Forster DE, McCullough ME. 2015. A series of meta-analytic tests of the depletion effect: self-control does not seem to rely on a limited resource. J. Exp. Psychol. Gen. 144, 796–815. ( 10.1037/xge0000083) [DOI] [PubMed] [Google Scholar]
- 54.Hagger MS, et al. 2016. A multilab preregistered replication of the ego-depletion effect. Perspect. Psychol. Sci. 11, 546–573. ( 10.1177/1745691616652873) [DOI] [PubMed] [Google Scholar]
- 55.Carter EC, McCullough ME. 2013. After a pair of self-control-intensive tasks, sucrose swishing improves subsequent working memory performance. BMC Psychol. 1, 22 ( 10.1186/2050-7283-1-22) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Xu X, Demos KE, Leahey TM, Hart CN, Trautvetter J, Coward P, Middleton KR, Wing RR. 2014. Failure to replicate depletion of self-control. PLoS ONE 9, e109950 ( 10.1371/journal.pone.0109950) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Inzlicht M, Berkman E. 2015. Six questions for the resource model of control (and some answers). Soc. Pers. Psychol. Compass 9, 511–524. ( 10.1111/spc3.12200) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Molden DC, Hui CM, Scholer AA, Meier BP, Noreen EE, D'Agostino PR, Martin V. 2012. Motivational versus metabolic effects of carbohydrates on self-control. Psychol. Sci. 23, 1137–1144. ( 10.1177/0956797612439069) [DOI] [PubMed] [Google Scholar]
- 59.Vadillo MA, Gold N, Osman M. 2016. The bitter truth about sugar and willpower. Psychol. Sci. 27, 1207–1214. ( 10.1177/0956797616654911) [DOI] [PubMed] [Google Scholar]
- 60.Müller T, Apps MAJ. 2018. Motivational fatigue: a neurocognitive framework for the impact of effortful exertion on subsequent motivation. Neuropsychologia. ( 10.1016/J.NEUROPSYCHOLOGIA.2018.04.030) [DOI] [PubMed] [Google Scholar]
- 61.MacLean EL, et al. 2014. The evolution of self-control. Proc. Natl Acad. Sci. USA 111, E2140–E2148. ( 10.1073/pnas.1323533111) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Stevens JR, Mühlhoff N. 2012. Intertemporal choice in lemurs. Behav. Processes 89, 121–127. ( 10.1016/J.BEPROC.2011.10.002) [DOI] [PubMed] [Google Scholar]
- 63.Beran MJ. 2015. The comparative science of ‘self-control’: what are we talking about? Front. Psychol. 6, 1–4. ( 10.3389/fpsyg.2015.00051) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Hayden BY. 2016. Time discounting and time preference in animals: a critical review. Psychon. Bull. Rev. 23, 39–53. ( 10.3758/s13423-015-0879-3) [DOI] [PubMed] [Google Scholar]
- 65.Tobin H, Logue AW. 1994. Self-control across species (Columba livia, Homo sapiens, and Rattus norvegicus). J. Comp. Psychol. 108, 126–133. ( 10.1037/0735-7036.108.2.126) [DOI] [PubMed] [Google Scholar]
- 66.Byrne RW, Corp N. 2004. Neocortex size predicts deception rate in primates. Proc. R. Soc. Lond. B 271, 1693–1699. ( 10.1098/rspb.2004.2780) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Deaner RO, Isler K, Burkart J, van Schaik C. 2007. Overall brain size, and not encephalization quotient, best predicts cognitive ability across non-human primates. Brain. Behav. Evol. 70, 115–124. ( 10.1159/000102973) [DOI] [PubMed] [Google Scholar]
- 68.Stephens DW, Brown JS, Ydenberg RC. 2007. Foraging: behavior and ecology. Chicago, IL: University of Chicago Press. [Google Scholar]
- 69.Wendt S, Czaczkes TJ. 2017. Individual ant workers show self-control. Biol. Lett. 13, 20170450 ( 10.1098/rsbl.2017.0450) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Bulley A, Henry J, Suddendorf T. 2016. Prospection and the present moment: the role of episodic foresight in intertemporal choices between immediate and delayed rewards. Rev. Gen. Psychol. 20, 29–47. ( 10.1037/gpr0000061) [DOI] [Google Scholar]
- 71.Suddendorf T, Corballis MC. 1997. Mental time travel and the evolution of the human mind. Genet. Soc. Gen. Psychol. Monogr. 123, 133–167. [PubMed] [Google Scholar]
- 72.Buckner RL, Carroll DC. 2007. Self-projection and the brain. Trends Cogn. Sci. 11, 49–57. ( 10.1016/j.tics.2006.11.004) [DOI] [PubMed] [Google Scholar]
- 73.Kwan D, Craver CF, Green L, Myerson J, Boyer P, Rosenbaum RS. 2012. Future decision-making without episodic mental time travel. Hippocampus 22, 1215–1219. ( 10.1002/hipo.20981) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Craver CF, Cova F, Green L, Myerson J, Rosenbaum RS, Kwan D, Bourgeois-Gironde S. 2014. An Allais paradox without mental time travel. Hippocampus 24, 1375–1380. ( 10.1002/hipo.22318) [DOI] [PubMed] [Google Scholar]
- 75.Kagel JH, MacDonald DN, Battalio RC, White S, Green L. 1986. Risk aversion in rats (Rattus norvegicus) under varying levels of resource availability. J. Comp. Psychol. 100, 95–100. ( 10.1037/0735-7036.100.2.95) [DOI] [Google Scholar]
- 76.Sozou PD. 1998. On hyperbolic discounting and uncertain hazard rates. Proc. R. Soc. Lond. B 265, 2015–2020. ( 10.1098/rspb.1998.0534) [DOI] [Google Scholar]
- 77.Rosati AG, Stevens JR, Hare B, Hauser MD. 2007. The evolutionary origins of human patience: temporal preferences in chimpanzees, bonobos, and human adults. Curr. Biol. 17, 1663–1668. ( 10.1016/J.CUB.2007.08.033) [DOI] [PubMed] [Google Scholar]
- 78.Stevens JR, Cushman FA, Hauser MD. 2005. Evolving the psychological mechanisms for cooperation. Annu. Rev. Ecol. Evol. Syst. 36, 499–518. ( 10.1146/annurev.ecolsys.36.113004.083814) [DOI] [Google Scholar]
- 79.Stevens JR, Hallinan EV, Hauser MD. 2005. The ecology and evolution of patience in two new world monkeys. Biol. Lett. 1, 223–226. ( 10.1098/rsbl.2004.0285) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Heilbronner SR, Rosati AG, Stevens JR, Hare B, Hauser MD. 2008. A fruit in the hand or two in the bush? Divergent risk preferences in chimpanzees and bonobos. Biol. Lett. 4, 246–249. ( 10.1098/rsbl.2008.0081) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Henly SE, Ostdiek A, Blackwell E, Knutie S, Dunlap AS, Stephens DW. 2007. The discounting-by-interruptions hypothesis: model and experiment. Behav. Ecol. 19, 154–162. ( 10.1093/beheco/arm110) [DOI] [Google Scholar]
- 82.Ainslie GW. 1974. Impulse control in pigeons. J. Exp. Anal. Behav. 21, 1333221 ( 10.1901/jeab.1974.21-485) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Berns GS, Laibson D, Loewenstein G. 2007. Intertemporal choice – toward an integrative framework. Trends Cogn. Sci. 11, 482–488. ( 10.1016/J.TICS.2007.08.011) [DOI] [PubMed] [Google Scholar]
- 84.Kacelnik A, Bateson M. 1996. Risky theories – the effects of variance on foraging decisions. Am. Zool. 36, 402–434. ( 10.1093/icb/36.4.402) [DOI] [Google Scholar]
- 85.Mazur JE, Logue AW. 1978. Choice in a ‘self-control’ paradigm: effects of a fading procedure. J. Exp. Anal. Behav. 30, 11–17. ( 10.1901/JEAB.1978.30-11) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Frederick S, Loewenstein G, O'Donoghue T. 2002. Time discounting and time preference: a critical review. J. Econ. Lit. 40, 351–401. ( 10.1257/jel.40.2.351) [DOI] [Google Scholar]
- 87.Green L, Fristoe N, Myerson J. 1994. Temporal discounting and preference reversals in choice between delayed outcomes. Psychon. Bull. Rev. 1, 383–389. ( 10.3758/BF03213979) [DOI] [PubMed] [Google Scholar]
- 88.Kirby KN, Herrnstein RJ. 1995. Preference reversals due to myopic discounting of delayed reward. Psychol. Sci. 6, 83–89. ( 10.1111/j.1467-9280.1995.tb00311.x) [DOI] [Google Scholar]
- 89.Stephens DW, Kerr B, Fernández-Juricic E. 2004. Impulsiveness without discounting: the ecological rationality hypothesis. Proc. R. Soc. Lond. B 271, 2459–2465. ( 10.1098/rspb.2004.2871) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Pavlic TP, Passino KM. 2010. When rate maximization is impulsive. Behav. Ecol. Sociobiol. 64, 1255–1265. ( 10.1007/s00265-010-0940-1) [DOI] [Google Scholar]
- 91.Levy JM, Namboodiri VMK, Hussain Shuler MG. 2015. Memory bias in the temporal bisection point. Front. Integr. Neurosci. 9, 44 ( 10.3389/fnint.2015.00044) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Blanchard TC, Pearson JM, Hayden BY. 2013. Postreward delays and systematic biases in measures of animal temporal discounting. Proc. Natl Acad. Sci. USA 110, 15 491–15 496. ( 10.1073/pnas.1310446110) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Blanchard TC, Strait CE, Hayden BY. 2015. Ramping ensemble activity in dorsal anterior cingulate neurons during persistent commitment to a decision. J. Neurophysiol. 114, 2439–2449. ( 10.1152/jn.00711.2015) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 94.Blanchard TC, Hayden BY. 2015. Monkeys are more patient in a foraging task than in a standard intertemporal choice task. PLoS ONE 10, 1–11. ( 10.1371/journal.pone.0117057) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.Logue AW, Smith ME, Rachlin H. 1985. Sensitivity of pigeons to prereinforcer and postreinforcer delay. Anim. Learn. Behav. 13, 181–186. ( 10.3758/BF03199271) [DOI] [Google Scholar]
- 96.Green L, Fischer EB Jr, Perlow S, Sherman L. 1981. Preference reversal and self control: choice as a function of reward amount and delay. Behav. Anal. Lett. 1, 43–51. [Google Scholar]
- 97.Fox AT, Smethells JR, Reilly MP. 2013. Flash rate discrimination in rats: rate bisection and generalization peak shift. J. Exp. Anal. Behav. 100, 211–221. ( 10.1002/jeab.36) [DOI] [PubMed] [Google Scholar]
- 98.Paglieri F. 2013. The costs of delay: waiting versus postpoing in intertemporal choice. J. Exp. Anal. Behav. 99, 362–377. ( 10.1002/jeab.18) [DOI] [PubMed] [Google Scholar]
- 99.Bramlett JL, Perdue BM, Evans TA, Beran MJ. 2012. Capuchin monkeys (Cebus apella) let lesser rewards pass them by to get better rewards. Anim. Cogn. 15, 963–969. ( 10.1007/s10071-012-0522-x) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 100.Boysen ST, Berntson GG. 1995. Responses to quantity: perceptual versus cognitive mechanisms in chimpanzees (Pan troglodytes). J. Exp. Psychol. Anim. Behav. Process. 21, 82–86. ( 10.1037/0097-7403.21.1.82) [DOI] [PubMed] [Google Scholar]
- 101.Addessi E, Paglieri F, Focaroli V. 2011. The ecological rationality of delay tolerance: insights from capuchin monkeys. Cognition 119, 142–147. ( 10.1016/j.cognition.2010.10.021) [DOI] [PubMed] [Google Scholar]
- 102.McClure SM, Ericson KM, Laibson DI, Loewenstein G, Cohen JD. 2007. Time discounting for primary rewards. J. Neurosci. 27, 5796–5804. ( 10.1523/jneurosci.4246-06.2007) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 103.Hayden BY, Parikh PC, Deaner RO, Platt ML. 2007. Economic principles motivating social attention in humans. Proc. R. Soc. B 274, 1751–1756. ( 10.1098/rspb.2007.0368) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 104.Lejuez CW, Read JP, Kahler CW, Richards JB, Ramsey SE, Stuart GL, Strong DR, Brown RA. 2002. Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task (BART). J. Exp. Psychol. Appl. 8, 75–84. ( 10.1037/1076-898X.8.2.75) [DOI] [PubMed] [Google Scholar]
- 105.Hsee CK, Abelson RP, Salovey P. 1991. The relative weighting of position and velocity in satisfaction. Psychol. Sci. 2, 263–267. ( 10.1111/j.1467-9280.1991.tb00146.x) [DOI] [Google Scholar]
- 106.Varey C, Kahneman D. 1992. Experiences extended across time: evaluation of moments and episodes. J. Behav. Decis. Mak. 5, 169–185. ( 10.1002/bdm.3960050303) [DOI] [Google Scholar]
- 107.Chapman GB. 2000. Preferences for improving and declining sequences of health outcomes. J. Behav. Decis. Mak. 13, 203–218. ( 10.1002/(SICI)1099-0771(200004/06)13:2%3C203::AID-BDM317%3E3.0.CO;2-S) [DOI] [Google Scholar]
- 108.Scholten M, Read D. 2010. The psychology of intertemporal tradeoffs. Psychol. Rev. 117, 925–944. ( 10.1037/a0019619) [DOI] [PubMed] [Google Scholar]
- 109.Kralik JD. 2005. Inhibitory control and response selection in problem solving: how cotton-top tamarins (Saguinus oedipus) overcome a bias for selecting the larger quantity of food. J. Comp. Psychol. 119, 78–89. ( 10.1037/0735-7036.119.1.78) [DOI] [PubMed] [Google Scholar]
- 110.Izquierdo A, Suda RK, Murray EA. 2004. Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J. Neurosci. 24, 7540–7548. ( 10.1523/JNEUROSCI.1921-04.2004) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 111.Chudasama Y, Kralik J, Murray E. 2006. Rhesus monkeys with orbital prefrontal cortex lesions can learn to inhibit prepotent responses in the reversed reward contingency task. Cereb. Cortex 17, 1154–1159. ( 10.1093/cercor/bhl025) [DOI] [PubMed] [Google Scholar]
- 112.Silberberg A, Fujita K. 1996. Pointing at smaller food amounts in an analogue of Boysen and Berntson's (1995) procedure. J. Exp. Anal. Behav. 66, 143–147. ( 10.1901/jeab.1996.66-143) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 113.Genty E, Palmier C, Roeder JJ. 2004. Learning to suppress responses to the larger of two rewards in two species of lemurs, Eulemur fulvus and E. macaco. Anim. Behav. 67, 925–932. ( 10.1016/j.anbehav.2003.09.007) [DOI] [Google Scholar]
- 114.Shifferman EM. 2009. Its own reward: lessons to be drawn from the reversed-reward contingency paradigm. Anim. Cogn. 12, 547–558. ( 10.1007/s10071-009-0215-2) [DOI] [PubMed] [Google Scholar]
- 115.Uher J, Asendorpf JB. 2008. Personality in the behaviour of great apes: temporal stability, cross-situational consistency and coherence in response. Anim. Behav. 75, 99–112. ( 10.1016/j.anbehav.2007.04.018) [DOI] [Google Scholar]
- 116.Anderson JR, Kuroshima H, Fujita K. 2010. Delay of gratification in capuchin monkeys (Cebus apella) and squirrel monkeys (Saimiri sciureus). J. Comp. Psychol. 124, 205–210. ( 10.1037/a0018240) [DOI] [PubMed] [Google Scholar]
- 117.Beran MJ. 2002. Maintenance of self-imposed delay of gratification by four chimpanzees (Pan troglodytes) and an orangutan (Pongo pygmaeus). J. Gen. Psychol. 129, 49–66. ( 10.1080/00221300209602032) [DOI] [PubMed] [Google Scholar]
- 118.Evans TA, Beran MJ. 2007. Delay of gratification and delay maintenance by rhesus macaques (Macaca mulatta). J. Gen. Psychol. 134, 199–216. ( 10.3200/GENP.134.2.199-216) [DOI] [PubMed] [Google Scholar]
- 119.Pelé M, Dufour V, Micheletta J, Thierry B. 2010. Long-tailed macaques display unexpected waiting abilities in exchange tasks. Anim. Cogn. 13, 263–271. ( 10.1007/s10071-009-0264-6) [DOI] [PubMed] [Google Scholar]
- 120.Pelé M, Micheletta J, Uhlrich P, Thierry B, Dufour V. 2011. Delay maintenance in Tonkean macaques (Macaca tonkeana) and brown capuchin monkeys (Cebus apella). Int. J. Primatol. 32, 149–166. ( 10.1007/s10764-010-9446-y) [DOI] [Google Scholar]
- 121.Dufour V, Sterck EHM, Thierry B. 2007. Chimpanzee (Pan troglodytes) anticipation of food return: coping with waiting time in an exchange task. J. Comp. Psychol. 121, 145–155. ( 10.1037/0735-7036.121.2.145) [DOI] [PubMed] [Google Scholar]
- 122.Leonardi RJ, Vick S-J, Dufour V. 2012. Waiting for more: the performance of domestic dogs (Canis familiaris) on exchange tasks. Anim. Cogn. 15, 107–120. ( 10.1007/s10071-011-0437-y) [DOI] [PubMed] [Google Scholar]
- 123.Pezzulo G, Cisek P. 2016. Navigating the affordance landscape: feedback control as a process model of behavior and cognition. Trends Cogn. Sci. 20, 414–424. ( 10.1016/J.TICS.2016.03.013) [DOI] [PubMed] [Google Scholar]
- 124.Botvinick MM, Cohen JD. 2014. The computational and neural basis of cognitive control: charted territory and new frontiers. Cogn. Sci. 38, 1249–1285. ( 10.1111/cogs.12126) [DOI] [PubMed] [Google Scholar]
- 125.Shiffrin RM, Schneider W. 1977. Controlled and automatic information processing: II. Perceptual learning, automatic attending, and a general theory. Psychol. Rev. 84, 127–190. ( 10.1037/0033-295X.84.2.127) [DOI] [Google Scholar]
- 126.Miller EK, Cohen JD. 2001. An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 24, 167–202. ( 10.1146/annurev.neuro.24.1.167) [DOI] [PubMed] [Google Scholar]
- 127.Weissman DH, Roberts KC, Visscher KM, Woldorff MG. 2006. The neural bases of momentary lapses in attention. Nat. Neurosci. 9, 971–978. ( 10.1038/nn1727) [DOI] [PubMed] [Google Scholar]
- 128.Boly M, et al. 2007. Baseline brain activity fluctuations predict somatosensory perception in humans. Proc. Natl Acad. Sci. USA 104, 12 187–12 192. ( 10.1073/pnas.0611404104) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 129.Monsell S. 2003. Task switching. Trends Cogn. Sci. 7, 134–140. ( 10.1016/S1364-6613(03)00028-7) [DOI] [PubMed] [Google Scholar]
- 130.Hayden B, Smith DV, Platt M. 2010. Cognitive control signals in posterior cingulate cortex. Front. Hum. Neurosci. 4, 223 ( 10.3389/fnhum.2010.00223) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 131.Logan GD, Schneider DW, Bundesen C. 2007. Still clever after all these years: searching for the homunculus in explicitly cued task switching. J. Exp. Psychol. Hum. Percept. Perform. 33, 978–994. ( 10.1037/0096-1523.33.4.978) [DOI] [PubMed] [Google Scholar]
- 132.Usher M, Cohen JD. 1999. Short term memory and selection processes in a frontal-lobe model. In Connectionist models in cognitive neuroscience. Perspectives in Neural Computing (eds Heinke D D, Humphreys GW, Olson A), pp. 78–91. London, UK: Springer. [Google Scholar]
- 133.Musslick S, Dey B, Özcimder K, Patwary MMA, Willke TL, Cohen JD. 2016. Controlled vs. automatic processing: a graph-theoretic approach to the analysis of serial vs. parallel processing in neural network architectures. In Proc. 38th Annu. Conf. Cogn. Sci. Soc. (CogSci 2016), Philadelphia, Pennsylvania, USA, 10–13 August 2016, pp. 1547–1552. Austin, TX: Cognitive Science Society. [Google Scholar]
- 134.Feng SF, Schwemmer M, Gershman SJ, Cohen JD. 2014. Multitasking versus multiplexing: toward a normative account of limitations in the simultaneous execution of control-demanding behaviors. Cogn. Affect. Behav. Neurosci. 14, 129–146. ( 10.3758/s13415-013-0236-9) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 135.Calhoun AJ, Hayden BY. 2015. The foraging brain. Curr. Opin. Behav. Sci. 5, 24–31. ( 10.1016/j.cobeha.2015.07.003) [DOI] [Google Scholar]
- 136.Kable JW, Glimcher PW. 2009. The neurobiology of decision: consensus and controversy. Neuron 63, 733–745. ( 10.1016/j.neuron.2009.09.003) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 137.Buckholtz JW, Martin JW, Treadway MT, Jan K, Zald DH, Jones O, Marois R. 2015. From blame to punishment: disrupting prefrontal cortex activity reveals norm enforcement mechanisms. Neuron 87, 1369–1380. ( 10.1016/j.neuron.2015.08.023) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 138.Hampshire A, Sharp DJ. 2015. Contrasting network and modular perspectives on inhibitory control. Trends Cogn. Sci. 19, 445–452. ( 10.1016/j.tics.2015.06.006) [DOI] [PubMed] [Google Scholar]
- 139.Eisenreich BR, Akaishi R, Hayden BY. 2017. Control without controllers: toward a distributed neuroscience of executive control. J. Cogn. Neurosci. 29, 1684–1698. ( 10.1162/jocn_a_01139) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 140.Ebitz RB, Hayden BY. 2016. Dorsal anterior cingulate: a Rorschach test for cognitive neuroscience. Nat. Neurosci. 19, P1278–P1279. ( 10.1038/nn.4387) [DOI] [PubMed] [Google Scholar]
- 141.Heilbronner SR, Hayden BY. 2016. Dorsal anterior cingulate cortex: a bottom-up view. Annu. Rev. Neurosci. 39, 149–170. ( 10.1146/annurev-neuro-070815-013952) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 142.Kolling N, Wittmann M, Rushworth MFS. 2014. Multiple neural mechanisms of decision making and their competition under changing risk pressure. Neuron 81, 1190–1202. ( 10.1016/j.neuron.2014.01.033) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 143.Kolling N, Wittmann MK, Behrens TEJ, Boorman ED, Mars RB, Rushworth MFS. 2016. Value, search, persistence and model updating in anterior cingulate cortex. Nat. Neurosci. 19, 1280–1285. ( 10.1038/nn.4382) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 144.Hayden B. 2018. Economic choice: the foraging perspective. Curr. Opin. Behav. Sci. 24, 1–6. ( 10.1016/j.cobeha.2017.12.002) [DOI] [Google Scholar]
- 145.Hayden BY, Moreno-Bote R. 2018. A neuronal theory of sequential economic choice. Brain Neurosci. Adv. 2, 1–15. ( 10.1177/2398212818766675) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 146.Kacelnik A, Vasconcelos M, Monteiro T, Aw J. 2011. Darwin's ‘tug-of-war' vs. starlings' ‘horse-racing’: how adaptations for sequential encounters drive simultaneous choice. Behav. Ecol. Sociobiol. 65, 547–558. ( 10.1007/s00265-010-1101-2) [DOI] [Google Scholar]
- 147.Cisek P, Kalaska JF. 2010. Neural mechanisms for interacting with a world full of action choices. Annu. Rev. Neurosci. 33, 269–298. ( 10.1146/annurev.neuro.051508.135409) [DOI] [PubMed] [Google Scholar]
- 148.Cisek P. 2012. Making decisions through a distributed consensus. Curr. Opin. Neurobiol. 22, 927–936. ( 10.1016/j.conb.2012.05.007) [DOI] [PubMed] [Google Scholar]
- 149.Gibson JJ. 1979. The ecological approach to visual perception. Boston, MA: Houghton Mifflin. [Google Scholar]
- 150.Strait CE, Sleezer BJ, Blanchard TC, Azab H, Castagno MD, Hayden BY. 2016. Neuronal selectivity for spatial positions of offers and choices in five reward regions. J. Neurophysiol. 115, 1098–1111. ( 10.1152/jn.00325.2015) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 151.Yoo SBM, Sleezer BJ, Hayden BY. 2018. Robust encoding of spatial information in orbitofrontal cortex and striatum. J. Cogn. Neurosci. 30, 898–913. ( 10.1162/jocn_a_01259) [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
This article has no additional data.
