Abstract
Evidence for time-dependent calculations about future rewards is scarce in non-human animals. In non-human primates, only great apes are comparable with humans. Still, some species wait for several minutes to obtain a better reward in delayed exchange tasks. Corvids have been shown to match with non-human primates in some time-related tasks. Here, we investigate a delay of gratification in two corvid species, the carrion crow (Corvus corone) and the common raven (Corvus corax), in an exchange task. Results show that corvids success decreases quickly as delay increases, with a maximal delay of up to 320 s (more than 5 min). The decision to wait rests both on the quality of the prospective reward and the time required to obtain it. Corvids also apply tactics (placing the reward on the ground or caching it) that probably alleviate costs of waiting and distract their attention during waiting. These findings contrast previous results on delayed gratification in birds and indicate that some species may perform comparably to primates.
Keywords: cognition, corvids, delay of gratification, exchange task
1. Introduction
Most animals generally neglect long-term benefits for immediate ones, which is often explained by impulsivity [1–4]. Animals appear to value time differently from humans, and this can be expected to affect their capacity to maximize food income or form expectations about future returns in the social domain [1]. Most studies investigating the cognitive determinants involved in the delay of gratification focus on primates owing to their phylogenetic proximity with humans [5,6]. However, accurate maximization of future intakes should be naturally selected in species living in complex social systems like corvids. As food hoarders, time-dependant calculations bear high ecological relevance for them [7–10]. Corvids are used to delaying the consumption of food [11] and to dissociating current from future motivational states [8,10,12]. What is still unclear is how they may integrate the value of a prospective reward according to the time required for obtaining it and if future-oriented decision-making compares with that of other species.
Delay of gratification in animals is generally assessed using classical delay choice tasks [13], where a subject can choose between a small immediate reward and a larger but delayed one. A delay of a few seconds is enough to see animals revert their choice to the immediate option in birds (chicken [14]; pigeons [15,16]) and in monkeys [17–19]. In the delayed exchange task, subjects have to keep food of relatively low value that they can exchange later against one of higher value. Here, primates can sometimes tolerate delays of several minutes according to the value of the expected reward [20–23]. They decide early on whether to wait or not, showing that they anticipate the duration of the delay and whether the reward is worth the cost of waiting. Despite indications that corvids should equate or approach primates' performances in term of impulsivity control, accurate valuation of reward and anticipation of delay duration [10], there is no evidence that this is indeed the case. Here, we investigate this question in two species of corvids, common ravens (Corvus corax) and carrion crows (Corvus corone corone) using a procedure identical to the one used in primates [20]: subjects are first trained to exchange, then they are given a food item of low value that they can choose to keep or to exchange for a food item of higher quality at the end of a given waiting period. We manipulate two core parameters: (i) the time birds must wait to exchange and (ii) the quality of the food reward obtained (ranging from preferred to highly preferred items). We predict that, similar to primates, birds should exchange more often at short delays and/or for highly preferred food. Additionally, they should give up waiting earlier than expected by chance if the value of the expected reward is not worth waiting for.
2. Material and methods
The study involves six crows and four ravens held at the Konrad Lorenz Forschungstelle (KLF) in Austria and two ravens tested at Edinburgh Zoo, RZSS, UK. Individuals' species, age, sex, rearing experience and individual food preferences are described in the electronic supplementary material. All birds were first trained to exchange one token for a food reward (see electronic supplementary material, tables S1 and S2). For testing, subjects are voluntarily separated in a familiar compartment. The experimenter stands in front of the cage and gives an initial piece of food to the individual. The experimenter keeps the giving hand closed into a fist while showing in the other hand the exchange reward, of higher quality than the initial item. The reward remains visible during the entire waiting period. After this period elapsed, the experimenter opens the fist presenting the palm up where the subject can return the initial food. If it does so, it receives in exchange the reward. If subjects eat the initial food or give it back too early, the trial ends. Testing is run in a succession of stages corresponding each to a specific waiting period. From one stage to the next, the waiting period increases (starting with 2 s, then 5, 20, 40, 80, 160, 320 and 640 s). Each stage composes of six sessions of eight trials each (electronic supplementary material). Three possible types of reward (low-, medium- and high-quality) are presented 16 times each per stage. Subjects who succeed in waiting at least once at a given stage are tested in the following one.
3. Results
As predicted, the number of birds exchanging the initial food for a better quality food as well as the proportion of their successful exchanges gradually decreases as the delay increases (figure 1). Over 40 s, birds succeed in less than 50 per cent of the trials. The maximum delay accepted in this task is 320 s, at which two crows are still exchanging at low rates. No significant difference between species is found when comparing the longest waiting time sustained at least once by each subject of the two species (Mann–Whitney test, U = 27; p = 0.17, Ncrows = 6, Nravens = 6). Interestingly, birds can decide early in a trial whether to wait or not. Early renouncement can occur both immediately after and immediately before a success and is not explained by an extinction of the waiting behaviour nor relevant to the hypothesis of a single early attempts followed by multiple renouncement in a given session (figure 2).
Nine subjects renounce waiting significantly earlier than predicted by chance, i.e. in the first seconds rather than randomly in the course of a trial (see electronic supplementary material, figure S1 and table S3). There is also a non-significant trend to give up earlier for the least preferred reward compared with the most preferred one (Wilcoxon, T+ = 11; n = 4; p = 0.06; in birds giving up earlier for all food qualities). Irrespective of the time to wait, the birds exchange the initial item more frequently when the offered reward is highly preferred (Friedman test, n = 12; d.f. = 2, p = 0.003).
When not exchanging, birds mainly eat the initial food (63.6% of cases), attempt to exchange it too early (19.7%), refuse to pick up the initial item (1.6%) or fail to give it back after the waiting time elapsed (15.1%). Those birds waiting for 20 s or longer routinely drop the food, i.e. placing it on the ground, and/or caching it in nearby crevices, while they visually check or cache repeatedly (see the electronic supplementary material and videos). Successful exchanges at the longest waiting periods (greater than 160 s) are all characterized by the use of placing or a combination of placing and caching.
4. Discussion
Our findings show that two corvid species are capable of controlling their immediate impulse to eat in order to gain a more preferred item in near future (waiting not only for seconds but also for minutes), with a maximal waiting time of up to 5 min. This performance deserves attention considering that previous studies on birds revealed hardly any tolerance to delays (range of few seconds [14–16,24]). However, to our knowledge, this study is also the first report of an exchange task being applied to birds.
The corvids' propensity to exchange low- for high-quality food is affected by both the value of the reward and the time required in obtaining it. This indicates that they integrate the expected reward value and associated time cost when making their decision. The high frequency of eating errors, and the fact that no improvement is observed over a stage confirms that waiting is indeed costly and the motivation to obtain the reward was not strong enough. Giving up earlier than predicted at delays where birds still succeed indicates that they understand something of the duration involved and judge the exchange not worth it. As with impulsivity control and reward value effect, crows and ravens may compare to primates in this respect [25].
In terms of tolerance to long delay, the corvids' maximal response is also comparable to those of monkeys tested in this set-up. Capuchin monkeys (Cebus apella), for instance, can wait up to a minute to exchange low-quality against high-quality food [20] although monkeys may wait longer than corvids when allowed to nibble the initial food. Interestingly, birds exchanging at long delays start to place the initial item on the ground and/or cache it to retrieve it later. These behaviours probably alleviate the cost of waiting: not having to hold the food distracts the bird's attention from it. Distractive strategies have been described in delay of gratification tasks in chimpanzees (Pan troglodytes) [25]. However, letting go of the food and keeping it away from self has yet not been observed in any of the primate species tested with exchange tasks; it certainly improved success rate in the present study.
In humans, children who exert the most patience are also those who attain higher socio-professional positions as adults [5]. It is not known whether good skills at time-related calculation are also correlated with social success in animal societies. Considering the first similarities detected here in performances between social species like corvids and primates, it is worth wondering how early in evolution time-dependent sensitivity might have arisen in animals despite later divergences in the organization of brain structures and tissues [26]. Such sensitivity certainly bears a high ecological relevance in food hoarding and food pilfering species like corvids and could have been selected for specifically. An extensive investigation of other birds and mammal species may bring fresh and much needed insights to this question.
Acknowledgements
Training and testing comply with Association for the Study of Animal Behaviour guidelines for ethical conduct of research with animals.
The project was funded by Y366-B17 (FWF), I105-G11 (COCOR, ESF-EUROCORES framework TECT), INCORE (EU, FP6) and by the Agence Nationale de la Recherche (ANR-08-BLAN-0042-01). We acknowledge ongoing support from RZSS and from the ‘Verein der Förderer’, the Herzog von Cumberland game park and Herzog von Cumberland Stiftung.
References
- 1.Stevens J. R., Hauser M. D. 2005. Cooperative brains: psychological constraints on the evolution of altruism. In From monkey brain to human brain (eds Dehaene S., Duhamel J. R., Rizolatto G., Hauser M. D.), pp. 159–187 Cambridge, MA: MIT Press [Google Scholar]
- 2.Kacelnik A. 2003. The evolution of patience. In Time and decision economic and psychological perspectives on intertemporal choice (eds Loewenstein G., Read D., Baumeister R. F.), pp. 115–138 New York, NY: Russell Sage Foundation [Google Scholar]
- 3.Stephens D. W., Kerr B., Fernandez-Juricic E. 2004. Impulsiveness without discounting: the ecological rationality hypothesis. Proc. R. Soc. Lond. B 271, 2459–2465 10.1098/rspb.2004.2871 (doi:10.1098/rspb.2004.2871) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Silberberg A., Widholm J. J., Bresler D., Fujita K., Anderson J. 1998. Natural choice in nonhuman primates. J. Exp. Psychol. Anim. Behav. Process. 24, 215–228 10.1037/0097-7403.24.2.215 (doi:10.1037/0097-7403.24.2.215) [DOI] [PubMed] [Google Scholar]
- 5.Mischel W., Underwood B. 1974. Instrumental ideation in delay of gratification. Child Dev. 45, 1083–1088 10.2307/1128098 (doi:10.2307/1128098) [DOI] [PubMed] [Google Scholar]
- 6.Hayden B. Y., Platt M. L. 2007. Animal cognition: great apes wait for grapes. Curr. Biol. 17, R922. 10.1016/j.cub.2007.08.061 (doi:10.1016/j.cub.2007.08.061) [DOI] [PubMed] [Google Scholar]
- 7.Bugnyar T., Kotrschal K. 2002. Observational learning and the raiding of food caches in ravens, Corvus corax: is it ‘tactical’ deception? Anim. Behav. 64, 185–195 10.1006/anbe.2002.3056 (doi:10.1006/anbe.2002.3056) [DOI] [Google Scholar]
- 8.Clayton N. S., Dickinson A. 1998. Episodic-like memory during chace recovery by scrub jays. Nature 395, 272–274 10.1038/26216 (doi:10.1038/26216) [DOI] [PubMed] [Google Scholar]
- 9.Emery N. J., Clayton N. S. 2001. Effects of experience and social context on prospective caching strategies by scrub jays. Nature 414, 443–446 10.1038/35106560 (doi:10.1038/35106560) [DOI] [PubMed] [Google Scholar]
- 10.Raby C. R., Alexis D. M., Dickinson A., Clayton N. 2007. Planning for the future by western scrub-jays. Nature 445, 919–921 10.1038/nature05575 (doi:10.1038/nature05575) [DOI] [PubMed] [Google Scholar]
- 11.Vander Wall S. B. 1991. Mechanisms of cache recovery by yellow pine chipmunks. Anim. Behav. 41, 851–863 10.1016/S0003-3472(05)80352-5 (doi:10.1016/S0003-3472(05)80352-5) [DOI] [Google Scholar]
- 12.Correia S. P. C., Dickinson A., Clayton N. S. 2007. Western scrub-jays anticipate future needs independently of their current motivational state. Curr. Biol. 17, 1–6 10.1016/j.cub.2007.03.063 (doi:10.1016/j.cub.2007.03.063) [DOI] [PubMed] [Google Scholar]
- 13.Rosati A. G., Stevens J. R., Hare B., Hauser M. D. 2007. The evolutionary origins of human patience: temporal preferences in chimpanzees, bonobos and human adults. Curr. Biol. 17, 1663–1668 10.1016/j.cub.2007.08.033 (doi:10.1016/j.cub.2007.08.033) [DOI] [PubMed] [Google Scholar]
- 14.Abeyesinghe S. M., Nicol C. J., Hartnell S. J., Wathes C. M. 2005. Can domestic fowl, Gallus gallus domesticus, show self-control. Anim. Behav. 70, 1–11 10.1016/j.anbehav.2004.10.011 (doi:10.1016/j.anbehav.2004.10.011) [DOI] [Google Scholar]
- 15.Mazur J. E. 1987. An adjusting procedure for studying delayed rein-forcement: the effects of delay and intervening events on reinforcement value. In Quantitative analyses of behavior (eds Commons M. L., Mazur J. E., Nevin J. A., Rachlin H.). pp. 55–73 Hillsdale, NJ: Erlbaum [Google Scholar]
- 16.Green L., Myerson J., Holt D. D., Slevin J. R., Estle S. J. 2004. Discounting of delayed food rewards in pigeons and rats: is there a magnitude effect? J. Exp. Anal. Behav. 81, 39–50 10.1901/jeab.2004.81-39 (doi:10.1901/jeab.2004.81-39) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Tobin H., Logue A. W., Chelonis J. J., Ackerman K. T., May J. G. 1996. Self-control in the monkey Macaca fascicularis. Anim. Learn. Behav. 24, 168–174 10.3758/BF03198964 (doi:10.3758/BF03198964) [DOI] [Google Scholar]
- 18.Szalda-Petree A. D., Craft B. B., Martin L. M., Deditius-Island H. K. 2004. Self-control in rhesus macaques (Macaca mulatta): controlling for differential stimulus exposure. Percept. Motor Skills 98, 141–146 [DOI] [PubMed] [Google Scholar]
- 19.Stevens J. R., Hallinan E. V., Hauser M. D. 2005. The ecology and evolution of patience in two New World monkeys. Biol. Lett. 1, 223–226 10.1098/rsbl.2004.0285 (doi:10.1098/rsbl.2004.0285) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Ramseyer A., Pelé M., Dufour V., Chauvin C., Thierry B. 2006. Accepting loss: the temporal limits of reciprocity in brown capuchin monkeys. Proc. R. Soc. B 273, 179–184 10.1098/rspb.2005.3300 (doi:10.1098/rspb.2005.3300) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Dufour V., Pelé M., Sterck E. H. M., Thierry B. 2007. Chimpanzee (Pan troglodytes) anticipation of food return: coping with waiting time in an exchange task. J. Comp. Psychol. 121, 145–155 10.1037/0735-7036.121.2.145 (doi:10.1037/0735-7036.121.2.145) [DOI] [PubMed] [Google Scholar]
- 22.Pelé M., Dufour V., Micheletta J., Thierry B. 2010. Long-tailed macaques display unexpected waiting abilities in exchange tasks. Anim. Cogn. 13, 263–271 10.1007/s10071-009-0264-6 (doi:10.1007/s10071-009-0264-6) [DOI] [PubMed] [Google Scholar]
- 23.Pelé M., Micheletta J., Uhlrich P., Thierry B., Dufour V. 2011. Delay maintenance in tonkean macaques (Macaca tonkeana) and brown capuchin monkeys (Cebus apella). Int. J. Primatol. 32, 149–166 10.1007/s10764-010-9446-y (doi:10.1007/s10764-010-9446-y) [DOI] [Google Scholar]
- 24.Vick S. J., Bovet D., Anderson J. R. 2010. How do African grey parrots (Psittacus erithacus) perform on a delay of gratification task? Anim. Cogn. 13, 351–358 10.1007/s10071-009-0284-2 (doi:10.1007/s10071-009-0284-2) [DOI] [PubMed] [Google Scholar]
- 25.Evans T. A., Beran M. J. 2007. Chimpanzees use self-distraction to cope with impulsivity. Biol. Lett. 3, 599–602 10.1098/rsbl.2007.0399 (doi:10.1098/rsbl.2007.0399) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Emery N. J., Clayton N. 2004. The mentality of crows: convergent evolution of intelligence in corvids and apes. Science 306, 1903–1907 10.1126/science.1098410 (doi:10.1126/science.1098410) [DOI] [PubMed] [Google Scholar]