Skip to main content
PMC home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 2003 Mar;79(2):207–218. doi: 10.1901/jeab.2003.79-207

Determinants of pigeons' choices in token-based self-control procedures.

Timothy D Hackenberg 1, Manish Vaidya 1
PMCID: PMC1284930  PMID: 12822687

Abstract

Four pigeons were exposed to a token-based self-control procedure with stimulus lights serving as token reinforcers. Smaller-reinforcer choices produced one token immediately; larger-reinforcer choices produced three tokens following a delay. Each token could be exchanged for 2-s access to food during a signaled exchange period each trial. The main variables of interest were the exchange delays (delays from the choice to the exchange stimulus) and the food delays (also timed from the choice), which were varied separately and together across blocks of sessions. When exchange delays and food delays were shorter following smaller-reinforcer choices, strong preference for the smaller reinforcer was observed. When exchange delays and food delays were equal for both options, strong preference for the larger reinforcer was observed. When food delays were equal for both options but exchange delays were shorter for smaller-reinforcer choices, preference for the larger reinforcer generally was less extreme than under conditions in which both exchange and food delays were equal. When exchange delays were equal for both options but food delays were shorter for smaller-reinforcer choices, preference for the smaller reinforcer generally was less extreme than under conditions in which both exchange and food delays favored smaller-reinforcer choices. On the whole, the results were consistent with prior research on token-based self-control procedures in showing that choices are governed by reinforcer immediacy when exchange and food delays are unequal and by reinforcer amount when exchange and food delays are equal. Further, by decoupling the exchange delays from food delays, the results tentatively support a role for the exchange stimulus as a conditioned reinforcer.

Full Text

The Full Text of this article is available as a PDF (281.4 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Flora S. R., Pavlik W. B. Human self-control and the density of reinforcement. J Exp Anal Behav. 1992 Mar;57(2):201–208. doi: 10.1901/jeab.1992.57-201. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Foster T. A., Hackenberg T. D., Vaidya M. Second-order schedules of token reinforcement with pigeons: effects of fixed- and variable-ratio exchange schedules. J Exp Anal Behav. 2001 Sep;76(2):159–178. doi: 10.1901/jeab.2001.76-159. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Grace R. C. Independence of reinforcement delay and magnitude in concurrent chains. J Exp Anal Behav. 1995 May;63(3):255–276. doi: 10.1901/jeab.1995.63-255. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Green L., Snyderman M. Choice between rewards differing in amount and delay: Toward a choice model of self control. J Exp Anal Behav. 1980 Sep;34(2):135–147. doi: 10.1901/jeab.1980.34-135. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Hyten C., Madden G. J., Field D. P. Exchange delays and impulsive choice in adult humans. J Exp Anal Behav. 1994 Sep;62(2):225–233. doi: 10.1901/jeab.1994.62-225. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Ito M., Asaki K. Choice behavior of rats in a concurrent-chains schedule: Amount and delay of reinforcement. J Exp Anal Behav. 1982 May;37(3):383–392. doi: 10.1901/jeab.1982.37-383. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Jackson K., Hackenberg T. D. Token reinforcement, choice, and self-control in pigeons. J Exp Anal Behav. 1996 Jul;66(1):29–49. doi: 10.1901/jeab.1996.66-29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. KELLEHER R. T., GOLLUB L. R. A review of positive conditioned reinforcement. J Exp Anal Behav. 1962 Oct;5:543–597. doi: 10.1901/jeab.1962.5-s543. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Logue A. W., Peña-Correal T. E., Rodriguez M. L., Kabela E. Self-control in adult humans: variation in positive reinforcer amount and delay. J Exp Anal Behav. 1986 Sep;46(2):159–173. doi: 10.1901/jeab.1986.46-159. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Logue A. W., Rodriguez M. L., Peña-Correal T. E., Mauro B. C. Choice in a self-control paradigm: Quantification of experience-based differences. J Exp Anal Behav. 1984 Jan;41(1):53–67. doi: 10.1901/jeab.1984.41-53. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Malagodi E. F., Webbe F. M., Waddell T. R. Second-order schedules of token reinforcement: effects of varying the schedule of food presentation. J Exp Anal Behav. 1975 Sep;24(2):173–181. doi: 10.1901/jeab.1975.24-173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Mazur J. E. Conditioned reinforcement and choice with delayed and uncertain primary reinforcers. J Exp Anal Behav. 1995 Mar;63(2):139–150. doi: 10.1901/jeab.1995.63-139. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Snyderman M. Delay and amount of reward in a concurrent chain. J Exp Anal Behav. 1983 May;39(3):437–447. doi: 10.1901/jeab.1983.39-437. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Webbe F. M., Malagodi E. F. Second-order schedules of token reinforcement: comparisons of performance under fixed-ratio and variable-ratio exchange schedules. J Exp Anal Behav. 1978 Sep;30(2):219–224. doi: 10.1901/jeab.1978.30-219. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES