Skip to main content
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1986 Jul;46(1):67–77. doi: 10.1901/jeab.1986.46-67

Choice between single and multiple delayed reinforcers.

J E Mazur
PMCID: PMC1348257  PMID: 3746189

Abstract

Pigeons chose between alternatives that differed in the number of reinforcers and in the delay to each reinforcer. A peck on a red key produced the same consequences on every trial within a condition, but between conditions the number of reinforcers varied from one to three and the reinforcer delays varied between 5 s and 30 s. A peck on a green key produced a delay of adjustable duration and then a single reinforcer. The green-key delay was increased or decreased many times per session, depending on a subject's previous choices, which permitted estimation of an indifference point, or a delay at which a subject chose each alternative about equally often. The indifference points decreased systematically with more red-key reinforcers and with shorter red-key delays. The results did not support the suggestion of Moore (1979) that multiple delayed reinforcers have no effect on preference unless they are closely grouped. The results were well described in quantitative detail by a simple model stating that each of a series of reinforcers increases preference, but that a reinforcer's effect is inversely related to its delay. The success of this model, which considers only delay of reinforcement, suggested that the overall rate of reinforcement for each alternative had no effect on choice between those alternatives.

Full text

PDF
68

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Baum W. M. The correlation-based law of effect. J Exp Anal Behav. 1973 Jul;20(1):137–153. doi: 10.1901/jeab.1973.20-137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. CATANIA A. C. Concurrent performances: a baseline for the study of reinforcement magnitude. J Exp Anal Behav. 1963 Apr;6:299–300. doi: 10.1901/jeab.1963.6-299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Davison M. C. Preference for mixed-interval versus fixed-interval schedules. J Exp Anal Behav. 1969 Mar;12(2):247–252. doi: 10.1901/jeab.1969.12-247. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Duncan B., Fantino E. Choice for periodic schedules of reinforcement. J Exp Anal Behav. 1970 Jul;14(1):73–86. doi: 10.1901/jeab.1970.14-73. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Fantino E. Choice and rate of reinforcement. J Exp Anal Behav. 1969 Sep;12(5):723–730. doi: 10.1901/jeab.1969.12-723. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Fantino E., Herrnstein R. J. Secondary reinforcement and number of primary reinforcements. J Exp Anal Behav. 1968 Jan;11(1):9–14. doi: 10.1901/jeab.1968.11-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Killeen P. On the measurement of reinforcement frequency in the study of preference. J Exp Anal Behav. 1968 May;11(3):263–269. doi: 10.1901/jeab.1968.11-263. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Mazur J. E., Snyderman M., Coe D. Influences of delay and rate of reinforcement on discrete-trial choice. J Exp Psychol Anim Behav Process. 1985 Oct;11(4):565–575. [PubMed] [Google Scholar]
  10. Moore J. Choice and multiple reinforcers. J Exp Anal Behav. 1982 Jan;37(1):115–122. doi: 10.1901/jeab.1982.37-115. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Moore J. Choice and number of reinforcers. J Exp Anal Behav. 1979 Jul;32(1):51–63. doi: 10.1901/jeab.1979.32-51. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Poniewaz W. R. Effects on preference of reinforcement delay, number of reinforcers, and terminal-link duration. J Exp Anal Behav. 1984 Sep;42(2):255–266. doi: 10.1901/jeab.1984.42-255. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Shull R. L., Spear D. J., Bryson A. E. Delay or rate of food delivery as determiners of response rate. J Exp Anal Behav. 1981 Mar;35(2):129–143. doi: 10.1901/jeab.1981.35-129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Squires N., Fantino E. A model for choice in simple concurrent and concurrent-chains schedules. J Exp Anal Behav. 1971 Jan;15(1):27–38. doi: 10.1901/jeab.1971.15-27. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES