Skip to main content
PMC home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 2001 Nov;76(3):321–338. doi: 10.1901/jeab.2001.76-321

Determinants of reinforcer accumulation during an operant task.

J M McFarland 1, K A Lattal 1
PMCID: PMC1284841  PMID: 11768714

Abstract

Responses by rats on an earn lever made available food pellets that were delivered to a food cup by responses on a second, collect, lever. The rats could either collect and immediately consume or accumulate (defined as the percentage of multiple earn responses and as the number of pellets earned before a collect response) earned pellets. In Experiment 1, accumulation varied as a function of variations in the earn or collect response requirements and whether the earn and collect levers were proximal (31 cm) or distal (248 cm) to one another. Some accumulation occurred under all but one of the conditions, but generally was higher when the earn and collect levers were distal to one another, particularly when the earn response requirement was fixed-ratio (FR) 1. In Experiment 2, the contributions of responses and time to accumulation were assessed by comparing an FR 20 earn response requirement to a condition in which only a single earn response was required at the end of a time interval nominally yoked to the FR interval. When 248 cm separated the earn and collect levers, accumulation was always greater in the FR condition, and it was not systematically related to reinforcement rate. In Experiment 3, increasing the earn response requirement with a progressive-ratio schedule that reset only with a collect response increased the likelihood of accumulation when the collect and earn levers were 248 cm apart, even though such accumulation increased the next earn response requirement. Reinforcer accumulation is an understudied dimension of operant behavior that relates to the analysis of such phenomena as hoarding and self-control, in that they too involve accumulating versus immediately collecting or consuming reinforcers.

Full Text

The Full Text of this article is available as a PDF (200.4 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. BREMNER F. J., TROWILL J. A. A combined manipulandum-reinforcement arrangement. J Exp Anal Behav. 1962 Jul;5:339–340. doi: 10.1901/jeab.1962.5-339. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Baum W. M. Choice, changeover, and travel. J Exp Anal Behav. 1982 Jul;38(1):35–49. doi: 10.1901/jeab.1982.38-35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Baum W. M. On two types of deviation from the matching law: bias and undermatching. J Exp Anal Behav. 1974 Jul;22(1):231–242. doi: 10.1901/jeab.1974.22-231. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Cole M. R. Operant hoarding: a new paradigm for the study of self-control. J Exp Anal Behav. 1990 Mar;53(2):247–261. doi: 10.1901/jeab.1990.53-247. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Davidson A. B., Davis D. J., Cook L. A rapid automatic technique for generating operant key-press behavior in rats. J Exp Anal Behav. 1971 Jan;15(1):123–127. doi: 10.1901/jeab.1971.15-123. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Felton M., Lyon D. O. The post-reinforcement pause. J Exp Anal Behav. 1966 Mar;9(2):131–134. doi: 10.1901/jeab.1966.9-131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Jackson K., Hackenberg T. D. Token reinforcement, choice, and self-control in pigeons. J Exp Anal Behav. 1996 Jul;66(1):29–49. doi: 10.1901/jeab.1996.66-29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Lattal K. A., Abreu-Rodrigues J. Response-independent events in the behavior stream. J Exp Anal Behav. 1997 Nov;68(3):375–398. doi: 10.1901/jeab.1997.68-375. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Lattal K. A., Gleeson S. Response acquisition with delayed reinforcement. J Exp Psychol Anim Behav Process. 1990 Jan;16(1):27–39. [PubMed] [Google Scholar]
  10. Lattal K. A., Williams A. M. Body weight and response acquisition with delayed reinforcement. J Exp Anal Behav. 1997 Jan;67(1):131–143. doi: 10.1901/jeab.1997.67-131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Matthews B. A., Shimoff E., Catania A. C., Sagvolden T. Uninstructed human responding: sensitivity to ratio and interval contingencies. J Exp Anal Behav. 1977 May;27(3):453–467. doi: 10.1901/jeab.1977.27-453. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Mazur J. E. Estimation of indifference points with an adjusting-delay procedure. J Exp Anal Behav. 1988 Jan;49(1):37–47. doi: 10.1901/jeab.1988.49-37. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Miller L. K. Some punishing effects of response-force. J Exp Anal Behav. 1970 Mar;13(2):215–220. doi: 10.1901/jeab.1970.13-215. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Rachlin H., Green L. Commitment, choice and self-control. J Exp Anal Behav. 1972 Jan;17(1):15–22. doi: 10.1901/jeab.1972.17-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Schaal D. W., Shahan T. A., Kovera C. A., Reilly M. P. Mechanisms underlying the effects of unsignaled delayed reinforcement on key pecking of pigeons under variable-interval schedules. J Exp Anal Behav. 1998 Mar;69(2):103–122. doi: 10.1901/jeab.1998.69-103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Wanchisen B. A., Tatham T. A., Hineline P. N. Pigeons' choices in situations of diminishing returns: fixed- versus progressive-ratio schedules. J Exp Anal Behav. 1988 Nov;50(3):375–394. doi: 10.1901/jeab.1988.50-375. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES