Skip to main content
PMC home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 2004 Jul;82(1):21–35. doi: 10.1901/jeab.2004.82-21

Within-session delay-of-reinforcement gradients.

Mark P Reilly 1, Kennon A Lattal 1
PMCID: PMC1284989  PMID: 15484869

Abstract

Within-session delay-of-reinforcement gradients were generated with pigeons by progressively increasing delays to reinforcement within each session. In Experiment 1, the effects of imposing progressive delays on variable-interval and fixed-interval schedules were investigated while controlling for simultaneous decreases in reinforcer rate across the session via a within-subject yoked-control procedure. Rate of key pecking decreased as a negatively decelerated function of delay of reinforcement within a session. These rate decreases were greater than those during a yoked-interval session in which the rate of immediate reinforcement decreased at the same rate as it did under the progressive-delay procedure. In Experiment 2, delay-of-reinforcement gradients were shallower when the progressive delay intervals were signaled by a blackout than when they were unsignaled. The delay gradients obtained in each experiment were similar to those generated under conditions in which different delays of reinforcement are imposed across blocks of sessions. The present procedure offers a technique for rapidly generating delay-of-reinforcement gradients that might serve as baselines for assessing the effects of other behavioral and pharmacological variables.

Full Text

The Full Text of this article is available as a PDF (186.9 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. AZZI R., FIX D. S., KELLER F. S., ROCHAESILVA M. I. EXTEROCEPTIVE CONTROL OF RESPONSE UNDER DELAYED REINFORCEMENT. J Exp Anal Behav. 1964 Mar;7:159–162. doi: 10.1901/jeab.1964.7-159. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. DEWS P. B. Free-operant behavior under conditions of delayed reinforcement. I. CRF-type schedules. J Exp Anal Behav. 1960 Jul;3:221–234. doi: 10.1901/jeab.1960.3-221. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Depoortere R. Y., Li D. H., Lane J. D., Emmett-Oglesby M. W. Parameters of self-administration of cocaine in rats under a progressive-ratio schedule. Pharmacol Biochem Behav. 1993 Jul;45(3):539–548. doi: 10.1016/0091-3057(93)90503-l. [DOI] [PubMed] [Google Scholar]
  4. FLESHLER M., HOFFMAN H. S. A progression for generating variable-interval schedules. J Exp Anal Behav. 1962 Oct;5:529–530. doi: 10.1901/jeab.1962.5-529. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. HODOS W., KALMAN G. Effects of increment size and reinforcer volume on progressive ratio performance. J Exp Anal Behav. 1963 Jul;6:387–392. doi: 10.1901/jeab.1963.6-387. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. HODOS W. Progressive ratio as a measure of reward strength. Science. 1961 Sep 29;134(3483):943–944. doi: 10.1126/science.134.3483.943. [DOI] [PubMed] [Google Scholar]
  7. Lattal K. A. Signal functions in delayed reinforcement. J Exp Anal Behav. 1984 Sep;42(2):239–253. doi: 10.1901/jeab.1984.42-239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Lattal K., Reilly M., Kohn J. Response persistence under ratio and interval reinforcement schedules. J Exp Anal Behav. 1998 Sep;70(2):165–183. doi: 10.1901/jeab.1998.70-165. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Nevin J. A., Mandell C., Atak J. R. The analysis of behavioral momentum. J Exp Anal Behav. 1983 Jan;39(1):49–59. doi: 10.1901/jeab.1983.39-49. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Nevin J. A. Response strength in multiple schedules. J Exp Anal Behav. 1974 May;21(3):389–408. doi: 10.1901/jeab.1974.21-389. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Richards R. W. A comparison of signaled and unsignaled delay of reinforcement. J Exp Anal Behav. 1981 Mar;35(2):145–152. doi: 10.1901/jeab.1981.35-145. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Schaal D. W., Branch M. N. Responding of pigeons under variable-interval schedules of signaled-delayed reinforcement: effects of delay-signal duration. J Exp Anal Behav. 1990 Jan;53(1):103–121. doi: 10.1901/jeab.1990.53-103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Schaal D. W., Branch M. N. Responding of pigeons under variable-interval schedules of unsignaled, briefly signaled, and completely signaled delays to reinforcement. J Exp Anal Behav. 1988 Jul;50(1):33–54. doi: 10.1901/jeab.1988.50-33. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Sizemore O. J., Lattal K. A. Dependency, temporal contiguity, and response-independent reinforcement. J Exp Anal Behav. 1977 Jan;27(1):119–125. doi: 10.1901/jeab.1977.27-119. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Sizemore O. J., Lattal K. A. Unsignalled delay of reinforcement in variable-interval schedules. J Exp Anal Behav. 1978 Sep;30(2):169–175. doi: 10.1901/jeab.1978.30-169. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Stretch R., Gerber G. J., Lane E. Cocaine self-injection behaviour under schedules of delayed reinforcement in monkeys. Can J Physiol Pharmacol. 1976 Aug;54(4):632–638. doi: 10.1139/y76-089. [DOI] [PubMed] [Google Scholar]
  17. Williams B. A. The effects of unsignalled delayed reinforcement. J Exp Anal Behav. 1976 Nov;26(3):441–449. doi: 10.1901/jeab.1976.26-441. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES