Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1997 May;67(3):337–351. doi: 10.1901/jeab.1997.67-337

Running and responding reinforced by the opportunity to run: effect of reinforcer duration.

T W Belke 1
PMCID: PMC1284610  PMID: 9163938

Abstract

The present study investigated the effect of reinforcer duration on running and on responding reinforced by the opportunity to run. Eleven male Wistar rats responded on levers for the opportunity to run in a running wheel. Opportunities to run were programmed to occur on a tandem fixed-ratio 1 variable-interval 30-s reinforcement schedule. Reinforcer duration varied across conditions from 30 to 120 s. As reinforcer duration increased, the rates of running and lever pressing declined, and latency to lever press increased. The increase in latency to respond was consistent with findings that unconditioned inhibitory aftereffects of reinforcement increase with reinforcer magnitude. The decrease in local lever-pressing rates, however, was inconsistent with the view that response strength increases with the duration of the reinforcer. Response rate varied inversely, not directly, with reinforcer duration. Furthermore, within-session data challenge satiation, fatigue, and response deprivation as determinants of the observed changes in running and responding. In sum, the results point to the need for further research with nonappetitive forms of reinforcement.

Full Text

The Full Text of this article is available as a PDF (471.9 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Allison James. Response deprivation, reinforcement, and economics. J Exp Anal Behav. 1993 Jul;60(1):129–140. doi: 10.1901/jeab.1993.60-129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. CATANIA A. C. Concurrent performances: a baseline for the study of reinforcement magnitude. J Exp Anal Behav. 1963 Apr;6:299–300. doi: 10.1901/jeab.1963.6-299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. FLESHLER M., HOFFMAN H. S. A progression for generating variable-interval schedules. J Exp Anal Behav. 1962 Oct;5:529–530. doi: 10.1901/jeab.1962.5-529. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. GUTTMAN N. Operant conditioning, extinction, and periodic reinforcement in relation to concentration of sucrose used as reinforcing agent. J Exp Psychol. 1953 Oct;46(4):213–224. doi: 10.1037/h0061893. [DOI] [PubMed] [Google Scholar]
  5. HUTT P. J. Rate of bar pressing as a function of quality and quantity of food reward. J Comp Physiol Psychol. 1954 Jun;47(3):235–239. doi: 10.1037/h0059855. [DOI] [PubMed] [Google Scholar]
  6. Harzem P., Lowe C. F., Priddle-Higson P. J. Inhibiting function of reinforcement: magnitude effects on variable-interval schedules. J Exp Anal Behav. 1978 Jul;30(1):1–10. doi: 10.1901/jeab.1978.30-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Iversen I. H. Techniques for establishing schedules with wheel running as reinforcement in rats. J Exp Anal Behav. 1993 Jul;60(1):219–238. doi: 10.1901/jeab.1993.60-219. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. KEESEY R. E., KLING J. W. Amount of reinforcement and free-operant responding. J Exp Anal Behav. 1961 Apr;4:125–132. doi: 10.1901/jeab.1961.4-125. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Lowe C. F., Davey G. C., Harzem P. Effects of reinforcement magnitude on interval and ratio schedules. J Exp Anal Behav. 1974 Nov;22(3):553–560. doi: 10.1901/jeab.1974.22-553. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. PREMACK D., SCHAEFFER R. W., HUNDT A. REINFORCEMENT OF DRINKING BY RUNNING: EFFECT OF FIXED RATIO AND REINFORCEMENT TIME. J Exp Anal Behav. 1964 Jan;7:91–96. doi: 10.1901/jeab.1964.7-91. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Perone M., Courtney K. Fixed-ratio pausing: Joint effects of past reinforcer magnitude and stimuli correlated with upcoming magnitude. J Exp Anal Behav. 1992 Jan;57(1):33–46. doi: 10.1901/jeab.1992.57-33. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Powell R. W. The effect of reinforcement magnitude upon responding under fixed-ratio schedules. J Exp Anal Behav. 1969 Jul;12(4):605–608. doi: 10.1901/jeab.1969.12-605. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Priddle-Higson P. J., Lowe C. F., Harzem P. Aftereffects of reinforcement on variable-ratio schedules. J Exp Anal Behav. 1976 May;25(3):347–354. doi: 10.1901/jeab.1976.25-347. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Reed P., Wright J. E. Effects of magnitude of food reinforcement on free-operant response rates. J Exp Anal Behav. 1988 Jan;49(1):75–85. doi: 10.1901/jeab.1988.49-75. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. STEBBINS W. C., MEAD P. B., MARTIN J. M. The relation of amount of reinforcement to performance under a fixed-in-terval schedule. J Exp Anal Behav. 1959 Oct;2:351–355. doi: 10.1901/jeab.1959.2-351. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Staddon J. E. Effect of reinforcement duration on fixed-interval responding. J Exp Anal Behav. 1970 Jan;13(1):9–11. doi: 10.1901/jeab.1970.13-9. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES