Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1978 Sep;30(2):219–224. doi: 10.1901/jeab.1978.30-219

Second-order schedules of token reinforcement: comparisons of performance under fixed-ratio and variable-ratio exchange schedules1

Frank M Webbe, E F Malagodi
PMCID: PMC1332718  PMID: 16812101

Abstract

Rats' lever pressing produced tokens according to a 20-response fixed-ratio schedule. Sequences of token schedules were reinforced under a second-order schedule by presentation of periods when tokens could be exchanged for food pellets. When the exchange period schedule was a six-response fixed ratio, patterns of completing the component token schedules were bivalued, with relatively long and frequent pauses marking the initiation of each new sequence. Altering the exchange period schedule to a six-response variable ratio resulted in sharp reductions in the frequency and duration of these initial pauses, and increases in overall rates of lever pressing. These results are comparable to those ordinarily obtained under simple fixed-ratio and variable-ratio schedules.

Keywords: second-order schedules, token reinforcement, variable-ratio schedules, fixed-ratio schedules, lever pressing, rats

Full text

PDF
219

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Blough D. S. Interresponse time as a function of continuous variables: a new method and some data. J Exp Anal Behav. 1963 Apr;6(2):237–246. doi: 10.1901/jeab.1963.6-237. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Byrd L. D., Marr M. J. Relations between patterns of responding and the presentation of stimuli under second-order schedules. J Exp Anal Behav. 1969 Sep;12(5):713–722. doi: 10.1901/jeab.1969.12-713. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Davison M. C. Successive interresponse times in fixed-ratio and second-order fixed-ratio performance. J Exp Anal Behav. 1969 May;12(3):385–389. doi: 10.1901/jeab.1969.12-385. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. FINDLEY J. D. An experimental outline for building and exploring multi-operant behavior repertoires. J Exp Anal Behav. 1962 Jan;5(Suppl):113–166. doi: 10.1901/jeab.1962.5-s113. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. FLESHLER M., HOFFMAN H. S. A progression for generating variable-interval schedules. J Exp Anal Behav. 1962 Oct;5:529–530. doi: 10.1901/jeab.1962.5-529. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Felton M., Lyon D. O. The post-reinforcement pause. J Exp Anal Behav. 1966 Mar;9(2):131–134. doi: 10.1901/jeab.1966.9-131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Gott C. T., Weiss B. The development of fixed-ratio performance under the influence of ribonucleic acid. J Exp Anal Behav. 1972 Nov;18(3):481–497. doi: 10.1901/jeab.1972.18-481. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. KELLEHER R. T. Conditioned reinforcement in chimpanzees. J Comp Physiol Psychol. 1957 Dec;50(6):571–575. doi: 10.1037/h0044327. [DOI] [PubMed] [Google Scholar]
  9. KINTSCH W. FREQUENCY DISTRIBUTION OF INTERRESPONSE TIMES DURING VI AND VR REINFORCEMENT. J Exp Anal Behav. 1965 Sep;8:347–352. doi: 10.1901/jeab.1965.8-347. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Kelleher R. T. Conditioned reinforcement in second-order schedules. J Exp Anal Behav. 1966 Sep;9(5):475–485. doi: 10.1901/jeab.1966.9-475. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Kelleher R. T. Fixed-ratio schedules of conditioned reinforcement with chimpanzees. J Exp Anal Behav. 1958 Aug;1(3):281–289. doi: 10.1901/jeab.1958.1-281. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Malagodi E. F. Acquistion of the token-reward habit in the rat. Psychol Rep. 1967 Jun;20(3 Suppl):1335–1342. doi: 10.2466/pr0.1967.20.3c.1335. [DOI] [PubMed] [Google Scholar]
  13. Malagodi E. F., Webbe F. M., Waddell T. R. Second-order schedules of token reinforcement: effects of varying the schedule of food presentation. J Exp Anal Behav. 1975 Sep;24(2):173–181. doi: 10.1901/jeab.1975.24-173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Marr M. J. Sequence schedules of reinforcement. J Exp Anal Behav. 1971 Jan;15(1):41–48. doi: 10.1901/jeab.1971.15-41. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Schneider B. A. A two-state analysis of fixed-interval responding in the pigeon. J Exp Anal Behav. 1969 Sep;12(5):677–687. doi: 10.1901/jeab.1969.12-677. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Shull R. L., Guilkey M., Witty W. Changing the response unit from a single peck to a fixed number of pecks in fixed-interval schedules. J Exp Anal Behav. 1972 Mar;17(2):193–200. doi: 10.1901/jeab.1972.17-193. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES