Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1973 Mar;19(2):311–330. doi: 10.1901/jeab.1973.19-311

Synthetic variable-interval schedules of reinforcement1

Charles P Shimp
PMCID: PMC1334083  PMID: 16811667

Abstract

Three pigeons pecked for food on a synthetic variable-interval schedule of reinforcement that had two independent parts: a variable-interval schedule that arranged a distribution of interreinforcement intervals, and a device that randomly assigned each reinforcement to one of 10 classes of interresponse times. The frequencies of reinforcement for the 10 classes of interresponse times were systematically varied, while the overall frequency of reinforcement was held within a comparatively narrow range. The 10 classes extended either from 0.1 to 0.6 sec in 0.05-sec intervals, or from 1.0 to 6.0 sec in 0.5-sec intervals. In the former case, some control by reinforcement was obtained, but it was weak and no simple relationships were discernible. In the latter case, the relative frequency of an interresponse time was a generally increasing function of its relative frequency of reinforcement, and two simple controlling relationships were found. First, the function relating interresponse times per opportunity to reinforcements per opportunity was, over a restricted range, approximately linear with a slope of unity. Second, when all 10 classes of interresponse times were reinforced equally often, the relative frequency of an interresponse time approximately equalled the relative reciprocal of its length.

Full text

PDF
311

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. ANGER D. The dependence of interresponse times upon the relative reinforcement of different interresponse times. J Exp Psychol. 1956 Sep;52(3):145–161. doi: 10.1037/h0041255. [DOI] [PubMed] [Google Scholar]
  2. Blough D. S. Interresponse time as a function of continuous variables: a new method and some data. J Exp Anal Behav. 1963 Apr;6(2):237–246. doi: 10.1901/jeab.1963.6-237. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Blough D. S. The reinforcement of least-frequent interresponse times. J Exp Anal Behav. 1966 Sep;9(5):581–591. doi: 10.1901/jeab.1966.9-581. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Blough P. M., Blough D. S. The distribution of interresponse times in the pigeon during variable-interval reinforcement. J Exp Anal Behav. 1968 Jan;11(1):23–27. doi: 10.1901/jeab.1968.11-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Catania A. C., Reynolds G. S. A quantitative analysis of the responding maintained by interval schedules of reinforcement. J Exp Anal Behav. 1968 May;11(3 Suppl):327–383. doi: 10.1901/jeab.1968.11-s327. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Chung S. H., Herrnstein R. J. Choice and delay of reinforcement. J Exp Anal Behav. 1967 Jan;10(1):67–74. doi: 10.1901/jeab.1967.10-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. HERRNSTEIN R. J. Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav. 1961 Jul;4:267–272. doi: 10.1901/jeab.1961.4-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Herbert E. W. Two-key concurrent responding: response-reinforcement dependencies and blackouts. J Exp Anal Behav. 1970 Jul;14(1):61–70. doi: 10.1901/jeab.1970.14-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Killeen P. On the measurement of reinforcement frequency in the study of preference. J Exp Anal Behav. 1968 May;11(3):263–269. doi: 10.1901/jeab.1968.11-263. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Lander D. G., Irwin R. J. Multiple schedules: effects of the distribution of reinforcements between component on the distribution of responses between conponents. J Exp Anal Behav. 1968 Sep;11(5):517–524. doi: 10.1901/jeab.1968.11-517. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Moffitt M., Shimp C. P. Two-key concurrent paced variable-interval paced variable-interval schedules of reinforcement. J Exp Anal Behav. 1971 Jul;16(1):39–49. doi: 10.1901/jeab.1971.16-39. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Mueller C. G. Theoretical Relationships Among Some Measures of Conditioning. Proc Natl Acad Sci U S A. 1950 Feb;36(2):123–130. doi: 10.1073/pnas.36.2.123. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. REYNOLDS G. S. On some determinants of choice in pigeons. J Exp Anal Behav. 1963 Jan;6:53–59. doi: 10.1901/jeab.1963.6-53. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Shimp C. P. Magnitude and frequency of reinforcement and frequencies of interresponse times. J Exp Anal Behav. 1968 Sep;11(5):525–535. doi: 10.1901/jeab.1968.11-525. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Shimp C. P. The concurrent reinforcement of two interresponse times: absolute rate of reinforcement. J Exp Anal Behav. 1970 Jan;13(1):1–8. doi: 10.1901/jeab.1970.13-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Shimp C. P. The concurrent reinforcement of two interresponse times: the relative frequency of an interresponse time equals its relative harmonic length. J Exp Anal Behav. 1969 May;12(3):403–411. doi: 10.1901/jeab.1969.12-403. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Shimp C. P. The reinforcement of four interresponse times in a two-alternative situation. J Exp Anal Behav. 1971 Nov;16(3):385–399. doi: 10.1901/jeab.1971.16-385. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Staddon J. E. Spaced responding and choice: a preliminary analysis. J Exp Anal Behav. 1968 Nov;11(6):669–682. doi: 10.1901/jeab.1968.11-669. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Stubbs D. A., Pliskoff S. S. Concurrent responding with fixed relative rate of reinforcement. J Exp Anal Behav. 1969 Nov;12(6):887–895. doi: 10.1901/jeab.1969.12-887. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES