Skip to main content
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1979 Jan;31(1):41–51. doi: 10.1901/jeab.1979.31-41

A Markov model description of changeover probabilities on concurrent variable-interval schedules1

Gene M Heyman
PMCID: PMC1332788  PMID: 16812122

Abstract

The primary data were peck-by-peck sequential records of four pigeons responding on several different concurrent variable-interval schedules. According to the hypothesis that the subject chooses the alternative with the highest probability of reinforcement at the moment, response-by-response performance in concurrent schedules should show sequential dependencies. However, such dependencies were not found, and it was possible to describe molecular-level performance with simple Markov chain models. The Markov model description implies that the momentary changeover probabilities were proportional to the overall relative reinforcement frequencies, and that changeover probabilities did not change as a function of previous responding. A second finding was that although a changeover-delay procedure was omitted, relative response frequencies closely approximated relative reinforcement frequencies.

Keywords: concurrent variable-interval schedules, matching, molecular analysis, molar analysis, changeover probability, changeover delay, key peck, pigeons

Full text

PDF
41

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Baum W. M. Choice in free-ranging wild pigeons. Science. 1974 Jul 5;185(4145):78–79. doi: 10.1126/science.185.4145.78. [DOI] [PubMed] [Google Scholar]
  2. Baum W. M., Rachlin H. C. Choice as time allocation. J Exp Anal Behav. 1969 Nov;12(6):861–874. doi: 10.1901/jeab.1969.12-861. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Baum W. M. Time allocation and negative reinforcement. J Exp Anal Behav. 1973 Nov;20(3):313–322. doi: 10.1901/jeab.1973.20-313. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Baum W. M. Time allocation in human vigilance. J Exp Anal Behav. 1975 Jan;23(1):45–53. doi: 10.1901/jeab.1975.23-45. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Blough D. S. The reinforcement of least-frequent interresponse times. J Exp Anal Behav. 1966 Sep;9(5):581–591. doi: 10.1901/jeab.1966.9-581. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Bradshaw C. M., Szabadi E., Bevan P. Behavior of humans in variable-interval schedules of reinforcement. J Exp Anal Behav. 1976 Sep;26(2):135–141. doi: 10.1901/jeab.1976.26-135. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Brown P. L., Jenkins H. M. Auto-shaping of the pigeon's key-peck. J Exp Anal Behav. 1968 Jan;11(1):1–8. doi: 10.1901/jeab.1968.11-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. FLESHLER M., HOFFMAN H. S. A progression for generating variable-interval schedules. J Exp Anal Behav. 1962 Oct;5:529–530. doi: 10.1901/jeab.1962.5-529. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Findley J. D. Preference and Switching under Concurrent Scheduling. J Exp Anal Behav. 1958 Apr;1(2):123–144. doi: 10.1901/jeab.1958.1-123. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. HERRNSTEIN R. J. Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav. 1961 Jul;4:267–272. doi: 10.1901/jeab.1961.4-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Herrnstein R. J. Quantitative hedonism. J Psychiatr Res. 1971 Aug;8(3):399–412. doi: 10.1016/0022-3956(71)90033-1. [DOI] [PubMed] [Google Scholar]
  13. Nevin J. A. Interval reinforcement of choice behavior in discrete trials. J Exp Anal Behav. 1969 Nov;12(6):875–885. doi: 10.1901/jeab.1969.12-875. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Silberberg A., Williams D. R. Choice behavior on discrete trials: a demonstration of the occurrence of a response strategy. J Exp Anal Behav. 1974 Mar;21(2):315–322. doi: 10.1901/jeab.1974.21-315. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Stubbs D. A., Pliskoff S. S. Concurrent responding with fixed relative rate of reinforcement. J Exp Anal Behav. 1969 Nov;12(6):887–895. doi: 10.1901/jeab.1969.12-887. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES