Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 2003 Jan;79(1):1–20. doi: 10.1901/jeab.2003.79-1

Dynamical concurrent schedules.

William L Palya 1, Robert W Allan 1
PMCID: PMC1284918  PMID: 12696738

Abstract

Previous work on the matching law has predominantly focused on the molar effects of the contingency by examining only one reinforcer ratio for extended periods. Responses are distributed as a function of reinforcer ratios under these static conditions. But the outcome under a dynamic condition in which reinforcer ratios change continuously has not been determined. The present study implemented concurrent variable-interval schedules that changed continuously across a fixed 5-min trial. The schedules were reciprocally interlocked. The variable interval for one key changed continuously from a variable-interval 15-s to a variable-interval 480-s, while the schedule for the other key changed from a variable-interval 480-s to a variable-interval 15-s. This dynamical concurrent schedule shifted behavior in the direction of matching response ratios to reinforcer ratios. Sensitivities derived from the generalized matching law were approximately 0.62, the mean absolute bias was approximately 0.11, and r2s were approximately 0.86. It was concluded that choice behavior can come to adapt to reinforcer ratios that change continuously over a relatively short time and that this change does not require extensive experience with a fixed reinforcer ratio. The results were seen as supportive of the view that all behavior constitutes choice.

Full Text

The Full Text of this article is available as a PDF (1.6 MB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Bailey J. T., Mazur J. E. Choice behavior in transition: development of preference for the higher probability of reinforcement. J Exp Anal Behav. 1990 May;53(3):409–422. doi: 10.1901/jeab.1990.53-409. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Baum W. M. On two types of deviation from the matching law: bias and undermatching. J Exp Anal Behav. 1974 Jul;22(1):231–242. doi: 10.1901/jeab.1974.22-231. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Davison M. C., Hunter I. W. Concurrent schedules: undermatching and control by previous experimental conditions. J Exp Anal Behav. 1979 Sep;32(2):233–244. doi: 10.1901/jeab.1979.32-233. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Davison M., Baum W. M. Choice in a variable environment: every reinforcer counts. J Exp Anal Behav. 2000 Jul;74(1):1–24. doi: 10.1901/jeab.2000.74-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Davison Michael, Baum William M. Choice in a variable environment: effects of blackout duration and extinction between components. J Exp Anal Behav. 2002 Jan;77(1):65–89. doi: 10.1901/jeab.2002.77-65. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. FLESHLER M., HOFFMAN H. S. A progression for generating variable-interval schedules. J Exp Anal Behav. 1962 Oct;5:529–530. doi: 10.1901/jeab.1962.5-529. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Herbert E. W. Two-key concurrent responding: response-reinforcement dependencies and blackouts. J Exp Anal Behav. 1970 Jul;14(1):61–70. doi: 10.1901/jeab.1970.14-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Landon J., Davison M. Reinforcer-ratio variation and its effects on rate of adaptation. J Exp Anal Behav. 2001 Mar;75(2):207–234. doi: 10.1901/jeab.2001.75-207. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Mazur J. E. Choice behavior in transition: development of preference with ratio and interval schedules. J Exp Psychol Anim Behav Process. 1992 Oct;18(4):364–378. doi: 10.1037//0097-7403.18.4.364. [DOI] [PubMed] [Google Scholar]
  11. Millenson J. R. Random interval schedules of reinforcement. J Exp Anal Behav. 1963 Jul;6(3):437–443. doi: 10.1901/jeab.1963.6-437. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Nevin J. A., Randolph, Holland S., McLean A. P. Variable-ratio versus variable-interval schedules: response rate, resistance to change, and preference. J Exp Anal Behav. 2001 Jul;76(1):43–74. doi: 10.1901/jeab.2001.76-43. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Palya W. L. Bipolar control in fixed interfood intervals. J Exp Anal Behav. 1993 Sep;60(2):345–359. doi: 10.1901/jeab.1993.60-345. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Palya W. L. Dynamics in the fine structure of schedule-controlled behavior. J Exp Anal Behav. 1992 May;57(3):267–287. doi: 10.1901/jeab.1992.57-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Palya W. L. Sign-tracking with an interfood clock. J Exp Anal Behav. 1985 May;43(3):321–330. doi: 10.1901/jeab.1985.43-321. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Wright A. A. Construction of equal-hue discriminability scales for the pigeon. J Exp Anal Behav. 1978 Mar;29(2):261–266. doi: 10.1901/jeab.1978.29-261. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES