Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1994 May;61(3):453–463. doi: 10.1901/jeab.1994.61-453

Human choice in concurrent ratio-interval schedules of reinforcement.

H I Savastano 1, E Fantino 1
PMCID: PMC1334432  PMID: 8207353

Abstract

Seven undergraduates participated in a concurrent-choice experiment with monetary reinforcers. Response-independent analogues of variable-interval and variable-ratio schedules were used to assess whether subjects would maximize reinforcement rate. The optimal pattern of behavior, in terms of maximizing reinforcement rate, involved a large bias toward the ratio alternative, with only occasional sampling of the interval schedule. Most experiments with pigeons, however, demonstrate matching of response rates to reinforcement rates, with only slight biases for the ratio schedule. Although subjects in the present experiment allocated more time to the ratio alternative than required by matching, the magnitude of the bias did not approximate that predicted by a maximizing account. After exposure to clock stimuli correlated with the operation of each schedule, 1 subject's behavior did show a substantial level of bias, increasing the total number of reinforcers obtained, and lay at a point between the predictions of matching and maximizing. The other subjects, however, continued to respond less optimally. The present results can be accounted for by a view of matching that incorporates the effects of delayed reinforcement.

Full text

PDF
453

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Baum W. M. Matching, undermatching, and overmatching in studies of choice. J Exp Anal Behav. 1979 Sep;32(2):269–281. doi: 10.1901/jeab.1979.32-269. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Baum W. M. On two types of deviation from the matching law: bias and undermatching. J Exp Anal Behav. 1974 Jul;22(1):231–242. doi: 10.1901/jeab.1974.22-231. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Baum W. M. Optimization and the matching law as accounts of instrumental behavior. J Exp Anal Behav. 1981 Nov;36(3):387–403. doi: 10.1901/jeab.1981.36-387. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. DeCarlo L. T. Matching and maximizing with variable-time schedules. J Exp Anal Behav. 1985 Jan;43(1):75–81. doi: 10.1901/jeab.1985.43-75. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Green L., Rachlin H., Hanson J. Matching and maximizing with concurrent ratio-interval schedules. J Exp Anal Behav. 1983 Nov;40(3):217–224. doi: 10.1901/jeab.1983.40-217. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Herrnstein R. J., Heyman G. M. Is matching compatible with reinforcement maximization on concurrent variable interval variable ratio? J Exp Anal Behav. 1979 Mar;31(2):209–223. doi: 10.1901/jeab.1979.31-209. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Heyman G. M., Herrnstein R. J. More on concurrent interval-ratio schedules: a replication and review. J Exp Anal Behav. 1986 Nov;46(3):331–351. doi: 10.1901/jeab.1986.46-331. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Keller J. V., Gollub L. R. Duration and rate of reinforcement as determinants of concurrent responding. J Exp Anal Behav. 1977 Sep;28(2):145–153. doi: 10.1901/jeab.1977.28-145. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Myers D. L., Myers L. E. Undermatching: a reappraisal of performance on concurrent variable-interval schedules of reinforcement. J Exp Anal Behav. 1977 Jan;27(1):203–214. doi: 10.1901/jeab.1977.27-203. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Shull R. L., Pliskoff S. S. Changeover delay and concurrent schedules: some effects on relative performance measures. J Exp Anal Behav. 1967 Nov;10(6):517–527. doi: 10.1901/jeab.1967.10-517. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Silberberg A., Thomas J. R., Berendzen N. Human choice on concurrent variable-interval variable-ratio schedules. J Exp Anal Behav. 1991 Nov;56(3):575–584. doi: 10.1901/jeab.1991.56-575. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Sizemore O. J., Lattal K. A. Unsignalled delay of reinforcement in variable-interval schedules. J Exp Anal Behav. 1978 Sep;30(2):169–175. doi: 10.1901/jeab.1978.30-169. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Vaughan W., Jr, Miller H. L., Jr Optimization versus response-strength accounts of behavior. J Exp Anal Behav. 1984 Sep;42(2):337–348. doi: 10.1901/jeab.1984.42-337. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Vyse S. A., Belke T. W. Maximizing versus matching on concurrent variable-interval schedules. J Exp Anal Behav. 1992 Sep;58(2):325–334. doi: 10.1901/jeab.1992.58-325. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Wearden J. H., Burgess I. S. Matching since Baum (1979). J Exp Anal Behav. 1982 Nov;38(3):339–348. doi: 10.1901/jeab.1982.38-339. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Williams B. A. Dissociation of theories of choice by temporal spacing of choice opportunities. J Exp Psychol Anim Behav Process. 1992 Jul;18(3):287–297. [PubMed] [Google Scholar]
  18. Williams B. A. The effects of unsignalled delayed reinforcement. J Exp Anal Behav. 1976 Nov;26(3):441–449. doi: 10.1901/jeab.1976.26-441. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES