Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1982 Jul;38(1):51–61. doi: 10.1901/jeab.1982.38-51

Performance of humans in concurrent avoidance/positive-reinforcement schedules

H V Ruddle, C M Bradshaw, E Szabadi, T M Foster
PMCID: PMC1347827  PMID: 16812284

Abstract

Performance maintained under concurrent schedules consisting of a variable-interval avoidance component and a variable-interval positive-reinforcement component was studied in three human subjects using points exchangeable for money as the reinforcer. The rate of responding in the avoidance component increased, and the rate of responding in the positive-reinforcement component declined, as a function of the frequency of point-losses avoided in the avoidance component. The performance of all three subjects conformed to equations proposed by Herrnstein to describe behavior in concurrent schedules. The logarithms of the ratios of the response rates in the two components, and the logarithms of the ratios of the times spent in the two components, were linearly related to the logarithms of the ratios of the frequency of loss avoidance in the avoidance component to the frequency of reinforcement in the positive-reinforcement component. When a changeover delay of 5.0 sec was imposed, the slopes of the linear functions were close to 1.0 in the case of two subjects, whereas the third subject exhibited significant undermatching. For two subjects the changeover delay was then reduced to 2.0 sec; in both cases the slopes of the linear functions were lower than under the 5.0-sec condition. One subject participated in a third phase, in which no changeover delay was imposed; there was a further reduction in the slopes of the linear functions.

Keywords: Herrnstein's equation, matching law, concurrent avoidance/positive-reinforcement schedules, changeover delay, button pressing, humans

Full text

PDF
51

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Baum W. M. Matching, undermatching, and overmatching in studies of choice. J Exp Anal Behav. 1979 Sep;32(2):269–281. doi: 10.1901/jeab.1979.32-269. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Baum W. M. On two types of deviation from the matching law: bias and undermatching. J Exp Anal Behav. 1974 Jul;22(1):231–242. doi: 10.1901/jeab.1974.22-231. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Baum W. M. Time allocation and negative reinforcement. J Exp Anal Behav. 1973 Nov;20(3):313–322. doi: 10.1901/jeab.1973.20-313. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Baum W. M. Time allocation in human vigilance. J Exp Anal Behav. 1975 Jan;23(1):45–53. doi: 10.1901/jeab.1975.23-45. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Bradshaw C. M., Szabadi E., Bevan P. Behavior of humans in variable-interval schedules of reinforcement. J Exp Anal Behav. 1976 Sep;26(2):135–141. doi: 10.1901/jeab.1976.26-135. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Bradshaw C. M., Szabadi E., Bevan P., Ruddle H. V. The effect of signaled reinforcement availability on concurrent performances in humans. J Exp Anal Behav. 1979 Jul;32(1):65–74. doi: 10.1901/jeab.1979.32-65. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Bradshaw C. M., Szabadi E., Bevan P. The effect of punishment on free-operant choice behavior in humans. J Exp Anal Behav. 1979 Jan;31(1):71–81. doi: 10.1901/jeab.1979.31-71. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. CATANIA A. C., CUTTS D. Experimental control of superstitious responding inhumans. J Exp Anal Behav. 1963 Apr;6:203–208. doi: 10.1901/jeab.1963.6-203. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Catania A. C., Reynolds G. S. A quantitative analysis of the responding maintained by interval schedules of reinforcement. J Exp Anal Behav. 1968 May;11(3 Suppl):327–383. doi: 10.1901/jeab.1968.11-s327. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Cliffe M. J., Parry S. J. Matching to reinforcer value: human concurrent variable-interval performance. Q J Exp Psychol. 1980 Nov;32(4):557–570. doi: 10.1080/14640748008401845. [DOI] [PubMed] [Google Scholar]
  11. De Villiers P. A. The law of effect and avoidance: a quantitative relationship between response rate and shock-frequency reduction. J Exp Anal Behav. 1974 Mar;21(2):223–235. doi: 10.1901/jeab.1974.21-223. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Farley J., Fantino E. The symmetrical law of effect and the matching relation in choice behavior. J Exp Anal Behav. 1978 Jan;29(1):37–60. doi: 10.1901/jeab.1978.29-37. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Farley J. Reinforcement and punishment effects in concurrent schedules: A test of two models. J Exp Anal Behav. 1980 May;33(3):311–326. doi: 10.1901/jeab.1980.33-311. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. HERRNSTEIN R. J. Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav. 1961 Jul;4:267–272. doi: 10.1901/jeab.1961.4-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Herrnstein R. J. Formal properties of the matching law. J Exp Anal Behav. 1974 Jan;21(1):159–164. doi: 10.1901/jeab.1974.21-159. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Herrnstein R. J., Hineline P. N. Negative reinforcement as shock-frequency reduction. J Exp Anal Behav. 1966 Jul;9(4):421–430. doi: 10.1901/jeab.1966.9-421. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Herrnstein R. J. Method and theory in the study of avoidance. Psychol Rev. 1969 Jan;76(1):49–69. doi: 10.1037/h0026786. [DOI] [PubMed] [Google Scholar]
  18. Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Lander D. G., Irwin R. J. Multiple schedules: effects of the distribution of reinforcements between component on the distribution of responses between conponents. J Exp Anal Behav. 1968 Sep;11(5):517–524. doi: 10.1901/jeab.1968.11-517. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Logue A. W., De Villiers P. A. Matching in concurrent variable-interval avoidance schedules. J Exp Anal Behav. 1978 Jan;29(1):61–66. doi: 10.1901/jeab.1978.29-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Morse W. H., Kelleher R. T. Schedules using noxious stimuli. I. Multiple fixed-ratio and fixed-interval termination of schedule complexes. J Exp Anal Behav. 1966 May;9(3):267–290. doi: 10.1901/jeab.1966.9-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Schroeder S. R., Holland J. G. Reinforcement of eye movement with concurrent schedules. J Exp Anal Behav. 1969 Nov;12(6):897–903. doi: 10.1901/jeab.1969.12-897. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Schuster R., Rachlin H. Indifference between punishment and free shock: evidence for the negative law of effect. J Exp Anal Behav. 1968 Nov;11(6):777–786. doi: 10.1901/jeab.1968.11-777. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Staddon J. E. Spaced responding and choice: a preliminary analysis. J Exp Anal Behav. 1968 Nov;11(6):669–682. doi: 10.1901/jeab.1968.11-669. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. WILKINSON G. N. Statistical estimations in enzyme kinetics. Biochem J. 1961 Aug;80:324–332. doi: 10.1042/bj0800324. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. de Villiers P. A. Toward a quantitative theory of punishment. J Exp Anal Behav. 1980 Jan;33(1):15–25. doi: 10.1901/jeab.1980.33-15. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES