Skip to main content
PMC home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243

On the law of effect1

R J Herrnstein
PMCID: PMC1333768  PMID: 16811440

Abstract

Experiments on single, multiple, and concurrent schedules of reinforcement find various correlations between the rate of responding and the rate or magnitude of reinforcement. For concurrent schedules (i.e., simultaneous choice procedures), there is matching between the relative frequencies of responding and reinforcement; for multiple schedules (i.e., successive discrimination procedures), there are contrast effects between responding in each component and reinforcement in the others; and for single schedules, there are a host of increasing monotonic relations between the rate of responding and the rate of reinforcement. All these results, plus several others, can be accounted for by a coherent system of equations, the most general of which states that the absolute rate of any response is proportional to its associated relative reinforcement.

Full text

PDF
245

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. BITTERMAN M. E. PHYLETIC DIFFERENCES IN LEARNING. Am Psychol. 1965 Jun;20:396–410. doi: 10.1037/h0022328. [DOI] [PubMed] [Google Scholar]
  2. BONEAU C. A., AXELROD S. Work decrement and reminiscence in pigeon operant responding. J Exp Psychol. 1962 Oct;64:352–354. doi: 10.1037/h0047944. [DOI] [PubMed] [Google Scholar]
  3. BRETHOWER D. M., REYNOLDS G. S. A facilitative effect of punishment on unpunished behavior. J Exp Anal Behav. 1962 Apr;5:191–199. doi: 10.1901/jeab.1962.5-191. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. BRUNSWIK E. Representative design and probabilistic theory in a functional psychology. Psychol Rev. 1955 May;62(3):193–217. doi: 10.1037/h0047470. [DOI] [PubMed] [Google Scholar]
  5. Baum W. M., Rachlin H. C. Choice as time allocation. J Exp Anal Behav. 1969 Nov;12(6):861–874. doi: 10.1901/jeab.1969.12-861. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Bernheim J. W., Williams D. R. Time-dependent contrast effects in a multiple schedule of food reinforcement. J Exp Anal Behav. 1967 May;10(3):243–249. doi: 10.1901/jeab.1967.10-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Bloomfield T. M. Behavioral contrast and relative reinforcement frequency in two multiple schedules. J Exp Anal Behav. 1967 Mar;10(2):151–158. doi: 10.1901/jeab.1967.10-151. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Brownstein A. J., Pliskoff S. S. Some effects of relative reinforcement rate and changeover delay in response-independent concurrent schedules of reinforcement. J Exp Anal Behav. 1968 Nov;11(6):683–688. doi: 10.1901/jeab.1968.11-683. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. CATANIA A. C. Concurrent performances: a baseline for the study of reinforcement magnitude. J Exp Anal Behav. 1963 Apr;6:299–300. doi: 10.1901/jeab.1963.6-299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. CATANIA A. C. Concurrent performances: reinforcement interaction and response independence. J Exp Anal Behav. 1963 Apr;6:253–263. doi: 10.1901/jeab.1963.6-253. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Catania A. C., Reynolds G. S. A quantitative analysis of the responding maintained by interval schedules of reinforcement. J Exp Anal Behav. 1968 May;11(3 Suppl):327–383. doi: 10.1901/jeab.1968.11-s327. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Chung S. H., Herrnstein R. J. Choice and delay of reinforcement. J Exp Anal Behav. 1967 Jan;10(1):67–74. doi: 10.1901/jeab.1967.10-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Findley J. D. Preference and Switching under Concurrent Scheduling. J Exp Anal Behav. 1958 Apr;1(2):123–144. doi: 10.1901/jeab.1958.1-123. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. HERRNSTEIN R. J., MORSE W. H. A conjunctive schedule of reinforcement. J Exp Anal Behav. 1958 Jan;1:15–24. doi: 10.1901/jeab.1958.1-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. HERRNSTEIN R. J. Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav. 1961 Jul;4:267–272. doi: 10.1901/jeab.1961.4-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. HERRNSTEIN R. J. SECONDARY REINFORCEMENT AND RATE OF PRIMARY REINFORCEMENT. J Exp Anal Behav. 1964 Jan;7:27–36. doi: 10.1901/jeab.1964.7-27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Holz W. C. Punishment and rate of positive reinforcement. J Exp Anal Behav. 1968 May;11(3):285–292. doi: 10.1901/jeab.1968.11-285. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Lander D. G., Irwin R. J. Multiple schedules: effects of the distribution of reinforcements between component on the distribution of responses between conponents. J Exp Anal Behav. 1968 Sep;11(5):517–524. doi: 10.1901/jeab.1968.11-517. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Neuringer A. J. Effects of reinforcement magnitude on choice and rate of responding. J Exp Anal Behav. 1967 Sep;10(5):417–424. doi: 10.1901/jeab.1967.10-417. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Nevin J. A. Differential reinforcement and stimulus control of not responding. J Exp Anal Behav. 1968 Nov;11(6):715–726. doi: 10.1901/jeab.1968.11-715. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Nevin J. A., Shettleworth S. J. An analysis of contrast effects in multiple schedules. J Exp Anal Behav. 1966 Jul;9(4):305–315. doi: 10.1901/jeab.1966.9-305. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. PLISKOFF S. S. RATE-CHANGE EFFECTS WITH EQUAL POTENTIAL REINFORCEMENTS DURING THE "WARNING" STIMULUS. J Exp Anal Behav. 1963 Oct;6:557–562. doi: 10.1901/jeab.1963.6-557. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. doi: 10.1901/jeab.1969.12-475. [DOI] [PMC free article] [Google Scholar]
  24. REYNOLDS G. S. Behavioral contrast. J Exp Anal Behav. 1961 Jan;4:57–71. doi: 10.1901/jeab.1961.4-57. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. REYNOLDS G. S. Relativity of response rate and reinforcement frequency in a multiple schedule. J Exp Anal Behav. 1961 Apr;4:179–184. doi: 10.1901/jeab.1961.4-179. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. REYNOLDS G. S. Some limitations on behavioral contrast and induction during successive discrimination. J Exp Anal Behav. 1963 Jan;6:131–139. doi: 10.1901/jeab.1963.6-131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Rachlin H., Baum W. M. Response rate as a function of amount of reinforcement for a signalled concurrent response. J Exp Anal Behav. 1969 Jan;12(1):11–16. doi: 10.1901/jeab.1969.12-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Reynolds G. S. An analysis of interactions in a multiple schedule. J Exp Anal Behav. 1961 Apr;4(2):107–117. doi: 10.1901/jeab.1961.4-107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Shimp C. P. Probabilistically reinforced choice behavior in pigeons. J Exp Anal Behav. 1966 Jul;9(4):443–455. doi: 10.1901/jeab.1966.9-443. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Shull R. L., Pliskoff S. S. Changeover delay and concurrent schedules: some effects on relative performance measures. J Exp Anal Behav. 1967 Nov;10(6):517–527. doi: 10.1901/jeab.1967.10-517. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Terrace H. S. Behavioral contrast and the peak shift: effects of extended discrimination training. J Exp Anal Behav. 1966 Nov;9(6):613–617. doi: 10.1901/jeab.1966.9-613. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES