Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1973 Jul;20(1):137–153. doi: 10.1901/jeab.1973.20-137

The correlation-based law of effect1

William M Baum
PMCID: PMC1334111  PMID: 16811687

Abstract

It is commonly understood that the interactions between an organism and its environment constitute a feedback system. This implies that instrumental behavior should be viewed as a continuous exchange between the organism and the environment. It follows that orderly relations between behavior and environment should emerge at the level of aggregate flow in time, rather than momentary events. These notions require a simple, but fundamental, change in the law of effect: from a law based on contiguity of events to a law based on correlation between events. Much recent research and argument favors such a change. If the correlation-based law of effect is accepted, it favors measures and units of analysis that transcend momentary events, extending through time. One can measure all consequences on a common scale, called value. One can define a unit of analysis called the behavioral situation, which circumscribes a set of values. These concepts allow redefinition of reinforcement and punishment, and clarification of their relation to discriminative stimuli.

Full text

PDF
137

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. ANGER D. The role of temporal discriminations in the reinforcement of Sidman avoidance behavior. J Exp Anal Behav. 1963 Jul;6(3):477–506. doi: 10.1901/jeab.1963.6-s477. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. BOREN J. J., SIDMAN M. A discrimination based upon repeated conditioning and extinction of avoidance behavior. J Comp Physiol Psychol. 1957 Feb;50(1):18–22. doi: 10.1037/h0045142. [DOI] [PubMed] [Google Scholar]
  3. BULLOCK D. H., SMITH W. C. An effect of repeated conditioning-extinction upon operant strength. J Exp Psychol. 1953 Nov;46(5):349–352. doi: 10.1037/h0054544. [DOI] [PubMed] [Google Scholar]
  4. Baum W. M., Rachlin H. C. Choice as time allocation. J Exp Anal Behav. 1969 Nov;12(6):861–874. doi: 10.1901/jeab.1969.12-861. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Bower G., McLean J., Meacham J. Value of knowing when reinforcement is due. J Comp Physiol Psychol. 1966 Oct;62(2):184–192. doi: 10.1037/h0023682. [DOI] [PubMed] [Google Scholar]
  6. Brownstein A. J., Pliskoff S. S. Some effects of relative reinforcement rate and changeover delay in response-independent concurrent schedules of reinforcement. J Exp Anal Behav. 1968 Nov;11(6):683–688. doi: 10.1901/jeab.1968.11-683. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. CATANIA A. C. Concurrent performances: a baseline for the study of reinforcement magnitude. J Exp Anal Behav. 1963 Apr;6:299–300. doi: 10.1901/jeab.1963.6-299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. CATANIA A. C. Concurrent performances: reinforcement interaction and response independence. J Exp Anal Behav. 1963 Apr;6:253–263. doi: 10.1901/jeab.1963.6-253. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Catania A. C., Reynolds G. S. A quantitative analysis of the responding maintained by interval schedules of reinforcement. J Exp Anal Behav. 1968 May;11(3 Suppl):327–383. doi: 10.1901/jeab.1968.11-s327. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Chung S. H., Herrnstein R. J. Choice and delay of reinforcement. J Exp Anal Behav. 1967 Jan;10(1):67–74. doi: 10.1901/jeab.1967.10-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. DEWS P. B. Free-operant behavior under conditions of delayed reinforcement. I. CRF-type schedules. J Exp Anal Behav. 1960 Jul;3:221–234. doi: 10.1901/jeab.1960.3-221. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. DEWS P. B. The effect of multiple S delta periods on responding on a fixed-interval schedule. J Exp Anal Behav. 1962 Jul;5:369–374. doi: 10.1901/jeab.1962.5-369. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Davison M. C. Preference for mixed-interval versus fixed-interval schedules. J Exp Anal Behav. 1969 Mar;12(2):247–252. doi: 10.1901/jeab.1969.12-247. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. De Villiers P. A. Reinforcement and response rate interaction in multiple random-interval avoidance schedules. J Exp Anal Behav. 1972 Nov;18(3):499–507. doi: 10.1901/jeab.1972.18-499. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Dews P. B. The effect of multiple S-delta periods on responding on a fixed-interval schedule: 3. Effect of changes in pattern of interruptions, parameters and stimuli. J Exp Anal Behav. 1965 Nov;8(6):427–435. doi: 10.1901/jeab.1965.8-427. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Duncan B., Fantino E. Choice for periodic schedules of reinforcement. J Exp Anal Behav. 1970 Jul;14(1):73–86. doi: 10.1901/jeab.1970.14-73. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Fantino E. Effects of required rates of responding upon choice. J Exp Anal Behav. 1968 Jan;11(1):15–22. doi: 10.1901/jeab.1968.11-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. HERRNSTEIN R. J. Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav. 1961 Jul;4:267–272. doi: 10.1901/jeab.1961.4-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. HERRNSTEIN R. J. SECONDARY REINFORCEMENT AND RATE OF PRIMARY REINFORCEMENT. J Exp Anal Behav. 1964 Jan;7:27–36. doi: 10.1901/jeab.1964.7-27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Herrnstein R. J., Hineline P. N. Negative reinforcement as shock-frequency reduction. J Exp Anal Behav. 1966 Jul;9(4):421–430. doi: 10.1901/jeab.1966.9-421. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Herrnstein R. J. Method and theory in the study of avoidance. Psychol Rev. 1969 Jan;76(1):49–69. doi: 10.1037/h0026786. [DOI] [PubMed] [Google Scholar]
  22. Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Holz W. C. Punishment and rate of positive reinforcement. J Exp Anal Behav. 1968 May;11(3):285–292. doi: 10.1901/jeab.1968.11-285. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Killeen P. On the measurement of reinforcement frequency in the study of preference. J Exp Anal Behav. 1968 May;11(3):263–269. doi: 10.1901/jeab.1968.11-263. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Neuringer A. J. Effects of reinforcement magnitude on choice and rate of responding. J Exp Anal Behav. 1967 Sep;10(5):417–424. doi: 10.1901/jeab.1967.10-417. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. doi: 10.1901/jeab.1970.14-361. [DOI] [PMC free article] [Google Scholar]
  27. Rachlin H., Baum W. M. Effects of alternative reinforcement: does the source matter? J Exp Anal Behav. 1972 Sep;18(2):231–241. doi: 10.1901/jeab.1972.18-231. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Rachlin H., Baum W. M. Response rate as a function of amount of reinforcement for a signalled concurrent response. J Exp Anal Behav. 1969 Jan;12(1):11–16. doi: 10.1901/jeab.1969.12-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. SIDMAN M. Two temporal parameters of the maintenance of avoidance behavior by the white rat. J Comp Physiol Psychol. 1953 Aug;46(4):253–261. doi: 10.1037/h0060730. [DOI] [PubMed] [Google Scholar]
  30. Schneider B. A. A two-state analysis of fixed-interval responding in the pigeon. J Exp Anal Behav. 1969 Sep;12(5):677–687. doi: 10.1901/jeab.1969.12-677. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Schneider J. W. Choice between two-component chained and tandem schedules. J Exp Anal Behav. 1972 Jul;18(1):45–60. doi: 10.1901/jeab.1972.18-45. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Schuster R., Rachlin H. Indifference between punishment and free shock: evidence for the negative law of effect. J Exp Anal Behav. 1968 Nov;11(6):777–786. doi: 10.1901/jeab.1968.11-777. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Shull R. L., Pliskoff S. S. Changeover delay and concurrent schedules: some effects on relative performance measures. J Exp Anal Behav. 1967 Nov;10(6):517–527. doi: 10.1901/jeab.1967.10-517. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Ten Eyck R. L. Effects of rate of reinforcement-time upon concurrent operant performance. J Exp Anal Behav. 1970 Nov;14(3):269–274. doi: 10.1901/jeab.1970.14-269. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Wilton R. N., Clements R. O. Observing responses and informative stimuli. J Exp Anal Behav. 1971 Mar;15(2):199–204. doi: 10.1901/jeab.1971.15-199. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES