Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1974 May;21(3):585–605. doi: 10.1901/jeab.1974.21-585

Contingency spaces and measures in classical and instrumental conditioning1

John Gibbon, Robert Berryman, Robert L Thompson
PMCID: PMC1333230  PMID: 4838201

Abstract

The contingency between conditional and unconditional stimuli in classical conditioning paradigms, and between responses and consequences in instrumental conditioning paradigms, is analyzed. The results are represented in two- and three-dimensional spaces in which points correspond to procedures, or procedures and outcomes. Traditional statistical and psychological measures of association are applied to data in classical conditioning. Root mean square contingency, Ø, is proposed as a measure of contingency characterizing classical conditioning effects at asymptote. In instrumental training procedures, traditional measures of association are inappropriate, since one degree of freedom—response probability—is yielded to the subject. Further analysis of instrumental contingencies yields a surprising result. The well established “Matching Law” in free-operant concurrent schedules subsumes the “Probability Matching” finding of mathematical learning theory, and both are equivalent to zero contingency between responses and consequences.

Full text

PDF
585

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. BITTERMAN M. E., WODINSKY J., CANDLAND D. K. Some comparative psychology. Am J Psychol. 1958 Mar;71(1):94–110. [PubMed] [Google Scholar]
  2. BUSH R. R., WILSON T. R. Two-choice behavior of paradise fish. J Exp Psychol. 1956 May;51(5):315–322. doi: 10.1037/h0044651. [DOI] [PubMed] [Google Scholar]
  3. Badia P., Culbertson S. The relative aversiveness of signalled vs unsignalled escapable and inescapable shock. J Exp Anal Behav. 1972 May;17(3):463–471. doi: 10.1901/jeab.1972.17-463. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Benedict J. O., Ayres J. J. Factors affecting conditioning in the truly random control procedure in the rat. J Comp Physiol Psychol. 1972 Feb;78(2):323–330. doi: 10.1037/h0032296. [DOI] [PubMed] [Google Scholar]
  5. Brown P. L., Jenkins H. M. Auto-shaping of the pigeon's key-peck. J Exp Anal Behav. 1968 Jan;11(1):1–8. doi: 10.1901/jeab.1968.11-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Bull J. A., 3rd, Overmier J. B. Additive and subtractive properties of excitation and inhibition. J Comp Physiol Psychol. 1968 Oct;66(2):511–514. doi: 10.1037/h0026362. [DOI] [PubMed] [Google Scholar]
  7. Byrd L. D. Responding in the cat maintained under response-independent electric shock and response-produced electric shock. J Exp Anal Behav. 1969 Jan;12(1):1–10. doi: 10.1901/jeab.1969.12-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Davis H., McIntire R. W. Conditioned suppression under positive, negative, and no contingency between conditioned and unconditioned stimuli. J Exp Anal Behav. 1969 Jul;12(4):633–640. doi: 10.1901/jeab.1969.12-633. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. GRAF V., BULLOCK D. H., BITTERMAN M. E. FURTHER EXPERIMENTS ON PROBABILITY-MATCHING IN THE PIGEON. J Exp Anal Behav. 1964 Mar;7:151–157. doi: 10.1901/jeab.1964.7-151. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Gibbon J. Discriminated punishment: avoidable and unavoidable shock. J Exp Anal Behav. 1967 Sep;10(5):451–460. doi: 10.1901/jeab.1967.10-451. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. HUNT H. F., BRADY J. V. Some effects of punishment and intercurrent anxiety on a simple operant. J Comp Physiol Psychol. 1955 Aug;48(4):305–310. doi: 10.1037/h0042529. [DOI] [PubMed] [Google Scholar]
  12. Herrnstein R. J., Hineline P. N. Negative reinforcement as shock-frequency reduction. J Exp Anal Behav. 1966 Jul;9(4):421–430. doi: 10.1901/jeab.1966.9-421. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Jones R. T. The effect of rate of delivery of response-independent shocks upon avoidance responding. J Exp Anal Behav. 1969 Nov;12(6):1023–1027. doi: 10.1901/jeab.1969.12-1023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. KELLEHER R. T., RIDDLE W. C., COOK L. PERSISTENT BEHAVIOR MAINTAINED BY UNAVOIDABLE SHOCKS. J Exp Anal Behav. 1963 Oct;6:507–517. doi: 10.1901/jeab.1963.6-507. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Killeen P. A yoked-chamber comparison of concurrent and multiple schedules. J Exp Anal Behav. 1972 Jul;18(1):13–22. doi: 10.1901/jeab.1972.18-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. LOCKARD J. S. Choice of a warning signal or no warning signal in an unavoidable shock situation. J Comp Physiol Psychol. 1963 Jun;56:526–530. doi: 10.1037/h0041552. [DOI] [PubMed] [Google Scholar]
  18. LYON D. O. SOME NOTES ON CONDITIONED SUPPRESSION AND REINFORCEMENT SCHEDULES. J Exp Anal Behav. 1964 Jul;7:289–291. doi: 10.1901/jeab.1964.7-289. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. McKearney J. W. Fixed-interval schedules of electric shock presentation: extinction and recovery of performance under different shock intensities and fixed-interval durations. J Exp Anal Behav. 1969 Mar;12(2):301–313. doi: 10.1901/jeab.1969.12-301. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. McKearney J. W. Maintenance of responding under a fixed-interval schedule of electric shock-presentation. Science. 1968 Jun 14;160(3833):1249–1251. doi: 10.1126/science.160.3833.1249. [DOI] [PubMed] [Google Scholar]
  21. Morse W. H., Mead R. N., Kelleher R. T. Modulation of elicited behavior by a fixed-interval schedule of electric shock presentation. Science. 1967 Jul 14;157(3785):215–217. doi: 10.1126/science.157.3785.215. [DOI] [PubMed] [Google Scholar]
  22. Neuringer A. J. Animals respond for food in the presence of free food. Science. 1969 Oct 17;166(3903):399–401. doi: 10.1126/science.166.3903.399. [DOI] [PubMed] [Google Scholar]
  23. Neuringer A. J. Many responses per food reward with free food present. Science. 1970 Jul 31;169(3944):503–504. doi: 10.1126/science.169.3944.503. [DOI] [PubMed] [Google Scholar]
  24. Nevin J. A. Interval reinforcement of choice behavior in discrete trials. J Exp Anal Behav. 1969 Nov;12(6):875–885. doi: 10.1901/jeab.1969.12-875. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Rachlin H. On the tautology of the matching law. J Exp Anal Behav. 1971 Mar;15(2):249–251. doi: 10.1901/jeab.1971.15-249. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Rescorla R. A. Conditioned inhibition of fear resulting from negative CS-US contingencies. J Comp Physiol Psychol. 1969 Apr;67(4):504–509. doi: 10.1037/h0027313. [DOI] [PubMed] [Google Scholar]
  27. Rescorla R. A. Pavlovian conditioning and its proper control procedures. Psychol Rev. 1967 Jan;74(1):71–80. doi: 10.1037/h0024109. [DOI] [PubMed] [Google Scholar]
  28. Rescorla R. A. Probability of shock in the presence and absence of CS in fear conditioning. J Comp Physiol Psychol. 1968 Aug;66(1):1–5. doi: 10.1037/h0025984. [DOI] [PubMed] [Google Scholar]
  29. SIDLEY N. A., SCHOENFELD W. N. BEHAVIOR STABILITY AND RESPONSE RATE AS FUNCTIONS OF REINFORCEMENT PROBABILITY ON "RANDOM RATIO" SCHEDULES. J Exp Anal Behav. 1964 May;7:281–283. doi: 10.1901/jeab.1964.7-281. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. SIDMAN M., HERRNSTEIN R. J., CONRAD D. G. Maintenance of avoidance behavior by unavoidable shocks. J Comp Physiol Psychol. 1957 Dec;50(6):553–557. doi: 10.1037/h0043500. [DOI] [PubMed] [Google Scholar]
  31. Seligman M. E. Chronic fear produced by unpredictable electric shock. J Comp Physiol Psychol. 1968 Oct;66(2):402–411. doi: 10.1037/h0026355. [DOI] [PubMed] [Google Scholar]
  32. Shimp C. P. Probabilistically reinforced choice behavior in pigeons. J Exp Anal Behav. 1966 Jul;9(4):443–455. doi: 10.1901/jeab.1966.9-443. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Stein L., Sidman M., Brady J. V. Some effects of Two Temporal Variables on Conditioned Suppression. J Exp Anal Behav. 1958 Apr;1(2):153–162. doi: 10.1901/jeab.1958.1-153. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Stretch R., Orloff E. R., Dalrymple S. D. Maintenance of responding by fixed-interval schedule of electric shock presentation in squirrel monkeys. Science. 1968 Nov 1;162(3853):583–586. doi: 10.1126/science.162.3853.583. [DOI] [PubMed] [Google Scholar]
  35. Williams D. R., Williams H. Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement. J Exp Anal Behav. 1969 Jul;12(4):511–520. doi: 10.1901/jeab.1969.12-511. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES