Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1968 Jul;11(4):385–403. doi: 10.1901/jeab.1968.11-385

Actual versus potential shock in making shock situations function as negative reinforcers1

D F Hake
PMCID: PMC1338501  PMID: 4970462

Abstract

The relative importance of potential and actual shocks in making shock situations function as negative reinforcers was studied. Shocks were scheduled to occur at the same rate during two stimuli. During one, squirrel monkeys could avoid the shocks; during the other, they were unavoidable. For the two stimuli the potential rate of shocks was the same, but the actual rate was lower during avoidance because of avoidance responding. Fixed-ratio responding was maintained by the change from unavoidable shock to avoidance, indicating that the change was reinforcing when it resulted in a reduction in actual shock rate with no reduction in potential shock rate. Further increases in the rate of potential shock during avoidance had little effect upon the fixed-ratio responding until the rate was increased to the point that the actual shock rate during avoidance was comparable with that during unavoidable shock. At that point, the fixed-ratio response rate decreased nearly to zero. These findings show that actual shocks are more important than potential shocks in determining whether or not a shock situation will function as a negative reinforcer; this explains why the change from unavoidable shock to avoidable shock is reinforcing.

Full text

PDF
385

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. ANGER D. The role of temporal discriminations in the reinforcement of Sidman avoidance behavior. J Exp Anal Behav. 1963 Jul;6(3):477–506. doi: 10.1901/jeab.1963.6-s477. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. AZRIN N. H., HOLZ W. C., HAKE D. F., AYLLON T. Fixed-ratio escape reinforcement. J Exp Anal Behav. 1963 Jul;6:449–456. doi: 10.1901/jeab.1963.6-449. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. AZRIN N. H., HOLZ W. C., HAKE D. Intermittent reinforcement by removal of a conditioned aversive stimulus. Science. 1962 Jun 1;136(3518):781–782. doi: 10.1126/science.136.3518.781. [DOI] [PubMed] [Google Scholar]
  4. AZRIN N. H. Time-out from positive reinforcement. Science. 1961 Feb 10;133(3450):382–383. doi: 10.1126/science.133.3450.382. [DOI] [PubMed] [Google Scholar]
  5. Azrin N. H., Hutchinson R. R., Hake D. F. Attack, avoidance, and escape reactions to aversive shock. J Exp Anal Behav. 1967 Mar;10(2):131–148. doi: 10.1901/jeab.1967.10-131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. CAMPBELL B. A., KRAELING D. Response strength as a function of drive level and amount of drive reduction. J Exp Psychol. 1953 Feb;45(2):97–101. doi: 10.1037/h0060223. [DOI] [PubMed] [Google Scholar]
  7. CAMPBELL B. A. The fractional reduction in noxious stimulation required to produce "just noticeable" learning. J Comp Physiol Psychol. 1955 Jun;48(3):141–148. doi: 10.1037/h0046764. [DOI] [PubMed] [Google Scholar]
  8. Clark F. C., Hull L. D. Free operant avoidance as a function of the response-shock = shock-shock interval. J Exp Anal Behav. 1966 Nov;9(6):641–647. doi: 10.1901/jeab.1966.9-641. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. DINSMOOR J. A., CLAYTON M. H. Chaining and secondary reinforcement based on escape from shock. J Exp Anal Behav. 1963 Jan;6:75–80. doi: 10.1901/jeab.1963.6-75. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. DINSMOOR J. A. Variable-interval escape from stimuli accompanied by shocks. J Exp Anal Behav. 1962 Jan;5:41–47. doi: 10.1901/jeab.1962.5-41. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. FERSTER C. B., APPEL J. B. Punishment of S delta responding in matching to sample by time out from positive reinforcement. J Exp Anal Behav. 1961 Jan;4:45–56. doi: 10.1901/jeab.1961.4-45. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Findley J. D., Ames L. L. A note on time out from avoidance with the chimpanzee. J Exp Anal Behav. 1965 Nov;8(6):419–423. doi: 10.1901/jeab.1965.8-419. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Findley J. D., Schuster C. R., Zimmerman J. Second-order avoidance behavior in monkeys. J Exp Anal Behav. 1966 Nov;9(6):703–708. doi: 10.1901/jeab.1966.9-703. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. HAKE D. F., AZRIN N. H. An apparatus for delivering pain shock to monkevs. J Exp Anal Behav. 1963 Apr;6:297–298. doi: 10.1901/jeab.1963.6-297. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Herrnstein R. J., Brady J. V. Interaction among components of a multiple schedule. J Exp Anal Behav. 1958 Oct;1(4):293–300. doi: 10.1901/jeab.1958.1-293. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Herrnstein R. J., Hineline P. N. Negative reinforcement as shock-frequency reduction. J Exp Anal Behav. 1966 Jul;9(4):421–430. doi: 10.1901/jeab.1966.9-421. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. KAPLAN M. The maintenance of escape behavior under fixed-ratio reinforcement. J Comp Physiol Psychol. 1956 Apr;49(2):153–157. doi: 10.1037/h0048735. [DOI] [PubMed] [Google Scholar]
  18. KELLEHER R. T., GOLLUB L. R. A review of positive conditioned reinforcement. J Exp Anal Behav. 1962 Oct;5:543–597. doi: 10.1901/jeab.1962.5-s543. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Morse W. H., Kelleher R. T. Schedules using noxious stimuli. I. Multiple fixed-ratio and fixed-interval termination of schedule complexes. J Exp Anal Behav. 1966 May;9(3):267–290. doi: 10.1901/jeab.1966.9-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. SIDMAN M. Avoidance conditioning with brief shock and no exteroceptive warning signal. Science. 1953 Aug 7;118(3058):157–158. doi: 10.1126/science.118.3058.157. [DOI] [PubMed] [Google Scholar]
  21. SIDMAN M. Time out from avoidance as a reinforcer: a study of response interaction. J Exp Anal Behav. 1962 Oct;5:423–434. doi: 10.1901/jeab.1962.5-423. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. SIDMAN M. Two temporal parameters of the maintenance of avoidance behavior by the white rat. J Comp Physiol Psychol. 1953 Aug;46(4):253–261. doi: 10.1037/h0060730. [DOI] [PubMed] [Google Scholar]
  23. THOMPSON D. M. ESCAPE FROM SD ASSOCIATED WITH FIXED-RATIO REINFORCEMENT. J Exp Anal Behav. 1964 Jan;7:1–8. doi: 10.1901/jeab.1964.7-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. VERHAVE T. Avoidance responding as a function of simultaneous and equal changes in two temporal parameters. J Exp Anal Behav. 1959 Jul;2:185–190. doi: 10.1901/jeab.1959.2-185. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. VERHAVE T. Technique for differential reinforcement of rate of avoidance responding. Science. 1959 Apr 10;129(3354):959–960. doi: 10.1126/science.129.3354.959-a. [DOI] [PubMed] [Google Scholar]
  26. VERHAVE T. The functional properties of a time out from an avoidance schedule. J Exp Anal Behav. 1962 Oct;5:391–422. doi: 10.1901/jeab.1962.5-391. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. WEISS B., LATIES V. G. Fractional escape and avoidance on a titration schedule. Science. 1958 Dec 19;128(3338):1575–1576. doi: 10.1126/science.128.3338.1575. [DOI] [PubMed] [Google Scholar]
  28. WEISS B., LATIES V. G. Titration behavior on various fractional escape programs. J Exp Anal Behav. 1959 Jul;2:227–248. doi: 10.1901/jeab.1959.2-227. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. WINOGRAD E. ESCAPE BEHAVIOR UNDER DIFFERENT FIXED RATIOS AND SHOCK INTENSITIES. J Exp Anal Behav. 1965 Mar;8:117–124. doi: 10.1901/jeab.1965.8-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. ZIMMERMAN J., FERSTER C. B. Intermittent punishment of Sdelta responding in matching to sample. J Exp Anal Behav. 1963 Jul;6:349–356. doi: 10.1901/jeab.1963.6-349. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES