Skip to main content
PMC home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 2001 May;75(3):311–333. doi: 10.1901/jeab.2001.75-311

Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing.

J A Dinsmoor 1
PMCID: PMC1284820  PMID: 11453621

Abstract

A molecular analysis based on the termination of stimuli that are positively correlated with shock and the production of stimuli that are negatively correlated with shock provides a parsimonious count for both traditional discrete-trial avoidance behavior and the data derived from more recent free-operant procedures. The necessary stimuli are provided by the intrinsic feedback generated by the subject's behavior, in addition to those presented by the experimenter. Moreover, all data compatible with the molar principle of shock-frequency reduction as reinforcement are also compatible with a delay-of-shock gradient, but some data compatible with the delay gradient are not compatible with frequency reduction. The delay gradient corresponds to functions relating magnitude of behavioral effect to the time between conditional and unconditional stimuli, the time between conditioned and primary reinforcers, and the time between responses and positive reinforcers.

Full Text

The Full Text of this article is available as a PDF (431.8 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. ANGER D. The dependence of interresponse times upon the relative reinforcement of different interresponse times. J Exp Psychol. 1956 Sep;52(3):145–161. doi: 10.1037/h0041255. [DOI] [PubMed] [Google Scholar]
  2. ANGER D. The role of temporal discriminations in the reinforcement of Sidman avoidance behavior. J Exp Anal Behav. 1963 Jul;6(3):477–506. doi: 10.1901/jeab.1963.6-s477. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. AZRIN N. H., HOLZ W. C., HAKE D. F., AYLLON T. Fixed-ratio escape reinforcement. J Exp Anal Behav. 1963 Jul;6:449–456. doi: 10.1901/jeab.1963.6-449. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Anger D. The effect upon simple animal behavior of different frequencies of reinforcement, Part II: separate control of the reinforcement of different IRTs. J Exp Anal Behav. 1973 Sep;20(2):301–312. doi: 10.1901/jeab.1973.20-301. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. BOLLES R. C., POPP R. J., Jr PARAMETERS AFFECTING THE ACQUISITION OF SIDMAN AVOIDANCE. J Exp Anal Behav. 1964 Jul;7:315–321. doi: 10.1901/jeab.1964.7-315. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. BOWER G., STARR R., LAZAROVITZ L. AMOUNT OF RESPONSE-PRODUCED CHANGE IN THE CS AND AVOIDANCE LEARNING. J Comp Physiol Psychol. 1965 Feb;59:13–17. doi: 10.1037/h0021623. [DOI] [PubMed] [Google Scholar]
  7. BROWN J. S., JACOBS A. The role of fear in the motivation and acquisition of responses. J Exp Psychol. 1949 Dec;39(6):747–759. doi: 10.1037/h0062836. [DOI] [PubMed] [Google Scholar]
  8. Baron A., Dewaard R. J., Lipson J. Increased reinforcement when timeout from avoidance includes access to a safe place. J Exp Anal Behav. 1977 May;27(3):479–494. doi: 10.1901/jeab.1977.27-479. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Baron A., Kaufman A., Fazzini D. Density and delay of punishment of free-operant avoidance. J Exp Anal Behav. 1969 Nov;12(6):1029–1037. doi: 10.1901/jeab.1969.12-1029. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Baum W. M., Rachlin H. C. Choice as time allocation. J Exp Anal Behav. 1969 Nov;12(6):861–874. doi: 10.1901/jeab.1969.12-861. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Baum W. M. The correlation-based law of effect. J Exp Anal Behav. 1973 Jul;20(1):137–153. doi: 10.1901/jeab.1973.20-137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Benedict J. O. Response-shock delay as a reinforcer in avoidance behavior. J Exp Anal Behav. 1975 Nov;24(3):323–332. doi: 10.1901/jeab.1975.24-323. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Bersh P. J., Alloy L. B. Avoidance based on shock intensity reduction with no change in shock probability. J Exp Anal Behav. 1978 Nov;30(3):293–300. doi: 10.1901/jeab.1978.30-293. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Bersh P. J., Alloy L. B. Reduction of shock duration as negative reinforcement in free-operant avoidance. J Exp Anal Behav. 1980 Mar;33(2):265–273. doi: 10.1901/jeab.1980.33-265. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Blough D. S. The reinforcement of least-frequent interresponse times. J Exp Anal Behav. 1966 Sep;9(5):581–591. doi: 10.1901/jeab.1966.9-581. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Bolles R. C., Stokes L. W., Younger M. S. Does CS termination reinforce avoidance behavior? J Comp Physiol Psychol. 1966 Oct;62(2):201–207. doi: 10.1037/h0023678. [DOI] [PubMed] [Google Scholar]
  17. Brownstein A. J., Pliskoff S. S. Some effects of relative reinforcement rate and changeover delay in response-independent concurrent schedules of reinforcement. J Exp Anal Behav. 1968 Nov;11(6):683–688. doi: 10.1901/jeab.1968.11-683. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Camp D. S., Raymond G. A., Church R. M. Temporal relationship between response and punishment. J Exp Psychol. 1967 May;74(1):114–123. doi: 10.1037/h0024518. [DOI] [PubMed] [Google Scholar]
  19. Cohen P. S. Punishment: the interactive effects of delay and intensity of shock. J Exp Anal Behav. 1968 Nov;11(6):789–799. doi: 10.1901/jeab.1968.11-789. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Cole M. Molar And Molecular Control In Variable-interval And Variable-ratio Schedules. J Exp Anal Behav. 1999 May;71(3):319–328. doi: 10.1901/jeab.1999.71-319. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. DINSMOOR J. A., CLAYTON M. H. Chaining and secondary reinforcement based on escape from shock. J Exp Anal Behav. 1963 Jan;6:75–80. doi: 10.1901/jeab.1963.6-75. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. DINSMOOR J. A. Punishment. I. The avoidance hypothesis. Psychol Rev. 1954 Jan;61(1):34–46. doi: 10.1037/h0062725. [DOI] [PubMed] [Google Scholar]
  23. DINSMOOR J. A. The effect of periodic reinforcement of bar-pressing in the presence of a discriminative stimulus. J Comp Physiol Psychol. 1951 Aug;44(4):354–361. doi: 10.1037/h0060006. [DOI] [PubMed] [Google Scholar]
  24. DINSMOOR J. A. Variable-interval escape from stimuli accompanied by shocks. J Exp Anal Behav. 1962 Jan;5:41–47. doi: 10.1901/jeab.1962.5-41. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. De Villiers P. A. Reinforcement and response rate interaction in multiple random-interval avoidance schedules. J Exp Anal Behav. 1972 Nov;18(3):499–507. doi: 10.1901/jeab.1972.18-499. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. De Villiers P. A. The law of effect and avoidance: a quantitative relationship between response rate and shock-frequency reduction. J Exp Anal Behav. 1974 Mar;21(2):223–235. doi: 10.1901/jeab.1974.21-223. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Dinsmoor J. A., Bowe C. A., Green L., Hanson J. Information on response requirements compared with information on food density as a reinforcer of observing in pigeons. J Exp Anal Behav. 1988 Mar;49(2):229–237. doi: 10.1901/jeab.1988.49-229. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Dinsmoor J. A., Clayton M. H. A conditioned reinforcer maintained by temporal association with the termination of shock. J Exp Anal Behav. 1966 Sep;9(5):547–552. doi: 10.1901/jeab.1966.9-547. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Dinsmoor J. A. Escape, avoidance, punishment: where do we stand? J Exp Anal Behav. 1977 Jul;28(1):83–95. doi: 10.1901/jeab.1977.28-83. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Dinsmoor J. A., Lee D. M., Brown M. M. Escape from serial stimuli leading to food. J Exp Anal Behav. 1986 Nov;46(3):259–279. doi: 10.1901/jeab.1986.46-259. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Donahoe J. W., Palmer D. C., Burgos J. E. The S-R issue: its status in behavior analysis and in Donahoe and Palmer's learning and complex behavior. J Exp Anal Behav. 1997 Mar;67(2):193–211. doi: 10.1901/jeab.1997.67-193. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. FIELD G. E., BOREN J. J. AN ADJUSTING AVOIDANCE PROCEDURE WITH MULTIPLE AUDITORY AND VISUAL WARNING STIMULI. J Exp Anal Behav. 1963 Oct;6:537–543. doi: 10.1901/jeab.1963.6-537. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Gardner E. T., Lewis P. Negative reinforcement with shock-frequency increase. J Exp Anal Behav. 1976 Jan;25(1):3–14. doi: 10.1901/jeab.1976.25-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Gardner E. T., Lewis P. Parameters affecting the maintenance of negatively reinforced key pecking. J Exp Anal Behav. 1977 Sep;28(2):117–131. doi: 10.1901/jeab.1977.28-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. HEFFERLINE R. F. An experimental study of avoidance. Genet Psychol Monogr. 1950 Nov;42(2):231–334. [PubMed] [Google Scholar]
  36. HEFFERLINE R. F., PERERA T. B. Proprioceptive discrimination of a covert operant without its observation by the subject. Science. 1963 Mar 1;139(3557):834–835. doi: 10.1126/science.139.3557.834. [DOI] [PubMed] [Google Scholar]
  37. HEFFERLINE R. F. The role of proprioception in the control of behavior. Trans N Y Acad Sci. 1958 Jun;20(8):739–764. doi: 10.1111/j.2164-0947.1958.tb00635.x. [DOI] [PubMed] [Google Scholar]
  38. Herrnstein R. J., Hineline P. N. Negative reinforcement as shock-frequency reduction. J Exp Anal Behav. 1966 Jul;9(4):421–430. doi: 10.1901/jeab.1966.9-421. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Herrnstein R. J. Method and theory in the study of avoidance. Psychol Rev. 1969 Jan;76(1):49–69. doi: 10.1037/h0026786. [DOI] [PubMed] [Google Scholar]
  40. Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Hineline P. N. Aversive control: A separate domain? J Exp Anal Behav. 1984 Nov;42(3):495–509. doi: 10.1901/jeab.1984.42-495. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Hineline P. N. Negative reinforcement without shock reduction. J Exp Anal Behav. 1970 Nov;14(3):259–268. doi: 10.1901/jeab.1970.14-259. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Jenkins H. M., Boakes R. A. Observing stimulus sources that signal food or no food. J Exp Anal Behav. 1973 Sep;20(2):197–207. doi: 10.1901/jeab.1973.20-197. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. KALISH H. I. Strength of fear as a function of the number of acquisition and extinction trials. J Exp Psychol. 1954 Jan;47(1):1–9. doi: 10.1037/h0053732. [DOI] [PubMed] [Google Scholar]
  45. KAMIN L. J. The effects of termination of the CS and avoidance of the US on avoidance learning. J Comp Physiol Psychol. 1956 Aug;49(4):420–424. doi: 10.1037/h0088011. [DOI] [PubMed] [Google Scholar]
  46. KAMIN L. J. The effects of termination of the CS and avoidance of the US on avoidance learning: an extension. Can J Psychol. 1957 Mar;11(1):48–56. doi: 10.1037/h0083690. [DOI] [PubMed] [Google Scholar]
  47. KAMIN L. J. The gradient of delay of secondary reward in avoidance learning. J Comp Physiol Psychol. 1957 Oct;50(5):445–449. doi: 10.1037/h0039982. [DOI] [PubMed] [Google Scholar]
  48. KELLEHER R. T., GOLLUB L. R. A review of positive conditioned reinforcement. J Exp Anal Behav. 1962 Oct;5:543–597. doi: 10.1901/jeab.1962.5-s543. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Katzev R. D., Hendersen R. W. Effects of exteroceptive feedback stimuli on extinguishing avoidance responses in Fischer 344 rats. J Comp Physiol Psychol. 1971 Jan;74(1):66–74. doi: 10.1037/h0030353. [DOI] [PubMed] [Google Scholar]
  50. Katzev R. Extinguishing avoidance responses as a function of delayed warning signal termination. J Exp Psychol. 1967 Nov;75(3):339–344. doi: 10.1037/h0025069. [DOI] [PubMed] [Google Scholar]
  51. Knapp R. K. Acquisition and extinction of avoidance with similar and different shock and escape situations. J Comp Physiol Psychol. 1965 Oct;60(2):272–273. doi: 10.1037/h0022354. [DOI] [PubMed] [Google Scholar]
  52. Krasnegor N. A., Brady J. V., Findley J. D. Second-order optional avoidance as a function of fixed-ratio requirements. J Exp Anal Behav. 1971 Mar;15(2):181–187. doi: 10.1901/jeab.1971.15-181. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. LOGAN F. A. DECISION MAKING BY RATS: DELAY VERSUS AMOUNT OF REWARD. J Comp Physiol Psychol. 1965 Feb;59:1–12. doi: 10.1037/h0021633. [DOI] [PubMed] [Google Scholar]
  54. Lewis P., Gardner E. T., Hutton L. Integrated delays to shock as negative reinforcement. J Exp Anal Behav. 1976 Nov;26(3):379–386. doi: 10.1901/jeab.1976.26-379. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Libby M. E., Church R. M. Timing of avoidance responses by rats. J Exp Anal Behav. 1974 Nov;22(3):513–517. doi: 10.1901/jeab.1974.22-513. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Logue A. W., De Villiers P. A. Matching in concurrent variable-interval avoidance schedules. J Exp Anal Behav. 1978 Jan;29(1):61–66. doi: 10.1901/jeab.1978.29-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. MACCORQUODALE K., MEEHL P. E. Preliminary suggestions as to a formalization of expectancy theory. Psychol Rev. 1953 Jan;60(1):55–63. doi: 10.1037/h0057598. [DOI] [PubMed] [Google Scholar]
  58. MOWRER O. H., KEEHN J. D. How are intertrial avoidance responses reinforced? Psychol Rev. 1958 Jul;65(4):209–221. doi: 10.1037/h0047079. [DOI] [PubMed] [Google Scholar]
  59. MOWRER O. H., LAMOREAUX R. R. Conditioning and conditionality (discrimination). Psychol Rev. 1951 May;58(3):196–212. doi: 10.1037/h0061399. [DOI] [PubMed] [Google Scholar]
  60. Mellitz M., Hineline P. N., Whitehouse W. G., Laurence M. T. Duration-reduction of avoidance sessions as negative reinforcement. J Exp Anal Behav. 1983 Jul;40(1):57–67. doi: 10.1901/jeab.1983.40-57. [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. OSGOOD C. E. Can Tolman's theory of learning handle avoidance training? Psychol Rev. 1950 May;57(3):133–137. doi: 10.1037/h0061424. [DOI] [PubMed] [Google Scholar]
  62. Palya W. L. Bipolar control in fixed interfood intervals. J Exp Anal Behav. 1993 Sep;60(2):345–359. doi: 10.1901/jeab.1993.60-345. [DOI] [PMC free article] [PubMed] [Google Scholar]
  63. RENNER K. E. DELAYED OF REINFORCEMENT: A HISTORICAL REVIEW. Psychol Bull. 1964 May;61:341–361. doi: 10.1037/h0048335. [DOI] [PubMed] [Google Scholar]
  64. RITCHIE B. F. Can reinforcement theory account for avoidance? Psychol Rev. 1951 Sep;58(5):382–386. doi: 10.1037/h0058315. [DOI] [PubMed] [Google Scholar]
  65. Rescorla R. A. Establishment of a positive reinforcer through contrast with shock. J Comp Physiol Psychol. 1969 Feb;67(2):260–263. doi: 10.1037/h0026789. [DOI] [PubMed] [Google Scholar]
  66. SIDMAN M. An adjusting avoidance schedule. J Exp Anal Behav. 1962 Apr;5:271–277. doi: 10.1901/jeab.1962.5-271. [DOI] [PMC free article] [PubMed] [Google Scholar]
  67. SIDMAN M. Avoidance conditioning with brief shock and no exteroceptive warning signal. Science. 1953 Aug 7;118(3058):157–158. doi: 10.1126/science.118.3058.157. [DOI] [PubMed] [Google Scholar]
  68. SIDMAN M., BOREN J. J. A comparison of two types of warning stimulus in an avoidance situation. J Comp Physiol Psychol. 1957 Jun;50(3):282–287. doi: 10.1037/h0046474. [DOI] [PubMed] [Google Scholar]
  69. SIDMAN M. Delayed-punishment effects mediated by competing behavior. J Comp Physiol Psychol. 1954 Apr;47(2):145–147. doi: 10.1037/h0053970. [DOI] [PubMed] [Google Scholar]
  70. SIDMAN M. Reduction of shock frequency as reinforcement for avoidance behavior. J Exp Anal Behav. 1962 Apr;5:247–257. doi: 10.1901/jeab.1962.5-247. [DOI] [PMC free article] [PubMed] [Google Scholar]
  71. SIDMAN M. Some properties of the warning stimulus in avoidance behavior. J Comp Physiol Psychol. 1955 Dec;48(6):444–450. doi: 10.1037/h0047481. [DOI] [PubMed] [Google Scholar]
  72. SIDMAN M. The temporal distribution of avoidance responses. J Comp Physiol Psychol. 1954 Oct;47(5):399–402. doi: 10.1037/h0059155. [DOI] [PubMed] [Google Scholar]
  73. SIDMAN M. Two temporal parameters of the maintenance of avoidance behavior by the white rat. J Comp Physiol Psychol. 1953 Aug;46(4):253–261. doi: 10.1037/h0060730. [DOI] [PubMed] [Google Scholar]
  74. SKINNER B. F. Are theories of learning necessary? Psychol Rev. 1950 Jul;57(4):193–216. doi: 10.1037/h0054367. [DOI] [PubMed] [Google Scholar]
  75. Shimp C. P. Synthetic variable-interval schedules of reinforcement. J Exp Anal Behav. 1973 Mar;19(2):311–330. doi: 10.1901/jeab.1973.19-311. [DOI] [PMC free article] [PubMed] [Google Scholar]
  76. Shimp C. P. The concurrent reinforcement of two interresponse times: the relative frequency of an interresponse time equals its relative harmonic length. J Exp Anal Behav. 1969 May;12(3):403–411. doi: 10.1901/jeab.1969.12-403. [DOI] [PMC free article] [PubMed] [Google Scholar]
  77. Shull R. L., Spear D. J., Bryson A. E. Delay or rate of food delivery as determiners of response rate. J Exp Anal Behav. 1981 Mar;35(2):129–143. doi: 10.1901/jeab.1981.35-129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  78. WINNICK W. A. Anxiety indicators in an avoidance response during conflict and nonconflict. J Comp Physiol Psychol. 1956 Feb;49(1):52–59. doi: 10.1037/h0047943. [DOI] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES