Skip to main content
PMC home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1963;6(3 Pt 2 Suppl):477–506. doi: 10.1901/jeab.1963.6-s477

THE ROLE OF TEMPORAL DISCRIMINATIONS IN THE REINFORCEMENT OF SIDMAN AVOIDANCE BEHAVIOR1

Douglas Anger
PMCID: PMC1404084  PMID: 14013166

Abstract

Animals learn to avoid with the Sidman procedure even though the avoidance response is not followed by the termination of any warning stimulus in the environment. What reinforces this response? The accepted explanation has been that the avoidance response is reinforced when it terminates other behavior that has become aversive by pairing with shock. However, the reinforcement may also be derived from the temporal discriminations that develop with Sidman avoidance. These and other temporal discriminations show that the animal has available some events that vary with the postresponse time. The shock will closely follow the temporal stimuli at long postresponse times and would be expected to make them aversive. The stimuli at short postresponse times would have a relatively low aversiveness due to their more remote relation to shock. Since the avoidance response changes a long postresponse time to a short one, that response would be followed by a decrease in aversiveness which would reinforce it. When sharp temporal discriminations are present, reinforcement from the decrease in aversiveness of temporal stimuli probably plays a dominant role in maintaining the avoidance response. This formulation fits the available data and has adequate answers for the objections that have been raised to earlier conceptions of the role temporal discriminations might play in Sidman avoidance. Although under some conditions the reinforcement in Sidman avoidance seems to be primarily due to the decrease in aversiveness of temporal stimuli, under other conditions there probably is reinforcement from the termination of conditioned aversive responses.

Full text

PDF
477

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. ANGER D. The dependence of interresponse times upon the relative reinforcement of different interresponse times. J Exp Psychol. 1956 Sep;52(3):145–161. doi: 10.1037/h0041255. [DOI] [PubMed] [Google Scholar]
  2. BARLOW J. A. Secondary motivation through classical conditioning: a reconsideration of the nature of backward conditioning. Psychol Rev. 1956 Nov;63(6):406–408. doi: 10.1037/h0042617. [DOI] [PubMed] [Google Scholar]
  3. BLOUGH D. S. Delayed matching in the pigeon. J Exp Anal Behav. 1959 Apr;2:151–160. doi: 10.1901/jeab.1959.2-151. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. BOREN J. J., SIDMAN M. Maintenance of avoidance behaviour with intermittent shocks. Can J Psychol. 1957 Sep;11(3):185–192. doi: 10.1037/h0083704. [DOI] [PubMed] [Google Scholar]
  5. BRUNER A., REVUSKY S. H. Collateral behavior in humans. J Exp Anal Behav. 1961 Oct;4:349–350. doi: 10.1901/jeab.1961.4-349. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. BRUSH F. R., BRUSH E. S., SOLOMON R. L. Traumatic avoidance learning: the effects of CS-US interval with a delayed-conditioning procedure. J Comp Physiol Psychol. 1955 Aug;48(4):285–293. doi: 10.1037/h0043496. [DOI] [PubMed] [Google Scholar]
  7. DAVIS R. C. Response patterns. Trans N Y Acad Sci. 1957 Jun;19(8):731–739. [PubMed] [Google Scholar]
  8. DINSMOOR J. A. Punishment. I. The avoidance hypothesis. Psychol Rev. 1954 Jan;61(1):34–46. doi: 10.1037/h0062725. [DOI] [PubMed] [Google Scholar]
  9. DINSMOOR J. A. Variable-interval escape from stimuli accompanied by shocks. J Exp Anal Behav. 1962 Jan;5:41–47. doi: 10.1901/jeab.1962.5-41. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. FERSTER C. B. Sustained behavior under delayed reinforcement. J Exp Psychol. 1953 Apr;45(4):218–224. doi: 10.1037/h0062158. [DOI] [PubMed] [Google Scholar]
  11. KAMIN L. J. Traumatic avoidance learning: the effects of CS-US interval with a trace-conditioning procedure. J Comp Physiol Psychol. 1954 Feb;47(1):65–72. doi: 10.1037/h0061380. [DOI] [PubMed] [Google Scholar]
  12. KELLEHER R. T., FRY W., COOK L. Inter-response time distribution as a function of differential reinforcement of temporally spaced responses. J Exp Anal Behav. 1959 Apr;2:91–106. doi: 10.1901/jeab.1959.2-91. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. MARTIN B. The assessment of anxiety by physiological behavioral measures. Psychol Bull. 1961 May;58:234–255. doi: 10.1037/h0045492. [DOI] [PubMed] [Google Scholar]
  14. MOWRER O. H., KEEHN J. D. How are intertrial avoidance responses reinforced? Psychol Rev. 1958 Jul;65(4):209–221. doi: 10.1037/h0047079. [DOI] [PubMed] [Google Scholar]
  15. Mechner F. Probability Relations within Response Sequences under Ratio Reinforcement. J Exp Anal Behav. 1958 Apr;1(2):109–121. doi: 10.1901/jeab.1958.1-109. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. SCHUSTER C. R., ZIMMERMAN J. Timing behavior during prolonged treatment with dl-amphetamine. J Exp Anal Behav. 1961 Oct;4:327–330. doi: 10.1901/jeab.1961.4-327. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. SIDMAN M. An adjusting avoidance schedule. J Exp Anal Behav. 1962 Apr;5:271–277. doi: 10.1901/jeab.1962.5-271. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. SIDMAN M. Avoidance conditioning with brief shock and no exteroceptive warning signal. Science. 1953 Aug 7;118(3058):157–158. doi: 10.1126/science.118.3058.157. [DOI] [PubMed] [Google Scholar]
  19. SIDMAN M., BOREN J. J. The use of shock-contingent variations in response-shock intervals for the maintenance of avoidance behavior. J Comp Physiol Psychol. 1957 Dec;50(6):558–562. doi: 10.1037/h0048927. [DOI] [PubMed] [Google Scholar]
  20. SIDMAN M. Drug-behavior interaction. Ann N Y Acad Sci. 1956 Nov 2;65(4):282–302. doi: 10.1111/j.1749-6632.1956.tb49640.x. [DOI] [PubMed] [Google Scholar]
  21. SIDMAN M. Reduction of shock frequency as reinforcement for avoidance behavior. J Exp Anal Behav. 1962 Apr;5:247–257. doi: 10.1901/jeab.1962.5-247. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. SIDMAN M. Some properties of the warning stimulus in avoidance behavior. J Comp Physiol Psychol. 1955 Dec;48(6):444–450. doi: 10.1037/h0047481. [DOI] [PubMed] [Google Scholar]
  23. SIDMAN M. The temporal distribution of avoidance responses. J Comp Physiol Psychol. 1954 Oct;47(5):399–402. doi: 10.1037/h0059155. [DOI] [PubMed] [Google Scholar]
  24. SIDMAN M. Two temporal parameters of the maintenance of avoidance behavior by the white rat. J Comp Physiol Psychol. 1953 Aug;46(4):253–261. doi: 10.1037/h0060730. [DOI] [PubMed] [Google Scholar]
  25. Sidman M. By-products of aversive control. J Exp Anal Behav. 1958 Aug;1(3):265–280. doi: 10.1901/jeab.1958.1-265. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Sidman M. Some Notes on "Bursts" in Free-operant Avoidance Experiments. J Exp Anal Behav. 1958 Apr;1(2):167–172. doi: 10.1901/jeab.1958.1-167. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Stein L., Sidman M., Brady J. V. Some effects of Two Temporal Variables on Conditioned Suppression. J Exp Anal Behav. 1958 Apr;1(2):153–162. doi: 10.1901/jeab.1958.1-153. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. WILSON M. P., KELLER F. S. On the selective reinforcement of spaced responses. J Comp Physiol Psychol. 1953 Jun;46(3):190–193. doi: 10.1037/h0057705. [DOI] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES