Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1987 Jul;48(1):117–131. doi: 10.1901/jeab.1987.48-117

Devaluation of stimuli contingent on choice: evidence for conditioned reinforcement.

R Dunn, B Williams, P Royalty
PMCID: PMC1338747  PMID: 3625101

Abstract

Pigeons were presented a concurrent-chains schedule of reinforcement that had terminal links of equal duration. The initial links of the schedule were periodically interrupted by 15-s periods during which an extinction schedule was in effect. The extinction periods were presented on either a response-contingent or a noncontingent basis. Relative response rate for the left alternative decreased when the extinction periods were accompanied by the left terminal-link stimulus. Relative response rate for the right alternative decreased when the extinction periods were accompanied by the right terminal-link stimulus. Relative response rate varied inversely with the frequency of presentation of the extinction periods but was unaffected by presence versus absence of the response contingency in the schedule of extinction-period presentation. Furthermore, relative response rate was unaffected by presentation of extinction periods accompanied by a novel stimulus. When the extinction periods were presented after reinforcement in the left terminal link instead of as interruptions of the initial links, relative response rate for the left alternative was reduced if the postreinforcement extinction period was accompanied by the terminal-link stimulus for the left chain and reduced less if the extinction period was accompanied by the terminal-link stimulus for the right chain. The results demonstrate that the correlation between the terminal-link stimulus and extinction influenced the relative response rate in the initial link.

Full text

PDF
117

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Chung S. H., Herrnstein R. J. Choice and delay of reinforcement. J Exp Anal Behav. 1967 Jan;10(1):67–74. doi: 10.1901/jeab.1967.10-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Duncan B., Fantino E. The psychological distance to reward. J Exp Anal Behav. 1972 Jul;18(1):23–34. doi: 10.1901/jeab.1972.18-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Dunn R., Fantino E. Choice and the relative immediacy of reinforcement. J Exp Anal Behav. 1982 Nov;38(3):321–326. doi: 10.1901/jeab.1982.38-321. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Fantino E., Dunn R., Meck W. Percentage reinforcement and choice. J Exp Anal Behav. 1979 Nov;32(3):335–340. doi: 10.1901/jeab.1979.32-335. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Fantino E. Preference for mixed- versus fixed-ratio schedules. J Exp Anal Behav. 1967 Jan;10(1):35–43. doi: 10.1901/jeab.1967.10-35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. HERRNSTEIN R. J. APERIODICITY AS A FACTOR IN CHOICE. J Exp Anal Behav. 1964 Mar;7:179–182. doi: 10.1901/jeab.1964.7-179. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. HERRNSTEIN R. J. SECONDARY REINFORCEMENT AND RATE OF PRIMARY REINFORCEMENT. J Exp Anal Behav. 1964 Jan;7:27–36. doi: 10.1901/jeab.1964.7-27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Hursh S. R., Fantino E. Relative delay of reinforcement and choice. J Exp Anal Behav. 1973 May;19(3):437–450. doi: 10.1901/jeab.1973.19-437. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Kendall S. B. Preference for intermittent reinforcement. J Exp Anal Behav. 1974 May;21(3):463–473. doi: 10.1901/jeab.1974.21-463. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Killeen P. On the measurement of reinforcement frequency in the study of preference. J Exp Anal Behav. 1968 May;11(3):263–269. doi: 10.1901/jeab.1968.11-263. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. LOGAN F. A. DECISION MAKING BY RATS: DELAY VERSUS AMOUNT OF REWARD. J Comp Physiol Psychol. 1965 Feb;59:1–12. doi: 10.1037/h0021633. [DOI] [PubMed] [Google Scholar]
  12. Leung J. P., Winton A. S. Preference for less segmented fixed-time components in concurrent-chain schedules of reinforcement. J Exp Anal Behav. 1986 Sep;46(2):175–183. doi: 10.1901/jeab.1986.46-175. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Leung J. P., Winton A. S. Preference for unsegmented interreinforcement intervals in concurrent chains. J Exp Anal Behav. 1985 Jul;44(1):89–101. doi: 10.1901/jeab.1985.44-89. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Mazur J. E. Choice between single and multiple delayed reinforcers. J Exp Anal Behav. 1986 Jul;46(1):67–77. doi: 10.1901/jeab.1986.46-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Mazur J. E. Probability and delay of reinforcement as factors in discrete-trial choice. J Exp Anal Behav. 1985 May;43(3):341–351. doi: 10.1901/jeab.1985.43-341. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Mazur J. E., Snyderman M., Coe D. Influences of delay and rate of reinforcement on discrete-trial choice. J Exp Psychol Anim Behav Process. 1985 Oct;11(4):565–575. [PubMed] [Google Scholar]
  17. Poniewaz W. R. Effects on preference of reinforcement delay, number of reinforcers, and terminal-link duration. J Exp Anal Behav. 1984 Sep;42(2):255–266. doi: 10.1901/jeab.1984.42-255. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Rescorla R. A. Effect of a stimulus intervening between CS and US in autoshaping. J Exp Psychol Anim Behav Process. 1982 Apr;8(2):131–141. [PubMed] [Google Scholar]
  19. Schneider B. A. A two-state analysis of fixed-interval responding in the pigeon. J Exp Anal Behav. 1969 Sep;12(5):677–687. doi: 10.1901/jeab.1969.12-677. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Schneider J. W. Reinforcer effectiveness as a function of reinforcer rate and magnitude: a comparison of concurrent performances. J Exp Anal Behav. 1973 Nov;20(3):461–471. doi: 10.1901/jeab.1973.20-461. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Shull R. L., Spear D. J., Bryson A. E. Delay or rate of food delivery as determiners of response rate. J Exp Anal Behav. 1981 Mar;35(2):129–143. doi: 10.1901/jeab.1981.35-129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Spetch M. L., Dunn R. Choice between reliable and unreliable outcomes: mixed percentage-reinforcement in concurrent chains. J Exp Anal Behav. 1987 Jan;47(1):57–72. doi: 10.1901/jeab.1987.47-57. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Todorov J. C., Hanna E. S., Bittencourt De Sá M. C. Frequency versus magnitude of reinforcement: New data with a different procedure. J Exp Anal Behav. 1984 Mar;41(2):157–167. doi: 10.1901/jeab.1984.41-157. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Todorov J. C. Interaction of frequency and magnitude of reinforcement on concurrent performances. J Exp Anal Behav. 1973 May;19(3):451–458. doi: 10.1901/jeab.1973.19-451. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Vaughan W. Choice: A local analysis. J Exp Anal Behav. 1985 May;43(3):383–405. doi: 10.1901/jeab.1985.43-383. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Williams B. A. Contrast, component duration, and the following schedule of reinforcement. J Exp Psychol Anim Behav Process. 1979 Oct;5(4):379–396. doi: 10.1037//0097-7403.5.4.379. [DOI] [PubMed] [Google Scholar]
  27. Williams B. A., Fantino E. Effects on choice of reinforcement delay and conditioned reinforcement. J Exp Anal Behav. 1978 Jan;29(1):77–86. doi: 10.1901/jeab.1978.29-77. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Williams B. A. The following schedule of reinforcement as a fundamental determinant of steady state contrast in multiple schedules. J Exp Anal Behav. 1981 May;35(3):293–310. doi: 10.1901/jeab.1981.35-293. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Winter J., Perkins C. C. Immediate reinforcement in delayed reward learning in pigeons. J Exp Anal Behav. 1982 Sep;38(2):169–179. doi: 10.1901/jeab.1982.38-169. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES