Abstract
Delay-reduction theory states that the effectiveness of a stimulus as a conditioned reinforcer may be predicted most accurately by the reduction in time to primary reinforcement correlated with its onset. We review support for the theory and then discuss two new types of experiments that assess it. One compares models of choice in situations wherein the less preferred outcome is made more accessible; the other investigates whether frequency of conditioned reinforcement affects choice beyond the effect exerted by frequency of primary reinforcement.
Full text
PDF










Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Abarca N., Fantino E. Choice and foraging. J Exp Anal Behav. 1982 Sep;38(2):117–123. doi: 10.1901/jeab.1982.38-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- CATANIA A. C. Concurrent performances: a baseline for the study of reinforcement magnitude. J Exp Anal Behav. 1963 Apr;6:299–300. doi: 10.1901/jeab.1963.6-299. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Case D. A., Fantino E. The delay-reduction hypothesis of conditioned reinforcement and punishment: Observing behavior. J Exp Anal Behav. 1981 Jan;35(1):93–108. doi: 10.1901/jeab.1981.35-93. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davison M. C., Temple W. Preference for fixed-interval schedules: an alternative model. J Exp Anal Behav. 1973 Nov;20(3):393–403. doi: 10.1901/jeab.1973.20-393. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dunn R. M. Choice, relative reinforcer duration, and the changeover ratio. J Exp Anal Behav. 1982 Nov;38(3):313–319. doi: 10.1901/jeab.1982.38-313. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dunn R., Fantino E. Choice and the relative immediacy of reinforcement. J Exp Anal Behav. 1982 Nov;38(3):321–326. doi: 10.1901/jeab.1982.38-321. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dunn R., Spetch M. L. Choice with uncertain outcomes: conditioned reinforcement effects. J Exp Anal Behav. 1990 Mar;53(2):201–218. doi: 10.1901/jeab.1990.53-201. [DOI] [PMC free article] [PubMed] [Google Scholar]
- ELLISON G. D., KONORSKI J. SEPARATION OF THE SALIVARY AND MOTOR RESPONSES IN INSTRUMENTAL CONDITIONING. Science. 1964 Nov 20;146(3647):1071–1072. doi: 10.1126/science.146.3647.1071. [DOI] [PubMed] [Google Scholar]
- Fantino E., Case D. A. Human observing: Maintained by stimuli correlated with reinforcement but not extinction. J Exp Anal Behav. 1983 Sep;40(2):193–210. doi: 10.1901/jeab.1983.40-193. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fantino E. Choice and rate of reinforcement. J Exp Anal Behav. 1969 Sep;12(5):723–730. doi: 10.1901/jeab.1969.12-723. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fantino E., Davison M. Choice: Some quantitative relations. J Exp Anal Behav. 1983 Jul;40(1):1–13. doi: 10.1901/jeab.1983.40-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fantino E., Duncan B. Some effects of interreinforcement time upon choice. J Exp Anal Behav. 1972 Jan;17(1):3–14. doi: 10.1901/jeab.1972.17-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fantino E., Freed D., Preston R. A., Williams W. A. Choice and conditioned reinforcement. J Exp Anal Behav. 1991 Mar;55(2):177–188. doi: 10.1901/jeab.1991.55-177. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fantino E., Preston R. A. Choice and foraging: the effects of accessibility on acceptability. J Exp Anal Behav. 1988 Nov;50(3):395–403. doi: 10.1901/jeab.1988.50-395. [DOI] [PMC free article] [PubMed] [Google Scholar]
- HERRNSTEIN R. J. SECONDARY REINFORCEMENT AND RATE OF PRIMARY REINFORCEMENT. J Exp Anal Behav. 1964 Jan;7:27–36. doi: 10.1901/jeab.1964.7-27. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hursh S. R. Economic concepts for the analysis of behavior. J Exp Anal Behav. 1980 Sep;34(2):219–238. doi: 10.1901/jeab.1980.34-219. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ito M., Asaki K. Choice behavior of rats in a concurrent-chains schedule: Amount and delay of reinforcement. J Exp Anal Behav. 1982 May;37(3):383–392. doi: 10.1901/jeab.1982.37-383. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ito M., Fantino E. Choice, foraging, and reinforcer duration. J Exp Anal Behav. 1986 Jul;46(1):93–103. doi: 10.1901/jeab.1986.46-93. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Killeen P. R., Fantino E. Unification of models for choice between delayed reinforcers. J Exp Anal Behav. 1990 Jan;53(1):189–200. doi: 10.1901/jeab.1990.53-189. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Killeen P. R. Incentive theory: II. Models for choice. J Exp Anal Behav. 1982 Sep;38(2):217–232. doi: 10.1901/jeab.1982.38-217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- LaFiette M. H., Fantino E. Responding on concurrent-chains schedules in open and closed economies. J Exp Anal Behav. 1989 May;51(3):329–342. doi: 10.1901/jeab.1989.51-329. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Luco J. E. Matching, delay-reduction, and maximizing models for choice in concurrent-chains schedules. J Exp Anal Behav. 1990 Jul;54(1):53–67. doi: 10.1901/jeab.1990.54-53. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Preston R. A., Fantino E. Conditioned reinforcement value and choice. J Exp Anal Behav. 1991 Mar;55(2):155–175. doi: 10.1901/jeab.1991.55-155. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ricci J. A. Key pecking under response-independent food presentation after long simple and compound stimuli. J Exp Anal Behav. 1973 May;19(3):509–516. doi: 10.1901/jeab.1973.19-509. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Royalty P., Williams B. A., Fantino E. Effects of delayed conditioned reinforcement in chain schedules. J Exp Anal Behav. 1987 Jan;47(1):41–56. doi: 10.1901/jeab.1987.47-41. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spetch M. L., Belke T. W., Barnet R. C., Dunn R., Pierce W. D. Suboptimal choice in a percentage-reinforcement procedure: effects of signal condition and terminal-link length. J Exp Anal Behav. 1990 Mar;53(2):219–234. doi: 10.1901/jeab.1990.53-219. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spetch M. L., Dunn R. Choice between reliable and unreliable outcomes: mixed percentage-reinforcement in concurrent chains. J Exp Anal Behav. 1987 Jan;47(1):57–72. doi: 10.1901/jeab.1987.47-57. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Squires N., Fantino E. A model for choice in simple concurrent and concurrent-chains schedules. J Exp Anal Behav. 1971 Jan;15(1):27–38. doi: 10.1901/jeab.1971.15-27. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vaughan W. Choice: A local analysis. J Exp Anal Behav. 1985 May;43(3):383–405. doi: 10.1901/jeab.1985.43-383. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Williams B. A., Dunn R. Preference for conditioned reinforcement. J Exp Anal Behav. 1991 Jan;55(1):37–46. doi: 10.1901/jeab.1991.55-37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wixted J. T. Nonhuman short-term memory: A quantitative reanalysis of selected findings. J Exp Anal Behav. 1989 Nov;52(3):409–426. doi: 10.1901/jeab.1989.52-409. [DOI] [PMC free article] [PubMed] [Google Scholar]