Abstract
Two experiments measured pigeons' choices between probabilistic reinforcers and certain but delayed reinforcers. In Experiment 1, a peck on a red key led to a 5-s delay and then a possible reinforcer (with a probability of .2). A peck on a green key led to a certain reinforcer after an adjusting delay. This delay was adjusted over trials so as to estimate an indifference point, or a duration at which the two alternatives were chosen about equally often. In all conditions, red houselights were present during the 5-s delay on reinforced trials with the probabilistic alternative, but the houselight colors on nonreinforced trials differed across conditions. Subjects showed a stronger preference for the probabilistic alternative when the houselights were a different color (white or blue) during the delay on nonreinforced trials than when they were red on both reinforced and nonreinforced trials. These results supported the hypothesis that the value or effectiveness of a probabilistic reinforcer is inversely related to the cumulative time per reinforcer spent in the presence of stimuli associated with the probabilistic alternative. Experiment 2 tested some quantitative versions of this hypothesis by varying the delay for the probabilistic alternative (either 0 s or 2 s) and the probability of reinforcement (from .1 to 1.0). The results were best described by an equation that took into account both the cumulative durations of stimuli associated with the probabilistic reinforcer and the variability in these durations from one reinforcer to the next.
Full text
PDF
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Bower G., McLean J., Meacham J. Value of knowing when reinforcement is due. J Comp Physiol Psychol. 1966 Oct;62(2):184–192. doi: 10.1037/h0023682. [DOI] [PubMed] [Google Scholar]
- Cicerone R. A. Preference for mixed versus constant delay of reinforcement. J Exp Anal Behav. 1976 Mar;25(2):257–261. doi: 10.1901/jeab.1976.25-257. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dunn R., Spetch M. L. Choice with uncertain outcomes: conditioned reinforcement effects. J Exp Anal Behav. 1990 Mar;53(2):201–218. doi: 10.1901/jeab.1990.53-201. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dunn R., Williams B., Royalty P. Devaluation of stimuli contingent on choice: evidence for conditioned reinforcement. J Exp Anal Behav. 1987 Jul;48(1):117–131. doi: 10.1901/jeab.1987.48-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fantino E. Choice and rate of reinforcement. J Exp Anal Behav. 1969 Sep;12(5):723–730. doi: 10.1901/jeab.1969.12-723. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Killeen P. R. Incentive theory: II. Models for choice. J Exp Anal Behav. 1982 Sep;38(2):217–232. doi: 10.1901/jeab.1982.38-217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- LOGAN F. A. DECISION MAKING BY RATS: UNCERTAIN OUTCOME CHOICES. J Comp Physiol Psychol. 1965 Apr;59:246–251. doi: 10.1037/h0021850. [DOI] [PubMed] [Google Scholar]
- Mazur J. E. Probability and delay of reinforcement as factors in discrete-trial choice. J Exp Anal Behav. 1985 May;43(3):341–351. doi: 10.1901/jeab.1985.43-341. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mazur J. E. Theories of probabilistic reinforcement. J Exp Anal Behav. 1989 Jan;51(1):87–99. doi: 10.1901/jeab.1989.51-87. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rachlin H., Green L. Commitment, choice and self-control. J Exp Anal Behav. 1972 Jan;17(1):15–22. doi: 10.1901/jeab.1972.17-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spetch M. L., Belke T. W., Barnet R. C., Dunn R., Pierce W. D. Suboptimal choice in a percentage-reinforcement procedure: effects of signal condition and terminal-link length. J Exp Anal Behav. 1990 Mar;53(2):219–234. doi: 10.1901/jeab.1990.53-219. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vaughan W. Choice: A local analysis. J Exp Anal Behav. 1985 May;43(3):383–405. doi: 10.1901/jeab.1985.43-383. [DOI] [PMC free article] [PubMed] [Google Scholar]