Abstract
Several theories in the learning literature describe decision rules for performance utilizing ratios and differences. The present paper analyzes rules for choice based on either delays to food, immediacies (the inverse of delays), or rates of food, combined factorially with a ratio or difference comparator. An experiment using the time-left procedure (Gibbon & Church, 1981) is reported with motivational differentials induced by unequal reinforcement durations. The preference results were compatible with a ratio-comparator decision rule, but not with decision rules based on differences. Differential reinforcement amounts were functionally equivalent to changes in delays to food. Under biased reinforcement, overall food rate was increased, but variance in preference was increased or decreased depending on which alternative was favored. This is a Weber law finding that is compatible with multiplicative, scalar sources of variance but incompatible with pacemaker rate changes proportional to food presentation rate.
Full text
PDF

























Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Baum W. M., Rachlin H. C. Choice as time allocation. J Exp Anal Behav. 1969 Nov;12(6):861–874. doi: 10.1901/jeab.1969.12-861. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chung S. H., Herrnstein R. J. Choice and delay of reinforcement. J Exp Anal Behav. 1967 Jan;10(1):67–74. doi: 10.1901/jeab.1967.10-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davison M. C., Tustin R. D. The relation between the generalized matching law and signal-detection theory. J Exp Anal Behav. 1978 Mar;29(2):331–336. doi: 10.1901/jeab.1978.29-331. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Epstein R. Amount consumed varies as a function of feeder design. J Exp Anal Behav. 1985 Jul;44(1):121–125. doi: 10.1901/jeab.1985.44-121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gibbon J., Church R. M. Comparison of variance and covariance patterns in parallel and serial theories of timing. J Exp Anal Behav. 1992 May;57(3):393–406. doi: 10.1901/jeab.1992.57-393. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gibbon J., Church R. M., Fairhurst S., Kacelnik A. Scalar expectancy theory and choice between delayed rewards. Psychol Rev. 1988 Jan;95(1):102–114. doi: 10.1037/0033-295x.95.1.102. [DOI] [PubMed] [Google Scholar]
- Gibbon J., Church R. M., Meck W. H. Scalar timing in memory. Ann N Y Acad Sci. 1984;423:52–77. doi: 10.1111/j.1749-6632.1984.tb23417.x. [DOI] [PubMed] [Google Scholar]
- HERRNSTEIN R. J. Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav. 1961 Jul;4:267–272. doi: 10.1901/jeab.1961.4-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Killeen P. R., Fetterman J. G. A behavioral theory of timing. Psychol Rev. 1988 Apr;95(2):274–295. doi: 10.1037/0033-295x.95.2.274. [DOI] [PubMed] [Google Scholar]
- Killeen P. R. Incentive theory: II. Models for choice. J Exp Anal Behav. 1982 Sep;38(2):217–232. doi: 10.1901/jeab.1982.38-217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Killeen P. On the measurement of reinforcement frequency in the study of preference. J Exp Anal Behav. 1968 May;11(3):263–269. doi: 10.1901/jeab.1968.11-263. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Logue A. W., Peña-Correal T. E. Responding during reinforcement delay in a self-control paradigm. J Exp Anal Behav. 1984 May;41(3):267–277. doi: 10.1901/jeab.1984.41-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mazur J. E. Choice behavior in transition: development of preference with ratio and interval schedules. J Exp Psychol Anim Behav Process. 1992 Oct;18(4):364–378. doi: 10.1037//0097-7403.18.4.364. [DOI] [PubMed] [Google Scholar]
- McCarthy D., Davison M. On the discriminability of stimulus duration. J Exp Anal Behav. 1980 Mar;33(2):187–211. doi: 10.1901/jeab.1980.33-187. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pearce J. M., Hall G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol Rev. 1980 Nov;87(6):532–552. [PubMed] [Google Scholar]
- Rescorla R. A. Probability of shock in the presence and absence of CS in fear conditioning. J Comp Physiol Psychol. 1968 Aug;66(1):1–5. doi: 10.1037/h0025984. [DOI] [PubMed] [Google Scholar]
- Ten Eyck R. L. Effects of rate of reinforcement-time upon concurrent operant performance. J Exp Anal Behav. 1970 Nov;14(3):269–274. doi: 10.1901/jeab.1970.14-269. [DOI] [PMC free article] [PubMed] [Google Scholar]