Abstract
Animals on interval schedules of reinforcement can rapidly adjust a temporal dependent variable, such as wait time, to changes in the prevailing interreinforcement interval. We describe data on the effects of impulse, step, sine-cyclic, and variable-interval schedules and show that they can be explained by a tuned-trace timing model with a one-back threshold-setting rule. The model can also explain steady-state timing properties such as proportional and Weber law timing and the effects of reinforcement magnitude. The model assumes that food reinforcers and other time markers have a decaying effect (trace) with properties that can be derived from the rate-sensitive property of habituation (the multiple-time-scale model). In timing experiments, response threshold is determined by the trace value at the time of the most recent reinforcement. The model provides a partial account for the learning of multiple intervals, but does not account for scalloping and other postpause features of responding on interval schedules and has some problems with square-wave schedules.
Full Text
The Full Text of this article is available as a PDF (328.3 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Baum W. M. Performances on ratio and interval schedules of reinforcement: Data and theory. J Exp Anal Behav. 1993 Mar;59(2):245–264. doi: 10.1901/jeab.1993.59-245. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Catania A. C., Reynolds G. S. A quantitative analysis of the responding maintained by interval schedules of reinforcement. J Exp Anal Behav. 1968 May;11(3 Suppl):327–383. doi: 10.1901/jeab.1968.11-s327. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Church R. M., Meck W. H., Gibbon J. Application of scalar timing theory to individual trials. J Exp Psychol Anim Behav Process. 1994 Apr;20(2):135–155. doi: 10.1037//0097-7403.20.2.135. [DOI] [PubMed] [Google Scholar]
- Epstein R. Amount consumed varies as a function of feeder design. J Exp Anal Behav. 1985 Jul;44(1):121–125. doi: 10.1901/jeab.1985.44-121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gibbon J., Church R. M. Representation of time. Cognition. 1990 Nov;37(1-2):23–54. doi: 10.1016/0010-0277(90)90017-e. [DOI] [PubMed] [Google Scholar]
- Higa J. J. Dynamics of time discrimination: II. The effects of multiple impulses. J Exp Anal Behav. 1996 Jul;66(1):117–134. doi: 10.1901/jeab.1996.66-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Higa J. J., Wynne C. D., Staddon J. E. Dynamics of time discrimination. J Exp Psychol Anim Behav Process. 1991 Jul;17(3):281–291. doi: 10.1037//0097-7403.17.3.281. [DOI] [PubMed] [Google Scholar]
- Killeen P. R., Fetterman J. G. A behavioral theory of timing. Psychol Rev. 1988 Apr;95(2):274–295. doi: 10.1037/0033-295x.95.2.274. [DOI] [PubMed] [Google Scholar]
- Lejeune H., Ferrara A., Simons F., Wearden J. H. Adjusting to changes in the time of reinforcement: peak-interval transitions in rats. J Exp Psychol Anim Behav Process. 1997 Apr;23(2):211–231. doi: 10.1037//0097-7403.23.2.211. [DOI] [PubMed] [Google Scholar]
- Lowe C. F., Davey G. C., Harzem P. Effects of reinforcement magnitude on interval and ratio schedules. J Exp Anal Behav. 1974 Nov;22(3):553–560. doi: 10.1901/jeab.1974.22-553. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Machado A. Learning the temporal dynamics of behavior. Psychol Rev. 1997 Apr;104(2):241–265. doi: 10.1037/0033-295x.104.2.241. [DOI] [PubMed] [Google Scholar]
- STADDON J. E. SOME PROPERTIES OF SPACED RESPONDING IN PIGEONS. J Exp Anal Behav. 1965 Jan;8:19–27. doi: 10.1901/jeab.1965.8-19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Staddon J. E. Attention and temporal discrimination: factors controlling responding under a cyclic-interval schedule. J Exp Anal Behav. 1967 Jul;10(4):349–359. doi: 10.1901/jeab.1967.10-349. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Staddon J. E. Effect of reinforcement duration on fixed-interval responding. J Exp Anal Behav. 1970 Jan;13(1):9–11. doi: 10.1901/jeab.1970.13-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Staddon J. E., Higa J. J. Multiple time scales in simple habituation. Psychol Rev. 1996 Oct;103(4):720–733. doi: 10.1037/0033-295x.103.4.720. [DOI] [PubMed] [Google Scholar]
- Staddon J. E., Higa J. J. Time and memory: towards a pacemaker-free theory of interval timing. J Exp Anal Behav. 1999 Mar;71(2):215–251. doi: 10.1901/jeab.1999.71-215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Staddon J., Higa J., Chelaru I. Time, trace, memory. J Exp Anal Behav. 1999 Mar;71(2):293–301. doi: 10.1901/jeab.1999.71-293. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wynne C. D., Staddon J. E. Typical delay determines waiting time on periodic-food schedules: Static and dynamic tests. J Exp Anal Behav. 1988 Sep;50(2):197–210. doi: 10.1901/jeab.1988.50-197. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wynne C. D., Staddon J. E. Waiting in pigeons: the effects of daily intercalation on temporal discrimination. J Exp Anal Behav. 1992 Jul;58(1):47–66. doi: 10.1901/jeab.1992.58-47. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zeiler M. D., Powell D. G. Temporal control in fixed-interval schedules. J Exp Anal Behav. 1994 Jan;61(1):1–9. doi: 10.1901/jeab.1994.61-1. [DOI] [PMC free article] [PubMed] [Google Scholar]