Abstract
Sequences of temporally spaced responses were reinforced to investigate the effects of delay of reinforcement on the formation of functional behavioral units. In Experiment 1, rats' two- and three-response demarcated sequences of left and right lever presses were reinforced such that different response distributions would occur depending on whether the sequences themselves or individual responses were functional units. The matching law could thus be obeyed either by individual responses or by sequences, but not by both; intermediate results were possible. Both regular (nonretractable) and retractable levers were used; the retractable levers precluded the occurrence of insufficiently spaced responses. At a minimum interresponse time of 5 s for regular levers and 7 s for retractable ones, matching results were intermediate, with greater evidence of sequence conditionability in the two-response sequences than in the three-response sequences. In Experiment 2, the required minimum interresponse spacing for two-response retractable-lever sequences was varied in an attempt to locate the sequence matching threshold. This attempt was unsuccessful, but the sequences (instead of individual responses) more closely obeyed the matching law. In the shortest spaced condition, conditional probability data on Lag 1 sequence emission order showed marked, highly similar patterning for all rats, indicating sequential control of the sequences. Post hoc definition of the behavioral unit in these studies is ambiguous. Although reinforcement contiguity was important, aspects of the results could support both molar- and molecular-level interpretations.
Keywords: delay of reinforcement, sequences, behavioral units, matching law, molar–molecular question, behavioral patterns, differential-reinforcement-of-low-rate schedules, lever press, rats
Full text
PDF


















Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Catania A. C. Reinforcement schedules: the role of responses preceding the one that produces the reinforcer. J Exp Anal Behav. 1971 May;15(3):271–287. doi: 10.1901/jeab.1971.15-271. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davison M. C., Hunter I. W. Concurrent schedules: undermatching and control by previous experimental conditions. J Exp Anal Behav. 1979 Sep;32(2):233–244. doi: 10.1901/jeab.1979.32-233. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Decasper A. J., Zeiler M. D. Time limits for completing fixed ratios. III. Stimulus variables. J Exp Anal Behav. 1974 Sep;22(2):285–300. doi: 10.1901/jeab.1974.22-285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fetterman J. G., Stubbs D. A. Matching, maximizing, and the behavioral unit: concurrent reinforcement of response sequences. J Exp Anal Behav. 1982 Jan;37(1):97–114. doi: 10.1901/jeab.1982.37-97. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hackenberg T. D., Hineline P. N. Choice in situations of time-based diminishing returns: immediate versus delayed consequences of action. J Exp Anal Behav. 1992 Jan;57(1):67–80. doi: 10.1901/jeab.1992.57-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Heyman G. M., Herrnstein R. J. More on concurrent interval-ratio schedules: a replication and review. J Exp Anal Behav. 1986 Nov;46(3):331–351. doi: 10.1901/jeab.1986.46-331. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hinson J. M., Staddon J. E. Hill-climbing by pigeons. J Exp Anal Behav. 1983 Jan;39(1):25–47. doi: 10.1901/jeab.1983.39-25. [DOI] [PMC free article] [PubMed] [Google Scholar]
- KELLEHER R. T., FRY W., COOK L. ADJUSTING FIXED-RATIO SCHEDULES IN THE SQUIRREL MONKEY. J Exp Anal Behav. 1964 Jan;7:69–77. doi: 10.1901/jeab.1964.7-69. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Killeen P. Preference for fixed-interval schedules of reinforcement. J Exp Anal Behav. 1970 Sep;14(2):127–131. doi: 10.1901/jeab.1970.14-127. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marcucella H. Signalled reinforcement in differential-reinforcement-of-low rate schedules. J Exp Anal Behav. 1974 Sep;22(2):381–390. doi: 10.1901/jeab.1974.22-381. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mazur J. E. Fixed and variable ratios and delays: further tests of an equivalence rule. J Exp Psychol Anim Behav Process. 1986 Apr;12(2):116–124. [PubMed] [Google Scholar]
- Morgan M. J. Effects of random reinforcement sequences. J Exp Anal Behav. 1974 Sep;22(2):301–310. doi: 10.1901/jeab.1974.22-301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Silberberg A., Ziriax J. M. Molecular maximizing characterizes choice on Vaughan's (1981) procedure. J Exp Anal Behav. 1985 Jan;43(1):83–96. doi: 10.1901/jeab.1985.43-83. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wasserman E. A., Nelson K. R., Larew M. B. Memory for sequences of stimuli and responses. J Exp Anal Behav. 1980 Jul;34(1):49–59. doi: 10.1901/jeab.1980.34-49. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weiss B., Laties V. G., Siegel L., Goldstein D. A computer analysis of serial interactions in spaced responding. J Exp Anal Behav. 1966 Nov;9(6):619–626. doi: 10.1901/jeab.1966.9-619. [DOI] [PMC free article] [PubMed] [Google Scholar]
