Abstract
Eighteen pigeons served in a discrete-trials short-term memory experiment in which the reinforcement probability for a peck on one of two keys depended on the response reinforced on the previous trial: either the probability of reinforcement on a trial was 0.8 for the same response reinforced on the previous trial and was 0.2 for the other response (Group A), or, it was 0 or 0.2 for the same response and 1.0 or 0.8 for the other response (Group B). A correction procedure ensured that over all trials reinforcement was distributed equally across the left and right keys. The optimal strategy was either a winstay, lose-shift strategy (Group A) or a win-shift, lose-stay strategy (Group B). The retention interval, that is the intertrial interval, was varied. The average probability of choosing the optimal alternative reinforced 80% of the time was 0.96, 0.84, and 0.74 after delays of 2.5, 4.0, and 6.0 sec, respectively for Group A, and was 0.87, 0.81, and 0.55 after delays of 2.5, 4.0, and 6.0 sec, respectively, for Group B. This outcome is consistent with the view that behavior approximated the optimal response strategy but only to an extent permitted by a subject's short-term memory for the cue correlated with reinforcement, that is, its own most-recently reinforced response. More generally, this result is consistent with “molecular” analyses of operant behavior, but is inconsistent with traditional “molar” analyses holding that fundamental controlling relations may be discovered by routinely averaging over different local reinforcement contingencies. In the present experiment, the molar results were byproducts of local reinforcement contingencies involving an organism's own recent behavior.
Keywords: short-term memory, choice, structure of behavior, molar versus molecular analysis, pigeons
Full text
PDF
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- HEARST E. Delayed alternation in the pigeon. J Exp Anal Behav. 1962 Apr;5:225–228. doi: 10.1901/jeab.1962.5-225. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hale J. M., Shimp C. P. Molecular contingencies: reinforcement probability. J Exp Anal Behav. 1975 Nov;24(3):315–321. doi: 10.1901/jeab.1975.24-315. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hawkes L., Shimp C. P. Reinforcement of behavioral patterns: shaping a scallop. J Exp Anal Behav. 1975 Jan;23(1):3–16. doi: 10.1901/jeab.1975.23-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Herrnstein R. J., Loveland D. H. Maximizing and matching on concurrent ratio schedules. J Exp Anal Behav. 1975 Jul;24(1):107–116. doi: 10.1901/jeab.1975.24-107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morgan M. J. Effects of random reinforcement sequences. J Exp Anal Behav. 1974 Sep;22(2):301–310. doi: 10.1901/jeab.1974.22-301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shimp C. P. Organization in memory and behavior. J Exp Anal Behav. 1976 Jul;26(1):113–130. doi: 10.1901/jeab.1976.26-113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shimp C. P. Probabilistically reinforced choice behavior in pigeons. J Exp Anal Behav. 1966 Jul;9(4):443–455. doi: 10.1901/jeab.1966.9-443. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shimp C. P. Synthetic variable-interval schedules of reinforcement. J Exp Anal Behav. 1973 Mar;19(2):311–330. doi: 10.1901/jeab.1973.19-311. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shimp C. P. The concurrent reinforcement of two interresponse times: the relative frequency of an interresponse time equals its relative harmonic length. J Exp Anal Behav. 1969 May;12(3):403–411. doi: 10.1901/jeab.1969.12-403. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shimp C. P. Time allocation and response rate. J Exp Anal Behav. 1974 May;21(3):491–499. doi: 10.1901/jeab.1974.21-491. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Silberberg A., Williams D. R. Choice behavior on discrete trials: a demonstration of the occurrence of a response strategy. J Exp Anal Behav. 1974 Mar;21(2):315–322. doi: 10.1901/jeab.1974.21-315. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Williams B. A. Probability learning as a function of momentary reinforcement probability. J Exp Anal Behav. 1972 May;17(3):363–368. doi: 10.1901/jeab.1972.17-363. [DOI] [PMC free article] [PubMed] [Google Scholar]