Abstract
When a pigeon's choices between two keys are probabilistically reinforced, as in discrete trial probability learning procedures and in concurrent variable-interval schedules, the bird tends to maximize, or to choose the alternative with the higher probability of reinforcement. In concurrent variable-interval schedules, steady-state matching, which is an approximate equality between the relative frequency of a response and the relative frequency of reinforcement of that response, has previously been obtained only as a consequence of maximizing. In the present experiment, maximizing was impossible. A choice of one of two keys was reinforced only if it formed, together with the three preceding choices, the sequence of four successive choices that had occurred least often. This sequence was determined by a Bernoulli-trials process with parameter p. Each of three pigeons matched when p was ½ or ¼. Therefore, steady-state matching by individual birds is not always a consequence of maximizing. Choice probability varied between successive reinforcements, and sequential statistics revealed dependencies which were adequately described by a Bernoulli-trials process with p depending on the time since the preceding reinforcement.
Full text
PDF
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- ANGER D. The dependence of interresponse times upon the relative reinforcement of different interresponse times. J Exp Psychol. 1956 Sep;52(3):145–161. doi: 10.1037/h0041255. [DOI] [PubMed] [Google Scholar]
- Blough D. S. The reinforcement of least-frequent interresponse times. J Exp Anal Behav. 1966 Sep;9(5):581–591. doi: 10.1901/jeab.1966.9-581. [DOI] [PMC free article] [PubMed] [Google Scholar]
- CATANIA A. C. Concurrent performances: reinforcement interaction and response independence. J Exp Anal Behav. 1963 Apr;6:253–263. doi: 10.1901/jeab.1963.6-253. [DOI] [PMC free article] [PubMed] [Google Scholar]
- CLARK W. A., MOLNAR C. E. THE LINC: A DESCRIPTION OF THE LABORATORY INSTRUMENT COMPUTER. Ann N Y Acad Sci. 1964 Jul 31;115:653–668. [PubMed] [Google Scholar]
- GRAF V., BULLOCK D. H., BITTERMAN M. E. FURTHER EXPERIMENTS ON PROBABILITY-MATCHING IN THE PIGEON. J Exp Anal Behav. 1964 Mar;7:151–157. doi: 10.1901/jeab.1964.7-151. [DOI] [PMC free article] [PubMed] [Google Scholar]
- HERRNSTEIN R. J. SECONDARY REINFORCEMENT AND RATE OF PRIMARY REINFORCEMENT. J Exp Anal Behav. 1964 Jan;7:27–36. doi: 10.1901/jeab.1964.7-27. [DOI] [PMC free article] [PubMed] [Google Scholar]
- REYNOLDS G. S. On some determinants of choice in pigeons. J Exp Anal Behav. 1963 Jan;6:53–59. doi: 10.1901/jeab.1963.6-53. [DOI] [PMC free article] [PubMed] [Google Scholar]
- REYNOLDS G. S. Relativity of response rate and reinforcement frequency in a multiple schedule. J Exp Anal Behav. 1961 Apr;4:179–184. doi: 10.1901/jeab.1961.4-179. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shimp C. P. Probabilistically reinforced choice behavior in pigeons. J Exp Anal Behav. 1966 Jul;9(4):443–455. doi: 10.1901/jeab.1966.9-443. [DOI] [PMC free article] [PubMed] [Google Scholar]