Abstract
Three experiments compared the amounts of behavioral variability generated with two reinforcement rules. In Experiments 1 and 2 pigeons received food whenever they generated a sequence of eight pecks, distributed over two keys, provided that the sequence contained a certain number of change-overs between the keys. Although no variability was required-the birds could obtain all reinforcers by repeating the same sequence-the pigeons emitted a large number of different sequences. In Experiment 3 pigeons received food whenever they generated a sequence that had not occurred during the last 25 trials. After prolonged training, the birds showed more sequence variability than in the first two experiments. The analysis of the internal structure of the response sequences revealed that, in general, (a) the location of the first peck was highly stereotyped; (b) as the trial advanced, the probability of switching to the initially preferred key decreased whereas the probability of switching to the other key increased; and (c) a first-order Markov chain model with transition probabilities given by a logistic function accounted well for the internal structure of the birds' response sequences. These findings suggest that, to a large extent, the variability of response sequences is an indirect effect of adjustments in changeover frequency.
Full Text
The Full Text of this article is available as a PDF (377.1 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Blough D. S. The reinforcement of least-frequent interresponse times. J Exp Anal Behav. 1966 Sep;9(5):581–591. doi: 10.1901/jeab.1966.9-581. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hunziker M. H., Saldana R. L., Neuringer A. Behavioral variability in SHR and WKY rats as a function of rearing environment and reinforcement contingency. J Exp Anal Behav. 1996 Jan;65(1):129–144. doi: 10.1901/jeab.1996.65-129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Machado A. Behavioral variability and frequency-dependent selection. J Exp Anal Behav. 1992 Sep;58(2):241–263. doi: 10.1901/jeab.1992.58-241. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Machado A., Cevik M. The discrimination of relative frequency by pigeons. J Exp Anal Behav. 1997 Jan;67(1):11–41. doi: 10.1901/jeab.1997.67-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Machado A. Operant conditioning of behavioral variability using a percentile reinforcement schedule. J Exp Anal Behav. 1989 Sep;52(2):155–166. doi: 10.1901/jeab.1989.52-155. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morris C. J. The operant conditioning of response variability: Free-operant versus discrete-response procedures. J Exp Anal Behav. 1987 May;47(3):273–277. doi: 10.1901/jeab.1987.47-273. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pryor K. W., Haag R., O'reilly J. The creative porpoise: training for novel behavior. J Exp Anal Behav. 1969 Jul;12(4):653–661. doi: 10.1901/jeab.1969.12-653. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schoenfeld W. N., Harris A. H., Farmer J. Conditioning response variability. Psychol Rep. 1966 Oct;19(2):551–557. doi: 10.2466/pr0.1966.19.2.551. [DOI] [PubMed] [Google Scholar]
- Shimp C. P. Reinforcement of least-frequent sequences of choices. J Exp Anal Behav. 1967 Jan;10(1):57–65. doi: 10.1901/jeab.1967.10-57. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Hest A., van Haaren F., van de Poll N. E. Operant conditioning of response variability in male and female Wistar rats. Physiol Behav. 1989 Mar;45(3):551–555. doi: 10.1016/0031-9384(89)90072-3. [DOI] [PubMed] [Google Scholar]