Abstract
A pigeon's peck on one key moved a light down one position in a 5×5 matrix of lights, while a peck on another key moved the light across one position. Reinforcement depended upon the occurrence of four pecks on each key (moving the matrix light from the top left to the bottom right), and a fifth peck on either key ended a trial without food. Though there were 70 different sequences that led to reinforcement, each of 12 pigeons developed a particular, stereotyped sequence which dominated its behavior (Experiment 1). Extinction produced substantial increases in sequence variability (Experiment 2). Removal of the matrix cues disrupted performance, though it partially recovered with extended training (Experiment 3). The pigeons did not master a contingency which required a different sequence on the current trial than on the previous one (Experiment 4), though they were able to learn to emit sequences which began with either left-left or left-right response patterns (Experiment 5). The experiments suggest that contingencies of reinforcement may contribute to the creation of complex units of behavior, and that stereotypy may be a likely consequence of contingent reinforcement.
Keywords: response sequences, complex operant, response stereotypy, key peck, pigeons
Full text
PDF













Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- ANTONITIS J. J. Response variability in the white rat during conditioning, extinction, and reconditioning. J Exp Psychol. 1951 Oct;42(4):273–281. doi: 10.1037/h0060407. [DOI] [PubMed] [Google Scholar]
- Blough D. S. The reinforcement of least-frequent interresponse times. J Exp Anal Behav. 1966 Sep;9(5):581–591. doi: 10.1901/jeab.1966.9-581. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brown P. L., Jenkins H. M. Auto-shaping of the pigeon's key-peck. J Exp Anal Behav. 1968 Jan;11(1):1–8. doi: 10.1901/jeab.1968.11-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goetz E. M., Baer D. M. Social control of form diversity and the emergence of new forms in children's blockbuilding. J Appl Behav Anal. 1973 Summer;6(2):209–217. doi: 10.1901/jaba.1973.6-209. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grayson R. J., Wasserman E. A. Conditioning of two-response patterns of key pecking in pigeons. J Exp Anal Behav. 1979 Jan;31(1):23–29. doi: 10.1901/jeab.1979.31-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- HERRNSTEIN R. J. Stereotypy and intermittent reinforcement. Science. 1961 Jun 30;133(3470):2067–2069. doi: 10.1126/science.133.3470.2067-a. [DOI] [PubMed] [Google Scholar]
- Hawkes L., Shimp C. P. Reinforcement of behavioral patterns: shaping a scallop. J Exp Anal Behav. 1975 Jan;23(1):3–16. doi: 10.1901/jeab.1975.23-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- NOTTERMAN J. M. Force emission during bar pressing. J Exp Psychol. 1959 Nov;58:341–347. doi: 10.1037/h0042801. [DOI] [PubMed] [Google Scholar]
- Olton D. S. Mazes, maps, and memory. Am Psychol. 1979 Jul;34(7):583–596. doi: 10.1037//0003-066x.34.7.583. [DOI] [PubMed] [Google Scholar]
- Pryor K. W., Haag R., O'reilly J. The creative porpoise: training for novel behavior. J Exp Anal Behav. 1969 Jul;12(4):653–661. doi: 10.1901/jeab.1969.12-653. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schwartz B. Studies of operant and reflexive key pecks in the pigeon. J Exp Anal Behav. 1977 Mar;27(2):301–313. doi: 10.1901/jeab.1977.27-301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schwartz B. Two types of pigeon key pecking: suppression of long- but not short-duration key pecks by duration-dependent shock. J Exp Anal Behav. 1977 Mar;27(2):393–398. doi: 10.1901/jeab.1977.27-393. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schwartz B., Williams D. R. Two different kinds of key peck in the pigeon: some properties of responses maintained by negative and positive response-reinforcer contingencies. J Exp Anal Behav. 1972 Sep;18(2):201–216. doi: 10.1901/jeab.1972.18-201. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shimp C. P. Short-term memory in the pigeon: the previously reinforced response. J Exp Anal Behav. 1976 Nov;26(3):487–493. doi: 10.1901/jeab.1976.26-487. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Straub R. O., Seidenberg M. S., Bever T. G., Terrace H. S. Serial learning in the pigeon. J Exp Anal Behav. 1979 Sep;32(2):137–148. doi: 10.1901/jeab.1979.32-137. [DOI] [PMC free article] [PubMed] [Google Scholar]
- TULVING E. INTRATRIAL AND INTERTRIAL RETENTION: NOTES TOWARDS A THEORY OF FREE RECALL VERBAL LEARNING. Psychol Rev. 1964 May;71:219–237. doi: 10.1037/h0043186. [DOI] [PubMed] [Google Scholar]
- TULVING E. Subjective organization in free recall of "unrelated" words. Psychol Rev. 1962 Jul;69:344–354. doi: 10.1037/h0043150. [DOI] [PubMed] [Google Scholar]
- Vogel R., Annau Z. An operant discrimination task allowing variability of reinforced response patterning. J Exp Anal Behav. 1973 Jul;20(1):1–6. doi: 10.1901/jeab.1973.20-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wasserman E. A. Conditioning of within-trial patterns of key pecking in pigeons. J Exp Anal Behav. 1977 Nov;28(3):213–220. doi: 10.1901/jeab.1977.28-213. [DOI] [PMC free article] [PubMed] [Google Scholar]