Abstract
Six pigeons were trained in a procedure in which sessions included seven unsignaled components, each offering two pecking keys, and each providing a potentially different reinforcer ratio between the two keys. Across conditions, various combinations of reinforcer ratios and reinforcer-magnitude ratios were used to create unequal reinforcer distributions between the two alternatives when averaged across a session. The results extended previous research using the same basic procedure that had included only reinforcer distributions symmetrical around 1:1. Data analyses suggested that the variables controlling choice operated at a number of levels: First, individual reinforcers had local effects on choice; second, sequences of successive reinforcers obtained at the same alternative (continuations) had cumulative effects; and, third, when these sequences themselves occurred with greater frequency, their effects further cumulated. A reinforcer obtained at the other alternative following a sequence of continuations (a discontinuation) had a large effect and apparently reset choice to levels approximating the sessional reinforcer ratio.
Full Text
The Full Text of this article is available as a PDF (291.8 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Bailey J. T., Mazur J. E. Choice behavior in transition: development of preference for the higher probability of reinforcement. J Exp Anal Behav. 1990 May;53(3):409–422. doi: 10.1901/jeab.1990.53-409. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baum W. M. On two types of deviation from the matching law: bias and undermatching. J Exp Anal Behav. 1974 Jul;22(1):231–242. doi: 10.1901/jeab.1974.22-231. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Belke T. W., Heyman G. M. Increasing and signaling background reinforcement: effect on the foreground response-reinforcer relation. J Exp Anal Behav. 1994 Jan;61(1):65–81. doi: 10.1901/jeab.1994.61-65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davison M., Baum W. M. Choice in a variable environment: every reinforcer counts. J Exp Anal Behav. 2000 Jul;74(1):1–24. doi: 10.1901/jeab.2000.74-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davison Michael, Baum William M. Choice in a variable environment: effects of blackout duration and extinction between components. J Exp Anal Behav. 2002 Jan;77(1):65–89. doi: 10.1901/jeab.2002.77-65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davison Michael, Baum William M. Every reinforcer counts: reinforcer magnitude and local preference. J Exp Anal Behav. 2003 Jul;80(1):95–129. doi: 10.1901/jeab.2003.80-95. [DOI] [PMC free article] [PubMed] [Google Scholar]
- HERRNSTEIN R. J. Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav. 1961 Jul;4:267–272. doi: 10.1901/jeab.1961.4-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hunter I., Davison M. Determination of a behavioral transfer function: White-noise analysis of session-to-session response-ratio dynamics on concurrent VI VI schedules. J Exp Anal Behav. 1985 Jan;43(1):43–59. doi: 10.1901/jeab.1985.43-43. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Landon J., Davison M. Reinforcer-ratio variation and its effects on rate of adaptation. J Exp Anal Behav. 2001 Mar;75(2):207–234. doi: 10.1901/jeab.2001.75-207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Landon Jason, Davison Michael, Elliffe Douglas. Concurrent schedules: short- and long-term effects of reinforcers. J Exp Anal Behav. 2002 May;77(3):257–271. doi: 10.1901/jeab.2002.77-257. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mazur J. E. Effects of rate of reinforcement and rate of change on choice behaviour in transition. Q J Exp Psychol B. 1997 May;50(2):111–128. doi: 10.1080/713932646. [DOI] [PubMed] [Google Scholar]
- Schofield G., Davison M. Nonstable concurrent choice in pigeons. J Exp Anal Behav. 1997 Sep;68(2):219–232. doi: 10.1901/jeab.1997.68-219. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stubbs D. A., Pliskoff S. S. Concurrent responding with fixed relative rate of reinforcement. J Exp Anal Behav. 1969 Nov;12(6):887–895. doi: 10.1901/jeab.1969.12-887. [DOI] [PMC free article] [PubMed] [Google Scholar]