Abstract
Choice typically is studied by exposing organisms to concurrent variable-interval schedules in which not only responses controlled by stimuli on the key are acquired but also switching responses and likely other operants as well. In the present research, discriminated key-pecking responses in pigeons were first acquired using a multiple schedule that minimized the reinforcement of switching operants. Then, choice was assessed during concurrent-probe periods in which pairs of discriminative stimuli were presented concurrently. Upon initial exposure to concurrently presented stimuli, choice approximated exclusive preference for the alternative associated with the higher reinforcement frequency. Concurrent schedules were then implemented that gave increasingly greater opportunities for switching operants to be conditioned. As these operants were acquired, the relation of relative response frequency to relative reinforcement frequency converged toward a matching relation. An account of matching with concurrent schedules is proposed in which responding exclusively to the discriminative stimulus associated with the higher reinforcement frequency declines as the concurrent stimuli become more similar and other operants-notably switching-are acquired and generalize to stimuli from both alternatives. The concerted effect of these processes fosters an approximate matching relation in commonly used concurrent procedures.
Full Text
The Full Text of this article is available as a PDF (207.2 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Baum W. M. Choice, changeover, and travel. J Exp Anal Behav. 1982 Jul;38(1):35–49. doi: 10.1901/jeab.1982.38-35. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baum W. M. Matching, undermatching, and overmatching in studies of choice. J Exp Anal Behav. 1979 Sep;32(2):269–281. doi: 10.1901/jeab.1979.32-269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baum W. M. On two types of deviation from the matching law: bias and undermatching. J Exp Anal Behav. 1974 Jul;22(1):231–242. doi: 10.1901/jeab.1974.22-231. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baum William M., Davison Michael. Choice in a variable environment: visit patterns in the dynamics of choice. J Exp Anal Behav. 2004 Jan;81(1):85–127. doi: 10.1901/jeab.2004.81-85. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boelens H., Kop P. F. Concurrent schedules: Spatial separation of response alternatives. J Exp Anal Behav. 1983 Jul;40(1):35–45. doi: 10.1901/jeab.1983.40-35. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brownstein A. J., Pliskoff S. S. Some effects of relative reinforcement rate and changeover delay in response-independent concurrent schedules of reinforcement. J Exp Anal Behav. 1968 Nov;11(6):683–688. doi: 10.1901/jeab.1968.11-683. [DOI] [PMC free article] [PubMed] [Google Scholar]
- CATANIA A. C., CUTTS D. Experimental control of superstitious responding inhumans. J Exp Anal Behav. 1963 Apr;6:203–208. doi: 10.1901/jeab.1963.6-203. [DOI] [PMC free article] [PubMed] [Google Scholar]
- CATANIA A. C. Independence of concurrent responding maintained by interval schedules of reinforcement. J Exp Anal Behav. 1962 Apr;5:175–184. doi: 10.1901/jeab.1962.5-175. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Crowley M. A. The allocation of time to temporally defined behaviors: responding during stimulus generalization. J Exp Anal Behav. 1979 Sep;32(2):191–197. doi: 10.1901/jeab.1979.32-191. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Crozier W. J. The Theory of the Visual Threshold: I. Time and Intensity. Proc Natl Acad Sci U S A. 1940 Jan 15;26(1):54–60. doi: 10.1073/pnas.26.1.54. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davison M. C., Hunter I. W. Performance on variable-interval schedules arranged singly and concurrently. J Exp Anal Behav. 1976 May;25(3):335–345. doi: 10.1901/jeab.1976.25-335. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davison M. C., Tustin R. D. The relation between the generalized matching law and signal-detection theory. J Exp Anal Behav. 1978 Mar;29(2):331–336. doi: 10.1901/jeab.1978.29-331. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davison M. Stimulus Effects On Behavior Allocation In Three-alternative Choice. J Exp Anal Behav. 1996 Sep;66(2):149–168. doi: 10.1901/jeab.1996.66-149. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davison Michael, Baum William M. Every reinforcer counts: reinforcer magnitude and local preference. J Exp Anal Behav. 2003 Jul;80(1):95–129. doi: 10.1901/jeab.2003.80-95. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dreyfus L. R., Dorman L. G., Fetterman J. G., Stubbs D. A. An invariant relation between changing over and reinforcement. J Exp Anal Behav. 1982 Nov;38(3):327–338. doi: 10.1901/jeab.1982.38-327. [DOI] [PMC free article] [PubMed] [Google Scholar]
- FLESHLER M., HOFFMAN H. S. A progression for generating variable-interval schedules. J Exp Anal Behav. 1962 Oct;5:529–530. doi: 10.1901/jeab.1962.5-529. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Findley J. D. Preference and Switching under Concurrent Scheduling. J Exp Anal Behav. 1958 Apr;1(2):123–144. doi: 10.1901/jeab.1958.1-123. [DOI] [PMC free article] [PubMed] [Google Scholar]
- HERRNSTEIN R. J. Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav. 1961 Jul;4:267–272. doi: 10.1901/jeab.1961.4-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hanna E. S., Blackman D. E., Todorov J. C. Stimulus effects on concurrent performance in transition. J Exp Anal Behav. 1992 Sep;58(2):335–347. doi: 10.1901/jeab.1992.58-335. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Herrnstein R. J., Loveland D. H. Matching in a network. J Exp Anal Behav. 1976 Sep;26(2):143–153. doi: 10.1901/jeab.1976.26-143. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Keen R., Machado A. How pigeons discriminate the relative frequency of events. J Exp Anal Behav. 1999 Sep;72(2):151–175. doi: 10.1901/jeab.1999.72-151. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Killeen P. A yoked-chamber comparison of concurrent and multiple schedules. J Exp Anal Behav. 1972 Jul;18(1):13–22. doi: 10.1901/jeab.1972.18-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Killeen P. On the measurement of reinforcement frequency in the study of preference. J Exp Anal Behav. 1968 May;11(3):263–269. doi: 10.1901/jeab.1968.11-263. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Logue A. W. Signal detection and matching: analyzing choice on concurrent variable-interval schedules. J Exp Anal Behav. 1983 Jan;39(1):107–127. doi: 10.1901/jeab.1983.39-107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lyons J., Klipec W. D. Color mixing with Kodak Wratten filters. J Exp Anal Behav. 1971 Mar;15(2):232–232. doi: 10.1901/jeab.1971.15-232. [DOI] [PMC free article] [PubMed] [Google Scholar]
- MacDonall James S. Reinforcing staying and switching while using a changeover delay. J Exp Anal Behav. 2003 Mar;79(2):219–232. doi: 10.1901/jeab.2003.79-219. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Macdonall J. A local model of concurrent performance. J Exp Anal Behav. 1999 Jan;71(1):57–74. doi: 10.1901/jeab.1999.71-57. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Machado A. Increasing the variability of response sequences in pigeons by adjusting the frequency of switching between two keys. J Exp Anal Behav. 1997 Jul;68(1):1–25. doi: 10.1901/jeab.1997.68-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McDevitt Margaret A., Williams Ben A. Arousal, changeover responses, and preference in concurrent schedules. J Exp Anal Behav. 2003 Nov;80(3):261–272. doi: 10.1901/jeab.2003.80-261. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Menlove R. L. Local patterns of responding maintained by concurrent and multiple schedules. J Exp Anal Behav. 1975 May;23(3):309–337. doi: 10.1901/jeab.1975.23-309. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nevin J. A., Jenkins P., Whittaker S., Yarensky P. Reinforcement contingencies and signal detection. J Exp Anal Behav. 1982 Jan;37(1):65–79. doi: 10.1901/jeab.1982.37-65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pliskoff S. S. Effects of symmetrical and asymmetrical changeover delays on concurrent performances. J Exp Anal Behav. 1971 Sep;16(2):249–256. doi: 10.1901/jeab.1971.16-249. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pliskoff S. S., Green D. Effects on concurrent performances of a stimulus correlated with reinforcer availability. J Exp Anal Behav. 1972 Mar;17(2):221–227. doi: 10.1901/jeab.1972.17-221. [DOI] [PMC free article] [PubMed] [Google Scholar]
- SKINNER B. F. Are theories of learning necessary? Psychol Rev. 1950 Jul;57(4):193–216. doi: 10.1037/h0054367. [DOI] [PubMed] [Google Scholar]
- Sainsbury R. S. Effect of proximity of elements on the feature-positive effect. J Exp Anal Behav. 1971 Nov;16(3):315–325. doi: 10.1901/jeab.1971.16-315. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shahan T., Lattal K. On the functions of the changeover delay. J Exp Anal Behav. 1998 Mar;69(2):141–160. doi: 10.1901/jeab.1998.69-141. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shull R. L., Pliskoff S. S. Changeover delay and concurrent schedules: some effects on relative performance measures. J Exp Anal Behav. 1967 Nov;10(6):517–527. doi: 10.1901/jeab.1967.10-517. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Silberberg A., Fantino E. Choice, rate of reinforcement, and the changeover delay. J Exp Anal Behav. 1970 Mar;13(2):187–197. doi: 10.1901/jeab.1970.13-187. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Silberberg A., Williams D. R. Choice behavior on discrete trials: a demonstration of the occurrence of a response strategy. J Exp Anal Behav. 1974 Mar;21(2):315–322. doi: 10.1901/jeab.1974.21-315. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Skinner B. F. Some thoughts about the future. J Exp Anal Behav. 1986 Mar;45(2):229–235. doi: 10.1901/jeab.1986.45-229. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stubbs D. A., Pliskoff S. S. Concurrent responding with fixed relative rate of reinforcement. J Exp Anal Behav. 1969 Nov;12(6):887–895. doi: 10.1901/jeab.1969.12-887. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stubbs D. A., Pliskoff S. S., Reid H. M. Concurrent schedules: a quantitative relation between changeover behavior and its consequences. J Exp Anal Behav. 1977 Jan;27(1):85–96. doi: 10.1901/jeab.1977.27-85. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Todorov J. C., de Oliveira Castro J. M., Hanna E. S., Bittencourt de Sa M. C., Barreto M. Q. Choice, experience, and the generalized matching law. J Exp Anal Behav. 1983 Sep;40(2):99–111. doi: 10.1901/jeab.1983.40-99. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Williams B. A., Bell M. C. Changeover behavior and preference in concurrent schedules. J Exp Anal Behav. 1996 May;65(3):513–526. doi: 10.1901/jeab.1996.65-513. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Williams B. A. Molar versus local reinforcement probability as determinants of stimulus value. J Exp Anal Behav. 1993 Jan;59(1):163–172. doi: 10.1901/jeab.1993.59-163. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Williams B., Bell M. Preference after training with differential changeover delays. J Exp Anal Behav. 1999 Jan;71(1):45–55. doi: 10.1901/jeab.1999.71-45. [DOI] [PMC free article] [PubMed] [Google Scholar]