Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 2004 Jan;81(1):85–127. doi: 10.1901/jeab.2004.81-85

Choice in a variable environment: visit patterns in the dynamics of choice.

William M Baum 1, Michael Davison 1
PMCID: PMC1284973  PMID: 15113135

Abstract

Molar and molecular views of behavior imply different approaches to data analysis. The molecular view privileges moment-to-moment analyses, whereas the molar view supports analysis of more and less extended activities. In concurrent performance, the molar view supports study of both extended patterns of choice and more local patterns of visiting the choice alternatives. Analysis of the present data illustrated the usefulness of investigating order at various levels of extendedness. Seven different reinforcer ratios were presented within each session, without cues to identify them, and pigeons pecked at two response keys that delivered food on variable-interval schedules. Choice changed rapidly within components as reinforcers were delivered and, following each reinforcer, shifted toward the alternative that produced it. If several reinforcers were delivered consecutively by one alternative, choice favored that alternative, but shifted more slowly with each new reinforcer. A discontinuation of such a series of reinforcers by the delivery of a reinforcer by the other alternative resulted in a large shift of choice toward that alternative. These effects were illuminated by analysis of visits to the two alternatives. Changes in visit length occurred primarily in the first postreinforcer visit to the repeatedly reinforced alternative. All other visits tended to be brief and equal. Performance showed multiple signs of moving in the direction of a fix-and-sample pattern that characterized steady-state performance in earlier experiments with many sessions of maintaining each schedule pair. The analyses of extended and local patterns illustrate the flexibility of a molar view of behavior.

Full Text

The Full Text of this article is available as a PDF (503.0 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Baum W. M. Chained concurrent schedules: reinforcement as situation transition. J Exp Anal Behav. 1974 Jul;22(1):91–101. doi: 10.1901/jeab.1974.22-91. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Baum W. M. Matching, undermatching, and overmatching in studies of choice. J Exp Anal Behav. 1979 Sep;32(2):269–281. doi: 10.1901/jeab.1979.32-269. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Baum W. M., Rachlin H. C. Choice as time allocation. J Exp Anal Behav. 1969 Nov;12(6):861–874. doi: 10.1901/jeab.1969.12-861. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Baum W. M. The correlation-based law of effect. J Exp Anal Behav. 1973 Jul;20(1):137–153. doi: 10.1901/jeab.1973.20-137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Baum W., Aparicio C. Optimality And Concurrent Variable-interval Variable-ratio Schedules. J Exp Anal Behav. 1999 Jan;71(1):75–89. doi: 10.1901/jeab.1999.71-75. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Baum W., Schwendiman J., Bell K. Choice, contingency discrimination, and foraging theory. J Exp Anal Behav. 1999 May;71(3):355–373. doi: 10.1901/jeab.1999.71-355. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Baum William M. From molecular to molar: a paradigm shift in behavior analysis. J Exp Anal Behav. 2002 Jul;78(1):95–116. doi: 10.1901/jeab.2002.78-95. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Bell Kenneth E., Baum William M. Group foraging sensitivity to predictable and unpredictable changes in food distribution: past experience or present circumstances? J Exp Anal Behav. 2002 Sep;78(2):179–194. doi: 10.1901/jeab.2002.78-179. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Davison M., Baum W. M. Choice in a variable environment: every reinforcer counts. J Exp Anal Behav. 2000 Jul;74(1):1–24. doi: 10.1901/jeab.2000.74-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Davison Michael, Baum William M. Choice in a variable environment: effects of blackout duration and extinction between components. J Exp Anal Behav. 2002 Jan;77(1):65–89. doi: 10.1901/jeab.2002.77-65. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Davison Michael, Baum William M. Every reinforcer counts: reinforcer magnitude and local preference. J Exp Anal Behav. 2003 Jul;80(1):95–129. doi: 10.1901/jeab.2003.80-95. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Dinsmoor J. A. Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing. J Exp Anal Behav. 2001 May;75(3):311–333. doi: 10.1901/jeab.2001.75-311. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. HERRNSTEIN R. J. Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav. 1961 Jul;4:267–272. doi: 10.1901/jeab.1961.4-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Hinson J. M., Staddon J. E. Matching, maximizing, and hill-climbing. J Exp Anal Behav. 1983 Nov;40(3):321–331. doi: 10.1901/jeab.1983.40-321. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Houston A. I., McNamara J. M., Sumida B. H. Relative allocation on concurrent schedules can depend on schedule parameters when behavioral parameters are constant. J Exp Anal Behav. 1987 Jan;47(1):127–131. doi: 10.1901/jeab.1987.47-127. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Houston A. I., McNamara J. How to maximize reward rate on two variable-interval paradigms. J Exp Anal Behav. 1981 May;35(3):367–396. doi: 10.1901/jeab.1981.35-367. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Killeen Peter R., Hall Scott S., Reilly Mark P., Kettle Lauren C. Molecular analyses of the principal components of response strength. J Exp Anal Behav. 2002 Sep;78(2):127–160. doi: 10.1901/jeab.2002.78-127. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Landon Jason, Davison Michael, Elliffe Douglas. Choice in a variable environment: effects of unequal reinforcer distributions. J Exp Anal Behav. 2003 Sep;80(2):187–204. doi: 10.1901/jeab.2003.80-187. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Landon Jason, Davison Michael, Elliffe Douglas. Concurrent schedules: reinforcer magnitude effects. J Exp Anal Behav. 2003 May;79(3):351–365. doi: 10.1901/jeab.2003.79-351. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Landon Jason, Davison Michael, Elliffe Douglas. Concurrent schedules: short- and long-term effects of reinforcers. J Exp Anal Behav. 2002 May;77(3):257–271. doi: 10.1901/jeab.2002.77-257. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Shull R. L., Gaynor S. T., Grimes J. A. Response rate viewed as engagement bouts: effects of relative reinforcement and schedule type. J Exp Anal Behav. 2001 May;75(3):247–274. doi: 10.1901/jeab.2001.75-247. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Silberberg A., Schrot J. A yoked-chamber comparison of concurrent and multiple schedules: the relationship between component duration and responding. J Exp Anal Behav. 1974 Jul;22(1):21–30. doi: 10.1901/jeab.1974.22-21. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES