Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 2004 Mar;81(2):135–154. doi: 10.1901/jeab.2004.81-135

Time and rate measures in choice transitions.

D T Cerutti 1, J E R Staddon 1
PMCID: PMC1284976  PMID: 15239489

Abstract

Three experiments with pigeons studied the relation between time and rate measures of behavior under conditions of changing preference. Experiment 1 studied a concurrent chain schedule with random-interval initial links and fixed-interval terminal links; Experiment 2 studied a multiple chained random-interval fixed-interval schedule; and Experiment 3 studied simple concurrent random-interval random-interval schedules. In Experiment 1, and to a lesser extent in the other two experiments, session-average initial-link wait-time differences were linearly related to session-average response-rate differences. In Experiment 1, and to a lesser extent in Experiment 3, ratios of session-average initial-link wait times and response rates were related by a power function. The weaker relations between wait and response measures in Experiment 2 appear to be due to the absence of competition between responses. In Experiments 1 and 2, initial-link changes lagged behind terminal-link changes. These findings may have implications for the relations between fixed- and variable-interval procedures and suggest that more attention should be paid to temporal measures in studies of free-operant choice.

Full Text

The Full Text of this article is available as a PDF (361.5 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Bailey J. T., Mazur J. E. Choice behavior in transition: development of preference for the higher probability of reinforcement. J Exp Anal Behav. 1990 May;53(3):409–422. doi: 10.1901/jeab.1990.53-409. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Baum W., Schwendiman J., Bell K. Choice, contingency discrimination, and foraging theory. J Exp Anal Behav. 1999 May;71(3):355–373. doi: 10.1901/jeab.1999.71-355. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Cleaveland J. M. Interresponse-time sensitivity during discrete-trial and free-operant concurrent variable-interval schedules. J Exp Anal Behav. 1999 Nov;72(3):317–339. doi: 10.1901/jeab.1999.72-317. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Davison M. C., Temple W. Preference for fixed-interval schedules: an alternative model. J Exp Anal Behav. 1973 Nov;20(3):393–403. doi: 10.1901/jeab.1973.20-393. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Davison M., Baum W. M. Choice in a variable environment: every reinforcer counts. J Exp Anal Behav. 2000 Jul;74(1):1–24. doi: 10.1901/jeab.2000.74-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Davison Michael, Baum William M. Choice in a variable environment: effects of blackout duration and extinction between components. J Exp Anal Behav. 2002 Jan;77(1):65–89. doi: 10.1901/jeab.2002.77-65. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Fantino E. Choice and rate of reinforcement. J Exp Anal Behav. 1969 Sep;12(5):723–730. doi: 10.1901/jeab.1969.12-723. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Fantino E., Royalty P. A molecular analysis of choice on concurrent-chains schedules. J Exp Anal Behav. 1987 Jul;48(1):145–159. doi: 10.1901/jeab.1987.48-145. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Grace R. C. A contextual model of concurrent-chains choice. J Exp Anal Behav. 1994 Jan;61(1):113–129. doi: 10.1901/jeab.1994.61-113. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Grace Randolph C. Acquisition of preference in concurrent chains: comparing linear-operator and memory-representational models. J Exp Psychol Anim Behav Process. 2002 Jul;28(3):257–276. [PubMed] [Google Scholar]
  11. Grace Randolph C. The value hypothesis and acquisition of preference in concurrent chains. Anim Learn Behav. 2002 Feb;30(1):21–33. doi: 10.3758/bf03192906. [DOI] [PubMed] [Google Scholar]
  12. HERRNSTEIN R. J. Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav. 1961 Jul;4:267–272. doi: 10.1901/jeab.1961.4-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. HERRNSTEIN R. J. SECONDARY REINFORCEMENT AND RATE OF PRIMARY REINFORCEMENT. J Exp Anal Behav. 1964 Jan;7:27–36. doi: 10.1901/jeab.1964.7-27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Killeen P. R., Fantino E. Unification of models for choice between delayed reinforcers. J Exp Anal Behav. 1990 Jan;53(1):189–200. doi: 10.1901/jeab.1990.53-189. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Killeen P. R. Incentive theory: II. Models for choice. J Exp Anal Behav. 1982 Sep;38(2):217–232. doi: 10.1901/jeab.1982.38-217. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Killeen P. Preference for fixed-interval schedules of reinforcement. J Exp Anal Behav. 1970 Sep;14(2):127–131. doi: 10.1901/jeab.1970.14-127. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Mazur J. E. Choice behavior in transition: development of preference with ratio and interval schedules. J Exp Psychol Anim Behav Process. 1992 Oct;18(4):364–378. doi: 10.1037//0097-7403.18.4.364. [DOI] [PubMed] [Google Scholar]
  18. Mazur J. E. Hyperbolic value addition and general models of animal choice. Psychol Rev. 2001 Jan;108(1):96–112. doi: 10.1037/0033-295x.108.1.96. [DOI] [PubMed] [Google Scholar]
  19. Shull R. L., Gaynor S. T., Grimes J. A. Response rate viewed as engagement bouts: effects of relative reinforcement and schedule type. J Exp Anal Behav. 2001 May;75(3):247–274. doi: 10.1901/jeab.2001.75-247. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Squires N., Fantino E. A model for choice in simple concurrent and concurrent-chains schedules. J Exp Anal Behav. 1971 Jan;15(1):27–38. doi: 10.1901/jeab.1971.15-27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Staddon J. E. R., Cerutti D. T. Operant conditioning. Annu Rev Psychol. 2002 Jun 10;54:115–144. doi: 10.1146/annurev.psych.54.101601.145124. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Wardlaw G. R., Davison M. C. Preference for fixed-interval schedules: effects of initial-link length. J Exp Anal Behav. 1974 Mar;21(2):331–340. doi: 10.1901/jeab.1974.21-331. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES