Skip to main content
PMC home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1998 Jan;69(1):87–102. doi: 10.1901/jeab.1998.69-87

Humans' choice in a self-control choice situation: sensitivity to reinforcer amount, reinforcer delay, and overall reinforcement density.

M Ito 1, K Nakamura 1
PMCID: PMC1284649  PMID: 9465415

Abstract

Human subjects were exposed to a concurrent-chains schedule in which reinforcer amounts, delays, or both were varied in the terminal links, and consummatory responses were required to receive points that were later exchangeable for money. Two independent variable-interval 30-s schedules were in effect during the initial links, and delay periods were defined by fixed-time schedules. In Experiment 1, subjects were exposed to three different pairs of reinforcer amounts and delays, and sensitivity to reinforcer amount and delay was determined based on the generalized matching law. The relative responding (choice) of most subjects was more sensitive to reinforcer amount than to reinforcer delay. In Experiment 2, subjects chose between immediate smaller reinforcers and delayed larger reinforcers in five conditions with and without timeout periods that followed a shorter delay, in which reinforcer amounts and delays were combined to make different predictions based on local reinforcement density (i.e., points per delay) or overall reinforcement density (i.e., points per total time). In most conditions, subjects' choices were qualitatively in accord with the predictions from the overall reinforcement density calculated by the ratio of reinforcer amount and total time. Therefore, the overall reinforcement density appears to influence the preference of humans in the present self-control choice situation.

Full Text

The Full Text of this article is available as a PDF (257.1 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Baum W. M. Matching, undermatching, and overmatching in studies of choice. J Exp Anal Behav. 1979 Sep;32(2):269–281. doi: 10.1901/jeab.1979.32-269. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Baum W. M. On two types of deviation from the matching law: bias and undermatching. J Exp Anal Behav. 1974 Jul;22(1):231–242. doi: 10.1901/jeab.1974.22-231. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Belke T. W., Pierce W. D., Powell R. A. Determinants of choice for pigeons and humans on concurrent-chains schedules of reinforcement. J Exp Anal Behav. 1989 Sep;52(2):97–109. doi: 10.1901/jeab.1989.52-97. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. FLESHLER M., HOFFMAN H. S. A progression for generating variable-interval schedules. J Exp Anal Behav. 1962 Oct;5:529–530. doi: 10.1901/jeab.1962.5-529. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Fantino E., Davison M. Choice: Some quantitative relations. J Exp Anal Behav. 1983 Jul;40(1):1–13. doi: 10.1901/jeab.1983.40-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Flora S. R., Pavlik W. B. Human self-control and the density of reinforcement. J Exp Anal Behav. 1992 Mar;57(2):201–208. doi: 10.1901/jeab.1992.57-201. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Grace R. C. Independence of reinforcement delay and magnitude in concurrent chains. J Exp Anal Behav. 1995 May;63(3):255–276. doi: 10.1901/jeab.1995.63-255. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Green L., Snyderman M. Choice between rewards differing in amount and delay: Toward a choice model of self control. J Exp Anal Behav. 1980 Sep;34(2):135–147. doi: 10.1901/jeab.1980.34-135. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Hyten C., Madden G. J., Field D. P. Exchange delays and impulsive choice in adult humans. J Exp Anal Behav. 1994 Sep;62(2):225–233. doi: 10.1901/jeab.1994.62-225. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Ito M., Asaki K. Choice behavior of rats in a concurrent-chains schedule: Amount and delay of reinforcement. J Exp Anal Behav. 1982 May;37(3):383–392. doi: 10.1901/jeab.1982.37-383. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Ito M., Oyama M. Relative sensitivity to reinforcer amount and delay in a self-control choice situation. J Exp Anal Behav. 1996 Sep;66(2):219–229. doi: 10.1901/jeab.1996.66-219. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Jackson K., Hackenberg T. D. Token reinforcement, choice, and self-control in pigeons. J Exp Anal Behav. 1996 Jul;66(1):29–49. doi: 10.1901/jeab.1996.66-29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Killeen P. R. Incentive theory: II. Models for choice. J Exp Anal Behav. 1982 Sep;38(2):217–232. doi: 10.1901/jeab.1982.38-217. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. King G. R., Logue A. W. Humans' sensitivity to variation in reinforcer amount: Effects of the method of reinforcer delivery. J Exp Anal Behav. 1990 Jan;53(1):33–45. doi: 10.1901/jeab.1990.53-33. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Logue A. W., Peña-Correal T. E., Rodriguez M. L., Kabela E. Self-control in adult humans: variation in positive reinforcer amount and delay. J Exp Anal Behav. 1986 Sep;46(2):159–173. doi: 10.1901/jeab.1986.46-159. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Logue A. W., Rodriguez M. L., Peña-Correal T. E., Mauro B. C. Choice in a self-control paradigm: Quantification of experience-based differences. J Exp Anal Behav. 1984 Jan;41(1):53–67. doi: 10.1901/jeab.1984.41-53. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Matthews B. A., Shimoff E., Catania A. C., Sagvolden T. Uninstructed human responding: sensitivity to ratio and interval contingencies. J Exp Anal Behav. 1977 May;27(3):453–467. doi: 10.1901/jeab.1977.27-453. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Mazur J. E. Estimation of indifference points with an adjusting-delay procedure. J Exp Anal Behav. 1988 Jan;49(1):37–47. doi: 10.1901/jeab.1988.49-37. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Omino T., Ito M. Choice and delay of reinforcement: Effects of terminal-link stimulus and response conditions. J Exp Anal Behav. 1993 Mar;59(2):361–371. doi: 10.1901/jeab.1993.59-361. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Rachlin H., Green L. Commitment, choice and self-control. J Exp Anal Behav. 1972 Jan;17(1):15–22. doi: 10.1901/jeab.1972.17-15. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES