Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1994 Sep;62(2):269–292. doi: 10.1901/jeab.1994.62-269

Effects of different accessibility of reinforcement schedules on choice in humans

Ursula Stockhorst
PMCID: PMC1334462  PMID: 16812743

Abstract

Based on the delay-reduction hypothesis, a less profitable schedule should be rejected if its duration exceeds the mean delay to reinforcement. It should be accepted if its duration is shorter than the mean delay. This was tested for humans, using a successive-choice schedule. The accessibility of the less profitable (variable-interval 18 s) schedule was varied by changing the duration (in terms of a fixed interval) of the waiting-time component preceding its presentation. Forty-eight students were randomly assigned to three groups. In Phase 1, the duration of the less profitable schedule equaled the mean delay to reinforcement in all groups. In Phase 2, waiting time preceding the less profitable schedule was reduced in Group 1 and increased in Group 2. Thus, the schedule was correlated either with a relative delay increase (Group 1) or a delay reduction (Group 2). In Group 3, conditions remained unchanged. As predicted, acceptance of the less profitable schedule decreased in Group 1 and increased in Group 2. The increased acceptance in Group 2 was accompanied by a decreased acceptance of the more profitable (variable-interval 3 s) schedule, resembling a pattern of negative contrast. Response rates were higher under the component preceding (a) the more profitable schedule in Group 1 and (b) the less profitable schedule in Group 2. Implications for the modification of human choice behavior are discussed.

Keywords: choice, delay-reduction hypothesis, successive-choice schedule, contrast, response rates, button pressing, adult humans

Full text

PDF
271

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Abarca N., Fantino E. Choice and foraging. J Exp Anal Behav. 1982 Sep;38(2):117–123. doi: 10.1901/jeab.1982.38-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Belke T. W., Pierce W. D., Powell R. A. Determinants of choice for pigeons and humans on concurrent-chains schedules of reinforcement. J Exp Anal Behav. 1989 Sep;52(2):97–109. doi: 10.1901/jeab.1989.52-97. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Carroll M. E., Carmona G. G., May S. A. Modifying drug-reinforced behavior by altering the economic conditions of the drug and a nondrug reinforcer. J Exp Anal Behav. 1991 Sep;56(2):361–376. doi: 10.1901/jeab.1991.56-361. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Case D. A., Fantino E. The delay-reduction hypothesis of conditioned reinforcement and punishment: Observing behavior. J Exp Anal Behav. 1981 Jan;35(1):93–108. doi: 10.1901/jeab.1981.35-93. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Charnov E. L. Optimal foraging, the marginal value theorem. Theor Popul Biol. 1976 Apr;9(2):129–136. doi: 10.1016/0040-5809(76)90040-x. [DOI] [PubMed] [Google Scholar]
  6. Chung S. H., Herrnstein R. J. Choice and delay of reinforcement. J Exp Anal Behav. 1967 Jan;10(1):67–74. doi: 10.1901/jeab.1967.10-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Cole C. S., Coyne J. C. Situational specificity of laboratory-induced learned helplessness. J Abnorm Psychol. 1977 Dec;86(6):615–623. doi: 10.1037//0021-843x.86.6.615. [DOI] [PubMed] [Google Scholar]
  8. Davison M. C., Temple W. Preference for fixed-interval schedules: an alternative model. J Exp Anal Behav. 1973 Nov;20(3):393–403. doi: 10.1901/jeab.1973.20-393. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Davison M. C., Temple W. Preference for fixed-interval terminal links in a three-key concurrent chain schedule. J Exp Anal Behav. 1974 Jul;22(1):11–19. doi: 10.1901/jeab.1974.22-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. DeGrandpre R. J., Bickel W. K., Rizvi S. A., Hughes J. R. Effects of income on drug choice in humans. J Exp Anal Behav. 1993 May;59(3):483–500. doi: 10.1901/jeab.1993.59-483. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Duncan B., Fantino E. Choice for periodic schedules of reinforcement. J Exp Anal Behav. 1970 Jul;14(1):73–86. doi: 10.1901/jeab.1970.14-73. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Dunn R., Fantino E. Choice and the relative immediacy of reinforcement. J Exp Anal Behav. 1982 Nov;38(3):321–326. doi: 10.1901/jeab.1982.38-321. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Dunn R., Spetch M. L. Choice with uncertain outcomes: conditioned reinforcement effects. J Exp Anal Behav. 1990 Mar;53(2):201–218. doi: 10.1901/jeab.1990.53-201. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Elsmore T. F., Fletcher G. V., Conrad D. G., Sodetz F. J. Reduction of heroin intake in baboons by an economic constraint. Pharmacol Biochem Behav. 1980 Nov;13(5):729–731. doi: 10.1016/0091-3057(80)90018-0. [DOI] [PubMed] [Google Scholar]
  15. Fantino E., Case D. A. Human observing: Maintained by stimuli correlated with reinforcement but not extinction. J Exp Anal Behav. 1983 Sep;40(2):193–210. doi: 10.1901/jeab.1983.40-193. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Fantino E. Choice and rate of reinforcement. J Exp Anal Behav. 1969 Sep;12(5):723–730. doi: 10.1901/jeab.1969.12-723. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Fantino E., Freed D., Preston R. A., Williams W. A. Choice and conditioned reinforcement. J Exp Anal Behav. 1991 Mar;55(2):177–188. doi: 10.1901/jeab.1991.55-177. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Fantino E., Preston R. A. Choice and foraging: the effects of accessibility on acceptability. J Exp Anal Behav. 1988 Nov;50(3):395–403. doi: 10.1901/jeab.1988.50-395. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Fantino E., Preston R. A., Dunn R. Delay reduction: current status. J Exp Anal Behav. 1993 Jul;60(1):159–169. doi: 10.1901/jeab.1993.60-159. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Fantino E. Timing in animal learning and behavior: discussion paper. Ann N Y Acad Sci. 1984;423:292–295. doi: 10.1111/j.1749-6632.1984.tb23438.x. [DOI] [PubMed] [Google Scholar]
  21. Flora S. R., Pavlik W. B. Human self-control and the density of reinforcement. J Exp Anal Behav. 1992 Mar;57(2):201–208. doi: 10.1901/jeab.1992.57-201. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. HERRNSTEIN R. J. SECONDARY REINFORCEMENT AND RATE OF PRIMARY REINFORCEMENT. J Exp Anal Behav. 1964 Jan;7:27–36. doi: 10.1901/jeab.1964.7-27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Hackenberg T. D., Hineline P. N. Choice in situations of time-based diminishing returns: immediate versus delayed consequences of action. J Exp Anal Behav. 1992 Jan;57(1):67–80. doi: 10.1901/jeab.1992.57-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Hastjarjo T., Silberberg A. Effects of reinforcer delays on choice as a function of income level. J Exp Anal Behav. 1992 Jan;57(1):119–125. doi: 10.1901/jeab.1992.57-119. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Hastjarjo T., Silberberg A., Hursh S. R. Quinine pellets as an inferior good and a Giffen good in rats. J Exp Anal Behav. 1990 Mar;53(2):263–271. doi: 10.1901/jeab.1990.53-263. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Hursh S. R. Behavioral economics of drug self-administration and drug abuse policy. J Exp Anal Behav. 1991 Sep;56(2):377–393. doi: 10.1901/jeab.1991.56-377. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Hursh S. R., Fantino E. Relative delay of reinforcement and choice. J Exp Anal Behav. 1973 May;19(3):437–450. doi: 10.1901/jeab.1973.19-437. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Ito M., Asaki K. Choice behavior of rats in a concurrent-chains schedule: Amount and delay of reinforcement. J Exp Anal Behav. 1982 May;37(3):383–392. doi: 10.1901/jeab.1982.37-383. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Ito M., Fantino E. Choice, foraging, and reinforcer duration. J Exp Anal Behav. 1986 Jul;46(1):93–103. doi: 10.1901/jeab.1986.46-93. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Jones S. L., Nation J. R., Massad P. Immunization against learned helplessness in man. J Abnorm Psychol. 1977 Feb;86(1):75–83. doi: 10.1037//0021-843x.86.1.75. [DOI] [PubMed] [Google Scholar]
  31. Killeen P. Preference for fixed-interval schedules of reinforcement. J Exp Anal Behav. 1970 Sep;14(2):127–131. doi: 10.1901/jeab.1970.14-127. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Leung J. P. Psychological distance to reward: A human replication. J Exp Anal Behav. 1989 May;51(3):343–352. doi: 10.1901/jeab.1989.51-343. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Leung J. P., Winton A. S. Preference for unsegmented interreinforcement intervals in concurrent chains. J Exp Anal Behav. 1985 Jul;44(1):89–101. doi: 10.1901/jeab.1985.44-89. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Luco J. E. Matching, delay-reduction, and maximizing models for choice in concurrent-chains schedules. J Exp Anal Behav. 1990 Jul;54(1):53–67. doi: 10.1901/jeab.1990.54-53. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Macewen D. The effects of terminal-link fixed-interval and variable-interval schedules on responding under concurrent chained schedules. J Exp Anal Behav. 1972 Sep;18(2):253–261. doi: 10.1901/jeab.1972.18-253. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Preston R. A., Fantino E. Conditioned reinforcement value and choice. J Exp Anal Behav. 1991 Mar;55(2):155–175. doi: 10.1901/jeab.1991.55-155. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. REYNOLDS G. S. Behavioral contrast. J Exp Anal Behav. 1961 Jan;4:57–71. doi: 10.1901/jeab.1961.4-57. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Ragotzy S. P., Blakely E., Poling A. Self-control in mentally retarded adolescents: choice as a function of amount and delay of reinforcement. J Exp Anal Behav. 1988 Mar;49(2):191–199. doi: 10.1901/jeab.1988.49-191. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Reynolds G. S. An analysis of interactions in a multiple schedule. J Exp Anal Behav. 1961 Apr;4(2):107–117. doi: 10.1901/jeab.1961.4-107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Spetch M. L., Belke T. W., Barnet R. C., Dunn R., Pierce W. D. Suboptimal choice in a percentage-reinforcement procedure: effects of signal condition and terminal-link length. J Exp Anal Behav. 1990 Mar;53(2):219–234. doi: 10.1901/jeab.1990.53-219. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Spetch M. L., Dunn R. Choice between reliable and unreliable outcomes: mixed percentage-reinforcement in concurrent chains. J Exp Anal Behav. 1987 Jan;47(1):57–72. doi: 10.1901/jeab.1987.47-57. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Timberlake W. A temporal limit on the effect of future food on current performance in an analogue of foraging and welfare. J Exp Anal Behav. 1984 Mar;41(2):117–124. doi: 10.1901/jeab.1984.41-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Timberlake W., Gawley D. J., Lucas G. A. Time horizons in rats foraging for food in temporally separated patches. J Exp Psychol Anim Behav Process. 1987 Jul;13(3):302–309. [PubMed] [Google Scholar]
  44. Wardlaw G. R., Davison M. C. Preference for fixed-interval schedules: effects of initial-link length. J Exp Anal Behav. 1974 Mar;21(2):331–340. doi: 10.1901/jeab.1974.21-331. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Weiner H. Cost to payoff contributions to preference under fixed-ratio contingencies with humans. Psychol Rep. 1967 Feb;20(1):31–35. doi: 10.2466/pr0.1967.20.1.31. [DOI] [PubMed] [Google Scholar]
  46. Williams B. A. Another look at contrast in multiple schedules. J Exp Anal Behav. 1983 Mar;39(2):345–384. doi: 10.1901/jeab.1983.39-345. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Williams B. A., Fantino E. Effects on choice of reinforcement delay and conditioned reinforcement. J Exp Anal Behav. 1978 Jan;29(1):77–86. doi: 10.1901/jeab.1978.29-77. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Williams B. A. Inverse relations between preference and contrast. J Exp Anal Behav. 1992 Sep;58(2):303–312. doi: 10.1901/jeab.1992.58-303. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Wixted J. T. Nonhuman short-term memory: A quantitative reanalysis of selected findings. J Exp Anal Behav. 1989 Nov;52(3):409–426. doi: 10.1901/jeab.1989.52-409. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES