Skip to main content
NCBI home page
Journal of Applied Behavior Analysis logoLink to Journal of Applied Behavior Analysis
. 2000 Fall;33(3):359–371. doi: 10.1901/jaba.2000.33-359

Designing interventions that include delayed reinforcement: implications of recent laboratory research.

R Stromer 1, J J McComas 1, R A Rehfeldt 1
PMCID: PMC1284263  PMID: 11051582

Abstract

The search for robust and durable interventions in everyday situations typically involves the use of delayed reinforcers, sometimes delivered well after a target behavior occurs. Integrating the findings from laboratory research on delayed reinforcement can contribute to the design and analysis of those applied interventions. As illustrations, we examine articles from the Journal of the Experimental Analysis of Behavior that analyzed delayed reinforcement with respect to response allocation (A. M. Williams & Lattal, 1999), stimulus chaining (B. A. Williams, 1999), and self-control (Jackson & Hackenberg, 1996). These studies help to clarify the conditions under which delayed reinforcement (a) exercises control of behavior, (b) entails conditioned reinforcement, and (c) displaces the effects of immediate reinforcement. The research has applied implications, including the development of positive social behavior and teaching people to make adaptive choices. DESCRIPTORS: delayed reinforcement, response allocation, stimulus chains, self-control, integration of basic and applied research

Full Text

The Full Text of this article is available as a PDF (118.9 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Ainslie G. W. Impulse control in pigeons. J Exp Anal Behav. 1974 May;21(3):485–489. doi: 10.1901/jeab.1974.21-485. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Alsop B., Stewart K. E., Honig W. K. Cued and uncued terminal links in concurrent-chains schedules. J Exp Anal Behav. 1994 Nov;62(3):385–397. doi: 10.1901/jeab.1994.62-385. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Baer R. A., Williams J. A., Osnes P. G., Stokes T. F. Delayed reinforcement as an indiscriminable contingency in verbal/nonverbal correspondence training. J Appl Behav Anal. 1984 Winter;17(4):429–440. doi: 10.1901/jaba.1984.17-429. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Belke T. W., Spetch M. L. Choice between reliable and unreliable reinforcement alternatives revisited: Preference for unreliable reinforcement. J Exp Anal Behav. 1994 Nov;62(3):353–366. doi: 10.1901/jeab.1994.62-353. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. CRUM J., BROWN W. L., BITTERMAN M. E. The effect of partial and delayed reinforcement on resistance to extinction. Am J Psychol. 1951 Apr;64(2):228–237. [PubMed] [Google Scholar]
  6. Carr E. G., Durand V. M. Reducing behavior problems through functional communication training. J Appl Behav Anal. 1985 Summer;18(2):111–126. doi: 10.1901/jaba.1985.18-111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Chelonis J. J., King G., Logue A. W., Tobin H. The effect of variable delays on self-control. J Exp Anal Behav. 1994 Jul;62(1):33–43. doi: 10.1901/jeab.1994.62-33. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Cicerone R. A. Preference for mixed versus constant delay of reinforcement. J Exp Anal Behav. 1976 Mar;25(2):257–261. doi: 10.1901/jeab.1976.25-257. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Critchfield T. S., Lattal K. A. Acquisition of a spatially defined operant with delayed reinforcement. J Exp Anal Behav. 1993 Mar;59(2):373–387. doi: 10.1901/jeab.1993.59-373. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Dixon M. R., Hayes L. J., Binder L. M., Manthey S., Sigman C., Zdanowski D. M. Using a self-control training procedure to increase appropriate behavior. J Appl Behav Anal. 1998 Summer;31(2):203–210. doi: 10.1901/jaba.1998.31-203. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Duncan B., Fantino E. The psychological distance to reward. J Exp Anal Behav. 1972 Jul;18(1):23–34. doi: 10.1901/jeab.1972.18-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Dunn R., Spetch M. L. Choice with uncertain outcomes: conditioned reinforcement effects. J Exp Anal Behav. 1990 Mar;53(2):201–218. doi: 10.1901/jeab.1990.53-201. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Dunn R., Williams B., Royalty P. Devaluation of stimuli contingent on choice: evidence for conditioned reinforcement. J Exp Anal Behav. 1987 Jul;48(1):117–131. doi: 10.1901/jeab.1987.48-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Durand V. M., Carr E. G. Functional communication training to reduce challenging behavior: maintenance and application in new settings. J Appl Behav Anal. 1991 Summer;24(2):251–264. doi: 10.1901/jaba.1991.24-251. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Fisher W. W., Mazur J. E. Basic and applied research on choice responding. J Appl Behav Anal. 1997 Fall;30(3):387–410. doi: 10.1901/jaba.1997.30-387. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Flora S. R., Pavlik W. B. Human self-control and the density of reinforcement. J Exp Anal Behav. 1992 Mar;57(2):201–208. doi: 10.1901/jeab.1992.57-201. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Fowler S. A., Baer D. M. "Do I have to be good all day? The timing of delayed reinforcement as a factor in generalization. J Appl Behav Anal. 1981 Spring;14(1):13–24. doi: 10.1901/jaba.1981.14-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Grosch J., Neuringer A. Self-control in pigeons under the Mischel paradigm. J Exp Anal Behav. 1981 Jan;35(1):3–21. doi: 10.1901/jeab.1981.35-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Hayes S. C., Hayes L. J. Applied implications of current JEAB research on derived relations and delayed reinforcement. J Appl Behav Anal. 1993 Winter;26(4):507–511. doi: 10.1901/jaba.1993.26-507. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Horner R. H., Day H. M. The effects of response efficiency on functionally equivalent competing behaviors. J Appl Behav Anal. 1991 Winter;24(4):719–732. doi: 10.1901/jaba.1991.24-719. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Hyten C., Madden G. J., Field D. P. Exchange delays and impulsive choice in adult humans. J Exp Anal Behav. 1994 Sep;62(2):225–233. doi: 10.1901/jeab.1994.62-225. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Jackson K., Hackenberg T. D. Token reinforcement, choice, and self-control in pigeons. J Exp Anal Behav. 1996 Jul;66(1):29–49. doi: 10.1901/jeab.1996.66-29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Jay A. S., Grote I., Baer D. M. Teaching participants with developmental disabilities to comply with self-instructions. Am J Ment Retard. 1999 Nov;104(6):509–522. doi: 10.1352/0895-8017(1999)104<0509:TPWDDT>2.0.CO;2. [DOI] [PubMed] [Google Scholar]
  24. Kazdin A. E., Bootzin R. R. The token economy: an evaluative review. J Appl Behav Anal. 1972 Fall;5(3):343–372. doi: 10.1901/jaba.1972.5-343. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Kazdin A. E. The token economy: a decade later. J Appl Behav Anal. 1982 Fall;15(3):431–445. doi: 10.1901/jaba.1982.15-431. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Krantz P. J., MacDuff M. T., McClannahan L. E. Programming participation in family activities for children with autism: parents' use of photographic activity schedules. J Appl Behav Anal. 1993 Spring;26(1):137–138. doi: 10.1901/jaba.1993.26-137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Lalli J. S., Mauro B. C. The paradox of preference for unreliable reinforcement: The role of context and conditioned reinforcement. J Appl Behav Anal. 1995 Fall;28(3):389–394. doi: 10.1901/jaba.1995.28-389. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Lalli J. S. Treatment of escape-maintained aberrant behavior with escape extinction and predictable routines. J Appl Behav Anal. 1994 Winter;27(4):705–714. doi: 10.1901/jaba.1994.27-705. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Lattal K. A., Gleeson S. Response acquisition with delayed reinforcement. J Exp Psychol Anim Behav Process. 1990 Jan;16(1):27–39. [PubMed] [Google Scholar]
  30. Lattal K. A., Metzger B. Response acquisition by Siamese fighting fish (Betta splendens) with delayed visual reinforcement. J Exp Anal Behav. 1994 Jan;61(1):35–44. doi: 10.1901/jeab.1994.61-35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Lattal K. A. Signal functions in delayed reinforcement. J Exp Anal Behav. 1984 Sep;42(2):239–253. doi: 10.1901/jeab.1984.42-239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Lattal K. A., Williams A. M. Body weight and response acquisition with delayed reinforcement. J Exp Anal Behav. 1997 Jan;67(1):131–143. doi: 10.1901/jeab.1997.67-131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. MacDuff G. S., Krantz P. J., McClannahan L. E. Teaching children with autism to use photographic activity schedules: maintenance and generalization of complex response chains. J Appl Behav Anal. 1993 Spring;26(1):89–97. doi: 10.1901/jaba.1993.26-89. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Neef N. A., Mace F. C., Shade D. Impulsivity in students with serious emotional disturbance: the interactive effects of reinforcer rate, delay, and quality. J Appl Behav Anal. 1993 Spring;26(1):37–52. doi: 10.1901/jaba.1993.26-37. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Neef N. A., Shade D., Miller M. S. Assessing influential dimensions of reinforcers on choice in students with serious emotional disturbance. J Appl Behav Anal. 1994 Winter;27(4):575–583. doi: 10.1901/jaba.1994.27-575. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Nevin J. A. Response strength in multiple schedules. J Exp Anal Behav. 1974 May;21(3):389–408. doi: 10.1901/jeab.1974.21-389. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Peck S. M., Wacker D. P., Berg W. K., Cooper L. J., Brown K. A., Richman D., McComas J. J., Frischmeyer P., Millard T. Choice-making treatment of young children's severe behavior problems. J Appl Behav Anal. 1996 Fall;29(3):263–290. doi: 10.1901/jaba.1996.29-263. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Rachlin H., Green L. Commitment, choice and self-control. J Exp Anal Behav. 1972 Jan;17(1):15–22. doi: 10.1901/jeab.1972.17-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Ragotzy S. P., Blakely E., Poling A. Self-control in mentally retarded adolescents: choice as a function of amount and delay of reinforcement. J Exp Anal Behav. 1988 Mar;49(2):191–199. doi: 10.1901/jeab.1988.49-191. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Reeve L., Reeve K. F., Brown A. K., Brown J. L., Poulson C. L. Effects of delayed reinforcement on infant vocalization rate. J Exp Anal Behav. 1992 Jul;58(1):1–8. doi: 10.1901/jeab.1992.58-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Schweitzer J. B., Sulzer-Azaroff B. Self-control: teaching tolerance for delay in impulsive children. J Exp Anal Behav. 1988 Sep;50(2):173–186. doi: 10.1901/jeab.1988.50-173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Stokes T. F., Baer D. M. An implicit technology of generalization. J Appl Behav Anal. 1977 Summer;10(2):349–367. doi: 10.1901/jaba.1977.10-349. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Stromer R., Mackay H. A., Howell S. R., McVay A. A., Flusser D. Teaching computer-based spelling to individuals with developmental and hearing disabilities: transfer of stimulus control to writing tasks. J Appl Behav Anal. 1996 Spring;29(1):25–42. doi: 10.1901/jaba.1996.29-25. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Stromer R., Mackay H. A., McVay A. A., Fowler T. Written lists as mediating stimuli in the matching-to-sample performances of individuals with mental retardation. J Appl Behav Anal. 1998 Spring;31(1):1–19. doi: 10.1901/jaba.1998.31-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Taylor I., O'Reilly M. F. Toward a functional analysis of private verbal self-regulation. J Appl Behav Anal. 1997 Spring;30(1):43–58. doi: 10.1901/jaba.1997.30-43. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Tombaugh T. N. Resistance to extinction as a function of the interaction between training and extinction delays. Psychol Rep. 1966 Dec;19(3):791–798. doi: 10.2466/pr0.1966.19.3.791. [DOI] [PubMed] [Google Scholar]
  47. Vollmer T. R., Borrero J. C., Lalli J. S., Daniel D. Evaluating self-control and impulsivity in children with severe behavior disorders. J Appl Behav Anal. 1999 Winter;32(4):451–466. doi: 10.1901/jaba.1999.32-451. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Wacker D. P., Steege M. W., Northup J., Sasso G., Berg W., Reimers T., Cooper L., Cigrand K., Donn L. A component analysis of functional communication training across three topographies of severe behavior problems. J Appl Behav Anal. 1990 Winter;23(4):417–429. doi: 10.1901/jaba.1990.23-417. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Wilkenfield J., Nickel M., Blakely E., Poling A. Acquisition of lever-press responding in rats with delayed reinforcement: A comparison of three procedures. J Exp Anal Behav. 1992 Nov;58(3):431–443. doi: 10.1901/jeab.1992.58-431. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Williams A. M., Lattal K. A. The role of the response-reinforcer relation in delay-of-reinforcement effects. J Exp Anal Behav. 1999 Mar;71(2):187–194. doi: 10.1901/jeab.1999.71-187. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Williams B. A., Dunn R. Preference for conditioned reinforcement. J Exp Anal Behav. 1991 Jan;55(1):37–46. doi: 10.1901/jeab.1991.55-37. [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Williams B. A. The effects of unsignalled delayed reinforcement. J Exp Anal Behav. 1976 Nov;26(3):441–449. doi: 10.1901/jeab.1976.26-441. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Williams B. A. Value transmission in discrimination learning involving stimulus chains. J Exp Anal Behav. 1999 Sep;72(2):177–185. doi: 10.1901/jeab.1999.72-177. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of Applied Behavior Analysis are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES