Skip to main content
PMC home page
Journal of Applied Behavior Analysis logoLink to Journal of Applied Behavior Analysis
. 2003 Winter;36(4):421–438. doi: 10.1901/jaba.2003.36-421

Dynamic changes in reinforcer effectiveness: theoretical, methodological, and practical implications for applied research.

Eric S Murphy 1, Frances K McSweeney 1, Richard G Smith 1, Jennifer J McComas 1
PMCID: PMC1284459  PMID: 14768663

Abstract

Reinforcers lose their effectiveness when they are presented repeatedly. Traditionally, this loss of effectiveness has been labeled satiation. However, recent evidence suggests that habituation provides a more accurate and useful description. The characteristics of behavior undergoing satiation differ for different stimuli (e.g., food, water), and these characteristics have not been identified for the noningestive reinforcers often used by applied behavior analysts (e.g., praise, attention). As a result, the term satiation provides little guidance for either maintaining or reducing the effectiveness of reinforcers. In contrast, the characteristics of behavior undergoing habituation are well known and are relatively general across species and stimuli. These characteristics provide specific and novel guidance about how to maintain or reduce the effectiveness of a reinforcer. In addition, habituation may lead to a better understanding of several puzzling phenomena in the conditioning literature (e.g., extinction, behavioral contrast), and it may provide a more precise and accurate description of the dynamics of many different types of behavior.

Full Text

The Full Text of this article is available as a PDF (124.2 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. AYLLON T. INTENSIVE TREATMENT OF PSYCHOTIC BEHAVIOUR BY STIMULUS SATIATION AND FOOD REINFORCEMENT. Behav Res Ther. 1963 May;1:53–61. doi: 10.1016/0005-7967(63)90008-1. [DOI] [PubMed] [Google Scholar]
  2. Ahmed S. H., Koob G. F. Long-lasting increase in the set point for cocaine self-administration after escalation in rats. Psychopharmacology (Berl) 1999 Oct;146(3):303–312. doi: 10.1007/s002130051121. [DOI] [PubMed] [Google Scholar]
  3. Aoyama K., McSweeney F. K. Habituation contributes to within-session changes in free wheel running. J Exp Anal Behav. 2001 Nov;76(3):289–302. doi: 10.1901/jeab.2001.76-289. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Ayllon T., Azrin N. H. Reinforcer sampling: a technique for increasing the behavior of mental patients. J Appl Behav Anal. 1968 Spring;1(1):13–20. doi: 10.1901/jaba.1968.1-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Baker T. B., Tiffany S. T. Morphine tolerance as habituation. Psychol Rev. 1985 Jan;92(1):78–108. [PubMed] [Google Scholar]
  6. Belke T. W. Running and responding reinforced by the opportunity to run: effect of reinforcer duration. J Exp Anal Behav. 1997 May;67(3):337–351. doi: 10.1901/jeab.1997.67-337. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Bickel W. K., Kelly T. H. The relationship of stimulus control to the treatment of substance abuse. NIDA Res Monogr. 1988;84:122–140. [PubMed] [Google Scholar]
  8. Bigelow G. E., Griffiths R. R., Liebson I. A. Pharmacological influences upon human ethanol self-administration. Adv Exp Med Biol. 1977;85B:523–538. doi: 10.1007/978-1-4615-9038-5_33. [DOI] [PubMed] [Google Scholar]
  9. Bizo L. A., Bogdanov S. V., Killeen P. R. Satiation causes within-session decreases in instrumental responding. J Exp Psychol Anim Behav Process. 1998 Oct;24(4):439–452. [PubMed] [Google Scholar]
  10. Bowman L. G., Piazza C. C., Fisher W. W., Hagopian L. P., Kogan J. S. Assessment of preference for varied versus constant reinforcers. J Appl Behav Anal. 1997 Fall;30(3):451–458. doi: 10.1901/jaba.1997.30-451. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Broster B. S., Rankin C. H. Effects of changing interstimulus interval during habituation in Caenorhabditis elegans. Behav Neurosci. 1994 Dec;108(6):1019–1029. doi: 10.1037//0735-7044.108.6.1019. [DOI] [PubMed] [Google Scholar]
  12. Charlop M. H., Kurtz P. F., Milstein J. P. Too much reinforcement, too little behavior: assessing task interspersal procedures in conjunction with different reinforcement schedules with autistic children. J Appl Behav Anal. 1992 Winter;25(4):795–808. doi: 10.1901/jaba.1992.25-795. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Cornell C. E., Rodin J., Weingarten H. Stimulus-induced eating when satiated. Physiol Behav. 1989 Apr;45(4):695–704. doi: 10.1016/0031-9384(89)90281-3. [DOI] [PubMed] [Google Scholar]
  14. De Vries T. J., Schoffelmeer A. N., Binnekade R., Vanderschuren L. J. Dopaminergic mechanisms mediating the incentive to seek cocaine and heroin following long-term withdrawal of IV drug self-administration. Psychopharmacology (Berl) 1999 Apr;143(3):254–260. doi: 10.1007/s002130050944. [DOI] [PubMed] [Google Scholar]
  15. Dunlap G., Koegel R. L. Motivating autistic children through stimulus variation. J Appl Behav Anal. 1980 Winter;13(4):619–627. doi: 10.1901/jaba.1980.13-619. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Egel A. L. Reinforcer variation: implications for motivating developmentally disabled children. J Appl Behav Anal. 1981 Fall;14(3):345–350. doi: 10.1901/jaba.1981.14-345. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Eiserer L. A., Hoffman H. S. Priming of ducklings' responses by presenting an imprinted stimulus. J Comp Physiol Psychol. 1973 Mar;82(3):345–359. doi: 10.1037/h0034122. [DOI] [PubMed] [Google Scholar]
  18. Epstein L. H., Rodefer J. S., Wisniewski L., Caggiula A. R. Habituation and dishabituation of human salivary response. Physiol Behav. 1992 May;51(5):945–950. doi: 10.1016/0031-9384(92)90075-d. [DOI] [PubMed] [Google Scholar]
  19. GLANZER M. Changes and interrelations in exploratory behavior. J Comp Physiol Psychol. 1961 Aug;54:433–438. doi: 10.1037/h0045140. [DOI] [PubMed] [Google Scholar]
  20. Gallistel C. R., Stellar J. R., Bubis E. Parametric analysis of brain stimulation reward in the rat: I. The transient process and the memory-containing process. J Comp Physiol Psychol. 1974 Nov;87(5):848–859. doi: 10.1037/h0037220. [DOI] [PubMed] [Google Scholar]
  21. Groves P. M., Thompson R. F. Habituation: a dual-process theory. Psychol Rev. 1970 Sep;77(5):419–450. doi: 10.1037/h0029810. [DOI] [PubMed] [Google Scholar]
  22. Hagopian L. P., Crockett J. L., van Stone M., DeLeon I. G., Bowman L. G. Effects of noncontingent reinforcement on problem behavior and stimulus engagement: the role of satiation, extinction, and alternative reinforcement. J Appl Behav Anal. 2000 Winter;33(4):433–449. doi: 10.1901/jaba.2000.33-433. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Hinson J., Tennison L. Within-session Analysis Of Visual Discrimination. J Exp Anal Behav. 1999 Nov;72(3):385–405. doi: 10.1901/jeab.1999.72-385. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Kahng S. W., Iwata B. A., Thompson R. H., Hanley G. P. A method for identifying satiation versus extinction effects under noncontingent reinforcement schedules. J Appl Behav Anal. 2000 Winter;33(4):419–432. doi: 10.1901/jaba.2000.33-419. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Kennedy C. H., Caruso M., Thompson T. Experimental analyses of gene-brain-behavior relations: some notes on their application. J Appl Behav Anal. 2001 Winter;34(4):539–549. doi: 10.1901/jaba.2001.34-539. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Killeen P. R. Economics, ecologics, and mechanics: The dynamics of responding under conditions of varying motivation. J Exp Anal Behav. 1995 Nov;64(3):405–431. doi: 10.1901/jeab.1995.64-405. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Killeen P. R., Hanson S. J., Osborne S. R. Arousal: its genesis and manifestation as response rate. Psychol Rev. 1978 Nov;85(6):571–581. [PubMed] [Google Scholar]
  28. Lerman D. C., Iwata B. A., Shore B. A., Kahng S. W. Responding maintained by intermittent reinforcement: implications for the use of extinction with problem behavior in clinical settings. J Appl Behav Anal. 1996 Summer;29(2):153–171. doi: 10.1901/jaba.1996.29-153. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Lerman D. C., Kelley M. E., Van Camp C. M., Roane H. S. Effects of reinforcement magnitude on spontaneous recovery. J Appl Behav Anal. 1999 Summer;32(2):197–200. doi: 10.1901/jaba.1999.32-197. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Ludwig A. M., Wikler A., Stark L. H. The first drink: psychobiological aspects of craving. Arch Gen Psychiatry. 1974 Apr;30(4):539–547. doi: 10.1001/archpsyc.1974.01760100093015. [DOI] [PubMed] [Google Scholar]
  31. Mackintosh N. J. Neurobiology, psychology and habituation. Behav Res Ther. 1987;25(2):81–97. doi: 10.1016/0005-7967(87)90079-9. [DOI] [PubMed] [Google Scholar]
  32. Marcus E. A., Nolen T. G., Rankin C. H., Carew T. J. Behavioral dissociation of dishabituation, sensitization, and inhibition in Aplysia. Science. 1988 Jul 8;241(4862):210–213. doi: 10.1126/science.3388032. [DOI] [PubMed] [Google Scholar]
  33. McSweeney F. K., Murphy E. S. Criticisms of the satiety hypothesis as an explanation for within-session decreases in responding. J Exp Anal Behav. 2000 Nov;74(3):347–361. doi: 10.1901/jeab.2000.74-347. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. McSweeney F. K., Norman W. D. Defining behavioral contrast for multiple schedules. J Exp Anal Behav. 1979 Nov;32(3):457–461. doi: 10.1901/jeab.1979.32-457. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. McSweeney F. K., Roll J. M. Responding changes systematically within sessions during conditioning procedures. J Exp Anal Behav. 1993 Nov;60(3):621–640. doi: 10.1901/jeab.1993.60-621. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. McSweeney F. K., Roll J. M., Weatherly J. N. Within-session changes in responding during several simple schedules. J Exp Anal Behav. 1994 Jul;62(1):109–132. doi: 10.1901/jeab.1994.62-109. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. McSweeney F. K., Swindell S. Behavioral economics and within-session changes in responding. J Exp Anal Behav. 1999 Nov;72(3):355–371. doi: 10.1901/jeab.1999.72-355. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. McSweeney F. K., Swindell S., Weatherly J. N. Within-session changes in responding during concurrent schedules with different reinforcers in the components. J Exp Anal Behav. 1996 Nov;66(3):369–390. doi: 10.1901/jeab.1996.66-369. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. McSweeney F., Weatherly J. Habituation To The Reinforcer May Contribute To Multiple-schedule Behavioral Contrast. J Exp Anal Behav. 1998 Mar;69(2):199–221. doi: 10.1901/jeab.1998.69-199. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. McSweeney F., Weatherly J., Swindell S. Within-session Changes In Responding During Concurrent Variable-interval Schedules. J Exp Anal Behav. 1996 Jul;66(1):75–95. doi: 10.1901/jeab.1996.66-75. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. McSweeney Frances K., Murphy Eric S., Kowal Benjamin P. Dishabituation with component transitions may contribute to the interactions observed during multiple schedules. Behav Processes. 2003 Aug 29;64(1):77–89. doi: 10.1016/s0376-6357(03)00127-x. [DOI] [PubMed] [Google Scholar]
  42. McSweeney Frances K., Swindell Samantha. Common processes may contribute to extinction and habituation. J Gen Psychol. 2002 Oct;129(4):364–400. doi: 10.1080/00221300209602103. [DOI] [PubMed] [Google Scholar]
  43. Michael J. Distinguishing between discriminative and motivational functions of stimuli. J Exp Anal Behav. 1982 Jan;37(1):149–155. doi: 10.1901/jeab.1982.37-149. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Myers Ernst Michelle, Epstein Leonard H. Habituation of responding for food in humans. Appetite. 2002 Jun;38(3):224–234. doi: 10.1006/appe.2001.0484. [DOI] [PubMed] [Google Scholar]
  45. Neiss R. Reconceptualizing arousal: psychobiological states in motor performance. Psychol Bull. 1988 May;103(3):345–366. doi: 10.1037/0033-2909.103.3.345. [DOI] [PubMed] [Google Scholar]
  46. REESE T. W., HOGENSON M. J. Food satiation in the pigeon. J Exp Anal Behav. 1962 Apr;5:239–245. doi: 10.1901/jeab.1962.5-239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Staddon J. E., Higa J. J. Multiple time scales in simple habituation. Psychol Rev. 1996 Oct;103(4):720–733. doi: 10.1037/0033-295x.103.4.720. [DOI] [PubMed] [Google Scholar]
  48. Stewart J., de Wit H., Eikelboom R. Role of unconditioned and conditioned drug effects in the self-administration of opiates and stimulants. Psychol Rev. 1984 Apr;91(2):251–268. [PubMed] [Google Scholar]
  49. Strubbe Jan H., van Dijk Gertjan. The temporal organization of ingestive behaviour and its interaction with regulation of energy balance. Neurosci Biobehav Rev. 2002 Jun;26(4):485–498. doi: 10.1016/s0149-7634(02)00016-7. [DOI] [PubMed] [Google Scholar]
  50. Swithers S. E., Hall W. G. Does oral experience terminate ingestion? Appetite. 1994 Oct;23(2):113–138. doi: 10.1006/appe.1994.1041. [DOI] [PubMed] [Google Scholar]
  51. Thompson R. F., Spencer W. A. Habituation: a model phenomenon for the study of neuronal substrates of behavior. Psychol Rev. 1966 Jan;73(1):16–43. doi: 10.1037/h0022681. [DOI] [PubMed] [Google Scholar]
  52. Vollmer T. R., Iwata B. A. Establishing operations and reinforcement effects. J Appl Behav Anal. 1991 Summer;24(2):279–291. doi: 10.1901/jaba.1991.24-279. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Vollmer T. R., Iwata B. A., Zarcone J. R., Smith R. G., Mazaleski J. L. The role of attention in the treatment of attention-maintained self-injurious behavior: noncontingent reinforcement and differential reinforcement of other behavior. J Appl Behav Anal. 1993 Spring;26(1):9–21. doi: 10.1901/jaba.1993.26-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Williams B. A. Another look at contrast in multiple schedules. J Exp Anal Behav. 1983 Mar;39(2):345–384. doi: 10.1901/jeab.1983.39-345. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Williams Ben A. Behavioral contrast redux. Anim Learn Behav. 2002 Feb;30(1):1–20. doi: 10.3758/bf03192905. [DOI] [PubMed] [Google Scholar]
  56. de Wit H., Chutuape M.A. Increased ethanol choice in social drinkers following ethanol preload. Behav Pharmacol. 1993 Feb;4(1):29–36. [PubMed] [Google Scholar]

Articles from Journal of Applied Behavior Analysis are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES