Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1978 Nov;30(3):361–381. doi: 10.1901/jeab.1978.30-361

Discriminated response and incentive processes in operant conditioning: a two-factor model of stimulus control1

Stanley J Weiss
PMCID: PMC1332779  PMID: 16812115

Abstract

Understanding stimulus control generated in instrumental learning requires the direct investigation of discriminated response and reinforcer (incentive) processes acquired exclusively through the response-reinforcer contingencies operating on complex (multicomponent) baselines. Two series of stimulus-compounding studies accomplished this direct investigation. In one series, the independent variable was the relative reinforcement between schedule components; in the second series, it was relative response rate between components. Stimulus-compounding tests revealed that response and incentive processes enhanced each other when in agreement, counteracted each other when in opposition, and produced intermediate results when only one factor was operating. This pattern of results led to the conclusion that these factors were algebraically combining and to the development of a response/incentive matrix reflecting these dynamics. This two-factor analysis was extended to the peak-shift effect in stimulus generalization experiments and to the generation of inhibitory control. Two decades of stimulus compounding and peak-shift research were organized within this two-factor framework, extending this traditional approach to learning to active research areas heretofore not systematically considered in these terms.

Keywords: stimulus control, stimulus compounding, stimulus generalization, incentive, summation, peak shift, inhibition, transfer of control

Full text

PDF
361

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Badia P., Culbertson S. The relative aversiveness of signalled vs unsignalled escapable and inescapable shock. J Exp Anal Behav. 1972 May;17(3):463–471. doi: 10.1901/jeab.1972.17-463. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Bloomfield T. M. A peak shift on a line-tilt continuum. J Exp Anal Behav. 1967 Jul;10(4):361–366. doi: 10.1901/jeab.1967.10-361. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Brownstein A. J. Concurrent schedules of response-independent reinforcement: duration of a reinforcing stimulus. J Exp Anal Behav. 1971 Mar;15(2):211–214. doi: 10.1901/jeab.1971.15-211. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Bull J. A., 3rd, Overmier J. B. Additive and subtractive properties of excitation and inhibition. J Comp Physiol Psychol. 1968 Oct;66(2):511–514. doi: 10.1037/h0026362. [DOI] [PubMed] [Google Scholar]
  5. CATANIA A. C. Concurrent performances: a baseline for the study of reinforcement magnitude. J Exp Anal Behav. 1963 Apr;6:299–300. doi: 10.1901/jeab.1963.6-299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Chung S. H., Herrnstein R. J. Choice and delay of reinforcement. J Exp Anal Behav. 1967 Jan;10(1):67–74. doi: 10.1901/jeab.1967.10-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. DICKSON J. F., Jr, THOMAS D. R. OPERANT DISCRIMINATION LEARNING AND STIMULUS GENERALIZATION AS A FUNCTION OF REWARD EXPOSURE. J Comp Physiol Psychol. 1963 Oct;56:829–833. doi: 10.1037/h0045066. [DOI] [PubMed] [Google Scholar]
  8. DINSMOOR J. A. A quantitative comparison of the discriminative and reinforcing functions of a stimulus. J Exp Psychol. 1950 Aug;40(4):458–472. doi: 10.1037/h0056266. [DOI] [PubMed] [Google Scholar]
  9. De Villiers P. A., Millenson J. R. Concurrent performances: a baseline for the study of conditioned anxiety. J Exp Anal Behav. 1972 Sep;18(2):287–294. doi: 10.1901/jeab.1972.18-287. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Dukhayyil A., Lyons J. E. The effect of overtraining on behavioral contrast and the peak-shift. J Exp Anal Behav. 1973 Sep;20(2):253–263. doi: 10.1901/jeab.1973.20-253. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Duncan B., Fantino E. The psychological distance to reward. J Exp Anal Behav. 1972 Jul;18(1):23–34. doi: 10.1901/jeab.1972.18-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Dysart J., Marx M. H., McLean J., Nelson J. A. Peak shift as a function of multiple schedules of reinforcement. J Exp Anal Behav. 1974 Nov;22(3):463–470. doi: 10.1901/jeab.1974.22-463. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Emurian H. H., Weiss S. J. Compounding discriminative stimuli controlling free-operant avoidance. J Exp Anal Behav. 1972 Mar;17(2):249–256. doi: 10.1901/jeab.1972.17-249. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Ernst A. J., Engberg L., Thomas D. R. On the form of stimulus generalization curves for visual intensity. J Exp Anal Behav. 1971 Sep;16(2):177–180. doi: 10.1901/jeab.1971.16-177. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. FREEBURNE C. M., TAYLOR J. E. Discrimination learning with shock for right and wrong responses in the same subjects. J Comp Physiol Psychol. 1952 Jun;45(3):266–268. [PubMed] [Google Scholar]
  16. GUTTMAN N. Generalization gradients around stimuli associated with different reinforcement schedules. J Exp Psychol. 1959 Nov;58:335–340. doi: 10.1037/h0045679. [DOI] [PubMed] [Google Scholar]
  17. GUTTMAN N., KALISH H. I. Discriminability and stimulus generalization. J Exp Psychol. 1956 Jan;51(1):79–88. doi: 10.1037/h0046219. [DOI] [PubMed] [Google Scholar]
  18. Gibbon J., Berryman R., Thompson R. L. Contingency spaces and measures in classical and instrumental conditioning. J Exp Anal Behav. 1974 May;21(3):585–605. doi: 10.1901/jeab.1974.21-585. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Grusec T. The peak shift in stimulus generalization: equivalent effects of errors and noncontingent shock. J Exp Anal Behav. 1968 May;11(3):239–249. doi: 10.1901/jeab.1968.11-239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Gutman A. Positive contrast, negative induction, and inhibitory stimulus control in the rat. J Exp Anal Behav. 1977 Mar;27(2):219–233. doi: 10.1901/jeab.1977.27-219. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. HANSON H. M. Effects of discrimination training on stimulus generalization. J Exp Psychol. 1959 Nov;58:321–334. doi: 10.1037/h0042606. [DOI] [PubMed] [Google Scholar]
  22. HEARST E., KORESKO M. B., POPPEN R. STIMULUS GENERALIZATION AND THE RESPONSE-REINFORCEMENT CONTINGENCY. J Exp Anal Behav. 1964 Sep;7:369–380. doi: 10.1901/jeab.1964.7-369. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. HEARST E., SIDMAN M. Some behavioral effects of a concurrently positive and negative stimulus. J Exp Anal Behav. 1961 Jul;4:251–256. doi: 10.1901/jeab.1961.4-251. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. HERRNSTEIN R. J. SECONDARY REINFORCEMENT AND RATE OF PRIMARY REINFORCEMENT. J Exp Anal Behav. 1964 Jan;7:27–36. doi: 10.1901/jeab.1964.7-27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. HOLZ W. C., AZRIN N. H., AYLLON T. Elimination of behavior of mental patients by response-produced extinction. J Exp Anal Behav. 1963 Jul;6:407–412. doi: 10.1901/jeab.1963.6-407. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. HONIG W. K. Prediction of preference, transposition, and transposition-reversal from the generalization gradient. J Exp Psychol. 1962 Sep;64:239–248. doi: 10.1037/h0048290. [DOI] [PubMed] [Google Scholar]
  27. Hearst E., Besley S., Farthing G. W. Inhibition and the stimulus control of operant behavior. J Exp Anal Behav. 1970 Nov;14(3 Pt 2 Suppl):373–409. doi: 10.1901/jeab.1970.14-s373. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Hearst E. Contrast and stimulus generalization following prolonged discrimination training. J Exp Anal Behav. 1971 May;15(3):355–363. doi: 10.1901/jeab.1971.15-355. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Hearst E. Discrimination learning as the summation of excitation and inhibition. Science. 1968 Dec 13;162(3859):1303–1306. doi: 10.1126/science.162.3859.1303. [DOI] [PubMed] [Google Scholar]
  30. Hendry D. P., Switalski R., Yarczower M. Generalization of conditioned suppression after differential training. J Exp Anal Behav. 1969 Sep;12(5):799–806. doi: 10.1901/jeab.1969.12-799. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Huff R. C., Sherman J. E., Cohn M. Some effects of response-independent reinforcement on auditory generalization gradients. J Exp Anal Behav. 1975 Jan;23(1):81–86. doi: 10.1901/jeab.1975.23-81. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. KELLEHER R. T., GOLLUB L. R. A review of positive conditioned reinforcement. J Exp Anal Behav. 1962 Oct;5:543–597. doi: 10.1901/jeab.1962.5-s543. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Klein M., Rilling M. Generalization of free-operant avoidance behavior in pigeons. J Exp Anal Behav. 1974 Jan;21(1):75–88. doi: 10.1901/jeab.1974.21-75. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. LEWIS M. EFFECT OF EFFORT ON VALUE: AN EXPLORATORY STUDY OF CHILDREN. Child Dev. 1964 Dec;35:1337–1342. doi: 10.1111/j.1467-8624.1964.tb05271.x. [DOI] [PubMed] [Google Scholar]
  35. LEWIS M. PSYCHOLOGICAL EFFECT OF EFFORT. Psychol Bull. 1965 Sep;64:183–190. doi: 10.1037/h0022224. [DOI] [PubMed] [Google Scholar]
  36. Lolordo V. M. Positive conditioned reinforcement from aversive situations. Psychol Bull. 1969 Sep;72(3):193–203. doi: 10.1037/h0027907. [DOI] [PubMed] [Google Scholar]
  37. Mariner R. W., Thomas D. R. Reinforcement duration and the peak shift in post-discrimination gradients. J Exp Anal Behav. 1969 Sep;12(5):759–766. doi: 10.1901/jeab.1969.12-759. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Melnick J. The effects of summated stimuli with retarded children. J Exp Child Psychol. 1972 Oct;14(2):277–286. doi: 10.1016/0022-0965(72)90050-1. [DOI] [PubMed] [Google Scholar]
  39. Meltzer D., Niebuhr B. R. Additive and suppressive response summation with a chain schedule. J Exp Anal Behav. 1974 Nov;22(3):519–524. doi: 10.1901/jeab.1974.22-519. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Miller L., Ackley R. Summation of responding maintained by fixed-interval schedules. J Exp Anal Behav. 1970 Mar;13(2):199–203. doi: 10.1901/jeab.1970.13-199. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Miller L. Compounding of discriminative stimuli from the same and different sensory modalities. J Exp Anal Behav. 1971 Nov;16(3):337–342. doi: 10.1901/jeab.1971.16-337. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Miller L. Compounding of pre-aversive stimuli. J Exp Anal Behav. 1969 Mar;12(2):293–299. doi: 10.1901/jeab.1969.12-293. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Overmier J. B., Seligman M. E. Effects of inescapable shock upon subsequent escape and avoidance responding. J Comp Physiol Psychol. 1967 Feb;63(1):28–33. doi: 10.1037/h0024166. [DOI] [PubMed] [Google Scholar]
  44. PIERREL R., SHERMAN J. G. Generalization and discrimination as a function of the S-D-S delta intensity difference. J Exp Anal Behav. 1962 Jan;5:67–71. doi: 10.1901/jeab.1962.5-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. PIERREL R., SHERMAN J. G. Generalization of auditory intensity following discrimination training. J Exp Anal Behav. 1960 Oct;3:313–322. doi: 10.1901/jeab.1960.3-313. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. RESCORLA R. A., LOLORDO V. M. INHIBITION OF AVOIDANCE BEHAVIOR. J Comp Physiol Psychol. 1965 Jun;59:406–412. doi: 10.1037/h0022060. [DOI] [PubMed] [Google Scholar]
  47. Rescorla R. A., Solomon R. L. Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning. Psychol Rev. 1967 May;74(3):151–182. doi: 10.1037/h0024475. [DOI] [PubMed] [Google Scholar]
  48. Richards R. W. Stimulus generalization and delay of reinforcement during one component of a multiple schedule. J Exp Anal Behav. 1973 Mar;19(2):303–309. doi: 10.1901/jeab.1973.19-303. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Riess D. Pavlovian phenomena in conditioned acceleration--stimulus summation. Cond Reflex. 1969 Oct-Dec;4(4):257–264. [PubMed] [Google Scholar]
  50. Rudolph R. L., Honig W. K. Effects of monochromatic rearing on spectral discrimination learning and the peak shift in chicks. J Exp Anal Behav. 1972 Jan;17(1):107–111. doi: 10.1901/jeab.1972.17-107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. SIDMAN M. Conditioned reinforcing and aversive stimuli in an avoidance situation. Trans N Y Acad Sci. 1957 Apr;19(6):534–544. doi: 10.1111/j.2164-0947.1957.tb00547.x. [DOI] [PubMed] [Google Scholar]
  52. SLOANE H. N., Jr STIMULUS GENERALIZATION ALONG A LIGHT FLICKER RATE CONTINUUM AFTER DISCRIMINATION TRAINING WITH SEVERAL S-'S. J Exp Anal Behav. 1964 May;7:217–222. doi: 10.1901/jeab.1964.7-217. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Stevenson J. G. Stimulus generalization: the ordering and spacing of test stimuli. J Exp Anal Behav. 1966 Jul;9(4):457–468. doi: 10.1901/jeab.1966.9-457. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. TERRACE H. S. WAVELENGTH GENERALIZATION AFTER DISCRIMINATION LEARNING WITH AND WITHOUT ERRORS. Science. 1964 Apr 3;144(3614):78–80. doi: 10.1126/science.144.3614.78. [DOI] [PubMed] [Google Scholar]
  55. THOMAS D. R. The effects of drive and discrimination training on stimulus generalization. J Exp Psychol. 1962 Jul;64:24–28. doi: 10.1037/h0047080. [DOI] [PubMed] [Google Scholar]
  56. THOMAS D. R., WILLIAMS J. L. A further study of stimulus generalization following three-stimulus discrimination training. J Exp Anal Behav. 1963 Apr;6:171–176. doi: 10.1901/jeab.1963.6-171. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. THOMPSON D. M. PUNISHMENT BY SD ASSOCIATED WITH FIXED-RATIO REINFORCEMENT. J Exp Anal Behav. 1965 May;8:189–194. doi: 10.1901/jeab.1965.8-189. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Terrace H. S. Behavioral contrast and the peak shift: effects of extended discrimination training. J Exp Anal Behav. 1966 Nov;9(6):613–617. doi: 10.1901/jeab.1966.9-613. [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Terrace H. S. Discrimination learning and inhibition. Science. 1966 Dec 30;154(3757):1677–1680. doi: 10.1126/science.154.3757.1677. [DOI] [PubMed] [Google Scholar]
  60. Terrace H. S. Discrimination learning, the peak shift, and behavioral contrast. J Exp Anal Behav. 1968 Nov;11(6):727–741. doi: 10.1901/jeab.1968.11-727. [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Terrace H. S. Evidence for the innate basis of the hue dimension in the duckling. J Exp Anal Behav. 1975 Jul;24(1):79–87. doi: 10.1901/jeab.1975.24-79. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Thomas D. R., Burr D. E. Stimulus generalization as a function of the delay between training and testing procedures: a reevaluation. J Exp Anal Behav. 1969 Jan;12(1):105–109. doi: 10.1901/jeab.1969.12-105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  63. Thomas D. R., Lyons J. Further evidence of a sensory-tonic interaction in pigeons. J Exp Anal Behav. 1968 Mar;11(2):167–171. doi: 10.1901/jeab.1968.11-167. [DOI] [PMC free article] [PubMed] [Google Scholar]
  64. Thomas D. R., Ost J., Thomas D. Stimulus Generalization as a Function of the Time between Training and Testing Procedures. J Exp Anal Behav. 1960 Jan;3(1):9–14. doi: 10.1901/jeab.1960.3-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  65. VERHAVE T. The functional properties of a time out from an avoidance schedule. J Exp Anal Behav. 1962 Oct;5:391–422. doi: 10.1901/jeab.1962.5-391. [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Van Houten R., Rudolph R. Summation of punishment suppression. J Exp Anal Behav. 1971 Jan;15(1):117–121. doi: 10.1901/jeab.1971.15-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  67. WEISS S. J. SUMMATION OF RESPONSE STRENGTHS INSTRUMENTALLY CONDITIONED TO STIMULI IN DIFFERENT SENSORY MODALITIES. J Exp Psychol. 1964 Aug;68:151–155. doi: 10.1037/h0049180. [DOI] [PubMed] [Google Scholar]
  68. WOLF M. M. Some effects of combined S-DS. J Exp Anal Behav. 1963 Jul;6:343–347. doi: 10.1901/jeab.1963.6-343. [DOI] [PMC free article] [PubMed] [Google Scholar]
  69. Weisman R. G. Factors influencing inhibitory stimulus control: differential reinforcement of other behavior during discrimination training. J Exp Anal Behav. 1970 Jul;14(1):87–91. doi: 10.1901/jeab.1970.14-87. [DOI] [PMC free article] [PubMed] [Google Scholar]
  70. Weisman R. G., Ramsden M. Discrimination of a response-independent component in a multiple schedule. J Exp Anal Behav. 1973 Jan;19(1):55–64. doi: 10.1901/jeab.1973.19-55. [DOI] [PMC free article] [PubMed] [Google Scholar]
  71. Weisman R. G. Some determinants of inhibitory stimulus control. J Exp Anal Behav. 1969 May;12(3):443–450. doi: 10.1901/jeab.1969.12-443. [DOI] [PMC free article] [PubMed] [Google Scholar]
  72. Weiss S. J. Discrimination training and stimulus compounding: consideration of non-reinforcement and response differentiation consequences of S. J Exp Anal Behav. 1971 May;15(3):387–402. doi: 10.1901/jeab.1971.15-387. [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. Weiss S. J. Stimulus compounding in free-operant and classical conditioning. A review and analysis. Psychol Bull. 1972 Sep;78(3):189–208. doi: 10.1037/h0032956. [DOI] [PubMed] [Google Scholar]
  74. Wheatley K. L., Thomas D. R. Relative and absolute density of reinforcement as factors influencing the peak shift. J Exp Anal Behav. 1974 Sep;22(2):409–418. doi: 10.1901/jeab.1974.22-409. [DOI] [PMC free article] [PubMed] [Google Scholar]
  75. Wildemann D. G., Holland J. G. The effect of the blackout method on acquisition and generalization. J Exp Anal Behav. 1973 Jan;19(1):73–80. doi: 10.1901/jeab.1973.19-73. [DOI] [PMC free article] [PubMed] [Google Scholar]
  76. Williams B. A. The failure of stimulus control after presence-absence discrimination of click-rate. J Exp Anal Behav. 1973 Jul;20(1):23–27. doi: 10.1901/jeab.1973.20-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  77. Wiltz R. A. Combined-stimulus control as a function of the response rate controlled by the absence of the single stimuli. J Exp Anal Behav. 1972 Nov;18(3):541–551. doi: 10.1901/jeab.1972.18-541. [DOI] [PMC free article] [PubMed] [Google Scholar]
  78. Wiltz R. A. Combining stimuli signalling response-dependent food and shock. J Exp Anal Behav. 1974 Sep;22(2):363–370. doi: 10.1901/jeab.1974.22-363. [DOI] [PMC free article] [PubMed] [Google Scholar]
  79. Yarczower M., Dickson J. F., Gollub L. R. Some effects on generalization gradients of tandem schedules. J Exp Anal Behav. 1966 Nov;9(6):631–639. doi: 10.1901/jeab.1966.9-631. [DOI] [PMC free article] [PubMed] [Google Scholar]
  80. Yarczower M., Gollub L. R., Dickson J. F. Some effects of discriminative training with equated frequency of reinforcement. J Exp Anal Behav. 1968 Jul;11(4):415–423. doi: 10.1901/jeab.1968.11-415. [DOI] [PMC free article] [PubMed] [Google Scholar]
  81. Yarczower M., Gollub L. R., Dickson J. F. Stimulus control and the response-reinforcement contingency. J Exp Anal Behav. 1969 Jul;12(4):561–563. doi: 10.1901/jeab.1969.12-561. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES