Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1962 Oct;5(4 Suppl):543–597. doi: 10.1901/jeab.1962.5-s543

A Review of Positive Conditioned Reinforcement1

Roger T Kelleher, Lewis R Gollub
PMCID: PMC1404082  PMID: 14031747

Abstract

This review critically analyzes experimental data relevant to the concept of conditioned reinforcement. The review has five sections. Section I is a discussion of the relationship between primary and conditioned reinforcement in terms of chains of stimuli and responses. Section II is a detailed analysis of the conditions in which the component stimuli in chained schedules of reinforcement will become conditioned reinforcers; this section also analyzes studies of token reinforcement, observing responses, switching responses, implicit chained schedules, and higher-order conditioning. Section III analyzes experiments in which potential conditioned reinforcers are used either to prolong responding or to generate responding during experimental extinction. This section discusses hypotheses that have been offered as alternatives to the concept of conditioned reinforcement and hypotheses concerning the necessary and sufficient conditions for establishing a conditioned reinforcer. Section IV discusses other variables that act when a conditioned reinforcer is being established or that act when an established conditioned reinforcer is used to develop or maintain behavior. Section V is a general discussion of conditioned reinforcement.

The evidence indicates that the conditioned reinforcing effectiveness of a stimulus is directly related to the frequency of primary reinforcement occurring in its presence, but is independent of the response rate or response pattern occurring in its presence. Results from chained schedules comprised of several components indicate that a stimulus can be established as a conditioned reinforcer by pairing it with an already established conditioned reinforcer rather than a primary reinforcer; however, this type of higher-order conditioning has not been clearly demonstrated with respondent conditioning procedures.

Although discriminative stimuli are usually conditioned reinforcers, the available evidence indicates that establishing a stimulus as a discriminative stimulus is not necessary or sufficient for establishing it as a conditioned reinforcer. Discriminative stimuli in chained schedules with several components are not always conditioned reinforcers; stimuli that are simply paired with reinforcers can become conditioned reinforcers.

The hypotheses that have been offered as alternatives to the concept of conditioned reinforcement are too limited to integrate the data that exist. The concepts of conditioned reinforcement and chained schedule, however, can be used to integrate the data obtained with diverse techniques. Recent experiments have revealed several techniques for the development of effective conditioned reinforcers. These techniques provide a powerful tool for advancing understanding of conditioned reinforcement and for extending control over behavior.

Full text

PDF
543

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. BERSH P. J. The influence of two variables upon the establishment of a secondary reinforcer for operant responses. J Exp Psychol. 1951 Jan;41(1):62–73. doi: 10.1037/h0059386. [DOI] [PubMed] [Google Scholar]
  2. BITTERMAN M. E., FEDDERSEN W. E., TYLER D. W. Secondary reinforcement and the discrimination hypothesis. Am J Psychol. 1953 Jul;66(3):456–464. [PubMed] [Google Scholar]
  3. BUTTER C. M., THOMAS D. R. Secondary reinforcement as a function of the amount of primary reinforcement. J Comp Physiol Psychol. 1958 Jun;51(3):346–348. doi: 10.1037/h0040835. [DOI] [PubMed] [Google Scholar]
  4. CARLTON P. L., MARKS R. A. Cold exposure and heat reinforced operant behavior. Science. 1958 Nov 28;128(3335):1344–1344. doi: 10.1126/science.128.3335.1344. [DOI] [PubMed] [Google Scholar]
  5. COATE W. B. Weakening of conditioned bar-pressing by prior extinction of its subsequent discriminated operant. J Comp Physiol Psychol. 1956 Apr;49(2):135–138. doi: 10.1037/h0049343. [DOI] [PubMed] [Google Scholar]
  6. COPPOCK H. W., CHAMBERS R. M. Reinforcement of position preference by automatic intravenous injections of glucose. J Comp Physiol Psychol. 1954 Oct;47(5):355–357. doi: 10.1037/h0061319. [DOI] [PubMed] [Google Scholar]
  7. D'AMATO M. R., LACHMAN R., KIVY P. Secondary reinforcement as affected by reward schedule and the testing situation. J Comp Physiol Psychol. 1958 Dec;51(6):737–741. doi: 10.1037/h0038446. [DOI] [PubMed] [Google Scholar]
  8. D'AMATO M. R. Secondary reinforcement and magnitude of primary reinforcement. J Comp Physiol Psychol. 1955 Oct;48(5):378–380. doi: 10.1037/h0041068. [DOI] [PubMed] [Google Scholar]
  9. DINSMOOR J. A. A quantitative comparison of the discriminative and reinforcing functions of a stimulus. J Exp Psychol. 1950 Aug;40(4):458–472. doi: 10.1037/h0056266. [DOI] [PubMed] [Google Scholar]
  10. DINSMOOR J. A. Resistance to extinction following periodic reinforcement in the presence of a discriminative stimulus. J Comp Physiol Psychol. 1952 Feb;45(1):31–35. doi: 10.1037/h0060524. [DOI] [PubMed] [Google Scholar]
  11. ELAM C. B., TYLER D. W., BITTERMAN M. E. A further study of secondary reinforcement and the discrimination hypothesis. J Comp Physiol Psychol. 1954 Oct;47(5):381–384. doi: 10.1037/h0060635. [DOI] [PubMed] [Google Scholar]
  12. FERSTER C. B., DEMYER M. K. A method for the experimental analysis of the behavior of autistic children. Am J Orthopsychiatry. 1962 Jan;32:89–98. doi: 10.1111/j.1939-0025.1962.tb00267.x. [DOI] [PubMed] [Google Scholar]
  13. FERSTER C. B. Sustained behavior under delayed reinforcement. J Exp Psychol. 1953 Apr;45(4):218–224. doi: 10.1037/h0062158. [DOI] [PubMed] [Google Scholar]
  14. FINDLEY J. D. An experimental outline for building and exploring multi-operant behavior repertoires. J Exp Anal Behav. 1962 Jan;5(Suppl):113–166. doi: 10.1901/jeab.1962.5-s113. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. FOX R. E., KING R. A. The effects of reinforcement scheduling on the strength of a secondary reinforcer. J Comp Physiol Psychol. 1961 Jun;54:266–269. doi: 10.1037/h0044870. [DOI] [PubMed] [Google Scholar]
  16. Ferster C. B. Intermittent Reinforcement of a Complex Response in a Chimpanzee. J Exp Anal Behav. 1958 Apr;1(2):163–165. doi: 10.1901/jeab.1958.1-163. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Findley J. D. Preference and Switching under Concurrent Scheduling. J Exp Anal Behav. 1958 Apr;1(2):123–144. doi: 10.1901/jeab.1958.1-123. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. GRICE G. R., DAVIS J. D. Effect of irrelevant thirst motivation on a response learned with food reward. J Exp Psychol. 1957 May;53(5):347–352. doi: 10.1037/h0045003. [DOI] [PubMed] [Google Scholar]
  19. GUTTMAN N. Operant conditioning, extinction, and periodic reinforcement in relation to concentration of sucrose used as reinforcing agent. J Exp Psychol. 1953 Oct;46(4):213–224. doi: 10.1037/h0061893. [DOI] [PubMed] [Google Scholar]
  20. HALL J. F. Studies in secondary reinforcement: I. Secondary reinforcement as a function of the frequency of primary reinforcement. J Comp Physiol Psychol. 1951 Jun;44(3):246–251. doi: 10.1037/h0056337. [DOI] [PubMed] [Google Scholar]
  21. HANSON H. M., WITOSLAWSKI J. J. Interaction between the components of a chained schedule. J Exp Anal Behav. 1959 Apr;2:171–177. doi: 10.1901/jeab.1959.2-171. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. HOLZ W. C., AZRIN N. H. Discriminative properties of punishment. J Exp Anal Behav. 1961 Jul;4:225–232. doi: 10.1901/jeab.1961.4-225. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. HOPKINS C. O. Effectiveness of secondary reinforcing stimuli as a function of the quantity and quality of food reinforcement. J Exp Psychol. 1955 Nov;50(5):339–342. doi: 10.1037/h0042708. [DOI] [PubMed] [Google Scholar]
  24. HULL C. L., LIVINGSTON J. R., ROUSE R. O., BARKER A. N. True, sham, and esophageal feeding as reinforcements. J Comp Physiol Psychol. 1951 Jun;44(3):236–245. doi: 10.1037/h0063258. [DOI] [PubMed] [Google Scholar]
  25. JENKINS W. O. A temporal gradient of derived reinforcement. Am J Psychol. 1950 Apr;63(2):237–243. [PubMed] [Google Scholar]
  26. KELLEHER R. T. Conditioned reinforcement in chimpanzees. J Comp Physiol Psychol. 1957 Dec;50(6):571–575. doi: 10.1037/h0044327. [DOI] [PubMed] [Google Scholar]
  27. KELLEHER R. T., FRY W. T. Stimulus functions in chained fixed-interval schedules. J Exp Anal Behav. 1962 Apr;5:167–173. doi: 10.1901/jeab.1962.5-167. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. KELLEHER R. T. Schedules of conditioned reinforcement during experimental extinction. J Exp Anal Behav. 1961 Jan;4:1–5. doi: 10.1901/jeab.1961.4-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. KELLEHER R. T. Stimulus-producing responses in chimpanzees. J Exp Anal Behav. 1958 Jan;1:87–102. doi: 10.1901/jeab.1958.1-87. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Kelleher R. T. Fixed-ratio schedules of conditioned reinforcement with chimpanzees. J Exp Anal Behav. 1958 Aug;1(3):281–289. doi: 10.1901/jeab.1958.1-281. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Kelleher R. T. Intermittent Conditioned Reinforcement in Chimpanzees. Science. 1956 Oct 12;124(3224):679–680. doi: 10.1126/science.124.3224.679. [DOI] [PubMed] [Google Scholar]
  32. LAWSON R. Amount of primary reward and strength of secondary reward. J Exp Psychol. 1953 Sep;46(3):183–187. doi: 10.1037/h0055180. [DOI] [PubMed] [Google Scholar]
  33. LAWSON R. Brightness discrimination performance and secondary reward strength as a function of primary reward amount. J Comp Physiol Psychol. 1957 Feb;50(1):35–39. doi: 10.1037/h0044896. [DOI] [PubMed] [Google Scholar]
  34. MASON D. J. The relation of secondary reinforcement to partial reinforcement. J Comp Physiol Psychol. 1957 Jun;50(3):264–268. doi: 10.1037/h0042212. [DOI] [PubMed] [Google Scholar]
  35. MCCLELLAND D. C., MCGOWN D. R. The effect of variable food reinforcement on the strength of a secondary reward. J Comp Physiol Psychol. 1953 Apr;46(2):80–86. doi: 10.1037/h0054241. [DOI] [PubMed] [Google Scholar]
  36. MILES R. C. The relative effectiveness of secondary reinforcers throughout deprivation and habit-strength parameters. J Comp Physiol Psychol. 1956 Apr;49(2):126–130. doi: 10.1037/h0041648. [DOI] [PubMed] [Google Scholar]
  37. MYERS J. L. Secondary reinforcement: a review of recent experimentation. Psychol Bull. 1958 Sep;55(5):284–301. doi: 10.1037/h0046125. [DOI] [PubMed] [Google Scholar]
  38. NAPALKOV A. V. [Chains of motor conditioned reflexes in pigeons]. Zh Vyssh Nerv Deiat Im I P Pavlova. 1959 Jul-Aug;9:615–621. [PubMed] [Google Scholar]
  39. OLDS J., MILNER P. Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J Comp Physiol Psychol. 1954 Dec;47(6):419–427. doi: 10.1037/h0058775. [DOI] [PubMed] [Google Scholar]
  40. POWELL D. R., Jr, PERKINS C. C., Jr Strength of secondary reinforcement as a determiner of the effects of duration of goal response on learning. J Exp Psychol. 1957 Feb;53(2):106–112. doi: 10.1037/h0045214. [DOI] [PubMed] [Google Scholar]
  41. PREMACK D. Toward empirical behavior laws. I. positive reinforcement. Psychol Rev. 1959 Jul;66(4):219–233. doi: 10.1037/h0040891. [DOI] [PubMed] [Google Scholar]
  42. PROKASY W. F., Jr The acquisition of observing responses in the absence of differential external reinforcement. J Comp Physiol Psychol. 1956 Apr;49(2):131–134. doi: 10.1037/h0046740. [DOI] [PubMed] [Google Scholar]
  43. RATNER S. C. Effect of extinction of dipper-approaching on subsequent extinction of bar-pressing and dipper-approaching. J Comp Physiol Psychol. 1956 Dec;49(6):576–581. doi: 10.1037/h0049151. [DOI] [PubMed] [Google Scholar]
  44. RAZRAN G. A note on second-order conditioning and secondary reinforcement. Psychol Rev. 1955 Sep;62(5):327–332. doi: 10.1037/h0047135. [DOI] [PubMed] [Google Scholar]
  45. RAZRAN G. The observable unconscious and the inferable conscious in current Soviet psychophysiology: interoceptive conditioning, semantic conditioning, and the orienting reflex. Psychol Rev. 1961 Mar;68:1–147. [PubMed] [Google Scholar]
  46. SHAPIRO M. M. Respondent salivary conditioning during operant lever pressing in dogs. Science. 1960 Sep 2;132(3427):619–620. doi: 10.1126/science.132.3427.619. [DOI] [PubMed] [Google Scholar]
  47. STEIN L. Secondary reinforcement established with subcortical stimulation. Science. 1958 Feb 28;127(3296):466–467. doi: 10.1126/science.127.3296.466. [DOI] [PubMed] [Google Scholar]
  48. Skinner B. F., Morse W. H. Sustained performance during very long experimental sessions. J Exp Anal Behav. 1958 Aug;1(3):235–244. doi: 10.1901/jeab.1958.1-235. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. VERPLANCK W. S., HAYES J. R. Eating and drinking as a function of maintenance schedule. J Comp Physiol Psychol. 1953 Oct;46(5):327–333. doi: 10.1037/h0055380. [DOI] [PubMed] [Google Scholar]
  50. WEISS B. Thermal behavior of the sub-nourished and pantothenic-acid-deprived rat. J Comp Physiol Psychol. 1957 Oct;50(5):481–485. doi: 10.1037/h0042270. [DOI] [PubMed] [Google Scholar]
  51. WIKE E. L., BARRIENTOS G. Secondary reinforcement and multiple drive reduction. J Comp Physiol Psychol. 1958 Oct;51(5):640–643. doi: 10.1037/h0047699. [DOI] [PubMed] [Google Scholar]
  52. WILSON M. P., KELLER F. S. On the selective reinforcement of spaced responses. J Comp Physiol Psychol. 1953 Jun;46(3):190–193. doi: 10.1037/h0057705. [DOI] [PubMed] [Google Scholar]
  53. WYCKOFF L. B., Jr The role of observing responses in discrimination learning. Psychol Rev. 1952 Nov;59(6):431–442. doi: 10.1037/h0053932. [DOI] [PubMed] [Google Scholar]
  54. WYCKOFF L. B., SIDOWSKI J., CHAMBLISS D. J. An experimental study of the relationship between secondary reinforcing and cue effects of a stimulus. J Comp Physiol Psychol. 1958 Feb;51(1):103–109. doi: 10.1037/h0046055. [DOI] [PubMed] [Google Scholar]
  55. WYCKOFF L. B. Toward a quantitative theory of secondary reinforcement. Psychol Rev. 1959 Jan;66(1):68–78. doi: 10.1037/h0046882. [DOI] [PubMed] [Google Scholar]
  56. ZIMMERMAN D. W. Durable secondary reinforcement: method and theory. Psychol Rev. 1957 Nov;64, Part 1(6):373–383. doi: 10.1037/h0041885. [DOI] [PubMed] [Google Scholar]
  57. ZIMMERMAN D. W. Sustained performance in rats based on secondary reinforcement. J Comp Physiol Psychol. 1959 Jun;52(3):353–358. doi: 10.1037/h0045807. [DOI] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES