Skip to main content
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1963 Oct;6(4):525–536. doi: 10.1901/jeab.1963.6-525

Towards an empirical calculus of reinforcement value

Thom Verhave
PMCID: PMC1404413  PMID: 14055948

Abstract

Only one of two keys reinforces the subject with food. This key can assume one of two colors, each associated with a different fixed-ratio schedule for obtaining reinforcement. The function of the second key is to permit the animal to switch from the long schedule to the short schedule. If the difference between the ratio schedules is large enough, a preference for the shorter schedule is demonstrable. A quantitative index of preference is obtained as follows: each time the animal switches to the shorter schedule, the number of pecks required to produce the next switch is increased. As the “ante” on the switching key increases, the effective difference between the two ratio schedules decreases. After each food reinforcement, when the bird is exposed to the choice-situation, it takes longer before the bird switches again. This is used to “titrate” the bird's preference. If it does not switch within x sec, the progressively increasing ratio schedule of the switching key is decreased. A specific value, in terms of a rather specific number of responses the bird settles at on the choice key, is obtained. This equilibrium is employed as a dependent variable. Several variables of which it is a function are explored.

Full text

PDF
525

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. FINDLEY J. D. An experimental outline for building and exploring multi-operant behavior repertoires. J Exp Anal Behav. 1962 Jan;5(Suppl):113–166. doi: 10.1901/jeab.1962.5-s113. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Findley J. D. Preference and Switching under Concurrent Scheduling. J Exp Anal Behav. 1958 Apr;1(2):123–144. doi: 10.1901/jeab.1958.1-123. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. HODOS W. Progressive ratio as a measure of reward strength. Science. 1961 Sep 29;134(3483):943–944. doi: 10.1126/science.134.3483.943. [DOI] [PubMed] [Google Scholar]
  4. MILLER N. E. Experiments on motivation. Studies combining psychological, physiological, and pharmacological techniques. Science. 1957 Dec 20;126(3286):1271–1278. doi: 10.1126/science.126.3286.1271. [DOI] [PubMed] [Google Scholar]
  5. SIDMAN M. Avoidance conditioning with brief shock and no exteroceptive warning signal. Science. 1953 Aug 7;118(3058):157–158. doi: 10.1126/science.118.3058.157. [DOI] [PubMed] [Google Scholar]
  6. SIDMAN M., STEBBINS W. C. Satiation effects under fixed-ratio schedules of reinforcement. J Comp Physiol Psychol. 1954 Apr;47(2):114–116. doi: 10.1037/h0054127. [DOI] [PubMed] [Google Scholar]
  7. SIDMAN M. Time out from avoidance as a reinforcer: a study of response interaction. J Exp Anal Behav. 1962 Oct;5:423–434. doi: 10.1901/jeab.1962.5-423. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. VERHAVE T. The functional properties of a time out from an avoidance schedule. J Exp Anal Behav. 1962 Oct;5:391–422. doi: 10.1901/jeab.1962.5-391. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES