Skip to main content
NCBI home page
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1994 Nov;62(3):367–383. doi: 10.1901/jeab.1994.62-367

Instructional versus schedule control of humans' choices in situations of diminishing returns

Timothy D Hackenberg, Veronica R Joker
PMCID: PMC1334473  PMID: 16812747

Abstract

Four adult humans chose repeatedly between a fixed-time schedule (of points later exchangeable for money) and a progressive-time schedule that began at 0 s and increased by a fixed number of seconds with each point delivered by that schedule. Each point delivered by the fixed-time schedule reset the requirements of the progressive-time schedule to its minimum value. Subjects were provided with instructions that specified a particular sequence of choices. Under the initial conditions, the instructions accurately specified the optimal choice sequence. Thus, control by instructions and optimal control by the programmed contingencies both supported the same performance. To distinguish the effects of instructions from schedule sensitivity, the correspondence between the instructed and optimal choice patterns was gradually altered across conditions by varying the step size of the progressive-time schedule while maintaining the same instructions. Step size was manipulated, typically in 1-s units, first in an ascending and then in a descending sequence of conditions. Instructions quickly established control in all 4 subjects but, by narrowing the range of choice patterns, they reduced subsequent sensitivity to schedule changes. Instructional control was maintained across the ascending sequence of progressive-time values for each subject, but eventually diminished, giving way to more schedule-appropriate patterns. The transition from instruction-appropriate to schedule-appropriate behavior was characterized by an increase in the variability of choice patterns and local increases in point density. On the descending sequence of progressive-time values, behavior appeared to be schedule sensitive, sometimes even optimally sensitive, but it did not always change systematically with the contingencies, suggesting the involvement of other factors.

Keywords: instructional control, schedule control, verbal behavior, choice, progressive-time schedules, fixed-time schedules, key press, adult humans

Full text

PDF
367

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. AYLLON T., AZRIN N. H. REINFORCEMENT AND INSTRUCTIONS WITH MENTAL PATIENTS. J Exp Anal Behav. 1964 Jul;7:327–331. doi: 10.1901/jeab.1964.7-327. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Baron A., Kaufman A. Human, free-operant avoidance of "time out" from monetary reinforcement. J Exp Anal Behav. 1966 Sep;9(5):557–565. doi: 10.1901/jeab.1966.9-557. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Baron A., Kaufman A., Stauber K. A. Effects of instructions and reinforcement-feedback on human operant behavior maintained by fixed-interval reinforcement. J Exp Anal Behav. 1969 Sep;12(5):701–712. doi: 10.1901/jeab.1969.12-701. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Baum W. M. Chained concurrent schedules: reinforcement as situation transition. J Exp Anal Behav. 1974 Jul;22(1):91–101. doi: 10.1901/jeab.1974.22-91. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Cerutti D. T. Discrimination theory of rule-governed behavior. J Exp Anal Behav. 1989 Mar;51(2):259–276. doi: 10.1901/jeab.1989.51-259. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Charnov E. L. Optimal foraging, the marginal value theorem. Theor Popul Biol. 1976 Apr;9(2):129–136. doi: 10.1016/0040-5809(76)90040-x. [DOI] [PubMed] [Google Scholar]
  7. Critchfield T. S. Signal-detection properties of verbal self-reports. J Exp Anal Behav. 1993 Nov;60(3):495–514. doi: 10.1901/jeab.1993.60-495. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Galizio M. Contingency-shaped and rule-governed behavior: instructional control of human loss avoidance. J Exp Anal Behav. 1979 Jan;31(1):53–70. doi: 10.1901/jeab.1979.31-53. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Hackenberg T. D., Axtell S. A. Human's choices in situations of time-based diminishing returns. J Exp Anal Behav. 1993 May;59(3):445–470. doi: 10.1901/jeab.1993.59-445. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Hayes S. C., Brownstein A. J., Haas J. R., Greenway D. E. Instructions, multiple schedules, and extinction: Distinguishing rule-governed from schedule-controlled behavior. J Exp Anal Behav. 1986 Sep;46(2):137–147. doi: 10.1901/jeab.1986.46-137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Hayes S. C., Brownstein A. J., Zettle R. D., Rosenfarb I., Korn Z. Rule-governed behavior and sensitivity to changing consequences of responding. J Exp Anal Behav. 1986 May;45(3):237–256. doi: 10.1901/jeab.1986.45-237. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Horne P. J., Lowe C. F. Determinants of human performance on concurrent schedules. J Exp Anal Behav. 1993 Jan;59(1):29–60. doi: 10.1901/jeab.1993.59-29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Joyce J. H., Chase P. N. Effects of response variability on the sensitivity of rule-governed behavior. J Exp Anal Behav. 1990 Nov;54(3):251–262. doi: 10.1901/jeab.1990.54-251. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Lefrancois J. R., Chase P. N., Joyce J. H. The effects of a variety of instructions on human fixed-interval performance. J Exp Anal Behav. 1988 May;49(3):383–393. doi: 10.1901/jeab.1988.49-383. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Rosenfarb I. S., Newland M. C., Brannon S. E., Howey D. S. Effects of self-generated rules on the development of schedule-controlled behavior. J Exp Anal Behav. 1992 Jul;58(1):107–121. doi: 10.1901/jeab.1992.58-107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Shimoff E., Catania A. C., Matthews B. A. Uninstructed human responding: Sensitivity of low-rate performance to schedule contingencies. J Exp Anal Behav. 1981 Sep;36(2):207–220. doi: 10.1901/jeab.1981.36-207. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Shimoff E., Matthews B. A., Catania A. C. Human operant performance: Sensitivity and pseudosensitivity to contingencies. J Exp Anal Behav. 1986 Sep;46(2):149–157. doi: 10.1901/jeab.1986.46-149. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Torgrud L. J., Holborn S. W. The effects of verbal performance descriptions on nonverbal operant responding. J Exp Anal Behav. 1990 Nov;54(3):273–291. doi: 10.1901/jeab.1990.54-273. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Vaughan M. E. Repeated acquisition in the analysis of rule-governed behavior. J Exp Anal Behav. 1985 Sep;44(2):175–184. doi: 10.1901/jeab.1985.44-175. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Wulfert E., Dougher M. J., Greenway D. E. Protocol analysis of the correspondence of verbal behavior and equivalence class formation. J Exp Anal Behav. 1991 Nov;56(3):489–504. doi: 10.1901/jeab.1991.56-489. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES