Abstract
Darwinian selection by consequences was instantiated in a computational model that consisted of a repertoire of behaviors undergoing selection, reproduction, and mutation over many generations. The model in effect created a digital organism that emitted behavior continuously. The behavior of this digital organism was studied in three series of computational experiments that arranged reinforcement according to random-interval (RI) schedules. The quantitative features of the model were varied over wide ranges in these experiments, and many of the qualitative features of the model also were varied. The digital organism consistently showed a hyperbolic relation between response and reinforcement rates, and this hyperbolic description of the data was consistently better than the description provided by other, similar, function forms. In addition, the parameters of the hyperbola varied systematically with the quantitative, and some of the qualitative, properties of the model in ways that were consistent with findings from biological organisms. These results suggest that the material events responsible for an organism's responding on RI schedules are computationally equivalent to Darwinian selection by consequences. They also suggest that the computational model developed here is worth pursuing further as a possible dynamic account of behavior.
Full Text
The Full Text of this article is available as a PDF (180.9 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Beardsley S. D., McDowell J. J. Application of Herrnstein's hyperbola to time allocation of naturalistic human behavior maintained by naturalistic social reinforcement. J Exp Anal Behav. 1992 Mar;57(2):177–185. doi: 10.1901/jeab.1992.57-177. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dallery J., McDowell J. J., Lancaster J. S. Falsification of matching theory's account of single-alternative responding: Herrnstein's k varies with sucrose concentration. J Exp Anal Behav. 2000 Jan;73(1):23–43. doi: 10.1901/jeab.2000.73-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Donahoe J. W., Burgos J. E., Palmer D. C. A selectionist approach to reinforcement. J Exp Anal Behav. 1993 Jul;60(1):17–40. doi: 10.1901/jeab.1993.60-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Donahoe J. W., Palmer D. C., Burgos J. E. The S-R issue: its status in behavior analysis and in Donahoe and Palmer's learning and complex behavior. J Exp Anal Behav. 1997 Mar;67(2):193–211. doi: 10.1901/jeab.1997.67-193. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Herrnstein R. J. On the law of effect. J Exp Anal Behav. 1970 Mar;13(2):243–266. doi: 10.1901/jeab.1970.13-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hull D. L., Langman R. E., Glenn S. S. A general account of selection: biology, immunology, and behavior. Behav Brain Sci. 2001 Jun;24(3):511–573. [PubMed] [Google Scholar]
- McDowell J. J., Dallery J. Falsification of matching theory: changes in the asymptote of Herrnstein's hyperbola as a function of water deprivation. J Exp Anal Behav. 1999 Sep;72(2):251–268. doi: 10.1901/jeab.1999.72-251. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McDowell J. J., Wood H. M. Confirmation of linear system theory prediction: Changes in Herrnstein's k as a function of changes in reinforcer magnitude. J Exp Anal Behav. 1984 Mar;41(2):183–192. doi: 10.1901/jeab.1984.41-183. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McDowell J. J., Wood H. M. Confirmation of linear system theory prediction: Rate of change of Herrnstein's kappa as a function of response-force requirement. J Exp Anal Behav. 1985 Jan;43(1):61–73. doi: 10.1901/jeab.1985.43-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shimp C. P. Computational behavior dynamics: an alternative description of Nevin (1969). J Exp Anal Behav. 1992 May;57(3):289–299. doi: 10.1901/jeab.1992.57-289. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Skinner B. F. Selection by consequences. Science. 1981 Jul 31;213(4507):501–504. doi: 10.1126/science.7244649. [DOI] [PubMed] [Google Scholar]
- Vaughan W. Melioration, matching, and maximization. J Exp Anal Behav. 1981 Sep;36(2):141–149. doi: 10.1901/jeab.1981.36-141. [DOI] [PMC free article] [PubMed] [Google Scholar]