Abstract
Science evolves from prior approximations of its current form. Interest in changes in species over time was not a new concept when Darwin made his famous voyage to the Galapagos Islands; concern with speciation stretches back throughout the history of modern thought. Behavioral science also does and must evolve. Such change can be difficult, but it can also yield great dividends. The focus of the current special section is on a common mutation that appears to have emerged across these areas and the critical features that define an emerging research area—applied quantitative analysis of behavior (AQAB). In this introduction to the “Special Issue on Applications of Quantitative Methods,” we will outline some of the common characteristics of research in this area, an exercise that will surely be outdated as the research area continues to progress. In doing so, we also describe how AQAB is relevant to theory, behavioral pharmacology, applied behavior analysis, and health behaviors. Finally, we provide a summary for the articles that appear in this special issue. The authors of these papers are all thinking outside the Skinner box, creating new tools and approaches, and testing them against relevant data. If we can keep up this evolution of methods and ideas, behavior analysis will regain its place at the head of the table!
Keywords: Applied quantitative analysis of behavior, Experimental analysis of behavior, Behavioral pharmacology, Applied behavior analysis, health behavior
Science evolves from prior approximations of its current form. Interest in changes in species over time was not a new concept when Darwin made his famous voyage to the Galapagos Islands; concern with speciation stretches back throughout the history of modern thought. The early Greek philosopher Anaximander (c. 610–546 bce), posited that land animals possibly descended from sea animals as an adaptation to the earth’s drying up (Kirk et al., 1983; Krebs, 2004). Although this interpretation has been debated (Gregory, 2017, p. 34–35), it nevertheless points to an early recognition that species are not static—and that some mechanism drives their change. This view may have been displaced by the essentialism of Plato (c. 428–348 BCE) and Aristotle (c. 384–322 bce), but evolutionary thought remained commonplace among elite Greeks through the Hellenistic era (Mayr, 1982). Although these musings were in line with evolution, they fell short of a comprehensive theory.
Philosophical thought on speciation, however, may have been the primordial ooze from which the ideas that became the backbone of evolutionary thought were selected. Lamarckian transmutation of species emerged—which contended that simple forms of life were generated and pushed by a “life force” towards greater complexity (Bowler, 2003). Although he did not believe in a common ancestor, Lamarck acknowledged that environmental pressures interacted with this process to create intergenerational adaptions to environmental circumstances—which created differing species. Darwin’s natural selection (Darwin, 1859) deploys this notion of intergenerational selection by environmental pressures, adding a clear mechanism (i.e., differential survival/reproduction) and greater contiguity (i.e., a common ancestor). Whereas the process of evolution and Darwin’s approach was eventually selected by the scientific community, the mechanism (i.e., natural selection) was not accepted until its combination with Mendelian Genetics in the modern synthesis (Huxley, 1974)—the heart of the evolutionary framework dominant to this day.
Behavioral science also does and must evolve. Such change can be difficult, but it can also yield great dividends. For example, the evolution of Herrnstein’s quantitative analysis of behavior from Skinner’s experimental analysis of behavior opened the door to sophisticated and precise approaches to theory development (Baum, 2002; Killeen, 1994). Likewise, the emergence of behavioral pharmacology (Laties, 2003) and applied behavior analysis (ABA; Baer et al., 1968) from their roots in the experimental analysis of behavior have yielded remarkable treatments for a range of conditions. Although a tome could be penned about the adaptations that these new environments have spurred (e.g., the acceptance of direct observation as a datum; Wolf (1993), the emergence of rapidly testable assays), the focus of the current special section is on a common mutation that appears to have emerged across these areas, and the critical features (Layng, 2019) that define an emerging research area—applied quantitative analysis of behavior (AQAB).
What is Applied Quantitative Analysis of Behavior?
Applied quantitative analysis of behavior is a new term, and thus deserves an introduction. It may be helpful to start with what is meant by each of the components in the title: What do “applied,” “quantitative,” “analysis,” and “behavior” mean? Doing so should not be construed as some sort of checklist for what defines research in the area. As a science, we have tried that approach in ABA (based on Baer et al., 1968), and there is reason to believe that that was a bad idea (Critchfield & Reed, 2017). Instead, we will outline some of the common characteristics of research in this area, an exercise that will surely be outdated as the research area continues to progress.
Working backwards, what do we mean by behavior? Defining behavior might seem to be a simple task for a behavior analyst, but maybe it’s not. Topography-based definitions of directly observed behavior are common in ABA. This approach dates back to the early recognition that mechanical recording of behavior in natural settings is often not feasible (Wolf, 1993) and represents a methodological compromise that likely facilitated applied behavior analysts’ entry into a wide range of relevant settings. The compromise, however, built a structural measurement tradition that markedly differed from the functional measurement tradition prominent in the experimental analysis of behavior, wherein responses are typically defined by their impact on the environment (e.g., closing a circuit behind a lever or response key) rather than their physical properties (e.g., the rat depressing the lever enough to close the circuit with its rear is treated as equivalent to closing it with their paw). Moreover, as the quantitative analysis of behavior emerged, measures such as time allocation (Baum & Rachlin, 1969) by animals responding under concurrent schedules emerged - separating measurement from the operative contingencies. Respecting the individuality of responding, many studies in behavioral pharmacology and other areas have adopted proportion-of-baseline as viable measure of change (Branch, 1991). And in areas of decision-making research, such as behavioral economics, self-report of hypothetical choices have been profitably used (Madden et al., 1997; Odum, 2011; Rachlin et al., 1991). This list is far from exhaustive. The key point is that data that can be useful for AQAB need not be restricted in form. Instead, the value of data to be used should be defined more pragmatically. If the use of a particular measure can be justified as revealing important order in nature, who are we to oppose it based on some outdated checklist-based approach to judging science? The responsibility to establish the value of the data, however, falls on the investigator.
Continuing from the back, what is the analysis of behavior? This also seems simple. Baer et al. (1968) likened their analytic dimension to establishing experimental control over behavior. We can be thankful that they did not hold their own work to that criterion or we would have been deprived of the solely correlational Meaningful Differences (Hart & Risely, 1995), which, it can be argued, is the most influential behavior analytic research to date (i.e., if measured by the number of times references in presidential speeches). Moreover, there are endless examples of correlational AQAB research that has added to our understanding of behavior and/or clinical conditions. The commonality between the experimental and correlational analyses of behavior in AQAB to date rests solidly on the demonstration of order in natural phenomena. Thus, it does not matter if the demonstration of order is experimental (Bickel et al., 2011b; Koffarnus et al., 2013; Rung & Epstein, 2020; Sofis et al., 2016; Sweeney & Shahan, 2013), cross sectional (Bruce et al., 2016; Madden et al., 1997), or correlational (Jarmolowicz et al., 2014; Sheffer et al., 2014; Vollmer & Bourret, 2000; Washio et al., 2011) if order is highlighted, the study can classify as the experimental analysis of behavior.
We must next consider the quantitative analysis of behavior. This is a well-established area of research centered around a shared love of finding theoretical order in observed behavior via the use of sophisticated quantitative models. Exemplars of this tradition can be seen at the annual meeting of the Society for the Quantitative Analysis of Behavior (SQAB), held just prior to the Association for Behavior Analysis International’s annual convention. We encourage anyone who can to attend SQAB at least once, or if you cannot attend, examine them in their published form in a special issue each year. Most of the models used in AQAB were developed and refined by this research area—thus, AQAB owes a great debt to the quantitative analysis of behavior. Given the robustness of the area, and the importance of basic science to developing actionable interventions, regular consultation with those proceedings should be on everyone’s to-do list.
Lastly, let’s consider AQAB. We would argue that AQAB is a distinct research area born out of both ABA and the quantitative analysis of behavior. It is distinct from the quantitative analysis of behavior in focus. In particular, rather than a focus on the development and refinement of theoretical statements (Smith, 2015), AQAB builds from these theories and analyses to understand issues of societal concern (Baer et al., 1968). Many researchers working in this tradition have worked absent a formal title for the endeavor. For example, extensive research has been conducted applying behavioral economic concepts and analyses such as delay discounting and demand to understand clinically relevant behavior such as substance use disorders (Bickel, Landes, et al., 2011a; Greenwald & Steinmiller, 2009, 2014; Yoon et al., 2021), and other poor health behaviors such as that manifest in obesity (Epstein et al., 2010; Stojek & MacKillop, 2017). These analyses and tools have given us sensitive and formal approaches to assessing abuse liability of drugs (Hursh et al., 2005; Hursh & Winger, 1995) and application of related analyses (e.g., probability discounting) have contributed significantly to our understanding of health behavior such as medication adherence (Bruce et al., 2018a; Bruce et al., 2018b; Jarmolowicz et al., 2017).
AQAB remains distinct from ABA in two respects: (1) the methodological differences related to behavior and the analysis of behavior described above may prevent some from considering this work under the ABA umbrella; and (2) AQAB is defined “by the interest society shows in the problem being studied” (Baer et al., 1968, p. 92) rather than in the subject or client benefiting from the research—as is often the interpretation of Baer et al.'s (1968) applied dimension. Although many of these analyses (e.g., applications of the matching law to athletic performance; Vollmer & Bourret, 2000) have continued to be published alongside more traditional ABA articles, they are often deemed translational and given separate editorial consideration. We argue that AQAB is a more accurate designation, particularly given the wide range of definitions of translational research.
How is AQAB Relevant to Theory?
Much of science is analogical, ranging from the ordinary language meaning of reinforce, to reflex reserves, internal clocks, and relational frames. Roediger (1980) listed three dozen analogies for memory, ranging from Plato’s wax tablet to Pribram’s hologram. What is the nature and role of such models? “A useful model then, represents the real world, not by correspondence or isomorphism, but by analogy, and this may be strong or weak” (Hesse, 2017, p. 305). Traditional scientific inference in psychology tends to be weak: “when I do x, y will change” as tested by null hypothesis statistics. The more data you collect, the more likely you are to find that the differences are “significant.” The best quantitative models make point predictions. The more data you collect, the more likely you are to find that they significantly deviate from the thing modeled. Mathematics thus puts a fine point on the dull pencil of analogy. Most of the quantitation in our field is descriptive—what physicists call “phenomenological”—as it attempts to find simple models to describe relationships: think of Herrnstein’s and Rachlin’s different hyperbolas, and the generalized matching law. These provide clarification but not understanding. For understanding, one requires a theory: a framework that in the best case includes efficient causes, mechanisms, and functions, along with the formal description provided by models. Such a theoretical analysis of behavior is at this point largely aspirational, but the excellent quantitative analysis of behavior we see in every issue of this journal affords us a large step toward it.
How is AQAB Relevant to Behavioral Pharmacology?
Like AQAB, behavioral pharmacology itself is a field that resulted from the marrying of behavior analysis and pharmacology. In general terms, behavior analysts study objective and observable behavior at the level of the individual, and this area has been described in some detail already. Pharmacologists, on the other hand, study how drugs and other chemical substances act on biological systems and how those systems respond to drugs. These two disciplines combine to form behavioral pharmacology. Behavioral pharmacologists rely on the principles of behavior analysis to explain behavioral effects of drugs. Though there may be some debate about how behavioral pharmacology began as a field in its own right, Peter Dews is often credited with its inception. Prior to Dews (1955), early behavioral pharmacology experiments involved unstructured observations of laboratory animals such as gross measures of locomotor activity, sleeping, and overt convulsions or sedation. In his clever experiment in 1955, Dews demonstrated that the effects of experimenter-administered pentobarbital on response rates depended on the schedule of reinforcement. Several important conclusions were drawn from this pivotal article. First, the effects of drugs on schedule-controlled behavior were observable at much lower doses than were required to result in grossly observable effects like uncoordinated movement, ataxia, or loss of righting reflexes. This gave behavioral pharmacologists a tool to evaluate drug effects under stable baselines (i.e., under steady-state conditions), and these baselines were quantifiable and sensitive to drug effects. Second, Dews found that pentobarbital had both rate-increasing and -decreasing effects on behavior depending on whether the schedule of reinforcement was a fixed-ratio or fixed-interval schedule. This was revolutionary for pharmacologists who largely had thought of drug effects through their interactions with a biological system and not as much as an interaction that also involved environmental factors.
Behavioral pharmacology experiments have become highly sophisticated in many ways, including the use of quantitative approaches. The matching law, behavioral-economic approaches, delay discounting, and other topics rooted in the experimental analysis of behavior quickly took hold in the laboratories of behavioral pharmacologists doing preclinical, laboratory research and shortly thereafter in applied laboratories and clinical trials. It is not possible to describe all the ways that AQAB is alive and well in the field of behavioral pharmacology, but some examples are worth highlighting. Within this special issue, Luc, Pizzagalli, and Kangus used principles of the generalized matching law and signal detection theory to confirm that individuals with anhedonia (i.e., loss of pleasure in previously rewarding activities and a core symptom of several psychiatric illnesses) demonstrate a blunted bias toward the alternative that provides richer access to rewards compared with control participants. From an applied perspective, a computerized task like the one used by these researchers could be used to detect ongoing and perhaps predict future occurrences of anhedonia as well as being used as a tool to detect treatment response during drug development. Another well-established finding in behavioral pharmacology research is that individuals with substance-use disorders display steeper discounting of delayed outcomes compared with control participants and these individuals discount hypothetical drug outcomes more steeply than hypothetical monetary outcomes (e.g., Amlung et al., 2017; Madden et al., 1997). Steep discounting predicts initiation of smoking in adolescents and young adults (Audrain-McGovern et al., 2009), progression and escalation of substance misuse in adolescents (Khurana et al., 2015), and treatment effectiveness and recidivism (Krishnan-Sarin et al., 2007; Washio et al., 2011; Yoon et al., 2007). Researchers are now using delay discounting and related behavioral-economic procedures and quantitative approaches to determine whether treatment strategies like episodic future thinking, mindfulness, choice bundling, and others can change discounting in individuals with substance-use disorders and whether this corresponds to drug abstinence and prevention of relapse (e.g., Stein et al., 2016).
How is AQAB Relevant to ABA?
The relevance of AQAB to ABA has historically taken one of two general forms: description of clinical or nonclinical behavior of interest and prospective simulation and testing of the conditions predicted by relevant quantitative models of behavior to improve clinical outcomes. Glimpses of a newer, third form of relevance between AQAB and ABA can be seen in recent translational studies for which clinical outcomes have failed to capture predicted yet potentially weak effects of certain independent variables. Thus, this third form of relevance between the two has as much bearing on guiding future AQAB work as it does on affecting practice.
Quantitative models of behavior have a longstanding tradition in ABA to describe and interpret both clinical and nonclinical behavior of interest. Perhaps nowhere else in the realm of the quantitative analysis of behavior is this truer than relating the matching law to clinical outcomes. Clear examples of this can be found throughout the ABA literature when researchers conceptualize the efficacy of treatments for problem behavior that are based on differential reinforcement of alternative behavior that do not arrange extinction for problem behavior. As just one example, Piazza et al. (1997) showed that the problem behavior of two participants remained low and compliance elevated when compliance resulted in positive reinforcement even though problem behavior continued to produce escape (see Payne & Dozier, 2013, for a review of such treatments, and Vollmer et al., 2020, for related commentary). The authors stated, “One potential explanation of these findings is that the relative rates of compliance and destructive behavior were a function of the relative value of the reinforcement produced by each response” (p. 293), which is nothing more than a restatement of the concatenated matching equation (Baum & Rachlin, 1969). Likewise, the matching law and other quantitative models of behavior have routinely been used outside clinical contexts to describe everyday behavior of interest (e.g., allocation of two- and three-point shots by college basketball players; Vollmer & Bourret, 2000).
A related but distinct relation between AQAB and ABA takes the form of prospective simulation and testing of the conditions predicted by relevant quantitative models of behavior to improve clinical outcomes. This second relation between AQAB and ABA is perhaps most clearly demonstrated by clinical evaluations of the predictions of behavioral momentum theory (BMT) as it relates to resurgence (Shahan & Sweeney, 2011). For example, Fisher et al. (2018) reanalyzed the data from four translational studies designed around the quantitative predictions of BMT for mitigating the resurgence of problem behavior and concluded that applications of BMT “can substantially improve the durability of common treatments for destructive behavior” (p. 281). Quantitative models of relapse and other problematic patterns of responding (e.g., resurgence as choice [Shahan & Craig, 2017; Shahan et al., 2020]) suggest alternative strategies for improving clinical practice, some of which have been explored through model simulation (e.g., Greer & Shahan, 2019) and retrospective quantitative analysis (e.g., Shahan & Greer, 2021).
When clinical or otherwise translational evaluations fail to capture the predicted effects of an independent variable described by a quantitative model of behavior, those results have the potential to guide future AQAB work, suggesting a third potential relation between AQAB and ABA. As an example, Greer et al. (2020) recently failed to detect an effect of treatment duration on the resurgence of problem behavior across six participants, findings at odds with the predictions of some quantitative models of relapse (e.g., BMT). Replication of such findings may not only guide the future selection and evaluation of other promising techniques for improving longstanding applied problems, but such data may also facilitate the refinement of relevant quantitative models of behavior via more targeted experimentation in the laboratory (i.e., reverse translation).
How is AQAB Relevant to Health Behavior?
Behavior analysts often work to facilitate individuals’ engagement in healthy behavior. Behavioral health is the sort of “under the dome” issue towards which some behavior analysts have long suggest we pivot (Friman, 2010). It is also an area that includes many researchers who may not be behavior analysts, but they are behavior-analysis adjacent. For example, behavioral health/health psychology programs reportedly cover Skinner’s work in their training (Kathy Goggin, personal communication, 2015). These are often skilled researchers who don’t necessarily appreciate the single-case designs that we use to evaluate our interventions but are open-minded to our interventions and their theoretical backing.
Quantitative analyses provide a concise shorthand of our theoretical positions that transcend the methodological differences that may divide us. If our colleagues believe impulsivity may govern poor health decisions, redirecting the conversation to considering patients’ ability to value future rewards is not a heavy lift (Bickel et al., 2012; Bickel & Yi, 2008), and has been successful across a wide range of health behaviors (Rung et al., 2019). For example, delay discounting is associated with obesity (Bickel et al., 2014; Jarmolowicz et al., 2014; Rasmussen et al., 2010; Weller et al., 2008), medication adherence (Epstein et al., 2021), and exercise (LeComte et al., 2020; Tate et al., 2015). In fact, delay discounting is even reduced by exercise (Sofis et al., 2016; Strickland et al., 2016). If our colleagues believe that risk tolerance affects medication uptake, models built on the back of probability discounting may be a solution (Bruce et al., 2016; Bruce et al., 2018a; Bruce et al., 2018b; Jarmolowicz et al., 2016; Jarmolowicz et al., 2018a). If our colleagues believe that patients don’t take their medications because they don’t value them, demand curves may provide an answer (Jarmolowicz et al., 2020). If our colleagues are puzzled by the dire issue of vaccine hesitancy, behavioral economic models seem to provide some valuable information (Hursh et al., 2020; Jarmolowicz et al., 2018b; Strickland et al., in press). This list is by no means exhaustive. The point is that our quantitative models can be successfully turned to help colleagues in behavioral health. This remains an emerging area—yet one that we could fruitfully find a home for AQAB.
Summary of the Special Section
“Math,” you might think, “is fine in theory, but in practice is too precise and brittle to be of much use.” If that is what you think, we hope that this special section will change your mind. It provides a sampling of creative and clearly described quantitative approaches of great potential for the analysis and synthesis of behavior. You may find some useful, and you may even be inspired to create your own.
The generalized matching law is a quantitative analysis that fills the pages of the Journal of the Experimental Analysis of Behavior (JEAB), totaling some 350 articles. How can it be used in an applied context? Most subjects rationally prefer the better of two alternatives. But what if they have difficulty deriving hedonic value stimuli (i.e., have anhedonia), as is the case with individuals suffering from major depressive disorder? Luc, Pizzagalli, and Kangas studied this issue and confirmed that people experiencing anhedonia are less biased toward the better alternative. These authors used this finding to develop a translational approach for measuring anhedonia in neuropsychiatric disorders to more precisely gauge the effectiveness of treatments.
Jack McDowell is an expert, creative quantitative analyst, and he is also a practicing clinician. We can think of no more perfect author for this review of 60 years of basic research on choice as relevant to clinical problems. Four decades ago, Jack published an influential article in the American Psychologist suggesting four new clinical interventions based on Herrnstein’s matching law (McDowell, 1982). In this special section, he reviews those and many other implications of quantitative approaches for clinical issues. He then introduces the reader to a line of work he and his students have been pursuing through the 20th century—recovering the basic operant phenomena in animated artificial organisms (AOs)—his evolutionary theory of behavior dynamics. He shows how AOs can evolve characters that exhibit psychopathologies, an analysis of which can suggest novel treatment approaches.
In a following article, Morris and McDowell go into detail about the construction and evaluation of AOs to better understand the subtypes of automatically reinforced self-injurious behavior and to simulate potential treatments for them. This approach seeks to provide insight on the mechanisms that separate clinically distinct subtypes of automatically reinforced behavior—work that is both important for our conceptual understanding of such behavior yet also potentially impossible to conduct through other means.
We confess that we procrastinated in contributing to this introduction; but who among us hasn’t at some time? Sokolowski and Tonneau note that procrastination has received little attention from quantitative behavior analysts compared to, for example, delay discounting. In a well-designed experiment, they showed that in general students procrastinated in completing tests, their degree of procrastination was constant over a series of such tests (i.e., it has the character of a trait), and that the group scallop was well-described as a hyperbola. This is bad news for us, because some of us thought we would outgrow our tendency to procrastinate.
In a kind of Catch-22, when you are depressed, it is hard to get motivated to do anything, including seeking help for the depression. Trusty, Swift, and Rasmussen address this problem by outlining how behavioral-economic analyses can enlighten us as to what components of help-seeking behavior (i.e., sensitivity to gains and losses, response costs of various types, biases) are largely to blame. Targeted therapies might then be designed for each individual; it is a kind of theoretical functional analysis.
Behavior analysis is an N-of-1 science. This doesn’t mean only one subject, but rather treating each subject in its own right, and not immediately lumping them together. Cox, Klapes, and Falligant provide an important extension of this concept. They apply it to over 2,000 individuals and over 8 million observations, testing whether the generalized matching law applies to each, what its parameters are, and how it can inform us of other aspects of behavior. Behavior analysts, welcome the age of Big Data, done right!
Delay discounting has become a cottage industry (as Len Green told one of us 20 years ago). That doesn’t mean it should use only the tools you’d find in a typical cottage. Berk, Gupta, and Sanabria introduce immediacy premium, a creative new measure that can be used to calculate degree of discounting. One of the great strengths of this approach is that it linearizes the effect of delay on choice. Check it out. You may decide it is time for a new loom in your cottage!
Machines are getting smarter than people. Why are computers not used more extensively in psychology in general and behavior analysis in particular? Bailey, Baker, Rzeszuek, and Lanovaz show how to do it. They applied machine learning to understand and improve a paper analysis of the functions controlling behavior. When the first pass was good but not perfect, they created artificial samples with which to improve the performance of their artificial neural net. It then outperformed all other models. Their research provides insight into the conditions that should be present in functional analysis. A clever use of AQAB.
Nobel-prize–winning scientist Percy Bridgeman once stated that science is “doing one’s damnedest with one’s mind, no holds barred.” We are proud that the behavior analysts in this special section are doing just that. They are all thinking outside the Skinner box, creating new tools and approaches, and testing them against relevant data. If we can keep up this evolution of methods and ideas, behavior analysis will regain its place at the head of the table!
Declarations
Conflicts of interest
The authors have no potential conflicts of interest to disclose.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- Amlung M, Vedelago L, Acker J, Balodis I, MacKillop J. Steep delay discounting and addictive behavior: A meta-analysis of continuous associations. Addiction. 2017;112(1):51–62. doi: 10.1111/add.13535. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Audrain-McGovern J, Rodriguez D, Epstein LH, Cuevas J, Rodgers K, Wileyto EP. Does delay discounting play an etiological role in smoking or is it a consequence of smoking? Drug & Alcohol Dependence. 2009;103(3):99–106. doi: 10.1016/j.drugalcdep.2008.12.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baer DM, Wolf MM, Risley TR. Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis. 1968;1:91–97. doi: 10.1901/jaba.1968.1-91. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baum WM. The Harvard Pigeon Lab under Herrnstein. Journal of the Experimental Analysis of Behavior. 2002;77:347–355. doi: 10.1901/jeab.2002.77-347. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baum WM, Rachlin HC. Choice as time allocation. Journal of the Experimental Analysis of Behavior. 1969;12:861–874. doi: 10.1901/jeab.1969.12-861. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bickel WK, Yi R. Temporal discounting as a measure of executive function: Insights from the competing neuro–behavioral decision system hypothesis of addiction. In: Houser D, McCabe K, editors. Neuroeconomics: Advances in health services research. Emerald Group Publishing; 2008. pp. 289–309. [PubMed] [Google Scholar]
- Bickel WK, Landes RD, Christensen DR, Jackson L, Jones BA, Kurth-Nelson Z, Redish AD. Single- and cross-commodity discounting among cocaine addicts: The commodity and its temporal location determine discounting rate. Psychopharmacology. 2011;217:177–187. doi: 10.1007/s00213-011-2272-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bickel WK, Yi R, Landes RD, Hill PF, Baxter C. Remember the Future: Working memory training decreases delay discounting among stimulant addicts. Biological Psychiatry. 2011;69(3):260–265. doi: 10.1016/j.biopsych.2010.08.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bickel WK, Jarmolowicz DP, Mueller ET, Gatchalian KM, McClure SM. Are executive function and impulsivity antipodes? A conceptual reconstruction with special reference to addiction. Psychopharmacology. 2012;221(3):361–387. doi: 10.1007/s00213-012-2689-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bickel WK, Wilson GA, Franck CT, Mueller ET, Jarmolowicz DP, Koffarnus MN, Fede SJ. Using crowsourcing to compare temporal, social temporal, and probability discounting among obese and non-obese individuals. Appetite. 2014;75:82–89. doi: 10.1016/j.appet.2013.12.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bowler PJ. Evolution: The history of an idea. University of California Press; 2003. [Google Scholar]
- Bruce JM, Bruce AS, Catley D, Lynch S, Goggin K, Reed DD, Lim SL, Strober L, Glusman M, Ness AR, Jarmolowicz DP. Being kind to your future self: Probability discounting of health decision-making. Annals of Behavioral Medicine. 2016;50:297–309. doi: 10.1007/s12160-015-9754-8. [DOI] [PubMed] [Google Scholar]
- Bruce JM, Bruce AS, Lynch S, Thelen J, Lim SL, Smith J, Catley D, Reed DD, Jarmolowicz DP. Probability discounting of treatment decisions in multiple sclerosis: Associations with disease knowledge, neuropsychiatric status, and adherence. Psychopharmacology. 2018;235:3303–3313. doi: 10.1007/s00213-018-5037-y. [DOI] [PubMed] [Google Scholar]
- Bruce JM, Jarmolowicz DP, Lynch S, Thelen J, Lim SL, Smith AK, Catley D, Bruce AS. How patients with multiple sclerosis weigh treatment risks and benefits. Health Psychology. 2018;37:680–690. doi: 10.1037/hea0000626. [DOI] [PubMed] [Google Scholar]
- Critchfield TS, Reed DD. The fuzzy concept of applied behavior analysis research. The Behavior Analyst. 2017;40:123–159. doi: 10.1007/s40614-017-0093-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Darwin C. On the origin of species by means of natural selection, or preservation of favoured races in the struggle for life. John Murray; 1859. [PMC free article] [PubMed] [Google Scholar]
- Dews PB. Studies on behavior. I. Differential sensitivity to pentobarbital of pecking performance in pigeons depending on the schedule of reward. Journal de Pharmacologie. 1955;113:393–401. [PubMed] [Google Scholar]
- Epstein LH, Salvy SJ, Carr KA, Dearing KK, Bickel WK. Food reinforcement, delay discounting and obesity. Physiology & Behavior. 2010;100(5):438–445. doi: 10.1016/j.physbeh.2010.04.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Epstein LH, Paluch RA, Stein JS, Quanttrin T, Masrandrea LD, Bree KA, Sze YY, Greenawald MH, Biondolillo MJ, Bickel WK. Delay discounting, glycemic regulation and health behaviors in adults with prediabetes. Behavioral Medicine. 2021;47:194–204. doi: 10.1080/08964289.2020.1712581. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fisher WW, Greer BD, Craig AR, Retzlaff BJ, Fuhrman AM, Lichtblau KR, Saini V. On the predictive validity of behavioral momentum theory for mitigating resurgence of problem behavior. Journal of the Experimental Analysis of Behavior. 2018;109(1):281–290. doi: 10.1002/jeab.303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friman PC. Come on in, the water is fine: Achieving mainstream relevance through integration with primary medical care. The Behavior Analyst. 2010;33(1):19–36. doi: 10.1007/BF03392201. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greenwald MK, Steinmiller CL. Behavioral economic analysis of opioid consumption in heroin-dependent individuals: Effects of alternative reinforcer magnitude and post-session drug supply. Drug & Alcohol Dependence. 2009;104:84–93. doi: 10.1016/j.drugalcdep.2009.04.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greenwald MK, Steinmiller CL. Cocaine behavioral economics: From the naturalistic environment to the controlled laboratory setting. Drug & Alcohol Dependence. 2014;141:27–33. doi: 10.1016/j.drugalcdep.2014.04.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greer BD, Shahan TA. Resurgence as choice: Implications for promoting durable behavior change. Journal of Applied Behavior Analysis. 2019;52(3):816–846. doi: 10.1002/jaba.573. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greer BD, Fisher WW, Retzlaff BJ, Fuhrman AM. A preliminary evaluation of treatment duration on the resurgence of destructive behavior. Journal of the Experimental Analysis of Behavior. 2020;113(1):251–262. doi: 10.1002/jeab.567. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gregory A. Anaximander: A re-assessment. Bloomsbury Academic; 2017. [Google Scholar]
- Hart, B., & Risely, T. R. (1995). Meaningful differences in the everyday experiences of young American children. Brookes.
- Hesse MB. Models and Analogies. In: Newton-Smith WH, editor. A companion to the philosophy of science. Wiley; 2017. pp. 299–307. [Google Scholar]
- Hursh SR, Winger G. Normalized demand for drugs and other reinforcers. Journal of the Experimental Analysis of Behavior. 1995;64(3):373–384. doi: 10.1901/jeab.1995.64-373. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hursh SR, Galuska CM, Winger G, Woods JH. The economics of drug abuse: a quantitative assessment of drug demand. Molecular Interventions. 2005;5(1):20–28. doi: 10.1124/mi.5.1.6. [DOI] [PubMed] [Google Scholar]
- Hursh SR, Strickland JC, Schwartz LP, Reed DD. Quantifying the impact of public perceptions on vaccine acceptance using behavioral economics. Frontiers in Public Health. 2020;8:article 608852. doi: 10.3389/fpubh.2020.608852. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huxley J. Evolution: The modern synthesis. Allen & Unwin; 1974. [Google Scholar]
- Jarmolowicz DP, Cherry JB, Reed DD, Bruce JM, Crespi JM, Lusk JL, Bruce AS. Robust relation between temporal discounting rates and body mass. Appetite. 2014;78:63–67. doi: 10.1016/j.appet.2014.02.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jarmolowicz DP, Reed DD, Bruce AS, Catley D, Lynch S, Goggin K, Lim SL, Strober L, Glusman M, Norouzinia AN, Bruce JM. Using EP50 to forecast treatment adherence in individuals with multiple sclerosis. Behavioural Processes. 2016;132:94–99. doi: 10.1016/j.beproc.2016.09.003. [DOI] [PubMed] [Google Scholar]
- Jarmolowicz DP, Bruce AS, Glusman M, Lim SL, Lynch S, Thelen J, Catley D, Zieber B, Reed DD, Bruce JM. On how patients with multiple sclerosis weigh side effect severity and treatment efficacy when making treatment decisions. Experimental & Clinical Psychopharmacology. 2017;25:479–484. doi: 10.1037/pha0000152. [DOI] [PubMed] [Google Scholar]
- Jarmolowicz DP, Reed DD, Bruce AS, Lynch S, Smith J, Bruce JM. Modeling effects of side-effect probability, side-effect severity, and medication efficacy on patients with multiple sclerosis medication choice. Experimental & Clinical Psychopharmacology. 2018;26:599–607. doi: 10.1037/pha0000220. [DOI] [PubMed] [Google Scholar]
- Jarmolowicz DP, Reed DD, Francisco AJ, Bruce JM, Lemley SM, Bruce AS. Modeling effects of risk and social distance on vaccination choice. Journal of the Experimental Analysis of Behavior. 2018;110:39–53. doi: 10.1002/jeab.438. [DOI] [PubMed] [Google Scholar]
- Jarmolowicz DP, Reed DD, Schneider TD, Smith J, Thelen J, Lynch S, Bruce AS, Bruce JM. Behavioral economic demand for medications and its relation to clinical measures in multiple sclerosis. Experimental & Clinical Psychopharmacology. 2020;28(3):258–264. doi: 10.1037/pha0000322. [DOI] [PubMed] [Google Scholar]
- Khurana A, Romer D, Betancourt LM, Brodsky NL, Giannetta JM, Hurt H. Experimentation versus progression in adolescent drug use: A test of an emerging neurobehavioral imbalance model. Development & Psychopathology. 2015;27(3):901–913. doi: 10.1017/S0954579414000765. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Killeen PR. Mathematical principles of reinforcement. Behavioral and Brain Sciences. 1994;17(1):105–172. doi: 10.1017/s0140525x00033628. [DOI] [Google Scholar]
- Kirk GS, Raven JE, Schofield M. The presocratic philosophers: A critical history with a selection of texts. 2. Cambridge University Press; 1983. [Google Scholar]
- Koffarnus MN, Jarmolowicz DP, Mueller ET, Bickel WK. Changing discounting in light of the competing neurobehavioral decision systems theory. Journal of the Experimental Analysis of Behavior. 2013;99(1):32–57. doi: 10.1002/jeab.2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Krebs RE. Groundbreaking scientific experiments, inventions, and discoveries of the Middle Ages and the Renaissance. Greenwood Press; 2004. [Google Scholar]
- Krishnan-Sarin S, Reynolds B, Duhig AM, Smith A, Liss T, McFetridge A, Cavallo DA, Carroll KM, Potenza MN. Behavioral impulsivity predicts treatment outcome in a smoking cessation program for adolescent smokers. Drug & Alcohol Dependence. 2007;88(1):79–82. doi: 10.1016/j.drugalcdep.2006.09.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Laties V. Behavior analysis and the growth of behavioral pharmacology. The Behavior Analyst. 2003;26:235–252. doi: 10.1007/BF03392079. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Layng TVJ. Toutorial: Understanding concepts: Implications for behavior analysts and educators. Perspectives on Behavior Science. 2019;42:345–363. doi: 10.1007/s40614-018-00188-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- LeComte RS, Sofis MJ, Jarmolowicz DP. Independent effects of ideal body image valuation and delay discounting on proximal and typical levels of physical activity. The Psychological Record. 2020;70:75–82. [Google Scholar]
- Madden GJ, Petry NM, Badger GJ, Bickel WK. Impulsive and self-control choices in opioid-dependent patients and non-drug-using control participants: Drug and monetary rewards. Experimental & Clinical Psychopharmacology. 1997;5(3):256–262. doi: 10.1037//1064-1297.5.3.256. [DOI] [PubMed] [Google Scholar]
- Mayr E. The growth of biological thought: Diversity, evolution, and inheritance. Belknap Press of Harvard University Press; 1982. [Google Scholar]
- McDowell JJ. The importance of Herrnstein's mathematical statement of the law of effect for behavior therapy. American Psychologist. 1982;37:771–779. doi: 10.1037//0003-066x.37.7.771. [DOI] [PubMed] [Google Scholar]
- Odum AL. Delay discounting: I'm a k, You're a k. Journal of the Experimental Analysis of Behavior. 2011;96(3):427–439. doi: 10.1901/jeab.2011.96-423. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Payne SW, Dozier CL. Positive reinforcement as treatment for problem behavior maintained by negative reinforcement. Journal of Applied Behavior Analysis. 2013;46(3):699–703. doi: 10.1002/jaba.54. [DOI] [PubMed] [Google Scholar]
- Piazza CC, Fisher WW, Hanley GP, Remick ML, Contrucci SA, Aitken TL. The use of positive and negative reinforcement in the treatment of escape–maintained destructive behavior. Journal of Applied Behavior Analysis. 1997;30(2):279–298. doi: 10.1901/jaba.1997.30-279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rachlin H, Raineri A, Cross D. Subjective probability and delay. Journal of the Experimental Analysis of Behavior. 1991;55(2):233–244. doi: 10.1901/jeab.1991.55-233. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rasmussen EB, Lawyer SR, Reilly W. Percent body fat is related to delay and probability discounting for food in humans. Behavioural Processes. 2010;83(1):23–30. doi: 10.1016/j.beproc.2009.09.001. [DOI] [PubMed] [Google Scholar]
- Roediger HL. Memory metaphors in cognitive psychology. Memory & Cognition. 1980;8(3):231–246. doi: 10.3758/bf03197611. [DOI] [PubMed] [Google Scholar]
- Rung JM, Epstein LH. Translating episodic future thinking manipulations for clinical use: Development of a clinical control. PLoS ONE. 2020;15(8):article e0237435. doi: 10.1371/journal.pone.0237435. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rung JM, Peck S, Hinnenkamp JE, Preston E, Madden GJ. Changing delay discounting and impulsive choice: Implications for addictions, prevention, and human health. Perspectives on Behavior Science. 2019;42:397–417. doi: 10.1007/s40614-019-00200-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shahan TA, Craig AR. Resurgence as choice. Behavioural Processes. 2017;141:100–127. doi: 10.1016/j.beproc.2016.10.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shahan TA, Greer BD. Destructive behavior increases as a function of reductions in alternative reinforcement during schedule thinning: A retrospective quantitative analysis. Journal of the Experimental Analysis of Behavior. 2021;116(2):243–248. doi: 10.1002/jeab.708. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shahan TA, Sweeney MM. A model of resurgence based on behavioral momentum theory. Journal of the Experimental Analysis of Behavior. 2011;95(1):91–108. doi: 10.1901/jeab.2011.95-91. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shahan TA, Browning KO, Nall RW. Resurgence as choice in context: Treatment duration and on/off alternative reinforcement. Journal of the Experimental Analysis of Behavior. 2020;113(1):57–76. doi: 10.1002/jeab.563. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sheffer CE, Christensen DR, Landes RD, Carter LP, Jackson L, Bickel WK. Delay discounting rates: A strong prognastic indicator of smoking relapse. Addictive Behaviors. 2014;39:1682–1689. doi: 10.1016/j.addbeh.2014.04.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith TL. A philosophy of science perspective on the quantitative analysis of behavior. Behavioural Processes. 2015;114:78–81. doi: 10.1016/j.beproc.2015.02.005. [DOI] [PubMed] [Google Scholar]
- Sofis MJ, Carrillo A, Jarmolowicz DP. Maintained physical activity induced changes in delay discounting. Behavioral Modification. 2016;41(4):499–528. doi: 10.1177/0145445516685047. [DOI] [PubMed] [Google Scholar]
- Stein JS, Wilson AG, Koffarnus MN, Daniel TO, Epstein LH, Bickel WK. Unstuck in time: Episodic future thinking reduces delay discounting and cigarette smoking. Psychopharmacology. 2016;233:3771–3778. doi: 10.1007/s00213-016-4410-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stojek MM, MacKillop J. Relative reinforcing value of food and delayed reward discounting in obesity and disordered eating: A systematic review. Clinical Psychology Review. 2017;55:1–11. doi: 10.1016/j.cpr.2017.04.007. [DOI] [PubMed] [Google Scholar]
- Strickland JC, Feinstein MA, Lacy RT, Smith MA. The effects of physical activity on impulsive choice: Influence of sensitivity to reinforcement amount and delay. Behavioural Processes. 2016;126:36–45. doi: 10.1016/j.beproc.2016.03.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Strickland, J. C., Reed, D. D., Hursh, S. R., Schwartz, L. P., Foster, R. N. S., Gelino, B. W., LeComte, R. S., Oda, F. S., Salzer, A. R., Schneider, T. D., Dayton, L., Latkin, C., & Johnson, M. W. (in press). Integrating operant and cognitive behavioral economics to inform infectious disease response: Prevention, testing, and vaccination in the COVID-19 pandemic. PLoS ONE. 10.1101/2021.01.20.21250195 [DOI] [PMC free article] [PubMed]
- Sweeney MM, Shahan TA. Effects of high, low, and thinning rates of alternative reinforcement on response elimination and resurgence. Journal of the Experimental Analysis of Behavior. 2013;100:102–116. doi: 10.1002/jeab.26. [DOI] [PubMed] [Google Scholar]
- Tate LM, Tsai P-F, Landes RD, Rettiganti M, Lefler L. Temporal discounting rates and their relation to exercise behavior in older adults. Physiology & Behavior. 2015;152:295–299. doi: 10.1016/j.physbeh.2015.10.003. [DOI] [PubMed] [Google Scholar]
- Vollmer TR, Bourret J. An application of the matching law to evaluate the allocation of two- and three-point shots by college basketball players. Journal of Applied Behavior Analysis. 2000;33(2):137–150. doi: 10.1901/jaba.2000.33-137. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vollmer TR, Peters KP, Kronfli FR, Lloveras LA, Ibañez VF. On the definition of differential reinforcement of alternative behavior. Journal of Applied Behavior Analysis. 2020;53(3):1299–1303. doi: 10.1002/jaba.701. [DOI] [PubMed] [Google Scholar]
- Washio Y, Higgins ST, Heil SH, McKerchar TL, Badger GJ, Skelly JM, Dantona RL. Delay discounting is associated with treatment response among cocaine-dependent outpatients. Experimental & Clinical Psychopharmacology. 2011;19(3):243–248. doi: 10.1037/a0023617. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weller RE, Cook EW, III, Avsar KB, Cox JE. Obese women show greater delay discounting than healthy-weight women. Appetite. 2008;51(3):563–569. doi: 10.1016/j.appet.2008.04.010. [DOI] [PubMed] [Google Scholar]
- Wolf MW. Remembrances of issues past: Celebrating JABA's 25th anniversary. Journal of Applied Behavior Analysis. 1993;26(3):543–544. doi: 10.1901/jaba.1993.26-543. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yoon JH, Higgins ST, Heil SH, Sugarbaker RJ, Thomas CS, Badger GJ. Delay discounting predicts postpartum relapse to cigarette smoking among pregnant women. Experimental & Clinical Psychopharmacology. 2007;15(2):176–186. doi: 10.1037/1064-1297.15.2.186. [DOI] [PubMed] [Google Scholar]
- Yoon JH, Suchting R, de Dios C, Vincent JN, McKay SA, Lane SD, Schmitz JM. Decreased cocaine demand following contingency management treatment. Drug & Alcohol Dependence. 2021;226:article 108883. doi: 10.1016/j.drugalcdep.2021.108883. [DOI] [PubMed] [Google Scholar]
