Skip to main content
Perspectives on Behavior Science logoLink to Perspectives on Behavior Science
. 2018 Jun 7;41(1):241–267. doi: 10.1007/s40614-018-0162-9

Why We Are Still Not Acting to Save the World: the Upward Challenge of a Post-Skinnerian Behavior Science

Mark R Dixon 1,, Jordan Belisle 1, Ruth Anne Rehfeldt 1, William B Root 1
PMCID: PMC6701496  PMID: 31976395

Abstract

Basic research on derived stimulus relations reveals many effects that may be useful in understanding and resolving significant and complex societal problems. Applied research on derived stimulus relations has done little to fulfill this promise, focusing instead mainly on simple demonstrations of well-known phenomena. We trace the research tradition of derived stimulus relations from laboratory to wide-scale implementation, and put forward several suggestions for how to progress effective and impactful research on derived relational responding to issues of immense social importance. To advance a science of behavior from relative social obscurity to the developing world-saving technologies, we must evaluate our own behavior as scientists in the grander social context.

Keywords: Stimulus relations, Relational frame theory, Verbal behavior, Social behavior


Skinner (e.g., 1953), among his many contributions to the field of behavior science, put forward the position that those who engage in a science of behavior have not only the potential to save the world, but also an obligation to do so. With the publication of Science and Human Behavior (1953), Skinner espoused a technology for predicting and controlling human behavior that evolved directly from his findings in basic animal laboratories, emphasizing the role of operant conditioning in the development of simple human capacities such as ratio/interval motor performances, to complex human abilities such as problem solving and thinking. Amidst criticisms of this approach from notable figures in philosophy and psychology suggesting that this account was too simplistic to explain the complexities of the human condition, Skinner (1957) published Verbal Behavior, a purely operant account of language. Three decades later, Skinner would despair over the limited impact behavioral analyses had had on solving the world’s most pressing problem. In a paper titled, “Why we are not acting to save the world,” Skinner (1987) described a world “in serious trouble” (p. 1), on the precipice of a nuclear winter, and experiencing overpopulation and mass resource depletion.1 The solutions were simple: “Destroy all nuclear weapons, limit family size, and adopt a much less polluting and less wasteful style of life” (Skinner, 1987, p. 1). Each of these solutions involved changing human behavior – the subject matter that the science of behavior was intended to explain. According to Skinner, the root of the problem was not to be found in any shortcoming of our own science or theory, but rather in a failure of society to embrace our scientific knowledge and apply the relevant principles at a large scale. The reason for this failure was that people tend to assume that behavior will change when the populace properly understands the prevalence and severity of the problems that we face. Skinner, of course, maintained that solutions were to be found in the operant contingencies controlling destructive behavior, rather than our knowledge about or worry over future affairs.

In the present paper, we put forward an alternative account of “why we are still not acting to save the world” that does not place blame on society’s failure to adopt exclusively operant principles. Instead, our position is that behavior science has been limited by failing to translate post-Skinnerian theoretical advances and laboratory discoveries that emphasize derived stimulus relations to scaled-up, impactful, and evidence-based technologies for use by members of the society. First, we describe derived relational accounts of language and cognitive development as a contemporary alternative to Skinner’s theories that could have greater utility in effecting the social changes sought by Skinner himself. Second, we explain that although basic experimental work has validated the principles in derived relational accounts, the applied wing of behavior science has not built on these advances by developing and empirically evaluating large- technologies suitable for addressing society’s large-scale problems. Finally, we suggest three potential strategies that, if embraced, may improve the likelihood that technologies emphasizing derived stimulus relations, can accomplish Skinner’s dream of saving the world through a science of human behavior.

Verbal Stimulus Relations: A Post-Skinnerian Account

Rule-Governance and Stimulus Relations

Behavioral description, prediction, and control of language events was first made possible in a systematic way by Skinner’s (1957) account in Verbal Behavior (Dymond, O’Hora, Whelan, & O’Donovan, 2006). Early empirical studies based on the analysis showed how language events could be manipulated, much as nonverbal behavior is, but these studies were largely focused on the most basic types of verbal operants (e.g., echoics, tacts, and mands) as acquired and demonstrated by people with intellectual or developmental disabilities (see Dixon, Small, & Rosales, 2007) or nonhumans (e.g., Pepperberg, 1981). - An important advance took place just over one decade after the publication of Verbal Behavior when Skinner (1969) introduced his conceptual analysis of rule governed behavior. Skinner defined rule-governed behavior as a contingency specifying stimulus, although the concept has been expanded and updated over the past four decades (Hayes, Brownstein, Zettle, Rosenfarb, & Korn, 1986; Hayes, Zettle, & Rosenfarb, 1989; Zettle & Hayes, 1982). Overall, the emergence of an account of rule governed behavior was significant because it contributed to the understanding of how language develops and how it can influence all other aspects of human responding (e.g., Hayes, 1989).

Accounts of rule-governed behavior sparked several basic laboratory studies detailing how rules can interact with changing contingencies, producing behavior that is not under the exclusive control of immediate environmental consequences (e.g., Catania, Matthews, & Shimoff, 1982; Matthews, Shimoff, Catania, & Sagvolten, 1977; Shimoff, Catania, & Matthews, 1981). The core finding was that rules, both externally delivered and self-generated, could establish behavior that either mimicked or countermanded the behavior patterns normally expected under schedules of reinforcement. Put another way, these studies suggest that language renders an analysis based purely on operant contingencies incomplete (Hayes, Rosenfarb, Wulfert, Munt, Korn, & Zettle, 1985; Hayes & Wolf, 1984; Rosenfarb & Hayes, 1984; Zettle & Hayes, 1982).2

Also shortly after the publication of Verbal Behavior, a stimulus relations account of language development emerged that did not rely on a direct history of reinforcement and could explain the emergence of rule-governed behavior. Sidman (1971) demonstrated that some verbal events are not acquired via direct contact with contingencies but rather are derived from prior reinforced relations through stimulus equivalence. Early discoveries showed that after conditionally relating dictated names to corresponding pictures and words, participants with language delays read words, named pictures, and matched pictures to words and words to pictures, in the absence of explicit instruction (Sidman & Tailby, 1982; Sidman, Kirk, & Willson-Morris, 1985; Sidman, Willson-Morris, & Kirk, 1986).3 These individuals behaved as though the stimuli were functionally substitutable, or equivalent to one another (Sidman, 1986). Related stimuli were said to combine to form an equivalence class, and the transfer of stimulus function4 from one class member to related class members created functional substitutability of stimuli. Such findings showed that a history of direct reinforcement was not necessary to explain every discriminated operant response.

A further advance in the understanding of the nature and implications of derived stimulus relations was the development of Relational Frame Theory (RFT; Hayes, Barnes-Holmes, & Roche, 2001). RFT made clear that there are many ways, in which people can relate non-identical stimulus events, including: coordination (identity), distinction (difference), comparison (difference along a specific dimension), opposition (opposites), deictic (relative to the current status or situation of the “speaker”), and hierarchical (membership in a category)5 (Hayes et al., 2001). Studies of these types of relations made clear that stimulus functions do not simply “transfer” to among related stimuli; rather the function of all class members is transformed consistent with their relationship to other class members (Dougher, Augustson, Markham, Greenway, & Wulfert, 1994; Dougher, Hamilton, Fink, & Harrington, 2007). This ability, according to RFT, is not something that emerges spontaneously in humans as they develop across the lifespan. Rather, each “frame family,” or type of relation, and the ability to entail emergent (untrained) relations based on it, is a high-order generalized operant much like motor imitation, that once learned, may be topographically boundless (Barnes-Holmes & Barnes-Holmes, 2000; Healy, Barnes-Holmes, & Smeets, 2000).

Advances in stimulus equivalence and RFT expand considerably the complexity of behavior analytic theories, and we argue, could have utility in solving the types of complex problems described by Skinner in 1987 and experienced by us now. These accounts are not without controversy; indeed, perhaps no other advancement in behavior science has received as much critical attention (e.g., Palmer, 2004). But that is perfectly appropriate, because if RFT is correct then descriptions of human behavior based strictly on control by reinforcement contingencies, as per Skinner (e.g., 1953, 1957) are incomplete. This is, in fact, the core assumption of the present article. As a preliminary matter, however, it is important to emphasize that a massive empirical literature now documents derived stimulus relations effects and, in the process, supports theoretical accounts like RFT. A very quick synopsis helps to make the point.

Early research showed that stimulus classes could incorporate many members (Saunders, Wachter, & Spradlin, 1988), including complex stimuli with compound (Markham & Dougher, 1993; Debert, Matos, & McIlvane, 2007) or cross modal features (Lane, Clow, Innis, & Critchfield, 1998), and could span a variety of nodal distances6 (Fields, Adams, Verhave, & Newman, 1990; Spencer & Chase, 1996). This research showed that stimuli sharing common members could spontaneously merge to form even larger classes (Saunders, Saunders, Kirby, & Spradlin, 1988). Other research explored relationships between derived stimulus classes and private events (Arntzen & Steingrimsdottir, 2017; DeGrandpre, Bickel, & Higgins, 1992; Dougher et al., 1994; Haimson, Wilkinson, Rosenquist, Ouimet, & McIlvane, 2009; Schlund, Cataldo, & Hoehn-Saric, 2008). But arguably the most important contribution of early research, as suggested above, is the often-replicated finding that stimulus functions, both operant (Tonneau & Gonzalaz, 2004) and respondent (Dougher et al., 1994), can propagate through stimulus classes (transformation of function), creating behavioral functional relations that are not the direct product of reinforcement contingencies.

Basic experimental research inspired specifically by RFT has further shown how derived stimulus relations alter the basic conception of learning as behavior analysts conceive of it. For example, the standard behavior analytic conception of conditioned consequences holds that formerly neutral stimuli acquire consequential functions through direct pairing with already-effective consequences (Catania, 2013). Yet stimuli never paired directly with an already-effective consequence can become reinforcers and punishers through transformation of function via frames of coordination and opposition (Whelan & Barnes-Holmes, 2004). Similarly, the traditional view is that stimuli can acquire avoidance functions through direct pairing with already-aversive stimuli (Catania, 2013). Yet stimuli never so paired can become avoided through transformation of functions through frames of coordination and distinction (Dymond, Roche, Forsyth, Whelan, & Rhoden, 2007).

RFT-inspired research has also illuminated the role of derived stimulus relations in complex language based events such as reasoning through analogy (Stewart, Barnes-Holmes, Roche, & Smeets, 2002; Ruiz & Luciano, 2011), self-discrimination of relational responses (Dymond & Barnes, 1995), and the formation of false memories based on the semantic relatedness of relational network stimuli (Guinther & Dougher, 2010). Other examples include hierarchical transitive class containment (a categorization effect), which can be examined as an operant class (Slattery, Stewart, & O’Hora, 2011), and the fundamental attribution error, which can be created as a product of deictic relational responding (Hooper, Erdogan, Keen, Lawton, & McHugh, 2015). Phenomena like these have been well described by scholars outside of behavior science but, prior to RFT, were not systematically addressed by behavior analysts.

Finally, basic research inspired by RFT has helped to shed light on everyday phenomena that are well-documented but contribute to global suffering. Examples include racism, bias, and stereotypes (Barnes-Holmes, Murphy, Barnes-Holmes & Stewart, 2010), obesity (Lillis, Hayes, Bunting & Masuda, 2009), anxiety reduction (Arch, Eifert, Davies, Vilardaga, Rose, & Craske, 2012), posttraumatic stress disorder (Walser & Hayes, 2006) and depression (Forman, Herbert, Moitra, Yeomans, & Geller, 2007). To illustrate, consider an example from our own research program. Immediately following 2001 World Trade Center terrorist attacks, we conducted a series of studies to determine the role of relational networks in both terrorist behavior and unwarranted fears directed toward Middle Eastern people. In 2003, we published a conceptual paper (Dixon, Dymond, Rehfeldt, Roche, & Zlomke, 2003) discussing how prejudice and terrorism could result from derived relational responding, and put forward descriptions of potential cultural interventions based on RFT that could be implemented in the United States and abroad. Between 2006 and 2009, we published a series of studies showing how prejudice toward Middle Eastern people as terrorists could be developed and dismantled, all using RFT technologies (Dixon, Rehfeldt, Zlomke, & Robinson, 2006; Dixon, Zlomke, & Rehfeldt, 2006; Dixon & Lemke, 2007; Dixon, Branon, Nastally, & Mui, 2009). The following illustrates the flavor of these analyses.

Take for example a relatively young Middle Eastern male [who] begins to struggle with how he will earn a living and make ends meet. Perhaps he just has learned that he will need to go hungry for the next few days because food is not available in his town. Let’s call his current state of economic affairs and hunger, “A.” [The man] is outraged by his never ending struggle for food and money. Let’s call this outrage, “B.” Yet, who should our young man be outraged at? … One day upon a trip to the downtown area he overhears a group of other men speaking about how it is “America’s fault” that there is no food. It is “America’s fault” that everyone is so poor. (Dixon et al., 2003, p. 135)

In this example of transformation of functions, C will now evoke emotional responses formerly restricted to A, even though the man has never directly experienced an American. Now, imagine that the man’s town acquaintances are Taliban, and they appear to be materially better off than he is. Let us call their relative well-being “Y,” and it is

…Opposite to our young man’s state of affairs…. Also opposite of our young man’s state of affairs is a feeling of happiness and pride in himself. Let’s call these feelings, “Z.” Now, through a similar transfer of stimulus functions, our young man begins to believe that feelings of happiness and pride are equivalent with joining the Taliban army. In notation, if A is opposite of Y and A is opposite of Z, then Y is the same as Z. (Dixon et al., 2003, p. 136)

Collectively, the research on derived stimulus relations is important because it expands the scope of behavior theory, in particular with respect to the extent to which it supports prediction and control of the behavior of very sophisticated organisms and explains some of the complicated behavioral phenomena associated with them (Sidman, 1994; Tonneau, 2001). The fact that verbally competent humans7 show the emergence of any number of untaught relations following an operant history for relating stimuli in arbitrarily applicable and arbitrarily applied ways that is contextually controlled has proved to be a useful paradigm for understanding many key aspects of human behavior (see Barnes & Holmes, 1991).

Thirty Years of Application Stagnation

To summarize thus far, theoretical advances in equivalence and RFT have provided the infrastructure for a robust research agenda that both supports the theory and provides insights into various aspects of complex human behavior. Unfortunately, no accompanying revolution has been seen in applied behavior analysis. Basic researchers have long discussed the implications of phenomena such as rule-governed behavior for solving complex problems outside the domain of disability treatment (Catania, Shimoff, & Matthews, 1989; Dixon, 2000; Guinther & Dougher, 2015; Malott, 1993; Skinner, 1977; Zettle, 1990). Yet while they were talking, a cognitive revolution took place (Miller, 2003; Sperry, 1993) in which, from the perspective of laypersons and mainstream psychologists, behavior analytic approaches were supplanted by those looking “inside the mind” to find solutions to human problems. The response of behavior analysts has been primarily to ruminate over the logical shortcomings of cognitivist accounts (O’Donohue, Ferguson, & Naugle, 2003; Faux, 2002; Skinner, 1977), but ever so steadily, during the past four or five decades, cognitively-oriented researchers (often bearing the moniker of “cognitive-behavioral”) have amassed considerable evidence for the effectiveness of their approaches in addressing a range of human problems (Butler, Chapman, Forman, & Beck, 2006). One wonders what might have been achieved by behavior analysts during the same interval had advances in derived stimulus relations research been systematically applied in the same way.

Rehfeldt (2011) summarized the history of publications on derived stimulus relations, including stimulus equivalence, through 2009 in the Journal of Applied Behavior Analysis (JABA), which often is considered the premier outlet for applied behavior research. Achievements were found to be quite limited; here we will cite three important examples. First, nearly all of the studies focused on establishing relations of sameness or equivalence. Since 2009, 12 additional studies have been published in JABA that targeted relations of sameness, compared to only 2 targeting other relations. This is a stunning lack of attention to the sizeable literature explicating other kinds of relations, which encompasses literally hundreds of supporting basic studies (Hayes et al., 2001). Since 2009 alone, nearly 200 studies referencing RFT have been published in other behavior science journals. It is not clear why JABA is different. Perhaps applied investigators are simply unaware of this literature or lack the skills to understand it. Perhaps reviewers in a journal that is considered to be “Skinnerian” are reluctant to accept work reflecting other theoretical frameworks and unfamiliar methods (e.g., Critchfield & Reed, 2017). Another possibility that we have often heard mentioned is that RFT researchers grew impatient with that journal’s theoretical perspective and found alternative outlets for their work. Whatever the case, a near-exclusive focus on sameness relations omits much that makes human behavior interesting, and thereby ignores a host of possible tools for addressing human problems.

Second, Rehfeldt (2011) found that nearly all applied studies on derived stimulus relations took place in highly controlled, laboratory-like environments. For any behavioral technology to have an impact that our discipline can be proud of, it must be implemented in the environments where human problems occur and evidence must be obtained showing long lasting, practically significant gains. As noted by Marr (2017), a speciated behavior science, one in which basic and applied efforts unfold relatively independently, is not sustainable. Likely consequences to the field include a narrow range of applications and isolation from the mainstream of society. Skinner (1987), of course, described a risk to the survival of our species should we fail to apply the most recent advances in behavior science to solving real and broad problems. The domain of derived relational responding is one such advance.8

Third, Rehfeldt (2011) found almost no attention to what may be called dissemination research (e.g., Fixsen & Blase, 1993), which addresses the variables that influence intervention acceptability, implementation integrity, and, ultimately, effectiveness in the field. Consider, for instance, that research has shown that staff are unlikely to implement behavior programs that are too tedious, time-consuming, or impractical to implement and therefore compete with other job requirements (Sugai & Horner, 2006). As traditionally structured, however, applications based on derived stimulus relations are regarded as rather cumbersome to design and implement (e.g., see Critchfield & Twyman, 2014; Fienup, Hamelin, Reyes-Giordano, & Falcomata, 2011; Fienup, Mylan, Brodsky, & Pytte, 2016). This is unsurprising given that, as Rehfeldt (2011) pointed, most existing applications based on derived stimulus relations are demonstration-of-concept exercises that were designed in service of experimental designs rather than of implementation at scale in natural environments. Most would not, therefore, be expected to be practitioner friendly. Rehfeldt called for the creation of practitioner-oriented manuals to help others implement derived stimulus relations protocols (for a recent example, see the PEAK Relational Training System; Dixon, 2014a, 2014b, 2015, 2016). As we will discuss in greater detail below, efficient transportability through manualization or other means is likely pivotal to the adoption, at a global scale, of technologies based on derived stimulus relations.

Simplicity: A Barrier to Solving Complex Social Problems

One further way to characterize the applied research on derived stimulus relations that Rehfeldt (2011) reviewed is that the repertoires crafted, and the procedures used to create them, were fairly simple. In virtually every study to date the outcomes have been the same: Training is engineered to promote the emergence of three or four-member stimulus classes. These studies demonstrate something important but, tracing back to Sidman’s (e.g., 1971) first experiments involving reading-related skills, the demonstration is now roughly 50 years old. Many interesting aspects of human behavior -- including behavior related to the world’s great problems -- involve far more complex repertoires (think of terrorism, musical improvisation, corporate greed, poetic composition, brinksmanship in international relations, and so forth). Indeed, every member of society interacts with thousands of stimulus relations every day. Current research in derived stimulus relations is a long way from examining the nuanced, novel repertoires that this kind of rich behavioral history can produce.

Applied behavior analysis has heavily emphasized problems related to developmental disabilities and other learning challenges, and this has also been a major focus in research employing derived stimulus relations. Some successes have been reported. For example investigators have employed emergent unimodal and cross-modal relations (Hayes, Tilley, & Hayes, 1988; Rehfledt & Dixon, 2005) to team academic topics such as simple mathematics (Lynch & Cuvo, 1995), geography (LeBlanc, Miguel, Cummings, Goldsmith, & Carr, 2003). derived manding (Murphy, Barnes-Holmes, & Barnes-Holmes, 2005), identification of coin values (Keintz, Miguel, Kao, & Finn, 2011), and derived textual control of activity schedules (Miguel, Yang, Finn, & Ahearn, 2009). Yet in many cases the relevant stimulus relations reflect mostly beginner-level skills and are much less complex than what has been demonstrated in the basic research laboratory. More importantly, as far as we have ascertained, the emergent abilities of interest remain linked to the procedures of a specific intervention. Almost never targeted is the capacity of persons with learning challenges to entail relations, as a higher order operant, in novel ways under a variety of everyday circumstances. To date, only a single investigation has demonstrated a technology for improving the generalized relational abilities of individuals with disabilities (Dixon, Belisle, Belvins, & Hayes, under review).

Research on college instruction provides hints that it is possible to develop complex intellectual repertoires. For example, Walker and Rehfeldt (2012) used an equivalence paradigm to teach single-subject design, and Fienup and Critchfield (2011) taught concepts related to inferential statistics. These studies suggest that it is possible to teach complex material to sophisticated learners with instruction based on derived stimulus relations. However, one need only consult Bloom’s taxonomy of educational objectives (https://cft.vanderbilt.edu/guides-sub-pages/blooms-taxonomy/) to see that what has been accomplished to date pales by comparison to the skills that college students are expected to display upon completing a degree program. Most relevant studies still tend to employ equivalence protocols modeled closely after those used by Sidman (1971) in pioneering work with developmentally disabled individuals (e.g., involving match-to-sample procedures in which the critical performances involve pointing at, reading, or speaking simple words or phrases). It is difficult to describe the emergent performances in these studies as representing anything other than the lowest level on Bloom’s taxonomy. In the real world, advanced students are also expected to create, evaluate, and analyze; to produce new and original work; to argue and defend conceptual positions; and to investigate complex problems (Anderson et al., 2001). In the process they presumably employ repertoires that involve non-equivalence relations and more complex behaviors than typically are examined in behavioral research. For this reason, existing research on instruction with advanced learners provides little inspiration for the development of a technology focusing on truly important college student learning outcomes, much less outcomes that are directly relevant to “saving the world.”

This is unfortunate because, where “saving the world” is concerned, college-level instruction should be of special interest. Effective college instruction has the potential to shape the repertoires of college students, who by virtue of being college students in the first place may be well positioned to someday occupy positions of societal influence. But flexible, cognitively complex repertoires of independent and collaborative problem solving are needed to address the most challenging global problems. Identifying parts of a graph (Walker & Rehfeldt, 2012) and responding appropriately to a p value (Fienup & Critchfield, 2011) are probably important fundamentals for people with scientific and technical aspirations, but what comes next? We are aware of no widely discussed strategic vision for moving instruction based on derived stimulus relations beyond simple demonstrations and toward comprehensive technologies that can shape world-changing repertoires.

Looking Ahead

Failure and Success in Translational Research in Stimulus Relations

If insights based on derived stimulus relations research have any potential for addressing large-scale human problems, this potential can only be realized through an energetic program of translational and applied research. To illustrate both hurdles and opportunities, we provide brief descriptions of one failure, and one success, in achieving societal impact by harnessing derived stimulus relations.

An Example of Failure: Combating Terrorism

Previously we described our own efforts to make sense of terrorism and of prejudice toward Middle Easterners that resulted in the wake of the 2001 terror attacks. We acknowledge that these efforts failed to “save the world,” and it is easy to understand why. Our work consisted entirely of demonstration-of-concept exercises. A theoretical paper, for instance, can suggest plausible applications but does not design them, implement them, or test their effectiveness. Our empirical studies were no more impactful because they were conducted in convenient laboratory environments using easy-to-recruit university students as participants. We did not work with people in war torn countries, and we did not devise persuasive ways to explain our work to people unfamiliar with behavior science. We did not develop scaled-up technologies that could be implemented at scale and evaluated for social impact.

Ultimately, evidence of our failure to “save the world” is abundant. Approximately one decade after we began that line of research, the war-related death toll of a war in Iraq, purportedly begun to reduce terrorism, had reached 461,000 (Hagopian et al., 2013). Controversial policies to ban immigration of Muslims were being pursued in the United States (Gomez, 2017, January 28). While we could argue that considerable strife might have been avoided if only people had listened to our theory, the reality is that our “technology” never progressed beyond the incipient stage and therefore had virtually no prospect of reducing real-world suffering.

An Example of Success: Acceptance and Commitment Therapy

A more positive example can be found in Acceptance and Commitment Therapy (ACT; Hayes, Strosahl, & Wilson, 1999), which is a treatment approach based on RFT principles (e.g., McEnteggart, in press) and treatment aspects translated from Eastern philosophy. ACT focuses on several processes (see Hayes et. al (1999) for a review) that are elements of psychological flexibility, which loosely describes a person’s ability to behave adaptively in a dynamic and evolving context. Large-scale effectiveness of ACT for clinical problems such as depression, anxiety, and addiction has been demonstrated in rigorous randomized control trial evaluations (Hayes, 2004; Powers, Vörding, & Emmelkamp, 2009). ACT is considered the catalyst for the so-called “third-wave” behavioral therapies (Hayes, 2004) that are employed routinely by professionals in numerous helping profession (e.g., psychology, social work, and counseling).

For present purposes, three features of ACT will be emphasized. First, it is a technology designed specifically for use with verbally sophisticated humans. It focuses on how verbal behavior can create, and remediate, maladaptive outcomes,9 and some of its procedures represent what is sometimes called “talk therapy.” Second, manualized treatment protocols have been developed to aid in the dissemination and implementation of ACT. Third, although ACT is complex, it incorporates a non-technical language that the general population can understand (Barnes-Holmes, Hussy, McEnteggart, Barnes-Holmes, & Foody, 2016; Vilardaga, Hayes, Levin, & Muto, 2009) and that, arguably, has helped to fuel its societal acceptance. Exemplifying this acceptance, ACT was featured in a 2006 Time magazine cover story, and concepts integral to ACT, such as mindfulness have become familiar to everyday people outside of therapeutic situations (e.g., Boyce, 2011). An ACT popular press book, Get out of your mind and into your life (Hayes & Smith, 2005) was a top-25 Amazon best-seller.

Strangely, despite these successes, many behavior analysts have been slow to embrace ACT and its component concepts. The Behavior Analyst Certification Board (BACB, 2016) does not require that Board Certified Behavior Analysts® (BCBA) be competent in ACT. The Association for Behavior Analysis International Accreditation Board does not require coverage of ACT or RFT in accredited graduate programs. Perhaps as a result, many popular applied behavior analysis textbooks (e.g., Cooper, Heron, & Heward, 2007; Mayer, Sulzer-Azaroff, & Wallace, 2013) make no mention of ACT or RFT. This is not entirely surprising given that such books tend to emphasize interventions for individuals with limited communicative abilities. For instance, by our own count more than 90% of the interventions described in Cooper et al. (2007) do not demand the use of language (e.g., differential reinforcement procedures), whereas ACT is, like the majority of human beings, explicitly language intensive. Behavior science is unlikely to get very far with the world’s big problems, we maintain, if it ignores the primary features that make humans human.

A Better Next 30 Years

It would be unproductive for us to lament the failure of research on derived stimulus relations to “save the world” without considering that it is us -- scientists most acquainted with derived stimulus relations -- who are most responsible for so little having been achieved to date. We acknowledge that, for more than 40 years, people like us have shown too little vision and initiative in taking on the world’s big problems, and this must change. At the same time, we do not wish to under-sell the complexity and difficulty of those problems. Even with vision and initiative aplenty, those problems are not going to be solved overnight. It is, therefore, not our goal to suggest specific solutions to any given problem but rather to propose some changes that might move our field toward a meaningful exploration of possible solutions.

Below we outline three goals that we feel, if achieved, could aid in translating theoretical advancements and basic experimental findings on derived stimulus relations to impactful social-level interventions to solve the world’s greatest issues.

More Behavior Analysts must Become Fluent in Stimulus Relations Research and Technologies

Before principles of derived stimulus relations can contribute to “saving the world,” they must be widely known. Stimulus equivalence was developed over 40 years ago, and basic research in RFT followed shortly thereafter. Yet only recently was stimulus equivalence added to the BACB task list that guides the requisite information and experiences that all practicing BCBAs must possess (BACB, 2016). Neither ACT nor RFT is on the task list, so there is no guarantee that any given BCBA would even know that things can be related on dimensions other than sameness, nor how this skill develops operantly. We find this a disturbing reality given that relational operant development may be the most important higher order operant to target in children with disabilities, and a necessity to consider relational events in treating other non-disabled populations. Cooper et al.’s (2007) Applied Behavior Analysis, perhaps the most commonly used text in behavior analysis training programs, devotes a total of 6 pages to rule-governed behavior and equivalence. The description of rule-governed behavior is strictly Skinnerian and does not reflect conceptual advances made since 1969. The description of stimulus equivalence is inaccurate in its treatment of transitivity and equivalence relations.10 Neither ACT nor its conceptual underpinnings in RFT research are mentioned. Overall, there appears to be no ready means for applied behavior analysis students to learn the relevant concepts, and contingency requiring applied behavior analysis faculty to teach them. In an effort to assist interested readers with addressing this problem, in Table 1 we provide a brief annotated bibliography of resources that explain equivalence, RFT, and ACT.

Table 1.

Annotated bibliography of resources needed to establish a foundational understanding of stimulus equivalence, Relational Frame Theory, and Acceptance and Commitment Therapy

Stimulus Equivalence

Sidman and Tailby ( 1982 )

Conditional discrimination vs. matching to sample: An expansion of the testing paradigm

Sidman had initially tested his stimulus equivalence theory in a paper published in 1971, where an equivalence-based conditional discrimination procedure was used to teach a boy with an intellectual disability to read. Sidman and Tailby (1982) provides a more detailed overview of the key components of stimulus equivalence. The paper additionally provides insight into experiments that could be developed to test the assumptions of Sidman’s stimulus equivalence theory.

Sidman ( 1994 )

Equivalence relations and behavior: A research story

Sidman (1994) is a comprehensive book describing the history of stimulus equivalence theory and research up to that point. The author goes beyond simply describing research that was done, and provides some background narrative into why the experiments were conducted in the first place. Another extension of this book is that the potentially far-reaching implications of Sidman’s stimulus equivalence theory are described in terms of complex, cognitive events such as planning and remembering.
Relational Frame Theory

Hayes, Barnes-Holmes, and Roche ( 2001 )

Relational frame theory: A post-Skinnerian account of human language and cognition

Hayes, Barnes-Holmes, and Roche (2001) wrote this comprehensive book following just over a decade of research on derived relational responding and Relational Frame Theory. All key aspects of the theory are described in formulaic detail. In addition, implications of the theory in explaining complex language and cognitive events are described, such as thinking and emotion. As well, clinical implications are described in term of complex clinical issues not typically treated by behavior analysts.

Törneke (2010)

Learning RFT: An introduction to relational frame theory and its clinical application

Törneke (2010) extends the work previously completed by Hayes and colleagues by considerably simplifying the description of Relational Frame Theory in a way that is accessible to all readers with a background in behavior analysis. Formulaic descriptions have been replaced with more general descriptions, and several situational examples are used to explain the concepts. Again, the implications for the theory are discussed.
Acceptance and Commitment Therapy

Hayes, Strosahl, and Wilson ( 1999 )

Acceptance and commitment therapy: An experiential approach to behavior change

Hayes, Strosahl, and Wilson (1999) provide an in-depth analysis of the basic tenants of ACT and its potential implications in this edited book. Direct links between findings in RFT research and the therapeutic concepts of experiential avoidance and cognitive fusion are described in detail. As well, a formulaic overview of each component of the ACT hexaflex is provided along with a detailed description of what is meant by “psychological flexibility.”

Walser, Luoma, and Hayes (2007)

Learning ACT: An acceptance & commitment therapy skills-training manual for therapists

Luoma, Hayes, & Walser (2007) extend upon the work previously completed by Hayes and colleagues by creating a user-friendly description of ACT. The book uses considerably more middle level terms than Hayes, Strosahl, and Wilson, and is designed to provide meaningful information to both behavior analysts as well as individuals without behavior analytic training. Clinical examples are provided of ACT in practice.

Note: Full references for these materials are provided in the references section

We acknowledge that “becoming familiar” is no simple matter. Any reader who inspects published resources on derived stimulus relations will quickly encounter a host of thorny technical terms and various forms of symbolic notation that many people find hard to follow. If too few people know about derived stimulus relations, this is in part due to the fact that considerable effort must be invested to master the literature. About this we offer two observations. First, the literature on any specialized topic is difficult for a non-expert to master. But if, as we believe is true for derived stimulus relations, a topic is an integral part of a well-rounded professional repertoire, there is little excuse for not doing the needed work. Second, however, if those who are already well-informed about derived stimulus relations expect others to join the party, they will have to do more to make the relevant concepts accessible.

There is evidence that non-experts find technical terms to be not only hard to understand but also aversive (Critchfield, Becirevic, & Reed, 2016; Critchfield et al., 2017), in which case user-friendly language would appear to be a prerequisite for recruiting converts to any specialized area. Here we remind the reader of ACT’s model for translational success, which is built in part on describing very technical ideas in less technical language (e.g., see the resources in Table 1). For example, in ACT “motivative augmental rules” are described as “values” to make contact with the existing repertoires of end users who are not behavior scientists. In essence, what has been accomplished in ACT is to build equivalence classes in which technical terms are equated with easier-to-grasp alternatives. For the benefit of novices just entering the world of derived stimulus relations, more of this translating is needed.

More Stimulus Relations Research Programs Are Needed

Many accomplished fields of study seek to evaluate the progression of knowledge from basic theories to societally-impactful outcomes (Hörig, Marincola, & Marincola, 2005; Tashiro & Mortenson, 2006). In medicine, this is called the bench-to-bedside model (Friedman, 2003; Drolet & Lorenzi, 2011; for a related biomedical framework, see Kyonka & Subramaniam, in press). Figure 1 shows this general model as it could be applied to behavioral research (in particular research on derived stimulus relations), which we have termed the Theory-to-Impact model. A theory sets the conditions for evaluating its utility in application. In behavior science, the most notable and widely applied theory is Skinner’s operant theory, and the inclusion of stimulus equivalence and RFT further expand the theoretical center of our field. The next stage describes basic research to evaluate the tenets put forward in the theory. Basic research on operant theory has been conducted for decades with animal models (Azrin, 1959; Byrne & Poling, 2017), and as discussed at some length above, several basic experimental studies on equivalence and RFT have supported the viability of these extensions in explaining complex aspects of human behavior. Translational research describes tightly controlled experimental evaluations of the application of theory and basic research findings. Basic research and translational research together comprise what has been described as efficacy research. The Society for Prevention Research (Flay et al., 2005) has described efficacy research as tightly controlled experimental research, usually utilizing randomized control trial evaluations that are implemented with strong treatment fidelity. Efficacy research is crucial to translating theory to meaningful technologies to improve the human condition. Most single-case evaluations would also likely function as efficacy research, where intentional and tightly controlled manipulations (e.g., alternating treatments design) in the independent variable are implemented to determine the effect of a treatment on one or several target behaviors.

Fig. 1.

Fig. 1

Diagram of a theory to impact continuum of behavior scientific research. Concentric circles show each level of research beginning with basic theoretical assumptions to large scale social impact. Arrows indicate that the stages are continuous and not categorical. The range of research covered in the subfield of Applied Behavior Analysis is noted, as well as the range of research that describes the efficacy and effectiveness of a behavior analytic approach

The next stage describes implementation, where the effect of the treatment is evaluated in real-world settings, conducted by parents, teachers, or staff, and under naturally occurring conditions. Experimental design logic may still be employed; however, trade-offs are made in experimental rigor. For example, Gresham, Gansle, and Noell (1993) discussed the importance of implementation fidelity in ensuring that an independent variable was conducted as intended; however, in naturally occurring conditions, error in implementation is expected. The final stage describes evaluations of treatment impact. These are broader changes in a variable that may have resulted from the larger-scale use of the treatment in society (Khandker, Koolwalk, & Samad, 2010; Marchand, Stice, Rohde, & Becker, 2011; White, 2009). In medicine, for example, the impact of mandatory vaccinations for children is evaluated in terms of global decreases in illnesses targeted by the vaccines. At this stage, there may be minimal or no experimental manipulation, as it is assumed that appropriate steps were taken to determine a causal relationship between the treatment and outcome at earlier research stages.

Implementation and impact research therefore both evaluate the effectiveness of treatment. Or, the degree to which the treatment has led to large-scale changes in naturally occurring environments (Flay et al., 2005; Gottfredson et al., 2015). Quasi-experimental designs may replace randomization as an emphasis is placed on the external validity of findings at the expense of internal validity. Confounding factors are not eliminated as in efficacy evaluations, rather confounds are accepted as part of the environment in which the research is conducted. Single-case research designs prevalent in behavioral science may not be generally amenable to effectiveness research, as the time-series manipulations and rigorously described methods are unlikely to be implemented by regular staff in natural settings without the direct oversight of behavior analysts.

Figure 2 provides an example of how research may evolve across these levels in a reticulated fashion. The figure shows that these stages should be viewed as on a continuum rather than as discrete types of research, as noted by previous writers (Critchfield, 2011; Kyonka & Subramaniam, in press; Mace & Critchfield, 2010; Vollmer, 2011). The figure also indicates that research at all levels should inform subsequent studies, ultimately building to the development and evaluations of technologies with the potential for large-scale impact. In general, research at all stages of the Theory-to-Impact model is needed. As noted earlier, however, it appears that behavioral research on derived stimulus relations technologies has not progressed far past basic experimental research and theoretical discourse. Only a small amount of efficacy research has been conducted (e.g., Brodsky & Fienup, in press), which is a shame because, in effort to “save the world,” this may be the most important type of research.

Fig. 2.

Fig. 2

Exemplar diagram showing how several research studies may interact within the theory to impact continuum of behavior scientific research. Points indicate example studies in a related line of research. Bidirectional arrows show the reticulation of research findings to research in other stages in the model

At least two strategies have been adopted in other fields to aid in translating basic findings to effective treatment technologies. First, the development of manualized protocols allows for procedures to be described in general terms that can be implemented by people in natural settings (Marchand et al., 2011; Gottfredson et al., 2015). The independent variable becomes implementation of the protocol, allowing for larger-scale changes in a socially relevant dependent variable to be evaluated. This approach has been adopted with some success by behavioral scientists in Positive Behavior Intervention and Supports models (PBIS; Horner, Sugai, Todd, & Lewis-Palmer, 2005; Sugai & Horner, 2006). Although the implementation of PBIS likely varies considerably from institution to institution, effectiveness research has firmly established that schools who adopt the protocol produce stronger outcomes for their students (Bradshaw, Koth, Bevans, Bevans, & Leaf, 2008; Childs, Kincaid, George, & Gage, 2016). ACT protocols adopt this same approach, where therapists may vary greatly in implementation, yet effective outcomes are demonstrated none-the-less (Hacker, Stone, & MacBeth, 2016). Both PBIS and ACT also have in common that commercial techniques are used to gain buy-in from society. “Positive” in PBIS does not refer to exclusive addition of reinforcing stimuli to the environment, rather is used in a colloquial way to refer to the avoidance of aversive techniques, which in some circles have given applied behavior analysis a bad name (Carr et al., 2002). A technical vernacular is important in a science, but what both ACT and PBIS show is that the technical vernacular does not need to be present in the manualized products that are implemented by end users in the everyday world.

Second, multi-tiered levels of support describe an implementation strategy in which loosely controlled general interventions are applied universally, and more tightly controlled interventions are prescribed on an “as-needed” basis (Hoover & Patton, 2008). An argument against the use of manualized protocols may be that such approaches will only work in the least-severe cases. Multi-tiered intervention models elucidate this concern by assessing for severity and individualizing treatment approaches accordingly. Currently, multi-tiered models are adopted in PBIS, response-to-intervention strategies in schools (Barnes & Harlacher, 2008), and as a model in the prevention and systems sciences (Lich, Ginexi, Osgood, & Mabry, 2013). Table 2 provides an example of a multi-tiered model that could make use of derived relational responding technologies to target global warming. The tiers in this model were adapted from PBIS as well as the prevention science model described by Lich et al. (2013). By delineating the level of support, as well as by researching the theory, efficacy, and effectiveness of our models, we may begin to develop technologies that have the potential to influence global behavioral change.

Table 2.

A Multi-Tiered model applied to issues of large-scale social importance with global warming as a national crisis as an example and solutions including aspects of Relational Frame Theory

Tier Description Example
I. Universal Prevention Efforts Established to promote improvement in some area for all members of an organization, group, or society. The efforts should be easily implemented and enforceable at a broader scale.

Problem:

Excessive pollution is depleting the ozone layer. The extinction of some animal species is occurring. There is a potential that the world will no longer be habitable by humans.

Prevention Effort:

Create global warming prevention month activities designed to encourage relations between people’s choices, personal values, and their effect on pollution and global warming.

II. Focused At-Risk Prevention Efforts Established assessment procedures to identify subsections of organizations, groups, or societies that are at-risk developing a problem of large-scale importance. Efforts should evaluate specific situational factors that put the subsection at greater risk and provide additional resources to decrease risk.

Problem:

The city of Maranne is a top contributor to energy use and pollution levels.

Prevention Effort:

A tax incentive is given to Maranne residents to attend an annual seminar on global warming designed to help promote values clarification and to help residents problem solve how to reduce energy consumption.

III. Focused Intensive Remediation Efforts Established assessment procedures to identify subsections of organizations, groups, or societies that currently have a problem of large-scale importance. Efforts should evaluate specific problem causes and act to remediate the problems using individualized strategies.

Problem: A factory in Maranne contributes over 50% of the pollution generated by the city. Assessment suggests that sustaining human existence on earth is not a value of the factory.

Remediation Effort:

Negotiations with the company are undertaken to reduce emissions by determining the values of the company (e.g., generating revenue) and providing experts to determine how revenues can be maintained or increased while reducing emissions and pollution.

Note: The examples and solutions in this table are designed to provide an exemplar of what an approach may look like. The social groups are fictional and the solutions have not been tested at any stage in the theory to impact model

Behavior Analysts must Learn to Effectively Disseminate Technological Approaches to Solving the world’s Problems at a Global Level

Dissemination is an active process that requires far more than the initial development of promising interventions (e.g., Fixsen & Blase, 1993). To put it another way, many useful technologies have not been widely adopted even though they were effective. Once behavior analysts begin to develop derived stimulus relations technologies that address the world’s big problems, they will have to figure out how to deliver them on a wide scale. Fig. 3 shows a dissemination model adapted from Drolet and Lorenzi’s (2011) biomedical research continuum and Gottfredson et al.’s (2015) model for the prevention sciences that could have utility in disseminating derived stimulus relations technologies at large scale once effective technologies have been developed and have obtained empirical support of effectiveness. Evaluating the effectiveness of a technology is the first step in the model. This means implementation and impact stage research, conducted by people in society for whom the technology is intended, and allowing for the likelihood of uncontrolled implementation errors and confounding variables that exist in the real world. Ideally, such effectiveness evaluations have developed as empirical extensions from several controlled evaluations of efficacy. Once effectiveness is established, Gottfredson et al. (2015) suggest scaling-up the technology through manualization, training packages, and other supports so that the technology is publicly accessible. Scaling-up the technology must interact bidirectionally with cost considerations to ensure that the cost associated with entire treatment package is not a barrier to large-scale implementation. Throughout the scaling up process, on-going evaluations must continue to ensure that all aspects of the technology are efficacious and effective in promoting the intended social change.

Fig. 3.

Fig. 3

Dissemination model from progressing from effectiveness research to sustainable replications of scaled-up behavioral applications

Two technologies developed by behavior analysts provide exemplars for the potential impact of scaling-up and continuously evaluating packaged interventions. PBIS and the Good Behavior Game (Barrish, Saunders, & Wolf, 1969; Embry, 2002; Solomon, Klein, Hintze, Cressey, & Peller, 2012) both incorporate contingency manipulation strategies to reduce challenging behaviors and promote positive social behaviors of children in classrooms. For the Good Behavior Game, impressive longitudinal data also exist, showing that adults who participated in the game as students show reduced rates of smoking initiation (Kellam & Anthony, 1998), drug abuse (Poduska et al., 2008) and risky sexual behaviors (Kellam et al., 2014). These data are interesting because they show the potential utility of behavior science in educational settings if implemented on a larger scale.

Although not as empirically developed as the latter two exemplar systems, the PEAK Relational Training System (Dixon, 2014a, 2014b, 2015, 2016) is one example of a technology grounded in derived stimulus relations that has begun to progress through these stages of technological dissemination. The effectiveness of RFT based procedures was supported in prior research establishing emergent skill repertoires in people with autism. PEAK built on this research by providing a commercially available package in considerable liberties were taken with the technical vocabulary of derived stimulus relations and other operant principles. The goal was for front-line caregivers to be able to implement sophisticated procedures with no outside assistance. In evaluating PEAK empirically, researchers shifted from single-subject research designs to group-based designs that would be familiar to a wider audience. To date the data show that PEAK has good reliability (Dixon, Stanley, Belisle, & Rowsey, 2016), validity (Dixon et al., 2015), and between groups outcome efficacy (McKeel, Dixon, Daar, Rowsey, & Szekely, 2015). One ongoing interest is to evaluate whether the scaled-up treatment package can be effective when conducted by frontline staff in schools and in therapeutic settings (Dixon et al., 2017).

Once effective, scaled-up, and cost-effective models have been developed, replication evaluations should be conducted to ensure that idiosyncratic variables in initial research were not responsible for obtained results (e.g., Fixsen & Blase, in press). Replications are especially necessary in evaluations of effectiveness, which often lack the experimental rigor to control for potential confounding variables in each context. Ongoing evaluation of replications may additionally elucidate changes that need to be made in the package to improve the probability of successful replication. An overarching consideration, especially in the context of global scale interventions as discussed in the current paper, is that all processes in the dissemination model should be implemented with consideration for sustainability. Once efficacious, effective, replicable, and sustainable solutions are available that make use of derived relational responding technologies, we can begin to apply what we know about consumer choice (Foxall, 2016), synthesizing contingency-based and rule-governed accounts, to innovatively disseminate impactful technologies to affect real-world change. Overall, as should now be evident, the needed program of research and develop is extensive and quite different from what is typically seen in today’s literature on applications of derived stimulus relations technology.

A Final Thought

Thirty years have now passed since Skinner’s (1987) paper on how behavior scientists should go about saving the world. Unfortunately, where the world’s big problems are concerned, our field has really never achieved much wide-scale impact. Perhaps this is because progress in science, especially translational science, is inherently slow. Or perhaps behavior scientists have grown too comfortable with their science as it was depicted in the early days by the field’s pioneers (e.g., Critchfield & Reed, 2017). Whatever the reason for the status quo, change is needed. If anything has become clear in the years since Skinner’s (1987) essay, it is that the world’s problems are not going to solve themselves. We suggest that theoretical and experimental findings emergent from derived stimulus relational accounts can help behavior scientists development and disseminate new technologies, synthesizing approaches rooted in contingency-based and rule-governed accounts of the behavior of verbally sophisticated humans. By their very nature, such technologies will be different from the exclusively contingency-focused approaches that arose from Skinner’s (e.g., 1953, 1957) perspective on behavior, and have failed to achieve the global changes sought by behavior scientists of the time. Although it can be uncomfortable to deviate from tradition, if behavior scientists fail to innovate and take up the real challenges that demand solutions, another 30 disappointing years will pass, with real, catastrophic consequences for the world.

To save anything, we need to know why it needs saving in the first place. When all the data and conclusions point to the maladaptive behavior of human beings, and those human beings are verbal, our interventions must be rooted in the best available science regarding human language. Derived stimulus relations as an outcome, relating as a process, and the technologies that bring such behaviors under predictive power, therefore need to be investigated and implemented far more vigorously than what has taken place in the past. Once this happens, we as behavior scientists may well be a little closer to saving the world.

Footnotes

1

These world issues are a still present concern, as we are again witnessing nuclear threats, resource depletion now carries the added concern of short and long term environmental sustainability, and the global population continues to rise.

2

As a point of clarification, we are not proposing that contingencies, immediate and delayed, do not influence behavior of verbally sophisticated humans, as recent research has shown that quantitative contingency-based models (e.g., matching law) predict several instances of human behavior (Hantula & Crowell, 2016; Hantula, Brockman, & Smith, 2008); rather, that both contingency governance and rule-governance must both be considered for a complete account (see Belisle, Paliliunas, Dixon, & Speelman, in press, for a study with recreational gamblers that synthesizes matching and derived rule following).

3

As noted by Hayes and Sanford (2014), over 25 years of research on equivalence responding in animals has failed to find systematic and replicable evidence that non-human animals can demonstrate symmetrical or transitive relational responding, which can be readily demonstrated by human infants, suggesting that language defined consistent with this and related accounts (RFT) describe a potentially exclusively human behavior.

4

Also referred to as transformation of function (e.g., Dymond & Rehfeldt, 2000), for reasons that will be addressed shortly.

5

With this expansion came a change in vocabulary. Sidman (e.g., 1994) had referred to such phenomena as symmetry (when two stimuli can be identified as “going together” regardless of which is presented) and equivalence (as described above). In RFT these are replaced by mutual entailment and combinatorial entailment, terms that are more readily adaptable to a variety of types of derived stimulus relations; for further explanation see Hayes, et al. (2001).

6

In effect, “degrees of separation,” defined as the number of steps of direct experiential association separating indirectly-associated stimuli.

7

Whether presumably nonverbal nonhumans show any of these effects is a matter still under debate; see Galizio (this issue) for a representative discussion.

8

A possible objection is that, whatever advances may have been made in behavior science, the means do not exist to distribute behavioral technology on a wide scale. We regard that objection as justification for a lack of ambition, or at least ingenuity, and point to promising examples of how behavioral technology might be adapted to mechanisms that support broad implementation. For instance, Root, Rehfeldt, and Castro (under review) described an online equivalence-based training system, in which instruction was presented online using a university learner management system, and generated better learning outcomes than traditional teaching practices. Rehfeldt, Jung, Aguirre, Nichols, and Root (2016) took the approach a step further by creating the first Massive Open Online Course (an electronically-delivered course available to anyone, anywhere) in which the instruction was designed with derived stimulus relations in mind. To date, unfortunately, few have attempted such in-the-trenches applications targeting large numbers of potential beneficiaries.

9

For example, ACT addresses the role of unproductive rule-governance in human problems. RFT provides insights about how stimulus relations contribute to rule development and rule following.

10

Cooper et al. (2007, p. 398) describe equivalence as the demonstration of reflexivity, symmetry, and transitivity, noting only that following A = B and B=C in a linear arrangement, that the transitive A = C is needed for equivalence; however, as noted by Sidman and Tailby (1982), both A = C and the bidirectional C = A are required.

Contributor Information

Mark R. Dixon, Phone: (618) 453-8275, Email: mdixon@siu.edu

Jordan Belisle, Email: jbelisle@siu.edu.

Ruth Anne Rehfeldt, Phone: 618-453-8276, Email: rehfeldt@siu.edu.

William B. Root, Email: wroot@siu.edu

References

  1. Anderson LW, Krathwohl DR, Airasian P, Cruikshank K, Mayer R, Pintrich P, et al. A taxonomy for learning, teaching and assessing: a revision of Bloom’s taxonomy. New York, NY: Longman Publishing; 2001. [Google Scholar]
  2. Arch JJ, Eifert GH, Davies C, Vilardaga JCP, Rose RD, Craske MG. Randomized clinical trial of cognitive behavioral therapy (CBT) versus acceptance and commitment therapy (ACT) for mixed anxiety disorders. Journal of Consulting and Clinical Psychology. 2012;80(5):750–765. doi: 10.1037/a0028310. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Arntzen E, Steingrimsdottir H. Equivalence class formation in older adults with electroencephalography (EEG) as an additional measure. Frontiers in Human Neuroscience. 2017;11:1–10. doi: 10.3389/fnhum.2017.00058. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Azrin NH. A technique for delivering shock to pigeons. Journal of the Experimental Analysis of Behavior. 1959;2:161–163. doi: 10.1901/jeab.1959.2-161. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Barnes AC, Harlacher JE. Clearing the confusion: response-to-intervention as a set of principles. Education and Treatment of Children. 2008;31:417–431. [Google Scholar]
  6. Barnes D, Holmes Y. Radical behaviorism, stimulus equivalence, and human cognition. The Psychological Record. 1991;41:19–31. [Google Scholar]
  7. Barnes-Holmes D, Barnes-Holmes Y. Explaining complex behavior: two perspectives on the concept of generalized operant classes. The Psychological Record. 2000;50:251–265. [Google Scholar]
  8. Barnes-Holmes Y, Hussey I, McEnteggart C, Barnes-Holmes D, Foody M. The relationship between relational frame theory and middle-level terms in acceptance and commitment therapy. In: Zettle RD, Hayes SC, Biglan A, editors. The Wiley handbook of contextual behavioral science. Malden, MA: John Wiley & Sons, Ltd; 2016. [Google Scholar]
  9. Barnes-Holmes D, Murphy A, Barnes-Holmes Y, Stewart I. The implicit relational assessment procedure: exploring the impact of private versus public contexts and the response latency criterion on pro-white and anti-black stereotyping among white Irish individuals. The Psychological Record. 2010;60(1):57–79. [Google Scholar]
  10. Barrish HH, Saunders M, Wolf MM. Good behavior game: effects of individual contingencies for group consequences on disruptive behavior in a classroom. Journal of Applied Behavior Analysis. 1969;2:119–124. doi: 10.1901/jaba.1969.2-119. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Behavior Analysis Certification Board (2016). Behavior analysis certification board: fourth edition task list. Retrieved from http://bacb.com/wp-content/uploads/2016/03/160101-BCBA-BCaBA-task-list-fourth-edition-english.pdf
  12. Belisle, J., Paliliunas, D., Dixon, M. R., & Speelman, R. C. (in press). Decreasing influence of arbitrarily applicable verbal relations of recreational gamblers: a randomized controlled trial. Journal of Applied Behavior Analysis. [DOI] [PubMed]
  13. Boyce . The mindfulness revolution: leading psychologists, teachers, artists and meditation teacher son the power of mindfulness in everyday life. Boulder, CO: Shambhala; 2011. [Google Scholar]
  14. Bradshaw CP, Koth CW, Bevans KB, Ialongo N, Leaf PJ. The impact of School-Wide Positive Behavioral Interventions and Supports (PBIS) on the organizational health of elementary schools. School Psychology Quarterly. 2008;23:462–473. [Google Scholar]
  15. Brodsky, J., & Fienup, D.M. (in press). Sidman goes to college: a meta-analysis of equivalence-based education in college instruction. Perspectives on Behavior Science. [DOI] [PMC free article] [PubMed]
  16. Butler AC, Chapman JE, Forman EM, Beck AT. The empirical status of cognitive-behavioral therapy: a review of meta-analyses. Clinical Psychology Review. 2006;26:17–31. doi: 10.1016/j.cpr.2005.07.003. [DOI] [PubMed] [Google Scholar]
  17. Byrne T, Poling A. Behavioral effects of delayed timeouts from reinforcement. Journal of the Experimental Analysis of Behavior. 2017;107:208–217. doi: 10.1002/jeab.246. [DOI] [PubMed] [Google Scholar]
  18. Carr EG, Dunlap G, Horner RH, Koegel RL, Turnbull AP, Sailor W, Anderson JL, Albin RW, Koegel LK, Fox L. Positive behavior support: evolution of an applied science. Journal of Positive Behavior Interventions. 2002;4:4–16. [Google Scholar]
  19. Catania, A.C. (2013). Learning (5th ed.). Cornwall-on-Hudson, NY: Sloan.
  20. Catania AC, Matthews BA, Shimoff E. Instructed versus shaped human verbal behavior: interactions with nonverbal responding. Journal of the Experimental Analysis of Behavior. 1982;38:233–248. doi: 10.1901/jeab.1982.38-233. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Catania, A. C., Shimoff, E., & Matthews, B. A. (1989). In S. C. Hayes (Ed.), Rule-governed behavior: cognition, contingencies, and instructional control (pp. 119–150). Reno, NV: Context Press.
  22. Childs KE, Kincaid D, George HP, Gage NA. The relationship between school-wide implementation of positive behavior intervention and supports and student discipline outcomes. Journal of Positive Behavior Interventions. 2016;18:89–99. [Google Scholar]
  23. Cooper JO, Heron TE, Heward WL. Applied behavior analysis. 2. London: Pearson; 2007. [Google Scholar]
  24. Critchfield TS. Translational contributions of the experimental analysis of behavior. The Behavior Analyst. 2011;34:3–17. doi: 10.1007/BF03392227. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Critchfield TS, Becirevic A, Reed DD. On the social validity of behavior-analytic communication: a call for research and description of one method. The Analysis of Verbal Behavior. 2016;33:1–23. doi: 10.1007/s40616-017-0077-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Critchfield TS, Doepke KJ, Epting LK, Becirevic A, Reed DD, Fienup DM, et al. Normative emotional responses to behavior analysis jargon or how not to use words to win friends and influence people. Behavior Analysis in Practice. 2017;10:97–106. doi: 10.1007/s40617-016-0161-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Critchfield TS, Reed DD. The fuzzy concept of applied behavior analysis research. The Behavior Analyst. 2017;40:123–159. doi: 10.1007/s40614-017-0093-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Critchfield TS, Twyman JT. Prospective instructional design: establishing conditions for emergent learning. Journal of Cognitive Education and Psychology. 2014;13:201–217. [Google Scholar]
  29. Debert P, Matos MA, McIlvane W. Conditional relations with compound abstract stimuli using a go/no-go procedure. Journal of the Experimental Analysis of Behavior. 2007;87:89–96. doi: 10.1901/jeab.2007.46-05. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. DeGrandpre RJ, Bickel WK, Higgins ST. Emergent equivalence relations between interoceptive (drug) and exteroceptive (visual) stimuli. Journal of the Experimental Analysis of Behavior. 1992;58:9–18. doi: 10.1901/jeab.1992.58-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Dixon MR. Manipulating the illusion of control: variations in gambling as a function of perceived control over chance outcomes. The Psychological Record. 2000;50:705–719. [Google Scholar]
  32. Dixon MR. The PEAK relational training system: direct training module. Carbondale, IL: Shawnee Scientific Press; 2014. [Google Scholar]
  33. Dixon MR. The PEAK relational training system: generalization module. Carbondale, IL: Shawnee Scientific Press; 2014. [Google Scholar]
  34. Dixon MR. The PEAK relational training system: equivalence module. Carbondale, IL: Shawnee Scientific Press; 2015. [Google Scholar]
  35. Dixon MR. The PEAK relational training system: transformation module. Carbondale, IL: Shawnee Scientific Press; 2016. [Google Scholar]
  36. Dixon, M. R., Belisle, J., Blevins, A., & Hayes, S. C. (under review). Derived relational responding is a generalized operant: evidence from children with autism using the PEAK-E curriculum. [DOI] [PMC free article] [PubMed]
  37. Dixon, M. R., Belisle, J., McKeel, A., Whiting, S., Speelman, R. C., Daar, J. H., & Rowsey, K. E. (2017). An internal and critical review of the PEAK relational training system for children with autism and related intellectual disabilities: 2014–2017. The Behavior Analyst. [DOI] [PMC free article] [PubMed]
  38. Dixon MR, Belisle J, Stanley CR, Rowsey KE, Daar S. Toward a behavior analysis of complex language for children with autism: evaluating the relationship between PEAK and the VB-MAPP. Journal of Developmental and Physical Disabilities. 2015;27:223–233. [Google Scholar]
  39. Dixon MR, Branon A, Nastally BL, Mui N. Examining prejudice towards Middle Eastern persons via a transformation of stimulus functions. The Behavior Analyst Today. 2009;10:295–318. [Google Scholar]
  40. Dixon MR, Dymond S, Rehfeldt RA, Roche B, Zlomke KR. Terrorism and relational frame theory. Behavior and Social Issues. 2003;12:129–147. [Google Scholar]
  41. Dixon MR, Lemke M. Reducing prejudice towards Middle Eastern persons as terrorists. European Journal of Behavior Analysis. 2007;8:5–12. [Google Scholar]
  42. Dixon MR, Rehfeldt RA, Zlomke KR, Robinson A. Exploring the development and dismantling of equivalence classes involving terrorist stimuli. The Psychological Record. 2006;56:83–103. [Google Scholar]
  43. Dixon MR, Stanley C, Belisle J, Rowsey KE. The test-retest and interrater reliability of the Promoting the Emergence of Advanced Knowledge-Direct Training assessment for use with individuals with autism and related disabilities. Behavior Analysis: Research and Practice. 2016;16:34–40. [Google Scholar]
  44. Dixon MR, Small SL, Rosales R. Extended analysis of empirical citations with Skinner’s Verbal Behavior: 1984–2004. The Behavior Analyst. 2007;30:197–209. doi: 10.1007/BF03392155. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Dixon MR, Zlomke KM, Rehfeldt RA. Restoring Americans’ nonequivalent frames of terror: an application of relational frame theory. The Behavior Analyst Today. 2006;7:275–289. [Google Scholar]
  46. Dougher MJ, Augustson E, Markham MR, Greenway DE, Wulfert E. The transfer of respondent eliciting and extinction functions through stimulus equivalence classes. Journal of the Experimental Analysis of Behavior. 1994;62:331–351. doi: 10.1901/jeab.1994.62-331. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Dougher MJ, Hamilton DA, Fink BC, Harrington J. Transformation of the discriminative and eliciting functions of generalized relational stimuli. Journal of the Experimental Analysis of Behavior. 2007;88:179–197. doi: 10.1901/jeab.2007.45-05. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Drolet BC, Lorenzi NM. Translational research: understanding the continuum from bench to bedside. Translational Research. 2011;157:1–5. doi: 10.1016/j.trsl.2010.10.002. [DOI] [PubMed] [Google Scholar]
  49. Dymond S, Barnes D. A transformation of self-discrimination response functions in accordance with the arbitrarily applicable relations of sameness, more than, and less than. Journal of the Experimental Analysis of Behavior. 1995;64:163–184. doi: 10.1901/jeab.1995.64-163. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Dymond S, O’Hora D, Whelan R, O’Donovan A. Citation analysis of Skinner’s Verbal Behavior: 1984–2004. The Behavior Analyst. 2006;29:75–88. doi: 10.1007/BF03392118. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Dymond, S., & Rehfeldt, R. A. (2000). Understanding complex behavior: the transformation of stimulus functions. The Behavior Analyst, 23, –239, 254. [DOI] [PMC free article] [PubMed]
  52. Dymond S, Roche B, Forsyth JP, Whelan R, Rhoden J. Transformation of avoidance response functions in accordance with same and opposite relational frames. Journal of the Experimental Analysis of Behavior. 2007;88:249–262. doi: 10.1901/jeab.2007.22-07. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Embry DD. The good behavior game: a best practice candidate as a universal behavioral vaccine. Clinical Child and Family Psychology Review. 2002;5:273–297. doi: 10.1023/a:1020977107086. [DOI] [PubMed] [Google Scholar]
  54. Faux SF. Cognitive neuroscience from a behavioral perspective: a critique of chasing ghosts with Geiger counters. The Behavior Analyst. 2002;25:161–173. doi: 10.1007/BF03392055. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Fields L, Adams BJ, Verhave T, Newman S. The effects of nodality on the formation of equivalence classes. Journal of the Experimental Analysis of Behavior. 1990;53:345–358. doi: 10.1901/jeab.1990.53-345. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Fienup DM, Critchfield TS. Transportability of equivalence-based programmed instruction: efficacy and efficiency in a college classroom. Journal of Applied Behavior Analysis. 2011;44:435–450. doi: 10.1901/jaba.2011.44-435. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Fienup DM, Hamelin DP, Reyes-Giordano K, Falcomata TS. College-level instruction: derived relations and programmed instruction. Journal of Applied Behavior Analysis. 2011;44:413–416. doi: 10.1901/jaba.2011.44-413. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Fienup DM, Mylan SE, Brodsky J, Pytte C. From the laboratory to the classroom: the effects of equivalence-based instruction on neuroanatomy competencies. Journal of Behavioral Education. 2016;25:143–165. [Google Scholar]
  59. Fixsen, D.L., & Blase, K.A (in press). The teaching-family model: the first 50 years. Perspectives on Behavior Science. [DOI] [PMC free article] [PubMed]
  60. Fixsen DL, Blase KA. Creating new realities: program development and dissemination. Journal of Applied Behavior Analysis. 1993;26:597–615. doi: 10.1901/jaba.1993.26-597. [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Flay BR, Biglan A, Boruch RF, Castro FG, Gottfredson D, Kellam S, et al. Standards of evidence: criteria for efficacy, effectiveness and dissemination. Prevention Science. 2005;6:151–175. doi: 10.1007/s11121-005-5553-y. [DOI] [PubMed] [Google Scholar]
  62. Forman EM, Herbert JD, Moitra E, Yeomans PD, Geller PA. A randomized controlled effectiveness trial of acceptance and commitment therapy and cognitive therapy for anxiety and depression. Behavior Modification. 2007;31:772–799. doi: 10.1177/0145445507302202. [DOI] [PubMed] [Google Scholar]
  63. Foxall GR. Consumer choice as behavior. In: Foxall GR, editor. Perspectives on consumer choice. London: Palgrave Macmillan; 2016. [Google Scholar]
  64. Friedman SL. Liver fibrosis—from bench to bedside. Journal of Hepatology. 2003;38:38–53. doi: 10.1016/s0168-8278(02)00429-4. [DOI] [PubMed] [Google Scholar]
  65. Gomez, A. (2017, January 28). Experts question legality of Trump’s immigration ban on Muslim countries. USA Today. Retrieved from https://www.usatoday.com/story/news/ 2017/01/28/experts-question-legality-trumps-ban-muslim-countries/97189982/.
  66. Gottfredson DC, Cook TD, Gardner FE, Gorman-Smith D, Howe GW, Sandler IN, Zafft KM. Standards of evidence for efficacy, effectiveness, and scale-up research in prevention science: next generation. Prevention Science. 2015;16:893–926. doi: 10.1007/s11121-015-0555-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  67. Gresham FM, Gansle KA, Noell GH. Treatment integrity in applied behavior analysis with children. Journal of Applied Behavior Analysis. 1993;26:257–263. doi: 10.1901/jaba.1993.26-257. [DOI] [PMC free article] [PubMed] [Google Scholar]
  68. Guinther PM, Dougher MJ. Semantic false memories in the form of derived relational intrusions following training. Journal of the Experimental Analysis of Behavior. 2010;93:329–347. doi: 10.1901/jeab.2010.93-329. [DOI] [PMC free article] [PubMed] [Google Scholar]
  69. Guinther PM, Dougher MJ. The clinical relevance of stimulus equivalence and relational frame theory in influencing the behavior of verbally competent adults. Current Opinion in Psychology. 2015;2:21–25. [Google Scholar]
  70. Hacker T, Stone P, MacBeth A. Acceptance and commitment therapy—do we know enough? Cumulative and sequential meta-analyses of randomized controlled trials. Journal of Affective Disorders. 2016;190:551–565. doi: 10.1016/j.jad.2015.10.053. [DOI] [PubMed] [Google Scholar]
  71. Hagopian, A., Flaxman, A. D., Takaro, T. K., Al Shatari, S. A. E., Rajaratnam, J., Becker, S., et al. (2013). Mortality in Iraq associated with the 2003–2011 war and occupation: findings from a national cluster sample survey by the university collaborative Iraq Mortality Study. PLoS Medicine, 10, e1001533. [DOI] [PMC free article] [PubMed]
  72. Haimson B, Wilkinson KM, Rosenquist C, Ouimet C, McIlvane WJ. Electrophysiological correlates of stimulus equivalence processes. Journal of the Experimental Analysis of Behavior. 2009;92:245–256. doi: 10.1901/jeab.2009.92-245. [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. Hantula DA, Brockman DD, Smith CL. Online shopping as foraging: the effects of increasing delays on purchasing and patch residence. IEEE Transactions on Professional Communication. 2008;51:147–154. [Google Scholar]
  74. Hantula DA, Crowell CR. Matching and behavioral contrast in a two-option repeated investment simulation. Managerial and Decision Economics. 2016;37:294–305. [Google Scholar]
  75. Hayes SC, editor. Rule-governed behavior: cognition, contingencies, and instructional control. Reno, NV: Context Press; 1989. [Google Scholar]
  76. Hayes SC. Acceptance and commitment therapy, relational frame theory, and the third wave of behavioral and cognitive therapies. Behavior Therapy. 2004;35:639–665. doi: 10.1016/j.beth.2016.11.006. [DOI] [PubMed] [Google Scholar]
  77. Hayes SC, Barnes-Holmes D, Roche B. Relational frame theory: a post-Skinnerian account of human language and cognition. New York, NY: Kluwer Academic/Plenum Publishers; 2001. [DOI] [PubMed] [Google Scholar]
  78. Hayes SC, Brownstein AJ, Zettle RD, Rosenfarb I, Korn Z. Rule-governed behavior and sensitivity to changing consequences of responding. Journal of the Experimental Analysis of Behavior. 1986;45:237–256. doi: 10.1901/jeab.1986.45-237. [DOI] [PMC free article] [PubMed] [Google Scholar]
  79. Hayes SC, Rosenfarb I, Wulfert E, Munt ED, Korn Z, Zettle RD. Self-reinforcement effects: an artifact of social standard setting? Journal of Applied Behavior Analysis. 1985;18:201–214. doi: 10.1901/jaba.1985.18-201. [DOI] [PMC free article] [PubMed] [Google Scholar]
  80. Hayes, S. C., & Sanford, B. T. (2014). Cooperation came first: Evolution and human cognition. Journal of the Experimental Analysis of Behavior, 101, 112–129. 10.1002/jeab.64. [DOI] [PubMed]
  81. Hayes, s.c., & smith. (2005). Get of your mind and into your life: The new acceptance and commitment therapy. Oakland, CA: New Harbinger.
  82. Hayes SC, Strosahl K, Wilson KG. Acceptance and commitment therapy: an experiential approach to behavior change. New York, NY: Guilford Press; 1999. [Google Scholar]
  83. Hayes LJ, Tilley KJ, Hayes SC. Extending equivalence class membership to gustatory stimuli. The Psychological Record. 1988;38:473–482. [Google Scholar]
  84. Hayes SC, Zettle RD, Rosenfarb I. Rule-following. In: Hayes SC, editor. Rule-governed behavior: cognition, contingencies, and instructional control. Reno, NV: Context Press; 1989. pp. 191–220. [Google Scholar]
  85. Healy O, Barnes-Holmes D, Smeets PM. Derived relational responding as generalized operant behavior. Journal of the Experimental Analysis of Behavior. 2000;74:207–227. doi: 10.1901/jeab.2000.74-207. [DOI] [PMC free article] [PubMed] [Google Scholar]
  86. Hooper N, Erdogan A, Keen G, Lawton K, McHugh L. Perspective taking reduces the fundamental attribution error. Journal of Contextual Behavioral Science. 2015;4:69–72. [Google Scholar]
  87. Hoover JJ, Patton JR. The role of special educators in a multitiered instructional system. Intervention in School and Clinic. 2008;43:195–202. [Google Scholar]
  88. Hörig H, Marincola E, Marincola FM. Obstacles and opportunities in translational research. Nature Medicine. 2005;11:705–708. doi: 10.1038/nm0705-705. [DOI] [PubMed] [Google Scholar]
  89. Homer RH, Sugai G, Todd AW, Lewis-Palmer T. School-wide positive behavior support. In: Bambara L, Kern L, editors. Individualized supports for students with problem behaviors: designing positive behavior plans. New York: Guilford Press; 2005. pp. 359–390. [Google Scholar]
  90. Keintz KS, Miguel CF, Kao B, Finn HE. Using conditional discrimination training to produce emergent relations between coins and their values in children with autism. Journal of Applied Behavior Analysis. 2011;44:909–913. doi: 10.1901/jaba.2011.44-909. [DOI] [PMC free article] [PubMed] [Google Scholar]
  91. Kellam, S. G., & Anthony, J. C. (1998). Targeting early antecedents to prevent tobacco smoking: findings from an epidemiologically based randomized field trial. American Journal of Public Health, 88, 1490–1495. [DOI] [PMC free article] [PubMed]
  92. Kellam, S. G., Wang, W., Mackenzie, A. C., Brown, C. H., Ompad, D. C., ... & Windham, A. (2014). The impact of the Good Behavior Game, a universal classroom-based preventive intervention in first and second grades, on high-risk sexual behaviors and drug abuse and dependence disorders into young adulthood. Prevention Science, 15, 6–18. 10.1007/s11121-012-0296-z. [DOI] [PMC free article] [PubMed]
  93. Khandker SR, Koolwal GB, Samad HA. Handbook on impact evaluation: quantitative methods and practices. Washington, DC: The World Bank; 2010. [Google Scholar]
  94. Kyonka, E.G.E. & Subramaniam, S. (in press). Translating behavior analysis: a spectrum rather than a roadmap. Perspectives on Behavior Science. [DOI] [PMC free article] [PubMed]
  95. Lane SD, Clow JK, Innis A, Critchfield TS. Generalization of cross-modal stimulus equivalence classes: operant processes as components in human category formation. Journal of the Experimental Analysis of Behavior. 1998;70:267–279. doi: 10.1901/jeab.1998.70-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  96. LeBlanc LA, Miguel CF, Cummings AR, Goldsmith TR, Carr JE. The effects of three stimulus-equivalence testing conditions on emergent US geography relations of children diagnosed with autism. Behavioral Interventions. 2003;18:279–289. [Google Scholar]
  97. Lich KH, Ginexi EM, Osgood ND, Mabry PL. A call to address complexity in prevention science research. Prevention Science. 2013;14:279–289. doi: 10.1007/s11121-012-0285-2. [DOI] [PubMed] [Google Scholar]
  98. Lillis J, Hayes SC, Bunting K, Masuda A. Teaching acceptance and mindfulness to improve the lives of the obese: a preliminary test of a theoretical model. Annals of Behavioral Medicine. 2009;37(1):58–69. doi: 10.1007/s12160-009-9083-x. [DOI] [PubMed] [Google Scholar]
  99. Luoma, J. B., Hayes, S. C., & Walser, R. D. (2007). Learning ACT: An acceptance & commitment therapy skills-training manual for therapists. Oakland, CA: New Harbinger.
  100. Lynch DC, Cuvo AJ. Stimulus equivalence instruction of fraction-decimal relations. Journal of Applied Behavior Analysis. 1995;28:115–126. doi: 10.1901/jaba.1995.28-115. [DOI] [PMC free article] [PubMed] [Google Scholar]
  101. Mace FC, Critchfield TS. Translational research in behavior analysis: historical traditions and imperative for the future. Journal of the Experimental Analysis of Behavior. 2010;93:293–312. doi: 10.1901/jeab.2010.93-293. [DOI] [PMC free article] [PubMed] [Google Scholar]
  102. Malott RW. A theory of rule-governed behavior and organizational behavior management. Journal of Organizational Behavior Management. 1993;12:45–65. [Google Scholar]
  103. Marchand E, Stice E, Rohde P, Becker CB. Moving from efficacy to effectiveness trials in prevention research. Behaviour Research and Therapy. 2011;49:32–41. doi: 10.1016/j.brat.2010.10.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  104. Markham MR, Dougher MJ. Compound stimuli in emergent stimulus relations: extending the scope of stimulus equivalence. Journal of the Experimental Analysis of Behavior. 1993;60:529–542. doi: 10.1901/jeab.1993.60-529. [DOI] [PMC free article] [PubMed] [Google Scholar]
  105. Marr MJ. The future of behavior analysis: foxes and hedgehogs revisited. The Behavior Analyst. 2017;40:197–207. doi: 10.1007/s40614-017-0107-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  106. Matthews BA, Shimoff E, Catania AC, Sagvolten T. Uninstructed human responding: sensitivity to ratio and interval contingencies. Journal of the Experimental Analysis of Behavior. 1977;27:453–467. doi: 10.1901/jeab.1977.27-453. [DOI] [PMC free article] [PubMed] [Google Scholar]
  107. Mayer, G. R., Sulzer-Azaroff, B., & Wallace, M. (2013) Behavior analysis for lasting change (3rded.). Cambridge, MA: The Cambridge Center – Sloan Century Series in Behavior Analysis.
  108. McEnteggart, C. (in press). A tutorial on the connection between the study of derived stimulus relations and acceptance and commitment therapy. Perspectives on Behavior Science. [DOI] [PMC free article] [PubMed]
  109. McKeel, A. N., Dixon, M. R., Daar, J. H., Rowsey, K. E., & Szekely, S. (2015). Evaluating the efficacy of the PEAK relational training system using a randomized controlled trial of children with autism. Journal of Behavioral Education, 24, 230–241. 10.1007/s10864-015-9219-y.
  110. Miguel CF, Yang HG, Finn HE, Ahearn WH. Establishing derived textual control in activity schedules with children with autism. Journal of Applied Behavior Analysis. 2009;42:703–709. doi: 10.1901/jaba.2009.42-703. [DOI] [PMC free article] [PubMed] [Google Scholar]
  111. Miller GA. The cognitive revolution: a historical perspective. Trends in Cognitive Sciences. 2003;7:141–144. doi: 10.1016/s1364-6613(03)00029-9. [DOI] [PubMed] [Google Scholar]
  112. Murphy C, Barnes-Holmes D, Barnes-Holmes Y. Derived manding in children with autism: synthesizing Skinner’s verbal behavior with relational frame theory. Journal of Applied Behavior Analysis. 2005;38:445–462. doi: 10.1901/jaba.2005.97-04. [DOI] [PMC free article] [PubMed] [Google Scholar]
  113. O’Donohue W, Ferguson KE, Naugle AE. The structure of the cognitive revolution: an examination from the philosophy of science. The Behavior Analyst. 2003;26:85–110. doi: 10.1007/BF03392069. [DOI] [PMC free article] [PubMed] [Google Scholar]
  114. Palmer DC. Data in search of a principle: a review of relational frame theory: a post-Skinnerian account of human language and cognition. Journal of the Experimental Analysis of Behavior. 2004;81:189–204. doi: 10.1901/jeab.2004.81-189. [DOI] [PMC free article] [PubMed] [Google Scholar]
  115. Pepperberg IM. Functional vocalizations by an African Grey parrot (Psittacus erithacus) Ethology. 1981;55:139–160. [Google Scholar]
  116. Poduska JM, Kellam SG, Wang W, Brown CH, Ialongo NS, Toyinbo P. Impact of the good behavior game, a universal classroom-based behavior intervention, on young adult service use for problems with emotions, behavior, or drugs or alcohol. Drug and Alcohol Dependence. 2008;95:S29–S44. doi: 10.1016/j.drugalcdep.2007.10.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  117. Powers MB, Vörding MBZVS, Emmelkamp PM. Acceptance and commitment therapy: a meta-analytic review. Psychotherapy and Psychosomatics. 2009;78:73–80. doi: 10.1159/000190790. [DOI] [PubMed] [Google Scholar]
  118. Rehfeldt RA. Toward a technology of derived stimulus relations: an analysis of articles published in the Journal of Applied Behavior Analysis, 1992–2009. Journal of Applied Behavior Analysis. 2011;44:109–119. doi: 10.1901/jaba.2011.44-109. [DOI] [PMC free article] [PubMed] [Google Scholar]
  119. Rehfeldt RA, Jung HL, Aguirre A, Nichols JL, Root WB. Beginning the dialogue on the e-transformation: behavior analysis’ first massive open online course (MOOC) Behavior Analysis in Practice. 2016;9:3–13. doi: 10.1007/s40617-015-0102-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  120. Rehfeldt RA, Dixon MR. Evaluating the establishment and maintenance of visual-visual and gustatory-visual equivalence relations in adults with developmental disabilities. Behavior Modification. 2005;29:696–707. doi: 10.1177/0145445503261048. [DOI] [PubMed] [Google Scholar]
  121. Root, W. B., Rehfeldt, R. A., and Castro, M. (under review). Online equivalence based instruction: revitalizing the teaching machine.
  122. Rosenfarb I, Hayes SC. Social standard setting: the Achilles heel of informational accounts of therapeutic change. Behavior Therapy. 1984;15:515–528. [Google Scholar]
  123. Ruiz FJ, Luciano C. Cross-domain analogies as relating derived relations among two separate relational networks. Journal of the Experimental Analysis of Behavior. 2011;95:369–385. doi: 10.1901/jeab.2011.95-369. [DOI] [PMC free article] [PubMed] [Google Scholar]
  124. Saunders RR, Saunders KJ, Kirby KC, Spradlin JE. The merger and development of equivalence classes by unreinforced conditional selection of comparison stimuli. Journal of the Experimental Analysis of Behavior. 1988;50:145–162. doi: 10.1901/jeab.1988.50-145. [DOI] [PMC free article] [PubMed] [Google Scholar]
  125. Saunders RR, Wachter J, Spradlin JE. Establishing auditory stimulus control over an eight-member equivalence class via conditional discrimination procedures. Journal of the Experimental Analysis of Behavior. 1988;49:95–115. doi: 10.1901/jeab.1988.49-95. [DOI] [PMC free article] [PubMed] [Google Scholar]
  126. Schlund MW, Cataldo MF, Hoehn-Saric R. Neural correlates of derived relational responding on tests of stimulus equivalence. Behavioral and Brain Functions. 2008;4:1–8. doi: 10.1186/1744-9081-4-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  127. Shimoff E, Catania AC, Matthews BA. Uninstructed human responding: sensitivity of low-rate performance to schedule contingencies. Journal of the Experimental Analysis of Behavior. 1981;36:207–220. doi: 10.1901/jeab.1981.36-207. [DOI] [PMC free article] [PubMed] [Google Scholar]
  128. Sidman M. Reading and auditory-visual equivalences. Journal of Speech and Hearing Research. 1971;14:5–13. doi: 10.1044/jshr.1401.05. [DOI] [PubMed] [Google Scholar]
  129. Sidman, M. (1986). Functional analysis of emergent verbal classes. In T. Thompson & M. D. Zeiler (Eds.), Analysis and integration of behavioral units (pp. 213245). Hillsdale, NJ: Erlbaum.
  130. Sidman M. Equivalence relations: a research story. Boston: Authors Cooperative; 1994. [Google Scholar]
  131. Sidman M, Kirk B, Willson-Morris M. Six-member stimulus classes generated by conditional discrimination procedures. Journal of the Experimental Analysis of Behavior. 1985;43:21–42. doi: 10.1901/jeab.1985.43-21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  132. Sidman M, Tailby W. Conditional discrimination vs. matching to sample: an expansion of the testing paradigm. Journal of the Experimental Analysis of Behavior. 1982;37:5–22. doi: 10.1901/jeab.1982.37-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  133. Sidman M, Willson-Morris M, Kirk B. Matching-to-sample procedures and the development of equivalence relations: the role of naming. Analysis and Intervention in Developmental Disabilities. 1986;6:1–19. [Google Scholar]
  134. Skinner, B. F. (1953). Science and human behavior. New York, NY: Simon & Schuster.
  135. Skinner BF. Verbal behavior. New York, NY: Appleton-Century Crofts; 1957. [Google Scholar]
  136. Skinner BF. Contingencies of reinforcement: a theoretical analysis. New York, NY: Appleton-Century Crofts; 1969. [Google Scholar]
  137. Skinner, B. F. (1977). Why I am not a cognitive psychologist. Behaviorism, 5, 1–10.
  138. Skinner, B. F. (1987). Why we are not acting to save the world. In B. F Skinner (Ed.) Upon further reflection (pp. 1–14). Upper Saddle River, NJ: Prentice Hall PTR.
  139. Slattery B, Stewart I, O'Hora D. Testing for transitive class containment as a feature of hierarchical classification. Journal of the Experimental Analysis of Behavior. 2011;96:243–260. doi: 10.1901/jeab.2011.96-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  140. Solomon BG, Klein SA, Hintze JM, Cressey JM, Peller SL. A meta-analysis of school-wide positive behavior support: an exploratory study using single-case synthesis. Psychology in the Schools. 2012;49:105–121. [Google Scholar]
  141. Spencer TJ, Chase PN. Speed analyses of stimulus equivalence. Journal of the Experimental Analysis of Behavior. 1996;65:643–659. doi: 10.1901/jeab.1996.65-643. [DOI] [PMC free article] [PubMed] [Google Scholar]
  142. Sperry RW. The impact and promise of the cognitive revolution. American Psychologist. 1993;48:878–885. [Google Scholar]
  143. Stewart I, Barnes-Holmes D, Roche B, Smeets PM. A functional-analytic model of analogy: a relational frame analysis. Journal of the Experimental Analysis of Behavior. 2002;78:375–396. doi: 10.1901/jeab.2002.78-375. [DOI] [PMC free article] [PubMed] [Google Scholar]
  144. Sugai G, Horner RR. A promising approach for expanding and sustaining school-wide positive behavior support. School Psychology Review. 2006;35:245–259. [Google Scholar]
  145. Tashiro T, Mortensen L. Translational research: how social psychology can improve psychotherapy. American Psychologist. 2006;61:959–966. doi: 10.1037/0003-066X.61.9.959. [DOI] [PubMed] [Google Scholar]
  146. Tonneau F. Equivalence relations: a critical analysis. European Journal of Behavior Analysis. 2001;2:1–33. [Google Scholar]
  147. Tonneau F, González C. Function transfer in human operant experiments: the role of stimulus pairings. Journal of the Experimental Analysis of Behavior. 2004;81:239–255. doi: 10.1901/jeab.2004.81-239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  148. Törneke N (2010). Learning RFT. An introduction to relational frame theory and its clinical implications. Oakland, CA: New Harbinger.
  149. Vilardaga R, Hayes SC, Levin ME, Muto T. Creating a strategy for progress: a contextual behavioral science approach. The Behavior Analyst. 2009;32:105–133. doi: 10.1007/BF03392178. [DOI] [PMC free article] [PubMed] [Google Scholar]
  150. Vollmer TR. Three variations of translational research: comments on Critchfield (2011) The Behavior Analyst. 2011;34:31–35. doi: 10.1007/BF03392231. [DOI] [PMC free article] [PubMed] [Google Scholar]
  151. Walker BD, Rehfeldt RA. An evaluation of the stimulus equivalence paradigm to teach single-subject design to distance education students via blackboard. Journal of Applied Behavior Analysis. 2012;45:329–344. doi: 10.1901/jaba.2012.45-329. [DOI] [PMC free article] [PubMed] [Google Scholar]
  152. Walser RD, Hayes SC. Acceptance and commitment therapy in the treatment of posttraumatic stress disorder. Cognitive-behavioral therapies for trauma. 2006;2:146–172. [Google Scholar]
  153. Whelan R, Barnes-Holmes D. The transformation of consequential functions in accordance with the relational frames of same and opposite. Journal of the Experimental Analysis of Behavior. 2004;82:177–195. doi: 10.1901/jeab.2004.82-177. [DOI] [PMC free article] [PubMed] [Google Scholar]
  154. White H. Theory-based impact evaluation: principles and practice. Journal of Development Effectiveness. 2009;1:271–284. [Google Scholar]
  155. Zettle RD. Rule-governed behavior: a radical behavioral answer to the cognitive challenge. The Psychological Record. 1990;40:41–49. [Google Scholar]
  156. Zettle RD, Hayes SC. Rule-governed behavior: a potential theoretical framework for cognitive-behavioral research and therapy. In: Kendall PC, editor. Advances in cognitive behavioral research and therapy. New York, NY: Academic Press; 1982. pp. 73–118. [Google Scholar]

Articles from Perspectives on Behavior Science are provided here courtesy of Association for Behavior Analysis International

RESOURCES