Abstract
Behavior analysis has a marketing problem. Although behavior analysts have speculated about the problems regarding our technical behavior-analytic terminology and how our terminology has hindered the dissemination of behavior analysis to outsiders, few have investigated the social acceptability of the terminology. The present paper reports the general public’s reactions to technical behavioral jargon versus non-technical substitute terms that refer to applied behavior-analytic techniques. Two-hundred participants, all non-behavior analysts, were recruited from Amazon Mechanical Turk and completed a survey on the social acceptability of behavioral jargon and non-technical terms. Specifically, participants rated the acceptability of how the six pairs of terms (technical and non-technical) sounded if the treatments were to be implemented for each of 10 potential populations of clients that behavior analysts typically work with. The results show that, overall, members of the general public found non-technical substitute terms more acceptable than technical behavior-analytic terms. The finding suggests that specialized vocabulary of behavior analysis may create hurdles to the acceptability of applied behavior-analytic services. The implication of these findings suggest the importance of a systematic investigation of listener behavior with respect to behavior analysis terms.
Keywords: Amazon mechanical turk, Behavior analysis, Dissemination, Jargon, Terminology, Public perception, Social acceptability
Whatever words we utter should be chosen with care for people will hear them and be influenced by them for good or ill. ∼Buddha
By many accounts, behavior analysis has a marketing problem (Doughty, Holloway, Shields, and Kennedy 2012; Freedman 2015; Smith 2015). Despite all of the good that behavior analysts accomplish in research and practice, their contributions remain relatively unappreciated by the general public compared to those of mainstream psychology. Normand, (2014) has suggested that the marketing problem stems in part from a deliberate effort by behavior analysts to distance themselves from the practices of laypersons and mainstream psychologists: “We redefined the subject matter of psychology and redesigned the experiments used to study that subject matter. We renamed almost every part of the world pertaining to that subject matter. We created our own organizations and our own journals.” (p. 67).
Skinner e.g., (1953, 1974) of course, was an early champion of this distancing, suggesting even prior to his formal training in psychology that the discipline required a makeover (see Skinner 1975), and frequently pointed to lay language as inaccurately characterizing the control of behavior. The point of distancing, therefore, was to avoid repeating sins of the past and thereby develop better ways of understanding and controlling behavior—and the many accomplishments of behavior analysis stand in testament to the importance of this effort.
In recent years concerns have been raised about a potential undesirable side effect of distancing. The specific worry is that interacting mainly with like-minded individuals has left behavior analysts unproductively isolated (Friman 2014a; Madden 2013; Morris 2014; Pietras, Reilly, and Jacobs 2013; Podlesnik 2013; Reed 2014; Schlinger 2014; St. Peter 2013; Vyse 2013, 2014), both topically (by addressing too few of the problems that concern the broader population) and linguistically (by discussing important problems with language that fails to inspire, inform, or motivate non-behavior analysts). The present report focuses on the latter concern, which Hineline, (1990) neatly summarized when he remarked that, “Perhaps the resistance to behavioral interpretations and techniques arises from our forbidding terms, from the misunderstood language of control, or from our eschewal of mentalistic phrasing.”
A critical property of verbal behavior is its influence on the listener. Although in Verbal Behavior, Skinner, (1957) focused primarily on composition (i.e., dynamics of speaker behavior), never far from the surface was a concern for audience effects. Consistent with this influence, over the years, many behavior analysts have commented on the importance of communicating effectively (e.g., Bailey 1991; Foxx 1996; Morris 1985) and in some cases have attempted to translate the technical jargon of behavior analysis for a general audience (see Lindsley 1991). Unfortunately, however, it appears that few behavior analysts have succeeded in the translation (e.g., see Friman 2014b). Even Skinner experienced difficulties disseminating the science of behavior1 to non-behaviorists (e.g., note the sometimes blistering reactions to Verbal Behavior [1957] and Beyond Freedom and Dignity [1971]; e.g., MacCorquodale 1970).
Ogden Lindsley (1991), who appreciated the marketing problem long before it was popular to discuss, registered two objections to the technical jargon of behavior analysis. The first problem is that “some jargon, like ‘negative reinforcement’ and ‘radical behaviorism,’ imply [sic] to most people the exact opposite of their technical meaning” (p. 449). This, Lindsley believed, results in people acting ineffectively when attempting to measure or change behavior. The second problem is that, “Skinner… never checked what his technical words meant to most people. It was left for those of us who applied his free operant principles and methods to struggle with abrasive jargon like ‘manipulate,’ ‘control,’ ‘subject,’ and ‘intervene,’ which turned users away” (p. 449). The second problem, we submit, is more general and pernicious than the first, because no one is likely to attempt to intervene using behavior-analytic approaches if the very language of behavior analysis makes those approaches seem objectionable.
Maurice (1993) colorfully describes this very phenomenon as part of her account of a lengthy search for services for her daughter. Her initial reaction to behavior-analytic services was to regard them as “harsh” (p. 102), “unnatural” (p. 88), and as a “usurpation… of will” (p. 89). Compare this initial trepidation to Maurice’s more positive reaction to the purveyor of an alternative therapy:
Charming, charismatic, Dr. Welch was full of hugs and gentle spontaneous caresses. Without shyness or reserve, she would reach out and stroke my hair, or clasp my hand in hers.... “What a beautiful mommy Anne-Marie has,” she murmured, smiling into my eyes, holding my gaze. And then, with a look of sadness, “What a terrible, terrible time this has been for you.” …How caring she was, how natural, unaffected, how unbelievably concerned (p. 94).
One moral of Maurice’s (1993) story concerns the amount of time that was wasted on ineffective approaches that seemed attractive based on the persuasive ways in which they were marketed. In particular, Maurice’s fascination with Dr. Welch delayed her embrace of behavior-analytic services. The lesson for applied behavior analysts should be clear: In the marketplace of human services, anything that makes them seem less warm and approachable—including the use of presumably unpleasant technical terms—might put them at a disadvantage compared to other kinds of service providers.
We do not suggest that behavior analysts have been completely oblivious to the marketability problem. A number of studies have examined consumer reactions to specific interventions, either after they were completed (e.g., Minkin et al. 1976; Wolf 1978) or as they were described prospectively to potential adopters (e.g., Kazdin 1980; Witt and Martens 1983; Witt, Martens, and Elliott 1984). But this is quite different from examining how the words of behavior analysis register with listeners. In most previous studies, behavioral jargon was intermingled with contextual information that also might influence responding. For instance, Witt et al., (1984) described factors for potential interventions such as how long they would require to implement, and in traditional social validity assessment, the consumer has already experienced the benefits of an intervention.
As part of a general quest to understand the scope and magnitude of the marketability problem, we advocate a program of research that will empirically evaluate the general reactions of non-behavior-analysts to behavior-analytic terms (and, consistent with Lindsley’s early marketing efforts, substitute terms that might be more acceptable). To illustrate the approach, we surveyed members of the general population using the popular crowdsourcing platform Amazon Mechanical Turk (mTurk; see Buhrmester, Kwang, and Gosling 2011; Mason and Suri 2012; Paolacci and Chandler 2014; Rand 2012), which is an online labor market comprised of “workers” whose demographic variability is far more representative of U.S. national diversity than the samples of typical university-based research studies (Paolacci and Chandler 2014).2 These workers can complete brief tasks for financial remuneration (including academic surveys), and at any given time, over 500,000 workers may be online. The purpose of this investigation was to use a sample of mTurk workers to estimate the general public’s reactions to technical versus non-technical terms that refer to applied behavior-analytic techniques.
Method
Participants
Participants were recruited from mTurk and completed the survey as what the mTurk system refers to as a Human Intelligence Task (HIT). The survey was accessible only to those mTurk workers in the USA who had completed at least 100 approved HITs and for whom previous requesters had designated 95 % or more of their previous HITs as reflecting acceptable quality of work. Workers were paid $0.30 if, within 20 min of accessing the survey, they completed it and submitted a unique completion code. On average, workers took 8.32 min (SD = 3.60 min) to do this. Workers who submitted the survey according to these dictates qualified as participants.
We received data from 204 participants; of the 204, 4 incomplete datasets were removed. All remaining datasets were considered complete and systematic. Among the 200 participants (M age = 37.72, SD age = 12.8 years), 50.5 % were male (n = 101) and 80 % self-identified as Caucasian, with remaining individuals self-identifying as African American (8.5 %), Asian/Asian American (7.0 %), Hispanic/Latino (3.5 %), and Native Hawaiian or Other Pacific Islander, and Other (∼1.0 % combined). Highest completed level of education consisted of high school/GED (10.0 %), some college (24.5 %), 2-year college degree (8.5 %), 4-year college degree (38.5 %), Master’s degree (14.0 %), professional degree (2.5 %), and doctoral degree (2.0 %); 71.5 % reported being employed, 22.5 % unemployed, and 6.0 % retired. Median total income during the past year was $40,000 to $44,999 (range under $5,000 to $100,000). Of the participants, most (87.0 %) reported being unfamiliar with the field of behavior analysis. One individual reported having a family member who is a Board Certified Behavior Analyst. None of the participants reported having used behavior-analytic services in the past.
Materials and Procedure
The survey was administered via a survey link which directed participants to a survey presented using Qualtrics Online Survey Software (http://www.qualtrics.com/). The survey contained general demographic questions (e.g., gender, age, ethnicity), and six pairs of terms (six technical behavior-analytic terms and six non-technical substitutes). The six technical behavior-analytic terms (non-technical substitute in parentheses) included: escape extinction (follow-through training), negative reinforcement (relieving consequences), negative punishment (penalty), chaining (teaching a sequence of responses), operant conditioning (learning from consequences), and reinforcement (incentivizing). The inspiration for the specific word pairs came from Lindsley’s, (1991) translations from technical jargon to plain English, although modifications were made to reflect contemporary usage of the terms.
Each of the 12 terms was presented with the following instruction:
Assume that a behavior analyst has conducted an appropriate battery of behavioral assessments and has recommended a treatment for a socially important behavior/performance issue. How acceptable does the recommended treatment sound for each population of treatment clients?
A specific treatment was presented in large, boldface letters (e.g., “Recommended treatment: Escape Extinction”), followed by 10 visual analog scales (VAS), each representing a type of population with which a behavior analyst might work: infants/toddlers, preschool children, children with special needs, elementary-aged students, high school students, college students, athletes, employees, adults with special needs, and senior citizens. Each VAS consisted of a 100-mm horizontal line with ends labeled as “Completely Unacceptable” and “Completely Acceptable.” On each line, a slider could be moved with the mouse to any location on this scale.
Results
Analyses focused on comparing ratings given to a technical term and its non-technical substitute. For economy of expression, we will refer to these comparisons as participant preferences (although, technically speaking, participants did not select between terms, but instead rated them separately). Because the D’Agostino-Pearson omnibus normality test indicated that VAS responses were not normally distributed, workers’ responses to the behavior analysis and substitute term in each pair were compared using the two-tailed Wilcoxon matched-pairs signed rank test. All rating differences were statistically significant except for those labeled as “NS” (non-significant) in Fig. 1.
Figure 1 shows the mean participant ratings for each term for each of the 10 populations of clients. Substitute terms were reliably rated as more acceptable than technical terms for all 10 populations for five out of the six pairs of terms. The behavior-analytic term “reinforcement” as rated more favorably than the substitute, “incentivizing” for every category of client except “employees” and “college students,” though in all of the instances the mean difference was of modest magnitude.
Discussion
Overall, members of the general public who were not behavior analysts found non-technical substitute terms, based on those suggested by Lindsley, (1991), to be more acceptable than technical behavior-analytic terms. There are many ways to construct survey items, and item construction can influence survey responding (e.g., Couper, Traugott, and Lamias 2001; Moser and Kalton 1971), so we extrapolate from these results only cautiously and while acknowledging a need for additional studies to evaluate the generality of the effects. For now, it may be observed that the effects are consistent with the suggestion that behavior analysis has a marketing problem (Doughty et al. 2012; Freedman 2015; Smith 2015), and these effects suggest that the specialized vocabulary of behavior analysis may create hurdles to the acceptability of applied behavior-analytic services.
Unaddressed in our survey is exactly why members of the general public found behavior-analytic terms to be problematic. One possibility is simply that technical terms are unfamiliar. A sizeable literature on dissemination indicates that innovations are most likely to be adopted when they are compatible with existing cultural practices (e.g., Rogers 2003), especially considering that communication largely dominates cultural practices (e.g., Aune, Hunter, Kim, and Kim 2001; Infante and Rancer 1996).3 It follows that people who “talk funny” are unlikely to be well-regarded (e.g., Wright and Bougie 2007). A more specific possible interpretation of our results was communicated by one participant who spontaneously wrote to us that, “Some of the behavior approaches sounded cruel, even medieval.” This reaction is consistent with Lindsley’s, (1991) observation that, in his experience, non-behavior analysts find technical terms to be “abrasive” (p. 449); with Maurice’s, (1993) observation that consumers may initially view behavioral interventions as “harsh” (p. 102); and with the view, sometimes propagated by non-behavior-analytic professionals, that behavioral interventions are psychologically damaging (Maurice 1993; see also Kohn 1993).
To paraphrase Skinner, (1957, 1977), the listener is always right, or, as Lindsley, (1991) observed: “You should select words for their impact on the listener, not on the speaker” (p. 449). Although Lindsley claimed to have developed non-technical substitute terms by vetting them with non-specialists, he presented no data to support his proposition that such people respond more positively to the substitute terms than their technical equivalents. Similarly, contextual behavioral psychologists have argued for the use of middle level functional terms that “serve as shortcuts for applying basic principles and theories to complex situations” (Villardaga et al. 2009, p. 115), but we have not seen any data validating their superiority over technical terms. The present findings might be largely predictable, but that does not diminish their standing as an empirical demonstration of an effect that numerous observers have thought to be important to the dissemination and societal support of behavior analysis.
Although behavior analysts have speculated about the linguistic basis of their marketability problem more often than they have examined it empirically, the present findings do have some precedent in the literature. Witt, Moe, Gutkin, and Andrews (1984) found that classroom teachers responded more negatively to interventions that were described using behavioral terms (e.g., time out) versus everyday language (having a quiet time). Interestingly, acceptability of behaviorally described interventions declined as a function of years of teaching experience, suggesting that the more entrenched an alternative vocabulary, the more objectionable behavior-analytic language will be (Witt, Martens, et al. 1984. More generally, it appears that people respond negatively to jargon, behavioral or otherwise, in part because it promotes awkward phrasing and tends to lack human-interest narrative features (Klare, Mabry, and Gustafson 1955a, 1955b). For example, Witt, Moe, et al. (1984) found that, like behavior-analytic jargon, humanistic psychology jargon also contributed to negative evaluation of some interventions.
Behavior analysts might take some comfort in the fact that one of the six targeted technical terms in our survey, “reinforcement,” was not reliably judged as less acceptable than a possible substitute term, “incentivizing.” One interpretation of this finding is that “reinforcement,” complete with relatively accurate connotations, has made its way into the lay vocabulary, thereby representing a rare success in the quest to behavioralize the culture. It is equally possible, of course, that “reinforcement” was deemed acceptable precisely because the term is widely misunderstood (e.g., people sometimes use it to mean “being nice” in a non-contingent fashion). Our survey was not intended to parse precisely what the target terms meant to participants, but of course that could be a productive focus of future studies.
Close inspection of Fig. 1 shows that, in a majority of cases (41 out of 60 instances) across the six pairs of terms, the absolute mean ratings of behavioral terms were in the negative range of the “Completely Unacceptable” to “Complete Acceptable” rating scale. This is noteworthy in light of research documenting a general positivity bias in language, that is, a tendency for people to use words with pleasant connotations more often than words with unpleasant connotations (Dodds et al. 2015; Kloumann, Danforth, Harris, Bliss, and Dodds 2012). If, as the present modest survey may suggest, behavioral terms tend to be regarded as unpleasant, one wonders about the effects on listeners when behavior analysts use the terms. It is reasonable to suggest that consumers may seek out professionals whose behavior they find to be pleasant, and avoid those whose behavior they find to be unpleasant.
Of course, the adverse effects of poorly chosen language are not limited to consumers of therapy services. College students, for instance, typically enter a first behavior analysis course with little to no understanding of behavioral principles and interventions, and as Lindsley, (1991) pointed out they may decide whether to pursue further study of behavior analysis partly based on the quality of their experience in the course. Because students emerge from the general population, they are likely to regard jargon with the same disfavor as our participants, and therefore a too-early, too-intense immersion in technical vocabulary may contribute to an unfavorable experience. As Lindsley argued, there is a need for substitute terms that bring novice’s behavior under control of the functional relations of behavior without being off-putting.
Also noteworthy is the demand on behavior analysts who work in multidisciplinary settings to maintain good relations with other kinds of professionals. As Friman (2014b) has described, unfortunately, few behavior analysts appear to have developed sophisticated repertoires for recruiting non-behavior analysts into productive collaboration (see also Hearst 1967). A colorful example of this problem was offered by Berger, (1973), who observed that:
When the behaviorists … begin to discuss conjunctive schedules and respondent discrimination, the social workers turn pale and begin to leave the room… The avoidance behavior of the social worker is understandable. Nowhere in the archives of psychology is there more esoteric nomenclature and mathematical formulation than in the behaviorist’s repertoire (p. 106).
It is reasonable to suggest that productive collaboration requires conversation, a core prerequisite of which would seem to be reliance on mutually acceptable and understandable terms.
The most obvious implication of the present study is to suggest the importance of a systematic investigation of listener behavior with respect to behavior analysis terms. Knowing the ways in which various listeners respond to various terms—as a matter of empirical demonstration rather than speculation—provides a basis for deciding which existing terms to retain, and which to supplement, for which purposes. For example, according to one interpretation, our results are consistent with the assumption that “reinforcement” is adequate for use with laypersons, but “escape extinction” and “chaining” probably are not. The results might, however, be different with other kinds of respondents (e.g., speech-language therapists who have been exposed to behavioral concepts and technology). Empirical approaches also are recommended for determining which specific substitute terms to embrace.
Some behavior analysts may regard the methodology that we employed with suspicion due to the dismissal of verbal-report methods by Skinner, (1953) and by some pioneering applied behavior analysts. As Baer, Wolf, and Risley (1968) observed, in most analyses of a person’s behavior, “the relevant question is not what he can say, but what he can do” (p. 93). When the topic of interest is verbal behavior, however, what a person can say is one important thing that the person can do, and there is plenty of precedent for assuming that that what people say about intervention acceptability correlates with their practical responses (e.g., Kazdin 1980; Rapucci and Saunders 1974; Witt and Martens 1983; Wolf 1978; for a more general discussion of the potential utility of verbal-report methods, see Critchfield and Epting 1998; Critchfield, Tucker, and Vuchinich 1998). We suggest, therefore, that survey responses can provide a valuable preliminary glimpse into the impact that behavioral jargon has on the behavior of non-behavior analysts.
Consider the example from Rolider, Axelrod, and Van Houten (1998) who surveyed behavior analysts and non-behavior analysts about their perceived understanding of behavior-analytic procedures, the extent to which they deemed the procedure as legitimate and compassionate, and the extent to which the hypothetical client was viewed as a participant in the treatment. Their results suggest that the heavy use of technical jargon decreased the non-behavior analysts’ understanding of the behavioral procedures and evoked unfavorable emotional reactions (Rolider et al. 1998). Of course, a thoroughgoing program of research on jargon and its substitutes will include non-survey methods that examine what people actually do after encountering behavioral jargon (e.g., whether consumers accept or reject a given type of intervention; and whether or not non-experts are led to they effectively pinpoint, measure, and intervene to change behavior).
Notwithstanding the nature of the verbal-report method employed in this study, some limitations remain, particularly regarding the representativeness of respondents obtained from mTurk and the use of a relatively small number of behavior-analytic terms and lay terms. Although this is the first study to examine social acceptability of behavior-analytic terms using mTurk, a number of recent studies have employed similar crowdsourcing methods, particularly within psychology and linguistics (see Lengel and Mullins-Sweatt 2016 and Sprouse 2011, respectively). However, the skeptical reader ought to question the generality of results obtained from people completing computerized tasks (i.e., mTurkers); we remind the reader, however, to consider the benefits of using mTurk (ease of use, low cost, broad sample of the American public; see Paolacci and Chandler 2014) relative to traditional survey-based methods relying primarily on small samples of undergraduate students. Regardless, future studies should attempt to compare the acceptability of terms across various populations and settings, especially in the service field (i.e., behavior analysts working with clients). The inspiration for the specific word pairs in our study came from Lindsley’s, (1991) translations from technical jargon to plain English, although modifications were made to reflect more modern usage of the terms. We invite future studies to investigate social acceptability of other popular behavior-analytic terms and their presumed lay counterparts.
In conclusion, it may be said that the incentive for studying the impact of behavior analysis jargon on listener behavior is twofold. One thrust is to promote dissemination by identifying terms that do not create listener responses that interfere with dissemination. Lindsley, (1991) went so far as to regard this as the hallmark of a successfully disseminated science. Science promotes the development of technology, and consequently, as happened in behavior analysis, technology often inherits the language of its progenitor science. An often-overlooked next step, according Lindsley (see also Fixsen, Naoom, Blase, Friedman, and Wallace 2005; Rogers 2003), is to divorce technology from the native scientific vocabulary and embed it in a way of speaking that is consistent with the existing practices of potential adopters:
A technology has only a technical jargon, but… a profession has both a technical jargon and a set of plain English equivalents.... The development of accurate, comfortable application names may be one of the most important steps in moving from a technology to a profession. (p. 450).
In a human-services marketplace full of non-behavioral approaches, it is a reasonable bet that competitor models of service delivery have observed the need to adopt user-friendly language (e.g., see Green 1996), calling to mind Wolf’s, (1978) seminal statement about the importance of social validity in behavior analysis:
It is clear that a number of the most important concepts in our culture are subjective, perhaps even the most important. Martin Luther, as the story goes, was severely criticized for setting Protestant hymns to the popular melodies of songs and dances of the time. He replied, “Why should we let the devil have all the best tunes?” (p. 210).
A very direct means of discovering what “tunes” (terms) are most acceptable to members of the general public is to ask them.
A second reason to study the effects of jargon on listener behavior is to achieve conceptual consistency in how terminology is regarded. Rorty, (1991) cautioned against assuming that a technical scientific vocabulary accurately represents a “true reality” whereas a lay vocabulary does not. The only valid measure of vocabulary is heuristic—its effectiveness in promoting the prediction and control of behavior (Leigland 2010), one aspect of which concerns the willingness of the public to engage with behavior-analytic services. If the marketing problem in behavior analysis is real, and if inflexible allegiance to jargon is one of its origins, then to date, behavior analysts have done a poor job of applying their own functional perspective on verbal behavior to problems regarding their own societal acceptance, and new data are needed to guide a solution to this problem.
Acknowledgments
We thank Gideon Naudé and Rachel Jackson for valuable feedback on drafts of the manuscript and Ed Morris for the many insightful conversations about the importance of using language for its effect on the specific audience. We also acknowledge Patrick Friman for inspiring us to examine our own levels of jargon.
All reviews and editorial decisions for this manuscript were handled independently by Guest Associate Editor Philip N. Hineline.
Compliance with Ethical Standards
Funding
The authors used no grant funding in this study.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Conflict of Interest
The authors declare that they have no conflict of interest.
Footnotes
We use the term behavior analysis here and throughout the manuscript.
We note that behavior analysts are beginning to use mTurk for behavioral studies on choice and decision making, and are publishing such findings in behavioral journals (Bechler, Green, and Myerson 2015; Bickel et al. 2014; Jarmolowicz, Bickel, Carter, Franck, and Mueller 2012; Johnson, Herrmann, and Johnson 2015; Myerson, Baumann, and Green 2014; Roma, Hursh, and Hudja 2016).
Although it is beyond the scope of this paper to address the extent to which people, particularly those in Western cultures, understand behavioral phenomena, including verbal and social behavior, we refer interested readers to Field and Hineline (2008) for a systematic discussion on the ubiquity of dispositional causes (i.e., traditional interpretations) for complex, temporally extended behavioral phenomena; namely, the verbal community may be uncomfortable with behavioral interpretations and prose that are distinct from their particular terms.
References
- Aune M, Hunter JE, Kim HJ, Kim JS. The effect of culture and self‐construals on predispositions toward verbal communication. Human Communication Research. 2001;27:382–408. doi: 10.1111/j.1468-2958.2001.tb00786.x. [DOI] [Google Scholar]
- Baer DM, Wolf MM, Risley TR. Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis. 1968;1:91–97. doi: 10.1901/jaba.1968.1-91. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bailey JS. Marketing behavior analysis requires different talk. Journal of Applied Behavior Analysis. 1991;24:445–448. doi: 10.1901/jaba.1991.24-445. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bechler C, Green L, Myerson J. Proportion offered in the dictator and ultimatum games decreases with amount and social distance. Behavioural Processes. 2015;115:149–155. doi: 10.1016/j.beproc.2015.04.003. [DOI] [PubMed] [Google Scholar]
- Berger M. Behaviorism in twenty-five words. Social Work. 1973;18:106–108. [Google Scholar]
- Bickel WK, Wilson AG, Franck CT, Mueller ET, Jarmolowicz DP, Koffarnus MN, et al. Using crowdsourcing to compare temporal, social temporal, and probability discounting among obese and non-obese individuals. Appetite. 2014;75:82–89. doi: 10.1016/j.appet.2013.12.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Buhrmester M, Kwang T, Gosling SD. Amazon’s mechanical turk: a new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science. 2011;6:3–5. doi: 10.1177/1745691610393980. [DOI] [PubMed] [Google Scholar]
- Couper MP, Traugott MW, Lamias MJ. Web survey design and administration. Public Opinion Quarterly. 2001;65:230–253. doi: 10.1086/322199. [DOI] [PubMed] [Google Scholar]
- Critchfield TS, Epting LK. The trouble with babies and the value of bath water: complexities in the use of verbal reports as data. The Analysis of Verbal Behavior. 1998;15:65–74. doi: 10.1007/BF03392924. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Critchfield TS, Tucker JA, Vuchinich RE. Self-report methods. In: Lattal KA, Perone M, editors. Handbook of methods for the experimental analysis of human behavior. New York: Plenum; 1998. pp. 435–470. [Google Scholar]
- Dodds PS, Clark EM, Desu S, Frank MR, Reagan AJ, Williams JR, et al. Human language reveals a universal positivity bias. Proceedings of the National Academy of Sciences. 2015;112:2389–2394. doi: 10.1073/pnas.1411678112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Doughty AH, Holloway C, Shields MC, Kennedy LE. Marketing behavior analysis requires (really) different talk: a critique of Kohn (2005) and a(nother) call to arms. Behavior and Social Issues. 2012;21:115–134. doi: 10.5210/bsi.v21i0.3914. [DOI] [Google Scholar]
- Field DP, Hineline PN. Dispositioning and the obscured roles of time in psychological explanations. Behavior and Philosophy. 2008;36:5–69. [Google Scholar]
- Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: a synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).
- Foxx RM. Translating the covenant: the behavior analyst as ambassador and translator. Behavior Analyst. 1996;19:147–161. doi: 10.1007/BF03393162. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Freedman, D. H. (2015). Improving the public perception of behavior analysis. Behavior Analyst, 1-7. doi:10.1007/s40614-015-0045-2 [DOI] [PMC free article] [PubMed]
- Friman PC. Behavior analysts to the front! A 15-step tutorial on public speaking. Behavior Analyst. 2014;37:109–118. doi: 10.1007/s40614-014-0009-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friman PC. Publishing in journals outside the box: attaining mainstream prominence requires demonstrations of mainstream relevance. Behavior Analyst. 2014;37:73–76. doi: 10.1007/s40614-014-0014-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Green G. Evaluating claims about treatments for autism. In: Maurice C, Green G, Luce S, editors. Behavioral intervention for young children with autism: a manual for parents and professionals. Austin: Pro-Ed; 1996. pp. 15–28. [Google Scholar]
- Hearst E. The behavior of Skinnerians. Contemporary Psychology. 1967;12:402–404. [Google Scholar]
- Hineline, P. N. (1990). Priorities and strategies for this new decade. Presidential address at the meeting of the Association for Behavior Analysis, Nashville, TN.
- Infante DA, Rancer AS. Argumentativeness and verbal aggressiveness: a review of recent theory and research. In: Burleson B, editor. Communication yearbook 19. Thousand Oaks: Sage; 1996. pp. 318–351. [Google Scholar]
- Jarmolowicz DP, Bickel WK, Carter AE, Franck CT, Mueller ET. Using crowdsourcing to examine relations between delay and probability discounting. Behavioural Processes. 2012;91:308–312. doi: 10.1016/j.beproc.2012.09.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johnson PS, Herrmann ES, Johnson MW. Opportunity costs of reward delays and the discounting of hypothetical money and cigarettes. Journal of the Experimental Analysis of Behavior. 2015;103:87–107. doi: 10.1002/jeab.110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kazdin A. Acceptability of time-out from reinforcement procedures for disruptive behavior. Behavior Therapy. 1980;11:329–344. doi: 10.1016/S0005-7894(80)80050-5. [DOI] [Google Scholar]
- Klare GR, Mabry JE, Gustafson LM. The relationship of human interest to immediate retention and acceptability of technical material. Journal of Applied Psychology. 1955;39:92–95. doi: 10.1037/h0047159. [DOI] [Google Scholar]
- Klare GR, Mabry JE, Gustafson LM. The relationship of style difficulty to immediate retention and acceptability of technical material. Journal of Educational Psychology. 1955;46:287–295. doi: 10.1037/h0044458. [DOI] [Google Scholar]
- Kloumann IM, Danforth CM, Harris KD, Bliss CA, Dodds PS. Positivity of the English language. PloS One. 2012;7:e29484. doi: 10.1371/journal.pone.0029484. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kohn A. Punished by rewards: the trouble with gold stars, incentive plans, A’s, praise, and other bribes. Boston: Houghton Mifflin; 1993. [Google Scholar]
- Leigland S. Functions of research in radical behaviorism for the further development of behavior analysis. Behavior Analyst. 2010;33:207–222. doi: 10.1007/BF03392220. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lengel GJ, Mullins-Sweatt SN. The importance and acceptability of general and maladaptive personality trait computerized assessment feedback. Psychological Assessment. 2016 doi: 10.1037/pas0000321. [DOI] [PubMed] [Google Scholar]
- Lindsley OR. From technical jargon to plain English for application. Journal of Applied Behavior Analysis. 1991;24:449–458. doi: 10.1901/jaba.1991.24-449. [DOI] [PMC free article] [PubMed] [Google Scholar]
- MacCorquodale K. On Chomsky’s review of Skinner’s verbal behavior. Journal of the Experimental Analysis of Behavior. 1970;13:83–99. doi: 10.1901/jeab.1970.13-83. [DOI] [Google Scholar]
- Madden GJ. Go forth and be variable. Behavior Analyst. 2013;36:137–143. doi: 10.1007/BF03392296. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mason W, Suri S. Conducting behavioral research on Amazon’s mechanical turk. Behavior Research Methods. 2012;44:1–23. doi: 10.3758/s13428-011-0124-6. [DOI] [PubMed] [Google Scholar]
- Maurice C. Let me hear your voice: a family’s triumph over autism. New York: Random House; 1993. [Google Scholar]
- Minkin N, Braukmann CJ, Minkin BL, Timbers GD, Timbers BJ, Fixsen DL, et al. The social validation and training of conversational skills. Journal of Applied Behavior Analysis. 1976;9:127–139. doi: 10.1901/jaba.1976.9-127. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morris EK. Public information, dissemination, and behavior analysis. Behavior Analyst. 1985;8:95–110. doi: 10.1007/BF03391916. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morris EK. Stop preaching to the choir, publish outside the box: a discussion. Behavior Analyst. 2014;37:87–94. doi: 10.1007/s40614-014-0011-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moser CA, Kalton G. Survey methods in social investigation. 2. London: Heinemann Educational; 1971. [Google Scholar]
- Myerson J, Baumann AA, Green L. Discounting of delayed rewards: (a)theoretical interpretation of the Kirby questionnaire. Behavioural Processes. 2014;107:99–105. doi: 10.1016/j.beproc.2014.07.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Normand MP. Opening Skinner’s box: an introduction. Behavior Analyst. 2014;37:67–68. doi: 10.1007/s40614-014-0016-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Paolacci G, Chandler J. Inside the turk: understanding mechanical turk as a participant pool. Current Directions in Psychological Science. 2014;23:184–188. doi: 10.1177/0963721414531598. [DOI] [Google Scholar]
- Pietras CJ, Reilly MP, Jacobs EA. Moving forward without changing course. Behavior Analyst. 2013;36:145–149. doi: 10.1007/BF03392297. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Podlesnik CA. The openness is there. Behavior Analyst. 2013;36:151–153. doi: 10.1007/BF03392298. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rand DG. The promise of mechanical turk: how online labor markets can help theorists run behavioral experiments. Journal of Theoretical Biology. 2012;299:172–179. doi: 10.1016/j.jtbi.2011.03.004. [DOI] [PubMed] [Google Scholar]
- Rapucci ND, Saunders JT. The social psychology of behavior modification: problems of implementation in natural settings. American Psychologist. 1974;29:649–660. doi: 10.1037/h0037630. [DOI] [PubMed] [Google Scholar]
- Reed DD. Determining how, when, and whether you should publish outside the box: sober advice for early career behavior analysts. Behavior Analyst. 2014;37:83–86. doi: 10.1007/s40614-014-0012-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rogers EM. Diffusion of innovations. New York: Simon & Schuster; 2003. [Google Scholar]
- Rolider A, Axelrod S, Van Houten R. Don’t speak behaviorism to me: how to clearly and effectively communicate behavioral interventions to the general public. Child and Family Behavior Therapy. 1998;20:39–56. doi: 10.1300/J019v20n02_03. [DOI] [Google Scholar]
- Roma, P. G., Hursh, S. R., & Hudja, S. (2016). Hypothetical purchase task questionnaires for behavioral economic assessments of value and motivation. Managerial and Decision Economics, 37, 306–323. doi:10.1002/mde.2718.
- Rorty R. Objectivity, relativism, and truth: philosophical papers. Cambridge: Cambridge University Press; 1991. [Google Scholar]
- Schlinger HD. Publishing outside the box: unforeseen dividends of talking to strangers. Behavior Analyst. 2014;37:77–81. doi: 10.1007/s40614-014-0010-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Skinner BF. Science and human behavior. New York: Macmillan; 1953. [Google Scholar]
- Skinner BF. Verbal behavior. New York: Appleton; 1957. [Google Scholar]
- Skinner B. Beyond freedom and dignity. New York: Bantam Vintage; 1971. [Google Scholar]
- Skinner BF. About behaviorism. New York: Random House; 1974. [Google Scholar]
- Skinner BF. The steep and thorny way to a science of behavior. American Psychologist. 1975;30:42–49. doi: 10.1037/0003-066X.30.1.42. [DOI] [PubMed] [Google Scholar]
- Skinner BF. Herrnstein and the evolution of behaviorism. American Psychologist. 1977;32:1006–1012. doi: 10.1037/0003-066X.32.12.1006. [DOI] [Google Scholar]
- Smith, J. M. (2015). Strategies to position behavior analysis as the contemporary science of what works in behavior change. Behavior Analyst, 1-13. doi:10.1007/s40614-015-0044-3 [DOI] [PMC free article] [PubMed]
- Sprouse J. A validation of Amazon mechanical turk for the collection of acceptability judgments in linguistic theory. Behavior Research Methods. 2011;43:155–167. doi: 10.3758/s13428-010-0039-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- St. Peter CC. Changing course through collaboration. Behavior Analyst. 2013;36:155–160. doi: 10.1007/BF03392299. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Villardaga R, Hayes SC, Levin ME, Muto T. Creating a strategy for progress: a contextual behavior science approach. Behavior Analyst. 2009;32:105–133. doi: 10.1007/BF03392178. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vyse S. Changing course. Behavior Analyst. 2013;36:123–135. doi: 10.1007/BF03392295. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vyse S. Publishing outside the box: popular press books. Behavior Analyst. 2014;37:69–72. doi: 10.1007/s40614-014-0013-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Witt JC, Martens BK. Assessing the acceptability of behavioral interventions. Psychology in the Schools. 1983;20:50–517. doi: 10.1002/1520-6807(198310)20:4<510::AID-PITS2310200420>3.0.CO;2-1. [DOI] [Google Scholar]
- Witt JC, Martens BK, Elliott SN. Factors affecting teachers’ judgments of the acceptability of behavioral interventions: time involvement, behavior problem severity, and type of intervention. Behavior Therapy. 1984;15:204–209. doi: 10.1016/S0005-7894(84)80022-2. [DOI] [Google Scholar]
- Witt JC, Moe G, Gutkin TB, Andrews L. The effect of saying the same thing in different ways: the problem of language and jargon in school-based consultation. Journal of School Psychology. 1984;22:361–367. doi: 10.1016/0022-4405(84)90023-2. [DOI] [Google Scholar]
- Wolf MM. Social validity: the case for subjective measurement or how applied behavior analysis is finding its heart. Journal of Applied Behavior Analysis. 1978;11:203–214. doi: 10.1901/jaba.1978.11-203. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wright SC, Bougie E. Intergroup contact and minority-language education: reducing language-based discrimination and its negative impact. Journal of Language and Social Psychology. 2007;26:157–180. doi: 10.1177/0261927X07300078. [DOI] [Google Scholar]