Abstract
Behavior analysts have long recognized the potential of a partnership with pediatric medicine as an opportunity to expand the influence of behavior analysis and positively impact population health. Despite significant achievements in this domain, the impact of behavioral science on the daily practice of pediatrics has been limited. In this commentary, the authors argue that the current health care and research environments are ripe for a renewed focus on behavioral modification in pediatric primary care, with a particular emphasis on the study of high-frequency, low-intensity problems. They provide some analysis of why behavioral pediatrics has failed to gain traction in primary care, describe aspects of the current primary care practice and research landscapes that provide opportunities for an expanded portfolio of research, identify several exemplars from the behavior analytic literature that have influenced pediatric primary care or have the potential to do so, and make recommendations for producing influential data.
Keywords: integrated primary care, pediatric primary care, applied behavior analysis
There has long been a strong argument for the benefits of merging of pediatric medicine and behavioral science to promote behavioral health (Smith, Rome, & Freedheim, 1967). This argument has varied some over time, but it generally hinges on a few well-established findings: (a) child behavior problems are quite common in pediatric settings (Arndorfer, Allen, & Aljazireh, 1999; Cassidy & Jellinek, 1998; Fries et al., 1993; Sharp, Pantell, Murphy, & Lewis, 1992);(b) primary care providers (PCPs) face significant barriers to the provision of behavioral care, including limited time, inadequate training, and financial disincentive (Cooper, Valleley, Polaha, Begeny, & Evans, 2006; Norlin, Crawford, Bell, Sheng, & Stein, 2011; Regalado, Larson, Wissow, & Halfon, 2010); and (c) integrating behavioral health services into medical settings increases patient access (Burt, Garbacz, Kupzyk, Frerichs, & Gathje, 2014; Kessler & Stafford, 2008), thereby improving patient experiences, reducing the cost of care, and promoting population health (Kazak, Nash, Hiroto, & Kaslow, 2017). Behavior analysts in particular have historically noted the potential of a mutually beneficial partnership with pediatrics (Cataldo, 1982; Christophersen & Rapoff, 1979). Along with pediatric psychologists, behavior analysts have a significant history of producing effective interventions pertinent to pediatric medicine (e.g., Christophersen, 1985; Christophersen & Berman, 1978; Finney & Christophersen, 1984; Friman, Finney, Rapoff, & Christophersen, 1985; Friman & Leibowitz, 1990; Piazza & Fisher, 1991; Piazza, Fisher, Chinn, & Bowman, 1991; Rapoff & Christophersen, 1982) and devising strategies for successfully collaborating with pediatric physicians (Allen, Barone, & Kuhn, 1993; Roberts & Lyman, 1990; Roberts & Wright, 1982; Schroeder, 2004; Stabler, 1979; Stancin & Perrin, 2014).
Despite a track record of significant achievement, the current influence of behavior analysis and other behavioral sciences on the practice of pediatrics can be considered something of a mixed success. Emphasis on behavioral and psychosocial problems in pediatric primary care has clearly grown. For example, the American Academy of Pediatrics’ (AAP) Bright Futures Guidelines now recommends PCPs introduce topics such as the use of time-out and positive reinforcement via contingent praise as part of routine care (Hagan, Shaw, & Duncan, 2008), and these concepts have become quite mainstream (Pew Research Center, 2015). Such widespread dissemination of behavioral technologies, however, has often come at the cost of fidelity to underlying behavioral principles. For instance, although most parents report using time-out, a large majority do so in a manner contradictory to its empirical and theoretical underpinnings (Drayton et al., 2017; Riley, Wagner, Tudor, Zuckerman, & Freeman, 2017). Such misconceptions are not exclusive to the lay public. A recent brief published in AAP News, the official magazine of the AAP, recommends avoiding consequence-based strategies with toddlers because they do not understand them (Bauer, Childers, & Curtin, 2016), a relatively common stance that is inconsistent with both developmental and behavioral intervention literatures. Practice guidelines increasingly recommend universal screening for psychosocial problems in pediatric primary care (Committee on Psychosocial Aspects of Child Family Health, 2009; Semansky, Koyanagi, & Vandivort-Warren, 2003; S. B. Williams, O’Connor, Eder, & Whitlock, 2009), but most problems remain unidentified (Sheldrick, Merchant, & Perrin, 2011). Evidence-based behavioral interventions for common pediatric concerns such as sleep disruption (Mindell et al., 2006), toilet training problems, medical regimen adherence (Graves, Roberts, Rapoff, & Boyer, 2010), and disruptive behavior (Chorpita & Daleiden, 2009; Garland, Hawley, Brookman-Frazee, & Hurlburt, 2008) all rely heavily on techniques derived from the principles of operant and respondent learning, but only a minority of children and families who would benefit from such services ever access them (Chisolm, Klima, Gardner, & Kelleher, 2009; Hacker et al., 2006; Rushton, Bruckman, & Kelleher, 2002). Pediatric residency programs are now required to include a rotation in developmental and behavioral pediatrics (McMillan, Land, & Leslie, 2017), but this has apparently had little overall impact on the management of behavioral concerns in primary care (Stein et al., 2016).
The continued need for better delivery of behavioral services in pediatric primary care represents an ongoing opportunity to advance the field of behavioral pediatrics. In this article, we argue that the time is ripe for increased empirical focus on behavior modification in pediatric primary care, and that a particular opportunity exists for behavior analysts to study and intervene on high-frequency, low-intensity behavioral problems within the context of well-child care. This is not to exclude or diminish the study of rarer, more intense problems. Rather, our intent is to articulate some current dimensions of the health care and research landscapes that have opened the door for a wider spectrum of study. We first present a rationale for why it is important to study high-frequency, low-intensity problems and how the current health care landscape provides opportunities to do so. We then offer suggestions on how to produce and disseminate data that will impact the field of pediatrics. In doing so, we identify a number of exemplars from the behavior analytic literature that hold the potential to impact pediatric primary care.
Why Study Routine Behavioral Issues?
There is Much Grist for the Mill
Perhaps the most obvious reason to study common behavioral concerns in primary care is that they are, in fact, quite common. More than one third of children will meet criteria for a psychiatric disorder before the age of 16 (Costello, Mustillo, Erkanli, Keeler, & Angold, 2003) and it follows that subclinical problems are even more frequent. In one study, 42% of parents reported behavioral or emotional symptoms that did not rise to the level of pathology but still caused distress and impairment (Costello & Shugart, 1992). Parents are most likely to seek professional behavioral guidance from their child’s PCP (Taylor, Moeller, Hamvas, & Rice, 2013). As a result, behavioral concerns are raised in 50–80% of all child medical visits (Cassidy & Jellinek, 1998; Fries et al., 1993; Sharp et al., 1992) and are the primary presenting concern in 15–20% of cases (J. Williams, Klinepeter, Palmes, Pulley, & Foy, 2004). Although most PCPs provide some guidance on behavioral topics (Cheng, DeWitt, Savageau, & O’Connor, 1999), the need clearly remains unmet. The median amount of time devoted to behavior or discipline during well-child care is zero minutes (Norlin et al., 2011). Studies of well-child care consistently identify behavioral topics like discipline, toilet training, sleep, and helping children learn as parents’ most commonly reported unmet needs (Combs-Orme, Holden Nixon, & Herrod, 2011; Olson et al., 2004; Schuster, Duan, Regalado, & Klein, 2000). Disadvantaged populations are disproportionately affected: non-English speakers, low-income families, and those lacking psychosocial supports are all more likely to report unmet behavioral health needs (Regalado et al., 2010). For researchers, this unmet need represents a large pool of potential study topics and participants.
A Long Standing, But Withstanding Problem
Addressing subclinical and prodromal child rearing concerns has long been identified as a goal of behavioral pediatrics and integrated primary care (Christophersen, 1982; Kanoy & Schroeder, 1985; Mesibov, Schroeder, & Wesson, 1977; Schroeder, 1979). Unfortunately, PCPs continue to report feeling underprepared to effectively deliver behavioral health counseling (Horwitz et al., 2015), and they often report recommending strategies that are not evidence based (Scholer, Nix, & Patterson, 2006). There have been numerous attempts to otherwise improve care for subclinical and prodromal child rearing issues, including provision of strategies and materials to PCPs to aid behavioral counseling (Barkin et al., 2008; Christophersen, 1982), behavioral advice call-in services (Kanoy & Schroeder, 1985; Polaha, Volkmer, & Valleley, 2007; Schroeder, 1979), walk-in appointments with behavioral specialists (Kanoy & Schroeder, 1985; Mesibov et al., 1977; Schroeder, 1979), behavioral consultation during usual well-child care (Talmi et al., 2016), and use of multimedia to deliver evidence-based information (Riley, Freeman, & Marshall, 2016; Scholer, Hudnut-Beumler, & Dietrich, 2010). These approaches are all well-reasoned and each has gained some empirical attention, but with few exceptions, it is difficult to find experimental evaluation of effective methods for integrating them into primary care workflows or their effects on child outcomes. For instance, in an excellent paper detailing various strategies for pediatricians to address common behavioral topics, Christophersen (1982) provided recommendations for counseling parents on effective time-out implementation. Thirty-five years later, it is now quite common for PCPs to advise parents on the use of time-out (Scholer et al., 2006), but there is little evidence to inform how such counseling is best delivered or to suggest it is effective at promoting parental implementation, much less at improving child behavior (Barkin et al., 2008). The dearth of such data represents an ongoing opportunity for behavioral pediatrics.
The Times They Are A-Changin’
Historically, the presence of behavioral health professionals during well-child care was presumably quite rare, but there is currently a movement toward higher levels of integration for behavioral clinicians. In a recent survey of psychologists working in pediatric primary care (Hoffses et al., 2017), most endorsed working in integrated models, in which behavioral health providers operate side-by-side with PCPs and behavioral services are available to all patients (Asarnow, Kolko, Miranda, & Kazak, 2017). Over 90% of psychologists reported sometimes or often engaging in consultation, another indicator of high integration. Descriptive studies of highly integrated models have become more common in the literature (Cederna-Meko, Ellens, Burrell, Perry, & Rafiq, 2016; Hunter et al., 2017; Talmi et al., 2016). By contrast, nearly all of the experimental pediatric literature has focused on co-located or collaborative models of integrated care in which therapies derived from traditional clinical child psychology are modified for the primary care environment but delivered temporally or spatially separate from medical care (e.g., Finney, Riley, & Cataldo, 1991; Kolko et al., 2014; McMenamy, Sheldrick, & Perrin, 2011; Perrin, Sheldrick, McMenamy, Henson, & Carter, 2014; Walkup, Mathews, & Green, 2017). Collaborative models clearly provide an important level of care (Asarnow, Rozenman, Wiblin, & Zeltzer, 2015), but as primary care shifts toward higher integration, there will be a need for a clinical science to inform a “portfolio” of practice from primary prevention to individualized tertiary intervention (Kazdin & Blase, 2011). There is currently little empiricism to inform delivery of the low-intensity end of that portfolio.
If You Build It, Will They Pay?
There are likely numerous reasons why research on interventions for high-frequency, low-intensity behavioral problems has not proliferated. One probable culprit is the historical unclarity of how such services could be adequately reimbursed in practice. Physicians cite poor or absent reimbursement as a barrier to the provision of behavioral guidance (Nasir, Watanabe-Galloway, & DiRenzo-Coffey, 2016; Pidano, Kimmelblatt, & Neace, 2011), and this is compounded by the disproportionately time-consuming nature of behavioral counseling (Cooper et al., 2006). Licensed mental health professionals have traditionally been constrained to the use of current procedural terminology assessment and psychotherapy codes, reimbursement of which is typically dependent on the diagnosis of a psychiatric disorder and prior authorization of services by payers, and thereby unsuitable for anticipatory guidance or subclinical concerns. So, traditionally there has been little financial incentive to address low-intensity concerns.
However, the health care payment landscape is shifting. As part of an increased emphasis on prevention and health promotion, aspects of the 2010 Affordable Care Act allow for reimbursement of behavioral services without a mental disorder diagnosis (Rozensky, 2014). At the same time, new billing options have emerged. Health and behavior (H&B) codes, which are designed for use in integrated settings (Miyamoto, 2006), do not require the presence of psychopathology to be reimbursed and can be used to assess and intervene on behavioral factors that contribute to physical health (Kessler, 2008). Talmi and Fazio (2012) have highlighted the potential of using H&B code to address subclinical behavioral concerns via brief consultations conducted during routine well-child visits, and some evidence indicates H&B code use is associated with higher levels of integration (Riley, Grennan, Menousek, & Hoffses, 2017). Beyond fee-for-service models, there is growing interest in alternative value-based payment models such as pay-for-performance (Unützer et al., 2012), bundled payment (Hussey, Ridgely, & Rosenthal, 2011), and global payment (Kathol, deGruy, & Rollman, 2014; Nutting et al., 2011) to finance integrated behavioral health services. These payment structures vary in their strengths and weaknesses, but contrasted with traditional fee-for-service reimbursement, each incentivizes clinicians to provide more efficient and value-based care (for recent reviews, see Miller et al., 2017 and Hobbs Knutson, 2017).
Given the volatility of health care reform, it is difficult to foresee with any certainty how or when payment models will change. If payment structures evolve from volume-based to value-based, economic reinforcers will shift, and so too will models of care. With respect to integrated primary care, this would likely result in an increased emphasis on team-based care and stepped-care interventions that are matched to the complexity of a given patient (Kathol et al. 2014). Such stepped care models would likely include efforts at primary and secondary prevention, both of which are squarely within the scope of behavioral pediatrics (Blum & Friman, 2000; Chamberlin, 1982; Christophersen, 1982). If behavioral health providers are to advocate for such services being well-reimbursed in practice, more and different data demonstrating their benefits are needed.
Generating Impactful Data
If the above argument is convincing, the question becomes how to seize the opportunity presented by high-frequency, low-intensity issues. We offer the following suggestions for generating impactful data based on our clinical, educational, and scholarly experiences in pediatric primary care. Although we see a particular opportunity to impact high-frequency, low-intensity problems, most of the recommendations are general enough to apply across a spectrum of patient complexity. This is not intended to be an exhaustive list, and we expect there are many other promising strategies.
Effectiveness Over Efficacy
The effort to disseminate evidence-based medicine into the primary care settings has been marked by a “quality chasm” (Bloom, 2002). Most clinical research is conducted at universities and academic medical centers, but most care is delivered through ambulatory primary care clinics (Green, Fryer, Yawn, Lanier, & Dovey, 2001). The result is a body of evidence which often does not generalize well to practice (Graham, James, & Cowan, 2000). On average, it takes 17 years for scientific evidence to influence day-to-day practice, and only a small fraction is ever adopted (Balas & Boren, 2000). Behavioral pediatrics is no exception, in that despite a strong evidence base, impact on daily practice has been limited. Among primary care scholars, recognition of the need for research findings to better inform clinical practice, and vice versa, has led to an increased emphasis on comparative effectiveness research (CER), the purpose of which is “to improve health out-comes by developing and disseminating evidence-based information to patients, clinicians, and other decision makers about which interventions are most effective for which patients under specific circumstances” (Conway & Clancy, 2009, p. 329). Typically designed to compare two or more active treatments, CER is by definition patient-centered, focusing on the needs and preferences of patients while seeking to improve health outcomes. This contrasts with traditional clinical trials, which are typically concerned with the isolation of independent variables to determine efficacy. The emphasis on pragmatic, patient-centered outcomes in CER is congruent with the applied dimension of applied behavior analysis, as both focus on societally important concerns and conduction of research in ecologically valid settings (Baer, Wolf, & Risley, 1968). In our view, applicability is the main challenge facing the dissemination of behavioral pediatrics in primary care. There is little question behavioral interventions work when delivered expertly and fully received by patients; however, whether and how they can be successfully implemented in daily pediatric practice remains largely unanswered.
One strategy for producing CER is to conduct practice-based research, meaning research trials are conducted within the usual clinical setting. This approach focuses on maximizing external validity to facilitate the dissemination and implementation of evidence-based practices (Westfall, Mold, & Fagnan, 2007). Such research is often conducted in practice-based research networks (PBRNs), collectives of practitioners who collaborate with researchers to serve as “real-world” laboratories (Green & Hickner, 2006; Heintzman et al., 2014; Nutting, Beasley, & Werner, 1999). According to the Agency for Health Care Research Quality, there are nearly 200 registered PBRNs in the United States, representing thousands of PCPs and millions of pediatric patients (Agency for Health Care Research & Quality, 2014). Practice-based research networks have been impactful in the study of pediatric psychosocial problems (e.g., Jellinek et al., 1999; Gardner et al., 2000; Kelleher et al., 1997, 1999; Kolko, Campo, Kilbourne, & Kelleher, 2012) and behavior analysts who wish to influence the practice of primary care would do well to partner with these communities, collaborate with practice-based researchers, and familiarize themselves with the CER literature.
Know Your Customers
A hallmark of CER is stakeholder engagement, actively seeking input from end users of health technologies to inform research practices from conceptualization to dissemination (Deverka et al., 2012). Stakeholders most commonly include patients and clinicians but may include others such as health care organizations, product developers (e.g., electronic health record vendors), payers, and policymakers (Concannon et al., 2014; Forsythe et al., 2016). Incorporation of stakeholder perspectives is designed to produce research that is relevant and translatable for the intended audience. Stakeholder engagement represents an important strategy for increasing the applicability of behavioral technologies in primary care.
Understanding the perspectives of PCPs is particularly important to developing and promoting behavioral technologies, as they and allied professionals serve as gatekeepers to those services (Allen et al., 1993). Existing research provides some important guidelines for developing behavioral interventions that are likely to be embraced by PCPs. For example, Arndorfer et al. (1999) found that pediatricians reported oppositional behavior as the most common and difficult-to-manage concern raised by parents. Further, pediatricians rated several potential behavioral interventions as highly acceptable. Beyond acceptability, interventions must meet the unique needs and preferences of PCPs. A recent survey of pediatric PCPs identified the amount of time required, applicability across multiple conditions, ease of use, and ease of learning as the factors most likely to influence adoption of psychosocial interventions (Arora, Stephan, Becker, & Wissow, 2016), echoing frequently cited barriers to behavioral care (Cooper et al., 2006; Meadows, Valleley, Haack, Thorson, & Evans, 2011; Nasir et al., 2016; Norlin et al., 2011; Pidano et al., 2011; Regalado et al., 2010). If they are to be widely embraced, behavioral technologies and the methods used to study those technologies must mitigate, rather than exacerbate, these barriers.
Embrace the Mundane
As Friman (2010) noted, much of clinical applied behavior analysis has been devoted to one tail of the normal distribution. Since the field’s inception, a good deal of success has been derived from applying behavioral principles to problems that other disciplines have failed to solve (Ayllon & Michael, 1959). This is perhaps best exemplified by the functional analysis and treatment of aberrant behaviors among individuals with profound developmental disabilities (Beavers, Iwata, & Lerman, 2013). Whereas that branch of behavior analysis has made a tremendous impact on a relatively small portion of the population, pediatric primary care demands the inverse: relatively modest improvements that are broadly relevant. Such broad relevance requires studying behaviors that are “normal.” While less prominent than the experimental analysis and treatment of aberrant behavior, there is a history of behavior analysts successfully tackling such run-in-the-mill problems. The study of “parent advice packages” is a prime example. Clark et al. (1977) described the effects of providing parents with written advice on managing disruptive behavior during shopping trips. The written materials described relatively simple response-cost and positive attention strategies which resulted in substantial reductions of problem behavior when implemented. Child tantrums in checkout lines is not an especially severe problem, but it is tremendously relatable for many parents and we expect such an advice package, if modernized and adapted for the clinical setting, would be very welcome in primary care offices. Similar advice packages have been developed for improving behavior at restaurants (Bauman, Reiss, Rogers, & Bailey, 1983) and reducing sleep problems of infants and toddlers (Adair, Zuckerman, Bauchner, Philipp, & Levenson, 1992; Eckerberg, 2002; Weymouth, Hudson, & King, 1987). Low-intensity interventions such as these—targeted, grounded in behavioral principles, flexibly delivered—hold strong potential to be implemented in pediatric practice.
Design Flexibly and Functionally
If behavior analysis has produced numerous technologies that effectively address behavioral issues that frequently present in primary care, and thus would seem to be of general interest to PCPs and families, why have those technologies not proliferated in research or practice? We suspect one reason is the methodological disconnect between the respective sciences of behavior analysis and pediatric medicine. In part, this disconnect is due to fundamentally different sets of research questions. Whereas behavior analysis has often sought to identify the best methods of alleviating the most severe problems, the impetus in primary care is more commonly to determine the most efficient way to influence the greatest number of individuals. To broaden the impact of behavior analysis in primary care, researchers must be flexible in selecting research methods, balancing an idiographic approach to behavior change with population health perspectives (Winett, Moore, & Anderson, 1991).
Research questions focused on idiographic approaches to behavior change are well suited to use of single-subject designs (SSDs), the hallmark method of behavior analysis. Such designs have notable strengths (e.g., control for threats to internal validity through repeated measurement of behavior across time, repeated demonstration of treatment effect, intra- and interparticipant comparison; and control of threats to external validity via direct and systematic replication; Freeman & Eagle, 2011; Freeman & Mash, 2007). The use of SSDs is critical for initially demonstrating the effect of interventions, replicating effects across different populations, and generating pilot data to inform additional research. Further, groups of providers or practices can serve as “subjects” and the unit of analysis can be the behavior of groups of patients (e.g., Friman et al., 1985).
Despite their strengths, SSDs may not produce data which are sufficiently translatable to the practice of pediatric primary care. Estimates of average patient panel sizes for PCPs range from 900–2500 (Raffoul, Moore, Kamerow, & Bazemore, 2016). It can therefore be expected that PCPs and clinic directors considering whether they should invest the resources to adopt a specific intervention or set of interventions within a primary care practice will be particularly concerned with how those interventions operate within a population. As an utmost example, consider an important finding in the adult literature that a few seconds of advice on smoking cessation from a physician increases the odds of patients quitting by 1–3% (Stead, Bergson, & Lancaster, 2013). This finding has relevance for PCPs who manage thousands of patients, but it is difficult to imagine how such an effect could be captured by SSDs. By their very nature, group designs involve larger sample sizes and are particularly relevant when the researcher is interested in assessing the proportion of individuals who respond to treatment. Thus, group designs may be ideal when the percentage of individuals who respond to an intervention is of paramount interest, or when examining the impact of intra- and interpersonal characteristics on treatment outcomes (i.e., moderators). Further, group designs, specifically randomized controlled trials (RCTs), are considered by many to be the gold standard for empirical demonstration of treatment effect (for commentary, see Bothwell, Greene, Podolsky, & Jones, 2016). Whether this view is accurate or not is beside the point. Pragmatically, large sample sizes are a general prerequisite for impacting primary care practices.
This is not to say the traditional RCTs are the only or best way to produce relatable data. On the contrary, behavior analysts and population researchers share a recognition of the limitations of traditional RCTs (Branch & Pennypacker, 2013; Heller & Page, 2002; Sanson-Fisher, Bonevski, Green, & D’Este, 2007), if for somewhat different reasons. The shift from efficacy to real world effectiveness has necessitated employment of alternative designs by primary care researchers for both scientific and pragmatic reasons (Ford & Norrie, 2016; Horn & Gassaway, 2007; Tunis, Stryer, & Clancy, 2003). These include but are not limited to cluster randomized trials (Puffer, Torgerson, & Watson, 2005), stepped wedge designs (Hemming, Haines, Chilton, Girling, & Lilford, 2015), sequential multiple assignment randomization trials (Murphy, 2005), and mixed-method approaches (Borkan, 2004). Importantly, these designs often use methodological features familiar to behavior analysts, including the sequential application of interventions, repeated measures, inductive reasoning, and iterative data-based decision-making. In fact, researchers have advocated the utility of interrupted time-series and multiple baseline designs for population-based research (Biglan, Ary, & Wagenaar, 2000; Hawkins, Sanson-Fisher, Shakeshaft, D’Este, & Green, 2007). Each of these approaches has relative strengths and weakness, varying in appropriateness depending on the nature of the research question being asked. Building an evidence base that translates intervention research findings into practice will likely require a variety of methods, from tightly controlled SSDs to large-scale pragmatic scientific approaches.
The study of time-out as a parenting strategy highlights the utility of design flexibility and relaxing allegiance to one category of designs. A large body of research has established the general efficacy of time-out in reducing problematic behaviors (Everett, Hupp, & Olmi, 2010; Morawska & Sanders, 2011). Part of this literature has also examined the differential effects of particular procedural components (e.g., the provision of warnings, contingent release, escape contingencies) on the effectiveness of time-out, typically via SSDs. Although excellent at establishing the internal validity of intervention components and effects, such studies do not address how parents use time-out in every day practice, nor are they particularly easy to translate to the primary care environment given differences in the populations, procedures, and settings studied. However, recent studies focused on the dissemination of time-out to the general population have begun to fill in this picture. Drayton et al. (2014) coded information about time-out found on the Internet to assess what misleading or incomplete information has been disseminated, which may be useful for PCPs counseling parents regarding effective implementation. A recent survey of parents in primary care (N = 401) further assessed parents’ perceptions and implementation of time-out (Riley et al., 2017), identifying critical areas for further study. For example, parents’ report that their child attempts to escape from time-out was the most robust predictor of perceived ineffectiveness. In our experience, escape from time- out represents common topic on which PCPs or imbedded behavioral health consultants might advise parents. Small-scale research has identified a number of viable strategies for reducing escape from time-out (Donaldson, Vollmer, Yakich, & Van Camp, 2013; Kunkle & Ortiz, 2016; Warzak & Floress, 2009), but it is unclear which of these should be employed in primary care for which patients. A pragmatic trial comparing various approaches to counseling parents on time-out escape would be of high value in the primary care setting.
Disseminate Differently
As long ago as the early 1990s, behavior analysts lamented that the evidence base for interventions targeting child behavioral health was being developed parallel to rather than in collaboration with pediatricians (Allen et al., 1993). The dissemination habits of behavior analysts are an important contributor to this disconnect. Likely as true today as in the 1990s, researchers tend to publish in a narrow band of outlets, often in journals read by likeminded scholars within the profession (Normand, 2014). Impacting pediatric primary care health will require publication in medically oriented journals targeting pediatric scholars and clinicians (e.g., Pediatrics, Journal of Pediatrics, JAMA Pediatrics, Journal of Developmental and Behavioral Pediatrics, Academic Pediatrics). Further, broadening the types of publications to include commentaries, topical reviews, and other summaries of the empirical and conceptual foundations for interventions promoted for adoption in primary care would expand the impact of behavior analysis. Of course, successful publishing in such outlets demands attention to the culture, language, and questions of the audience and thereby will require flexibility of communication style.
Dissemination of the Bedtime Pass, an intervention for bedtime resistance in young children designed and initially tested by behavior analysts (Friman et al., 1999), illustrates the utility and potential impact of disseminating differently. Although the initial demonstration of treatment effects used a withdrawal design across just two participants, the authors chose an outlet targeting pediatricians, Archives of Pediatric and Adolescent Medicine, rather than behavior analysts. In justifying the publication of a study with two participants, the journal’s editor included a note with the article explaining, “The idea is so novel and easy, I hope our readers will try it and let us know if it works for their patients” (p. 1027). The impact of this dissemination choice has been tangible. Shortly after publication, the lead author participated in interviews with multiple national news outlets (Friman, 2014). A quick Internet search shows that the Bedtime Pass continues to be regularly mentioned in popular media outlets such as Parents magazine (Cettina, 2012), Today.com (2007), Huffington Post (Prueher, 2015), and NPR.org (Clarke, 2015).
The success of the Bedtime Pass is not solely due to publication in a visible outlet, nor would it likely have been accepted for publication by that outlet did it not exemplify the other features we have argued for above. The Bedtime Pass targets a common problem (Blader, Koplewicz, Abikoff, & Foley, 1997) and uses behavioral principles (i.e., differential reinforcement of alternative behavior plus extinction; Freeman, 2006) to inform an “easy” intervention, mitigating the barriers of time and training for PCPs. Both SSDs and group methodologies have been used to evaluate the intervention and investigations have included ratings of acceptability from PCPs and parents (Freeman, 2006; Friman et al., 1999; Moore, Friman, Fruzzetti, & MacAleese, 2006). Can the Bedtime Pass be implemented systematically in pediatric primary care to improve population health outcomes? This would be a challenging but excellent question to answer.
Conclusion
Behavior analysis has made important contributions to pediatric primary care and still has much more to offer. The current health care landscape’s increased focus on the integration of medical and behavioral services offers a ripe opportunity for behavior analysts to impact mainstream child health. This area remains in need of empirical investigation and pragmatic clinical science to inform practice. Studies examining applications to larger groups of patients (e.g., PCP patient panels), externally valid methods of delivery, and stakeholder variables that influence effective dissemination are critical to widely disseminating behavioral interventions for routine child rearing challenges to pediatric primary care. Behavior analysts are positioned to help fill that void by leveraging the strengths of the discipline to devise and evaluate clinical strategies that are grounded in behavioral principles, pragmatic for practitioners, and valued by families. Doing so will require blending adherence to the field’s behavioral roots with flexible, pragmatic science.
Acknowledgments
This project was supported by grant K12 HS022981 from the Agency for Health Care Research and Quality. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Agency for Health Care Research and Quality.
This article was supported by the Health Resources and Services Administration (HRSA) of the U.S. Department of Health and Human Services (HHS) under grant D40HP26865 and title Graduate Psychology Education Programs. This information or content and conclusions are those of the authors and should not be construed as the official position or policy of, nor should any endorsements be inferred by HRSA, HHS, or the U.S. Government.
References
- Adair R, Zuckerman B, Bauchner H, Philipp B, & Levenson S (1992). Reducing night waking in infancy: A primary care intervention. Pediatrics, 89, 585–588. [PubMed] [Google Scholar]
- Agency for Health Care Research and Quality. (2014). PBRN registry. Retrieved from https://pbrn.ahrq.gov/pbrn-registry
- Allen KD, Barone VJ, & Kuhn BR (1993). A behavioral prescription for promoting applied behavior analysis within pediatrics. Journal of Applied Behavior Analysis, 26, 493–502. 10.1901/jaba.1993.26-493 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Arndorfer RE, Allen KD, & Aljazireh L (1999). Behavioral health needs in pediatric medicine and the acceptability of behavioral solutions: Implications for behavioral psychologists. Behavior Therapy, 30, 137–148. 10.1016/S0005-7894(99)80050-1 [DOI] [Google Scholar]
- Arora PG, Stephan SH, Becker KD, & Wissow L (2016). Psychosocial interventions for use in pediatric primary care: An examination of providers’ perspectives. Families, Systems, & Health, 34, 414–423. 10.1037/fsh0000233 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Asarnow JR, Kolko DJ, Miranda J, & Kazak AE (2017). The pediatric patient-centered medical home: Innovative models for improving behavioral health. American Psychologist, 72, 13–27. 10.1037/a0040411 [DOI] [PubMed] [Google Scholar]
- Asarnow JR, Rozenman M, Wiblin J, & Zeltzer L (2015). Integrated medical-behavioral care compared with usual primary care for child and adolescent behavioral health: A meta-analysis. Journal of the American Medical Association Pediatrics, 169, 929–937. 10.1001/jamapediatrics.2015.1141 [DOI] [PubMed] [Google Scholar]
- Ayllon T, & Michael J (1959). The psychiatric nurse as a behavioral engineer. Journal of the Experimental Analysis of Behavior, 2, 323–334. 10.1901/jeab.1959.2-323 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baer DM, Wolf MM, & Risley TR (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91–97. 10.1901/jaba.1968.1-91 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Balas EA, & Boren SA (2000). Managing clinical knowledge for health care improvement In Bemmel J & McCray A (Eds.), Yearbook of medical informatics 2000 (pp. 65–70). Stuttgart, Germany: Schattauer Publishing. [PubMed] [Google Scholar]
- Barkin SL, Finch SA, Ip EH, Scheindlin B, Craig JA, Steffes J, … Wasserman RC (2008). Is office-based counseling about media use, timeouts, and firearm storage effective? Results from a cluster-randomized, controlled trial. Pediatrics, 122(1), e15–e25. 10.1542/peds.2007-2611 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bauer NS, Childers DO, & Curtin M (2016, December). Principles of positive parenting can be shared during pediatric visits. AAP News. Retrived from http://www.aappublications.org/news/aapnewsmag/2016/12/13/PositiveParenting121316.full.pdf
- Bauman KE, Reiss ML, Rogers RW, & Bailey JS (1983). Dining out with children: Effectiveness of a parent advice package on premeal in appropriate behavior. Journal of Applied Behavior Analysis, 16, 55–68. 10.1901/jaba.1983.16-55 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Beavers GA, Iwata BA, & Lerman DC (2013). Thirty years of research on the functional analysis of problem behavior. Journal of Applied Behavior Analysis, 46, 1–21. 10.1002/jaba.30 [DOI] [PubMed] [Google Scholar]
- Biglan A, Ary D, & Wagenaar AC (2000). The value of interrupted time-series experiments for community intervention research. Prevention Science, 1, 31–49. 10.1023/A:1010024016308 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Blader JC, Koplewicz HS, Abikoff H, & Foley C (1997). Sleep problems of elementary school children. A community survey. Archives of Pediatrics & Adolescent Medicine, 151, 473–480. 10.1001/archpedi.1997.02170420043007 [DOI] [PubMed] [Google Scholar]
- Bloom BS (2002). Crossing the quality chasm: A new health system for the 21st century. Journal of the American Medical Association, 287, 646–647. 10.1001/jama.287.5.646-a [DOI] [Google Scholar]
- Blum N, & Friman PC (2000). Behavioral pediatrics: The confluence of applied behavior analysis and pediatric medicine In Carr J & Austin J (Eds.), Handbook of applied behavior analysis (pp. 161–186). Reno, NV: Context Press. [Google Scholar]
- Borkan JM (2004). Mixed methods studies: A foundation for primary care research. Annals of Family Medicine, 2, 4–6. 10.1370/afm.111 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bothwell LE, Greene JA, Podolsky SH, & Jones DS (2016). Assessing the gold standard—lessons from the history of RCTs. The New England Journal of Medicine, 374, 2175–2181. 10.1056/NEJMms1604593 [DOI] [PubMed] [Google Scholar]
- Branch MN, & Pennypacker HS (2013). Generality and generalization of research findings In Madden GJ & Dube WV (Eds.), APA hand-book of behavior analysis (1st ed., pp. 151–175). Washington, DC: American Psychological Association. [Google Scholar]
- Burt JD, Garbacz SA, Kupzyk KA, Frerichs L, & Gathje R (2014). Examining the utility of behavioral health integration in well-child visits: Implications for rural settings. Families, Systems, & Health, 32, 20–30. 10.1037/a0035121 [DOI] [PubMed] [Google Scholar]
- Cassidy LJ, & Jellinek MS (1998). Approaches to recognition and management of childhood psychiatric disorders in pediatric primary care. Pediatric Clinics of North America, 45, 1037–1052. 10.1016/S0031-3955(05)70061-4 [DOI] [PubMed] [Google Scholar]
- Cataldo MF (1982). The scientific basis for a behavioral approach to pediatrics. Pediatric Clinics of North America, 29, 415–423. 10.1016/S0031-3955(16)34150-5 [DOI] [PubMed] [Google Scholar]
- Cederna-Meko CL, Ellens RE, Burrell KM, Perry DS, & Rafiq F (2016). An exploration of behavioral health productivity and billing practices within pediatric primary care. Journal of Pediatric Psychology, 41, 1133–1143. 10.1093/jpepsy/jsw063 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cettina T (2012, April). Pillow talk: How to end sleep struggles. Parents Retrieved from http://www.parents.com/kids/sleep/tips/end-sleep-struggles/
- Chamberlin RW (1982). Prevention of behavioral problems in young children. Pediatric Clinics of North America, 29, 239–247. 10.1016/S0031-3955(16)34139-6 [DOI] [PubMed] [Google Scholar]
- Cheng TL, DeWitt TG, Savageau JA, & O’Connor KG (1999). Determinants of counseling in primary care pediatric practice: Physician attitudes about time, money, and health issues. Archives of Pediatrics & Adolescent Medicine, 153, 629–635. 10.1001/archpedi.153.6.629 [DOI] [PubMed] [Google Scholar]
- Chisolm DJ, Klima J, Gardner W, & Kelleher KJ (2009). Adolescent behavioral risk screening and use of health services. Administration and Policy in Mental Health and Mental Health Services Research, 36, 374–380. 10.1007/s10488-009-0245-8 [DOI] [PubMed] [Google Scholar]
- Chorpita BF, & Daleiden EL (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77, 566–579. 10.1037/a0014565 [DOI] [PubMed] [Google Scholar]
- Christophersen ER (1982). Incorporating behavioral pediatrics into primary care. Pediatric Clinics of North America, 29, 261–296. 10.1016/S0031-3955(16)34141-4 [DOI] [PubMed] [Google Scholar]
- Christophersen ER (1985). Enhancing the effectiveness of health education strategies. Clinics in Perinatology, 12, 381–389. [PubMed] [Google Scholar]
- Christophersen ER, & Berman R (1978). Encopresis treatment. Issues in Comprehensive Pediatric Nursing, 3, 51–66. [PubMed] [Google Scholar]
- Christophersen ER, & Rapoff MA (1979). Behavioral pediatrics In Pomerleau OF & Brady JP (Eds.), Behavioral medicine: Theory and practice (pp. 99–123). Baltimore, MD: Williams and Wilkins. [Google Scholar]
- Clark HB, Greene BF, Macrae JW, McNees MP, Davis JL, & Risley TR (1977). A parent advice package for family shopping trips: Development and evaluation. Journal of Applied Behavior Analysis, 10, 605–624. 10.1901/jaba.1977.10-605 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Clarke WM (2015). The bedtime pass helps parents and kids skip the sleep struggles. Retrieved from http://www.npr.org/sections/health-shots/2015/09/18/441492810/the-bedtime-pass-helps-parents-and-kids-skip-the-sleep-struggles
- Combs-Orme T, Holden Nixon B, & Herrod HG (2011). Anticipatory guidance and early child development: Pediatrician advice, parent behaviors, and unmet needs as reported by parents from different backgrounds. Clinical Pediatrics, 50, 729–737. 10.1177/0009922811403302 [DOI] [PubMed] [Google Scholar]
- Committee on Psychosocial Aspects of Child and Family Health and Task Force on Mental Health. (2009). Policy statement—the future of pediatrics: Mental health competencies for pediatric primary care. Pediatrics, 124, 410–421. 10.1542/peds.2009-1061 [DOI] [PubMed] [Google Scholar]
- Concannon TW, Fuster M, Saunders T, Patel K, Wong JB, Leslie LK, & Lau J (2014). A systematic review of stakeholder engagement in comparative effectiveness and patient-centered outcomes research. Journal of General Internal Medicine, 29, 1692–1701. 10.1007/s11606-014-2878-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Conway PH, & Clancy C (2009). Comparative-effectiveness research—implications of the Federal Coordinating Council’s report. The New England Journal of Medicine, 361, 328–330. 10.1056/NEJMp0905631 [DOI] [PubMed] [Google Scholar]
- Cooper S, Valleley RJ, Polaha J, Begeny J, & Evans JH (2006). Running out of time: Physician management of behavioral health concerns in rural pediatric primary care. Pediatrics, 118(1), e132–e138. 10.1542/peds.2005-2612 [DOI] [PubMed] [Google Scholar]
- Costello EJ, Mustillo S, Erkanli A, Keeler G, & Angold A (2003). Prevalence and development of psychiatric disorders in childhood and adolescence. Archives of General Psychiatry, 60, 837–844. 10.1001/archpsyc.60.8.837 [DOI] [PubMed] [Google Scholar]
- Costello EJ, & Shugart MA (1992). Above and below the threshold: Severity of psychiatric symptoms and functional impairment in a pediatric sample. Pediatrics, 90, 359–368. [PubMed] [Google Scholar]
- Deverka PA, Lavallee DC, Desai PJ, Esmail LC, Ramsey SD, Veenstra DL, & Tunis SR (2012). Stakeholder participation in comparative effectiveness research: Defining a framework for effective engagement. Journal of Comparative Effectiveness Research, 1, 181–194. 10.2217/cer.12.7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Donaldson JM, Vollmer TR, Yakich TM, & Van Camp C (2013). Effects of a reduced time-out interval on compliance with the time-out instruction. Journal of Applied Behavior Analysis, 46, 369–378. 10.1002/jaba.40 [DOI] [PubMed] [Google Scholar]
- Drayton AK, Andersen MN, Knight RM, Felt BT, Fredericks EM, & Dore-Stites DJ (2014). Internet guidance on time out: Inaccuracies, omissions, and what to tell parents instead. Journal of Developmental and Behavioral Pediatrics, 35, 239–246. 10.1097/DBP.0000000000000059 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Drayton AK, Byrd MR, Albright JJ, Nelson EM, Andersen MN, & Morris NK (2017). Deconstructing the time-out: What do mothers understand about a common disciplinary procedure? Child & Family Behavior Therapy, 39, 91–107. 10.1080/07317107.2017.1307677 [DOI] [Google Scholar]
- Eckerberg B (2002). Treatment of sleep problems in families with small children: Is written information enough? Acta Paediatrica, 91, 952–959. 10.1111/j.1651-2227.2002.tb02861.x [DOI] [PubMed] [Google Scholar]
- Everett GE, Hupp SD, & Olmi DJ (2010). Time-out with parents: A descriptive analysis of 30 years of research. Education and Treatment of Children, 33, 235–259. [Google Scholar]
- Finney JW, & Christophersen ER (1984). Behavioral pediatrics: Health education in pediatric primary care. Progress in Behavior Modification, 16, 185–229. 10.1016/B978-0-12-535616-9.50011-0 [DOI] [PubMed] [Google Scholar]
- Finney JW, Riley AW, & Cataldo MF (1991). Psychology in primary health care: Effects of brief targeted therapy on children’s medical care utilization. Journal of Pediatric Psychology, 16, 447–461. 10.1093/jpepsy/16.4.447 [DOI] [PubMed] [Google Scholar]
- Ford I, & Norrie J (2016). Pragmatic trials. The New England Journal of Medicine, 375, 454–463. 10.1056/NEJMra1510059 [DOI] [PubMed] [Google Scholar]
- Forsythe LP, Ellis LE, Edmundson L, Sabharwal R, Rein A, Konopka K, & Frank L (2016). Patient and stakeholder engagement in the PCORI pilot projects: Description and lessons learned. Journal of General Internal Medicine, 31, 13–21. 10.1007/s11606-015-3450-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- Freeman KA (2006). Treating bed time resistance with the bed time pass: A systematic replication and component analysis with 3-year-olds. Journal of Applied Behavior Analysis, 39, 423–428. 10.1901/jaba.2006.34-05 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Freeman KA, & Eagle R (2011). Single subject research designs In Thomas JC & Hersen M (Eds.), Understanding research in clinical and counseling psychology (2nd ed., pp. 129–154). New York, NY: Routledge. [Google Scholar]
- Freeman KA, & Mash EJ (2007). Single-case research designs. Handbook of clinical psychology, 32, 2–351. [Google Scholar]
- Fries JF, Koop CE, Beadle CE, Cooper PP, England MJ, Greaves RF, … The Health Project Consortium. (1993). Reducing health care costs by reducing the need and demand for medical services. The New England Journal of Medicine, 329, 321–325. 10.1056/NEJM199307293290506 [DOI] [PubMed] [Google Scholar]
- Friman PC (2010). Come on in, the Water is Fine: Achieving Mainstream Relevance through Integration with Primary Medical Care. The Behavior Analyst/MABA, 33, 19–36. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friman PC (2014). Publishing in journals outside the box: Attaining mainstream prominence requires demonstrations of mainstream relevance. The Behavior Analyst, 37, 73–76. 10.1007/s40614-014-0014-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friman PC, Finney JW, Rapoff MA, & Christophersen ER (1985). Improving pediatric appointment keeping with reminders and reduced response requirement. Journal of Applied Behavior Analysis, 18, 315–321. 10.1901/jaba.1985.18-315 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friman PC, Hoff KE, Schnoes C, Freeman KA, Woods DW, & Blum N (1999). The bedtime pass: An approach to bedtime crying and leaving the room. Archives of Pediatrics & Adolescent Medicine, 153, 1027–1029. 10.1001/archpedi.153.10.1027 [DOI] [PubMed] [Google Scholar]
- Friman PC, & Leibowitz JM (1990). An effective and acceptable treatment alternative for chronic thumb- and finger-sucking. Journal of Pediatric Psychology, 15, 57–65. 10.1093/jpepsy/15.1.57 [DOI] [PubMed] [Google Scholar]
- Gardner W, Kelleher KJ, Wasserman R, Childs G, Nutting P, Lillienfeld H, & Pajer K (2000). Primary care treatment of pediatric psychosocial problems: A study from pediatric research in office settings and ambulatory sentinel practice network. Pediatrics, 106(4), e44 10.1542/peds.106.4.e44 [DOI] [PubMed] [Google Scholar]
- Garland AF, Hawley KM, Brookman-Frazee L, & Hurlburt MS (2008). Identifying common elements of evidence-based psychosocial treatments for children’s disruptive behavior problems. Journal of the American Academy of Child & Adolescent Psychiatry, 47, 505–514. 10.1097/CHI.0b013e31816765c2 [DOI] [PubMed] [Google Scholar]
- Graham RP, James PA, & Cowan TM (2000). Are clinical practice guidelines valid for primary care? Journal of Clinical Epidemiology, 53, 949–954. 10.1016/S0895-4356(99)00224-3 [DOI] [PubMed] [Google Scholar]
- Graves MM, Roberts MC, Rapoff M, & Boyer A (2010). The efficacy of adherence interventions for chronically ill children: A meta-analytic review. Journal of Pediatric Psychology, 35, 368–382. 10.1093/jpepsy/jsp072 [DOI] [PubMed] [Google Scholar]
- Green LA, Fryer GE Jr., Yawn BP, Lanier D, & Dovey SM (2001). The ecology of medical care revisited. The New England Journal of Medicine, 344, 2021–2025. 10.1056/NEJM200106283442611 [DOI] [PubMed] [Google Scholar]
- Green LA, & Hickner J (2006). A short history of primary care practice-based research networks: From concept to essential research laboratories. Journal of the American Board of Family Medicine, 19, 1–10. 10.3122/jabfm.19.1.1 [DOI] [PubMed] [Google Scholar]
- Hacker KA, Myagmarjav E, Harris V, Suglia SF, Weidner D, & Link D (2006). Mental health screening in pediatric practice: Factors related to positive screens and the contribution of parental/personal concern. Pediatrics, 118, 1896–1906. 10.1542/peds.2006-0026 [DOI] [PubMed] [Google Scholar]
- Hagan JF, Shaw JS, & Duncan PM (2008). Bright futures: Guidelines for health supervision of infants, children, and adolescents. Elk Grove Village, IL: American Academy of Pediatrics. [Google Scholar]
- Hawkins NG, Sanson-Fisher RW, Shakeshaft A, D’Este C, & Green LW (2007). The multiple baseline design for evaluating population-based research. American Journal of Preventive Medicine, 33, 162–168. 10.1016/j.amepre.2007.03.020 [DOI] [PubMed] [Google Scholar]
- Heintzman J, Gold R, Krist A, Crosson J, Li-kumahuwa S, & DeVoe JE (2014). Practice-based research networks (PBRNs) are promising laboratories for conducting dissemination and implementation research. Journal of the American Board of Family Medicine, 27, 759–762. 10.3122/jabfm.2014.06.140092 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Heller RF, & Page J (2002). A population perspective to evidence based medicine: “Evidence for population health.” Journal of Epidemiology and Community Health, 56, 45–47. 10.1136/jech.56.1.45 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hemming K, Haines TP, Chilton PJ, Girling AJ, & Lilford RJ (2015). The stepped wedge cluster randomised trial: Rationale, design, analysis, and reporting. British Medical Journal, 350, h391 10.1136/bmj.h391 [DOI] [PubMed] [Google Scholar]
- Hobbs Knutson K (2017). Payment for integrated care: Challenges and opportunities. Child and Adolescent Psychiatric Clinics of North America, 26, 829–838. 10.1016/j.chc.2017.06.010 [DOI] [PubMed] [Google Scholar]
- Hoffses KW, Riley AR, Menousek K, Schellinger K, Grennan A, Cammarata C, & Steadman JL (2017). Professional practices, training, and funding mechanisms: A survey of pediatric primary care psychologists. Clinical Practice in Pediatric Psychology, 5, 39–49. 10.1037/cpp0000173 [DOI] [Google Scholar]
- Horn SD, & Gassaway J (2007). Practice-based evidence study design for comparative effectiveness research. Medical Care, 45(10, Suppl. 2), S50–S57. 10.1097/MLR.0b013e318070c07b [DOI] [PubMed] [Google Scholar]
- Horwitz SM, Storfer-Isser A, Kerker BD, Szilagyi M, Garner A, O’Connor KG, … Stein RE (2015). Barriers to the identification and management of psychosocial problems: Changes from 2004 to 2013. Academic Pediatrics, 15, 613–620. 10.1016/j.acap.2015.08.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hunter CL, Funderburk JS, Polaha J, Bauman D, Goodie JL, & Hunter CM (2017). Primary Care Behavioral Health (PCBH) model research: Current state of the science and a call to action. Journal of Clinical Psychology in Medical Settings. Advance online publication. 10.1007/s10880-017-9512-0 [DOI] [PubMed] [Google Scholar]
- Hussey PS, Ridgely MS, & Rosenthal MB (2011). The PROMETHEUS bundled payment experiment: Slow start shows problems in implementing new payment models. Health Affairs, 30, 2116–2124. 10.1377/hlthaff.2011.0784 [DOI] [PubMed] [Google Scholar]
- Jellinek MS, Murphy JM, Little M, Pagano ME, Comer DM, & Kelleher KJ (1999). Use of the Pediatric Symptom Checklist to screen for psychosocial problems in pediatric primary care: A national feasibility study. Archives of Pediatrics & Adolescent Medicine, 153, 254–260. 10.1001/archpedi.153.3.254 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kanoy KW, & Schroeder CS (1985). Suggestions to parents about common behavior problems in a pediatric primary care office: Five years of follow-up. Journal of Pediatric Psychology, 10, 15–30. 10.1093/jpepsy/10.1.15 [DOI] [PubMed] [Google Scholar]
- Kathol RG, deGruy F, & Rollman BL (2014). Value-based financially sustainable behavioral health components in patient-centered medical homes. Annals of Family Medicine, 12, 172–175. 10.1370/afm.1619 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kazak AE, Nash JM, Hiroto K, & Kaslow NJ (2017). Psychologists in patient-centered medical homes (PCMHs): Roles, evidence, opportunities, and challenges. American Psychologist, 72, 1–12. 10.1037/a0040382 [DOI] [PubMed] [Google Scholar]
- Kazdin AE, & Blase SL (2011). Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspectives on Psychological Science, 6, 21–37. 10.1177/1745691610393527 [DOI] [PubMed] [Google Scholar]
- Kelleher KJ, Childs GE, Wasserman RC, McInerny TK, Nutting PA, & Gardner WP (1997). Insurance status and recognition of psychosocial problems. Archives of Pediatrics & Adolescent Medicine, 151, 1109–1115. 10.1001/archpedi.1997.02170480039006 [DOI] [PubMed] [Google Scholar]
- Kelleher KJ, Moore CD, Childs GE, Angelilli ML, & Comer DM, & the Pediatric Research in Office Settings. Ambulatory Sentinel Practice Network. (1999). Patient race and ethnicity in primary care management of child behavior problems: A report from PROS and ASPN. Medical Care, 37, 1092–1104. 10.1097/00005650-199911000-00002 [DOI] [PubMed] [Google Scholar]
- Kessler R (2008). Integration of care is about money too: The health and behavior codes as an element of a new financial paradigm. Families, Systems, & Health, 26, 207–216. 10.1037/a0011918 [DOI] [Google Scholar]
- Kessler R, & Stafford D (2008). Primary careis the de facto mental health system In Kessler R & Stafford D (Eds.), Collaborative medicine case studies (pp. 9–21). New York, NY: Springer; 10.1007/978-0-387-76894-6_2 [DOI] [Google Scholar]
- Kolko DJ, Campo J, Kilbourne AM, Hart J, Sakolsky D, & Wisniewski S (2014). Collaborative care outcomes for pediatric behavioral health problems: A cluster randomized trial. Pediatrics, 133(4), e981–e992. 10.1542/peds.2013-2516 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kolko DJ, Campo JV, Kilbourne AM, & Kelleher K (2012). Doctor-office collaborative care for pediatric behavioral problems: A preliminary clinical trial. Archives of Pediatrics & Adolescent Medicine, 166, 224–231. 10.1001/archpediatrics.2011.201 [DOI] [PubMed] [Google Scholar]
- Kunkle KL, & Ortiz C (2016). Maternal treatment acceptability and preference of room time-out and deferred time-out escape contingencies. Child & Family Behavior Therapy, 38, 105–123. 10.1080/07317107.2016.1172875 [DOI] [Google Scholar]
- McMenamy J, Sheldrick RC, & Perrin EC (2011). Early intervention in pediatrics offices for emerging disruptive behavior in toddlers. Journal of Pediatric Health Care, 25, 77–86. 10.1016/j.pedhc.2009.08.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- McMillan JA, Land M Jr., & Leslie LK (2017). Pediatric residency education and the behavioral and mental health crisis: A call to action. Pediatrics, 139, e20162141 10.1542/peds.2016-2141 [DOI] [PubMed] [Google Scholar]
- Meadows T, Valleley R, Haack MK, Thorson R, & Evans J (2011). Physician “costs” in providing behavioral health in primary care. Clinical Pediatrics, 50, 447–455. 10.1177/0009922810390676 [DOI] [PubMed] [Google Scholar]
- Mesibov GB, Schroeder CS, & Wesson L (1977). Parental concerns about their children. Journal of Pediatric Psychology, 2, 13–17. 10.1093/jpepsy/2.1.13 [DOI] [Google Scholar]
- Miller BF, Ross KM, Davis MM, Melek SP, Kathol R, & Gordon P (2017). Payment reform in the patient-centered medical home: Enabling and sustaining integrated behavioral health care. American Psychologist, 72, 55–68. 10.1037/a0040448 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mindell JA, Kuhn B, Lewin DS, Meltzer LJ, & Sadeh A, & the American Academy of Sleep Medicine. (2006). Behavioral treatment of bedtime problems and night wakings in infants and young children. Sleep: Journal of Sleep and Sleep Disorders Research, 29, 1263–1276. [PubMed] [Google Scholar]
- Miyamoto RE (2006). Billing effectively with the new health and behavior current procedural terminology codes in primary care and specialty clinics. Journal of Clinical Psychology, 62, 1221–1229. 10.1002/jclp.20299 [DOI] [PubMed] [Google Scholar]
- Moore BA, Friman PC, Fruzzetti AE, & MacAleese K (2006). Brief report: Evaluating the Bedtime Pass Program for child resistance to bed-time—a randomized, controlled trial. Journal of Pediatric Psychology, 32, 283–287. 10.1093/jpepsy/jsl025 [DOI] [PubMed] [Google Scholar]
- Morawska A, & Sanders M (2011). Parental use of time out revisited: A useful or harmful parenting strategy? Journal of Child and Family Studies, 20, 1–8. 10.1007/s10826-010-9371-x [DOI] [Google Scholar]
- Murphy SA (2005). An experimental design for the development of adaptive treatment strategies. Statistics in Medicine, 24, 1455–1481. 10.1002/sim.2022 [DOI] [PubMed] [Google Scholar]
- Nasir A, Watanabe-Galloway S, & DiRenzo-Coffey G (2016). Health services for behavioral problems in pediatric primary care. The Journal of Behavioral Health Services & Research, 43, 396–401. 10.1007/s11414-014-9450-7 [DOI] [PubMed] [Google Scholar]
- Norlin C, Crawford MA, Bell CT, Sheng X, & Stein MT (2011). Delivery of well-child care: A look inside the door. Academic Pediatrics, 11, 18–26. 10.1016/j.acap.2010.12.008 [DOI] [PubMed] [Google Scholar]
- Normand MP (2014). Opening Skinner’s box: An introduction. The Behavior Analyst, 37, 67–68. 10.1007/s40614-014-0016-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nutting PA, Beasley JW, & Werner JJ (1999). Practice-based research networks answer primary care questions. Journal of the American Medical Association, 281, 686–688. 10.1001/jama.281.8.686 [DOI] [PubMed] [Google Scholar]
- Nutting PA, Crabtree BF, Miller WL, Stange KC, Stewart E, & Jaén C (2011). Transforming physician practices to patient-centered medical homes: Lessons from the national demonstration project. Health Affairs, 30, 439–445. 10.1377/hlthaff.2010.0159 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Olson LM, Inkelas M, Halfon N, Schuster MA, O’Connor KG, & Mistry R (2004). Overview of the content of health supervision for young children: Reports from parents and pediatricians. Pediatrics, 113(Suppl.), 1907–1916. [PubMed] [Google Scholar]
- Perrin EC, Sheldrick RC, McMenamy JM, Henson BS, & Carter AS (2014). Improving parenting skills for families of young children in pediatric settings: A randomized clinical trial. Journal of the American Medical Association Pediatrics, 168, 16–24. 10.1001/jamapediatrics.2013.2919 [DOI] [PubMed] [Google Scholar]
- Pew Research Center. (2015). Parenting in America: Outlook, worries, aspirations are strongly linked to financial situation. Retrieved from http://www.pewsocialtrends.org/files/2015/12/2015-12-17_parenting-in-america_FINAL.pdf
- Piazza CC, & Fisher W (1991). A faded bedtime with response cost protocol for treatment of multiple sleep problems in children. Journal of Applied Behavior Analysis, 24, 129–140. 10.1901/jaba.1991.24-129 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Piazza CC, Fisher W, Chinn S, & Bowman L (1991). Reinforcement of incontinent stools in the treatment of encopresis. Clinical Pediatrics, 30, 28–32. 10.1177/000992289103000105 [DOI] [PubMed] [Google Scholar]
- Pidano AE, Kimmelblatt CA, & Neace WP (2011). Behavioral health in the pediatric primary care setting: Needs, barriers, and implications for psychologists. Psychological Services, 8, 151–165. 10.1037/a0019535 [DOI] [Google Scholar]
- Polaha J, Volkmer A, & Valleley RJ (2007). A call-in service to address parent concerns about child behavior in rural primary care. Families, Systems, & Health, 25, 333–343. 10.1037/1091-7527.25.3.333 [DOI] [Google Scholar]
- Prueher I (2015, 2016, October 30). If you’re struggling with your child at bedtime, the bedtime pass can help. Retrieved from http://www.huffingtonpost.com/ingrid-prueher/if-youre-struggling-with-_b_8430550.html
- Puffer S, Torgerson DJ, & Watson J (2005). Cluster randomized controlled trials. Journal of Evaluation in Clinical Practice, 11, 479–483. 10.1111/j.1365-2753.2005.00568.x [DOI] [PubMed] [Google Scholar]
- Raffoul M, Moore M, Kamerow D, & Bazemore A (2016). A primary care panel size of 2500 is neither accurate nor reasonable. Journal of the American Board of Family Medicine, 29, 496–499. 10.3122/jabfm.2016.04.150317 [DOI] [PubMed] [Google Scholar]
- Rapoff MA, & Christophersen ER (1982). Improving compliance in pediatric practice. Pediatric Clinics of North America, 29, 339–357. 10.1016/S0031-3955(16)34145-1 [DOI] [PubMed] [Google Scholar]
- Regalado M, Larson K, Wissow LS, & Halfon N (2010). Factors associated with discipline counseling for parents of infants and young children. Academic Pediatrics, 10, 353–359. 10.1016/j.acap.2010.07.006 [DOI] [PubMed] [Google Scholar]
- Riley AR, Freeman KA, & Marshall S (2016). Dissemination of evidence-based behavioral advice via video in pediatric primary care. Clinical Pediatrics, 55, 122–128. 10.1177/0009922815586053 [DOI] [PubMed] [Google Scholar]
- Riley AR, Grennan A, Menousek K, & Hoffses KW (2017). Pediatric primary care psychologists’ reported level of integration, billing practices, and reimbursement frequency. Families, Systems, & Health. Advance online publication. 10.1037/fsh0000306 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Riley AR, Wagner DV, Tudor ME, Zuckerman KE, & Freeman KA (2017). A survey of parents’ perceptions and use of time-out in comparison to empirical evidence. Academic Pediatrics, 17, 168–175. 10.1016/j.acap.2016.08.004 [DOI] [PubMed] [Google Scholar]
- Roberts MC, & Lyman RD (1990). The psychologist as a pediatric consultant In Gross AM & Drabman RS (Eds.), Handbook of clinical behavioral pediatrics (pp. 11–27). New York, NY: Springer; 10.1007/978-1-4613-0505-7_2 [DOI] [Google Scholar]
- Roberts MC, & Wright L (1982). The role of the pediatric psychologist as consultant to pediatricians In Tuma JM (Ed.), Handbook for the practice of pediatric psychology (pp. 251–289). New York, NY: Wiley. [Google Scholar]
- Rozensky RH (2014). Implications of the Affordable Care Act for education and training in professional psychology. Training and Education in Professional Psychology, 8, 83–94. 10.1037/tep0000021 [DOI] [Google Scholar]
- Rushton J, Bruckman D, & Kelleher K (2002). Primary care referral of children with psychosocial problems. Archives of Pediatrics & Adolescent Medicine, 156, 592–598. 10.1001/archpedi.156.6.592 [DOI] [PubMed] [Google Scholar]
- Sanson-Fisher RW, Bonevski B, Green LW, & D’Este C (2007). Limitations of the randomized controlled trial in evaluating population-based health interventions. American Journal of Preventive Medicine, 33, 155–161. 10.1016/j.amepre.2007.04.007 [DOI] [PubMed] [Google Scholar]
- Scholer SJ, Hudnut-Beumler J, & Dietrich MS (2010). A brief primary care intervention helps parents develop plans to discipline. Pediatrics, 125(2), e242–e249. 10.1542/peds.2009-0874 [DOI] [PubMed] [Google Scholar]
- Scholer SJ, Nix RL, & Patterson B (2006). Gaps in pediatricians’ advice to parents regarding early childhood aggression. Clinical Pediatrics, 45, 23–28. 10.1177/000992280604500104 [DOI] [PubMed] [Google Scholar]
- Schroeder CS (1979). Psychologists in a private pediatric practice. Journal of Pediatric Psychology, 4, 5–18. 10.1093/jpepsy/4.1.5 [DOI] [PubMed] [Google Scholar]
- Schroeder CS (2004). Reaching beyond the guild In Wildman BW & Stancin T (Eds.), New directions for research and treatment of pediatric psychosocial problems in primary care (pp. 1–32). Westport, CT: Greenwood. [Google Scholar]
- Schuster MA, Duan N, Regalado M, & Klein DJ (2000). Anticipatory guidance: What information do parents receive? What information do they want? Archives of Pediatrics & Adolescent Medicine, 154, 1191–1198. 10.1001/archpedi.154.12.1191 [DOI] [PubMed] [Google Scholar]
- Semansky RM, Koyanagi C, & Vandivort-Warren R (2003). Behavioral health screening policies in Medicaid programs nationwide. Psychiatric Services, 54, 736–739. 10.1176/appi.ps.54.5.736 [DOI] [PubMed] [Google Scholar]
- Sharp L, Pantell RH, Murphy LO, & Lewis CC (1992). Psychosocial problems during child health supervision visits: Eliciting, then what? Pediatrics, 89(4 Part 1), 619–623. [PubMed] [Google Scholar]
- Sheldrick RC, Merchant S, & Perrin EC (2011). Identification of developmental-behavioral problems in primary care: A systematic review. Pediatrics, 128, 356–363. 10.1542/peds.2010-3261 [DOI] [PubMed] [Google Scholar]
- Smith EE, Rome LP, & Freedheim DK (1967). The clinical psychologist in the pediatric office. The Journal of Pediatrics, 71, 48–51. 10.1016/S0022-3476(67)80229-4 [DOI] [PubMed] [Google Scholar]
- Stabler B (1979). Emerging Models of Psychologist-Pediatrician Liaison 1. Journal of Pediatric Psychology, 4, 307–313. 10.1093/jpepsy/4.3.307 [DOI] [Google Scholar]
- Stancin T, & Perrin EC (2014). Psychologists and pediatricians: Opportunities for collaboration in primary care. American Psychologist, 69, 332–343. 10.1037/a0036046 [DOI] [PubMed] [Google Scholar]
- Stead LF, Bergson G, & Lancaster T (2013). Physician advice for smoking cessation. Cochrane Database of Systemcatic Reviews. Advance online publication. 10.1002/14651858.CD000165.pub4 [DOI] [PubMed] [Google Scholar]
- Stein RE, Storfer-Isser A, Kerker BD, Garner A, Szilagyi M, Hoagwood KE, … McCue Horwitz S (2016). Beyond ADHD: How well are we doing? Academic Pediatrics, 16, 115–121. 10.1016/j.acap.2015.08.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Talmi A, & Fazio E (2012). Commentary: Promoting health and well-being in pediatric primary care settings: Using health and behavior codes at routine well-child visits. Journal of Pediatric Psychology, 37, 496–502. 10.1093/jpepsy/jss047 [DOI] [PubMed] [Google Scholar]
- Talmi A, Muther EF, Margolis K, Buchholz M, Asherin R, & Bunik M (2016). The scope of behavioral health integration in a pediatric primary care setting. Journal of Pediatric Psychology, 41, 1120–1132. 10.1093/jpepsy/jsw065 [DOI] [PubMed] [Google Scholar]
- Taylor CA, Moeller W, Hamvas L, & Rice JC (2013). Parents’ professional sources of advice regarding child discipline and their use of corporal punishment. Clinical Pediatrics, 52, 147–155. 10.1177/0009922812465944 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Today.com. (2007). Trouble getting your kids to bed at night? Retrieved from https://www.today.com/parents/trouble-getting-your-kids-bed-night-2D80555678
- Tunis SR, Stryer DB, & Clancy CM (2003). Practical clinical trials: Increasing the value of clinical research for decision making in clinical and health policy. Journal of the American Medical Association, 290, 1624–1632. 10.1001/jama.290.12.1624 [DOI] [PubMed] [Google Scholar]
- Unützer J, Chan Y-F, Hafer E, Knaster J, Shields A, Powers D, & Veith RC (2012). Quality improvement with pay-for-performance incentives in integrated behavioral health care. American Journal of Public Health, 102(6), e41–e45. 10.2105/AJPH.2011.300555 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Walkup JT, Mathews T, & Green CM (2017). Transdiagnostic behavioral therapies in pediatric primary care. Journal of the American Medical Association Psychiatry, 74, 557–558. 10.1001/jamapsychiatry.2017.0448 [DOI] [PubMed] [Google Scholar]
- Warzak WJ, & Floress MT (2009). Time-out training without put-backs, spanks, or restraint: A brief report of deferred time-out. Child & Family Behavior Therapy, 31, 134–143. 10.1080/07317100902910570 [DOI] [Google Scholar]
- Westfall JM, Mold J, & Fagnan L (2007). Practice-based research—“Blue Highways” on the NIH roadmap. Journal of the American Medical Association, 297, 403–406. 10.1001/jama.297.4.403 [DOI] [PubMed] [Google Scholar]
- Weymouth J, Hudson A, & King N (1987). The management of children’s nighttime behaviour problems: Evaluation of an advice booklet. Behavioural Psychotherapy, 15, 123–133. 10.1017/S0141347300011216 [DOI] [Google Scholar]
- Williams J, Klinepeter K, Palmes G, Pulley A, & Foy JM (2004). Diagnosis and treatment of behavioral health disorders in pediatric practice. Pediatrics, 114, 601–606. 10.1542/peds.2004-0090 [DOI] [PubMed] [Google Scholar]
- Williams SB, O’Connor EA, Eder M, & Whitlock EP (2009). Screening for child and adolescent depression in primary care settings: A systematic evidence review for the US Preventive Services Task Force. Pediatrics, 123(4), e716–e735. 10.1542/peds.2008-2415 [DOI] [PubMed] [Google Scholar]
- Winett RA, Moore JF, & Anderson ES (1991). Extending the concept of social validity: Behavior analysis for disease prevention and health promotion. Journal of Applied Behavior Analysis, 24, 215–230. 10.1901/jaba.1991.24-215 [DOI] [PMC free article] [PubMed] [Google Scholar]
