Abstract
Objective
Because the integration of mental or behavioral health services in pediatric primary care is a national priority, a description and evaluation of the interventions applied in the healthcare setting is warranted. This paper examines several intervention research studies based on alternative models for delivering behavioral health care in conjunction with comprehensive pediatric care.
Method
This review describes the diverse methods applied to different clinical problems, such as brief mental health skills, clinical guidelines, and evidence-based practices (EBP), and the empirical outcomes of this research literature. Next, several key treatment considerations are discussed to maximize the efficiency and effectiveness of these interventions. Some practical suggestions for overcoming key service barriers are provided to enhance the capacity of the practice to deliver behavioral health care.
Results
There is moderate empirical support for the feasibility, acceptability, and clinical utility of these interventions for treating internalizing and externalizing behavior problems. Practical strategies to extend this work and addressing methodological limitations are provided that draw upon recent frameworks designed to simplify the treatment enterprise (e.g., common elements).
Discussion
Pediatric primary care has become an important venue for providing mental health services to children and adolescents due, in part, to its many desirable features (e.g., no stigma, local setting, familiar providers). Further adaptation of existing delivery models may promote the delivery of effective integrated interventions with primary care providers as partners designed to address mental health problems in pediatric healthcare.
Keywords: pediatric primary care, integrated mental health services, collaborative care, behavioral health services, pediatric mental health care
The Pediatric Primary Care Setting as a Context for Mental Health Services
Primary care settings, such as pediatric or family medicine practice, play an important role in addressing the mental health needs of children and adolescents (Kelleher & Stevens, 2009; Stille et al., 2010). In the healthcare arena, mental health disorders are commonly referred to as behavioral health (BH) problems, which reflect those broad conditions related to emotional health that include substance use, abuse, or addiction, mental illness, and mental disorders (Substance Abuse and Mental Health Services Administration, 2011). Some of the more common child or adolescent BH problems seen in primary care include oppositional or aggressive behavior, attention deficit hyperactivity disorder, anxiety and depression, autism spectrum disorders, learning problems, and substance use (Roongpraiwan, Efron, Sewell, & Mathai, 2007). At least four reasons contribute to the importance of primary care as a venue for the delivery of services to address these problems, as briefly noted below.
Behavioral Health Problems in Pediatric Settings are Prevalent and Burdensome
Pediatric BH problems convey significant public health impact on home and school adjustment, family functioning, and health service costs (Wissow, Anthony, et al., 2008). For example, children with disruptive behavior disorders (i.e., oppositional and aggressive behavior, hyperactivity and inattentiveness) represent the largest single source of referrals to child mental health settings (Schuhmann, Durning, Eyberg, & Boggs, 1996). Commonly identified initially by primary care providers (PCP), such problems are prevalent from preschool through adulthood (16–19%), are associated with significant clinical comorbidities (e.g., anxiety, depression) and functional impairments (Caspi, Moffitt, Newman, & Silva, 1996), and are highly stable over time (Shaw & Gross, 2008). Anxiety, depressive, and substance use disorders are also prevalent and associated with broad psychosocial impairments (e.g., early school dropout, social withdrawal, peer problems, suicidality; [Costello, 1989]). Due to their limited use of services, many children with behavioral health problems have multiple system involvement (e.g., child welfare, juvenile justice).
Specialty Mental Health has Many Limitations
Despite the high rates of pediatric BH disorders, four of out five children ages 6 to 17 with a mental health problem do not receive any help (Soni, 2009). Some of the reasons for this scenario reflect limitations in treatment access, acceptability, and impact that cut across problems and disorders (Kelleher & Stevens, 2009). Common obstacles include the unavailability of appropriate providers, insurance restrictions, long delays for services, high drop-out or no-show rates, limited quality but high cost of care, stigma, and poor communication between the mental and physical health professions (Kolko, 2009). Thus, many children with BH problems receive suboptimal care and suffer significant long-term impairments.
The Chronic Care Model Can Improve Illness Care
The increasing need to address chronic health conditions requiring extended care and lifestyle modifications has been promoted through use of the Chronic Care Model or CCM, an established method for improving chronic illness care (Von Korff, Gruman, Schaefer, Curry, & Wagner, 1997). The CCM incorporates six core elements to organize and manage several clinical resources (e.g., practice re-design, information systems; see next section for more details), including the flexible use of clinical care managers as educators, consultants, and clinicians working collaboratively with the PCP (Katon et al., 1995; Wagner, Austin, & Von Korff, 1996). In the context of BH problems, the CCM has been adapted to address the demands of chronic mental health conditions that require ongoing treatment activities completed by both patients and their providers (Katon, Unützer, Wells, & Jones, 2010). Nearly 60 clinical trials evaluating a CCM-based intervention in primary care have documented improved outcomes for several psychiatric disorders in adults, including depression, anxiety, and bipolar disorder (Woltmann et al., 2012). The CCM provides an important treatment direction for providing comprehensive care to pediatric patients (Bower-Russa, Knutson, & Winebarger, 2001; Wissow, Anthony, et al., 2008).
Health Policy Initiatives Seek to Improve Care Access, Comprehensiveness, and Quality
As the standard of care for health care delivery, the patient-centered medical (or health) home (PCMH) has encouraged a type of care that is easily accessible, continuous, comprehensive, family centered, coordinated, and delivered or directed by well trained physicians known to child and family (Turchi, Gatto, & Antonelli, 2007). When combined with additional service elements (e.g., patient involvement in their own health and well-being, using the best available evidence and appropriate technology (Stille et al., 2010), the PCMH is a natural venue for incorporating pediatric BH services. Integration is also a priority (Kelleher & Stevens, 2009) in the Affordable Care Act [ACA](Department of Health and Human Services, 2012), driven, in part, by the need to address the availability, quality, and cost of services. One implication of the ACA for pediatric patients is its focus on fostering access to care for all children in a PCMH, especially those with unmet BH needs (Asarnow et al., 2005; Committee on Psychosocial Aspects of Child and Family Health and Task Force on Mental Health, 2009; Foy, Kelleher, Laraque, & The American Academy of Pediatrics Task Force on Mental Health, 2010; Roongpraiwan et al., 2007; Turchi et al., 2007).
Models for the Delivery of Pediatric Behavioral Health Services
Several approaches have guided the delivery of mental health services in the pediatric setting (Perrin & Sheldrick, 2010; American Academy of Child and Adolescent Psychiatry, 2010; Guevara, Greenbaum, Shera, Bauer, & Schwartz, 2009; Novotney, 2010). These models reflect the different programmatic and fiscal needs or resources found in a given practice (e.g., scope, complexity, and cost of services, use of evidence-based practices or EBP, provider and family burden [Kelleher, Campo, & Gardner, 2006]). Five approaches that vary primarily in level of service integration have been described: 1) external coordination, 2) consultation, 3) training for the PCP, 4) on-site intervention (but without apparent PCP collaboration), and 5) on-site intervention with collaboration (American Academy of Child and Adolescent Psychiatry, 2010; S. McDaniel, Campbell, & Seaburn, 1990; Perrin & Sheldrick, 2011; R. C. Sheldrick & Perrin, 2010). These models incorporate and extend some of the components noted in recent frameworks (Brown & Wissow, 2012; Wissow, Anthony, et al., 2008) that describe key mental health skills for the primary care setting (i.e., general mental health skills, brief interventions for major mental health problems, EBPs for diagnosis-specific disorders). We briefly review some empirical examples of each model in this section.
Coordination with an External Provider
A few reports have described or evaluated programs in which the PCP and an outside mental health provider have shared cases to deliver coordinated BH services but in each of their respective offices. In one recent program (Targeted Child Psychiatric Services; Connor et al., 2006), a psychiatrist, nurse, or social worker provided consultation after conducting and discussing the results of an initial evaluation (Aupont et al., 2012). They jointly determined the treatment plan. One third of all referrals were returned to the PCP for follow-up services; the rest were treated by an outside provider. Brief ratings by the outside provider collected during treatment showed improvements in severity of symptoms and psychosocial adjustment, though the absence of controls and formal patient self reports limits the significance of these outcomes. Importantly, this model allows for children with diverse BH needs to receive services in an appropriate setting. It is worth mentioning that this arrangement occurs far more often in practice than it is studied or even reported, as this model is typical of how PCPs work with specialists, including those who deliver BH services.
Consultation with the Primary Care Provider
The consultation model has generally provided brief and focused clinical advice and recommendations to a primary care provider (e.g., diagnostic feedback, medication options) by peer experts or specialty mental health providers (e.g., psychiatrists, social workers). These contacts vary in terms of their intensity/frequency (single vs. ongoing), relationship to the consultant (familiar/local vs. distant expert), and format (phone consultation, written reports, web-conferencing), but do not include on-site or co-located BH services. Thus, access is influenced by schedule and availability. Several regional networks and state-wide initiatives have developed programs that provide phone consultation to the PCP with a clinical resource (psychiatrist, social worker) and occasional follow-up client appointments or referrals (National Network of Child Psychiatry Access Programs, 2012). In one state-wide program (Massachusetts Child Psychiatry Access Project, MCPAP), the PCP can call to obtain consultation about care decisions (e.g., diagnostic dilemmas, choice and dose of medication, recommended monitoring, follow-up) and there is an option to provide short term intervention and referral assistance (Sarvet et al., 2010; R.C. Sheldrick, Mattern, & Perrin, 2012). These authors note that caregivers informally reported improvements in child symptoms and that the PCPs were satisfied with the program.
Training the Primary Care Provider in Mental Health Skills
Ongoing peer consultation has been used to help PCPs diagnose and manage children with ADHD more effectively (e.g., recommendations for medication management). For example, work by Epstein has examined a collaborative consultative service with an expert pediatrician to promote the use of clinical practice guidelines for ADHD established by the American Academy of Pediatrics or AAP (American Academy of Pediatrics, 2001) in a large practice network, such as using titration trials and periodic monitoring during medication maintenance (Epstein et al., 2007). Self reports revealed greater use of these practices by community pediatricians, but there was no significant improvement in children’s ADHD symptom relative to a comparison group. Within the consultation group, however, those PCPs who used these methods had children whose ADHD symptoms had improved. Extensions of this program that included focused academic detailing have documented greater use of rating scales, systematic monitoring of response (Epstein et al., 2008), and improvements in children’s ADHD symptoms at home and school (Epstein et al., 2010). Other programs for training PCPs in various psychosocial and pharmacologic skills to hep manage BH problems in children and adolescents have been provided through the REACH Institute (http://www.thereachinstitute.org). This program is also evaluating the impact of training on attitudes, skills, and clinical practices related to treating ADHD, which will provide novel data on large-scale practice change efforts.
Other programs have sought to more formally enhance the PCPs repertoire using brief mental health assessment and communication skills (Brown, Wissow, & Riley, 2007; Gledhill, Kramer, Iliffe, & Garralda, 2003; Regalado, Larson, Wissow, & Halfon, 2010) or by using group workshops or tutorials to improve communication among parents, teachers, and primary care providers of children with ADHD (Wolraich, Bickman, Lambert, Simmons, & Doffing, 2005). In one of the more extensive curricula reported, PCPs were trained in seven broad mental health management skills, such as agenda setting, problem-formulation, managing negative affect and resistance, and advice giving (types of “common factors”; see next section). Training was associated with improvements in parent-rated child functioning and youth-rated symptoms at 6-month follow-up (Wissow, Gadomski, et al., 2008). Other training programs have documented greater use of screening measures for depression (Gledhill et al., 2003) but some reports document limited impact on the delivery (Gadomski, Wissow, Slade, & Jenkins, 2010) or impact of similar interventions (Brown & Wissow, 2009; Wolraich, Bickman et al., 2005).
On-site Intervention
On-site programs typically use a trained or prepared clinician to deliver BH services in the practice, but often with minimal PCP or team participation. Because such practitioners may work fairly independently, this arrangement often involves limited care coordination or collaboration with other members of the child’s healthcare team. In some cases, this may involve renting space in the practice to a mental health practitioner. Several reports are based on controlled studies evaluating the delivery of standardized EBPs with children or adolescents.
Two case reports treated internalizing problems using a brief 8-session behavior therapy that targets anxiety and depression (Weersing, Gonzalez, Campo, & Lucas, 2008) that includes educational (e.g., flight or fight reaction), skill-building (activation, exposure), and practice sessions (e.g., engagement plans). An extension of this approach also focused on somatic symptoms (Weersing, Rozenman, Maher-Bridge, & Campo, 2012). Case examples reported improvements in all three problems using indigenous clinicians in two pediatric practices. The authors suggest that an active behavioral approach may promote improvement, though they also recognize the need for a more rigorous evaluation.
One other study targeting depression examined an internet-based depression prevention program (CATCH-IT [Van Vorhees et al., 2007]) with two different engagement approaches applied by the PCP in a randomized trial in 84 adolescents with persistent subthreshold depression (B. W. Van Voorhees et al., 2009). One version was delivered using a motivational interview (MI) with 3 follow-up phone calls from a social worker, and the other was delivered using more directive, brief advice (BA). Both groups had a high level of contact with the internet program (91%, 78%) and showed improvements (fewer depressive symptoms and cases with significant depressive symptoms), but the MI group showed some additional benefits (fewer self harm thoughts, less hopelessness, fewer depressive episodes) at 12-week assessment. These promising results highlight the potential benefit of PCP-delivered and supported internet-based interventions that may reduce cost and promote efficient access to effective care for adolescents.
Turning to the externalizing problems, several novel interventions or existing EBPs have been applied, consistent with policy recommendations to improve services for this problem (Scholer et al., 2006). A set of studies by Lavigne and colleagues were based on a rigorous randomized trial in preschoolers with Oppositional Defiant Disorder (ODD) that found significant but comparable improvements in 1-year outcomes after an EBP (Incredible Years) that was either delivered on-site by a nurse or off-site by a local pediatric psychologist, or the receipt of bibliotherapy only (Lavigne, LeBailly, Gouze, Cicchetti, Jessup et al., 2008). Girls showed more improvement than boys in the nurse-led EBP, but boys showed more improvement in bibliotherapy (Lavigne, LeBailly, Gouze, Cicchetti, Pochyly et al., 2008). Several baseline variables were related to greater improvement in ODD outcome (e.g., life events, parenting distress, child internalizing problems, functional impairment, difficult temperament). Follow-up analyses found that caregivers with lower or higher levels of education were more likely to attend the psychologist-led and nurse-administered EBPs, respectively (Lavigne et al., 2010).
These results are consistent with other recent studies that have evaluated alternative EBPs. One trial with 30 young children evaluated a brief, 4-session, group version of Parent Child Interaction Training (PCIT), called Primary-Care PCIT, relative to a condition in which parents received a basic manual with guidelines (PCIT-Anticipatory Guidance). The two conditions had comparable effects on caregiver-reported child problem behaviors, ineffective parenting strategies, and satisfaction at posttreatment which were maintained by 6-month follow-up (Berkovits, O’Brien, Carter, & Eyberg, 2010). Likewise, caregivers of 30 young children were randomized to a 4-session behavioral family intervention (Primary Care Triple P-Positive Parenting Program) or a wait-list control condition (Turner & Sanders, 2006). Relative to controls, the Primary Care Triple P program reported several significant improvements (severity of targeted child behavior problems, dysfunctional parenting, parental stress and anxiety, parental satisfaction with parenting), most of which were maintained by 6-month follow-up. No differences were found on other reports (child behavior problems, disruptive behavior) and parent-child observations (e.g., child behavior, aversive or positive parenting).
Finally, three studies examined the impact of exposure to media-based programs. In one randomized trial (n = 224), caregivers who completed a brief screen (Pediatric Symptom Checklist; PCS-17 [Jellinek et al., 1999]) were assigned to an intervention or control group. In the intervention group, the PCP reviewed the screen, made a referral, and scheduled a follow-up visit, and then a parent educator conducted counseling sessions by telephone using a positive parenting curriculum (nurturance, discipline, respect). The intervention group showed significant improvements on self-reports of child problems (aggression, delinquency, attention problems, including reports of children fighting, being bullied, or sustaining fight-related injuries). The study highlights the potential benefit of phone calls for sessions, though the wide variation in treatment exposure suggests that further evaluation of these components is warranted. Two uncontrolled studies of parental exposure to a brief (15 minutes) multimedia educational program (Play Nicely, 2 ed.) that teaches childhood aggression management skills found that parents reported benefits in terms of their practices after viewing (Scholer, Mukherjee, Gibbs, Memon, & Jongeward, 2007) and at one year follow-up (Scholer et al., 2006).
On-site Collaborative Care
On-site collaborative care represents the integration of a clinical resource who works directly with the PCP and/treatment team to prevent, identify, and manage BH problems in the practice (Kolko, 2009), thus facilitating the sharing of a number of key clinical functions (Perrin, 1999). Successful collaborations often include practice-wide BH functions, such as timely access to consultation, direct clinical service, care coordination and communication with shared-decision making, PCP education or training, and continuity of care (American Academy of Child and Adolescent Psychiatry, 2010). A practical model is found in the work of Campo et al., 2005, which described a model for treating BH problems in pediatric primary care using a trained nurse practitioner who is a member of the treatment team.
In contrast to the extensive literature on CCM-based collaborative care intervention trials with adult patients, there are only a few such trials with pediatric BH problems. Two trials reported positive results with adolescent depression. Asarnow et al. (2005) conducted a randomized trial (n = 418) in five healthcare settings that compared collaborative care management with treatment as usual (TAU). The care management intervention was broad-based (e.g., expert leader teams, care managers who supported PCPs in evaluating and managing depression, patient and clinician choice regarding treatment modality, clinician training in evaluation and psychosocial and pharmacological treatment). Relative to TAU, collaborative care was more effective in promoting service use, reducing depressive symptoms and disorders, promoting adjustment, and enhancing satisfaction. However, modest rates of psychotherapy (32% vs. 21%) and medication use (13% vs. 16%) were reported for both conditions. A follow-up study revealed a significantly lower likelihood of severe depression for collaborative care (vs. EUC) at 6-month, but not at 18-month, follow-up (Asarnow et al., 2009).
A pilot study extended the collaborative care model for adolescent depression by incorporating additional CCM principles (care manager, enhanced patient and parent psychoeducation, patient choice for medication [mostly SSRI’s] and/or psychotherapy [6–8 sessions of CBT], follow-up tracking of symptoms. oversight by a mental health specialist). The 42 patients received an average of 9 visits or calls in their chosen intervention option. At 6-month follow-up, 74% of the youth showed at least a 50% reduction in self-reported depressive symptoms with high levels of patient and provider satisfaction (Richardson, McCauley, & Katon, 2009), which compares to the results of Asarnow et al. (2005). The adolescents were especially supportive of teaching parents more about the treatments they received.
Several trials have targeted children with behavior problems. A randomized trial with 163 children and their caregivers compared a protocol for a pediatric office-based, nurse-administered intervention (PONI) to enhanced usual care (EUC) consisting of brief assessment recommendations and a facilitated referral to a local specialist (Kolko, Campo, Kelleher, & Cheng, 2010). Nearly two-thirds of these children had co-morbid ADHD. PONI included several abbreviated content modules (e.g., child CBT, parent management practice, family problem solving, peer and school programs, medication regimen) from a prior intervention for behavior problems and ADHD (Kolko et al., 2009). Relative to EUC, PONI was associated with several improvements (e.g., service completion, child health/adjustment, individualized behavioral targets, client and PCP satisfaction, fewer treatment barriers, ADHD remission) at 1-year follow-up. However, both groups showed improvements on several outcomes (e.g., severity of behavior, inattention, and internalizing problems, functional impairment, peer relations). One-half of the children with ADHD or either ODD or CD were in remission by one-year follow-up. A few variables predicted overall child health improvement, such as the severity of child depression or anxiety, and family conflict (Kolko, Cheng, Campo, & Kelleher, 2011).
To improve upon these modest effects, the PONI condition was expanded by incorporating the six principles of the CCM (Doctor-Office Collaborative Care; DOCC) to target both behavior problems and two comorbid disorders (ADHD, anxiety). The components that were adapted to address each principle and the topics within each clinical content area that were included are listed in Table 1. DOCC included additional evidence-based medication management guidelines to target ADHD (American Academy of Pediatrics, 2001) and brief behavior therapy for anxiety (Weersing et al., 2008). Clinicians (nurse, social worker) served as a care manager (CM) who delivered and coordinated services with practice staff, especially the PCP. A two-year pilot effectiveness trial documented the feasibility, fidelity, and acute impact of DOCC for children referred for modest behavior problems, relative to EUC (Kolko, Campo, Kilbourne, & Kelleher, 2012). Although improvements were found in several outcomes for both conditions, DOCC showed significantly greater service use, improvement in individualized target behaviors, reductions in severity of oppositionality, inattention, hyperactivity, and functional impairment, and consumer satisfaction. However, this study was limited by the small sample size, absence of follow-up, and limited training of PCPs in ADHD management.
Table 1.
Chronic Care Model Principle and Core Elements | Clinical Content/Topics |
---|---|
Leadership Team: PCP and CM as treatment team with facilitator | Assessment Measures: Vanderbilt ADHD Parent Diagnostic Rating Scale; IGAR, PEDS-QL |
Decision Support: Automated assessments; EBP medication & psychosocial treatment of ADHD | Engagement: Intake assessment findings, orientation, psychoeducation, rules |
Delivery System Design: CM delivers services via liaison with PCP; care management process | Self Management: Positive thoughts, managing stress, emotion regulation |
Clinical Information Systems: Integrated notes; case reviews with PCP to monitor progress/plans; data collection options | Behavior Change: Attending/ignoring, promoting positives, punishment, home contingencies, problem-solving, social skills |
Self-Management Support: Psychoeducational materials & workbook, assessment summary and discharge Suggestions | Maintenance: Family problem-solving & family communication; emotionally and physically harsh interactions |
Community Resources: Referral list; mobilization of community resources to assist families (e.g., local ADHD advocacy group). | ADHD Medication Management: triage, psychoeducation, decision making, consultation and monitoring; survival school skills |
Key: PCP = pediatric care provider; CM = care manager; EBP = evidence-based practice; ADHD = attention deficit hyperactivity disorder; IGAR = individual goal achievement ratings; PEDS-QL = pediatric quality of life inventory.
Feedback from the families and PCPs in this pilot study was used to extend the scope, procedures, and evaluation of the DOCC approach (Kolko, Campo, Kilbourne, Hart, & Sakolsky, 2013; Kolko, Jackson, Kilbourne, Sakolsky, & Campo, 2013), which included several elements (e.g., PCP training in ADHD care management, improved case tracking, expanded referral network). Focus groups were conducted with PCPs in both conditions every six months to solicit and address perceived study benefits, barriers, and recommendations. Eight pediatric practices were randomized to DOCC or EUC with a sample of 321 families. Relative to EUC, DOCC was associated with several improvements on patient (e.g., child and caregiver participation, severity of behavior problems and ADHD symptoms, remission rates for behavior and internalizing problems, treatment response) and PCP self-reports (e.g., perceived competency, skill in ADHD medication management), with maintenance at 1-year follow-up (Kolko, Campo et al., 2013). Based on the focus groups (Kolko, Jackson et al., 2013), DOCC practices reported concerns with practical issues (e.g., space), whereas EUC practices reported concerns about patient reactions (e.g., referral follow-up or stigma). These results further support the acceptability of CCM-based interventions and incorporation of PCP feedback on implementation over time.
A recent outcome study incorporated practice staff as co-therapists with a mental health provider to deliver an EBP to address young children’s disruptive behavior (Perrin, Sheldrick, McMenamy, Henson, & Carter, in press). The Incredible Years (IY) was administered in a 10-week group program to caregivers of 2 to 4 year-old children in a randomized trial in 11 offices. A total of 345 parents were assigned to three conditions: randomly assigned to parent training group (PTG), randomly assigned to wait-list control (WL), and non-random PTG. The groups were led by a psychologist and a trained practice staff member (nurse, social worker). Compared to WL controls, the two PTG groups showed greater reductions in reports of negative parenting behaviors and child behavior problems, which were supported by observed parent-child interactions, after treatment and at one-year follow-up. This study supports the benefits of offering parent training in primary care (Berkovits et al., 2010; Turner & Sanders, 2006) and the feasibility of training pediatric staff to co-lead an on-site, EBP-based, parenting group.
One final and unique application involved the placement of a psychiatrically trained pediatrician in the pediatric practice to conduct several functions (education and consultation, diagnostic evaluations, record reviews, community resources) in nine pediatric practices (Goodfriend, Thomas, Livingood, & Goldhagen, 2006). The primary activities were conducting an evaluation (42%), followed next by teaching lectures (22%). Medical record data indicated a significant increase in the number of mental health diagnoses identified by the pediatricians. The potential benefit of this program is its potential to model all of these comprehensive BH services.
Lessons Learned: How to Make Pediatric Behavioral Healthcare More Effective
Several BH interventions based on different delivery models and levels of care integration have been applied in settings serving children and adolescents, many of which involve common EBPs (Stancin, Perrin, & Ramirez, 2009). These interventions have included external coordination of specialty services delivered in a different setting, PCP consultation, PCP training in brief mental health skills, an on-site clinician to administer intervention, and collaborative care in which on-site services are delivered by a clinician in coordination with the child’s PCP. The selection of a particular delivery model is most likely based on the types of practice resources available to administer treatment (e.g., access to an existing clinician or CM) as well as financial arrangements.
Although we did not conduct a meta-analysis of outcomes, evaluations of these diverse interventions using alternative experimental designs (uncontrolled pilot studies, randomized trials) have documented benefits on several BH outcomes. These improvements have included multiple gains (e.g., lower ratings of internalizing and externalizing problems, and functional impairment, higher remission rates for specific disorders). Some studies have reported improvements in observed child behavior, parental functioning and practices, and consumer satisfaction. Most outcomes were maintained at short-term follow-up. At the same time, these studies raise clinical or practical challenges to service integration, such as the need to find, train, and fund an appropriate clinician, the burden to providing comprehensive but routine mental health care in a medical home, and the expectation of developing a broad range of BH expertise.
The empirical limitations of this literature also bear mention (e.g., uncontrolled designs, small samples, limited collection of PCP measures, few follow-ups that include downstream health-related outcomes). In general, the conduct of large trials with diversity (e.g., geography, practice staff, population, intervention) would expand the knowledge base on integrated care. In addition, several key features of effective collaborative care trials with adults have been identified, including patient self-management, PCP involvement in patient monitoring, patient assessment at baseline and follow-up, and having 16 weeks of care with patient follow-up (Rubenstein et al., 2009; Woltmann et al., 2012). Of course, obtaining sufficient funding for rigorous trials of this kind of “practice re-design” in pediatric primary care is a salient challenge.
To address these and other future directions, several treatment features or practice functions that may enhance the capacity to integrate and sustain effective BH services are discussed. Some of these concepts have been described in recent summaries of EBP knowledge transfer related to the mental health arena (Chorpita, Bernstein, & Daleiden, 2011), social work practice (Barth et al., 2012), and pediatric primary care (Brown & Wissow, 2012; Committee on Psychosocial Aspects of Child and Family Health and Task Force on Mental Health, 2009; Foy et al., 2010; Wissow, Anthony, et al., 2008). These topics are consistent with the theme of this special series designed to “do more with what we already know” in applying recent evidence on children’s BH services.
Coordination and Continuity of Care
The emerging policy developments related to the PCMH and the ACA bear implications for the design of integrated healthcare in pediatric settings based on a few key principles or values. These principles include the efficient coordination and continuity of comprehensive care practices delivered by a prepared treatment team familiar with the family (Stille et al., 2010; Turchi et al., 2007). Of course, promoting “holistic” care that bundles health and BH services requires a strategy that organizes the individuals (e.g. pediatricians, nurses, clinicians), resources (space, time, expertise, money), and activities of the team or practice (e.g., collection of parent ratings, parent education, treatment, follow-up calls to monitor response).
Clear communication among healthcare team members is especially important since continuity of care extends across several decades. With the introduction of electronic health or medical records, conveying the results of a specific BH service (e.g., screening, treatment, referral) using an integrated progress note can facilitate follow-up by the child’s medical team. A common challenge across all models of service delivery involves conflicting confidentiality regulations that limit communication among providers (Levy, Hill, Sheldrick, & Perrin, 2013). Accordingly, some strategies may facilitate the sharing of mental health notes (e.g., obtain caregiver release, establish guidelines for the content of a note).
Collaborative Treatment Infrastructure
A strength of the CCM that may enhance the move towards comprehensive care supported by a treatment team is its emphasis on shared decision-making by providers and family members over the course of a care regimen (Pincus, Hough, Houtsinger, Rollman, & Frank, 2003), among other tasks (Perrin, 1999). The collaborative care applications that have targeted internalizing (Joan R. Asarnow et al., 2005; Richardson et al., 2009) and externalizing problems (Kolko et al., 2012; Perrin et al., in press) clearly rely upon tasks and ongoing feedback from PCPs, caregivers, and children (e.g., assessment, treatment, monitoring, referral). These tasks can be adapted to each unique problem and population to ensure their relevance, feasibility, and flexibility. Of course, many of these functions have been completed in research studies by trained CMs who work closely with the child’s PCP, a resource that may not always be available in everyday practice. Still, collaboration among existing team members can ensure delivery of on-site care using brief screening and counseling methods (Brown & Wissow, 2012; Chorpita et al., 2011).
Brief Screening and Assessment Tools
Several brief and validated screening tools for use in pediatric primary care have been applied in these studies, including the Pediatric Symptom Checklist (Gardner, Lucas, Kolko, & Campo, 2007; Jellinek et al., 1999), the Ages and Stages Questionnaire Social-Emotional (ASQ-SE; Squires, Bricker, & Twombley, 2002) and the Strengths and Difficulties Questionnaire (Goodman & Goodman, 2009). All three of these tools are being widely used and include clinical cutoffs for different clinical domains (e.g., attentional or internalizing problems). These instruments may be sufficient for case conceptualization and treatment planning purposes, but could also be supplemented by other assessment measures that capture child, caregiver, and family functioning based on the studies reviewed here and in other sources (see Kolko, 2009). New instruments have been developed as part of the Survey of Wellbeing of Young Children (www.TheSWYC.org): the Baby Pediatric Symptom Checklist (BPSC) for children up to 18 months, and the Preschool Pediatric Symptom Checklist (PPSC) for children from 18 months to 5 years of age (R. C. Sheldrick, B. S. Henson, S. Merchant et al., 2012b; R. C. Sheldrick, B. S. Henson, E. N. Neger et al., 2012a). Other tools are available for more specific screening, e.g. for ADHD (Vanderbilt ADHD Parent Diagnostic Rating Scale (Wolraich, Wibbelsman et al., 2005), Routine regular screening programs in primary care settings have been slow to catch on, related to resource allocation and logistics of implementation. Supervision of a practice-wide program of behavioral screening and appropriate follow-up is an excellent task for a clinician who is co-located in the primary care practice.
Common factors
Engagement and relationship-building
Although few of these studies describe their client engagement activities, such “non-specific” factors that are common across therapeutic approaches help to lay the foundation for behavior change by a healthcare provider (Duncan, Miller, Wampold, & Hubble, 2010). Bickman (2005) articulated the nature and impact of many of these characteristics, such as client characteristics (motivation, expectations), therapist qualities (orientation, training, personal history), change processes (interactions), treatment structure (therapist focus on key client reactions), and therapeutic relationship (alliance, engagement). In the primary care arena, these basic skills are relevant for medical staff (e.g., eliciting mental health concerns, building rapport, showing empathy) and PCPs (e.g., addressing treatment readiness, preferences, and barriers), among other skills (see Brown & Wissow, 2012, p.492). These foundational skills can enhance relationship-building, treatment engagement, and motivation (Brown, Riley, & Wissow, 2007; Regalado et al., 2010; Wissow, Anthony, et al., 2008).
Monitoring of Client Progress and Feedback
A second method to enhance the impact of common factors involves the monitoring of client progress and collection of ongoing client feedback about the intervention process or outcome. Few treatment trials report engagement measures during treatment, though some in other settings have included child and/or parent engagement measures (Kolko et al., 2009; Lindhiem & Kolko, 2010). In terms of client outcome, several studies documented patient progress across sessions using brief but standardized clinical assessment measures, such as the PHQ-9 or the PSC-Y for adolescents (Asarnow et al., 2005; Richardson et al., 2009) or the PSC for caregivers (Jellinek et al., 1999). One comprehensive system used in numerous pediatric primary care offices allows parents to complete online questionnaires examining health and development for review by the PCP prior to a visit (Child Health & Development Interactive System, 2013, www.chadis.com). Another measurement system described as “client directed and outcome informed” (CDOI) offers efficient methods for monitoring these two important aspects of successful treatment delivery, such as the 4-item Session Rating Scale (SRS) and Child Outcome Rating Scale (CORS [Anker, Duncan, & Sparks, 2009]).
Given increasing attention to the personalization of health care, there is a need to document progress on clinical goals relevant to a given patient. The use of individualized measures of client progress may contribute to treatment adaptation. Some studies have included an interview measure (Individualized Goal Attainment Ratings, IGAR) that includes up to four individualized child target behaviors identified by parents at intake and then rated for level of improvement during treatment and at follow-up assessments. The tool includes a graphic interface showing both progress and care processes delivered which has documented improvements in trials evaluating co-located or collaborative care (Kolko et al., 2010; Kolko et al., 2012). Another measure that captures a child’s more specific problems is called the Top Problems list (Weisz et al., 2011). These measures provide immediate feedback about key process or outcome data using a “dashboard” style medium and may facilitate engagement, individualization, treatment adaptation (Weisz et al., 2011).
Common Elements and Modular Content
The rapid patient flow or pace found in healthcare settings requires the use of targeted and efficient interventions which may be facilitated using common elements and modular treatments to simplify treatment delivery (Chorpita, Becker, & Daleiden, 2007; Chorpita & Daleiden, 2009; Weisz, Mohrman, & McCracken, 2012; Weisz et al., 2012). By common elements, we mean specific procedures or methods found to be commonly applied to address a given problem (e.g., psychoeducation, practice, modeling, monitoring, time-out, cognitive coping, exposure, problem solving, communication); thus, some elements reflect general content, whereas others reflect a specific training method. Modules reflect a structured routine for the administration of one or more related common elements or procedures.
Brief modular content is especially relevant in healthcare settings where the duration of a session or treatment regimen is far shorter than in specialty care, and the patient population may present with subclinical symptoms or several comorbid conditions (Weisz et al., 2012). Several adaptations of existing treatment protocols (or EBPs) for specific disorders have used core components to target behavior problems (Berkovits et al., 2010; Turner & Sanders, 2006), anxiety (Crawley et al., 2013; Weersing et al., 2012), and depression (Richardson et al., 2009). A brief (8-session) version of cognitive behavioral therapy (BCBT) for anxiety disorders (Coping Cat; Kendall & Hedtke, 2006) may also lend itself to primary care (Kendall, Hudson, Gosch, Flannery-Schroeder, & Suveg, 2008). Other modules abbreviated from treatment packages developed for aggressive families (Kolko, Iselin, & Gully, 2011) and children (Kolko, Cheng et al., 2011; Kolko et al., 2009) include similar content (e.g., parenting. social skills, school behavior management) and specific methods to address comorbidities (e.g., ADHD medication management). Each module has also included common training processes during implementation (e.g., modeling, rehearsal, feedback).
The use of common elements is especially timely as the transition towards more holistic primary healthcare calls for PCPs to address a child’s physical and BH conditions in a coordinated system of care. This “generalist” approach achieves a balance between breadth and depth, and parallels the kind of therapeutic model employed by BH practitioners working in an emergency department or a consultation-liaison service (Chorpita et al., 2011). The documentation of a set of common elements for several mental health disorders provides an important resource for PCPs who deliver pediatric behavioral healthcare (Weisz et al., 2012). It is worth noting that the American Academy of Pediatrics (AAP) provides a summary of “Evidence-Based Child and Adolescent Psychosocial Interventions” twice each year on its website (www.aap.org/mentalhealth) using data from the PracticeWise Evidence-Based Services Database (www.practicewise.com). The table is based on an ongoing review of randomized clinical psychosocial and combined treatment trials for children and adolescents with BH needs. A more extensive BH curriculum promoted by the AAP in its clinician toolkit also can be found online (aap.org/health/mental health).
Building the Capacity of Pediatric Providers
Training
Some intervention trials have trained PCPs and office staff in critical assessment and intervention functions (Brown, Wissow et al., 2007; Gledhill et al., 2003; Regalado et al., 2010; The REACH Institute, 2010), and in specific collaboration skills (S. H. McDaniel & Campbell, 1997). In addition to the use of technology, effective training methods for PCPs involve direct methods for skills training (e.g., observation, practice, teaching others), problem-based learning in which discussions of actual case histories generate increasingly more complex reactions and outcomes that integrate one’s initial responses to these case histories, and distributed (vs. concentrated -- all or none) learning which involves frequent but brief discussions on a specific topic. Several examples of PCP training are described elsewhere (Epstein et al., 2008; Wissow, Anthony, et al., 2008). In contrast, the clinicians or nurses who served as CMs in other studies (Kolko et al., 2010; Kolko et al., 2012) were trained more intensively in several intervention tasks using diverse components (e.g., manual review, didactic seminars, review of session tapes, practice role-plays with feedback, delivery of care using pilot cases with supervisory feedback). Some of these methods could be adapted for use in routine practice settings.
Clinical Consultation
Access to clinical or case consultation can enhance treatment integrity, patient response, and provider confidence. Various options for incorporating consultation have been used, including psychiatric phone consultation (Sarvet et al., 2010; R.C. Sheldrick et al., 2012), peer consultation from a PCP (Epstein et al., 2010; Epstein et al., 2008), back-up supervision (Richardson et al., 2009), and weekly supervision from a supervisor (Kolko et al., 2010; Kolko et al., 2012). However, securing ongoing case consultation in routine practice is difficult, especially since it is not reimbursable. Consultation with a local BH professional may be a viable resource for obtaining important feedback on diagnostic challenges, treatment barriers, and referral options.
Implementation Models
Few strategies to promote implementation of integrated care in pediatric settings have been reported, beyond the generic CCM. Thus, there is need to apply existing models to promote treatment delivery and quality. Several models are relevant to promoting EBP adaptation and implementation in healthcare settings, such as the Consolidated Framework for Implementation Research (Damschroder et al., 2009), Interactive Systems Framework (Wandersman et al., 2008), “4 C’s” model of coordination, communication, comprehensiveness, and continuity of care (Horvitz-Lennon, Kilbourne, & Pincus, 2006), Organizational Health Transformation Model (Lukas et al., 2007), key elements for quality improvement in medical practice (Solberg, 2007), and some common factors to improving the mental health capacity of primary care staff (Wissow et al., 2008b; Wissow et al., 2008a). One model, Replicating Effective Programs (REP), has been applied in primary care settings with adults (Horvitz-Lennon et al., 2006). To our knowledge, these models have not been studied in pediatric practice.
Reimbursement and Fiscal Sustainability
Although already an important part of many implementation models, attention to improving reimbursement and fiscal sustainability is needed to cover the costs of integrating BH resources (e.g., space, staff training, assessment instruments, consultation). Pediatric practices cannot afford to hire mental health clinicians as team members due to cumbersome and restrictive credentialing policies, poor payment rates, and idiosyncratic rules about acceptable practices and providers. Recent policy statements offer recommendations to address these challenges to obtaining adequate reimbursement (Adair, Perrin, Hubbard, & Savageau, 2010; American Academy of Child and Adolescent Psychiatry, 2009; Foy et al., 2010), including the use of financial incentives. Strategies such as Pay-for-Performance or Pay for Implementation of an EBP to improve patient outcomes are now common in health care practice (Mehrotra et al., 2007) and insurance programs (Rosenthal & Frank, 2006), but not in BH practice (Bremer, Scholle, Keyser, Houtsinger, & Pincus, 2008).
Conclusions
This brief review describes several clinical trials and intervention studies conducted in pediatric primary care to document the integration of alternative models for the delivery of behavioral services. These studies have yielded positive findings supportive of their feasibility, clinical benefit or impact, satisfaction or acceptability, and, to some extent, maintenance. Families express preferences for receiving mental health services in a primary care setting (Kolko et al., 2010; Kolko et al., 2012) and PCPs support the incorporation of clinical resources in the practice (Kelleher & Stevens, 2009). The use of trained clinicians to coordinate and deliver treatment supported by brief screening and ongoing monitoring permits many of the same routines as are found in a typical mental health setting.
These observations highlight the real-world relevance of integrated care models that can incorporate “best practices” based on brief modular interventions to achieve meaningful outcomes to families and pediatricians, and the potential to promote the quality and continuity of care. These features may ultimately advance the public health impact of BH services by reducing the severity of clinical problems, improving adaptive behavior and functioning, and possibly reducing “downstream” service costs (e.g., sick or ER visits, clinical resources). Of course, the outcomes of these studies are still modest in scope and provide only some direction on how to proceed to enhance and sustain integrated care. Hopefully, some of the lessons learned and directions for practice and research reviewed herein can be applied to enhance the acceptability, cost-effectiveness, fiscal sustainability, and eventual scalability of integrated BH services in the healthcare setting serving pediatric populations.
References
- American Academy of Child and Adolescent Psychiatry. A Guide to Building Collaborative Mental Health Care Partnerships In Pediatric Primary Care. 2010. pp. 1–27. [Google Scholar]
- American Academy of Pediatrics. Clinical practice guidelines: Treatment of the school-aged child with attention-deficit/hyperactivity disorder. Pediatrics. 2001;108:1033–1044. doi: 10.1542/peds.108.4.1033. [DOI] [PubMed] [Google Scholar]
- Anker MG, Duncan BL, Sparks JA. Using client feedback to improve couple therapy outcomes: a randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology. 2009;77(4):693–704. doi: 10.1037/a0016062. [DOI] [PubMed] [Google Scholar]
- Asarnow JR, Jaycox LH, Duan N, LaBorde AP, Rea MM, Murray P. Effectiveness of a quality improvement intervention for adolescent depression in primary care clinics. Journal of the American Medical Association. 2005;293(3):311–319. doi: 10.1001/jama.293.3.311. [DOI] [PubMed] [Google Scholar]
- Asarnow JR, Jaycox LH, Tang L, Duan N, LaBorde AP, Zeledon LR. Long-term benefits of short-term quality improvement interventions for depressed youths in primary care. The American Journal of Psychiatry. 2009;166(9):1002–1010. doi: 10.1176/appi.ajp.2009.08121909. [DOI] [PubMed] [Google Scholar]
- Aupont O, Doerfler L, Connor DF, Stille C, Tisminetzky M, McLaughlin TJ. A Collaborative Care Model to Improve Access to Pediatric Mental Health Services. Administration and Policy in Mental Health and Mental Health Services Research. 2012;40(4):264–273. doi: 10.1007/s10488-012-0413-0. [DOI] [PubMed] [Google Scholar]
- Barth RP, Lee BR, Lindsey MA, Collins KS, Strieder F, Chorpita BF. Evidence-Based Practice at a Crossroads: The Timely Emergence of Common Elements and Common Factors. Research on Social Work Practice. 2012;22(1):108–119. doi: 10.1177/1049731511408440. [DOI] [Google Scholar]
- Berkovits MD, O’Brien KA, Carter CG, Eyberg SM. Early identification and intervention for behavior problems in primary care: A comparison of two abbreviated versions of parent-child interaction therapy. Behavior Therapy. 2010;41(3):375–387. doi: 10.1016/j.beth.2009.11.002. [DOI] [PubMed] [Google Scholar]
- Bickman L, Mulvaney S. Large-scale evaluations of children’s mental health services: The Ft. Bragg and Stark County studies. In: Steele RG, Roberts MC, editors. Handbook of mental health services for children, adolescents, and families. New York, NY: Kluwer Academic/Plenum Publishers; 2005. pp. 371–386. [Google Scholar]
- Bower-Russa ME, Knutson JF, Winebarger A. Disciplinary history, adult disciplinary attitudes, and risk for abusive parenting. Journal of Community Psychology. 2001;29(3):219–240. doi: 10.1002/jcop.1015. [DOI] [Google Scholar]
- Bremer RW, Scholle SH, Keyser D, Houtsinger JVK, Pincus HA. Pay for Performance in Behavioral Health. Psychiatric Services. 2008;59(12):1419–1429. doi: 10.1176/ps.2008.59.12.1419. [DOI] [PubMed] [Google Scholar]
- Brown JD, Riley AW, Wissow LS. Identification of youth psychosocial problems during pediatric primary care visits. Administration and Policy in Mental Health and Mental Health Services Research. 2007;34(3):269–281. doi: 10.1007/s10488-006-0106-7. [DOI] [PubMed] [Google Scholar]
- Brown JD, Wissow LS. Discussion of sensitive health topics with youth during primary care visits: relationship to youth perceptions of care. Journal of Adolescent Health. 2009;44(1):48–54. doi: 10.1016/j.jadohealth.2008.06.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brown JD, Wissow LS. Rethinking the mental health treatment skills of primary care staff: a framework for training and research. Adm Policy Ment Health. 2012;39(6):489–502. doi: 10.1007/s10488-011-0373-9. [DOI] [PubMed] [Google Scholar]
- Brown JD, Wissow LS, Riley A. Physician and patient characteristics associated with discussion of psychosocial health during pediatric primary care visits. Clinical Pediatrics. 2007;46(9):812–820. doi: 10.1177/0009922807304144. [DOI] [PubMed] [Google Scholar]
- Campo JV, Shafer S, Strohm J, Lucas A, Gelacek Cassesse C, Shaeffer D. Pediatric behavioral health in primary care: A collaborative approach. Journal of the American Psychiatric Nurses Association. 2005;11(5):276–282. [Google Scholar]
- Caspi A, Moffitt TE, Newman DL, Silva PA. Behavioral observations at age 3 years predict adult psychiatric disorders. Archives of General Psychiatry. 1996;53:1033–1039. doi: 10.1001/archpsyc.1996.01830110071009. [DOI] [PubMed] [Google Scholar]
- Child Health & Development Interactive System. About Us. 2013 Retrieved 9/9/2013, 2013, from http://www.chadis.com/families/about_chadis.html.
- Chorpita BF, Becker KD, Daleiden EL. Understanding the common elements of evidence-based practice: Misconceptions and clinical examples. Journal of the American Academy of Child and Adolescent Psychiatry. 2007;46:647–652. doi: 10.1097/chi.0b013e318033ff71. [DOI] [PubMed] [Google Scholar]
- Chorpita BF, Bernstein A, Daleiden EL. Empirically Guided Coordination of Multiple Evidence-Based Treatments: An Illustration of Relevance Mapping in Children’s Mental Health Services. Journal of Consulting and Clinical Psychology. 2011;79:470–480. doi: 10.1037/a0023982. [DOI] [PubMed] [Google Scholar]
- Chorpita BF, Daleiden EL. Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology. 2009;77(3):566–579. doi: 10.1037/a0014565. [DOI] [PubMed] [Google Scholar]
- Committee on Psychosocial Aspects of Child and Family Health and Task Force on Mental Health. The Future of Pediatrics: Mental Health Competencies for Pediatric Primary Care. Pediatrics. 2009;124(1):410–421. doi: 10.1542/peds.2009-1061. [DOI] [PubMed] [Google Scholar]
- Connor DF, McLaughlin TJ, Jeffers-Terry M, O’Brien WH, Stille CJ, Young LM. Targeted child psychiatric services: A new model of pediatric primary clinician - child psychiatry collaborative care. Clinical Pediatrics. 2006;45(5):423–434. doi: 10.1177/0009922806289617. [DOI] [PubMed] [Google Scholar]
- Costello EJ. Child psychiatric disorders and their correlates: A primary pediatric sample. Journal of the American Academy of Child and Adolescent Psychiatry. 1989;28:851–855. doi: 10.1097/00004583-198911000-00007. [DOI] [PubMed] [Google Scholar]
- Crawley SA, Kendall PC, Benjamin CL, Brodman DM, Wei C, Beidas RS. Brief Cognitive-Behavioral Therapy for Anxious Youth: Feasibility and Initial Outcomes. Cognitive and Behavioral Practice. 2013;20(2):123–133. doi: 10.1016/j.cbpra.2012.07.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Science. 2009;4(50) doi: 10.1186/1748-5908-4-50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Department of Health and Human Services. Affordable Care Act. 2012 from http://www.hhs.gov/opa/affordable-care-act/index.html.
- Duncan BL, Miller SD, Wampold BE, Hubble MA. The heart and soul of change: Delivering what works in therapy. 2. Washington, D.C: American Psychological Association; 2010. [Google Scholar]
- Epstein JN, Langberg JM, Lichtenstein PK, Altaye M, Brinkman WB, House K. Attention-Deficit/Hyperactivity Disorder Outcomes for Children Treated in Community-Based Pediatric Settings. Archives of Pedatrics & Adolescent Medicine. 2010;164(2):160–165. doi: 10.1001/archpediatrics.2009.263. [DOI] [PubMed] [Google Scholar]
- Epstein JN, Langberg JM, Lichtenstein PK, Mainwaring BA, Luzader CP, Stark LJ. Community-wide intervention to improve the Attention-Deficit/Hyperactivity Disorder assessment and treatment practices of community physicians. Pediatrics. 2008;122(1):19–27. doi: 10.1542/peds.2007-2704. [DOI] [PubMed] [Google Scholar]
- Epstein JN, Rabiner DL, Johnson DE, FitzGerald DP, Chrisman A, Alaattin E. Improving Attention-Deficit/Hyperactivity Disorder Treatment Outcomes Through Use of a Collaborative Consultation Treatment Service by Community-Based Pediatricians. Archives of Pedatrics & Adolescent Medicine. 2007;161(9):835–840. doi: 10.1001/archpedi.161.9.835. [DOI] [PubMed] [Google Scholar]
- Foy JM, Kelleher KJ, Laraque D The American Academy of Pediatrics Task Force on Mental Health. Enhancing pediatric mental health care: Strategies for preparing a primary care practice. Pediatrics. 2010;125:S87–S108. doi: 10.1542/peds.2010-0788E. [DOI] [PubMed] [Google Scholar]
- Gadomski A, Wissow LS, Slade E, Jenkins P. Training Clinicians in Mental Health Communication Skills: Impact on Primary Care Utilization. Academic Pediatrics. 2010;10(5):346–352. doi: 10.1016/j.acap.2010.06.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gardner W, Lucas A, Kolko DJ, Campo JV. Comparison of the PSC-17 and alternative mental health screens in an at-risk primary care sample. Journal of the American Academy of Child & Adolescent Psychiatry. 2007;46(5):611–618. doi: 10.1097/chi.0b013e318032384b. [DOI] [PubMed] [Google Scholar]
- Gledhill J, Kramer T, Iliffe S, Garralda ME. Training general practitioners in the identification and management of adolescent depression with the consultation: A feasilility study. Journal of Adolescence. 2003;26(2):245–250. doi: 10.1016/s0140-1971(02)00128-8. [DOI] [PubMed] [Google Scholar]
- Goodfriend M, Thomas B, Livingood W, Goldhagen J. A model for training pediatricians to expand mental health services in the community practice setting. Clinical Pediatrics. 2006;45(7):649–654. doi: 10.1177/0009922806291018. [DOI] [PubMed] [Google Scholar]
- Goodman AM, Goodman R. Strengths and Difficulties Questionnaire as a dimensional measure of child mental health. Journal of the American Academy of Child & Adolescent Psychiatry. 2009;48(4):400–403. doi: 10.1097/CHI.0b013e3181985068. [DOI] [PubMed] [Google Scholar]
- Guevara JP, Greenbaum PE, Shera D, Bauer L, Schwartz DF. Survey of mental health consultation and referral among primary care pediatricians. Academic Pediatrics. 2009;9:123–127. doi: 10.1016/j.acap.2008.12.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Horvitz-Lennon M, Kilbourne AM, Pincus HA. From silos to bridges: meeting the general health care needs of adults with severe mental illnesses. Health Affairs (Millwood) 2006;25(3):659–669. doi: 10.1377/hlthaff.25.3.659. [DOI] [PubMed] [Google Scholar]
- Jellinek MS, Murphy J, Little M, Pagano ME, Comer DM, Kelleher KJ. Use of the pediatric symptom checklist to screen for psychosocial problems in pediatric primary care: a national feasibility study. Archives of Pediatric and Adolescent Medicine. 1999;153:254–260. doi: 10.1001/archpedi.153.3.254. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Katon W, Unützer J, Wells K, Jones L. Collaborative depression care: history, evolution and ways to enhance dissemination and sustainability. General Hospital Psychiatry. 2010;32(5):456–464. doi: 10.1016/j.genhosppsych.2010.04.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Katon W, Von Korff M, Lin E, Walker E, Simone GE, Bush T. Collaborative management to achieve treatment guidelines: Impact on depression in primary care. Journal of the American Medical Academy. 1995;273:1026–1031. [PubMed] [Google Scholar]
- Kelleher K, Campo JV, Gardner W. Management of pediatric mental disorders in primary care: Where are we now and where are we going? Current Opinion in Pediatrics. 2006;18:649–653. doi: 10.1097/MOP.0b013e3280106a76. [DOI] [PubMed] [Google Scholar]
- Kelleher K, Stevens J. Evolution of child mental health services in primary care. 2009;9(1):7–13. doi: 10.1016/j.acap.2008.11.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kendall PC, Hedtke KA. The Coping Cat workbook. 2. Ardmore, PA: Workbook Publishing; 2006. [Google Scholar]
- Kendall PC, Hudson JL, Gosch E, Flannery-Schroeder E, Suveg C. Cognitive-behavioral therapy for anxiety disordered youth: A randomized clinical trial evaluating child and family modalities. Journal of Consulting and Clinical Psychology. 2008;76(2):282–297. doi: 10.1037/0022-006X.76.2.282. [DOI] [PubMed] [Google Scholar]
- Kolko DJ. Options for the delivery of mental health services. In: McInerny TK, editor. American Academy of Pediatrics Textbook of Pediatric Care. Elk Grove Village, IL: American Academy of Pediatrics; 2009. [Google Scholar]
- Kolko DJ, Campo J, Kilbourne AM, Hart J, Sakolsky D. Collaborative Care Outcomes for Pediatric Behavioral Health Problems: A Cluster Randomized Trial. 2013 doi: 10.1542/peds.2013-2516. Under Review. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kolko DJ, Campo JV, Kelleher K, Cheng Y. Improving access to care and clinical outcome for pediatric behavioral problems: A randomized trial of a nurse-administered intervention in primary care. Journal of Developmental & Behavioral Pediatrics. 2010;31(5):393–404. doi: 10.1097/DBP.0b013e3181dff307. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kolko DJ, Campo JV, Kilbourne AM, Kelleher K. Doctor-office collaborative care for pediatric behavioral problems. Archives of Pedatrics & Adolescent Medicine. 2012;166(3):224–231. doi: 10.1001/archpediatrics.2011.201. [DOI] [PubMed] [Google Scholar]
- Kolko DJ, Cheng Y, Campo JV, Kelleher K. Moderators and Predictors of Clinical Outcome in a Randomized Trial for Behavior Problems in Pediatric Primary Care. Journal of Pediatric Psychology. 2011;36(7):753–765. doi: 10.1093/jpepsy/jsr006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kolko DJ, Dorn LD, Bukstein OG, Pardini DA, Holden EA, Hart JA. Community vs. clinic-based modular treatment of children with early-onset ODD or CD: A clinical trial with three-year follow-up. Journal of Abnormal Child Psychology. 2009;37:591–609. doi: 10.1007/s10802-009-9303-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kolko DJ, Iselin AM, Gully KJ. Evaluation of the sustainability and clinical outcome of Alternatives for Families: Cognitive-Behavioral Therapy (AF-CBT) in a child protection center. Child Abuse & Neglect. 2011;35(2):105–116. doi: 10.1016/j.chiabu.2010.09.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kolko DJ, Jackson LJ, Kilbourne AM, Sakolsky D, Campo J. Evaluation of Physician Experiences/Expectations Before and After Collaborative Care Intervention: A Qualitative Analysis. 2013 Under Review. [Google Scholar]
- Lavigne JV, LeBailly SA, Gouze KR, Binns HJ, Keller J, Pate L. Predictors and correlates of completing behavioral parent training for the treatment of oppositional defiant disorder in pediatric primary care. Behavior Therapy. 2010;41(2):198–211. doi: 10.1016/j.beth.2009.02.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lavigne JV, LeBailly SA, Gouze KR, Cicchetti C, Jessup BW, Arend R. Predictor and moderator effects in the treatment of Oppositional Defiant Disorder in pediatric primary care. Journal of Pediatric Psychology. 2008;33(5):462–472. doi: 10.1093/jpepsy/jsm075. [DOI] [PubMed] [Google Scholar]
- Lavigne JV, LeBailly SA, Gouze KR, Cicchetti C, Pochyly J, Arend R. Treating oppositional defiant disorder in primary care: A comparison of three models. J Pediatr Psychol. 2008;33(5):449–461. doi: 10.1093/jpepsy/jsm074. [DOI] [PubMed] [Google Scholar]
- Levy S, Hill E, Sheldrick C, Perrin E. Co-located care among Pediatricians and Developmental/Mental Health Providers. Paper presented at the the Society of Developmental and Behavioral Pediatrics; Baltimore, MD. 2013. [Google Scholar]
- Lindhiem O, Kolko DJ. Trajectories of symptom reduction and engagement during treatment for childhood behavior disorders: Differences across settings. Journal of Abnormal Child Psychology. 2010;38(7):995–1005. doi: 10.1007/s10802-010-9416-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lukas CV, Holmes SK, Cohen AB, Restuccia J, Cramer IE, Shwartz M. Transformational change in health care systems: An organizational model. Health Care Management Review. 2007;32(4):309–320. doi: 10.1097/01.HMR.0000296785.29718.5d. [DOI] [PubMed] [Google Scholar]
- McDaniel S, Campbell T, Seaburn D. Family-oriented Primary Care. New York: Springer-Verlag; 1990. [Google Scholar]
- McDaniel SH, Campbell TL. Training Health Professionals to Collaborate. Families, Systems and Health. 1997;15:353–358. [Google Scholar]
- Mehrotra A, Pearson SD, Coltin KL, Kleinman KP, Singer JA, Rabson B. The response of physician groups to P4P incentives. The American journal of managed care. 2007;13(5):249–255. [PubMed] [Google Scholar]
- National Network of Child Psychiatry Access Programs. National Network of Child Psychiatry Access Programs Memberwide Call-In Meeting (Call Summary) 2012. Feb 6, 2012. [Google Scholar]
- Novotney A. Integrated care is nothing new for these psychologists. Monitor on Psychology. 2010 Jan;41:41–49. 2010. [Google Scholar]
- Perrin EC. Collaboration in pediatric primary care: A pediatrician’s view. Journal of Pediatric Psychology. 1999;24:453–458. doi: 10.1093/jpepsy/24.5.453. [DOI] [PubMed] [Google Scholar]
- Perrin EC, Sheldrick RC. AAP Pediatrician Survey: Conceptual Model and Specific Aims. Unpublished survey. Tufts University School of Medicine; Boston: 2010. [Google Scholar]
- Perrin EC, Sheldrick RC. The challenge of mental health care in pediatrics. Archives of Pediatrics & Adolescent Medicine. 2011 doi: 10.1001/archpediatrics.2011.202. [DOI] [PubMed] [Google Scholar]
- Perrin EC, Sheldrick RC, McMenamy JM, Henson BS, Carter AS. Improving parenting skills for families of young children in pediatric settings: a randomized clinical trial. Pediatrics. doi: 10.1001/jamapediatrics.2013.2919. in press. [DOI] [PubMed] [Google Scholar]
- Pincus HA, Hough L, Houtsinger JK, Rollman BL, Frank RG. Emerging models of depression care: Multi-level (‘6 P’) strategies. International Journal of Methods in Psychiatric Research. 2003;12(1):54–63. doi: 10.1002/mpr.142. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Regalado M, Larson K, Wissow LS, Halfon N. Factors Associated With Discipline Counseling For Parents of Infants and Young Children. Academic Pediatrics. 2010;10(5):353–359. doi: 10.1016/j.acap.2010.07.006. [DOI] [PubMed] [Google Scholar]
- Richardson LP, McCauley E, Katon W. Collaborative care for adolescent depression: a pilot study. General Hospital Psychiatry. 2009;31(1):36–45. doi: 10.1016/j.genhosppsych.2008.09.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Roongpraiwan R, Efron D, Sewell J, Mathai J. Comparison of mental health symptoms between children attending developmental/behavioural paediatric clinics and child and adolescent mental health service. Journal of Paediatrics and Child Health. 2007;43:122–126. doi: 10.1111/j.1440-1754.2007.01030.x. [DOI] [PubMed] [Google Scholar]
- Rosenthal MB, Frank RG. What is the Empirical Basis for Paying for Quality in Health Care? Medical Care Research and Review. 2006;63(2):135–157. doi: 10.1177/1077558705285291. [DOI] [PubMed] [Google Scholar]
- Rubenstein LV, Williams JW, Danz M, Shekelle P, Suttorp M, Johnsen B. Determining Key Features of Effective Depression Interventions. Vol. 70. Los Angeles, CA: Department of Veterans Affairs; 2009. [PubMed] [Google Scholar]
- Sarvet B, Gold J, Bostic JQ, Masek BJ, Prince JB, Jeffers-Terry M. Improving access to mental health care for children: the Massachusetts child psychiatry access project. Pediatrics. 2010;126:1191–1200. doi: 10.1542/peds.2009-1340. [DOI] [PubMed] [Google Scholar]
- Scholer SJ, Cherry R, Garrard HG, Gupta AO, Mace R, Greeley N. A multimedia program helps parents manage childhood aggression. Clinical Pediatrics. 2006;45(9):835–840. doi: 10.1177/0009922806294217. [DOI] [PubMed] [Google Scholar]
- Scholer SJ, Mukherjee AB, Gibbs KI, Memon S, Jongeward KL. Parents view a brief violence provention program in clinic. Clinical Pediatrics. 2007;46(8):724–734. doi: 10.1177/0009922807302508. [DOI] [PubMed] [Google Scholar]
- Schuhmann E, Durning P, Eyberg SM, Boggs SR. Screening for conduct problem behavior in pediatric settings using the Eyberg Child Behavior Inventory. Ambulatory Child Health. 1996;2:35–41. [Google Scholar]
- Shaw DS, Gross H. What we have Learned about Early Childhood and the Development of Delinquency. In: Liberman AM, editor. The Long View of Crime: A Synthesis of Longitudinal Research. New York: Springer; 2008. pp. 79–127. [Google Scholar]
- Sheldrick RC, Henson BS, Merchant S, Neger EN, Murphy JM, Perrin EC. The Preschool Pediatric Symptom Checklist (PPSC): Development and initial validation of a new social-emotional screening instrument. Academic Pediatrics. 2012;12(5):456–467. doi: 10.1016/j.acap.2012.06.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sheldrick RC, Henson BS, Neger EN, Merchant S, Murphy JM, Perrin EC. The Baby Pediatric Symptom Checklist (BPSC): Development and initial validation of a new social-emotional screening instrument. Academic Pediatrics. 2012;13(1):72–80. doi: 10.1016/j.acap.2012.08.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sheldrick RC, Mattern K, Perrin EC. Pediatricians’ Perceptions of an off-site collaboration with child psychiatry. Clinical Pediatrics. 2012;51:546–550. doi: 10.1177/0009922812444601. [DOI] [PubMed] [Google Scholar]
- Sheldrick RC, Perrin EC. Medical home services for children with behavioral health conditions. Journal of Developmental & Behavioral Pediatrics. 2010;31(2):92. doi: 10.1097/DBP.0b013e3181cdabda. [DOI] [PubMed] [Google Scholar]
- Solberg LI. Improving medical practice: A conceptual framework. Ann Fam Med. 2007;5(3):251–256. doi: 10.1370/afm.666. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Soni A. The Five Most Costly Children’s Conditions, 2006: Estimates for the U.S. Civilian Noninstitutionalized Children, Aged 0–17. 2009 Medical Expenditure Panel Survey: Statistical Brief #242. [Google Scholar]
- Squires J, Bricker D, Twombley E. The ASQ-SE User’s Guide. Baltimore, MD: Brookes Publishing Co; 2002. [Google Scholar]
- Stancin T, Perrin EC, Ramirez L. Pediatric psychology and primary care. In: Roberts MC, Steele RG, editors. Handbook of Pediatric Psychology. 4. New York: Guilford Press; 2009. pp. 630–646. [Google Scholar]
- Stille C, Turchi RM, Antonelli R, Cabana MD, Cheng TL, Laraque D. The Family-Centered Medical Home: Specific Considerations for Child Health Research and Policy. Academic Pediatrics. 2010;2010(10):211–217. doi: 10.1016/j.acap.2010.05.002. [DOI] [PubMed] [Google Scholar]
- Substance Abuse and Mental Health Services Administration. Leading Change: A Plan for SAMHSA’S Roles and Actions 2011–2014. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2011. [Google Scholar]
- The REACH Institute. The REACH Institute; 2010, 2012. Retrieved December 23 2013, from http://www.thereachinstitute.org/ [Google Scholar]
- Turchi RM, Gatto ME, Antonelli RC. Children with Special Health Care Needs-There is no Place Like Home. Current Opinions in Pediatrics. 2007;19:503–508. doi: 10.1097/MOP.0b013e32825a67b4. [DOI] [PubMed] [Google Scholar]
- Turner KMT, Sanders MR. Help when it’s needed first: A controlled evaluation of brief, preventive behavioral family intervention in a primary care setting. Behavior Therapy. 2006;37(2):131–142. doi: 10.1016/j.beth.2005.05.004. [DOI] [PubMed] [Google Scholar]
- Van Voorhees BW, Ellis JM, Gollan JK, Bell CC, Stuart SS, Fogel J. Development and Process Evaluation of a Primary Care Internet-Based Intervention to Prevent Depression in Emerging Adults. Primary Care Companion Journal of Clinical Psychiatry. 2007;9:346–355. doi: 10.4088/pcc.v09n0503. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Voorhees BW, Fogel J, Reinecke M, Gladstone T, Stuart S, Gollan J. Randomized clinical trial of an internet-based depression prevention program for adolescents (Project CATCH-IT) in Primary Care: 12-Week outcomes. Journal of Developmental and Behavioral Pediatrics. 2009;30(1):14. doi: 10.1097/DBP.0b013e3181966c2a. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Von Korff M, Gruman J, Schaefer J, Curry S, Wagner E. Collaborative management of chronic illness. Annals of Internal Medicine. 1997;127(12):1097–1102. doi: 10.7326/0003-4819-127-12-199712150-00008. [DOI] [PubMed] [Google Scholar]
- Wagner E, Austin BT, Von Korff M. Organizing care for patients with chronic illness. Milbank Quarterly. 1996;74(4):511–544. [PubMed] [Google Scholar]
- Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell K, Stillman L. Bridging the Gap Between Prevention Research and Practice: The Interactive Systems Framework for Dissemination and Implementation. American Journal of Community Psychology. 2008;41(3–4):171–181. doi: 10.1007/s10464-008-9174-z. [DOI] [PubMed] [Google Scholar]
- Weersing VR, Gonzalez A, Campo JV, Lucas AN. Brief Behavioral Therapy for pediatric anxiety and depression: Piloting an integrated treatment approach. Cognitive and Behavioral Practice. 2008;15(2):126–139. doi: 10.1016/j.cbpra.2007.10.001. [DOI] [Google Scholar]
- Weersing VR, Rozenman MS, Maher-Bridge M, Campo JV. Anxiety, depression, and somatic distress: Developing a transdiagnostic internalizing toolbox for pediatric practice. Cognitive and Behavioral Practice. 2012;19(1):68–82. doi: 10.1016/j.cbpra.2011.06.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weisz J, Mohrman SA, McCracken A. It’s a great time to be a physician: Building a healthcare system that works. Bozeman, MT: Second River Healthcare Press; 2012. [Google Scholar]
- Weisz JR, Chorpita BF, Frye A, Ng MY, Lau N, Bearman SK. Youth top problems: Using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. Journal of Consulting and Clinical Psychology. 2011;79(3):369–380. doi: 10.1037/a0023307. [DOI] [PubMed] [Google Scholar]
- Weisz JR, Chorpita BF, Palinkas LA, Schoenwald SK, Miranda J, Bearman SK. Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: a randomized effectiveness trial. Arch Gen Psychiatry. 2012;69(3):274–282. doi: 10.1001/archgenpsychiatry.2011.147. [DOI] [PubMed] [Google Scholar]
- Wissow L, Anthony B, Brown J, DosReis S, Gadomski A, Ginsburg G. A common factors approach to improving the mental health capacity of Pediatric Primary Care. Administration and Policy in Mental Health and Mental Health Services Research. 2008;35(4):305–318. doi: 10.1007/s10488-008-0178-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wissow LS, Gadomski A, Roter D, Larson S, Brown J, Zachary C. Improving Child and Parent Mental Health in Primary Care: A Cluster-Randomized Trial of Communication Skills Training. Pediatrics. 2008;121(2):266–275. doi: 10.1542/peds.2007-0418. [DOI] [PubMed] [Google Scholar]
- Wolraich ML, Bickman L, Lambert EW, Simmons T, Doffing MA. Intervening to improve communication between parents, teachers, and primary care providers of children with ADHD or at high risk for ADHD. Journal of Attention Disorders. 2005;9(1):354–368. doi: 10.1177/1087054705278834. [DOI] [PubMed] [Google Scholar]
- Wolraich ML, Wibbelsman CJ, Brown TE, Evans SW, Gotlieb EM, Knight JR. Attention-Deficit/Hyperactivity Disorder among adolescents: A review of the diagnosis, treatment, and clinical implications. Pediatrics. 2005;115(6):1734–1746. doi: 10.1542/peds.2004-1959. [DOI] [PubMed] [Google Scholar]
- Woltmann E, Grogan-Kaylor A, Perron B, Georges H, Kilbourne AM, Bauer MS. Comparative Effectiveness of Collaborative Chronic Care Models for Mental Health Conditions Across Primary, Specialty, and Behavioral Health Care Settings: Systematic Review and Meta-Analysis. The American Journal of Psychiatry. 2012;169(8):790–804. doi: 10.1176/appi.ajp.2012.11111616. [DOI] [PubMed] [Google Scholar]