Abstract
Collaborative Care is an innovative approach to integrated mental health service delivery that focuses on reducing access barriers, improving service quality, and lowering healthcare expenditures. A large body of evidence supports the effectiveness of Collaborative Care models with adults and, increasingly, for youth. Although existing studies examining these models for youth have focused exclusively on primary care, the education sector is also an appropriate analog for the accessibility that primary care offers to adults. Collaborative Care aligns closely with the practical realities of the education sector and may represent a strategy to achieve some of the objectives of increasingly popular multi-tiered systems of supports frameworks. Unfortunately, no resources exist to guide the application of Collaborative Care models in schools. Based on the existing evidence for Collaborative Care models, the current paper (1) provides a rationale for the adaptation of Collaborative Care models to improve mental health service accessibility and effectiveness in the education sector; (2) presents a preliminary Collaborative Care model for use in schools; and (3) describes avenues for research surrounding school-based Collaborative Care, including the currently funded Accessible, Collaborative Care for Effective School-based Services (ACCESS) project.
Keywords: Collaborative Care, Primary Care, Adaptation, Integration, School Mental Health
Over 18 million children and adolescents in the United States experience mental health problems (Costello, Mustillo, Erkanli, Keeler, & Angold, 2003), yet only one third receive treatment (Kataoka, Zhang, & Wells, 2002; Merikangas et al., 2011). Among those youth who receive care, up to 70% do so in the education sector (Farmer, Burns, Phillips, Angold, & Costello, 2003; Merikangas et al., 2010), which reduces barriers such as transportation and health insurance (Pullmann, Bruns, Daly, & Sander, 2013; Pullmann, VanHooser, Hoffman, & Heflinger, 2009). Schools have access to nearly the entire population of children and adolescents, which places them in a unique position to provide a range of interventions to prevent and treat youth mental health problems (Fazel, Hoagwood, Stephan, & Ford, 2014). Schools offer a variety of programs to address the social, emotional, and behavioral needs of their students and many offer some type of integrated school-based mental health (SBMH) services (e.g., prevention; early identification; individual, group, or family counseling) through school- or district-based mental health providers, school health/mental health clinics, or through formal relationships with community mental health providers (Fazel, Hoagwood, et al., 2014; Foster et al., 2005; Green, Xuan, Kwong, Hoagwood, & Leaf, 2015; Kutash, Duchnowski, & Lynn, 2006). Despite the established ability of SBMH to promote service accessibility (Kataoka, Stein, Nadeem, & Wong, 2007; Lyon, Ludwig, VanderStoep, Gudmundsen, & McCauley, 2012), a number of barriers inhibit the provision of optimally engaging and effective care. Barriers include continued stigma surrounding mental health treatment (Bowers, Manion, Papadopoulos, & Gauvreau, 2013), an insufficiently sized SBMH workforce to address the service needs of school populations (Lyon, Maras, Pate, Igusa, & VanderStoep, 2015), and low use of high-quality, evidence-based practices (EBP) among existing school practitioners (Owens et al., 2014). Greater use of integrated approaches for providing mental health care in schools could substantially improve mental, emotional, behavioral, and academic outcomes for youth by improving the effectiveness, efficiency, and contextual appropriateness of education sector services (Atkins, Hoagwood, Kutash, & Seidman, 2010; Bruns et al., 2016; Stephan, Mulloy, & Brey, 2011).
The Collaborative Care (CC) model, an integrated approach to improving access to mental health services in primary care settings, may be a particularly useful model to address barriers to quality mental health care and improved outcomes for youth in schools. CC is focused on delivering patient-centered, population-based care using a team of coordinated providers. It also emphasizes accountable, evidence-based, and measurement-driven interventions (Asarnow, Rozenman, Wiblin, & Zeltzer, 2015; Campo et al., 2005; Kolko et al., 2014; Kolko, Campo, Kelleher, & Cheng, 2010; Kolko & Perrin, 2014). Drawing from established CC practices that integrate mental health and primary care – as well as preliminary work conducted by the authors – the purpose of this paper is to (1) explore the potential usefulness of the CC model to facilitate improved access, service integration, and quality in SBMH; (2) articulate a CC informed model to enhance SBMH services; and (3) outline a research agenda to further advance CC in schools. This work represents the first step in an iterative process designed to adapt the CC model for use in schools with the goals of improving (a) the capacity of schools to provide mental health services, (b) mental health service accessibility, and (c) the use of evidence-based practices. The project, titled Accessible, Collaborative Care for Effective School-based Services (ACCESS), is intended to be responsive to barriers such as an insufficiently sized SBMH workforce to address the service needs of school populations (Lyon, Maras, et al., 2015) and low use of high-quality evidence-based practices among existing school practitioners (Evans & Weist, 2004; Owens et al., 2014).
Integrated and Collaborative Care Models
Models of integrated care – defined as care received from a team of health professionals working together to coordinate or deliver services in nontraditional mental/behavioral health settings (e.g., primary care, schools) – are becoming increasingly popular, largely as a result of evidence supporting their ability to increase the accessibility and effectiveness of care for vulnerable populations of youth (i.e., low SES, racial/ethnic minority) (Asarnow et al., 2005; Kolko et al., 2014, 2010; Richardson et al., 2014). Elkin and colleagues (in press) recently articulated how integrated models may be categorized according to three different dimensional constructs: coordination (primary care providers deliver care in conjunction/communication with community-based behavioral health specialists), co-location (primary care and behavioral health providers are located in the same setting or in nearby offices), and collaboration (multidisciplinary teams working with care coordinators). For instance, in a model emphasizing coordination, a mental health specialist may serve as an advisor to a primary care provider without seeing the individual client. In this type of model, a primary care provider may access a psychiatrist through a centralized mental health telephone program (e.g., Hilt et al., 2013) or receive skills training in mental health interventions. In co-located models, providers occupy the same or adjacent physical space, but usually do not develop a shared care plan. Collaborative care models are integrated approaches that tend to be team-based, evidence-based, use population-based tracking, and utilize care managers to facilitate the coordination between primary care providers (PCPs) and mental health providers.
CC is one of the most common integrated care models and reflects one of the best-tested and most effective models for overcoming barriers to treatment and improving outcomes for mental health conditions. A recently published meta-analysis (Asarnow et al., 2015) synthesized 31 randomized control trials (RCTs) comparing a variety of integrated primary care interventions to usual care to address youth mental health problems. Pooled analyses of all studies investigating integrated treatment interventions estimated that youth from the trials involving integrated care models had a 66% probability of having a better treatment outcome compared to usual care. This probability increased to 73% for the five trials that explicitly evaluated CC interventions. The CC model includes: (1) patient-centered care using a multidisciplinary team working together to coordinate care through case management and shared treatment plans; (2) a “population-based approach” to tracking outcomes with plans for increasing treatment intensity if patients are not improving, such that attention is paid to improving outcomes for the whole population rather than just the individual; (3) use of evidence-based interventions; (4) using measurement-based treatment models and systems to monitor and track progress based on patient specific treatment goals; (5) accountability through consultation and supervision; and (6) client education and engagement (Asarnow et al., 2015; Campo et al., 2005; Kolko et al., 2014; Kolko & Perrin, 2014; Richardson et al., 2014; Unützer, Harbin, Schoenbaum, & Druss, 2013). To achieve the principles outlined, the CC model employs several strategies including reassigning delivery of specific components of care to a care manager, the development of a pre-defined treatment protocol with input from all care providers that includes clarity on who will play which role, use of clinical information systems to track and improve outcomes, a focus on client engagement to increase activation, regular team meetings to review progress and adjust treatment, and involvement of a care manager in the provision of self-management support. A common component of several CC interventions is the advancement of treatment intensity for service recipients who are not improving, which is referred to as “stepped care” (Von Korff, Gruman, Schaefer, Curry, & Wagner, 1997). Stepped care was developed based on the recognition that (a) not all service recipients require the highest level of care and (b) tracking outcomes allows for evaluation of client response to lower intensity treatment, pragmatic clinical decision making, and more effective and efficient services. Because CC explicitly involves shared work by multidisciplinary teams, well-defined team roles become critical. In this vein, there is often a need for “task shifting” (Patel, 2009) such that new types of professionals (e.g., depression care managers) are trained in activities that have been historically completed by another type of professional (e.g. specialized mental health providers). This requires planning to define these roles, methods to train individuals in new skills, and a focus on developing strategies for communications among all parties.
Over 70 randomized trials support the effectiveness of CC for adult populations with multiple meta-analyses and systematic reviews documenting short and long term benefits for depression and anxiety (Archer et al., 2012; Thota et al., 2012; Woltmann et al., 2012). Furthermore, because they emphasize the integration of different health services, transparency/accountability, efficiency, and the effective use of data, CC models have been identified as particularly well aligned with the provisions of the Affordable Care Act (Katon & Unützer, 2013; Mechanic, 2012). Although far fewer than with adults, a number of studies systemically explored the acceptability, feasibility, and effectiveness of the model in pediatric primary care settings. Three randomized trials have investigated CC interventions for depressed adolescents (e.g., Asarnow et al., 2005; Clarke et al., 2005; Richardson et al., 2014), and two others (Kolko et al., 2014, 2010) studied the impact of the model on younger children with behavioral disorders (i.e., attention-deficit/hyperactivity disorder [ADHD] and oppositional defiant disorder). Collectively, these studies provide initial support for CC’s effectiveness, although in several of the studies, the advantage was modest.
Specifically, in studies addressing adolescent depression, Asarnow et al. (2005) and Richardson et al. (2014) both found positive effects, relative to controls, of CC models on some intervention processes (e.g., engagement; Asarnow et al., 2005), and service recipient outcomes, such as depression symptoms and remission rates (Asarnow et al., 2005; Richardson et al., 2014). Regarding behavioral disorders, Kolko and colleagues (2012; 2014) conducted two RCTs investigating pediatric CC interventions for younger children (aged 5–12). Findings from the first trial found an advantage for the CC intervention, relative to a usual care condition, demonstrating significantly better performance in several specific domains – including reducing oppositional behaviors, inattention, hyperactivity and functional impairment (Kolko, Campo, Kilbourne, & Kelleher, 2012). There were no reductions in anxiety, depression or conduct disorder symptoms (Kolko et al., 2012). In their second randomized study, compared to the control group, CC study pediatricians reported greater gains in skills and competency in treating ADHD, but did not demonstrate improved beliefs about delivering psychosocial treatment in primary care. Study participants showed clinically significant improvements in ADHD symptoms, behavioral problems in general, internalizing symptoms and parental stress (Kolko et al., 2014).
Applicability of Collaborative Care to the Education Sector
The education sector offers an avenue for increasing access to, and quality of, mental healthcare for youth. Indeed, the accessibility of mental health services in schools eclipses that in any other setting (Farmer et al., 2003; Kataoka et al., 2007; Lyon et al., 2012). School-based personnel are often the first to identify student mental health problems and frequently connect students to mental health services, including those who are unable or unlikely to access services in primary care or specialty mental health care settings (Green et al., 2013, 2015). As a result, schools are in a unique position to offer a range of mental health prevention and intervention services.
Given that academic problems are likely to co-occur with both physical and mental health difficulties (McLeod, Uemura, & Rohrman, 2012), schools present a compelling setting for integration of physical health, behavioral/mental health, and academic support services for students. A growing number of schools offer population-based services through Multi-Tiered Systems of Support (MTSS), an integrative framework for organizing school-based approaches to preventing and addressing emotional and behavioral as well as academic problems (Bruns et al., 2016; Fazel, Hoagwood, et al., 2014). MTSS is intended to provide a continuum of care that emphasizes evidence-based services, progress monitoring, and data-driven decision making based on student needs. The MTSS and CC models share many commonalities and could be integrated to enhance the school mental health service delivery model and assure coordination of mental health and school-based academic and social/emotional support services. As described below, however, CC may offer specific roles and activities through which to realize the principles of the broader MTSS framework.
Commonalities across the MTSS and CC models include matching levels of intervention to the type, severity, and complexity of presenting problems across multiple tiers of intervention (i.e., stepped care). In MTSS, Tier 1 interventions are delivered to all students and students who are identified as needing additional help receive targeted support at Tier 2. Those who continue to struggle after receiving secondary-level supports are provided with intensive, individualized, Tier 3 interventions (Bruns et al., 2016). CC begins its stepped care approach with a caseload of service recipients who receive brief, relatively inexpensive interventions (that approximate the focus of Tier 2) before advancing to more intensive services reminiscent of Tier 3. Treatment adjustments – often including psychiatric consultation or the delivery of specific evidence-based treatment protocols – occur when patients do not improve as expected or meet treatment targets on standardized scales. Both models emphasize regularly tracking of student progress and outcomes, although procedures for tracking and adjusting interventions tend to be more specifically articulated within applications of CC (e.g., via regular supervisory or consultation meetings for case review).
Attention to, and evidence for, Tier 1 services within MTSS has grown rapidly nationwide (Durlak, Weissberg, Dymnicki, Taylor, & Schellinger, 2011), however many schools are struggling with day-to-day implementation efforts (VanDerHeyden & Burns, 2010). Furthermore, far fewer studies and less guidance is available to inform Tier 2 and 3 services (Bruns et al., 2016) and a significant gap between “what works” and what actually gets implemented, particularly in relation to school-based mental health, remains (Forman et al., 2013; Owens et al., 2014). Integration of components of the CC approach, such as navigating entry into appropriate services, delivering a continuum of selective and indicated behavioral health supports, and systematizing effective behavioral health progress monitoring, could facilitate achievement of MTSS objectives. For example, MTSS models call for universal screening of students with the aim of identifying at risk students and subsequently monitoring progress (Sugai & Horner, 2009). Research, however, indicates that less than 2% of schools utilize systematic screening of mental and behavioral health problems (Romer & McIntosh, 2005) and frequently do not have systems in place to monitor treatment progress for students receiving Tier 2 and 3 services (Lyon, Bruns, et al., 2014). A cornerstone of the CC model is the systematic utilization of primary care or physical health providers (e.g., via targeted training and the provision of standardized assessment tools) to support the identification of appropriate cases for services that are then coordinated by case managers. Schools often employ multidisciplinary health and mental health professionals (e.g., nurses, psychologists, and social workers), who consult regularly with school- and community-based supports for students (Weist et al., 2012) and could be utilized to help identify students and assure that students get needed services. As described in further detail below, CC addresses these issues by establishing and revising professional roles to support its key components, such as case management, building communication and collaboration structures to facilitate information sharing, and promoting accountability. Key functions of CC roles include initial identification of cases, assessment of needs/diagnosis, liaising/coordination with service providers and recipients, psychosocial intervention delivery, and medication management, among others. Because the MTSS framework is comprised primarily of overarching principles, it is less specific with regard to the specific roles and functions of participating professionals. For this reason, CC reflects a possible method through which to support MTSS objectives, particularly at the Tier 2 and 3 levels.
Despite the potential for CC and MTSS to work synergistically to address student needs by promoting accountability, supporting mental health services using existing resources, and establishing specific roles and communication structures to facilitate efficiency and effectiveness, insufficient research has been done to advance a CC model for the education sector. This reflects a substantial missed opportunity, given the potential for integrated models to help address many outstanding issues surrounding the accessibility, effectiveness, and efficiency of school-based mental health.
A Preliminary Collaborative Care Model for Schools
In an effort to capitalize on the synergy between CC and MTSS, our research team is working to develop an adapted model that retains key core components from adult- and youth-oriented versions of CC while increasing contextual appropriateness for the education sector. Table 1 displays core components of the established CC model (i.e., service provider roles, emphasis on evidence-based intervention, symptom tracking/clinical information systems, stepped care, consultation/supervision, service recipient education, and case management), which have been synthesized from the extant models of pediatric CC (Asarnow et al., 2015; Campo et al., 2005; Kolko & Perrin, 2014, 2014; Richardson et al., 2014), as well as the intended functions of the components. In addition, the table details documented constraints of the education sector that are likely to drive modifications of the CC model. These include the characteristics of students, who tend to present with a wide range of developmental and behavioral/emotional problems (Lyon, Bruns, et al., 2014; Walker, Kerns, Lyon, Bruns, & Cosgrove, 2010); the need for health and mental health interventions in schools to align with the educational mission and educational outcomes (Prodente, Sander, & Weist, 2002); tradeoffs between service accessibility and ease of facilitating parental engagement (Langley, Nadeem, Kataoka, Stein, & Jaycox, 2010); variability in medical staff availability in schools, as well as the appropriateness of a central role for medical providers (Bohnenkamp, Stephan, & Bobo, 2015; Power, Blum, Guevara, Jones, & Leslie, 2013); and opportunities to involve a range of educational personnel in mental health interventions (Owens et al., 2014).
Table 1.
Collaborative Care Model for Youth* | Education Sector Constraints | School-Based Collaborative Care Model | |
---|---|---|---|
Core Components | Functions | Potential Adaptations | |
Key Leadership Team/Service Provider Roles:
|
Liaison, assessment/monitoring, coordination (CM); Intervention support, medication management, case identification (PCP); Consultation, diagnostic clarification, CM training (Psychiatrist/Psychologist) | Mental health problems are frequently initially identified by educators (Green, Xuan, Kwong, Hoagwood, & Leaf, 2015). No clear individual to function in CM role (Power et al., 2013). |
|
Evidence-Based Intervention | Maximize the effectiveness of clinical contacts | School mental health providers unlikely to use EBPs (Langley et al., 2010; Owens et al., 2014) Presenting problems seen in school mental health represent a wide range of internalizing, externalizing, relational problems, as well as educational problems, etc. (Walker et al., 2010). |
|
Symptom Tracking / Clinical Information Systems | Monitor treatment and response; Decision support; Service recipient feedback and engagement; Facilitate service integration | Schools are principally focused on educational outcomes (e.g., attendance, grades, test scores), even when mental health services are concerned (Prodente et al., 2002). Many youth presenting for school-based mental health services demonstrate subclinical levels of problems, making traditional symptom tracking less relevant (Foster et al., 2005; Jonson-Reid, Kontak, Citerman, Essma, & Fezzi, 2004). HIPAA and FERPA laws make sharing medical and school records difficult (Geierstanger, Amaral, Mansour, & Walters, 2004; Power et al., 2013). School-based providers often do not monitor treatment progress or provide client feedback related to health, mental health, and/or academic outcomes (Kelly & Lueck, 2011; Lyon, Ludwig, et al., 2015). |
|
Stepped Care Intervention Design | Efficient, individualized, and responsive service delivery | Schools must provide services to students with a wide range of severity levels (Fazel et al., 2014). |
|
Consultation / Supervision | Decision support; Intervention integrity | Consultation with referral sources (i.e., teachers, administrators, instructional support teams) is often an expectation (Weist et al., 2012). School-based mental health providers often work in isolation from other providers (Lyon, Ludwig, et al., 2014). |
|
Client Education and Engagement | Family problem solving & management; Psycho-education; Post-discharge maintenance | Parent engagement in school-based services is often problematic, especially for older adolescents (Langley et al., 2010). Variable feedback provided to students regarding treatment. |
|
Case Management | Coordinate care; Connect to community resources or more intensive specialty care; Maintain relationships with local providers | Successful referrals outside of the school setting are difficult (Lyon, Ludwig, et al., 2014). Multiple indigenous helpers exist within schools to support students (Atkins et al., 2010; Owens et al., 2014). |
|
Based on Asarnow et al., 2015; Kolko & Perrin, 2014; Kolko et al., 2014; Richardson et al., 2014; Campo et al., 2005
Abbreviations: PCP = pediatric care provider; CM = care manager; EBP =evidence-based practice; SW=social worker; MTSS=Multi-tie MTSS=Multi-tiered Systems of Support
To be responsive to these constraints, Table 1 also details potential adaptations for a school-based CC model. It is important to emphasize that this model is preliminary and that some components will change as it is subjected to further systematic development and evaluation as the ACCESS project advances (see below). Highlights of the preliminary model surrounding service provider roles include identifying existing school-based personnel to function as care managers. In contrast to MTSS models, which frequently do not have a central contact person to coordinate and monitor treatments for students receiving Tier 2 and 3 services, CC explicitly details the objectives of an individual functioning in the care manager position (Ratzliff, Unutzer, Katon, & Stephens, 2016) and brings a well-documented history of establishing care managers using primarily existing resources. Because they sit at the center of the CC model, specific attention should be paid to the most effective ways of identifying, recruiting, and training individuals who will function as care coordinators. Care managers are typically charged with liaising among service personnel and with service recipients, organizing the services delivered by the other medical and mental health professionals, delivering some lower-intensity mental health interventions within a stepped care model, and monitoring outcomes. Individuals who have existing expertise working with multiple systems and integrating physical health, mental health, and educational health – such as school social workers, school nurses, school counselors, or school psychologists – may be optimally suited for this role.
Furthermore, because schools vary widely in the extent to which they can offer comprehensive primary care services a school-based CC model is likely to differ from primary care models in the scope of medical providers’ roles. Although schools with school-based health centers (SBHCs) typically provide primary care services, often via a nurse practitioner (Lofink et al., 2013), there are fewer than 2,000 such centers nationwide (Strozer, Juszczak, & Ammerman, 2010). To be effective and generalizable, an adapted CC model must be able to be responsive to varying school-based health and mental health personnel resources and administrative service arrangements (Foster et al., 2005). Such a model may ultimately deemphasize physical health providers, relative to existing CC models in primary care. Nevertheless, these types of providers are still likely to be critical to the overall success of the model, especially with regard to their ability to (1) facilitate the identification of students with mental health concerns who may present for physical health services, and (2) serve a supportive role – such as medication administration or monitoring – for more intensive cases where psychiatric medication may be prescribed by an external practitioner (e.g., psychiatrist, primary care provider).
Additional proposed adaptations relate to the nature of the evidence-based interventions supported by a school-based CC model. Although most existing models have focused on a single type of diagnosis or presenting problem (e.g., ADHD, depression) to conduct well-specified research, service needs in schools may necessitate a broader approach. Service models that are prepared to address a wider range of presenting problems are more likely to be judged to be useful by stakeholders such as clinicians (Borntrager, Chorpita, Higa-McMillan, & Weisz, 2009). Some approaches to pediatric CC (e.g., Kolko & Perrin, 2014) have begun to incorporate common elements of evidence-based interventions (Chorpita, Daleiden, & Weisz, 2005a) –delivered within a modular intervention framework (Chorpita, Daleiden, & Weisz, 2005b) – that allow for flexibility and responsivity to client presenting problems. These approaches are compelling, considering research supporting the effectiveness of common elements interventions relative to both usual care and standard-arranged evidence-based treatment manuals (Weisz et al., 2012). Furthermore, prior research has documented that a modularized, common elements paradigm demonstrates good fit for groups of school-based mental health providers (Lyon, Ludwig, et al., 2014; Lyon, Charlesworth-Attie, Vander Stoep, & McCauley, 2011; Stephan, Wissow, & Pichler, 2010; Weist et al., 2009), with some studies including medical providers as well (Stephan, Connors, Arora, & Brey, 2013). Building on these findings, faculty from the University of Maryland’s Center for School Mental Health have developed an innovative initiative, the Mental Health Training Intervention for Health Providers in Schools (MH-TIPS; Bohnenkamp et al., 2015), which includes training for school nurses in common elements of evidence-based practice.
Potential opportunities for addressing a wider variety of presenting problems are discussed in the research agenda detailed below. In addition, symptom tracking and clinical information systems will likely need to be augmented to incorporate educational outcomes. A digital registry for outcome tracking, originally designed to support CC for adults, has recently been adapted for use with youth receiving school-based mental health services (Lyon et al., 2016), but is not yet optimized to support a school-specific collaborative model. Given that the functions of many health information technologies are only likely to be optimized if the clinical information and decision models that underlie them are well specified (Chorpita, Daleiden, & Bernstein, 2015), a clearly articulated CC model for schools is a critical first step in developing or adapting technologies to support it. Although existing information systems designed for clinical purposes may be adapted for this purpose, it may also be appropriate for school-based CC providers to make use of existing educational data systems that support monitoring these kinds of outcomes (e.g., May et al., 2003). A stepped care model in schools will also continue to be critical for efficiently addressing student needs. Such a model can be made more explicit through the MTSS multi-tier framework that also incorporates universal school-wide supports to reduce overall service needs and which makes clear distinctions between Tier 2 and Tier 3 services. Related, consultation and supervision can be expanded to support educators surrounding the identification of – and supports for – students with mental health service needs. Client education and engagement efforts may need to be increased, especially among younger students or students with externalizing problems – where parental involvement is particularly critical. Finally, to capitalize on existing school resources, case management activities for school-based CC should attend to both internal and external resources, including indigenous helpers who can continue to support service recipients following the conclusion of formal services.
Advancing Research on Collaborative Care in Schools
There is strong evidence for the effectiveness of CC models for adults and, increasingly, for youth in primary care settings. The preliminary adaptations of the model, presented in the section above, provide a potential framework for pursuing a CC research agenda in schools. Doing so is likely to further expand the public health relevance of the model for youth by capitalizing on the accessibility of the education sector and building on the tiered service delivery systems already in place in many schools. Below, we articulate an overarching research agenda for evaluating the viability of CC in schools and determining which additional adaptations may be necessary in order to best achieve the accessibility, quality, and efficiency objectives on which the model was originally founded (Katon & Unützer, 2013). In addition, we describe a project currently underway to refine and evaluate the proposed model and advance the study of CC in schools.
A Preliminary Research Agenda
Given that research evaluating CC models in schools is only just emerging, studies should attend explicitly to evaluating and enhancing the contextual appropriateness, or fit, of these models. Indeed, innovation-setting fit has been identified as a commonly-referenced, but infrequently studied, implementation outcome (Aarons, Hurlburt, & Horwitz, 2010; Lyon, Ludwig, et al., 2014; Southam-Gerow, Rodríguez, Chorpita, & Daleiden, 2012). In particular, this includes the alignment of the model and its associated innovations (e.g., digital patient registries) with different aspects of the individuals (e.g., service providers, service recipients), structures/policies (e.g., academic calendar), and resources (e.g., funding sources, workforce allocation) available in the school context. Although many characteristics of destination settings are commonly conceptualized as barriers to the implementation or effectiveness of evidence-based practices, an alternative – or complementary – perspective is to view them as local constraints that may be leveraged to improve the local relevance and impact of new innovations (Chambers, Glasgow, & Stange, 2013; Lyon & Koerner, 2016). It is primarily this latter perspective that has informed the research directions described below, which include attention to: (a) alignment between the CC model and the roles and personnel present in schools, (b) intervention content, (c) technologies to support collaborative service delivery, and (d) the effectiveness and efficiency of the CC approach.
Professional role alignment
The preliminary model presented above provides some direction surrounding the school-based personnel whose roles could be shifted to support the implementation of a CC model in schools. Although the availability of school-based physical and mental health providers is variable across schools and districts, the CC model fortunately makes few assumptions about the specific type of professionals who must carry out its specific functions. Indeed, optimal distribution of the tasks contained within the model (e.g., student identification, service coordination, outcome monitoring) among existing or new service providers in the education sector remains largely unknown. Redefining professional roles by shifting some tasks to other (less expensive or more accessible) service providers is an implementation strategy with growing enthusiasm and empirical support (Murray et al., 2014; Patel, 2009; Powell et al., 2012, 2015). Although there may be variability in the extent to which different service providers are interested in adopting new roles, authors have begun to point out the promise of this approach for SBMH (Bruns et al., 2016; Fazel, Patel, Thomas, & Tol, 2014; Owens et al., 2014). Mapping indigenous service providers’ roles to determine who may be situated to deliver components of the CC model in schools represents an important future step for continued research.
Intervention content
CC is, first and foremost, a service delivery model driven by a set of structures and principles that shape provider communication, case conceptualization, and intervention. Although there is a strong emphasis on evidence-based practice, the content of the interventions delivered within this model varies across applications. If, as indicated above, CC in schools is going to be responsive to a wide range of student social, emotional, and behavioral health concerns (including those that are primarily internalizing or externalizing), then circumscribed and disorder-specific intervention approaches are likely to be insufficient. Future research on CC in schools should include explicit attention to the ways in which evidence-based content can best be delivered to service recipients with different presenting problems and at different developmental levels, as well as whether a common elements approach (Chorpita et al., 2005a) has the opportunity to increase the reach and effectiveness of the intervention model in that setting.
Use of technology
Digital technologies (e.g., patient registries and decision support tools) have quickly become a cornerstone of the CC model due to their ability to integrate physical and mental health data, support data-driven decision making, and enhance evidence-based service delivery (Kolko et al., 2014; Kolko & Perrin, 2014; Power et al., 2013; Richardson et al., 2014). Many outstanding issues remain, however, regarding how integrated data systems may support CC delivery in the education sector. For example, given that some school-based providers struggle with parent engagement (Langley et al., 2010), technologies may provide one pathway through which to collect and share information. Partnering to Achieve School Success (PASS), is another intervention model that includes explicit collaborative work between primary care and school settings, but with services located in primary care, not schools (Power et al., 2013; Power, Lavin, Mautone, & Blum, 2010). The PASS program (Power et al., 2010) relies heavily on a relatively simple technology, telephone communications, to augment face-to-face services. Findings suggest that telephone contacts predicted treatment initiation. Additional ways to strategically use technologies (e.g., service recipient portals for registries, personalized health records, text messages) to bridge the “home-school gap” and support involvement of parents and youth in education sector service delivery represents an important avenue for future research.
Considering that one goal of the adapted CC model is to track educational as well as health-related data (see Table 1) and that recent findings indicate school-based mental health professionals place a high value on educational indicators to monitor progress (Connors, Arora, Curtis, & Stephan, 2015; Lyon et al., 2015), it is imperative that decision support technologies for CC in schools have the capability to track educational outcomes. Lyon, Borntrager, Nakamura, and Higa-McMillan (2013) articulated how digital infrastructure to support educational data monitoring in school-based mental health may include (a) the development of new technologies or (b) the repurposing of existing technologies to support clinical objectives. Implementation of CC in the education sector is unlikely to be fully supported by existing health-related or educational data systems, so some level of adaptation is likely to be indicated. Research is necessary to determine the ways that existing technologies may be best adapted to facilitate CC workflows in schools. Addressing data sharing between school and clinical staff to meet Federal Educational Rights and Privacy Act (FERPA) and Health Insurance Portability and Accountability Act (HIPAA) requirements will also be critical to developing adapted health information systems for schools.
Effectiveness and implementability
Ultimately, the value of CC models in schools will be determined by their ability to promote improved student outcomes, relative to more traditional services. Given the priorities of the education sector, evaluations should be designed to determine the impact of CC on both the mental health and educational outcomes of youth. In addition, to rapidly prepare a school-specific CC model for scale-up, hybrid effectiveness-implementation models (Bernet, Willens, & Bauer, 2013; Curran, Bauer, Mittman, Pyne, & Stetler, 2012) may be considered to circumvent the more traditional and protracted stepwise progression from efficacy to effectiveness and, ultimately, implementation. Hybrid designs simultaneously evaluate (a) an intervention’s impact in real world and (b) the implementation strategy (or strategies) used to install the intervention. As an initial step, a “Hybrid 1” trial, which focuses on effectiveness, may evaluate the impact of the CC model on students receiving school-based services while simultaneously collecting descriptive information about the conditions or processes that lead to successful (or unsuccessful) implementation. This is particularly important given that very little attention has been paid to implementation models for establishing CC for pediatric populations (Kolko & Perrin, 2014). Relevant factors may include facets of implementation climate (Ehrhart, Aarons, & Farahnak, 2014), implementation leadership (Aarons, Ehrhart, Farahnak, & Sklar, 2014), or available personnel/resources. Finally, given prior research indicating that $6.50 are saved for every $1 spent delivering CC in primary care settings (Unützer et al., 2008), carefully evaluation of the costs (and cost-effectiveness) of the model in the education sector is important. In schools, administrative arrangements for mental health services vary widely, with financial responsibility sometimes falling to districts, external healthcare providers, or other entities (Foster et al., 2005). The cost savings associated with CC delivery may be experienced by different SBMH stakeholders, based on these arrangements. Cost savings in schools may also be better reflected in nonmonetary benefits such as improved attendance, increased retention and graduation rates.
Current Effort: The ACCESS Project
The ACCESS project was initiated based on identified needs to increase the use of evidence-based practices by school-based practitioners; further enhance service accessibility; and integrate mental health, primary care, and educational providers and services – needs which mirror those identified in the literature (described above). This project leverages a longstanding partnership involving a local public health organization, multiple community-based health service organizations that provide embedded mental and physical health services in schools, area school districts, and academic researchers, who will engage in an iterative process, incorporating stakeholder input and pilot testing, to develop the ACCESS model. The CC model was selected for adaptation based on its strong empirical support, potential for fit with the school context and MTSS, the public health organization’s existing familiarity with the model in the county’s primary care settings (Unützer et al., 2012), and a desire for system-wide service model standardization. Key project activities include: (a) Synthesis of existing CC models to identify “core components” and “adaptable periphery” (Damschroder et al., 2009) of CC to determine which elements are essential when implementing the model in schools; (b) Holding collaborative stakeholder planning meetings to allow providers, districts, community agencies, and service recipients to provide structured input into the development of the ACCESS model; (c) Developing an adapted CC model for schools (i.e., the ACCESS model), based on the content presented in the current paper and stakeholder input; (d) Revising the ACCESS model through systematic, mixed methods data collection surrounding the model’s adherence to core components of CC and appropriateness to the school context; (e) Piloting the ACCESS training and implementation procedures with a small number of integrated service teams in schools to determine acceptability, feasibility, appropriateness, and likely effectiveness; and (f) Articulating a plan for larger-scale implementation and sustainment, including review of existing methods of adjusting fee and payment structures to support CC (Unützer et al., 2012).
Through the process described above, we anticipate that the model presented in Table 1 will be revised, portions elaborated, and preliminary evidence gathered to drive future innovation and research. Most importantly, we intend to engage in a deliberate process with school stakeholders of identifying appropriate school-based and external personnel to engage in the key functions of each CC role (e.g., assessment/identification, monitoring, case management, consultation). In our pilot, we will also explicitly evaluate the extent to which existing health-information technologies support assessment, progress monitoring, stepped care decision-making, and effective consultation/supervision processes; all a key components of the CC model. Previous work in the service system in which the pilot will occur has involved adaptation of a measurement feedback system – a type of clinical information system that supports the progress monitoring by collecting and providing feedback to service providers and recipients – in the educational context (Lyon et al., 2016). We anticipate that providers and consultants piloting the ACCESS model will use this system to identify students for discussion and problem solving.
Conclusion
This paper is intended to build on innovative research conducted in the primary care and education sectors and move toward explicit adaptation of the CC model to support integrated school-based mental health services. In light of growing sentiment that traditional specialty mental health services are likely to be increasingly de-emphasized and supplanted in favor of co-located and integrated services (Fazel et al., 2014), initiatives such as the one described herein are timely and important. Models that support collaborations among medical providers, mental health providers, and educators carry great potential to support more accessible, effective, and efficient services (Katon & Unützer, 2013). Situating these models in schools is likely to improve their reach and facilitate positive mental health and educational outcomes for youth. Nevertheless, many questions remain about the optimal ways to align CC with the education sector to ensure sufficient flexibility and to address the specific needs and resources of individual districts and school buildings. Although somewhat challenging, these questions are not new to CC, which almost invariably must be implemented with consideration of existing financial and practice resources (Kolko & Perrin, 2014). The preliminary model described above reflects our team’s initial attempt to address some of the most critical elements of contextual appropriateness. Although we expect the model to be revised – perhaps substantially – as the ACCESS project activities unfold, we remain optimistic about the potential for the model to break down boundaries between physical health, mental health, and education in support of the larger goals of enhanced student wellbeing.
Acknowledgments
Funding: Work on this publication was supported in part by the Klingenstein Third Generation Foundation and the National Institute of Mental Health (award number K08MH095939).
Footnotes
Disclosure: None of the authors have any financial conflicts of interest to disclose.
References
- Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research. 2010;38(1):4–23. doi: 10.1007/s10488-010-0327-7. http://doi.org/10.1007/s10488-010-0327-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Aarons G, Ehrhart M, Farahnak L, Sklar M. The role of leadership in creating a strategic climate for evidence-based practice implementation and sustainment in systems and organizations. Frontiers in Public Health Services and Systems Research. 2014;3(4) doi: 10.1146/annurev-publhealth-032013-182447. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Archer J, Bower P, Gilbody S, Lovell K, Richards D, Gask L, … Coventry P. Collaborative care for depression and anxiety problems. Cochrane Database of Systematic Reviews. 2012;10:CD006525. doi: 10.1002/14651858.CD006525.pub2. http://doi.org/10.1002/14651858.CD006525.pub2. [DOI] [PubMed] [Google Scholar]
- Asarnow JR, Jaycox LH, Duan N, LaBorde AP, Rea MM, Murray P, … Wells KB. Effectiveness of a quality improvement intervention for adolescent depression in primary care clinics: a randomized controlled trial. Jama. 2005;293(3):311–319. doi: 10.1001/jama.293.3.311. [DOI] [PubMed] [Google Scholar]
- Asarnow JR, Rozenman M, Wiblin J, Zeltzer L. Integrated medical-behavioral care compared with usual primary care for child and adolescent behavioral health: A meta-analysis. JAMA Pediatrics. 2015;169(10):929–937. doi: 10.1001/jamapediatrics.2015.1141. http://doi.org/10.1001/jamapediatrics.2015.1141. [DOI] [PubMed] [Google Scholar]
- Atkins MS, Hoagwood KE, Kutash K, Seidman E. Toward the integration of education and mental health in schools. Administration and Policy in Mental Health and Mental Health Services Research. 2010;37(1–2):40–47. doi: 10.1007/s10488-010-0299-7. http://doi.org/10.1007/s10488-010-0299-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bernet AC, Willens DE, Bauer MS. Effectiveness-implementation hybrid designs: Implications for quality improvement science. Implementation Science. 2013;8(supplement 1) Retrieved from http://www.biomedcentral.com/content/pdf/1748-5908-8-S1-S2.pdf. [Google Scholar]
- Bohnenkamp JH, Stephan SH, Bobo N. Supporting student mental health: The role of the school nurse in coordinated school mental health care. Psychology in the Schools. 2015;52(7):714–727. http://doi.org/10.1002/pits.21851. [Google Scholar]
- Borntrager CF, Chorpita BF, Higa-McMillan C, Weisz JR. Provider attitudes toward evidence-based practices: are the concerns with the evidence or with the manuals? Psychiatric Services (Washington, DC) 2009;60(5):677–681. doi: 10.1176/ps.2009.60.5.677. http://doi.org/10.1176/appi.ps.60.5.677. [DOI] [PubMed] [Google Scholar]
- Bowers H, Manion I, Papadopoulos D, Gauvreau E. Stigma in school-based mental health: Perceptions of young people and service providers. Child and Adolescent Mental Health. 2013;18(3):165–170. doi: 10.1111/j.1475-3588.2012.00673.x. http://doi.org/10.1111/j.1475-3588.2012.00673.x. [DOI] [PubMed] [Google Scholar]
- Bruns EJ, Duong MT, Lyon AR, Pullmann MD, Cook CR, Cheney D, McCauley E. Fostering SMART partnerships to develop an effective continuum of behavioral health services and supports in schools. American Journal of Orthopsychiatry. 2016;86(2):156–170. doi: 10.1037/ort0000083. http://doi.org/10.1037/ort0000083. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Campo JV, Shafer S, Strohm J, Lucas A, Cassesse CG, Shaeffer D, Altman H. Pediatric behavioral health in primary care: a collaborative approach. Journal of the American Psychiatric Nurses Association. 2005;11(5):276–282. http://doi.org/10.1177/1078390305282404. [Google Scholar]
- Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8(1):117. doi: 10.1186/1748-5908-8-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chorpita BF, Daleiden EL, Bernstein AD. At the intersection of health information technology and decision support: measurement feedback systems…and beyond. Administration and Policy in Mental Health and Mental Health Services Research. 2015:1–7. doi: 10.1007/s10488-015-0702-5. http://doi.org/10.1007/s10488-015-0702-5. [DOI] [PubMed]
- Chorpita BF, Daleiden EL, Weisz JR. Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research. 2005a;7(1):5–20. doi: 10.1007/s11020-005-1962-6. http://doi.org/10.1007/s11020-005-1962-6. [DOI] [PubMed] [Google Scholar]
- Chorpita BF, Daleiden EL, Weisz JR. Modularity in the design and application of therapeutic interventions. Applied and Preventive Psychology. 2005b;11(3):141–156. http://doi.org/10.1016/j.appsy.2005.05.002. [Google Scholar]
- Clarke G, Debar L, Lynch F, Powell J, Gale J, O’Connor E, … Hertert S. A randomized effectiveness trial of brief cognitive-behavioral therapy for depressed adolescents receiving antidepressant medication. Journal of the American Academy of Child & Adolescent Psychiatry. 2005;44(9):888–898. http://doi.org/10.1016/S0890-8567(09)62194-8. [PubMed] [Google Scholar]
- Connors EH, Arora P, Curtis L, Stephan SH. Evidence-based assessment in school mental health. Cognitive and Behavioral Practice. 2015;22(1):60–73. http://doi.org/10.1016/j.cbpra.2014.03.008. [Google Scholar]
- Costello EJ, Mustillo S, Erkanli A, Keeler G, Angold A. Prevalence and development of psychiatric disorders in childhood and adolescence. Archives of General Psychiatry. 2003;60(8):837–844. doi: 10.1001/archpsyc.60.8.837. http://doi.org/10.1001/archpsyc.60.8.837. [DOI] [PubMed] [Google Scholar]
- Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs. Medical Care. 2012;50(3):217–226. doi: 10.1097/MLR.0b013e3182408812. http://doi.org/10.1097/MLR.0b013e3182408812. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC, et al. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Science. 2009;4(1):50. doi: 10.1186/1748-5908-4-50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Durlak JA, Weissberg RP, Dymnicki AB, Taylor RD, Schellinger KB. The impact of enhancing students’ social and emotional learning: a meta-analysis of school-based universal interventions. Child Development. 2011;82(1):405–432. doi: 10.1111/j.1467-8624.2010.01564.x. http://doi.org/10.1111/j.1467-8624.2010.01564.x. [DOI] [PubMed] [Google Scholar]
- Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: The development and validity testing of the Implementation Climate Scale (ICS) Implement Sci. 2014;9:157. doi: 10.1186/s13012-014-0157-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Elkin TD, Sarver DE, Wong Sarver N, Young J, Buttross S. Future Directions for the implementation and dissemination of statewide developmental-behavioral pediatric integrated health care. Journal of Clinical Child & Adolescent Psychology. doi: 10.1080/15374416.2016.1152551. in press. [DOI] [PubMed] [Google Scholar]
- Evans SW, Weist MD. Commentary: Implementing empirically supported treatments in the schools: What are we asking? Clinical Child and Family Psychology Review. 2004;7(4):263–267. doi: 10.1007/s10567-004-6090-0. http://doi.org/10.1007/s10567-004-6090-0. [DOI] [PubMed] [Google Scholar]
- Farmer EMZ, Burns BJ, Phillips SD, Angold A, Costello EJ. Pathways into and through mental health services for children and adolescents. Psychiatric Services. 2003;54(1):60–66. doi: 10.1176/appi.ps.54.1.60. http://doi.org/10.1176/appi.ps.54.1.60. [DOI] [PubMed] [Google Scholar]
- Fazel M, Hoagwood K, Stephan S, Ford T. Mental health interventions in schools in high-income countries. The Lancet Psychiatry. 2014;1(5):377–387. doi: 10.1016/S2215-0366(14)70312-8. http://doi.org/10.1016/S2215-0366(14)70312-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fazel M, Patel V, Thomas S, Tol W. Mental health interventions in schools in low-income and middle-income countries. The Lancet Psychiatry. 2014;1(5):388–398. doi: 10.1016/S2215-0366(14)70357-8. http://doi.org/10.1016/S2215-0366(14)70357-8. [DOI] [PubMed] [Google Scholar]
- Forman SG, Shapiro ES, Codding RS, Gonzales JE, Reddy LA, Rosenfield SA, … Stoiber KC. Implementation science and school psychology. School Psychology Quarterly. 2013;28(2):77. doi: 10.1037/spq0000019. [DOI] [PubMed] [Google Scholar]
- Foster S, Rollefson M, Doksum T, Noonan D, Robinson G, Teich J. School mental health services in the United States, 2002–2003. SAMHSA’s National Clearinghouse for Alcohol and Drug Information (NCADI) 2005 Retrieved from http://eric.ed.gov/?id=ED499056.
- Geierstanger SP, Amaral G, Mansour M, Walters SR. School-based health centers and academic performance: research, challenges, and recommendations. Journal of School Health. 2004;74(9):347–352. doi: 10.1111/j.1746-1561.2004.tb06627.x. http://doi.org/10.1111/j.1746-1561.2004.tb06627.x. [DOI] [PubMed] [Google Scholar]
- Green JG, McLaughlin KA, Alegría M, Costello EJ, Gruber MJ, Hoagwood K, … Kessler RC. School mental health resources and adolescent mental health service use. Journal of the American Academy of Child & Adolescent Psychiatry. 2013;52(5):501–510. doi: 10.1016/j.jaac.2013.03.002. http://doi.org/10.1016/j.jaac.2013.03.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Green JG, Xuan Z, Kwong L, Hoagwood K, Leaf PJ. School referral patterns among adolescents with serious emotional disturbance enrolled in systems of care. Journal of Child and Family Studies. 2015;25(1):290–298. doi: 10.1007/s10826-015-0209-4. http://doi.org/10.1007/s10826-015-0209-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hilt RJ, Romaire MA, McDonell MG, Sears JM, Krupski A, Thompson JN, … Trupin EW. The Partnership ACollaborative Careess Line: evaluating a child psychiatry consult program in Washington State. JAMA pediatrics. 2013;167(2):162–168. doi: 10.1001/2013.jamapediatrics.47. [DOI] [PubMed] [Google Scholar]
- Jonson-Reid M, Kontak D, Citerman B, Essma A, Fezzi N. School social work case characteristics, services, and dispositions: Year one results. Children & Schools. 2004;26(1):5–22. http://doi.org/10.1093/cs/26.1.5. [Google Scholar]
- Kataoka SH, Zhang L, Wells KB. Unmet need for mental health care among US children: Variation by ethnicity and insurance status. American Journal of Psychiatry. 2002;159(9):1548–1555. doi: 10.1176/appi.ajp.159.9.1548. [DOI] [PubMed] [Google Scholar]
- Kataoka S, Stein BD, Nadeem E, Wong M. Who gets care? Mental health service use following a school-based suicide prevention program. Journal of the American Academy of Child & Adolescent Psychiatry. 2007;46(10):1341–1348. doi: 10.1097/chi.0b013e31813761fd. http://doi.org/10.1097/chi.0b013e31813761fd. [DOI] [PubMed] [Google Scholar]
- Katon WJ, Unützer J. Health reform and the Affordable Care Act: The importance of mental health treatment to achieving the triple aim. Journal of Psychosomatic Research. 2013;74(6) doi: 10.1016/j.jpsychores.2013.04.005. http://doi.org/10.1016/j.jpsychores.2013.04.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kelly MS, Lueck C. Adopting a data-driven public health framework in schools: Results from a multi-disciplinary survey on school-based mental health practice. Advances in School Mental Health Promotion. 2011;4(4):5–12. http://doi.org/10.1080/1754730X.2011.9715638. [Google Scholar]
- Kolko DJ, Campo J, Kilbourne AM, Hart J, Sakolsky D, Wisniewski S. Collaborative care outcomes for pediatric behavioral health problems: a cluster randomized trial. Pediatrics. 2014;133(4):X35–X35. doi: 10.1542/peds.2013-2516. http://doi.org/10.1542/peds.2013-2516d. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kolko DJ, Campo JV, Kelleher K, Cheng Y. Improving access to care and clinical outcome for pediatric behavioral problems: A randomized trial of a nurse-administered intervention in primary care. Journal of Developmental and Behavioral Pediatrics: JDBP. 2010;31(5):393–404. doi: 10.1097/DBP.0b013e3181dff307. http://doi.org/10.1097/DBP.0b013e3181dff307. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kolko DJ, Campo JV, Kilbourne AM, Kelleher K. Doctor-office collaborative care for pediatric behavioral problems: a preliminary clinical trial. Archives of Pediatrics & Adolescent Medicine. 2012;166(3):224–231. doi: 10.1001/archpediatrics.2011.201. http://doi.org/10.1001/archpediatrics.2011.201. [DOI] [PubMed] [Google Scholar]
- Kolko DJ, Perrin E. The integration of behavioral health interventions in children’s health care: services, science, and suggestions. Journal of Clinical Child & Adolescent Psychology. 2014;43(2):216–228. doi: 10.1080/15374416.2013.862804. http://doi.org/10.1080/15374416.2013.862804. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kutash K, Duchnowski AJ, Lynn N. School-based mental health: An empirical guide for decision-makers. Miami, FL: The Research & Training Center for Children’s Mental Health; 2006. Retrieved from http://rtckids.fmhi.usf.edu/rtcpubs/study04/default.cfm. [Google Scholar]
- Langley AK, Nadeem E, Kataoka SH, Stein BD, Jaycox LH. Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation. School Mental Health. 2010;2(3):105–113. doi: 10.1007/s12310-010-9038-1. http://doi.org/10.1007/s12310-010-9038-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lofink H, Kuebler J, Juszczak L, Schlitt J, Even M, Rosenberg J, White I. 2010–2011 School-Based Health Alliance census report. Washington, D.C: School-Based Health Alliance; 2013. [Google Scholar]
- Lyon AR, Borntrager C, Nakamura B, Higa-McMillan C. From distal to proximal: Routine educational data monitoring in school-based mental health. Advances in School Mental Health Promotion. 2013;6(4):263–279. doi: 10.1080/1754730X.2013.832008. http://doi.org/10.1080/1754730X.2013.832008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lyon AR, Bruns EJ, Weathers ES, Canavas N, Ludwig K, Stoep AV, … McCauley E. Taking evidence-based practices to school: using expert opinion to develop a brief, evidence-informed school-based mental health intervention. Advances in School Mental Health Promotion. 2014;7(1):42–61. http://doi.org/10.1080/1754730X.2013.857903. [Google Scholar]
- Lyon AR, Charlesworth-Attie S, Vander Stoep A, McCauley E. Modular psychotherapy for youth with internalizing problems: Implementation with therapists in school-based health centers. School Psychology Review. 2011;40(4):569. [Google Scholar]
- Lyon AR, Koerner K. User-centered design for psychosocial intervention development and implementation. Clinical Psychology: Science & Practice. 2016;23(2):180–200. doi: 10.1111/cpsp.12154. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lyon AR, Ludwig KA, VanderStoep A, Gudmundsen G, McCauley E. Patterns and predictors of mental healthcare utilization in schools and other service sectors among adolescents at risk for depression. School Mental Health. 2012;5(3):155–165. doi: 10.1007/s12310-012-9097-6. http://doi.org/10.1007/s12310-012-9097-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lyon AR, Ludwig K, Romano E, Koltracht J, Stoep AV, McCauley E. Using modular psychotherapy in school mental health: Provider perspectives on intervention-setting fit. Journal of Clinical Child & Adolescent Psychology. 2014;43(6):890–901. doi: 10.1080/15374416.2013.843460. http://doi.org/10.1080/15374416.2013.843460. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lyon AR, Ludwig K, Wasse JK, Bergstrom A, Hendrix E, McCauley E. Determinants and functions of standardized assessment use among school mental health clinicians: A mixed methods evaluation. Administration and Policy in Mental Health and Mental Health Services Research. 2015;43(1):122–134. doi: 10.1007/s10488-015-0626-0. http://doi.org/10.1007/s10488-015-0626-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lyon AR, Maras MA, Pate CM, Igusa T, VanderStoep A. Modeling the Impact of School-Based Universal Depression Screening on Additional Service Capacity Needs: A System Dynamics Approach. Administration and Policy in Mental Health and Mental Health Services Research. 2015;43(2):168–188. doi: 10.1007/s10488-015-0628-y. http://doi.org/10.1007/s10488-015-0628-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lyon AR, Wasse JK, Ludwig K, Zachry M, Bruns EJ, Unützer J, McCauley E. The Contextualized Technology Adaptation Process (CTAP): Optimizing health information technology to improve mental health systems. Administration and Policy in Mental Health and Mental Health Services Research. 2016;43(3):394–409. doi: 10.1007/s10488-015-0637-x. http://doi.org/10.1007/s10488-015-0637-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- May S, Ard WI, Todd AW, Horner RH, Glasgow A, Sugai G, Sprague J. School-wide information system. Eugene: Educational and Community Supports, University of Oregon; 2003. [Google Scholar]
- McLeod JD, Uemura R, Rohrman S. Adolescent mental health, behavior problems, and academic achievement. Journal of Health and Social Behavior. 2012 doi: 10.1177/0022146512462888. 622146512462888. http://doi.org/10.1177/0022146512462888. [DOI] [PMC free article] [PubMed]
- Mechanic D. Seizing opportunities under the Affordable Care Act for transforming the mental and behavioral health system. Health Affairs. 2012;31(2):376–382. doi: 10.1377/hlthaff.2011.0623. http://doi.org/10.1377/hlthaff.2011.0623. [DOI] [PubMed] [Google Scholar]
- Merikangas KR, He J, Burstein M, Swanson SA, Avenevoli S, Cui L, … Swendsen J. Lifetime Prevalence of Mental Disorders in US Adolescents: Results from the National Comorbidity Study-Adolescent Supplement (NCS-A) Journal of the American Academy of Child and Adolescent Psychiatry. 2010;49(10):980–989. doi: 10.1016/j.jaac.2010.05.017. http://doi.org/10.1016/j.jaac.2010.05.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Merikangas KR, He J, Burstein M, Swendsen J, Avenevoli S, Case B, … Olfson M. Service utilization for lifetime mental disorders in U.S. adolescents: Results of the National Comorbidity Survey–Adolescent Supplement (NCS-A) Journal of the American Academy of Child & Adolescent Psychiatry. 2011;50(1):32–45. doi: 10.1016/j.jaac.2010.10.006. http://doi.org/10.1016/j.jaac.2010.10.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Murray LK, Dorsey S, Haroz E, Lee C, Alsiary MM, Haydary A, … Bolton P. A common elements treatment approach for adult mental health problems in low- and middle-income countries. Cognitive and Behavioral Practice. 2014;21(2):111–123. doi: 10.1016/j.cbpra.2013.06.005. http://doi.org/10.1016/j.cbpra.2013.06.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Owens JS, Lyon AR, Brandt NE, Warner CM, Nadeem E, Spiel C, Wagner M. Implementation science in school mental health: Key constructs in a developing research agenda. School Mental Health. 2014;6(2):99–111. doi: 10.1007/s12310-013-9115-3. http://doi.org/10.1007/s12310-013-9115-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Patel V. The future of psychiatry in low- and middle-income countries. Psychological Medicine. 2009;39(11):1759–1762. doi: 10.1017/s0033291709005224. http://doi.org/10.1017/S0033291709005224. [DOI] [PubMed] [Google Scholar]
- Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, … York JL. A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review. 2012;69(2):123–157. doi: 10.1177/1077558711430690. http://doi.org/10.1177/1077558711430690. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, … Kirchner JE. A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science. 2015;10(1):21. doi: 10.1186/s13012-015-0209-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Power TJ, Blum NJ, Guevara JP, Jones HA, Leslie LK. Coordinating mental health care across primary care and schools: ADHD as a case example. Advances in School Mental Health Promotion. 2013;6(1):68–80. doi: 10.1080/1754730X.2013.749089. http://doi.org/10.1080/1754730X.2013.749089. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Power TJ, Hughes CL, Helwig JR, Nissley-Tsiopinis J, Mautone JA, Lavin HJ. Getting to first base: Promoting engagement in family–school intervention for children with ADHD in urban, primary care practice. School Mental Health. 2010;2(2):52–61. http://doi.org/10.1007/s12310-010-9029-2. [Google Scholar]
- Power TJ, Lavin HJ, Mautone JA, Blum NJ. Partnering to Achieve School Success: A collaborative care model of early intervention for attention and behavior problems in urban contexts. Handbook of Youth Prevention Science. 2010:375–392. [Google Scholar]
- Prodente CA, Sander MA, Weist MD. Furthering support for expanded school mental health programs. Children’s Services. 2002;5(3):173–188. http://doi.org/10.1207/S15326918CS0503_3. [Google Scholar]
- Pullmann MD, Bruns EJ, Daly BP, Sander MA. Improving the evaluation and impact of mental health and other supportive school-based programmes on students’ academic outcomes. Advances in School Mental Health Promotion. 2013;6(4):226–230. http://doi.org/10.1080/1754730X.2013.835543. [Google Scholar]
- Pullmann MD, VanHooser S, Hoffman C, Heflinger CA. Barriers to and supports of family participation in a rural system of care for children with serious emotional problems. Community Mental Health Journal. 2009;46(3):211–220. doi: 10.1007/s10597-009-9208-5. http://doi.org/10.1007/s10597-009-9208-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ratzliff A, Unutzer J, Katon W, Stephens KA. Integrated Care: Creating Effective Mental and Primary Health Care Teams. Hoboken, N.J: John Wiley & Sons; 2016. [Google Scholar]
- Richardson LP, Ludman E, McCauley E, Lindenbaum J, Larison C, Zhou C, … Katon W. Collaborative care for adolescents with depression in primary care: A randomized clinical trial. JAMA. 2014;312(8):809–816. doi: 10.1001/jama.2014.9259. http://doi.org/10.1001/jama.2014.9259. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Romer D, McIntosh K. The roles and perspectives of school mental health professionals in promoting adolescent mental health. In: Evans DL, Foa EB, Gur RE, Hendin H, O’Brien CP, Seligman ME, Walsh T, editors. Treating and preventing adolescent mental health disorders: What we know and what we don’t know: A research agenda for improving the mental health of our youth. New York: Oxford University Press; 2005. pp. 597–615. [Google Scholar]
- Southam-Gerow MA, Rodríguez A, Chorpita BF, Daleiden EL. Dissemination and implementation of evidence based treatments for youth: Challenges and recommendations. Professional Psychology: Research and Practice. 2012;43(5):527–534. http://doi.org/10.1037/a0029101. [Google Scholar]
- Stephan SH, Connors EH, Arora P, Brey L. A learning collaborative approach to training school-based health providers in evidence-based mental health treatment. Children and Youth Services Review. 2013;35(12):1970–1978. http://doi.org/10.1016/j.childyouth.2013.09.008. [Google Scholar]
- Stephan SH, Wissow L, Pichler E. Utilizing common factors and practice elements to improve mental health care by school-based primary care providers. Report on Emotional and Behavioral Disorders in Youth. 2010;10(54):81–86. [Google Scholar]
- Stephan S, Mulloy M, Brey L. Improving collaborative mental health care by school-based primary care and mental health providers. School Mental Health. 2011;3(2):70–80. http://doi.org/10.1007/s12310-010-9047-0. [Google Scholar]
- Strozer J, Juszczak L, Ammerman A. 2007–2008 National school-based health care census. Washington, DC: National Assembly on School-Based Health Care; 2010. [Google Scholar]
- Sugai G, Horner RH. Responsiveness-to-intervention and school-wide positive behavior supports: Integration of multi-tiered system approaches. Exceptionality. 2009;17(4):223–237. http://doi.org/10.1080/09362830903235375. [Google Scholar]
- Thota AB, Sipe TA, Byard GJ, Zometa CS, Hahn RA, McKnight-Eily LR, … Williams SP. Collaborative care to improve the management of depressive disorders: A community guide systematic review and meta-analysis. American Journal of Preventive Medicine. 2012;42(5):525–538. doi: 10.1016/j.amepre.2012.01.019. http://doi.org/10.1016/j.amepre.2012.01.019. [DOI] [PubMed] [Google Scholar]
- Unützer J, Chan YF, Hafer E, Knaster J, Shields A, Powers D, Veith RC. Quality improvement with pay-for-performance incentives in integrated behavioral health care. American Journal of Public Health. 2012;102(6):e41–e45. doi: 10.2105/AJPH.2011.300555. http://doi.org/10.2105/AJPH.2011.300555. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Unützer J, Harbin H, Schoenbaum M, Druss B. The collaborative care model: An approach for integrating physical and mental health care in Medicaid health homes. HEALTH HOME, Information Resource Center. 2013:1–13. [Google Scholar]
- Unützer J, Katon WJ, Fan MY, Schoenbaum MC, Lin EHB, Penna RDD, Powers D. Long-term cost effects of collaborative care for late-life depression. The American Journal of Managed Care. 2008;14(2):95–100. [PMC free article] [PubMed] [Google Scholar]
- VanDerHeyden AM, Burns MK. Essentials of response to intervention. Vol. 79. John Wiley & Sons; 2010. [Google Scholar]
- Von Korff M, Gruman J, Schaefer J, Curry SJ, Wagner EH. Collaborative management of chronic illness. Annals of Internal Medicine. 1997;127(12):1097–1102. doi: 10.7326/0003-4819-127-12-199712150-00008. http://doi.org/10.7326/0003-4819-127-12-199712150-00008. [DOI] [PubMed] [Google Scholar]
- Walker SC, Kerns SEU, Lyon AR, Bruns EJ, Cosgrove TJ. Impact of school-based health center use on academic outcomes. Journal of Adolescent Health. 2010;46(3):251–257. doi: 10.1016/j.jadohealth.2009.07.002. http://doi.org/10.1016/j.jadohealth.2009.07.002. [DOI] [PubMed] [Google Scholar]
- Weist MD, Mellin EA, Chambers KL, Lever NA, Haber D, Blaber C. Challenges to collaboration in school mental health and strategies for overcoming them. Journal of School Health. 2012;82(2):97–105. doi: 10.1111/j.1746-1561.2011.00672.x. http://doi.org/10.1111/j.1746-1561.2011.00672.x. [DOI] [PubMed] [Google Scholar]
- Weist M, Lever N, Stephan S, Youngstrom E, Moore E, Harrison B, … Stiegler K. Formative evaluation of a framework for high quality, evidence-based services in school mental health. School Mental Health. 2009;1(4):196–211. http://doi.org/10.1007/s12310-009-9018-5. [Google Scholar]
- Weisz JR, Chorpita BF, Palinkas LA, Schoenwald SK, Miranda J, Bearman SK … Research Network on Youth Mental Health. Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: a randomized effectiveness trial. Archives of General Psychiatry. 2012;69(3):274–282. doi: 10.1001/archgenpsychiatry.2011.147. http://doi.org/10.1001/archgenpsychiatry.2011.147. [DOI] [PubMed] [Google Scholar]
- Woltmann E, Grogan-Kaylor A, Perron B, Georges H, Kilbourne AM, Bauer MS. Comparative effectiveness of collaborative chronic care models for mental health conditions across primary, specialty, and behavioral health care settings: Systematic review and meta-analysis. American Journal of Psychiatry. 2012;169(8):790–804. doi: 10.1176/appi.ajp.2012.11111616. http://doi.org/10.1176/appi.ajp.2012.11111616. [DOI] [PubMed] [Google Scholar]