Abstract
Background:
Increased availability of evidence-based practices (EBPs) is essential to alleviating the negative public health and societal effects of behavioral health problems. A major challenge to implementing and sustaining EBPs broadly is the limited and fragmented nature of available funding.
Method:
We conducted a scoping review that assessed the current state of evidence on EBP financing strategies for behavioral health based on recent literature (i.e., post-Affordable Care Act). We defined financing strategies as techniques that secure and direct financial resources to support EBP implementation. This article introduces a conceptualization of financing strategies and then presents a compilation of identified strategies, following established reporting guidelines for the implementation strategies. We also describe the reported level of use for each financing strategy in the research literature.
Results:
Of 23 financing strategies, 13 were reported as being used within behavioral health services, 4 had potential for use, 5 had conceptual use only, and 1 was potentially contraindicated. Examples of strategies reported being used include increased fee-for-service reimbursement, grants, cost sharing, and pay-for-success contracts. No strategies had been evaluated in ways that allowed for strong conclusions about their impact on EBP implementation outcomes.
Conclusion:
The existing literature on EBP financing strategies in behavioral health raises far more questions than answers. Therefore, we propose a research agenda that will help better understand these financing strategies. We also discuss the implications of our findings for behavioral health professionals, system leaders, and policymakers who want to develop robust, sustainable financing for EBP implementation in behavioral health systems.
Plain language abstract:
Organizations that treat behavioral health problems (mental health and substance use) often seek to adopt and use evidence-based practices (EBPs). A challenge to adopting EBPs broadly is the limited funding available, often from various sources that are poorly coordinated with one another. To help organizations plan effectively to adopt EBPs, we conducted a review of recent evidence (i.e., since the passage of the 2010 Affordable Care Act) on strategies for financing EBP adoption in behavioral health systems. We present definitions of 23 identified strategies and describe each strategy’s reported (in the research literature) level of use to fund EBP adoption in behavioral health services. Of the 23 financing strategies, 13 strategies had evidence of use, 4 had potential for use, 5 had conceptual use only, and 1 was potentially contraindicated. Examples of strategies with evidence of use include increased fee-for-service reimbursement, grants, cost sharing, and pay-for-success contracts. This comprehensive list of EBP financing strategies may help guide decision-making by behavioral health professionals, system leaders, and policymakers. The article also presents a research agenda for building on the current research literature by (1) advancing methods to evaluate financing strategies’ effects, (2) partnering with stakeholders and decision-makers to examine promising financing strategies, (3) focusing on strategies and service systems with the greatest needs, (4) improving methods to guide the selection of financing strategies, and (5) paying greater attention to sustainable long-term financing of EBPs.
Keywords: Financing strategies, evidence-based practice, behavioral health systems, implementation, sustainment
The need for increased investment in evidence-based practices
Across the life span, as many as one in five people experience a mental health or substance use problem each year (Costello & Angold, 2016; Substance Abuse and Mental Health Services Administration, 2017), with billions of dollars in associated economic impact (Trautmann et al., 2016). Rigorous research has identified numerous evidence-based practices (EBPs) with demonstrated effectiveness for behavioral health problems (Society of Clinical Psychology, 2019; Weisz & Kazdin, 2017) that can also produce significant economic benefits when implemented on a large scale (Dopp et al., 2017, 2018; Okamura et al., 2018). Yet service systems continue to offer treatments of limited or unknown effectiveness (Bruns et al., 2016; Jones et al., 2014; McHugh & Barlow, 2010)—especially for marginalized and underserved groups (Agency for Healthcare Research and Quality, 2017). The U.S. behavioral health system needs reforms that make EBPs much more widely available than is currently the case, thus maximizing the population-level impact of services (Jones et al., 2014; Kazak et al., 2010).
A growing body of research identifies ways to improve the implementation of EBPs, where implementation means the initial adoption and spreading of EBPs in everyday clinical settings (Bauer et al., 2015). Many factors can influence implementation processes and outcomes, but limited and fragmented funding is often noted as a critical barrier to EBP implementation (Beidas et al., 2016; Lang & Connell, 2017; Raghavan et al., 2008). To help address that barrier, we conducted a scoping review to identify financing strategies that might support the implementation of EBPs in behavioral health services.
Challenges involved in funding EBP implementation
Implementing EBPs is expensive for behavioral health provider agencies because it generally requires them to engage in many activities beyond typical service provision (Bruns et al., 2016; Chambers et al., 2013; McHugh & Barlow, 2010; Raghavan et al., 2008; Schoenwald et al., 2011), such as monitoring treatment outcomes, fidelity, and adaptations; delivery of non-routine services (e.g., case management, care coordination, and caregiver involvement); purchasing required resources and materials; and expert training and consultation. These activities are not only core to many EBPs but also result in numerous direct costs and indirect expenses (i.e., lost productivity or billable hours) that can be difficult for an agency to afford; subsequently, such core activities are often absent or low-quality in community services. Given the ongoing, dynamic influences of factors like clinician turnover (Beidas et al., 2016), continued implementation support is also necessary to sustain EBPs, representing a considerable ongoing investment (Bond et al., 2014; Roundfield & Lang, 2017).
Unfortunately, the funding needs of EBPs are not well aligned with typical methods of financing for behavioral health services, which rely heavily on siloed service delivery systems (e.g., mental health and substance use) seeking support from third-party funders (e.g., public and commercial insurers, government authorities, philanthropy; see Garfield, 2011). Funding for direct service delivery traditionally comes from program budgets and fee-for-service payments. Indeed, private and public payors currently account for nearly all U.S. health care expenditures (Cleverley & Cleverley, 2018; Folland et al., 2017), including behavioral health (Frank & Glied, 2006), and therefore funders have a tremendous influence on service delivery systems. Since these funds are often too limited to cover EBP delivery costs, let alone implementation (Knapp et al., 2006; Stewart et al., 2016), funders may disincentivize EBP implementation in favor of low-cost treatment options. This is especially true in behavioral health where patients often have little ability to pay for care out-of-pocket.
Strategies to finance EBP implementation
Within the current funding context, maximizing the public health impact of EBPs will require implementation strategies that can align service delivery and funding systems to effectively support implementation activities (Knapp et al., 2006). Implementation strategies are methods or techniques used to enhance implementation, sustainment, or scale-up of an EBP (Proctor et al., 2013). Over the past decade, a national group of experts has begun a broader effort to compile and describe implementation strategies (Powell et al., 2015; Proctor et al., 2013; Waltz et al., 2015) to inform implementation research and practice.
That group of experts identified “financial strategies” as one important type of implementation strategy, but more work is needed to understand this subset of strategies. Close examination reveals that the “financial strategies” were often described very generally (e.g., “Fund and contract for the clinical innovation,” “Access new funding”; Powell et al., 2015) and grouped together simply because they involved money (Waltz et al., 2015). To clarify thinking in this area, we define financing strategies as those implementation strategies that secure and direct financial resources to support essential activities for EBP implementation; that is, strategies that link funding and service delivery systems. There remains a need for a list of financing strategies that are specified according to published guidelines (Proctor et al., 2013).
The present study
The purpose of this scoping review was to assess the current state of scientific understanding for EBP financing strategies. Since neither behavioral health experts nor implementation experts have given much attention to this topic, a scoping review was the most appropriate literature review method to use. A scoping review assesses the current state of evidence for a topic area; such reviews are broad in nature and consider many sources of evidence (e.g., quantitative and/or qualitative research, policy documents), providing a general assessment as opposed to the more targeted questions posed in a systematic review (Tricco et al., 2018). Based on the results of our scoping review, we developed (1) a conceptual figure that describes our thinking about financing strategies and makes critical distinctions among them, other implementation strategies, and other financing activities; (2) a compilation of 23 financing strategies for implementation and associated evidence from available literature; and (3) a research agenda that calls on behavioral health and implementation experts to leverage and study these financing strategies with the goal of developing robust, sustainable financing for EBPs.
Conceptualization of financing strategies
Figure 1 depicts our conceptualization of financing strategies within the full range of EBP implementation strategies. We developed and refined this conceptual figure during our scoping review to capture our evolving conceptualization of financing strategies throughout the process. We present it here first to help orient readers to the concept of financing strategies.
We grounded our figure in three key outcomes that the implementation strategies influence: EBP acceptability, appropriateness, and feasibility (Proctor et al., 2011). Acceptability refers to perceptions of whether the EBP provides a reasonable option for delivering care—is it consistent with one’s personal and professional values? Appropriateness refers to perceptions of whether the EBP fits with the service delivery context and patient population—does it make sense to deliver it in our setting? Feasibility refers to perceptions of practical ability to adopt the EBP—can it be delivered in our setting, with current resources and constraints, to achieve desired clinical outcomes? These outcomes are perceptual (rather than behavioral) and thus, per expectancy theory (Georgopoulos et al., 1957), offer the most proximal indicators of whether a strategy can successfully promote EBP implementation by providers and decision-makers.
Figure 1 suggests that many implementation strategies can influence outcomes through non-financial mechanisms, such as influencing attitudes or decision-making (e.g., clinician education about the benefits of exposure therapy), helping to allocate responsibility (e.g., redefining roles in a clinic so that community health workers have the authority to deliver therapy), or obtaining and directing resources (e.g., hiring an EBP program coordinator or building additional office space). The area inside the dashed circle in Figure 1 represents the subset of strategies targeting each outcome that somehow involve monetary transactions (i.e., “financial strategies” in Waltz et al., 2015). We only define the subset of those strategies that involve obtaining and directing financial resources to pay for services—indicated by the gray shading—as financing strategies. Thus, we think of financing strategies as most closely aligned with increasing feasibility of implementation. Yet, the overlap among the three outcomes in the figure indicates our expectation that financing strategies could sometimes (but not always) influence appropriateness and acceptability as well.
An example that illustrates the multi-faceted nature of financing strategies is pay-for-performance (P4P)—a financing model that augments traditional fee-for-service systems by allowing for additional payments in response to achieving predetermined performance metrics (Garner et al., 2018). P4P can function as a financing strategy for implementation when the payments are structured to help cover the increased costs of implementing or continuing to provide the EBP. Examples include the payor, such as an insurance company, offering bonuses to clinics for each 6-month period in which they achieve a desired EBP implementation outcome—for example, a certain proportion of behavioral health providers meets fidelity requirements for cognitive-behavioral therapy for depression—or a clinical outcome—for example, a certain proportion of patients with major depressive disorder shows clinically significant improvement. Regardless of the targeted outcome, if the bonuses are paid to the clinics (rather than individual providers as in some P4P models), then the extra income could be used to cover the cost of implementing cognitive-behavioral therapy in that clinic. Covering costs in this manner certainly can increase feasibility. However, this P4P model might also impact acceptability if major funders start incorporating P4P incentives for cognitive-behavioral therapy into their reimbursement systems, which provides a social “legitimating” signal that adopting the EBP is desirable (Mendel & Scott, 2010). The requirements for P4P payments could also influence appropriateness, as a higher proportion shifts risk onto the clinics (i.e., greater likelihood of paying to implement the EBP but not receiving the bonuses) and off from the payor.
Under such conditions, P4P would fall into the very center of Figure 1 where acceptability, appropriateness, and feasibility converge within a single financing strategy. Of course, not every financing strategy is so comprehensive. Receiving a grant, contract, or philanthropic gift to implement an EBP would still qualify as a financing strategy but might not directly influence acceptability or appropriateness. Other financing strategies may only influence appropriateness or acceptability in addition to feasibility, but not both. Finally, it bears repeating that not all strategies that involve money are necessarily financing strategies. For example, financial incentives provided directly to the providers for EBP adoption and delivery can increase acceptability (Beidas et al., 2017), but we would only consider the incentives of a financing strategy if they helped to cover the organizational costs of the EBP. In fact, such a strategy has more in common with non-financial incentives (e.g., social praise) as both use contingencies to shape attitudes and decision-making regarding implementation.
Financing strategies compilation
Our scoping review of EBP financing strategies covered two major sources of information. First, we reviewed existing compilations of implementation strategies or financing mechanisms to identify financing strategies and generated detailed descriptions of each financing strategy. Second, we conducted a literature search to identify implementation studies and related resources (e.g., reports and policy briefs) that involved financing strategies. The purpose of this step was to characterize the evidence available about each strategy’s use in behavioral health; we initially hoped to identify research evaluating the impact of financing strategies, but as described subsequently, we were only able to characterize reported levels of use. We documented our approach with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses—scoping review checklist (Tricco et al., 2018; see Additional File 1).
Review of existing compilations
Many of the details required to identify and characterize financing strategies are not typically reported in behavioral health implementation research (see Hooley et al., 2019, for a general discussion of implementation strategy reporting). Thus, we used our team’s collective knowledge of implementation science, behavioral health services, public administration/financing, health economics, and health policy to select compilations from which to identify financing strategies. Table 1 summarizes the nine compilations (three of implementation strategies and six of health care financing mechanisms) that we reviewed and the number of potential financing strategies identified in each compilation. When a given compilation was divided into sub-categories, we focused on the sub-categories most relevant to financing strategies; these are noted in the table. Overall, we considered 205 potential strategies, of which 118 (58%) were selected as candidates for inclusion in the financing strategies compilation. Strategies were selected if they met our aforementioned definition of a financing strategy: methods or techniques that support implementation of EBPs by securing and directing financial resources. For this stage of review, we considered all possible strategies without regard to their use in behavioral health. Strategies were excluded if they only involved payment for existing or routine care (without connection to EBP implementation); involved non-financial incentives or activities; or regulated purchasing (e.g., price setting).
Table 1.
Compilation | Type | Reference(s) | Sub-categories reviewed | Number of strategies | ||
---|---|---|---|---|---|---|
Financing | Non-financing | Total | ||||
1. Cochrane EPOC: Effective Practice and Organization of Care | I | Cochrane EPOC (2002, 2015) |
Financial interventions/ arrangements |
19 | 18 | 37 |
2. ERIC: Expert Recommendations for Implementing Change | I | Powell et al. (2012, 2015); Waltz et al. (2015) | Financial strategies | 23 | 0 | 23 |
3. HCP-LAN: Health Care Payment Learning and Action List | F | HCP-LAN (2017) | n/a | 10 | 1 | 11 |
4. Mixed provider payment systems | F | Feldhaus and Mathauer (2018) | n/a | 10 | 1 | 11 |
5. NASMHPD: National Association of State Mental Health Program Directors | F | NASMHPD (2010, 2012); Steverman & Shern (2013) | Financing mechanisms; changes in financing and payment policies | 15 | 22 | 37 |
6. Policy Ecology Framework | I | Raghavan et al. (2008) | n/a | 5 | 8 | 13 |
7. RAND Corporation health care financing resources | F | Friedberg et al. (2015); RAND Corporation (2015) | n/a | 13 | 4 | 17 |
8. SAMHSA (Substance Abuse and Mental Health Services Administration) Medicaid handbook | F | SAMHSA (2013) | Reimbursement methodologies | 7 | 19 | 26 |
9. Strategies to increase access to child health services | F | Bright et al. (2017) | n/a | 16 | 14 | 30 |
All compilations | 118 | 87 | 205 |
Type of compilation: F = health care financing, I = implementation strategies.
Literature search techniques
The first author used three search procedures to identify potential articles for inclusion in our review. Articles were included if they described one or more financing strategies that were (1) used to pay for implementation of one or more behavioral health EBPs and (2) identified in our review of existing compilations. We did not require the articles had been published with peer review given that much information about policy-related interventions, such as financing strategies, is published outside of the peer-reviewed journal articles. As needed, inclusion decisions were discussed with the team of authors until consensus was reached.
First, we conducted keyword searches within various databases using a combination of keywords and search limits designed to capture the following concepts:
Financing strategies (Financ*, Fund*, Reimburse*, Pay*, Repay*, Renumerate*, Medicaid, Medicare);
Implementation (Implement*, Scale*, Spread, Deliver*, Uptake, Adopt*, Sustain*, Maintain*, Operat*);
Behavioral health (“Mental disorder”; “Mental health”; “Mental illness”; “Behavioral disorder”; “Behavioral health”; “Behavior problem*”; Psych*; “Disruptive behavior”; Trauma*).
The databases searched were PsycINFO, MEDLINE (via PubMed), and EconLit. It should be noted that our team initially focused our search strategies on youth behavioral health services, which is an area of interest for many of us, but we found that most search results focused on adult services. Therefore, we expanded our search strategies to include all age groups and eliminated search terms (e.g., “Family First” for the Family First Prevention and Services Act) and databases (e.g., National Children’s Alliance online library) that were not yielding unique results. We restricted all searches to the date range January 1, 2010 through March 31, 2019 (the date we completed the review) because research prior to the passage of the U.S. Patient Protection and Affordable Care Act in 2010 was likely to be incomplete or outdated.
Second, the first author identified promising articles by hand-searching tables of contents from 17 peer-reviewed journals, selected by the research team, that regularly publish studies about implementation and/or health care financing (e.g., Administration and Policy in Mental Health and Mental Health Services Research, American Journal of Public Health, BMC Health Services Research, Health Affairs, Implementation Science, Journal of Behavioral Health Services Research). For the sake of feasibility, this review was limited to the past 5 years. A list of health care financing articles from the RAND Corporation (www.rand.org/topics/health-care-financing.html) was also reviewed from 2010 to March 2019. Finally, the first author examined the reference lists from both potential articles and the previously reviewed compilations to identify additional articles.
A flowchart for our literature search is included in Figure 2. Our search yielded 12,126 articles (12,043 from the database searches and 83 from the table of contents searches) to be reviewed for inclusion/exclusion. Most articles were screened out by a review of the title and abstract, with 129 receiving full-text review to evaluate eligibility criteria. Of those articles, 27 were selected for inclusion and review of their reference lists generated an additional nine articles that were also included. The final list of 36 articles (indicated in the reference list) served as the evidence base for financing strategies used in behavioral health.
Creating the financing strategies compilation
Once the literature search was complete, we reviewed all materials (i.e., strategy definitions from the compilations; articles identified in the literature search) to create a comprehensive compilation of financing strategies used in behavioral health, including detailed descriptions and the level of use for each strategy. The first author created the original compilation, after which the co-authors reviewed and provided formative feedback. The study team iteratively revised the compilation until consensus was reached.
Descriptions of financing strategies
To create the compilation, we selected a final list of financing strategies and generated detailed descriptions of each strategy along key dimensions. The 118 strategies identified from our nine source compilations each had their own definitions, and there was often considerable overlap—but also key distinctions—among the strategies and definitions identified, so we combined overlapping strategies. We then identified the characteristics of each financing strategy using seven key dimensions for implementation strategies (i.e., actors, actions, action targets, temporality, dose, outcomes addressed, and justification) as outlined by Proctor et al. (2013) and then synthesized those characteristics into an overall definition. We reviewed the 36 articles identified in our literature review as part of our process for creating the compilation of financing strategies; it was useful to consider how articles had applied and described different strategies to assist in identifying their key dimensions.
Ultimately, we identified 23 financing strategies. Table 2 lists the strategies, their definitions, and the references from which they were identified. We aimed to create definitions that clearly distinguished among strategies (e.g., highlighting key differences between blended [combined] and braided [coordinated] funding streams) but were also general enough that they could be applied across a variety of contexts and situations (e.g., the definitions for both blended and braided funding streams could describe organization of funds from a variety of government agencies). As a complement to that table, Table 3 presents a detailed specification of the seven key dimensions (Proctor et al., 2013) that we identified for each financing strategy.
Table 2.
Financing strategy | Definitiona | Primary source(s)b | Reported level of usec |
---|---|---|---|
Fee-for-service reimbursement | Include the EBP in an insurance fee-for-service list/formulary so that providers can receive reimbursement for providing that practice | 1, 2, 3, 4, 5, 6, 7, 8 | Current use |
Increased fee-for-service reimbursement rate | Increase insurance reimbursement rates to providers for the EBP, relative to other services, to offset increased costs to providers for delivering that practice | 2, 3, 6 | Current use |
Removed/altered billing limits | Allow insurance payments to providers for services that are disallowed under typical billing limits (additional sessions, services for patients with designated diagnoses, etc.) when delivering the EBP | 2, 5, 7, 8 | Current use |
Technical support for billing | Provide assistance (from insurance or a third party) to providers for preparing and successfully submitting claims for the delivery of the EBP | 2 | Current use |
Pay-for-success (PFS) financing | Establish agreements in which private or non-profit investors prospectively provide funding for providers to deliver the EBP, and a government entity provides a payout to the investors if pre-established outcomes or quality metrics are achieved in a designated time period | 5 | Current use |
Global budgets for general funds | When allocating government general funds, include funding in the overall annual budget of a state, county, or municipal agency to cover the costs of the agency’s providers to deliver the EBP | 1, 5 | Current use |
Line-item budgets for general funds | When allocating government general funds, include designated (protected) funding in the annual budget of a state, county, or municipal agency to cover the costs of the agency’s providers to deliver an EBP | 1, 5 | Current use |
Braided funding streams | Coordinate multiple funding sources across two or more government agencies to cover the costs of the agencies’ providers to deliver the EBP, such that each individual funding source remains accounted for separately; generally established through annual budgets | 5 | Current use |
Contracts for EBPs | Award funding contracts from state, county, or municipal agencies to provider organizations that agree to deliver the EBP | 1, 2, 5, 6, 9 | Current use |
Inclusion in block grants | Allow payment to providers for delivering the EBP using block grants, which provide a fixed amount of money to state, county, or municipal agencies to pay for a designated set of health services | 2, 5 | Current use |
Shifting funds between programs | Reallocate funds from other programs and practices, within or across state, county, or municipal agencies, to cover the costs of delivering the EBP; often funds currently dedicated to services whose use is expected to decline due to the EBP | 2 | Current use |
Grant funding | Award funding from government or private grant-making agencies to provider organizations that propose to deliver the EBP | 1, 2 | Current use |
Charitable/philanthropic donations | Collect donations from private or non-profit investors that will be used by provider organizations to cover the costs of delivering the EBP | 1, 2, 5 | Current use |
Cost sharing | Use state, county, or municipal funds to pay for infrastructure (such as a dedicated intermediary organization) that supports the delivery of EBPs by providing training, technical assistance, and other non-monetary resources to providers within a given jurisdiction | 2 | Current use |
Credentialing/rostering providers | Establish agreements between insurance companies and training organizations for EBPs, in which designated providers are allowed to receive payment for the EBP (often at an increased rate) | 6 | Potential use |
Blended funding streams | Combine multiple funding sources across two or more government agencies to cover the costs of the agencies’ providers to deliver the EBP, such that all funding is accounted for together and no longer separable by source; generally established through legislative action | 5 | Potential use |
Dedicated taxes | Collect a state, county, or municipal tax, then allocate the revenue from that tax to provider organizations that deliver the EBP | 1, 2, 5 | Potential use |
Capitated or patient-based payments | Provide a set, prospective insurance payment to providers that is expected to cover all expenses for a given patient’s care (including increased costs of delivering the EBP) in a designated time period | 1, 2, 3, 4, 7, 8 | Conceptual only |
Pay-for-performance (P4P) | Provide a financial bonus (on top of other insurance payments) to provider organizations for achieving pre-established outcomes or quality metrics in a designated time period, with bonuses sufficient to cover increased costs to providers for delivering the EBP | 1, 2, 3, 4, 7, 9 | Conceptual only |
Value-based purchasing | Provide insurance reimbursement to providers only when they achieve pre-established outcomes or quality metrics for a designated time period, with reimbursement sufficient to cover increased costs to providers for delivering the EBP | 3, 7 | Conceptual only |
Government bonds | Issue state, county, or municipal bonds (securities) for purchase by private or non-profit investors, then allocate the revenue from those bonds to provider organizations that deliver the EBP | 5 | Conceptual only |
Vouchers | Provide vouchers of a predetermined value that patients can redeem to receive the EBP from providers, who are then repaid by the insurance or government payor that issued the voucher | 1 | Conceptual only |
Bundled or episode-based payments | Provide a set insurance payment to a group of providers that is expected to cover all expenses for a given diagnosis or episode of care (including increased costs of delivering and coordinating the EBPs across providers); can be prospective or retrospective payments | 1, 3, 4, 5, 7, 8 | Potentially contraindicated use |
Note. EBP = evidence-based practice.
Definitions were derived from seven key dimensions of implementation strategies, which are presented for each financing strategy in Table 3.
The numbers for primary sources refer to the list of existing compilations from which we identified financing strategies (see Table 1 for more details).
Refers to the reported level of use for each financing strategy in behavioral health services, within the research literature identified in our scoping review (see Table 4 for more details).
Table 3.
Financing strategy | Key characteristicsa | ||||||
---|---|---|---|---|---|---|---|
Actors | Actions | Action targets | Temporality | Dose | Outcomes | Justification | |
Fee-for-service reimbursement | Insurance or managed care companies | Provide reimbursement for a specified EBP (i.e., include on list/formulary) | Provider organizations | Retrospective (reimbursement) | Per billable unit of the EBP | Decrease costs for service providers; increase acceptability of EBP | Reimbursement is necessary to cover the costs of care; excluding EBPs from fee-for-service lists/formularies disincentivizes their use |
Increased fee-for-service reimbursement rate | Insurance or managed care companies | Provide increased reimbursement for a specified EBP, relative to other services | Provider organizations | Retrospective (reimbursement) | Per billable unit of the EBP | Increase feasibility and decrease cost for service providers | EBPs have considerable out-of-session costs—such as for training, consultation, case management, and so on—for which traditional fee-for-service reimbursement is insufficient, so increased reimbursement rates are needed to make EBPs viable in a fee-for-service model |
Removed/altered billing limits | Insurance or managed care companies | Provide payment for a specified EBP in cases where payment would not otherwise be provided (e.g., agree to a waiver) | Provider organizations | Variable | Variable | Increase feasibility and decrease cost for service providers | In some cases, the value of an EBP can only be achieved by allowing for payment in greater frequency or with different patients than is typically allowed by the funding agreement, so altering the billing limits is necessary to make the EBP feasible |
Technical support for billing | Insurance or managed care companies, or a third party | Provide assistance that increases the likelihood of successful billing for an EBP | Providers, provider organizations | Variable | Variable | Increase feasibility and decrease cost for service providers | Providers may not be able to successfully submit claims for an EBP without technical assistance, and they cannot obtain the benefits of funding agreements without successful billing |
Pay-for-success (PFS) financing | Private or non-profit investors, government payor, independent evaluation team, third-party intermediary (optional) | Private investors fund implementation of an EBP; government payor provides payout to investors if pre-established outcomes/quality metrics achieved (per independent evaluation) in a designated time period; may be managed by an intermediary | Provider organizations (receive funding), investors (receive payout) | Prospective (funding), retrospective (payout) | Funding 1×, but payout structure is variable | Increase adoption and penetration of EBP; increase feasibility and decrease cost for service providers and government payor | Provides the initial investment for implementation of an EBP (e.g., covering costs of training, consultation, materials, space, system reorganization), which is often beyond the resources available to many government agencies, and ensures that the government pays for interventions that produce measurable value to the public (shifts financial risk to investors) |
Global budgets for general funds | State, county, or municipal agencies | Include funding to cover the costs of EBP as part of responsible agency’s overall budget when allocating general funds | Provider organizations | Prospective | Per year | Decrease costs for service providers; increase acceptability of EBP | Budget allocations are necessary to cover the costs of care, including service provision and out-of-session costs (e.g., training, consultation, case management); failure to budget for EBPs disincentivizes their use |
Line-item budgets for general funds | State, county, or municipal agencies | Include designated (protected) funding for EBP in responsible agency’s budget when allocating general funds | Provider organizations | Prospective | Per year | Decrease costs for service providers; increase acceptability of EBP | Budget allocations are necessary to cover the costs of care, including service provision and out-of-session costs (e.g., training, consultation, case management); failure to budget for EBPs disincentivizes their use and line-item budgets protect the funds for use with a designated EBP |
Braided funding streams | (At least two) state, county, or municipal agencies | Coordinate multiple funding sources to pay for an EBP, such that each individual funding source remains accounted for separately; generally established through annual budgets | Provider organizations | Prospective | Per year | Increase feasibility and decrease cost for service providers and participating agencies | EBPs accrue costs and benefits across multiple government entities; braided funding streams allow for the distribution of costs across entities to align with the distribution of benefits, with higher up-front feasibility and lower long-term feasibility |
Contracts for EBPs | State, county, or municipal agencies | Award contracts to organizations that agree to provide an EBP | Provider organizations | Variable | Variable number of years; payment may be fee-for-service | Increase feasibility and decrease costs for service providers; increase acceptability of EBP | Allocates funds to cover the costs of EBPs, including service provision and out-of-session costs (e.g., training, consultation, case management); making EBP a requirement for contract funding incentivizes their use |
Inclusion in block grants | State, county, or municipal agencies | Provide payment for an EBP using grants that provide a fixed amount of money to pay for a designated set of health services | Provider organizations | Variable | Variable; payment may be fee-for-service | Decrease costs for service providers; increase acceptability of EBP | Funding is necessary to cover the costs of care; allowing payment for EBP from block grants incentivizes their use |
Shifting funds between programs | State, county, or municipal agencies | Pay for an EBP using funds that were previously allocated to a different program or practice | Provider organizations | Prospective | Variable | Decrease costs for service providers; increase acceptability of EBP | Reallocation of funds can cover the costs of care, including service provision and out-of-session costs (e.g., training, consultation, case management); funds are often reallocated from programs and practices whose use is expected to decline due to the EBP |
Grant funding | Government or private grant-making agencies | Award grant funds to organizations that propose to provide an EBP | Provider organizations | Variable | Variable number of years | Increase feasibility and decrease costs for service providers; increase acceptability of EBP | Provides funds to cover the costs of EBPs, including service provision and out-of-session costs (e.g., training, consultation, case management); making an EBP a requirement for grant funding incentivizes its use |
Charitable/ philanthropic donations | Private or non-profit investors | Donate funds to organizations that will provide an EBP | Provider organization | Variable | Variable | Increase feasibility and decrease costs for service providers; increase acceptability of EBP | Provides funds to cover the costs of EBPs, including service provision and out-of-session costs (e.g., training, consultation, case management); when donors make EBP a condition of the gift, that incentivizes the use of those practices |
Cost sharing | State, county, or municipal agencies | Pay for infrastructure to support the delivery of EBPs through training, technical assistance, and other non-monetary resources | Provider organization; intermediary organizations and resources | Prospective | Variable | Increase feasibility and decrease costs for service providers | Provides resources necessary to support the provision of EBP (e.g., training, consultation) that may be difficult for provider agencies to purchase or may be purchased at a better economy of scale by the government |
Credentialing/ rostering providers | Purveyor or intermediary organizations, insurance, or managed care companies | Designate providers as eligible to receive increased reimbursement for an EBP | Providers, provider organizations | Retrospective (reimbursement) | 1× or more frequently (e.g., annually) if recertification required | Increase fidelity to EBP; increase feasibility and decrease cost for service providers | Payors only provide reimbursement for the EBP to approved providers, who are expected to provide the practice with greater fidelity and thus are worth the increased cost of services |
Blended funding streams | (At least two) state, county, or municipal agencies | Combine multiple funding sources to pay for an EBP, such that all funding is consolidated and no longer separable by source; generally established with legislative action | Provider organizations | Prospective | Variable, depends on enacting legislation | Increase feasibility and decrease cost for service providers and participating agencies | EBP accrue costs and benefits across multiple government entities; braided funding streams allow for the distribution of costs across entities to align with the distribution of benefits, with lower up-front feasibility and higher long-term feasibility |
Dedicated taxes | State, county, or municipal government | Collect taxes that are allocated to agencies and providers to deliver the EBP | Provider organization | Prospective | Per year | Increase feasibility and decrease costs for service providers | Taxes provide additional revenue that can be used to cover the costs of EBPs (e.g., training, consultation, case management), thus returning value to taxpayers |
Capitated or patient-based payments | Insurance or managed care companies | Provide a set payment that is expected to cover all expenses for a given patient’s care in a designated time period | Provider organizations | Prospective (pre-payment) | Per month or per year | Increase appropriateness of care; can increase feasibility and decrease cost for service providers, depending on structure | Provides funds necessary to ensure high-value care for a given patient, while shifting financial risk management to providers; if the capitated rate is sufficiently high, it could be used to cover considerable out-of-session costs of EBPs—such as for training, consultation, case management, and so on—especially because it is provided prospectively |
Pay-for-performance (P4P) | Insurance or managed care companies | Provide a financial bonus (on top of other payments) for achieving pre-established outcomes or quality metrics in a designated time period | Providers, provider organizations | Retrospective | Per month or per year | Increase acceptability of the EBP; can increase feasibility and decrease cost for service providers, depending on the structure | Provides incentives for providing high-quality care, which can be tied directly or indirectly to an EBP; incentives to the provider organization could be used to cover considerable out-of-session costs of EBPs—such as for training, consultation, case management, and so on |
Value-based purchasing | Insurance or managed care companies | Provide reimbursement only when pre-established outcomes or quality metrics are achieved | Providers, provider organizations | Retrospective | Per month or per year | Increase appropriateness of care; can increase feasibility and decrease cost for service providers, depending on the structure | Requires evidence of high-value care prior to reimbursement, shifting financial risk management to providers; if the reimbursement rate is sufficiently high, it could be used to cover considerable out-of-session costs of EBPs—such as for training, consultation, case management, and so on |
Government bonds | State, county, or municipal agencies; private or non-profit investors | Government entity sells bonds (securities) to investors, and the income is allocated to provide an EBP | Provider organization | Prospective | Per year | Increase feasibility and decrease costs for service providers | Bonds provide additional revenue that can be used to cover the costs of EBPs (e.g., training, consultation, case management), thus returning value to taxpayers |
Vouchers | Insurance or managed care companies; state, county, or municipal agencies | Provide vouchers of a predetermined value that patients can redeem for EBP from providers | Patients, provider organizations | Retrospective | Per billable unit of the EBP | Decrease costs for service providers; increase acceptability of EBP | Vouchers can cover the costs of care, including service provision and out-of-session costs (e.g., training, consultation, case management); restriction of voucher use to EBPs can incentivize the use of such practices |
Bundled or episode-based payments | Insurance or managed care companies | Provide a set payment that is expected to cover all expenses associated with a given diagnosis or episode of care (across providers and provider organizations) | Provider organizations | Prospective or retrospective | Per care episode | Increase appropriateness of care; can increase feasibility and decrease cost for service providers, depending on the structure | Provides funds necessary to ensure high-value care for a given clinical problem, while shifting financial risk management to providers; if the bundled rate is sufficiently high, it could be used to cover considerable out-of-session costs of EBPs—such as for training, consultation, case management, and so on—especially when it is provided prospectively |
Note. EBP = evidence-based practice. aAs defined by Proctor et al. (2013).
Reported levels of use for financing strategies in the research literature
Through our review of the 36 articles identified in the literature search, we characterized the use of each financing strategy—as documented in existing research—to fund implementation of evidence-based behavioral health services. Given the state of the literature, it was not possible to provide a detailed assessment of the impact of financing strategies, as might be done in a systematic review. All the identified studies used observational methods that could not evaluate the impact of discrete financing strategies. Instead, for each article, we recorded the (1) financing strategy(ies) described and (2) service system(s) involved, both behavioral health (mental health, substance use, intellectual/developmental disability) and others (criminal/juvenile justice, child welfare, health care/medical, dental, public health education, social services [e.g., employment, housing]). We used that information to categorize each strategy into one of the four general levels:
Current use: Evidence from three or more articles that the strategy has been used to fund the implementation of evidence-based behavioral health services.
Potential use: Evidence that the strategy has been used to fund the implementation of evidence-based health services in general, but limited or absent evidence (two or fewer articles) for its use in behavioral health services.
Conceptual only: Strategy was identified in our review of existing compilations and thus could be promising to explore in future research, but we found no articles describing its use to fund the implementation of any evidence-based health services.
Potentially contraindicated use: Some research indicates the strategy may not be feasible or effective for funding the implementation of evidence-based behavioral health services, at least under certain conditions (no strategies were clearly contraindicated).
Of the 36 articles, 14 (38%) mentioned multiple financing strategies for a mean of 2.4 financing strategies per article (range = 1–8; SD = 2.2). Furthermore, 28 articles (78%) discussed the use of financing strategies in behavioral health systems. Each article examined between one and six service systems, with 15 (42%) considering multiple systems and an average of 1.8 systems per article (SD = 1.4).
Table 4 summarizes the level of use for each financing strategy as reported in the research literature. The table presents all information from our review and specifically highlights the evidence of use within behavioral health systems. Overall, 13 financing strategies (56%) had evidence of use within behavioral health services, 4 (17%) had potential for use, 5 (23%) were only conceptual, and 1 (4%) was potentially contraindicated. Among strategies in the two highest levels of use, all 17 had evidence of use in mental health services, 9 (53%) in substance use services, and 1 (6%) in intellectual/developmental disability services. Criminal/juvenile justice (n = 9; 53%) and child welfare (n = 13; 76%) were the most common non-behavioral-health service systems in which financing strategies were used.
Table 4.
Refers to the reported level of use of the financing strategy in behavioral health services, within the research literature identified in our scoping review. Current use: Evidence from three or more articles that the strategy has been used to fund the implementation of evidence-based behavioral health services. Potential use: Evidence that the strategy has been used to fund the implementation of evidence-based health services in general, but limited or absent evidence (two or fewer articles) for its use in behavioral health services. Conceptual only: Strategy was identified in our review of existing compilations, but we found no research articles describing its use to fund implementation of any evidence-based health services. Potentially contraindicated use: Some research indicates the strategy may not be feasible or effective for funding implementation of evidence-based behavioral health services, at least under certain conditions (no strategies were clearly contraindicated).
Definitions for each financing strategy are presented in Table 2.
Refers to the service system(s) documented in empirical literature—listed in the References column—as using the financing strategy. For behavioral health systems, ID = intellectual/developmental disability; MH = mental health; SU = substance use. For other systems, CJ = criminal/juvenile justice; CW = child welfare; DE = dental; ED = education; HC = health care/medicine; PH = public health; SS = social services (e.g., housing, employment).
References marked with an asterisk (*) reported the use of the financing strategy in one or more behavioral health systems. AGA = Association of Government Accountants; NCTSN = National Child Traumatic Stress Network.
Discussion
A major challenge to widespread, sustainable implementation of EBPs concerns how to cover the costs of implementation with the limited and fragmented funding available (Beidas et al., 2016; Lang & Connell, 2017; Raghavan et al., 2008). In this scoping review, we considered how financing strategies might help overcome the cost-related barriers to the implementation of EBPs that can, in turn, alleviate the public health and societal impacts of behavioral health problems. We identified a critical gap in the literature: researchers need to conduct more studies that advance the understanding of EBP financing strategies. This result was not our hope at the outset of the review, as we wished to identify more definitive evidence-based recommendations for financing implementation. Nevertheless, our conceptual figure and compilation of financing strategies represent important advances for implementation research in behavioral health that can directly inform future research, in ways described later in our proposed research agenda.
Implications of the scoping review findings
We developed a conceptual figure (see Figure 1) that defines financing strategies as techniques that secure and direct financial resources to support EBP implementation. Previous work did not clearly distinguish financing strategies from related approaches to implementation or health care financing (see Table 1), resulting in a lack of clarity about approaches to financing EBPs. We encourage experts in implementation, behavioral health, and health care finance to use our conceptual figure to ensure adequate consideration of financing for implementation-related activities, such as covering EBP costs that are not included in traditional reimbursement or paying for implementation strategies. Given the highly fragmented nature of the current U.S. health care funding system (Cleverley & Cleverley, 2018; Folland et al., 2017; Garfield, 2011) and ongoing reliance on fee-for-service reimbursement models in behavioral health systems, implementation-related costs are rarely considered explicitly and are often treated as “someone else’s problem.” More explicit attention to financing strategies—which includes understanding their role within health care finance—could help service delivery and funding systems achieve greater alignment around funding for implementation activities (Knapp et al., 2006).
We identified 23 financing strategies for implementing EBPs in our review, of which 17 were reported having been used to at least some degree in behavioral health systems. No previous compilations included all 23 of these strategies; Powell et al. (2012, 2015) included the most, 13 strategies or 56.5% (see Table 2). Thus, this compilation appears to be the most comprehensive list of financing strategies for behavioral health care to date. We also used reporting guidelines for implementation strategies (Proctor et al., 2013) to provide comprehensive, standardized definitions of every financing strategy—a practice that remains rare in behavioral health research (Hooley et al., 2019)—and we identified the types of behavioral health services in which each strategy has been studied (see Tables 2 to 4). We encourage implementation researchers to use our compilation to define, measure, and report on the financing strategies used in their studies whenever feasible.
Our compilation may also serve as a useful resource for behavioral health professionals, system leaders, and policymakers who are interested in supporting the implementation of EBPs. The compilation offers a menu of options that these decision-makers might consider as part of strategic planning processes (Schell et al., 2013) that determine when and how to allocate resources toward implementation. For example, the compilation can be used by (1) the director of a behavioral health agency to identify alternative sources of financing to cover non-reimbursable EBP costs; (2) an intermediary agency to advise organizations whom they are supporting in the implementation process; (3) a state behavioral health director when deciding how to distribute resources to agencies within the state to encourage EBP adoption; or (4) an insurance company seeking to make changes in their reimbursement model to reward the quality and effectiveness of services provided. Of course, we recognize the need to further develop our compilation so that it offers more user-friendly information to decision-makers, such as guidance on the pros and cons of these strategies (e.g., importance vs. feasibility) and on how to execute them within their service systems.
Proposed agenda for future research on financing strategies
Our financing strategy compilation and accompanying conceptual figure may prove necessary and useful, but we are certain that they are not sufficient. Our review provides numerous examples of how, in the present environment, EBP implementation costs remain daunting for even the most forward-thinking behavioral health systems to finance (see e.g., the case studies presented by Stroul, 2007, 2009). Additional efforts will be needed to fully align funding in ways that support EBP implementation. Therefore, we suggest a research agenda that will help to better understand financing strategies in terms of five key questions raised by the findings of our review: (1) How can we evaluate the effectiveness of financing strategies?; (2) Besides research literature, what are the other critical sources of evidence about financing strategies?; (3) Which strategies and systems have the greatest needs for future research in this area?; (4) Can financing strategies be combined and coordinated to increase their impact?; and (5) How can financing strategies support the long-term sustainment of EBPs?
First, we need to advance the methods used to evaluate financing strategies, as the research literature we reviewed was silent on this topic. We were able to describe whether the strategies had been used in behavioral health research studies, but found no studies that evaluated their effects on key implementation outcomes, such as adoption, feasibility, penetration, or sustainment (Proctor et al., 2011)—let alone health outcomes. Given that financing strategies are generally system-level interventions that involve changes in local, state, or even federal policy, it will be important for researchers to use policy research methods that can evaluate causality in quasi-experimental designs (e.g., non-equivalent dependent variables, which capture the effects of confounders; Coryn & Hobson, 2011) and represent complex relations within systems (e.g., qualitative and mixed methods [Eisman et al., 2020]; systems science methods, such as system dynamics or agent-based modeling [Luke et al., 2018]). Traditional research methods for evaluating the impact of individually focused interventions and implementation strategies (e.g., training) will rarely be sufficient for understanding the effects of financing strategies. However, it will still be important to ground models and hypotheses for evaluating financing strategies within the theories and frameworks from relevant disciplines (e.g., public finance, health economics, and implementation science).
Second, because financing strategies were not well-represented in the research literature we reviewed, we recommend considering alternative sources of evidence used by decision-makers to determine which financing strategies to offer and pursue under various circumstances. Such decision-makers could include behavioral health professionals, system leaders, and policymakers. Innovative new strategies may emerge in response to rapidly changing financial and regulatory environments, and decision-makers may be more influenced by pragmatic local evidence than they are by the results of published research studies. In future work, we plan to have representatives from behavioral health provider agencies, EBP intermediary agencies, and funding agencies to review our financing strategy compilation and, using the modified Delphi method developed for the Expert Recommendations for Implementing Change project (Powell et al., 2015; Waltz et al., 2014), provide feedback on (1) the current strategies and definitions and (2) additional strategies or sources of evidence to consider. It could also be worthwhile to conduct scoping reviews of financing strategy literature from other evidence sources that are more difficult to systematically search, such as health care trade publications or behavioral health system evaluation reports.
Third, although there is great need for more research on financing strategies in all behavioral health care, our review showed that the need is especially pronounced for certain strategies and service systems. Both substance use and intellectual/developmental disability services had less evidence of financing strategy use than did child welfare (i.e., a non-behavioral-health service system). It will be important to determine whether alternative search strategies (e.g., different search terms or databases) could produce more evidence of financing strategies for these systems. Also, because all the research we reviewed came from the United States, studies are needed to examine the use and impact of various financing strategies in other countries with different funding systems for health care. Moreover, the financing strategies classified as “conceptual only” and “potentially contraindicated” merit additional investigation. For example, we noted in the introduction that P4P holds promise as an EBP financing strategy—yet we found no evidence that such a P4P contract has been executed, let alone rigorously evaluated (Damberg et al., 2014; Garner et al., 2012, 2018; Nagle & Usry, 2016). Bundled payments also deserve more attention; we classified that strategy as “potentially contraindicated” because it has proven difficult to execute (Hussey et al., 2011), but ongoing advances could make bundled payments more feasible (Damberg et al., 2014; Niederman et al., 2017) and they are desired by behavioral health systems (Stroul, 2007; Stroul et al., 2009).
Fourth, we foresee an increasing demand for guidance on the tailored selection of financing strategies, which involves matching strategies to the goals, strengths, and needs of a given EBP implementation effort. The articles from our literature review described using as many as eight financing strategies (M > 2) in a given implementation effort (see e.g., Armstrong et al., 2012; Jaramillo et al., 2018; Powell et al., 2016; Rieckmann et al., 2015; Scudder et al., 2017) and indicated that stakeholders found coordination among various funding sources to be a major barrier to using EBPs in their systems (e.g., Jaramillo et al., 2018; Stroul, 2007; Stroul et al., 2009). Barring major reform of financing practices, behavioral health systems will require support to successfully incorporate the optimal combination of financing strategies for the EBPs they implement. Methods of tailoring implementation strategies are in their infancy, but a recent paper (Powell et al., 2017) identified several promising approaches for consideration. For example, we have started to explore how intervention mapping (Bartholomew et al., 1998)—a multi-step method for developing interventions or implementation strategies based on theory, research evidence, and stakeholder perspectives—can be used to guide stakeholders in their strategic selection of financing strategies for EBP implementation.
Finally, nearly all the research we reviewed on financing strategies has focused on funding for active EBP implementation. Such funding, although limited and potentially declining (Bruns et al., 2016), is regularly available at present through short-term government or foundation awards aimed at service “transformation” (Garfield, 2011; Scudder et al., 2017; Sigel et al., 2013). Yet recent research has revealed a need for much greater emphasis on the sustainment of EBPs (Scheirer & Dearing, 2011; Schell et al., 2013; Shelton et al., 2018), where sustainment is defined as continued use of an EBP over a specified period for the continued achievement of program and population outcomes (Scheirer & Dearing, 2011). Without sustained use after implementation, the public health impact of EBPs will remain limited. At present, financial barriers have led to unsuccessful sustainment in many EBP initiatives (Massatti et al., 2008; Rodriguez et al., 2018; Stewart et al., 2016) as the need for continued funding of implementation-related activities is substantial and difficult to satisfy (Bond et al., 2014; Roundfield & Lang, 2017). A few initial studies have laid the groundwork for understanding how financing strategies might influence sustainment (Apsler et al., 2017; Edwards et al., 2015; Scudder et al., 2017) but have also made it clear that more research—and different strategies—are needed to navigate the complex, multi-level, and ever-shifting funding environment as part of EBP sustainment efforts (Chambers et al., 2013; Shelton et al., 2018; Willging et al., 2015). We encourage greater attention in ongoing efforts around the goal of supporting sustainability planning for EBPs.
Conclusion
In sum, the existing literature on EBP financing strategies in behavioral health offers promising solutions but raises far more questions. Strong partnerships among implementation researchers, practitioners, funding agencies, and behavioral health systems and providers will be essential to fully understand and address these complex problems. By collaborating and learning together, we can hope to realize widespread, sustainable EBP implementation at a level that can produce population-level benefits in behavioral health.
Footnotes
Author contributions: A.R.D. designed and oversaw all aspects of the study, conducted data collection and analysis, and wrote the first draft of this manuscript. All other authors contributed to the development of the data collection plan and/or interpretation of findings, with order of authorship determined by the extent of their contributions. All authors reviewed and provided feedback on this manuscript.
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: A.R.D. is an investigator with the Implementation Research Institute (IRI), at the George Warren Brown School of Social Work, Washington University in St. Louis; through an award from the National Institutes of Mental Health (5R25MH08091607) and the Department of Veterans Affairs, Health Services Research & Development Service, Quality Enhancement Research Initiative (QUERI).
Ethical approval: As a scoping review, this study did not involve human subject research and was exempt from Institutional Review Board oversight.
ORCID iDs: Alex R Dopp https://orcid.org/0000-0002-2522-6546
Peter Mundey https://orcid.org/0000-0002-7711-0641
Beverly W Funderburk https://orcid.org/0000-0001-6524-2383
Availability of data and materials: The datasets generated and analyzed during this study are reported within this article.
References
†Existing compilations used to generate the compilation of financing strategies
*Studies identified in literature searches for inclusion in the compilation
- Agency for Healthcare Research and Quality. (2017). 2016 national healthcare quality and disparities report. [Google Scholar]
- *Apsler R., Formica S. W., Stout E., Carr C. (2017). Can an infusion of federal funds result in sustainable projects? An evaluation of suicide prevention programs. Journal of Primary Prevention, 38, 551–565. 10.1007/s10935-017-0489-0 [DOI] [PubMed] [Google Scholar]
- *Armstrong M. I., Milch H., Curtis P., Endress P. (2012). A business model for managing system change through strategic financing and performance indicators: A case study. American Journal of Community Psychology, 49, 517–525. 10.1007/s10464-012-9512-z [DOI] [PubMed] [Google Scholar]
- *Association of Government Accountants. (2014). Blended and braided funding: A guide for policy makers and practitioners. https://www.agacgfm.org/AGA/Intergovernmental/documents/BlendedandBraidedFunding.pdf
- Bartholomew L. K., Parcel G. S., Kok G. (1998). Intervention mapping: A process for developing theory- and evidence-based health education programs. Health Education and Behavior, 25(5), 545–563. https://doi:10.1186/1471-2458-9-216 [DOI] [PubMed] [Google Scholar]
- Bauer M. S., Damschroder L., Hagedorn H., Smith J., Kilbourne A. M. (2015). An introduction to implementation science for the non-specialist. BMC Psychology, 3, 1. 10.1186/S40359-015-0089-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Beidas R. S., Becker-Haimes E. M., Adams D. R., Skriner L., Stewart R. E., Wolk C. B., Buttenheim A. M., Williams N. J., Inaker P., Richey E., Marcus S. C. (2017). Feasibility and acceptability of two incentive-based implementation strategies for mental health therapists implementing cognitive-behavioral therapy: A pilot study to inform a randomized controlled trial. Implementation Science, 12, 148. 10.1186/s13012-017-0684-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Beidas R. S., Marcus S., Wolk C. B., Powell B., Aarons G. A., Evans A. C., Hurford M. O., Hadley T., Adams D. R., Walsh L. M., Babbar S., Barg F., Mandell D. S. (2016). A prospective examination of clinician and supervisor turnover within the context of implementation of evidence-based practices in a publicly-funded mental health system. Administration and Policy in Mental Health and Mental Health Services Research, 43(5), 640–649. 10.1007/s10488-015-0673-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bond G. R., Drake R. E., McHugo G. J., Peterson A. E., Jones A. M., Williams J. (2014). Long-term sustainability of evidence-based practices in community mental health agencies. Administration and Policy in Mental Health and Mental Health Services Research, 41(2), 228–236. 10.1007/s10488-012-0461-5 [DOI] [PubMed] [Google Scholar]
- †Bright T., Felix L., Kuper H., Polack S. (2017). A systematic review of strategies to increase access to health services among children in low and middle income countries. BMC Health Services Research, 17, 252. 10.1186/s12913-017-2180-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- *Bruns E. J., Kerns S. E. U., Pullmann M. D., Hensley S. W., Lutterman T., Hoagwood K. E. (2016). Research, data, and evidence-based treatment use in state behavioral health systems, 2001–2012. Psychiatric Services, 67(5), 496–503. 10.1176/appi.ps.201500014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chambers D. A., Glasgow R. E., Stange K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8, 117. 10.1186/1748-5908-8-117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cleverley W. O., Cleverley J. O. (2018). Essentials of health care finance (8th ed.). Jones & Bartlett Learning. [Google Scholar]
- †Cochrane Effective Practice and Organisation of Care. (2015). EPOC taxonomy. https://epoc.cochrane.org/epoc-taxonomy
- †Cochrane Effective Practice and Organisation of Care Group. (2002). Data collection checklist. https://methods.cochrane.org/sites/methods.cochrane.org.bias/files/public/uploads/EPOC%20Data%20Collection%20Checklist.pdf
- Coryn C. L. S., Hobson K. A. (2011). Using nonequivalent dependent variables to reduce internal validity threats in quasi-experiments: Rationale, history, and examples from practice. New Directions in Evaluation, 131, 31–39. 10.1002/ev.375 [DOI] [Google Scholar]
- Costello E., Angold A. (2016). Developmental epidemiology. In Cichetti D. (Ed.), Developmental psychology, Vol. 1: Theory and method (3rd ed., pp. 94–128). Wiley. [Google Scholar]
- *Covell N. H., Margolies P. J., Myers R. W., Sederer L., Ruderman D., Von Bramer J., Fazio M. L., McNabb L. M., Thorning H., Watkins L., Hinds M., Dixon L. B. (2016). Using incentives for training participation. Psychiatric Rehabilitation Journal, 39(1), 81–83. 10.1037/prj0000165 [DOI] [PubMed] [Google Scholar]
- *Damberg C. L., Sorbero M. E., Lovejoy S. L. (2014). Measuring success in health care value-based purchasing programs: Findings from an environmental scan, literature review, and expert panel discussions. RAND Corporation. [PMC free article] [PubMed] [Google Scholar]
- *D’Angelo G., Pullmann M. D., Lyon A. R. (2017). Community engagement strategies for implementation of a policy supporting evidence-based practices: A case study of Washington State. Administration and Policy in Mental Health and Mental Health Services Research, 44, 6–15. 10.1007/s10488-015-0664-7 [DOI] [PubMed] [Google Scholar]
- *Dopp A. R., Coen A. S., Smith A. B., Reno J. R., Bernstein D. B., Kerns S. E. U., Altschul D. B. (2018). Economic impact of the statewide implementation of an evidence-based treatment: Multisystemic therapy in New Mexico. Behavior Therapy, 49(4), 551–566. 10.1016/j.beth.2017.12.003 [DOI] [PubMed] [Google Scholar]
- Dopp A. R., Hanson R. F., Saunders B. E., Dismuke C. E., Moreland A. D. (2017). Community-based implementation of trauma-focused interventions for youth: Economic impact of the learning collaborative model. Psychological Services, 14(1), 57–65. 10.1037/ser0000131 [DOI] [PMC free article] [PubMed] [Google Scholar]
- *Edwards J. M., Stein-Seroussi A., Flewelling R. L., Orwin R. G., Zhang L. (2015). Sustainability of state-level substance abuse prevention infrastructure after the completion of the SPF SIG. Journal of Primary Prevention, 36, 177–186. 10.1007/s10935-015-0382-7 [DOI] [PubMed] [Google Scholar]
- Eisman A. B., Kilbourne A. M., Dopp A. R., Saldana L., Eisenberg D. (2020). Economic evaluation in implementation science: Making the business case for implementation strategies. Psychiatry Research, 283, 112433. 10.1016/j.psychres.2019.06.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- †Feldhaus I., Mathauer I. (2018). Effects of mixed provider payment systems and aligned cost sharing practices on expenditure growth management, efficiency, and equity: A structured review of the literature. BMC Health Services Research, 18, 996. 10.1186/s12913-018-3779-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Folland S., Goodman A. C., Stano M. (2017). The economics of health and health care (8th ed.). Routledge. [Google Scholar]
- Frank R. G., Glied S. (2006). Changes in mental health financing since 1971: Implications for policymakers and patients. Health Affairs, 25(3), 601–613. 10.1377/hlthaff.25.3.601 [DOI] [PubMed] [Google Scholar]
- *Fraser A., Tan S., Kruithof K. (2018). Evaluation of the Social Impact Bond Trailblazers in health and social care: Final report. Policy Innovation Research Unit, Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine. [Google Scholar]
- †Friedberg M. W., Chen P. G., White C., Jung O., Raaen L., Hirshman S., Hoch E., Stevens C., Ginsburg P. B., Casalino L. P., Tutty M., Vargo C., Lipinski L. (2015). Effects of health care payment models on physician practice in the United States. RAND Corporation. [PMC free article] [PubMed] [Google Scholar]
- Garfield R. L. (2011). Mental health financing in the United States: A primer. Kaiser Family Foundation. http://kff.org/medicaid/report/mental-health-financing-in-the-united-states/ [Google Scholar]
- *Garner B. R., Godley S. H., Dennis M. L. (2012). Using pay for performance to improve treatment implementation for adolescent substance use disorders: Results from a cluster randomized trial. Archives of Pediatric and Adolescent Medicine, 166(10), 938–944. 10.1001/archpediatrics.2012.802 [DOI] [PMC free article] [PubMed] [Google Scholar]
- *Garner B. R., Lwin A. K., Strickler G. K., Hunter B. D., Shepard D. S. (2018). Pay-for-performance as a cost-effective implementation strategy: Results from a cluster randomized trial. Implementation Science, 13, 92. 10.1186/s13012-018-0774-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Georgopoulos B. S., Mahoney G. M., Jones N. W., Jr (1957). A path-goal approach to productivity. Journal of Applied Psychology, 41(6), 345–353. 10.1037/h0048473 [DOI] [Google Scholar]
- *Gottfredson D. C., Kearley B., Thornberry T. P., Slothower M., Devlin D., Fader J. J. (2018). Scaling-up evidence-based programs using a public funding stream: A randomized trial of Functional Family Therapy for court-involved youth. Prevention Science, 19, 939–953. 10.1007/s11121-018-0936-z [DOI] [PubMed] [Google Scholar]
- †Health Care Payment Learning and Action Network. (2017). Alternative payment model (APM) framework refresh. https://hcp-lan.org/apm-refresh-white-paper/
- *Herndon J. B., Tomar S. L., Catalanotto F. A., Vogel W. B., Shenkman E. A. (2015). The effect of Medicaid primary care provider reimbursement on access to early childhood caries preventive services. Health Services Research, 50(1), 136–160. 10.1111/1475-6773.12200 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hooley C., Amano T., Markovitz L., Yaeger L., Proctor E. (2019). Assessing implementation strategy reporting in the mental health literature: A narrative review. Administration and Policy in Mental Health and Mental Health Services Research, 47(1), 19–35. 10.1007/s10488-019-00965-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- *Hussey P. S., Ridgely M. S., Rosenthal M. B. (2011). The PROMETHEUS bundled payment experiment: Slow start shows problems in implementing new payment models. Health Affairs, 30(11), 2116–2124. 10.1377/hlthaff.2011.0784 [DOI] [PubMed] [Google Scholar]
- *Iovan S., Lantz P. M., Shapiro S. (2018). “Pay for Success” projects: Financing interventions that address social determinants of health in 20 countries. American Journal of Public Health, 108, 1473–1477. 10.2105/AJPH.2018.304651 [DOI] [PMC free article] [PubMed] [Google Scholar]
- *Jaramillo E. T., Willging C. E., Green A. E., Gunderson L. M., Fettes D. L., Aarons G. A. (2018). “Creative financing”: Funding evidence-based interventions in human service systems. Journal of Behavioral Health Services Research, 46, 366–383. 10.1007/s11414-018-9644-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- *Jones A. M., Bond G. R., Peterson A. E., Drake R. E., McHugo G. J., Williams J. R. (2014). Role of state mental health leaders in supporting evidence-based practices over time. Journal of Behavioral Health Services Research, 41(3), 347–355. 10.1007/s11414-013-9358-7 [DOI] [PubMed] [Google Scholar]
- *Katz A. S., Brisbois B., Zerger S., Hwang S. W. (2018). Social impact bonds as a funding method for health and social programs: Potential areas of concern. American Journal of Public Health, 108(2), 210–215. 10.2105/AJPH.2017.304157 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kazak A. E., Hoagwood K., Weisz J. R., Hood K., Kratochwill T. R., Vargas L. A., Banez G. A. (2010). A meta-systems approach to evidence-based practice for children and adolescents. American Psychologist, 65(2), 85–97. 10.1037/a0017784 [DOI] [PubMed] [Google Scholar]
- Knapp M., Funk M., Curran C., Prince M., Grigg M., Mcdaid D. (2006). Economic barriers to better mental health practice and policy. Health Policy and Planning, 21(3), 157–170. 10.1093/heapol/czl003 [DOI] [PubMed] [Google Scholar]
- Lang J. M., Connell C. M. (2017). Measuring costs to community-based agencies for implementation of an evidence-based practice. Journal of Behavioral Health Services Research, 44(1), 122–134. 10.1007/s11414-016-9541-8 [DOI] [PubMed] [Google Scholar]
- *Lantz P. M., Rosenbaum S., Ku L., Iovan S. (2016). Pay for Success and population health: Early results from eleven projects reveal challenges and promise. Health Affairs, 35(11), 2053–2061. 10.1377/hlthaff.2016.0713 [DOI] [PubMed] [Google Scholar]
- Luke D. A., Morshed A. B., McKay V. R., Combs T. B. (2018). Systems science methods in dissemination and implementation research. In Brownson R. C., Colditz G. A., Proctor E. K. (Eds.), Dissemination and implementation research in health: Translating science to practice (2nd ed., pp. 157-173). Oxford University Press. [Google Scholar]
- *Magnabosco J. L. (2006). Innovations in mental health services implementation: A report on state-level data from the U.S. Evidence-Based Practices Project. Implementation Science, 1, 13. 10.1186/1748-5908-1-13 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Massatti R. R., Sweeney H. A., Panzano P. C., Roth D. (2008). The de-adoption of innovative mental health practices (IMHP): Why organizations choose not to sustain an IMHP. Administration and Policy in Mental Health and Mental Health Services Research, 35(1–2), 50–65. 10.1007/s10488-007-0141-z [DOI] [PubMed] [Google Scholar]
- *McBeath B., Chuang E., Carnochan S., Austin M. J., Stuart M. (2018). Service coordination by public sector managers in a human service contracting environment. Administration and Policy in Mental Health and Mental Health Services Research, 46, 115–127. 10.1007/s10488-018-0899-1 [DOI] [PubMed] [Google Scholar]
- McHugh R. K., Barlow D. H. (2010). The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. American Psychologist, 65(2), 73–84. 10.1037/a0018121 [DOI] [PubMed] [Google Scholar]
- Mendel P., Scott W. R. (2010). Institutional change and the organization of healthcare: The dynamics of “muddling through.” In Bird C. E., Conrad P., Fremont A. M., Timmermans S. (Eds.), Handbook of medical sociology (6th ed., pp. 249–269). Vanderbilt University Press. [Google Scholar]
- *Miller N. A., Merryman M. B., Eskow K. G., Chasson G. S. (2016). State design and use of Medicaid 1915(c) waivers and related benefits to provide services to children and youth with autism spectrum disorder. American Journal on Intellectual and Developmental Disabilities, 121(4), 295–311. 10.1352/1944-7558-121.4.295 [DOI] [PubMed] [Google Scholar]
- *Nagle G. A., Usry L. R. (2016). Using public health strategies to shape early childhood policy. American Journal of Orthopsychiatry, 86(2), 171–178. 10.1037/ort0000088 [DOI] [PubMed] [Google Scholar]
- †National Association of State Mental Health Program Directors. (2010). NASMHPD policy brief: Financing and the public mental health system. https://www.nasmhpd.org/sites/default/files/Financing_Policy_Brief.pdf
- †National Association of State Mental Health Program Directors. (2012). Fact sheet on harmonizing funding streams: The SBHA role. www.nasmhpd.org/sites/default/files/Public%20Private%20Financing_Fact%20Sheet%20on%20Harmonizing%20Funding%20Streams.pdf
- *National Child Traumatic Stress Network. (2016). Financing and sustainability survey report. www.nctsn.org/resources/nctsn-financing-and-sustainability-survey-report
- *Niederman R., Huang S. S., Trescher A. L., Listl S. (2017). Getting the incentives right: Improving oral health equity with university school-based caries prevention. American Journal of Public Health, 107(S1), S50–S55. 10.2105/AJPH.2016.303614 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Okamura K. H., Wolk C. B., Kang-Yi C. D., Stewart R., Rubin R. M., Weaver S., Evans A. C., Cidav Z., Beidas R. S., Mandell D. S. (2018). The price per prospective consumer of providing therapist training and consultation in seven evidence-based treatments within a large public behavioral health system: An example cost-analysis metric. Frontiers in Public Health, 5, 356. 10.3389/fpubh.2017.00356 [DOI] [PMC free article] [PubMed] [Google Scholar]
- *Orwin R. G., Stein-Seroussi A., Edwards J. M., Landy A. L., Flewelling R. L. (2014). Effects of the Strategic Prevention Framework State Incentives Grant (SPF SIG) on state prevention infrastructure in 26 States. Journal of Primary Prevention, 35, 163–180. 10.1007/s10935-014-0342-7 [DOI] [PubMed] [Google Scholar]
- Powell B. J., Beidas R. S., Lewis C. C., Aarons G. A., McMillen J. C., Proctor E. K., Mandell D. S. (2017). Methods to improve the selection and tailoring of implementation strategies. Journal of Behavioral Health Services Research, 44(2), 177–194. 10.1007/s11414-015-9475-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- *Powell B. J., Beidas R. S., Rubin R. M., Stewart R. E., Wolk C. B., Matlin S. L., Weaver S., Hurford M. O., Evans A. C., Hadley T. R., Mandell D. S. (2016). Applying the Policy Ecology Framework to Philadelphia’s behavioral health transformation efforts. Administration and Policy in Mental Health and Mental Health Services Research, 43, 909–926. 10.1007/s10488-016-0733-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- †Powell B. J., McMillen J. C., Proctor E. K., Carpenter C. R., Griffey R. T., Bunger A. C., Glass J. E., York J. L. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research Review, 69(2), 123–157. 10.1177/1077558711430690 [DOI] [PMC free article] [PubMed] [Google Scholar]
- †Powell B. J., Waltz T. J., Chinman M. J., Damschroder L. J., Smith J. L., Matthieu M. M., Proctor E. K., Kirchner J. E. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10, 1. 10.1186/s13012-015-0209-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Proctor E., Silmere H., Raghavan R., Hovmand P., Aarons G., Griffey R., Hensley M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. 10.1007/s10488-010-0319-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Proctor E. K., Powell B. J., McMillen J. C. (2013). Implementation strategies: Recommendations for specifying and reporting. Implementation Science, 8, 139. 10.1186/1748-5908-8-139 [DOI] [PMC free article] [PubMed] [Google Scholar]
- †Raghavan R., Bright C. L., Shadoin A. L. (2008). Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implementation Science, 3, 26. 10.1186/1748-5908-3-26 [DOI] [PMC free article] [PubMed] [Google Scholar]
- †RAND Corporation. (2015). Paying for health care: In depth. https://www.rand.org/health-care/key-topics/paying-for-care/in-depth.html
- *Rieckmann T., Abraham A., Zwick J., Rasplica C., McCarty D. (2015). A longitudinal study of state strategies and policies to accelerate evidence-based practices in the context of systems transformation. Health Services Research, 50(4), 1125–1145. 10.1111/1475-6773.12273 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rodriguez A., Lau A. S., Wright B., Regan J., Brookman-Frazee L. (2018). Mixed-method analysis of program leader perspectives on the sustainment of multiple child evidence-based practices in a system-driven implementation. Implementation Science, 13, 1. 10.1186/s13012-018-0737-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Roundfield K. D., Lang J. M. (2017). Costs to community mental health agencies to sustain an evidence-based practice. Psychiatric Services, 68(9), 876–882. 10.1176/appi.ps.201600193 [DOI] [PubMed] [Google Scholar]
- Scheirer M. A., Dearing J. W. (2011). An agenda for research on the sustainability of public health programs. American Journal of Public Health, 101(11), 2059–2067. 10.2105/AJPH.2011.300193 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schell S. F., Luke D. A., Schooley M. W., Elliott M. B., Herbers S. H., Mueller N. B., Bunger A. C. (2013). Public health program capacity for sustainability: A new framework. Implementation Science, 8, 1. 10.1186/1748-5908-8-15 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schoenwald S. K., Garland A. F., Chapman J. E., Frazier S. L., Sheidow A. J., Southam-Gerow M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 32–43. 10.1007/s10488-010-0321-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- *Scudder A. T., Taber-Thomas S. M., Schaffner K., Pemberton J. R., Hunter L., Herschell A. D. (2017). A mixed-methods study of system-level sustainability of evidence-based practices in 12 large-scale implementation initiatives. Health Research Policy & Systems, 15, 102. 10.1186/s12961-017-0230-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shelton R. C., Cooper B. R., Stirman S. W. (2018). The sustainability of evidence-based interventions and practices in public health and health care. Annual Review of Public Health, 39(1), 55–76. 10.1146/annurev-publhealth-040617-014731 [DOI] [PubMed] [Google Scholar]
- Sigel B. A., Benton A. H., Lynch C. E., Kramer T. L. (2013). Characteristics of 17 statewide initiatives to disseminate trauma-focused cognitive-behavioral therapy (TF-CBT). Psychological Trauma: Theory, Research, Practice, & Policy, 5(4), 323–333. 10.1037/a0029095 [DOI] [Google Scholar]
- Society of Clinical Psychology. (2019). Research-supported psychological treatments. https://www.div12.org/psychological-treatments/
- †Steverman S., Shern D. (2013). Sustaining primary prevention programming in behavioral health: Financing strategies for improving health, well-being and productivity of young people, families and their communities. https://www.nasmhpd.org/content/nasmhpd-prevention-centers-webinar-sustaining-primary-prevention-programming-behavioral
- Stewart R. E., Adams D. R., Mandell D. S., Hadley T. R., Evans A., Rubin R., Erney J., Neimark G., Hurford M. O., Beidas R. S. (2016). The perfect storm: Collision of the business of mental health and the implementation of evidence-based practices. Psychiatric Services, 67(2), 159–161. 10.1176/appi.ps.201500392 [DOI] [PMC free article] [PubMed] [Google Scholar]
- *Stroul B. A. (2007). Issue brief 1: Effective strategies to finance a broad array of services and supports. Research and Training Center for Children’s Mental Health, Louis de la Parte Florida Mental Health Institute (FMHI), University of South Florida. [Google Scholar]
- *Stroul B. A., Pires S. A., Armstrong M. I., McCarthy J., Pizzigati K., Wood G. M., Echo-Hawk H. (2009). Effective financing strategies for systems of care: Examples from the field—A resource compendium for financing systems of care (2nd ed.). Research and Training Center for Children’s Mental Health, Louis de la Parte Florida Mental Health Institute (FMHI), University of South Florida. [Google Scholar]
- †Substance Abuse and Mental Health Services Administration. (2013). Medicaid handbook: Interface with behavioral health services (HHS Publication No. SMA-13-4773). [Google Scholar]
- Substance Abuse and Mental Health Services Administration. (2017). Key substance use and mental health indicators in the United States: Results from the 2016 National Survey on Drug Use and Health (HHS Publication No. SMA 17-5044, NSDUH Series H-52). Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration. https://www.samhsa.gov/data/ [Google Scholar]
- *Szanton S. L., Spoelstra S., Gitlin L. (2015). Complexities and actualization: Embedding a home-based functional improvement intervention within a Medicaid Waiver. Implementation Science, 10(S1), A69. 10.1186/1748-5908-10-S1-A69 [DOI] [Google Scholar]
- *Tan S., Fraser A., Giacomantonio C., Kruithof K., Sim M., Lagarde M., Disley E., Rubin J., Mays N. (2015). An evaluation of social impact bonds in health and social care: Interim report. Policy Innovation Research Unit, Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine. [Google Scholar]
- Trautmann S., Rehm J., Wittchen H.-U. (2016). The economic costs of mental disorders: Do our societies react appropriately to the burden of mental disorders? EMBO Reports, 17(9), 1245–1249. 10.15252/embr.201642951 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tricco A. C., Lillie E., Zarin W., O’Brien K. K., Colquhoun H., Levac D., Moher D., Peters M. D. J., Horsley T., Weeks L., Hempel S., Akl E. A., Chang C., McGowan J., Stewart L., Hartling L., Aldcroft A., Wilson M. G., Garritty C., Straus S. E. (2018). PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and explanation. Annals of Internal Medicine, 169, 467–473. 10.7326/M18-0850 [DOI] [PubMed] [Google Scholar]
- *Velott D. L., Agbese E., Mandell D., Stein B. D., Dick A. W., Yu H., Leslie D. L. (2016). Medicaid 1915(c) home and community based services waivers for children with autism spectrum disorder. Autism, 20(4), 473–482. 10.1177/1362361315590806 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Waltz T. J., Powell B. J., Chinman M. J., Smith J. L., Matthieu M. M., Proctor E. K., Damschroder L. J., Kirchner J. E. (2014). Expert recommendations for implementing change (ERIC): Protocol for a mixed methods study. Implementation Science, 9, 39. 10.1186/1748-5908-9-39 [DOI] [PMC free article] [PubMed] [Google Scholar]
- †Waltz T. J., Powell B. J., Matthieu M. M., Damschroder L. J., Chinman M. J., Smith J. L., Proctor E. K., Kirchner J. E. (2015). Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: Results from the Expert Recommendations for Implementing Change (ERIC) study. Implementation Science, 10, 109. 10.1186/s13012-015-0295-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weisz J. R., Kazdin A. (2017). Evidence-based psychotherapies for children and adolescents (3rd ed.). Guilford Press. [Google Scholar]
- *Willging C. E., Aarons G. A., Trott E. M. (2016). Contracting and procurement for evidence-based interventions in public-sector human services: A case study. Administration and Policy in Mental Health and Mental Health Services Research, 43, 675–692. 10.1007/s10488-015-0681-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Willging C. E., Green A. E., Gunderson L., Chaffin M., Aarons G. A. (2015). From a “perfect storm” to “smooth sailing”: Policymaker perspectives on implementation and sustainment of an evidence-based practice in two states. Child Maltreatment, 20(1), 24–36. 10.1177/1077559514547384 [DOI] [PMC free article] [PubMed] [Google Scholar]