Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2020 Oct 1.
Published in final edited form as: Adm Policy Ment Health. 2020 Jan;47(1):60–72. doi: 10.1007/s10488-019-00973-8

The Policy Ecology of Behavioral Health Homes: Case Study of Maryland’s Medicaid Health Home Program

Elizabeth M Stone 1, Gail L Daumit 2, Alene Kennedy-Hendricks 1, Emma E McGinty 1
PMCID: PMC7040852  NIHMSID: NIHMS1559321  PMID: 31506860

Abstract

Behavioral health homes, shown to improve receipt of evidence-based medical services among people with serious mental illness in randomized clinical trials, have had limited results in real-world settings; nonetheless, these programs are spreading rapidly. To date, no studies have considered what set of policies is needed to support effective implementation of these programs. As a first step toward identifying an optimal set of policies to support behavioral health home implementation, we use the policy ecology framework to map the policies surrounding Maryland’s Medicaid behavioral health home program. Results suggest that existing policies fail to address important implementation barriers.

Keywords: Behavioral health home, Integrated care, Serious mental illness, Healthcare policy

Introduction

Individuals with serious mental illnesses (SMIs) such as schizophrenia and bipolar disorder experience disproportionately high rates of comorbid medical conditions (De Hert et al. 2006; Janssen et al. 2015; Parks et al. 2006). Individuals with SMI are one and a half times more likely to have cardiovascular disease (Correll et al. 2017) and nearly two times more likely to have diabetes mellitus (Vancampfort et al. 2016) compared to those in the general population. The increased prevalence and mortality due to these conditions among individuals with SMI relative to those without contributes to a 10–20 year shortened life expectancy (Daumit et al. 2010; Olfson et al. 2015). Despite the high need for care for these individuals, fragmentation in the healthcare system reduces the accessibility of needed services (Horvitz-Lennon et al. 2006). This often results in sub-optimal quality of care for physical healthcare services among individuals with SMI (McGinty et al. 2015).

One model for addressing fragmentation and coordinating services for individuals with SMI is the “behavioral health home,” in which specialty mental health programs are responsible for coordinating and/or delivering physical healthcare services for people with SMI. A key rationale for this model, differentiating it from primary-care based health home efforts like the Primary Care Medical Home (PCMH), is that many individuals with SMI receive the majority of their healthcare services in the specialty mental health sector (Bao et al. 2013). Behavioral health homes have been shown in randomized clinical trials to improve outcomes related to utilization (e.g., increase primary care visits and increase emergency department visits), receipt of preventive care (e.g., vaccination and screening and monitoring for diabetes and blood pressure), and coordination and satisfaction with physical health care (Druss et al. 2001, 2017). The promising results of these RCTS helped lead to a proliferation of “real-world” behavioral health home models. In recent years, behavioral health homes have been created through two major U.S. initiatives: the Substance Abuse and Mental Health Services Administration’s Primary and Behavioral Health Care Integration (PBHCI) program, which supported the development of 213 behavioral health home programs at community mental health centers from 2009 to 2016 (SAMHSA 2016), and the Affordable Care Act’s Medicaid Health Home Waiver. The Medicaid health home waiver program, which creates a financing mechanism by which specialty mental health providers can be reimbursed for the provision or coordination of primary care services for a high-cost high-need population, has spurred widespread adoption of the behavioral health home model (CMS 2018a). As of September 2018, Seventeen states and Washington, D.C. have implemented behavioral health homes for individuals with SMI through the Medicaid waiver (CMS 2018c).

Evaluations of real-world behavioral health homes have shown limited and mixed effects on outcomes (Murphy et al. 2019). Studies have shown some beneficial effects on screening and monitoring for physical health conditions (e.g., diabetes and blood pressure) (Breslau et al. 2018b; Gilmer et al. 2016; Murphy et al. under review; Missouri Department of Health 2017; Tepper et al. 2017). However, studies of effects on utilization measures (e.g., inpatient stays, emergency department visits, outpatient primary care visits) have mixed results (Bandara et al. under review; Breslau et al. 2018a, b; Missouri Department of Health 2017; Krupski et al. 2016; Ohio Departmet of Medicaid 2015; Tepper et al. 2017). Evaluations of behavioral health home impact on health outcomes (e.g., cholesterol and diabetes control, weight management, smoking cessation) show small or no effects (Gilmer et al. 2016; Missouri Department of Health 2017; Scharf et al. 2016; Schuster et al. 2018; Tepper et al. 2017).

The limited impacts found in evaluations of these real-world behavioral health home programs are likely due, in part, to challenges related to implementation (Murphy et al. 2019). While behavioral health home implementation barriers are well documented—prominent barriers include lack of information sharing (Golembiewski et al. 2015; McGinty et al. 2018; Missouri Department of Health 2017; Ohio Departmet of Medicaid 2015; Scharf et al. 2014b), recruiting and retraining consumers (Annamalai et al. 2018; Golembiewski et al. 2015; Maragakis and RachBeisel 2015; Ohio Departmet of Medicaid 2015; Scharf et al. 2013, 2014a, b), and insufficient training for staff (Golembiewski et al. 2015; Missouri Department of Health 2017; Scharf et al. 2013; Scharf et al. 2014b)—the policy environment of behavioral health home implementation is not. A coordinated effort of policies is required for implementing complex programs such as behavioral health homes, however evidence on a model policy environment for these programs does not exist. As a first step toward defining a model, we use the Maryland behavioral health home model as a case study. We aim to delineate the existing policy environment supporting behavioral health home implementation in Maryland using the policy ecology framework (Raghavan et al. 2008), summarize prior literature surrounding the effectiveness of the policies within Maryland’s ecology, and consider additional and alternative policies that could better support behavioral health home implementation.

Maryland’s Medicaid Health Home Program

Since October 2013, 59 Medicaid behavioral health homes, created through the Affordable Care Act waiver program, have been implemented in psychiatric rehabilitation programs in Maryland (Maryland 2018). Psychiatric rehabilitation programs were chosen as the primary location of behavioral health home implementation in Maryland as a way to reach individuals with SMI where they already regularly receive care and because psychiatric rehabilitation programs had previous experience providing and coordinating mental health and social services for individuals with SMI (Maryland 2018). The behavioral health home adds the coordination of physical health care and delivery of other health home services, which include provision of basic preventive services and individual and family support services, to the psychiatric rehabilitation programs’ responsibilities. Full details of Maryland’s behavioral health home program have been described elsewhere (McGinty et al. 2018).

Similar to evaluations of behavioral health homes in other states, early evaluations in Maryland have found limited impacts of the model on outcomes related to utilization and quality of care. Maryland behavioral health homes were associated with reduced likelihood of all-cause emergency department visits, with the overall reduction driven by reduced emergency department visits for physical health conditions (Bandara et al. under review). They had no impact on measures of the quality of care for diabetes or cardiovascular disease, but did increase the likelihood of cancer screening for cervical and breast cancers (McGinty et al. under review; Murphy et al. under review).

Policy Ecology Framework

Developed by Raghavan et al. (2008), the policy ecology framework outlines four levels surrounding the service or program of interest that comprise the broader context of evidence-based practice implementation. The organizational level is the most proximal to the clinical encounter and consists of the organization in which the services are delivered. The regulatory and purchasing agency level is comprised of the regulatory and funding environment surrounding the organization. The political level refers to the legislative and advocacy efforts supporting the policy. The social level consists of the societal norms and subcultures that affect the policy and other levels of the framework. Policies at each of the four levels interact with and influence policies at the other levels. Raghavan et al. (2008) assert that successful implementation and long-term sustainment of evidence-based practices requires consideration and alignment of policies across the entire ecology. An adapted version of the framework, applied to behavioral health home implementation, is shown in Fig. 1. In this adaptation, policies are mapped onto the framework by level of enactment. The political level is renamed the legislative level to reflect the focus on policy enactment and the social level is represented by the social context, which both impacts and is impacted by policies at the other three levels but which is not a level of policy enactment in and of itself.

Fig. 1.

Fig. 1

Behavioral health home policy ecology

Examples of key factors within the social context include societal and provider stigma and health system and community resources and relationships. Individuals with SMI are a highly stigmatized group (Pescosolido et al. 2013). Negative attitudes toward these individuals persist within the healthcare setting and, for behavioral health homes, this may impact clinical how people with SMI and mental health and primary care providers interact with each other and make decisions regarding treatment (Corrigan 2004; Stone et al. 2019; Thornicroft et al. 2007). Resources and relationships with health systems and other community organizations are especially important for behavioral health homes, as many of their primary goals are related to coordinating and making referrals for care. Additionally, these resources and relationships may impact the ability of behavioral health home participants to access care (Bao et al. 2013; McGinty et al. 2018; Scharf et al. 2013).

Case Study Methods

Policies (i.e., legislation, regulations, and rules) supporting implementation of Maryland behavioral health homes were identified using the Code of Maryland Regulations (COMAR 2018) and Maryland Department of Health’s Maryland Chronic Health Homes website (Maryland 2018). Policies related to behavioral health home implementation were identified and assigned to a level of the policy ecology using an iterative process with study team members.

Policy Ecology of Maryland’s Medicaid Health Home Program

Legislative Level

At the legislative level, the sole lever was the creation of an optional Medicaid State Plan waiver in the 2010 Affordable Care Act, Section 2703 (Table 1) (CMS 2018a). This waiver created a Medicaid reimbursement mechanism that allowed states to establish health homes to “integrate and coordinate all primary, acute, behavioral health, and long-term services and supports” for a defined population with chronic mental or physical health conditions (CMS 2018a). States receive an enhanced 90% Federal Medical Assistance Percentage reimbursement rate for the first 2 years of health home service provision and programs are required to report outcomes on core quality and utilization measures to the state (CMS 2018a). Other specifications of the health home target population, structure, and financing are left up to the states (CMS 2018a).

Table 1.

Policy strategies supporting implementation of Maryland behavioral health homes enacted at the legislative level

Policy strategy Details
The Affordable Care Act (ACA) of 2010, Section 2703—Medicaid health home waiver The ACA created an optional Medicaid State Plan benefit which allowed states to create health homes and bill Medicaid for services to coordinate care for Medicaid recipients with chronic conditions
Eligible health home participants must have two or more chronic conditions (mental health, substance use, asthma, diabetes, heart disease, obesity), have one chronic condition and are at risk for a second, or have one serious and persistent mental health condition
Eligible health home providers can be a designated provider (e.g., physician, community health center, behavioral health service agency) or a team of health professionals (e.g., physicians, behavioral health professionals, social workers)
Health home services billable to Medicaid include comprehensive care management, care coordination, health promotion, comprehensive transitional care/follow-up, patient and family support, and referral to community and social support services
States are required to report health home data to the Centers for Medicaid and Medicare Services (CMS). Each year, CMS creates a set of core quality and utilization measures (e.g., number of participants with hypertension whose blood pressure is adequately controlled, number of emergency department visits). In addition to these measures, states are expected to collect information on goals and measures specific to their programs
In the first 2 years of a program, the state is eligible for an enhanced 90% Federal Medical Assistance Percentage for reimbursement of health home services. Development of payment methodologies (e.g., per-member per-month, fixed rates) for health home services were left to the states.

Regulatory and Purchasing Agency Level

In Maryland, the behavioral health home policies implemented at the regulatory and purchasing agency level are related to licensure, accreditation, evaluation, and program requirements (Table 2). To operate as a behavioral health home, organizations must be licensed by the state as a psychiatric rehabilitation program. The regulatory body for these programs, as well as behavioral health homes, is the Maryland Department of Health (COMAR 2018).

Table 2.

Policy strategies supporting implementation of Maryland behavioral health homes enacted at the regulatory and purchasing agency level

Policy strategies Details
State licensure Programs implementing behavioral health homes must be licensed by the state of Maryland as a psychiatric rehabilitation program (PRP)
Accreditation PRPs in Maryland must be accredited as a behavioral health home by either the Joint Commission or the Commission on Accreditation of Rehabilitation Facilities (CARF)
The Joint Commission’s Behavioral Health Home Certification includes measures of the behavioral health home’s ability to:
  1. Assess and document data for at least the following chronic conditions: metabolic syndrome, diabetes, hypertension, heart disease, asthma, chronic obstructive pulmonary disease, Hepatitis C, HIV/AIDS, and obesity

  2. Identify and adapt to health literacy needs of participants

  3. Manage transition of care and access to integrated care

  4. Use health information technology (HIT) to: support continuity of care and provision of integrated care, document and track care, support disease management, support preventive care, create reports, facilitate information exchange, support performance measurement


CARF’s Health Home Standards include measures of the behavioral health home’s:
  1. Program description (defining population served, how services will be provided/accessed/coordinated, referral procedures, and process for primary health care coordination and disease management)

  2. Provision of: health promotion/education, comprehensive care management, care coordination, comprehensive transitional care, individual and family support services, and referral to needed community/ social supports

  3. Use of flexible scheduling to enhances access

  4. Capacity for same day or next day visits, same-day staff response to phone calls, and after-hours access

Evaluation and reporting The Centers for Medicaid and Medicare Services (CMS) and the Maryland Department of Health (MDH) require behavioral health homes to report on monthly enrollment, participant characteristics, health care utilization and access, and health care quality measures
MDH requires monthly reports detailing behavioral health home service delivery and participant health and social outcomes as well as program assessments every six months demonstrating that all regulatory requirements are being met and that a quality improvement plan is being implemented
The behavioral health homes must use eMedicaid, an online portal used by the state to document and bill for Medicaid services, to:
  1. Input information related to participants’ services and health at least monthly

  2. Generate monthly reports documenting service delivery and participants’ health and social outcomes

  3. Update participant diagnoses and outcomes every 6 months

Participant eligibility Individuals are eligible to participate in behavioral health homes if they receive Maryland Medical Assistance and receive outpatient mental health rehabilitation or treatment services from a PRP
Program eligibility To be eligible as a behavioral health home, programs must meet regulations laid out in the Code of Maryland Regulations
Staffing Minimum behavioral health home staffing requirements include:
  1. Health home care manager (.5 FTE per 125 participants). A nurse practitioner, registered nurse, or physician’s assistant who leads the implementation and coordination of health home activities

  2. Health home director (0.5 FTE per 125 participants). An individual with a bachelor’s degree and 2 years’ experience in health administration, a master’s degree in a related field, or a registered nurse, physician, or nurse practitioner who leads the clinical aspects of the health home (e.g., facilitating health education groups, providing training on medical diseases, treatments, and medications). The health home director can also serve as the health home care manager provided that requirements for both positions are met

  3. Physician or nurse practitioner consultant (1.5 h per participant per year). The consultant reviews participant care documents and assists with treatment planning

  4. Administrative support staff as needed to meet the service provision and reporting requirements

Health information technology (HIT) HIT requirements for behavioral health homes include:
  1. Registering with the Chesapeake Regional Information System for our Patients (CRISP), a regional health information exchange, to receive alerts for hospital encounter

  2. Registering with CRISP or state Administrative Services Only (ASO) program to receive access to real-time pharmacy data

  3. Maintaining an electronic database with ability to maintain up-to-date contact information and record/ review clinical appointments

  4. Using eMedicaid, an online portal used by the state to document and bill for Medicaid services, or another HIT tool that feeds into eMedicaid to input information related to evaluation and reporting requirements

Internal protocols Behavioral health homes must develop internal protocol for reviewing and responding to hospital encounter alerts and pharmacy use data
Communication Behavioral health home regulations related to communication between providers (within and outside of the behavioral health home) and participants include:
  1. Convening health home staff meetings every 6 months at minimum

  2. Collaborating with Managed Care Organizations and the ASO

  3. Providing on-call and crisis intervention services by telephone 24 h a day, 7 days a week

  4. Using HIT to facilitate communication between health home staff, participants, caregivers, and other providers

Participant documentation Behavioral health homes are required to maintain a file for each participant that includes a signed consent form, an initial assessment of the participant’s health and social service needs and a care plan, updated every 6 months. Care plans may be combined with existing PRP care plans and must include participant goals (and time frames and proposed interventions for meeting goals), relevant community networks and supports, optimal clinical outcomes, and participant and nurse care manager signatures
Payment mechanism Behavioral health homes are reimbursed at a monthly rate of $102.86 per participant. Reimbursement is contingent upon meeting behavioral health home requirements (e.g., two services per-member per-month)
Service delivery Reimbursable behavioral health home services include comprehensive care management, care coordination and health promotion, comprehensive transitional care/follow-up, individual and family support, and referral to community and social support services. HIT should be used to link services, as appropriate, and service delivery must be documented in eMedicaid. Behavioral health home participants must receive at least two services per month. Components of each service are described below
Comprehensive care management:
  1. Conduct initial assessment of patient physical, mental, substance use, and social service needs

  2. Develop care plan (described above)

  3. Delineate staff roles and providers involved in participant care

  4. Monitor and reassess participant health status and progress toward goals through monitoring of population health status and evaluation of outcomes


Care coordination and health promotion:
  1. Coordinate and provide health care services, preventive and health promotion services, mental health and substance use services, chronic disease management services, and long-term care and support services

  2. Coordinate services and support including appointment scheduling, referrals and follow-up monitoring, hospital discharge processes, and communication with other providers

  3. Assign a health home care manager to each participant

  4. Develop policies and procedures to facilitate coordination between primary care, specialists, and behavioral health providers and community-based organizations

  5. Develop security protocols to protect confidential health information

  6. Assist participants with the implementation of their care plan (e.g. health education)

  7. Coordinate with parents and families of participants who are minors

  8. Use eMedicaid to document, review, and report health home service delivery


Comprehensive transitional care/follow-up:
  1. Provide services to streamline plans of care, reduce avoidable hospital admissions and emergency department use, ease transition to long-term services, and ensure appropriate follow-up across settings

  2. Increase participants’ ability to manage care and live safely in community

  3. Utilize CRISP alerts and follow up with participants within 2 business days of hospital discharge


Individual and family support services:
  1. Advocate for and assist participants in accessing needed resources and medications

  2. Utilize peer supports, support groups, and self-care programs

  3. Ensure that communication is language, literacy, and culturally appropriate


Referral to community and social support services:
  1. Assist in accessing and coordinating medical assistance, disability benefits, subsidized or supported housing, personal needs support, peers support, or legal services

Provider trainings Provider trainings/webinars are offered on the Department of Health website. Details of the trainings are described below.
Provider Training: Health Homes for Children & Youth
  1. Program objectives

  2. Participant eligibility

  3. Health home services

  4. Provider enrollment

  5. CRISP

  6. Pilot program—lessons learned

  7. Health home claims and billing

  8. eMedicaid


Provider Training: Mental Health Providers
  1. Program objectives

  2. Participant eligibility

  3. Health home services

  4. Provider enrollment

  5. CRISP

  6. Consumer scenarios

  7. Health home claims and billing

  8. eMedicaid


Health Home Accreditation: CARF & The Joint Commission
  1. Overview of CARF

  2. CARF accreditation standards

  3. CARF survey process

  4. Overview of The Joint Commission

  5. The Joint Commission accreditation requirements

  6. The Joint Commission survey process

The state also requires that the behavioral health homes themselves be accredited by either the Commission on Accreditation of Rehabilitation Facilities (CARF) (CARF 2018) or the Joint Commission (2018). This accreditation verifies that minimum standards, detailed in Table 2, are being met by the health home. An initial application for accreditation asks programs to detail information about program structure and service provision. This application is followed by on-site observations and document review by the accrediting agency. Programs that are granted accreditation may be granted one-year, three-year, or provisional accreditation. The program is required to submit scheduled quality improvement plans, detailing program strategies for improvement in response to feedback from the accreditation process and updates to accreditation standards, to the accrediting agency and recertify at the end of the cycle (CARF 2018; Joint Commission 2018).

In addition to submitting these plans to the accrediting agencies, behavioral health homes in Maryland are required to submit evaluations every 6 months to the Maryland Department of Health (COMAR 2018). Reports to the Department of Health include information on service delivery and patient health information and outcomes as well as program assessments demonstrating fulfillment of regulatory requirements and implementation of a quality improvement plan. These evaluations are used by the state to create quarterly reports on the behavioral health homes statewide (Marlyand 2018). The resultant reports are primarily descriptive in nature, and evaluation results are not, currently tied to any financial incentives or accountability efforts.

Also at the regulatory and purchasing agency level, the Code of Maryland Regulations includes program requirements put forth by the Maryland Department of Health (COMAR 2018). Participants must be Medicaid recipients and already receive services from the psychiatric rehabilitation program in which the behavioral health home is located. Behavioral health home enrollment is optional for participants—programs must receive consent of each participant’s willingness to participate. Program eligibility is dependent on meeting the regulations outlined in the Code of Maryland Regulations.

In addition to policies regarding participation, the Maryland Department of Health lays out other policies for behavioral health home program structure and infrastructure (COMAR 2018). One requirement relates to staffing. Maryland requires four positions—health home care manager, health home director, physician or nurse practitioner consultant, and administrative support staff—and outlines specific credentials and full-time employee to consumer ratios for each role. The Department of Health also has requirements related to health information technology. Behavioral health homes are given access to the Chesapeake Regional Information System for our Patients (CRISP), a regional health information exchange, to receive alerts of hospital admissions and discharges. Additionally, behavioral health homes must register with CRISP or the State’s Administrative Services Organization (ASO) program to receive real-time pharmacy data. Behavioral health homes must also register with eMedicaid, an online portal used by the state to document and bill for Medicaid services. Finally, behavioral health homes must maintain an electronic database with contact and clinical appointment information for consumers; how this database is created is left up to individual program sites.

Additional regulatory agency requirements focus on behavioral health home functions and service delivery (COMAR 2018). The Maryland Department of Health requires behavioral health homes to create internal protocols for reviewing and responding to hospital encounter alerts and pharmacy-use data, lays out communication requirements (e.g., use of health information technology to communicate with patients and other providers), and mandates health home staff meetings at least every 6 months. Participant documentation and care plans, which include consumer goals and progress, must be updated every 6 months. Staff trainings are offered as webinars through the state Department of Health and cover topics including an overview of behavioral health homes, behavioral health home accreditation, and eMedicaid (Maryland 2018).

Reimbursement for Maryland behavioral health homes is a per-member monthly rate of $102.86, contingent on each participant receiving at least two health home services per month (COMAR 2018). The services covered include comprehensive care management (e.g., monitoring and documenting participant health status and progress toward care plan goals), care coordination and health promotion (e.g., delivery of preventive services and education regarding chronic physical health conditions), comprehensive transitional care (e.g., follow up with participants within 2 days of hospital discharge), individual and family support services (e.g., assisting participants with transportation to medically necessary services), and referral to community and social support services (e.g., connecting participants to needed services including medical assistance, subsidized or supportive housing, and legal services).

Organizational Level

At the organizational level, programs implementing behavioral health homes enact their own policies related to population health management software, provider co-location, and staffing (Table 3). Organizations can choose to adopt the state-endorsed software for completing population health management tasks; organizations must purchase the software but the cost of populating it with administrative claims data is covered by the state. Behavioral health home programs make policy decisions regarding how they will facilitate coordination with primary care providers, e.g. the decision to co-locate primary care services at the psychiatric rehabilitation program; the use of contracts or memorandums of agreement (MOUs) with external providers or organizations; or the use of informal partnerships only, where health home providers build relationships with primary care providers in the community. Beyond the staffing requirements laid out by the state of Maryland, organizations can choose to hire additional staff or set added credentialing requirements for behavioral health home staff. Additionally, organizations may shift psychiatric rehabilitation program staff roles to include behavioral health home service delivery.

Table 3.

Policy strategies supporting implementation of Maryland behavioral health homes enacted at the organizational level

Policy strategies Details
Population health management software Organizations implementing behavioral health homes can choose to purchase the population health management software endorsed by the state. This software system pulls participant health and pharmaceutical data from eMedicaid for population health management tasks
Coordination with primary care providers Behavioral health home programs adopt organizational policy strategies related to coordination with primary care providers including:
  1. Co-location of services (e.g., primary care provider provides services at the psychiatric rehabilitation program (PRP) location)

  2. Formal partnerships with external providers or organizations (e.g., use of a contract or memorandum of agreement)

  3. Informal relationships with external providers or organizations (e.g., steering participants to specific primary care providers)

Staffing Beyond meeting the staffing requirements set by the Maryland Department of Health, behavioral health homes have flexibility in staffing considerations by:
  1. Hiring additional behavioral health home staff beyond state requirements

  2. Defining credentialing requirements for behavioral health home staff

  3. Shifting PRP staff roles to include behavioral health home service delivery

Discussion

The policy ecology of Medicaid behavioral health homes in Maryland includes policies at the legislative, regulatory and purchasing agency, and organizational levels, which are, in turn, impacted by the social context. Despite the implementation of policies across levels of the policy ecology, some of the policies supporting implementation of the Maryland behavioral health homes are not supported by current evidence. Specifically, staffing categories, laid out in both the regulatory and purchasing agency and organizational levels, have been shown to have little effect on program effectiveness in other settings (Burns et al. 2007). Further, three studies (Daumit et al. 2018; Maragakis and RachBeisel 2015; McGinty et al. 2018) have documented barriers to behavioral health home implementation in Maryland, suggesting that changes to the policy ecology may be needed to better support implementation. Five key barriers were identified: (1) challenges coordinating with external providers; (2) inadequate health information technology; (3) lack of population health management capacity; (4) staffing shortfalls; and (5) consumer engagement challenges. These barriers are similar to barriers to behavioral health home implementation in other states (Murphy et al. 2019). While there is not yet an evidence-based policy ecology for implementation of behavioral health homes, additional policies, shown to be successful in other contexts, may be needed to address the barriers to and better support of behavioral health home implementation in Maryland. In the following paragraphs, we briefly summarize the key barriers to behavioral health home implementation identified in three prior studies of Maryland’s program and consider potential changes to the current policy ecology that may help overcome those barriers.

Challenges Coordinating with External Providers

Challenges coordinating with external primary care providers, including lack of incentives for primary care providers to participate in services and negative provider attitudes toward individuals with SMI, were reported by Maryland behavioral health home leaders (Daumit et al. 2018; McGinty et al. 2018). In the existing policy ecology, coordination with external providers is addressed at the organizational level, with each behavioral health home developing their own strategies for primary care coordination. As the entire per-member per-month payment currently goes to the psychiatric rehabilitation program implementing the behavioral health home, changes to policy at the regulatory and purchasing agency level such as enhanced reimbursement rates or other financial incentives may be an effective way to increase external primary care providers’ willingness to coordinate with behavioral health homes (Stewart et al. 2016). Alternative payment models such as a hub-and-spoke model, similar to one used in Vermont’s Medicaid health home program (Clemans-Cope et al. 2017) or an accountable care organization (ACO), similar to that in Massachusetts’s Medicaid Section 1115 wavier (Massachusetts 2018) could create funding streams for both the psychiatric rehabilitation programs implementing the behavioral health homes and the primary care providers in the community with whom they need to coordinate services. Co-located behavioral health home models, in which participants can see a primary care provider onsite at the specialty mental health program implementing the behavioral health home, may also help overcome this barrier. However, extant studies of behavioral health home implementation suggest that co-location is not feasible for all sites (McGinty et al. 2018; Scharf et al. 2013). In Maryland, less than 20% of sites have co-located primary care providers, and those primary care providers are not full-time (e.g., they are onsite 2 days per week); even in the presence of co-location, many consumers at those sites still choose to see an external primary care provider (McGinty et al. 2018).

Inadequate Health Information Technology

The Maryland behavioral health homes have several health information technology systems for accessing participant health information and documentation and billing. However, barriers to effective use of health information technology such as delayed data and lack of interoperability between systems persist. Sites lack effective population health management technology: 27 Maryland behavioral health home sites utilize an elective, state-supported population health management software, but report significant challenges in the software’s usability; and other sites create their own databases for managing participant information (Daumit et al. 2018; McGinty et al. 2018). Sites are supposed to be able to track the services received by participants through the eMedicaid database, but this database’s primary function is billing as opposed to population health management and implementation leaders report that the claims populating the database are often delayed by months, making it impossible to track service receipt in real time (Daumit et al. 2018; McGinty et al. 2018). At the regulatory and purchasing agency level of the policy ecology, financial incentives for health information technology improvements, along the lines of the Medicare and Medicaid Promoting Interoperability Program (CMS 2018b) may serve as a model for encouraging use of specific, interoperable platforms. Policies at the legislative level could also increase the utility of health information technology by addressing issues related to data sharing. One example is North Carolina’s 2015 Health Information Exchange Act, which was designed to promote sharing of health information across healthcare sectors by establishing a state-wide health information exchange and requiring providers who receive Medicaid funding to connect with the exchange (North Carolina 2018). While these policies may help improve health information technology for behavioral health homes in the long term, it may take time for providers to adjust to new programs and workflows (LLuch 2011).

Lack of Population Health Management Capacity

Beyond the health information technology barriers discssued above, additional barriers in Maryland relate to the behavioral health home’s capacity to conduct population health management, a strategy for addressing a continuum of health needs in a population using continuous monitoring and targeted interventions (Struijs et al. 2015). Lack of experience conducting population health management, tension between population health management and direct clinical care, and inflexibility in the Maryland health home service requirements (e.g., requiring two services per member per month for reimbursement) decrease the cacapity of behavioral health homes to conduct this task (Daumit et al. 2018; Maragakis and RachBeisel 2015; McGinty et al. 2018). Currently, the only aspect of the policy ecology meant to facilitate population health management is the software described above—which as noted, has significant usability challenges reported by implementers (Daumit et al. 2018; McGinty et al. 2018). As the goal of population health management is to improve outcomes by targeting high-need individuals, modifying the current regulatory and purchasing agency level reimbursement policy requiring two services per member per month to allow for fewer (or more) services depending on the needs of the specific patient may aid implementation.

Regulatory and purchasing agency level policies that hold behavioral health homes accountable for participant outcomes may also promote population health management by incentivizing focus on the highest need individuals. Such policies may require publishing behavioral health home outcomes in a public manner or providing a financial incentive for meeting performance metrics, such as the ACO model, in which providers share responsibility for meeting quality of care and outcome benchmarks and related financial costs or savings (Shortell et al. 2015), Implementation of ACOs, however, would require buy-in from organizations and providers beyond the behavioral health home and while paying for outcomes is perceived as an effective incentive for adoption of evidence-based practices, the complexity involved may make some stakeholders reluctant to implement this policy (Stewart et al. 2018).

Staffing Shortfalls

Challenges with staff recruitment, retainment, and expertise have been identified as a barrier to behavioral health home implementation in Maryland(Daumit et al. 2018; Maragakis and RachBeisel 2015; McGinty et al. 2018). While staff turnover is a problem in mental health care settings more broadly (Johnson et al. 2018), in the behavioral health home context may be due in part lack of provider experience in performing the care coordination and population health management tasks intrinsic to the health home model. There is some training provided by the state Department of Health through webinars that can be accessed online, but the webinars are not reoccurring (all online material is dated 2013) and there are no state requirements that behavioral health home staff complete the training (Maryland 2018). More intensive training in behavioral health home services may help providers develop the skills needed to effectively deliver services for the complex population with SMI. Development of policies requiring continuing education unit (CEU) or certifications by the regulatory agency or prioritization of staff with these trainings at the organizational level could incentivize participation in trainings.

Consumer Engagement Challenges

Finally, one study of behavioral health home implementation in Maryland identified engaging participants, especially for initial health home enrollment, as a challenge (Maragakis and RachBeisel 2015). Current policy at the legislative and regulatory and purchasing agency levels attempts to maximize participant engagement by targeting a high-need population—individuals with SMI—in the location where they regularly receive care—psychiatric rehabilitation programs. Psychiatric rehabilitation participants may then opt to be enrolled into the behavioral health home, which requires a formal participant consent and enrollment process. To further facilitate participation of consumers in the behavioral health home, switching from the current opt-in policy to an opt-out policy, similar to those used by behavioral health homes in other states, may be beneficial (CMS 2018c).

Many of the challenges impacting implementation of behavioral health homes in Maryland are not unique to either the state or to the behavioral health home setting but are present in implementation of other evidence-based practices more broadly (Aarons et al. 2009; Ubbink et al. 2013). The use of the policy ecology as a framework for analysis emphasizes the importance of looking beyond the intervention itself to consider the complete policy environment. Failing to do so may contribute to misalignment between the goals of the intervention and the resources and infrastructure supporting implementation leaving critical gaps and limiting effectiveness of complex interventions intended to improve access to care and health outcomes for individuals.

Results from this study should be viewed within the context of its limitations. This study only examined the policy ecology of behavioral health homes in Maryland. While it was beyond the scope of this study to compare the policy ecology of Maryland’s Medicaid behavioral health home program to the policy ecology of behavioral health home programs in other states or to quantitatively evaluate the effects of the policies within Maryland’s policy ecology on program implementation and consumer health outcomes, future studies should consider these questions. This study focused on the policy ecology of Maryland behavioral health homes implemented in psychiatric rehabilitation program settings, where the majority (N = 59) of Maryland’s behavioral health homes are implemented. Maryland also implements behavioral health homes in a small number of mobile treatment programs (N = 11) (Maryland 2018). Given the small scope of this program and the fact that the three studies examining barriers to implementation of Maryland’s behavioral health home program focused on psychiatric rehabilitation program settings, we did not consider the policy ecology for behavioral health homes implemented in mobile treatment programs. Mobile treatment programs are a unique setting; behavioral health home implementation in this context likely requires different policy supports than implementation of behavioral health homes in non-mobile contexts.

Further research is needed to rigorously evaluate how the policies we discuss as options for strengthening Maryland’s behavioral health home policy ecology, such as financial incentives for primary care providers and implementing behavioral health homes within ACOs, influence behavioral health home implementation and consumer outcomes.

Conclusion

While Maryland behavioral health homes are currently supported by policies at the organizational, regulatory and purchasing agency, and legislative levels of the policy ecology framework, there remain substantial barriers to effective implementation, documented in three recent studies (Daumit et al. 2018; Maragakis and RachBeisel 2015; McGinty et al. 2018). Modifications to existing polices and additional policies may be needed in order to support effective real-world implementation of behavioral health homes. This case study is a first step toward the identification of a model policy ecology needed to realize the promise of behavioral health homes demonstrated through randomized clinical trials (Druss et al. 2001, 2017).

Acknowledgments

Funding NIMH K01MH106631 (PI: McGinty) and NIMH R24MH102822 (PI: Daumit).

Footnotes

Conflict of interest The authors declare that they have no conflict of interest.

Research Involving Human Participants and/or Animals and Informed Consent This article does not contain any studies with human participants or animals performed by any of the authors.

Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

A preliminary version of this manuscript was presented as a poster at the 2018 Conference on the Science of Dissemination and Implementation in Health.

References

  1. Aarons GA, Wells RS, Zagursky K, et al. (2009). Implementing evidence-based practice in community mental health agencies: A multiple stakeholder analysis. American Journal of Public Health, 99(11), 2087–2095. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Annamalai A, Staeheli M, Cole RA, & Steiner JL (2018). Establishing an integrated health care clinic in a Community Mental Health Center: Lessons learned. Psychiatric Quarterly, 89(1), 169–181. [DOI] [PubMed] [Google Scholar]
  3. Bandara SN, Kennedy-Hendricks A, Stuart EA, et al. (under review). The effect of the Maryland Medicaid Health Home Waiver on Emergency Department and Inpatient Utilization Among Individuals with Serious Mental Illness. [DOI] [PMC free article] [PubMed]
  4. Bao Y, Casalino LP, & Pincus HA (2013). Behavioral health and health care reform models: Patient-centered medical home, health home, and accountable care organization. The Journal of Behavioral Health Services & Research, 40(1), 121–132. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Breslau J, Leckman-Westin E, Han B, et al. (2018a). Impact of a mental health based primary care program on emergency department visits and inpatient stays. General Hospital Psychiatry, 52, 8–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Breslau J, Leckman-Westin E, Yu H, et al. (2018b). Impact of a mental health based primary care program on quality of physical health care. Administration and Policy in Mental Health and Mental Health Services Research, 45(2), 276–285. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Burns T, Catty J, Dash M, et al. (2007). Use of intensive case management to reduce time in hospital in people with severe mental illness: Systematic review and meta-regression. British Medical Journal, 335(7615), 336. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Centers for Medicare and Medicaid Services. (2018a). Health Homes. Retrieved September 9, 2018, from https://www.medicaid.gov/medicaid/Itss/health-homes/index.html.
  9. Centers for Medicare and Medicaid Services. (2018b). Promoting Interoperability. Retrieved October 31, 2018, from https://www.cms.gov/Regulations-and-Guidance/Legislation/EHRIncentivePrograms/index.html?redirect=/EHrIncentivePrograms/.
  10. Centers for Medicare and Medicaid Services. (2018c). State-by-State Health Home State Plan Amendment Matrix. Retrieved September 23, 2018, from https://www.medicaid.gov/state-resource-center/medicaid-state-technical-assistance/health-home-information-resource-center/downloads/state-hh-spa-at-a-glance-matrix.pdf.
  11. Clemans-Cope L, Wishner JB, Allen EH, et al. (2017). Experiences of three states implementing the Medicaid health home model to address opioid use disorder—Case studies in Maryland, Rhode Island, and Vermont. Journal of Substance Abuse Treatment, 83, 27–35. [DOI] [PubMed] [Google Scholar]
  12. Correll CU, Solmi M, Veronese N, et al. (2017). Prevalence, incidence and mortality from cardiovascular disease in patients with pooled and specific severe mental illness: A large-scale metaanalysis of 3,211,768 patients and 113,383,368 controls. World Psychiatry, 16(2), 163–180. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Corrigan P (2004). How stigma interferes with mental health care. American Psychologist, 59(7), 614. [DOI] [PubMed] [Google Scholar]
  14. Daumit G, Anthony C, Ford DE, et al. (2010). Pattern of mortality in a sample of maryland residents with severe mental illness. Psychiatry Research, 176(2–3), 242–245. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Daumit GL, Stone EM, Kennedy-Hendricks A, et al. (2018). Care coordination and population health management strategies and challenges in a behavioral health home model. Medical Care, 57(1), 79–84. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. De Hert M, Van Winkel R, Van Eyck D, et al. (2006). Prevalence of diabetes, metabolic syndrome and metabolic abnormalities in schizophrenia over the course of the illness: A cross-sectional study. Clinical Practic & Epidemiology in Mental Health, 2, 14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Druss BG, Rohrbaugh RM, Levinson CM, & Rosenheck RA (2001). Integrated medical care for patients with serious psychiatric illness: A randomized trial. Archives of General Psychiatry, 58(9), 861–868. [DOI] [PubMed] [Google Scholar]
  18. Druss BG, von Esenwein SA, Glick GE, et al. (2017). Randomized Trial of an Integrated Behavioral Health Home: The Health Outcomes Management and Evaluation (HOME) Study. American Journal of Psychiatry, 174(3), 246–255. 10.1176/appi.ajp.2016.16050507. [DOI] [PubMed] [Google Scholar]
  19. Gilmer TP, Henwood BF, Goode M, et al. (2016). Implementation of integrated health homes and health outcomes for persons with serious mental illness in Los Angeles County. Psychiatric Services, 67(10), 1062–1067. [DOI] [PubMed] [Google Scholar]
  20. Golembiewski EH, Askelson NM, Bentler SE, et al. (2015). Evaluation of the Integrated Health Home (Ihh) Program In Iowa: Qualitative interviews with site administrators. Iowa City: University of Iowa Public Policy Center. [Google Scholar]
  21. Horvitz-Lennon M, Kilbourne AM, & Pincus HA (2006). From silos to bridges: Meeting the general health care needs of adults with severe mental illnesses. Health Aff (Millwood), 25(3), 659–669. [DOI] [PubMed] [Google Scholar]
  22. Janssen EM, McGinty EE, Azrin ST, et al. (2015). Review of the evidence: Prevalence of medical conditions in the United States population with serious mental illness. General Hospital Psychiatry, 37(3), 199–222. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Johnson J, Hall LH, Berzins K, et al. (2018). Mental healthcare staff well-being and burnout: A narrative review of trends, causes, implications, and recommendations for future interventions. International Journal of Mental Health Nursing, 27(1), 20–32. [DOI] [PubMed] [Google Scholar]
  24. Krupski A, West II, Scharf DM, et al. (2016). Integrating primary care into community mental health centers: Impact on utilization and costs of health care. Psychiatric Services, 67(11), 1233–1239. [DOI] [PubMed] [Google Scholar]
  25. Lluch M (2011). Healthcare professionals’ organisational barriers to health information technologies—A literature review. International Journal of Medical Informatics, 80(12), 849–862. [DOI] [PubMed] [Google Scholar]
  26. Maragakis A, & RachBeisel J (2015). Integrated care and the behavioral health home: A new program to help improve somatic health outcomes for those with serious mental illness. The Journal of Nervous and Mental Disease, 203(12), 891–895. [DOI] [PubMed] [Google Scholar]
  27. Maryland Department of Health. (2018). Maryland Chronic Health Homes. Retrieved September 26, 2018, from https://mmcp.health.maryland.gov/Pages/Health-Homes.aspx.
  28. Massechusetts Executive Office of Health and Human Services. (2018). MassHealth Medicaid Section 1115 Demonstration. Retrieved October 31, 2018, from https://www.mass.gov/files/documents/2018/06/27/1115%20MassHealth%20Demonstration%20STC%206-27-18.pdf,.
  29. McGinty EE, Baller J, Azrin ST, et al. (2015). Quality of medical care for persons with serious mental illness: A Comprehensive Review. Schizophrenia Research, 165(2–3), 227–235. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. McGinty EE, Kennedy-Hendricks A, Linden S, et al. (2018). An innovative model to coordinate healthcare and social services for people with serious mental illness: A mixed-methods case study of Maryland’s Medicaid health home program. General Hospital Psychiatry, 51, 54–62. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. McGinty EE, Stone EM, Kennedy-Hendricks A, et al. (under review). The effect of the Maryland Medicaid Health Home Waiver on Quality of Care for Diabetes and Cardiovascular disease among individuals with serious mental illness.
  32. Missouri Department of Health. (2017). Missouri CMHC Healthcare Homes: Progress Report 2016. Retrieved March 20, 2018, from https://dmh.mo.gov/mentalillness/docs/cmhchch2016report.pdf.
  33. Murphy KA, Daumit GL, Stone E, et al. (2019). Physical health outcomes and implementation of behavioural health homes: A comprehensive review. International Review of Psychiatry, 30, 224–241. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Murphy K, Daumit GL, Stone EM, et al. (under review) Effect of the Maryland Medicaid Behavioral Health Home Program on Cancer Screening in People with Serious Mental Illness. [DOI] [PMC free article] [PubMed]
  35. North Carolina Health Information Exchange Authority. (2018). About the NC HIEA. Retrieved October 31, 2018, from https://hiea.nc.gov/about-us/about-nc-hiea.
  36. Ohio Departmet of Medicaid. (2015). Health Homes Performance Measures: Comprehensive Evaluation Report. Retrieved March 20, 2018, from http://mha.ohio.gov/Portals/0/assets/Initiatives/HealthHomes/OH-SFY2015_O2A-Health-Homes-Performance-Measures_FINAL.pdf.
  37. Olfson M, Gerhard T, Huang C, et al. (2015). Premature mortality among adults with schizophrenia in the United States. JAMA Psychiatry, 72(12), 1172–1181. [DOI] [PubMed] [Google Scholar]
  38. Parks J, Svendsen D, Singer P, et al. (2006). Morbidity and mortality in people with serious mental illness. Alexandria, VA: National Association of State Mental Health Program Directors (NASMHPD) Medical Directors Council, 25(4), 1–87. [Google Scholar]
  39. Pescosolido BA, Medina TR, Martin JK, et al. (2013). The “Backbone” of Stigma: Identifying the Global Core of Public Prejudice Associated With Mental Illness. American Journal of Public Health, 103(5), 853–860. 10.2105/AJPH.2012.301147. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Raghavan R, Bright CL, & Shadoin AL (2008). Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implementation Science, 3(1), 26. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Scharf DM, Breslau J, Hackbarth NS, et al. (2014a). An examination of New York State’s integrated primary and mental health care services for adults with serious mental illness. Rand Health Quarterly, 4, 3. [PMC free article] [PubMed] [Google Scholar]
  42. Scharf DM, Eberhart NK, Hackbarth NS, et al. (2014b). Evaluation of the SAMHSA primary and behavioral health care integration (PBHCI) grant program. Rand Health Quarterly, 4, 6. [PMC free article] [PubMed] [Google Scholar]
  43. Scharf DM, Eberhart NK, Schmidt N, et al. (2013). Integrating primary care into community behavioral health settings: Programs and early implementation experiences. Psychiatric Services, 64(7), 660–665. [DOI] [PubMed] [Google Scholar]
  44. Scharf DM, Schmidt Hackbarth N, Eberhart NK, et al. (2016). General medical outcomes from the Primary and Behavioral Health Care Integration grant program. Psychiatric Services, 67(11), 1226–1232. [DOI] [PubMed] [Google Scholar]
  45. Schuster J, Nikolajski C, Kogan J, et al. (2018). A payer-guided approach to widespread diffusion of behavioral health homes in real-world settings. Health Affairs, 37(2), 248–256. [DOI] [PubMed] [Google Scholar]
  46. Shortell SM, Colla CH, Lewis VA, et al. (2015). Accountable care organizations: The national landscape. Journal of Health Politics, Policy and Law, 40(4), 647–668. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Stewart RE, Adams DR, Mandell DS, et al. (2016). The perfect storm: Collision of the business of mental health and the implementation of evidence-based practices. Psychiatric Services, 67(2), 159–161. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Stewart RE, Marcus SC, Hadley TR, Hepburn BM, & Mandell DS (2018). State adoption of incentives to promote evidence-based practices in behavioral health systems. Psychiatric Services, 69(6), 685–688. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Stone EM, Chen LN, Daumit GL, et al. (2019). General medical clinicians’ attitudes toward people with serious mental illness: A scoping review. The Journal of Behavioral Health Services & Research. 10.1007/s11414-019-09652-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Struijs JN, Drewes HW, Heijink R, et al. (2015). How to evaluate population management? Transforming the Care Continuum Alliance population health guide toward a broadly applicable analytical framework. Health Policy, 119(4), 522–529. [DOI] [PubMed] [Google Scholar]
  51. Substance Abuse and Mental Health Services Administration. (2016). SAMHSA PBHCI Grantees by HHS Regions. Retrieved December 11, 2018, from https://www.integration.samhsa.gov/SAMHSA_PBHCI_Grantees_Cohort_I-IX.pdf.
  52. Tepper MC, Cohen AM, Progovac AM, et al. (2017). Mind the gap: Developing an integrated behavioral health home to address health disparities in serious mental illness. Psychiatric Services, 68(12), 1217–1224. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. The Code of Maryland Regulations. (2018). Health Homes. Retrieved September 26, 2018, from http://www.dsd.state.md.us/comar/SubtitleSearch.aspx?search=10.09.33.
  54. The Commission on Accreditation of Rehabilitation Facilities. (2018). Core Treatment Program Standards—Health Home (HH). Behavioral Health Standards Manual., 42, 23. [Google Scholar]
  55. The Joint Commission. (2018). Behavioral Health Home Certification. Retrieved September 26, 2018, from https://www.jointcommission.org/accreditation/behavioral_health_home.aspx.
  56. Thornicroft G, Rose D, & Kassam A (2007). Discrimination in health care against people with mental illness. International Review of Psychiatry, 19(2), 113–122. 10.1080/09540260701278937. [DOI] [PubMed] [Google Scholar]
  57. Ubbink DT, Guyatt GH, & Vermeulen H (2013). Framework of policy recommendations for implementation of evidence-based practice: A systematic scoping review. British Medical Journal Open, 3(1), e001881. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Vancampfort D, Correll CU, Galling B, et al. (2016). Diabetes mellitus in people with schizophrenia, bipolar disorder and major depressive disorder: A systematic review and large scale metaanalysis. World Psychiatry, 15(2), 166–174. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES