Skip to main content
BMC Psychiatry logoLink to BMC Psychiatry
. 2021 Oct 24;21:525. doi: 10.1186/s12888-021-03542-2

Experiences of healthcare staff providing community-based mental healthcare as a multidisciplinary community mental health team in Central and Eastern Europe findings from the RECOVER-E project: an observational intervention study

Catharina Roth 1, Michel Wensing 1,, Martina Rojnic Kuzman 2,3, Sarah Bjedov 2, Sara Medved 2, Ana Istvanovic 4, Danijela Stimac Grbic 4, Ivana Pavic Simetin 4, Aleksandar Tomcuk 5, Jovo Dedovic 5, Tatijana Djurisic 6, Raluca Ileana Nica 7, Tiberiu Rotaru 8, Antoni Novotni 9, Stojan Bajraktarov 9, Milos Milutinovic 9, Vladimir Nakov 10, Zahari Zarkov 10, Roumyana Dinolova 10, Bethany Hipple Walters 11, Laura Shields-Zeeman 11, Ionela Petrea 11,12
PMCID: PMC8543797  PMID: 34689733

Abstract

Background

Community Mental Health Teams (CMHTs) deliver healthcare that supports the recovery of people with mental illness. The aim of this paper was to explore to what extent team members of five CMHTs newly implemented in five countries perceived that they had introduced aspects of the recovery-oriented, strength-based approach into care after a training week on recovery-oriented practice. In addition, it evaluated what the team members’ perceptions on their care roles and their level of confidence with this role were.

Method

An observational intervention study using a quantitative survey that was administered among 52 health professionals (21 Nurses, 13 Psychiatrists, 9 Psychologists, 8 Social Workers) and 14 peer workers including the Recovery Self-Assessment Tool Provider Version (RSA-P), the Team Member Self-Assessment Tool (TMSA), and demographic questions was conducted. The measures were self-reported. Descriptive statistics were used to calculate the means and standard deviations for continuous variables and frequencies and percentages for categorical variables (TMSA tool and demographic data). The standard technique to calculate scale scores for each subscale of the RSA-P was used. Bivariate linear regression analyses were applied to explore the impact of predictors on the subscales of the RSA-P. Predictors with significant effects were included in multiple regression models.

Result

The RSA-P showed that all teams had the perception that they provide recovery–oriented practice to a moderately high degree after a training week on recovery-oriented care (mean scores between 3.85–4.46). Health professionals with fewer years of professional experience perceived more frequently that they operated in a recovery-oriented way (p = 0.036, B = − 0.268). Nurses and peer workers did not feel confident or responsible to fulfil specific roles.

Conclusion

The findings suggest that a one-week training session on community-based practices and collaborative teamwork may enhance recovery-oriented practice, but the role of nurses and peer workers needs further attention.

Trial registration

Each trial was registered before participant enrolment in the clinicaltrials.gov database: Croatia, Zagreb (Trial Reg. No. NCT03862209); Montenegro, Kotor (Trial Reg. No. NCT03837340); Romania, Suceava (Trial Reg. No. NCT03884933); Macedonia, Skopje (Trial Reg. No. NCT03892473); Bulgaria, Sofia (Trial Reg. No. NCT03922425).

Supplementary Information

The online version contains supplementary material available at 10.1186/s12888-021-03542-2.

Keywords: Community mental health services; Implementation; Collaborative Teamwork, Role perceptions

Background

Mental illnesses are the main cause for disability worldwide [1], and contribute substantially to loss of healthy life years [2, 3]. Moreover, people experiencing mental illnesses are more likely to be excluded from social life, are at higher risk of poverty and stigmatisation [2, 3]. They are more likely to suffer from medical comorbidity, poor physical health, and are at higher risk of premature death compared to people without mental illnesses [4]. In Europe more than one in six people have mental health problems [5], which translates to more than 21 million people currently living with depression (4.5%) and more than five million with other severe mental illnesses, such as bipolar disorder (1%) and schizophrenia (0.3%) [5].

In Europe, access to and quality of mental healthcare varies considerably across countries and systems [6]. In low- and middle-income countries between 76 and 85% of people with mental illness do not receive the treatment they need [1, 3, 7, 8]. Usual care typically involved inpatient mental healthcare and institution-based outpatient mental healthcare, without much outreach activity (i.e. home visits) or involvement of service user preferences or experiences of care. Mental health systems particularly in Eastern and Central Europe are at in the process of developing and strengthening community-based services [8, 9]. Many mental health systems have gone through a process of deinstitutionalization by replacing long-stay and institutional inpatient care with community-based alternatives [6, 10]. Shifting healthcare from the hospitals to community care aims at supporting individuals with mental illnesses in maintaining independence, promoting choices, and enhancing inclusion [10]. In Central and Eastern Europe, community-based services have often been piloted or implemented for a short-duration of time, typically in the form of a community mental health centre located in a primary care centre or a hospital [11, 12]. Sustaining the work of community-based services and ensuring that they provide a comprehensive set of services in and outside the clinic remains less common in the Central and Eastern European region.

Numerous service delivery models exist for the delivery of community-based mental health services. Often, care delivered in the community is done through a form of a community mental health team [10]. Community Mental Health Teams (CMHTs) are often multidisciplinary, including professions such as nurses, psychiatrists, psychologists, and social workers [10]. Peer workers (trained individuals with a diagnosis of severe mental illness) may be included in CMHTs as well. The combined expertise and interdisciplinary work practices of these professions enables a service user to receive more holistic care addressing their medical, mental and social needs [10]. A frequently used service delivery model and evidence-based practice for severe mental illness (SMI) is the flexible assertive community treatment (FACT) model [13]. The FACT model helps service user receive intensive support within their community by a multidisciplinary team, which works recovery-oriented rather than focusing on illness [1416]. Next to a low client-staff ratio and regular team meetings, key components of the FACT model include a shared and team-based caseload, as well as home visits [13, 17]. A case manager coordinates individual caseloads, although all professionals within the team provide mental healthcare. In times of an increased need for treatment and care, the team works together to meet those needs. This care model provides an opportunity for a transition between high- and low-intensity treatment and care and a shared case-load, and thus may enhances recovery [13].

Although recovery from SMI is an individual journey, professional care and guidance can support recovery outcomes [18, 19]. A recovery-oriented approach focuses on the person, addresses stigmatisation, and facilitates social inclusion, and improves quality of life, citizenship, and participation in society [3, 20]. It is a collaborative process between mental healthcare providers and service user which facilitates shared decision making and puts the service users’ individual perspectives on recovery in the centre of the treatment [21, 22]. Recovery-oriented practice includes service user empowerment, peer support, the right to informed choice, respecting individual needs, and the right to be treated ethically [22].

Recovery usually occurs in an individual’s personal environment and includes feelings like hope, understanding of competences and skills, having an active and social life, personal autonomy, and living a meaningful life with a positive sense of self [20, 23]. Peer support in mental health is defined as support for a person with a mental health issue provided by people with personal lived experiences of a mental health issue [24]. Persons with lived experience are also increasingly embedded into service delivery teams, as a peer worker or peer specialist [25, 26]. The support of peer workers can have a positive impact on the recovery journey of people with SMI [24, 27].

Care managed by a highly qualified CMHT can support the transition from hospital to community, participation in social life and support increases in overall service user satisfaction [2830]. This requires commitment by each team member, a shared vision, a clear distribution of roles, and a common purpose [31]. Multidisciplinary team functioning is complex and requires a deeper understanding of the different professions operating in teams, such as in CMHTs. Boundaries between the profession can act as barrier and influence communication and coordination negatively which has an impact on service user safety and care integration [32]. Previous research shows that not all healthcare providers work effectively in a multidisciplinary team [31]. Unclear role allocation, lack of clarity regarding leadership can also hinder team functioning [31].

Research has shown that comprehensive community-based mental health services can lead to an improvement in healthcare and service user outcomes, including quality of life, treatment adherence, healthcare accessibility, and social outcomes [10, 3335]. Additionally, CMHTs can reduce the number of days spent in hospital, increase service user satisfaction, reduce suicide rates, and number of admissions to the hospital [10, 31]. Furthermore, most people with SMI favour recovery-oriented healthcare services provided in their community in order to participate in social life and sustain employment [23, 28, 29].

These insights have led to the design and implementation of CMHTs for providing inclusive mental healthcare based on the recovery-oriented approach and social support in five sites in five Central and Eastern European countries within the Large-scale implementation of community-based mental health care for people with severe and enduring mental ill health in Europe project (RECOVER-E) [36]. The ultimate aim of the RECOVER-E project is to implement and evaluate multidisciplinary CMHTs delivering care in a recovery-oriented way to people with SMI and compare it to the treatment as usual on three levels: 1) service user outcome, 2) performance of team members; and 3) socioeconomic evaluation [36].

The present study aim is two-fold: to explore the extent to which CMHT members perceive they deliver care in a recovery-oriented, strength-based approach, and to evaluate team members’ perceptions on their care roles in the CMHT and their level of confidence with this role.

Methods and design

Study Design

The research presented in this manuscript is part of the RECOVER-E project, a European research project with five randomized trials on the implementation of community-based mental healthcare for people with SMI [36]. In each of the five sites, the study was designed as a clinical and health-economic evaluation on the basis of a hybrid effectiveness-implementation trial, which assesses both implementation outcomes and service user health outcomes. Each of the five hybrid trials is conducted as pragmatic randomised trial in two parallel groups with measurements among service users and healthcare providers (members of the CMHTs within each site).

The presented study focuses on the fidelity of the CMHT (whether the model of community mental healthcare had been adopted as planned) and the experiences of the involved health workers. It reports the findings from a paper-based survey among all team members of the CMHTs in each project site at local start of the study, after having completed a one-week training session on the concept of CMHT and the principles of recovery-oriented care. The local research teams were responsible for distributing the survey to the CMHT members after the training.

Study setting

Community mental health teams were established and implemented in Sofia, Bulgaria; Zagreb, Croatia; Skopje, North Macedonia; Kotor, Montenegro; Siret-Suceava, Romania (Supplementary Material). The full rationale and selection criteria for these sites is described in a prior publication [36].

Participants

This study included all members of the CMHTs in the five sites. Each team consists of at least one nurse, psychiatrist, psychologist, social worker, and a peer worker (person with lived experience of a SMI), all 18 years of age or older who also are members of the CMHT. Peer workers are existing service user with a diagnosis of a SMI at each of the mental health services in the 5 sites. All teams were newly established for the RECOVER-E project, but some team members had collaborated in teams in previous projects. All health professionals and peer workers were required to provide consent to participate in the study. Informed consent was obtained by each health professional and each peer worker verbally.

Sampling and recruitment

Sampling and recruitment were organised by the local research team in each project site individually

Zagreb, Croatia

During a daily meeting at the department of psychiatry at the University Hospital Centre Zagreb (ZUHC) the RECOVER-E project and its goals were presented. Healthcare professionals who were interested in this topic could approach the local principal investigator and decide if they want to participate. All healthcare professionals who accepted to become a part of the CMHT participated in this study, and were employees of the ZUHC. Peer workers were recruited from patients that were treated at the ZUHC due to SMI and were recovered during psychosocial treatment afterwards.

Kotor, Montenegro

In Montenegro CMHT members were employed by the Special Psychiatric Hospital in Kotor. They have been selected by the director of the clinic based on their commitment to work, their previous work results and on their own motivation and interest to work in this kind of programme and their awareness of the need to provide more than just hospital-based services for service users. The directors explained the project and the nature of the study and asked if they want to participate on a voluntary basis. In early October 2018 three peer workers were recruited from a group of locally treated clients at the hospital and the Mental Health Centre in Kotor. Inclusion criteria were a presence of severe mental health disorder, the willingness to participate in working activities of mental health team, and the capacity to offer peer support based on the opinion of the treating psychiatrist. All healthcare proffesionals and peer workers who accepted to become a part of the CMHT participated in this study.

Siret, Romania

In Romania CMHT members were selected out of the people working at the hospital in Siret by the local principle investigator. All team members were willing to spend some of their free time on pioneering a new service in mental health. Moreover, they were the most active during the on-site training provided by the project coordination. The peer workers were selected together by the social worker, psychiatrist and psychologist based on their professional experience. All healthcare professionals and the peer workers who accepted to become a part of the CMHT participated in this study.

Skopje, North Macedonia

All CMHT members were employed at the University Clinic of Psychiatry Skopje and were recruited by the directors of the clinic. They selected the employees based on their willingness and motivation to try something new. The directors explained the project and the nature of the study and asked if they want to participate. The two peer workers, who were recruited, were treated at the clinic due to SMI previously and were recovered during psychosocial treatment. They are not employed at the clinic but were also selected by the directors of the clinic. Everybody took part in the first training that was organized in Skopje. All healthcare professionals and the peer workers who accepted to become a part of the CMHT also decided to participate in this study. Six members went to the second training in the Netherlands and updated the others.

Sofia, Bulgaria

Healthcare providers were recruited by the director of the MHC Shipkovenski. They decided on a voluntary basis if they want to participate in this project. All CMHT members were employed at the MHC “Prof. N. Shipkovenski” a hospital for the district Sofia. The psychiatrists who work at the MHC Shipkovenski and those who collaborate with the centre suggested service user who were interested to fill in the role as peer workers. The director of the MHC Shipkovenski selected ten potential participants which participated in the training in July 2019. Three of them were invited and agreed to participate in the project. All healthcare professionals and the peer workers who accepted to become a part of the CMHT also decided to participate in this study.

Training on recovery-oriented practices

After members of the CMHTs were appointed by each mental health service in the five sites, CMHT members participated in a two-week training programme, with one week of the training carried out in their home country and one week as an intensive site visit and training week in the Netherlands, hosted by GGZ Noord-Holland-Noord. Data was collected after the first training week. In this training, healthcare professionals and peer workers had the chance to improve their understanding of community based mental health approaches, with the aim of being able to implement a cohesive team in their city or district. The training programme for the CMHT were developed by a multidisciplinary Expert Panel (including a peer worker) and reviewed closely by the implementation site coordinators for local relevance and adaptation. The training covered key components of community mental health care, working with a shared caseload, and home treatments. It focused on building the hands-on skills and competencies necessary for delivering high quality community care, as well as working with peer specialists and families. A substantial component of the training (and subsequent mentoring and hands-on coaching) focused on the most difficult change process in building a sustainable CMHT, which is changing the mindset from viewing treatment for people with SMI as custodial (protection from communities/societies, care in institutions and hospitals) and shift to perceiving services as an aid to a meaningful life in the community [37].

Data collection

Data was collected using a paper-based survey administered among CMHT members at the local start of the study during a staff meeting in each site by the local research team after the first week of training in their home country (Table 1). The questionnaire items had been translated prior to the start of the study at each site into the local language by members of the local research team who were fluent in English and in the local language and back translated. It took the team members approximately 15 to 20 min to complete the questionnaire. An informed consent was signed by all selected staff members prior to the start of the study.

Table 1.

Period of data collection and dates of the two training weeks per project site

Zagreb, Croatia Kotor, Montenegro Siret, Romania Skopje, North Macedonia Sofia, Bulgaria
Period of Recruitment May 2018 – September 2018

1. – 15.

October 2018

January 2018 and March 2018 20. – 31. May 2019

April 2019 –

June 2019

Training Week 1 (on-site-training) 24. – 28. September 2018

4. – 8.

November 2018

28. January – 02. February 2019

24. – 28.

June 2019

15. – 19.

July 2019

Data collection February 2019 February 2019 April 2019 June 2019 November 2019
Training Week 2 (Netherlands)

6. – 10.

May 2019

6. – 10.

May 2019

6. – 10.

May 2019

02. – 06. December 2019 02. – 06. December 2019

Measurements

Sociodemographic data questionnaire

The sociodemographic part of the questionnaire included questions such as year of birth, sex, profession, years of professional experience, and place of work.

Recovery Self-Assessment (RSA-Provider Version)

The Recovery Self-Assessment (RSA) is a 32-item measure developed to assess to what degree a program implements recovery-oriented practice [38]. It is a self-reflective tool that is designed to identify efforts made by healthcare agencies to provided recovery-oriented care. Research has shown that the RSA has moderate to strong internal reliability (Cronbach’s α 0.63–0.90) [3841]. Response options include a 5-point Likert scale from 1 (strongly disagree) to 5 (strongly agree) and two additional answering options (Don’t know and Not Applicable) [42]. There are four different versions of the RSA: Person in recovery, Family member/advocate, provider, and CEOs/Directors. In this study the provider version (RSA-P) was used. The measure covers the following five subscales: Life Goals, Involvement, Diversity of Treatment Options, Choice, and Individually Tailored Services. The Life Goal domain refers to the extent to which staff helps with the development and achievement of life goals based on the preferences of the patient. Involvement indicates to what degree healthcare provider and clients perceive that clients are involved in their healthcare and in decision-making. Diversity of Treatment Option Subscale refers to what extend the healthcare organisation provides different treatment options and supports clients to get involved in non-mental health activities. The Choice domain indicates to what degree healthcare provider and clients feel that choices are available to clients and if the choice is respected. The subscale Individually Tailored Services refers to the perception that healthcare services are tailored to individuals’ personal needs, culture and affectations [41]. Higher scores indicate a greater degree of implementation of recovery-oriented practices [38].

Team Member Self-Assessment

The Team member Self-Assessment Tool (TMSA) developed by the Advancing Integrated Mental Health Solutions (AIMS) Centre of the University of Washington, Psychiatry & Behavioural Sciences Division of Population Health and is a part of the Team building and workflow guide [43]. The tool (worksheet) consists of 26-items that allow each member of a care team to think about what collaborative care roles he/she currently practices. The worksheet includes five different care roles: Identify and Engage Patients, Track Treatment Outcome, Initiate, and Provide Treatment, Proactively Adjust Treatment if Patients are not responding, and other tasks Important for our Program. Response options for the first question “Is this your role” include yes or no. Answering option for the second question “Your level of comfort with this task” include high or medium/low.

Data analysis

All questionnaires were included in the analysis. Prior to analysis, all variables were checked for data entry errors and missing values. The two response options (‘Don’t Know’ and ‘Not Applicable’) were set as user missing value when conducting the first analysis since this is a common method for categorial variables with response options like ‘Not Applicable’ or ‘Don’t Know’. Then the standard technique to calculate scale scores for each subscale of the RSA-P was used [44]. This meant that, for each subscale all associate items were summarized and aggregate measures were constructed for further analysis for the whole sample as well as per project site. This method only allows for a few missing values. Thus, items with a high number (n > 6) of ‘Not Applicable’ responses were reviewed and discussed with the local research teams of each site to understand in what way this response option was interpreted by the CMHT members who completed the questionnaire. Most of these items turned out to be relating to services/treatment options which were not offered by the hospitals, the mental health institutes or not within the scope of the RECOVER-E project. Thus, the answering option ‘Not Applicable’ was combined with ‘Strongly Disagree’ in the second and final analysis, as both indicated that those services were not provided. Bivariate linear regression analyses were applied to explore the impact of predictors on the five aggregate measures for the whole sample. Predictors with significant effects were included in multiple regression models, albeit these were considered as highly tentative given the small sample size. The internal consistency of the RSA-P and its five subscales were evaluated using Cronbach’s alpha coefficient.

Descriptive statistics were used to calculate the means and standard deviations for continuous variables and frequencies and percentages for categorical variables for the TMSA tool and demographic data. For interpretation of the findings the cut-off points for the TMSA tool for each profession was 50% indicated that half of the given profession felt like a listed role is their responsibility or that half of them felt confident to fulfil these roles. Two participants indicated ‘other’ as profession and were excluded from the TMSA analysis. Data was analysed with the Statistical Package for Social Science SPSS version 25 [45]. Statistical significance was defined as p < 0.05.

Ethical considerations

Prior to the start of the study in August 2018, ethical approval was obtained from the Medical Ethics Committee of the Heidelberg School of Medicine (S-496/2018), which led the RECOVER-E project work package for research evaluation and is responsible for the overall coordination of the project’s research activities. In addition, each study at each implementation site received ethical approval from the local institutional review board prior to the start of the study. Before consent was given by the participants, a member of the local research team at each project site explained the aims and objectives of the study.

The study was performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments.

Siret, Romania; Sofia, Bulgaria; Zagreb, Croatia

The local research team provided verbal information about the project to participating health professionals and peer workers. Verbal consent was obtained from each health professional and peer worker prior to the start of the study.

Skopje, North Macedonia

Eligible health professionals and peers were informed verbally by the local research team. Health professionals and peers who chose to participate in the CMTH received an informed consent letter and gave their verbal consent to participate, prior to the start of the study.

Kotor, Montenegro

Informed consent of all eligible health professionals and peer workers who decided to take part in this study was obtained in form of a signed informed consent form. The purpose and the aim of the study was explained to them prior to the study verbally.

Results

Description of the sample

All team members from each site filled in the questionnaire (n = 66, 100%). Table 2 presents the descriptive characteristics of the sample categorised by countries. The largest community mental health team was the Croatian team with n = 21 (n = 21, 31.8% of the total sample), the smallest team was the Romanian team with n = 6 (n = 6, 9.1% of the sample) individuals. Of the total study population 65.2% (n = 43, 62.2%) were female. The mean age was 40.02 (SD = 10.96) years. A third of the participating professionals were nurses (n = 21, 31.8%). A vast majority (n = 42, 63.6%) of the healthcare professionals had more than 5 years of experience.

Table 2.

Description of the study population (n = 52 healthcare professionals and n = 14 peer workers) per project site

Project site Zagreb,
Croatia
n = 21
Kotor, Montenegro
n = 15
Siret,
Romania
n = 6
Skopje, North Macedonia
n = 10
Sofia,
Bulgaria
n = 14
Total
N = 66
Sex
 Female 15 (71.4%) 9 (60.0%) 4 (66.7%) 5 (50.0%) 10 (71.4%) 43 (65.2%)
 Male 6 (28.6%) 6 (40.0%) 2 (33.3%) 5 (50.0%) 4 (28,6%) 23 (34.8%)
Age
 Mean (SD) 41.3 (12.56) 38.47 (9.71) 43.67 (6.98) 39.10 (11.22) 38.93 (11.83) 40.02 (10.96)
Profession
 Nurse 9 (42.9%) 5 (33.3%) 2 (33.3%) 2 (20.0%) 3 (21.4%) 21 (31.8%)
 Psychiatrist 4 (19.0%) 4 (26.7%) 1 (16.7%) 2 (20.0%) 2 (14.3%) 13 (19.7%)
 Psychologist 1 (4.8%) 2 (13.3%) 1 (16.7%) 2 (20.0%) 3 (21.4%) 9 (13.6%)
 Social worker 3 (14.3%) 1 (6.7%) 1 (16.7%) 1 (10.0%) 2 (14.3%) 8 (12.1%)
 Peer worker 4 (19.0%) 3 (20.0%) 1 (16.7%) 2 (20.0%) 4 (28.6%) 14 (21.2%)
 Other 0 0 0 1 (10.0%) 0 1 (1.5%)
Professional Experience
 Less than one year 0 2 (13.3%) 1 (16.7%) 1 (10.0%) 4 (28.6%) 8 (12.1%)
 Between one and two years 1 (4.8%) 0 0 1 (10.0%) 3 (21.4%) 5 (7.6%)
 Between two and three years 3 (14.3%) 0 0 0 0 3 (4.5%)
 Between three and four years 2 (9.5%) 0 1 (16.7%) 1 (10.0%) 0 4 (6.1%)
 Between four and five years 1 (4.8%) 0 0 3 (30.0%) 0 4 (6.1%)
 More than five years 14 (66.7%) 13 (86.7%) 4 (66.7%) 4 (40.0%) 7 (50.0%) 42 (63.6%)

*Team size varies due different local human resources

Recovery Self-Assessment Provider Version (RSA-P)

Overall Recovery Self-Assessment Scale

The members of the CMHT in Romania and Bulgaria reported the highest mean scores of the RSA-P subscales, with an overall scale 4.46 (SD 0.327) and 4.46 (SD 0.211), respectively. The team members of the Croatian team reported an overall mean of 4.16 (SD 0.404). The lowest means were indicated by the Macedonian team 4.05 (SD 0.694) and the Montenegrin team 3.58 (SD 0.275). This pattern was similar for the different subscales (Table 3).

Table 3.

Recovery Self-Assessment Scale (Provider Version) per project site

Project sites
 RSA-P subscale, mean score (standard deviation) Zagreb, Croatia
(n = 21)
Kotor, Montenegro (n = 15) Siret, Romania
(n = 9)
Skopje, Macedonia
(n = 10)
Sofia, Bulgaria
(n = 14)
Life Goals 4.1 (0.46) 3.7 (0.33) 4.6 (0.37) 4.0 (0.68) 4.4 (0.28)
Involvement 3.8 (0.57) 2.7 (0.65) 4.6 (0.45) 4.0 (0.88) 4.5 (0.31)
Diversity of treatment option 4.2 (0.54) 3.1 (0.23) 4.6 (0.36) 4.1 (0.75) 4.7 (0.19)
Choice 4.4 (0.43) 4.5 (0.32) 4.5 (0.35) 4.0 (0.72) 4.8 (0.15)
Individually tailored service 4.0 (0.46) 3.4 (0.47) 4.7 (0.37) 4.1 (0.91) 4.6 (0.24)
Total RSA-P 4.2 (0.40) 3.6 (0.28) 4.5 (0.33) 4.1 (0.69) 4.5 (0.21)

* Response options include a 5-point Likert scale from 1 (strongly disagree) to 5 (strongly agree) and two additional answering options (Don’t know and Not Applicable, Higher scores indicate a greater degree of implementation of recovery-oriented practices

Associations between individual characteristics and Recovery Self-Assessment

Profession (p = 0.029, beta coefficient = 0.271) and professional experience (p = 0.008, beta coefficient = − 0.328) were associated with the total RSA-P score. However, only professional experience (p = 0.036, beta coefficient = − 0.268) remained significant in the multiple regression analysis with both predictors. The effect of professional experience on the total RSA-P implied that healthcare providers with fewer years of professional experience (less than 5 years) were more likely to perceive that their healthcare practice operated recovery-oriented compared to team members with more years of professional experience.

RSA-P-Subscales

The amount of professional experience had an impact on the degree to what healthcare provider perceived choices are available to clients and if these choices are respected (p = 0.027, beta coefficient = − 0.286). More specifically, professionals with fewer years of professional experience (less than 5 years) were more likely to perceive that individual choices are available to clients and that these choices are respected than with team members with more years of work experience. Additionally, work experience (p = 0.003, beta coefficient = − 0.357) and profession (p = 0.012, beta coefficient = 0.311) were associated with the extent to which staff helps with the development and achievement of life goals based on the preferences of the patients. In the multiple regression analysis with both predictors, only professional experience remained significant (p = 0.023, beta coefficient = − 0.286,). Thus, CMHT members with more years of professional experience (more than 5 years) perceived that their role was less supportive regarding helping clients with achieving and developing their individual life goals. Healthcare provider with less work experience (less than 5 years) had a higher tendency to perceive that clients are involved in their healthcare and in decision-making compared to their those with more years of experience (p = 0.016, beta coefficient = − 0.311). Professionals with more years of work experience (more than 5 years) felt less like their healthcare organisation provides different treatment options or supports clients to get involved in non-mental health activities (p = 0.017, beta coefficient = − 0.302). The expected effect of professional experience on the subscale Individually Tailored Services was not significant although close (p = 0.051, beta coefficient = − 0.251).

Team Member Self-Assessment

The findings of the TMSA are reported by professions. More than 50% indicate that most members of a profession saw themselves in a certain role and/or felt highly confident in fulfilling these roles. The questionnaire was completed after the healthcare professionals received the first week of training and started to work as CMHTs.

Nurses

A large majority of the nurses (81.0%) saw themselves in the role of identifying and engaging patients. Nevertheless, only a small number (33.3%) stated that they feel highly confident to fulfil the different responsibilities within this role on the CMHT. A third stated that diagnosing behavioural health disorders is their responsibility (33.3%). Over 50% also saw themselves as having a role in tracking treatment outcomes, although only a few felt confident to fulfil this role. A vast majority of nurses saw their role in different responsibilities within this role as well, such as by conducting behavioural health assessments, developing, and updating behavioural health treatment plans, educating service user about symptoms and treatment option, brief counselling, activity scheduling, behavioural activation, facilitating referral to specialty care or social services, and creating and supporting relapse prevention plan. However, only a few felt confident to fulfil these responsibilities. A large majority of nurses also stated that proactively adjust treatment if patients are not responding is their role, however less than a third of them felt confident to fulfil these roles. Although other tasks such as administrative support for program (scheduling, resources) is a role more than 50% of the nurses also saw themselves in, only a few felt confident to fulfil these roles (Tables 4, 5 and 6).

Table 4.

Team Member Self-Assessment tool: Identify and Engage Patients and Track Treatment Outcome

In total n = 65 professionals Nurse
n = 21
Psychiatrist
n = 13
Psychologist
n = 9
Social worker
n = 8
Peer worker
n = 14
Identify and Engage Patients
 Identify People who may need help Is this my rolea 17 (81.0%) 13 (100.0%) 8 (88.9%) 8 (100.0%) 3 (21.4%)
Highly confidentb 7 (33.3%) 13 (100.0%) 8 (88.9%) 6 (75.0%) 2 (14.2%)
 Screen for behavioural health problems using valid measures Is this my rolea 13 (61.9%) 12 (92.3%) 8 (88.9%) 5 (62.5%) 1 (7.1%)
Highly confidentb 5 (23.8%) 11 (84.6%) 6 (66.7%) 2 (25.0%) 1 (7.1%)
 Diagnose behavioural health disorders Is this my rolea 7 (33.3%) 13 (100.0%) 7 (77.7%) 5 (62.5%) 1 (7.1%)
Highly confidentb 5 (23.8%) 12 (92.3%) 6 (66.7%) 1 (12.5%) 0 (0.0%)
 Engage patients in collaborative care program and introduce care team Is this my rolea 17 (81.0%) 13 (100.0%) 7 (77.7%) 8 (100.0%) 11 (78.6%)
Highly confidentb 10 (47.6%) 10 (76.9%) 4 (44.4%) 4 (50.0%) 4 (28.6%)
Track Treatment Outcome
 Track treatment engagement & adherence using registry Is this my rolea 15 (71.4%) 12 (92.3%) 5 (55.6%) 5 (62.5%) 8 (57.1%)
Highly confidentb 3 (14.3%) 9 (69.2%) 1 (11.1%) 2 (25.0%) 1 (7.1%)
 Reach out to patients who are non-adherent or disengaged Is this my rolea 17 (81.0%) 12 (92.3%) 8 (88.9%) 6 (75.0%) 9 (64.3%)
Highly confidentb 6 (28.6%) 8 (61.5%) 3 (33.3%) 2 (25.0%) 1 (7.7%)
 Track patients’ symptoms with measurement tool Is this my rolea 12 (57.1%) 12 (92.3%) 8 (88.9%) 5 (62.5%) 4 (28.6%)
Highly confidentb 5 (28.8%) 9 (69.2%) 5 (55.5%) 3 (37.5%) 0 (0.0%)
 Track medication side effects and concerns Is this my rolea 13 (61.9%) 13 (100.0%) 4 (44.4%) 3 (37.5%) 7 (50.0%)
Highly confidentb 9 (42.9%) 11 (84.6%) 1 (11.1%) 1 (12.5%) 1 (7.1%)
 Track outcome of referrals and other treatments Is this my rolea 15 (71.4%) 13 (100.0%) 7 (77.7%) 8 (100.0%) 8 (57.1%)
Highly confidentb 8 (38.1%) 11 (84.6%) 4 (44.4%) 2 (25.0%) 2 (14.3%)

Absolute Numbers; a Answering categories were: yes; no; b Answering categories were: high; Med/low confident; ‘other n = 1’ was excluded from this analysis

Table 5.

Team Member Self-Assessment tool: Initiate and provide treatment

In total n = 65 professionals Nurse
n = 21
Psychiatrist
n = 13
Psychologist
n = 9
Social worker
n = 8
Peer worker
n = 14
Initiate and provide treatment
 Perform behavioural health assessment Is this my rolea 12 (57.1%) 13 (100.0%) 8 (88.9%) 6 (75.0%) 8 (57.1%)
Highly confidentb 5 (28.8%) 11 (84.6%) 5 (55.6%) 3 (37.5%) 2 (14.3%)
 Develop and update behavioural health treatment plan Is this my rolea 12 (57.1%) 13 (100.0%) 8 (88.9%) 5 (62.5%) 10 (71.4%)
Highly confidentb 3 (14.3%) 11 (84.6%) 3 (33.3%) 2 (25.0%) 2 (14.3%)
 Service user education about symptoms and treatment option Is this my rolea 14 (66.7%) 13 (100.0%) 8 (88.9%) 4 (50.0%) 9 (64.3%)
Highly confidentb 7 (33.3%) 13 (100.0%) 6 (66.7%) 4 (50.0%) 8 (57.1%)
 Prescribe psychotropic medications Is this my rolea 4 (19.0%) 13 (100.0%) 1 (11.1%) 1 (12.5%) 1 (7.1%)
Highly confidentb 1 (4.8%) 13 (100.0%) 1 (11.1%) 0 (0.0%) 0 (0.0%)
 Service user education about medications and side effects Is this my rolea 6 (28.6%) 13 (100.0%) 2 (22.2%) 1 (12.5%) 4 (28.6%)
Highly confidentb 4 (19.0%) 13 (100.0%) 2 (22.2%) 0 (0.0%) 1 (7.1%)
 Brief counselling, activity scheduling, behavioural activation Is this my rolea 13 (61.9%) 13 (100.0%) 9 (100.0%) 7 (87.5%) 8 (57.1%)
Highly confidentb 7 (33.3%) 11 (84.6%) 6 (66.7%) 5 (62.5%) 2 (14.3%)
 Evidence-based psychotherapy Is this my rolea 6 (28.6%) 11 (84.6%) 8 (88.9%) 3 (37.5%) 1 (7.1%)
Highly confidentb 4 (21.1%) 8 (61.5%) 6 (66.7%) 1 (12.5%) 0 (0.0%)
 Identify and treat coexisting medical conditions Is this my rolea 7 (33.3%) 13 (100.0%) 3 (33.3%) 1 (12.5%) 0 (0.0%)
Highly confidentb 4 (21.1%) 11 (84.6%) 3 (3339%) 0 (0.0%) 0 (0.0%)
 Facilitate referral to specialty care or social services Is this my rolea 13 (61.9%) 13 (100.0%) 4 (44.4%) 8 (100.0%) 2 (14.3%)
Highly confidentb 5 (28.8%) 11 (84.6%) 2 (22.2%) 7 (87.5%) 1 (7.1%)
 Create and support relapse prevention plan Is this my rolea 17 (81.0%) 13 (100.0%) 9 (100.0%) 8 (100.0%) 5 (35.7%)
Highly confidentb 8 (38.1%) 13 (100.0%) 6 (66.7%) 5 (62.5%) 1 (7.1%)

Absolute Numbers; a Answering categories were: yes; no; b Answering categories were: high; Med/low confident; ‘other n = 1’ was excluded from this analysis

Table 6.

Team Member Self-Assessment tool: Proactively adjust treatment if patients are not responding and other tasks important for our project

In total n = 65 professionals Nurse
n = 21
Psychiatrist
n = 13
Psychologist
n = 9
Social worker
n = 8
Peer worker
n = 14
Proactively adjust treatment if patients are not responding
 Assess need for changes in treatment Is this my rolea 15 (71.4%) 13 (100.0%) 7 (77.8%) 7 (87.5%) 5 (35.7%)
Highly confidentb 4 (21.1%) 12 (92.3%) 4 (44.4%) 5 (62.5%) 0 (0.0%)
 Facilitate changes in treatment/ treatment plan Is this my rolea 15 (71.4%) 13 (100.0%) 9 (100.0%) 7 (87.5%) 5 (35.7%)
Highly confidentb 5 (28.8%) 10 (76.9%) 4 (44.4%) 4 (50.0%) 0 (0.0%)
 Provide caseload-focused psychiatric consultation Is this my rolea 13 (61.9%) 13 (100.0%) 4 (44.4%) 5 (62.5%) 6 (42.9%)
Highly confidentb 6 (28.6%) 11 (84.6%) 0 (0.0%) 2 (5.0%) 2 (14.3%)
 Provide in-person psychiatric assessment when needed Is this my rolea 12 (57.1%) 13 (100.0%) 4 (44.4%) 1 (12.5%) 1 (7.1%)
Highly confidentb 5 (23.8%) 13 (100.0%) 0 (0.0%) 1 (12.5%) 1 (7.1%)
Other tasks important for this program
 Coordinate communication among team members/ providers Is this my rolea 11 (52.4%) 11 (84.6%) 8 (88.9%) 5 (62.5%) 7 (50.0%)
Highly confidentb 4 (21.1%) 9 (69.2%) 5 (55.6%) 3 (37.5%) 3 (21.4%)
 Administrative support for program (e.g., scheduling, resources) Is this my rolea 15 (71.4%) 11 (84.6%) 6 (66.7%) 7 (87.5%) 7 (50.0%)
Highly confidentb 4 (21.1%) 9 (69.2%) 3 (33.3%) 4 (50.0%) 2 (14.3%)
 Clinical supervision for Program Is this my rolea 10 (47.6%) 12 (92.3%) 5 (55.6%) 4 (50.0%) 7 (50.0%)
Highly confidentb 5 (23.8%) 12 (92.3%) 3 (33.3%) 1 (12.5%) 3 (21.4%)

Absolute Numbers; a Answering categories were: yes; no; b Answering categories were: high; Med/low confident; ‘other n = 1’ was excluded from this analysis

Psychiatrists

Most psychiatrists saw themselves in all listed roles, and also felt confident to fulfil these roles. They particularly identified with the role of tracking treatment outcomes and initiating and providing treatment (Tables 4, 5 and 6).

Psychologists

A vast majority of psychologists identified with all roles listed and felt highly confident to fulfil these roles. Although they felt like they were responsible for some tasks such as prescribing psychotropic medications, service user education about medications and side effects, identifying and treating coexisting medical conditions, and facilitating referral to specialty care or social services of within the role of tracking treatment outcomes, they saw themselves more in the roles of identifying and engaging patients and initiating and providing treatment (Tables 4, 5 and 6).

Social workers

A majority of social workers saw themselves in all roles listed, but did not feel confident to fulfil these roles. All social workers stated that they were responsible for identifying people who may need help, engaging patients and introducing the care team to the patient. Interestingly, all social workers saw themselves in the role of tracking outcome of referrals and other treatments, but only two felt confident to fulfil this role (25.0%). Initiate and provide treatment is a role mainly psychiatrists identified with; however, all social workers stated that they saw themselves in facilitate referral to specialty care or social services and create and support relapse prevention plans, and indicated feeling highly confident to fulfil these tasks (Tables 4, 5 and 6).

Peer workers

Almost all peer workers saw themselves in the role of engaging service users in the care program and introduce care team to the service user (78.6%), only around a third felt confident to fulfil this role (28.6%). Interestingly, more than half of peer workers saw themselves in the role of tracking treatment outcomes, except for tracking patients’ symptoms with measurement tools, although they did not feel confident to fulfil this role. They also stated to be responsible for some tasks within the role of initiating and providing treatment like performing behavioural health assessment, develop and update behavioural health treatment plan, service user education about symptoms and treatment option, and brief counselling, activity scheduling, behavioural activation. However, they only felt confident to fulfil the task of educating patients about symptoms and treatment options. Less than 50% felt responsible for the role of proactively adjusting treatment if patients are not responding. Half of the peer workers identified with the role of fulfilling other tasks important for the program, nevertheless only a few felt confident enough to fulfil this role (Tables 4, 5 and 6).

Discussion

The aim of this study was to explore the extent to which CMHT members perceived that they deliver care in a recovery-oriented, strength-based approach after they received the first week of a two-weeks of training session covering the concept of recovery-oriented practice and started to work as CMHT. We found that all CMHT members in the five sites perceived that they incorporated recovery principles (such as involving service user in the management of their own care, giving them a voice and a choice as well as tailoring the service they provide to the need of the individuals) into their practice to a moderately high degree based on the RSA-P. Specific aspects such as connecting service user with self-help, peer support or advocacy groups and programs, and embedding service user on advisory boards and management meetings showed room for enhanced implementation. Healthcare professionals with less professional experience had the tendency to perceive that their practice implemented recovery-oriented care principles compared to team members with a higher degree of professional experience.

The importance of shifting towards placing the service user at the centre of care and embedding recovery principles into clinical practice has been recognised in international documents such as the WHO Mental Health Action Plan [46]. Globally, mental professional organizations and mental health systems have introduced curricula or training on recovery-oriented care, such as the Substance Abuse and Mental Health Services Administration (SAMHSA) recovery-oriented curricula introduced in 2009 [47]. CMHT members perceived that they already embedded recovery-oriented care principles into their clinical practice; however, CMHT members in this study are a group of highly motivated health care professionals within the mental health workforce in each of the five sites, who are committed to furthering their care delivery strategies and improving client outcomes. They are therefore not represented of the typical mental health workforce, and it is possible that the motivation to provide recovery-oriented care within the teams is higher compared to healthcare providers who have not been selected or are not interested in community care. It is possible that younger generations of health professionals are more motivated to adopt new methods in care delivery and client communication. These findings are consistent with those by Malone et al. [10]. They conducted a systematic review on the effects of CMHT management compared to non-research CMHT management. All healthcare professional working as CMHT included in their review have been selected or linked to the research programme. Hence, it is not clear if the results can be generalised from selected or highly committed professionals to non-selected professionals. The same applies to the findings of this study. The members of each CMHT of this study attended the first week of two-weeks training on the concept of recovery provided by the coordinating project team. This training might have a positive impact on the perceptions of the healthcare provider regarding the degree of recovery-oriented care within their organisation. Prior research shows that new knowledge and skills can enhance motivation and enthusiasm among health care professionals. One prior study found that staff which had been trained in recovery-oriented interventions had higher perceptions of recovery-oriented care compared to nontrained staff [22]. On its own, training cannot sustain motivation and shifts in practices, and other implementation strategies such as mentoring, supervision and feedback [22, 48], and booster training [49] focused on knowledge acquisition and skill-building are important for sustaining practice changes in community mental health care [50].

Related to our second aim to explore how CMHT members perceived their new roles within a CMHT format and as a multidisciplinary team, we found that nurses saw themselves mainly in the role of identifying and engaging patients, tracking treatment outcomes, proactively adjusting treatment if patients are not responding and other tasks important for this project. Nevertheless, compared to the psychiatrists and psychologists, most of the nurses did not feel confident to fulfil specific roles. Psychiatrists, psychologists, and social workers saw themselves in almost all roles listed. In comparison with the psychologists and social workers, psychiatrists felt highly confident to fulfil each role. Peer workers mainly saw themselves in the role of engaging patients and fulfil other tasks important to the project. Nevertheless, they did not feel confident to fulfil specific roles. Interestingly, most peer workers saw themselves in roles included within the domain of track treatment outcomes and initiate and provide treatment. CMHT members of this study, especially nurses and peer workers, are not always aware of their role or responsibilities or do not feel confident to fulfil specific roles. It makes sense that for example nurses do not feel confident doing some of the tasks that a psychiatrist usually does, as it is not necessarily their role in the teams, it may be something that they have not been trained for and/or it is something that they are legally not allowed to. Moreover, it may be due to the specific training/education these professionals acquire through their university career as well as longstanding traditions. In Croatia for example university level education of nurses is very new [51]. Thus, nurses may have not yet acquired their professional identity. This might have an impact on how nurses identified with certain roles and responsibilities. Additionally, peer workers, in general, do not have any specific peer support education to define their professional identity. This findings are consistent with those by Carpenter et al. [52]; in their study they investigated the impact of working in multidisciplinary CMHTs in North England on social workers and health professionals. They particularly examined the relationship between team identification, team functioning, psychological well-being and job satisfaction [52]. Although they found out that there is a moderate to high level of role clarity within the members of CMHTs, various role conflicts were detected [52]. Conflicts included disagreements between professions or discipline, workload, misunderstandings of roles and responsibilities or an increase in paperwork [52]. Carpenter et al. [52] concluded that role clarity promoted job satisfaction and decreases work related stress. In our study role clarity seems to be problematic, thus conflicts and disagreements may be pre-programmed. In addition, psychiatrists, psychologist, and social workers saw themselves in almost all listed roles, regardless of being confident to fulfil those roles, an unclear division of roles impeded effective team collaboration and cooperation. The existing stigmatisation in the society and among healthcare professionals may had an impact on the role of peer workers. The fact that peer workers are more and more involved in providing mental health care requires a huge shift in the way mental health professionals think. Additionally, the level of self-stigmatisation among peers may be very high and influencing these results of this study as well [53, 54].

Another source of role conflict detected by Carpenter et al. [52] was inadequate allocation of resources for people with SMI e.g. access to appropriate service based on individual needs. These findings agree with those by Singh [31], in his study he reported that the rapid reduction of beds for people with SMI had an negative impact on the care provided by CMHTs. Although CMHTs may operate effectively, a majority of patients with SMI need to be admitted to acute hospital care to receive the care they need [31]. Thus, access to an adequate number of acute beds and hospital care is necessary not only for patients with SMI but also for CMHTs to provide effective community-based mental health care and to avoid conflicts.

Implications for practice and policy

  • It takes time to adjust to new roles and responsibilities when working in a new service delivery format, such as a community mental health team. Role clarification and implementation strategies that span beyond training alone are needed to enhance teamwork and role confidence.

  • Moving towards embedding more recovery-oriented principles in clinical practice takes time and practice. Training can help to raise enthusiasm for this process of change, however more practice and time is needed

  • It is meaningful to capture changes in perceptions and experiences in role changes in care teams over time, and tailor implementation strategies and capacity building accordingly.

Strengths and Limitations

This is a descriptive study in five mental health centres in different Eastern and Central Europe countries, hence the generalizability of the findings is uncertain. Moreover, all healthcare providers of all five CMHT volunteered to be part of a mobile team, so their personal commitment and their own motivation might influence the results positively compared to healthcare provider who are not involved in such a project. In addition, results may be driven by particular countries due to the difference in sample size. Due to relatively small sample sizes per country, country-specific analysis cannot be performed. Another limitation is that results are based on quantitative data only which do not really capture the scale of practice-level changes and the nuances entailed in it. Qualitative data, such as interview data, are needed to verify the findings. Data was collected after the health professionals and the peer workers received the first week of two-week training session. One week of training about the recovery approach may be unlikely to be sufficient to establish any real change in knowledge, attitudes, and appropriate actions. However, the findings reported in this manuscript focus only on the first step in the project plan, leading to the project aim. In fact, rather than relying on just one-week of training, the project entails additional ongoing support and supervision from the project partners which long term experience in implementing this model of care [36].

Conclusion

After a one-week training session on community-based practices and collaborative teamwork, health workers had implemented key aspects of recovery-oriented practice, allocated roles and responsibilities. Training on its own can usually not sustain motivation and practice, so a highly motivated team is needed in order to embed newly learned skills into practice which was the case in this study. However, the role of nurses and peer workers needs to specify in more detail to improve their confidence level.

Supplementary Information

Additional file 1. (15KB, docx)

Acknowledgements

We would like to thank all healthcare professionals who participated in this study and contribute to the improvement of mental health care. Moreover, would we like to acknowledges the mandate and funding for this project from the European Union’s Horizon 2020 Research and Innovation Programme and the Global Alliance for Chronic Disease.

Abbreviations

WHO

World Health Organisation

SMI

Severe Mental Illness

CMHT

Community Mental Health Team

RECOVER-E

Large-scale implementation of community-based mental health care for people with severe and enduring mental ill health in Europe

RSA-P

Recovery self-assessment tool Provider Version

TMSA

Team Member Self-Assessment Tool

Authors’ contributions

MW and LSZ conceived this study and elaborated the research protocol. CR conducted data-analysis and wrote the draft-manuscript. MW, BHP and LSZ provided extensive inputs in the draft-manuscript. The remaining authors (MRK, SB, SM, AI, DSG, IP, AT, JD, TD, RIN, TR, AN, SB, MM, VN and RD) translated the source questionnaire into local languages, conducted data-collection, and provided inputs into the manuscript. All authors provided approved the final version of the manuscript.

Authors’ information

Not applicable.

Funding

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under Grant Agreement 779362. Open Access funding enabled and organized by Projekt DEAL.

Availability of data and materials

The dataset generated and analysed during the current study will not be made publicly available due to European Data Protection Law but maybe available by the corresponding author on reasonable request.

Declarations

Ethics approval and consent to participate

Ethics approval was obtained of the Medical Ethics Committee of the Medical Faculty Heidelberg (S-496/2018) prior to the start of the study in August 2018 by the Heidelberg Team. Additionally, each study in each implementation site has received ethical approval from a local institutional review board prior to the start of the study:

Name of the committee for Zagreb, Croatia: Ethics Committee of the University Hospital Centre (UHC) Zagreb; Ethical approval: 18.07.2018, Number: 02/21 AG, Class 8.1–18/149–2.

Name of the committee for Kotor, Montenegro: Ethics Committee of the HI Specialized Psychiatric Hospital Dobrota Kotor, Ethical approval: 28.09.2018, Number 3463/1.

Name of the committee for Suceava, Romania: Ethics Council Chronic Psychiatric Hospital Siret, Ethical approval: 21.11.2018.

Name of the committee for Skopje, North Macedonia: Ethical Committee for Research on Human Subjects, Medical Faculty, SS Cyril and Methodius University Skopje, Skopje, North Macedonia; Ethical approval: 21.05.2018.

Name of the committee for Sofia, Bulgaria: Commission of Ethics at the National Centre of Public Health and Analyses, Sofia, Bulgaria; Ethical approval: 25.01.2019.

The study was performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments.

Written informed consent was obtained from all participants before enrolment.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no conflict of interest.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Wang PS, Aguilar-Gaxiola S, Alonso J, Angermeyer MC, Borges G, Bromet EJ, Bruffaerts R, de Girolamo G, de Graaf R, Gureje O, Haro JM, Karam EG, Kessler RC, Kovess V, Lane MC, Lee S, Levinson D, Ono Y, Petukhova M, Posada-Villa J, Seedat S, Wells JE. Use of mental health services for anxiety, mood, and substance disorders in 17 countries in the WHO world mental health surveys. Lancet. 2007;370(9590):841–850. doi: 10.1016/S0140-6736(07)61414-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Vos T, Barber RM, Bell B, Bertozzi-Villa A, Biryukov S, Bolliger I, Charlson F, Davis A, Degenhardt L, Dicker D, Duan L, Erskine H, Feigin VL, Ferrari AJ, Fitzmaurice C, Fleming T, Graetz N, Guinovart C, Haagsma J, Hansen GM, Hanson SW, Heuton KR, Higashi H, Kassebaum N, Kyu H, Laurie E, Liang X, Lofgren K, Lozano R, MacIntyre MF, Moradi-Lakeh M, Naghavi M, Nguyen G, Odell S, Ortblad K, Roberts DA, Roth GA, Sandar L, Serina PT, Stanaway JD, Steiner C, Thomas B, Vollset SE, Whiteford H, Wolock TM, Ye P, Zhou M, Ãvila MA, Aasvang GM, Abbafati C, Ozgoren AA, Abd-Allah F, Aziz MIA, Abera SF, Aboyans V, Abraham JP, Abraham B, Abubakar I, Abu-Raddad LJ, Abu-Rmeileh NME, Aburto TC, Achoki T, Ackerman IN, Adelekan A, Ademi Z, Adou AK, Adsuar JC, Arnlov J, Agardh EE, al Khabouri MJ, Alam SS, Alasfoor D, Albittar MI, Alegretti MA, Aleman AV, Alemu ZA, Alfonso-Cristancho R, Alhabib S, Ali R, Alla F, Allebeck P, Allen PJ, AlMazroa MAA, Alsharif U, Alvarez E, Alvis-Guzman N, Ameli O, Amini H, Ammar W, Anderson BO, Anderson HR, Antonio CAT, Anwari P, Apfel H, Arsenijevic VSA, Artaman A, Asghar RJ, Assadi R, Atkins LS, Atkinson C, Badawi A, Bahit MC, Bakfalouni T, Balakrishnan K, Balalla S, Banerjee A, Barker-Collo SL, Barquera S, Barregard L, Barrero LH, Basu S, Basu A, Baxter A, Beardsley J, Bedi N, Beghi E, Bekele T, Bell ML, Benjet C, Bennett DA, Bensenor IM, Benzian H, Bernabe E, Beyene TJ, Bhala N, Bhalla A, Bhutta Z, Bienhoff K, Bikbov B, Abdulhak AB, Blore JD, Blyth FM, Bohensky MA, Basara BB, Borges G, Bornstein NM, Bose D, Boufous S, Bourne RR, Boyers LN, Brainin M, Brauer M, Brayne CEG, Brazinova A, Breitborde NJK, Brenner H, Briggs ADM, Brooks PM, Brown J, Brugha TS, Buchbinder R, Buckle GC, Bukhman G, Bulloch AG, Burch M, Burnett R, Cardenas R, Cabral NL, Nonato IRC, Campuzano JC, Carapetis JR, Carpenter DO, Caso V, Castaneda-Orjuela CA, Catala-Lopez F, Chadha VK, Chang JC, Chen H, Chen W, Chiang PP, Chimed-Ochir O, Chowdhury R, Christensen H, Christophi CA, Chugh SS, Cirillo M, Coggeshall M, Cohen A, Colistro V, Colquhoun SM, Contreras AG, Cooper LT, Cooper C, Cooperrider K, Coresh J, Cortinovis M, Criqui MH, Crump JA, Cuevas-Nasu L, Dandona R, Dandona L, Dansereau E, Dantes HG, Dargan PI, Davey G, Davitoiu DV, Dayama A, de la Cruz-Gongora V, de la Vega SF, de Leo D, del Pozo-Cruz B, Dellavalle RP, Deribe K, Derrett S, Des Jarlais DC, Dessalegn M, deVeber GA, Dharmaratne SD, Diaz-Torne C, Ding EL, Dokova K, Dorsey ER, Driscoll TR, Duber H, Durrani AM, Edmond KM, Ellenbogen RG, Endres M, Ermakov SP, Eshrati B, Esteghamati A, Estep K, Fahimi S, Farzadfar F, Fay DFJ, Felson DT, Fereshtehnejad SM, Fernandes JG, Ferri CP, Flaxman A, Foigt N, Foreman KJ, Fowkes FGR, Franklin RC, Furst T, Futran ND, Gabbe BJ, Gankpe FG, Garcia-Guerra FA, Geleijnse JM, Gessner BD, Gibney KB, Gillum RF, Ginawi IA, Giroud M, Giussani G, Goenka S, Goginashvili K, Gona P, de Cosio TG, Gosselin RA, Gotay CC, Goto A, Gouda HN, Guerrant R, Gugnani HC, Gunnell D, Gupta R, Gupta R, Gutierrez RA, Hafezi-Nejad N, Hagan H, Halasa Y, Hamadeh RR, Hamavid H, Hammami M, Hankey GJ, Hao Y, Harb HL, Haro JM, Havmoeller R, Hay RJ, Hay S, Hedayati MT, Pi IBH, Heydarpour P, Hijar M, Hoek HW, Hoffman HJ, Hornberger JC, Hosgood HD, Hossain M, Hotez PJ, Hoy DG, Hsairi M, Hu H, Hu G, Huang JJ, Huang C, Huiart L, Husseini A, Iannarone M, Iburg KM, Innos K, Inoue M, Jacobsen KH, Jassal SK, Jeemon P, Jensen PN, Jha V, Jiang G, Jiang Y, Jonas JB, Joseph J, Juel K, Kan H, Karch A, Karimkhani C, Karthikeyan G, Katz R, Kaul A, Kawakami N, Kazi DS, Kemp AH, Kengne AP, Khader YS, Khalifa SEAH, Khan EA, Khan G, Khang YH, Khonelidze I, Kieling C, Kim D, Kim S, Kimokoti RW, Kinfu Y, Kinge JM, Kissela BM, Kivipelto M, Knibbs L, Knudsen AK, Kokubo Y, Kosen S, Kramer A, Kravchenko M, Krishnamurthi RV, Krishnaswami S, Defo BK, Bicer BK, Kuipers EJ, Kulkarni VS, Kumar K, Kumar GA, Kwan GF, Lai T, Lalloo R, Lam H, Lan Q, Lansingh VC, Larson H, Larsson A, Lawrynowicz AEB, Leasher JL, Lee JT, Leigh J, Leung R, Levi M, Li B, Li Y, Li Y, liang J, Lim S, Lin HH, Lind M, Lindsay MP, Lipshultz SE, Liu S, Lloyd BK, Ohno SL, Logroscino G, Looker KJ, Lopez AD, Lopez-Olmedo N, Lortet-Tieulent J, Lotufo PA, Low N, Lucas RM, Lunevicius R, Lyons RA, Ma J, Ma S, Mackay MT, Majdan M, Malekzadeh R, Mapoma CC, Marcenes W, March LM, Margono C, Marks GB, Marzan MB, Masci JR, Mason-Jones AJ, Matzopoulos RG, Mayosi BM, Mazorodze TT, McGill NW, McGrath JJ, McKee M, McLain A, McMahon BJ, Meaney PA, Mehndiratta MM, Mejia-Rodriguez F, Mekonnen W, Melaku YA, Meltzer M, Memish ZA, Mensah G, Meretoja A, Mhimbira FA, Micha R, Miller TR, Mills EJ, Mitchell PB, Mock CN, Moffitt TE, Ibrahim NM, Mohammad KA, Mokdad AH, Mola GL, Monasta L, Montico M, Montine TJ, Moore AR, Moran AE, Morawska L, Mori R, Moschandreas J, Moturi WN, Moyer M, Mozaffarian D, Mueller UO, Mukaigawara M, Murdoch ME, Murray J, Murthy KS, Naghavi P, Nahas Z, Naheed A, Naidoo KS, Naldi L, Nand D, Nangia V, Narayan KMV, Nash D, Nejjari C, Neupane SP, Newman LM, Newton CR, Ng M, Ngalesoni FN, Nhung NT, Nisar MI, Nolte S, Norheim OF, Norman RE, Norrving B, Nyakarahuka L, Oh IH, Ohkubo T, Omer SB, Opio JN, Ortiz A, Pandian JD, Panelo CIA, Papachristou C, Park EK, Parry CD, Caicedo AJP, Patten SB, Paul VK, Pavlin BI, Pearce N, Pedraza LS, Pellegrini CA, Pereira DM, Perez-Ruiz FP, Perico N, Pervaiz A, Pesudovs K, Peterson CB, Petzold M, Phillips MR, Phillips D, Phillips B, Piel FB, Plass D, Poenaru D, Polanczyk GV, Polinder S, Pope CA, Popova S, Poulton RG, Pourmalek F, Prabhakaran D, Prasad NM, Qato D, Quistberg DA, Rafay A, Rahimi K, Rahimi-Movaghar V, Rahman S, Raju M, Rakovac I, Rana SM, Razavi H, Refaat A, Rehm J, Remuzzi G, Resnikoff S, Ribeiro AL, Riccio PM, Richardson L, Richardus JH, Riederer AM, Robinson M, Roca A, Rodriguez A, Rojas-Rueda D, Ronfani L, Rothenbacher D, Roy N, Ruhago GM, Sabin N, Sacco RL, Ksoreide K, Saha S, Sahathevan R, Sahraian MA, Sampson U, Sanabria JR, Sanchez-Riera L, Santos IS, Satpathy M, Saunders JE, Sawhney M, Saylan MI, Scarborough P, Schoettker B, Schneider IJC, Schwebel DC, Scott JG, Seedat S, Sepanlou SG, Serdar B, Servan-Mori EE, Shackelford K, Shaheen A, Shahraz S, Levy TS, Shangguan S, She J, Sheikhbahaei S, Shepard DS, Shi P, Shibuya K, Shinohara Y, Shiri R, Shishani K, Shiue I, Shrime MG, Sigfusdottir ID, Silberberg DH, Simard EP, Sindi S, Singh JA, Singh L, Skirbekk V, Sliwa K, Soljak M, Soneji S, Soshnikov SS, Speyer P, Sposato LA, Sreeramareddy CT, Stoeckl H, Stathopoulou VK, Steckling N, Stein MB, Stein DJ, Steiner TJ, Stewart A, Stork E, Stovner LJ, Stroumpoulis K, Sturua L, Sunguya BF, Swaroop M, Sykes BL, Tabb KM, Takahashi K, Tan F, Tandon N, Tanne D, Tanner M, Tavakkoli M, Taylor HR, te Ao BJ, Temesgen AM, Have MT, Tenkorang EY, Terkawi AS, Theadom AM, Thomas E, Thorne-Lyman AL, Thrift AG, Tleyjeh IM, Tonelli M, Topouzis F, Towbin JA, Toyoshima H, Traebert J, Tran BX, Trasande L, Trillini M, Truelsen T, Trujillo U, Tsilimbaris M, Tuzcu EM, Ukwaja KN, Undurraga EA, Uzun SB, van Brakel WH, van de Vijver S, Dingenen RV, van Gool CH, Varakin YY, Vasankari TJ, Vavilala MS, Veerman LJ, Velasquez-Melendez G, Venketasubramanian N, Vijayakumar L, Villalpando S, Violante FS, Vlassov VV, Waller S, Wallin MT, Wan X, Wang L, Wang JL, Wang Y, Warouw TS, Weichenthal S, Weiderpass E, Weintraub RG, Werdecker A, Wessells KRR, Westerman R, Wilkinson JD, Williams HC, Williams TN, Woldeyohannes SM, Wolfe CDA, Wong JQ, Wong H, Woolf AD, Wright JL, Wurtz B, Xu G, Yang G, Yano Y, Yenesew MA, Yentur GK, Yip P, Yonemoto N, Yoon SJ, Younis M, Yu C, Kim KY, Zaki MES, Zhang Y, Zhao Z, Zhao Y, Zhu J, Zonies D, Zunt JR, Salomon JA, Murray CJL. Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2015;386(9995):743–800. doi: 10.1016/S0140-6736(15)60692-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Kohn R, Saxena S, Levav I, Saraceno B. The treatment gap in mental health care. Bull World Health Organ. 2004;82(11):858–866. [PMC free article] [PubMed] [Google Scholar]
  • 4.Mitchell AJ, Malone D, Doebbeling CC. Quality of medical care for people with and without comorbid mental illness and substance misuse: systematic review of comparative studies. Br J Psychiatry. 2009;194(6):491–499. doi: 10.1192/bjp.bp.107.045732. [DOI] [PubMed] [Google Scholar]
  • 5.OECD, Union E . Health at a Glance: Europe 2018 State of Health in the EU Cycle: OECD. 2018. [Google Scholar]
  • 6.Gutierrez-Colosia MR, Salvador-Carulla L, Salinas-Perez JA, Garcia-Alonso CR, Cid J, Salazzari D, et al. Standard comparison of local mental health care systems in eight European countries. Epidemiol Psychiatric Sci. 2019;28(2):210–223. doi: 10.1017/S2045796017000415. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Thornicroft G, Chatterji S, Evans-Lacko S, Gruber M, Sampson N, Aguilar-Gaxiola S, al-Hamzawi A, Alonso J, Andrade L, Borges G, Bruffaerts R, Bunting B, de Almeida JMC, Florescu S, de Girolamo G, Gureje O, Haro JM, He Y, Hinkov H, Karam E, Kawakami N, Lee S, Navarro-Mateu F, Piazza M, Posada-Villa J, de Galvis YT, Kessler RC. Undertreatment of people with major depressive disorder in 21 countries. Br J Psychiatry. 2017;210(2):119–124. doi: 10.1192/bjp.bp.116.188078. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Kohrt BA, Asher L, Bhardwaj A, Fazel M, Jordans MJD, Mutamba BB, et al. The Role of Communities in Mental Health Care in Low- and Middle-Income Countries: A Meta-Review of Components and Competencies. Int J Environ Res Public Health. 2018;15(6). [DOI] [PMC free article] [PubMed]
  • 9.Pec O. Mental health reforms in the Czech Republic. BJPsych Int. 2019;16(1):4–6. doi: 10.1192/bji.2017.27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Malone D, Newron-Howes G, Simmonds S, Marriot S, Tyrer P. Community mental health teams (CMHTs) for people with severe mental illnesses and disordered personality. Cochrane Database Syst Rev. 2007;3:CD000270. doi: 10.1002/14651858.CD000270.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Petrea I. Mental Health in Former Soviet Countries:From Past Legacies to Modern Practices. Public Health Rev. 2012;34(2):5. doi: 10.1007/BF03391673. [DOI] [Google Scholar]
  • 12.Priebe S, Matanov A, Demi N, Simic J, Jovanovic S, Gajic M, et al. Community Mental Health Centres Initiated by the South-Eastern Europe Stability Pact: Evaluation in Seven Countries. Community Ment Health J. 2011;48(3):352–362. doi: 10.1007/s10597-011-9417-6. [DOI] [PubMed] [Google Scholar]
  • 13.van Veldhuizen JR. FACT: a Dutch version of ACT. Community Ment Health J. 2007;43(4):421–433. doi: 10.1007/s10597-007-9089-4. [DOI] [PubMed] [Google Scholar]
  • 14.Nugter MA, Engelsbel F, Bähler M, Keet R, van Veldhuizen R. Outcomes of FLEXIBLE Assertive Community Treatment (FACT) Implementation: A Prospective Real Life Study. Community Ment Health J. 2016;52(8):898–907. doi: 10.1007/s10597-015-9831-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Nielsen CM, Hjorthøj C, Killaspy H, Nordentoft M. The effect of flexible assertive community treatment in Denmark: a quasi-experimental controlled study. Lancet Psychiatry. 2021;8(1):27–35. doi: 10.1016/S2215-0366(20)30424-7. [DOI] [PubMed] [Google Scholar]
  • 16.Svensson B, Hansson L, Lexén A. Outcomes of clients in need of intensive team care in Flexible Assertive Community Treatment in Sweden. Nordic J Psychiatry. 2018;72(3):226–231. doi: 10.1080/08039488.2018.1430168. [DOI] [PubMed] [Google Scholar]
  • 17.Lexén A, Svensson B. Mental health professional experiences of the flexible assertive community treatment model: a grounded theory study. J Ment Health. 2016;25(4):379–384. doi: 10.1080/09638237.2016.1207236. [DOI] [PubMed] [Google Scholar]
  • 18.Khoury E. Recovery Attitudes and Recovery Practices Have an Impact on Psychosocial Outreach Interventions in Community Mental Health Care. Front Psychiatry. 2019;10:560. doi: 10.3389/fpsyt.2019.00560. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Davidson L, O'Connell M, Tondora J, Styron T, Kangas K. The Top Ten Concerns About Recovery Encountered in Mental Health System Transformation. Psychiatr Serv. 2006;57(5):640–645. doi: 10.1176/ps.2006.57.5.640. [DOI] [PubMed] [Google Scholar]
  • 20.Boardman J, Shepherd G. RECOVERY: Implementing recovery in mental health services. Int Psychiatry. 2012;9(1):6–8. doi: 10.1192/S1749367600002897. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Osborn LA, Stein CH. Community Mental Health Care Providers' Understanding of Recovery Principles and Accounts of Directiveness with Consumers. Psychiatr Q. 2017;88(4):755–767. doi: 10.1007/s11126-017-9495-x. [DOI] [PubMed] [Google Scholar]
  • 22.Hornik-Lurie T, Shalev A, Haknazar L, Garber Epstein P, Ziedenberg-Rehav L, Moran GS. Implementing recovery-oriented interventions with staff in a psychiatric hospital: A mixed-methods study. J Psychiatr Ment Health Nurs. 2018;25(9–10):569–581. doi: 10.1111/jpm.12502. [DOI] [PubMed] [Google Scholar]
  • 23.Andresen R, Caputi P, Oades L. Stages of recovery instrument: development of a measure of recovery from serious mental illness. Aust N Z J Psychiatry. 2006;40(11–12):972–980. doi: 10.1080/j.1440-1614.2006.01921.x. [DOI] [PubMed] [Google Scholar]
  • 24.Gillard S, Holley J. Peer workers in mental health services: literature overview. Adv Psychiatr Treat. 2018;20(4):286–292. doi: 10.1192/apt.bp.113.011940. [DOI] [Google Scholar]
  • 25.Stratford AC, Halpin M, Phillips K, Skerritt F, Beales A, Cheng V, Hammond M, O’Hagan M, Loreto C, Tiengtom K, Kobe B, Harrington S, Fisher D, Davidson L. The growth of peer support: an international charter. J Ment Health. 2019;28(6):627–632. doi: 10.1080/09638237.2017.1340593. [DOI] [PubMed] [Google Scholar]
  • 26.Chisholm J, Petrakis M. Peer Worker Perspectives on Their Potential Role in the Success of Implementing Recovery-Oriented Practice in a Clinical Mental Health Setting. J Evid Based Soc Work. 2020;17(3):300–316. doi: 10.1080/26408066.2020.1729282. [DOI] [PubMed] [Google Scholar]
  • 27.Barr KR, Townsend ML, Grenyer BFS. Using peer workers with lived experience to support the treatment of borderline personality disorder: a qualitative study of consumer, carer and clinician perspectives. Borderline Personal Disord Emoti Dysregul. 2020;7(1):20. doi: 10.1186/s40479-020-00135-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Leff J, Trieman N. Long-stay patients discharged from psychiatric hospitals: Social and clinical outcomes after five years in the community. the TAPS Project 46. Br J Psychiatry. 2000;176(3):217–223. doi: 10.1192/bjp.176.3.217. [DOI] [PubMed] [Google Scholar]
  • 29.Trieman N, Leff J, Glover G. Outcome of long stay psychiatric patients resettled in the community: prospective cohort study. BMJ. 1999;319(7201):13–16. doi: 10.1136/bmj.319.7201.13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Caldas de Almeida J, Killaspy H. Long Term Mental Health Care for People with Severe Mental Disorders. 2011. [Google Scholar]
  • 31.Singh SP. Running an effective community mental health team. Adv Psychiatr Treat. 2018;6(6):414–422. doi: 10.1192/apt.6.6.414. [DOI] [Google Scholar]
  • 32.Haines A, Perkins E, Evans EA, McCabe R. Multidisciplinary team functioning and decision making within forensic mental health. Ment Health Rev (Brighton) 2018;23(3):185–196. doi: 10.1108/MHRJ-01-2018-0001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Caldas Almeida J, Mateus P, Tomé G, Katschnig H, Hinkov H, Sooniste I. Joint Action on Mental Health and Well-Being, Towards Community-Based and Socially Inclusive Mental Health Care, Situation Analysis and Recommendations for Action. 2016. [Google Scholar]
  • 34.Bond G, Drake R, Mueser K, Latimer E. Assertive Community Treatment for People with Severe Mental Illness. Dis Management Health Outcomes. 2001;9(3):141–159. doi: 10.2165/00115677-200109030-00003. [DOI] [Google Scholar]
  • 35.Simmonds S, Coid J, Joseph P, Marriott S, Tyrer P. Community mental health team management in severe mental illness: a systematic review. Br J Psychiatry. 2001;178(6):497–502. doi: 10.1192/bjp.178.6.497. [DOI] [PubMed] [Google Scholar]
  • 36.Shields-Zeeman L, Petrea I, Smit F, Walters BH, Dedovic J, Kuzman MR, Nakov V, Nica R, Novotni A, Roth C, Tomcuk A, Wijnen BFM, Wensing M. Towards community-based and recovery-oriented care for severe mental disorders in Southern and Eastern Europe: aims and design of a multi-country implementation and evaluation study (RECOVER-E) Int J Ment Heal Syst. 2020;14(1):30. doi: 10.1186/s13033-020-00361-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Keet R, Vetten-Mc Mahon M, Shields-Zeeman L, Ruud T, Weeghel J, Bahler M, et al. Recovery for all in the community; position paper on principles and key elements of community-based mental health care. BMC Psychiatry. 2019;19(1):174. doi: 10.1186/s12888-019-2162-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.O'Connell M, Tondora J, Croog G, Evans A, Davidson L. From rhetoric to routine: assessing perceptions of recovery-oriented practices in a state mental health and addiction system. Psychiatr Rehabil J. 2005;28(4):378–386. doi: 10.2975/28.2005.378.386. [DOI] [PubMed] [Google Scholar]
  • 39.Williams J, Leamy M, Bird V, Harding C, Larsen J, Le Boutillier C, et al. Measures of the recovery orientation of mental health services: Systematic review. Soc Psychiatry Psychiatr Epidemiol. 2012;47(11):1827–1835. doi: 10.1007/s00127-012-0484-y. [DOI] [PubMed] [Google Scholar]
  • 40.Salzer MS, Brusilovskiy E. Advancing Recovery Science: Reliability and Validity Properties of the Recovery Assessment Scale. Psychiatr Serv. 2014;65(4):442–453. doi: 10.1176/appi.ps.201300089. [DOI] [PubMed] [Google Scholar]
  • 41.Konkoly Thege B, Ham E, Ball LC. A Factor Analytic Investigation of the Person-in-Recovery and Provider Versions of the Revised Recovery Self-Assessment (RSA-R) Eval Health Prof. 2017;40(4):505–516. doi: 10.1177/0163278716674247. [DOI] [PubMed] [Google Scholar]
  • 42.Piat M, Boyer R, Fleury M-J, Lesage A, O'Connell M, Sabetti J. Resident and proprietor perspectives on a recovery orientation in community-based housing. Psychiatric Rehabil J. 2015;38(1):88–95. doi: 10.1037/prj0000104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Team building and workflow guide: University of Washington – AIMS Center 2019 [cited 2020 21. January ]. Available from: https://aims.uw.edu/resource-library/team-building-and-workflow-guide.
  • 44.O'Connell M. Recovery Self-Assessment (RAS): Scoring instructions and factors. 2019. [Google Scholar]
  • 45.Wagner WE., III . Using IBM® SPSS® statistics for research methods and social science statistics: Sage Publications. 2019. [Google Scholar]
  • 46.Saxena S, Funk M, Chisholm D. World Health Assembly adopts Comprehensive Mental Health Action Plan 2013-2020. Lancet. 2013;381(9882):1970–1971. doi: 10.1016/S0140-6736(13)61139-3. [DOI] [PubMed] [Google Scholar]
  • 47.Sowers W, Primm A, Cohen D, Pettis J, Thompson K. Transforming Psychiatry: A Curriculum on Recovery-Oriented Care. Acad Psychiatry. 2016;40(3):461–467. doi: 10.1007/s40596-015-0445-3. [DOI] [PubMed] [Google Scholar]
  • 48.Lodge AC, Kaufman L, Stevens MS. Barriers to Implementing Person-Centered Recovery Planning in Public Mental Health Organizations in Texas: Results from Nine Focus Groups. Admin Pol Ment Health. 2017;44(3):413–429. doi: 10.1007/s10488-016-0732-7. [DOI] [PubMed] [Google Scholar]
  • 49.Fu SS, Roth C, Battaglia CT, Nelson DB, Farmer MM, Do T, Goldstein MG, Widome R, Hagedorn H, Zillich AJ. Training primary care clinicians in motivational interviewing: a comparison of two models. Patient Educ Couns. 2015;98(1):61–68. doi: 10.1016/j.pec.2014.10.007. [DOI] [PubMed] [Google Scholar]
  • 50.Murray LK, Dorsey S, Bolton P, Jordans MJ, Rahman A, Bass J, et al. Building capacity in mental health interventions in low resource countries: an apprenticeship model for training local providers. Int J Ment Heal Syst. 2011;5(1):30. doi: 10.1186/1752-4458-5-30. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Kalauz S, Orlic-Sumić M, Simunec D. Nursing in Croatia: past, present, and future. Croat Med J. 2008;49(3):298–306. doi: 10.3325/cmj.2008.3.298. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Carpenter J. Working in Multidisciplinary Community Mental Health Teams: The Impact on Social Workers and Health Professionals of Integrated Mental Health Care. Br J Soc Work. 2003;33(8):1081–1103. doi: 10.1093/bjsw/33.8.1081. [DOI] [Google Scholar]
  • 53.Vandewalle J, Debyser B, Beeckman D, Vandecasteele T, Van Hecke A, Verhaeghe S. Peer workers’ perceptions and experiences of barriers to implementation of peer worker roles in mental health services: A literature review. Int J Nurs Stud. 2016;60:234–250. doi: 10.1016/j.ijnurstu.2016.04.018. [DOI] [PubMed] [Google Scholar]
  • 54.England HE. Stepping forward to 2020/21: The mental health workforce plan for England. 2017. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Additional file 1. (15KB, docx)

Data Availability Statement

The dataset generated and analysed during the current study will not be made publicly available due to European Data Protection Law but maybe available by the corresponding author on reasonable request.


Articles from BMC Psychiatry are provided here courtesy of BMC

RESOURCES