Skip to main content
BMC Psychiatry logoLink to BMC Psychiatry
. 2014 Nov 18;14:307. doi: 10.1186/s12888-014-0307-7

Protocol for the effect evaluation of Individual Placement and Support (IPS): a randomized controlled multicenter trial of IPS versus treatment as usual for patients with moderate to severe mental illness in Norway

Vigdis Sveinsdottir 1,, Camilla Løvvik 1,4, Tonje Fyhn 1, Karin Monstad 2, Kari Ludvigsen 2, Simon Øverland 3,4, Silje Endresen Reme 1
PMCID: PMC4244061  PMID: 25403470

Abstract

Background

Roughly one third of disability pensions in Norway are issued for mental and behavioral disorders, and vocational rehabilitation offered to this group has traditionally been dominated by train-and-place approaches with assisted or sheltered employment. Based on a more innovative place-and-train approach, Individual Placement and Support (IPS) involves supported employment in real-life competitive work settings, and has shown great promise for patients with severe mental illness.

Methods/design

The study is a multicenter Randomized Controlled Trial (RCT) of IPS in a Norwegian context, involving an effect evaluation, a process evaluation, and a cost/benefit analysis. IPS will be compared to high quality treatment as usual (TAU), with labor market participation and educational activity at 12 months post inclusion as the primary outcome. The primary outcome will be measured using register data, and the project will also include complete follow-up up to 4 years after inclusion for long-term outcome data. Secondary outcomes include mental health status, disability and quality of life, collected through survey questionnaires at baseline, and after 6 and 12 months. Participants will include patients undergoing treatment for moderate to severe mental illness who are either unemployed or on sickness or social benefits. The estimated total sample size of 400–500 will be randomly assigned to the interventions. To be eligible, participants must have an expressed desire to work, and sufficient Norwegian reading and writing skills to fill out the questionnaires.

Discussion

The Effect Evaluation of Individual Placement and Support (IPS) will be one of the largest randomized controlled trials to date investigating the effectiveness of IPS on competitive employment, and the first study to evaluate the effectiveness of IPS for patients with moderate to severe mental illness within a Norwegian context.

Trial registration

Clinicaltrials.gov: NCT01964092. Registered October 16th, 2013.

Keywords: Disability, Individual placement and support, IPS, Mental health, Quality of life, Randomized controlled trial, Vocational rehabilitation, Return to work, Labor market participation, Supported employment

Background

Roughly one third of disability pensions in Norway are issued for mental and behavioral disorders [1]. The proportion is even higher among those awarded disability pension before the age of 40, where such disorders account for 58% of all awards [1]. While approximately 65% of people with severe mental illness want to work, only 15% are employed, suggesting a large gap of unmet needs [2]. There are several economic, social, and moral arguments for facilitating work participation and preventing exclusion from working life among people suffering from mental illness, and there is strong evidence suggesting that work can have beneficial effects on physical and mental health [3,4]. Concerns that competitive employment could be harmful for patients with severe mental illness are widespread, but emerging evidence has shown that work participation improves both clinical and social functioning, finances, self-esteem, and psychiatric symptoms for these patients [58]. These observations can be understood through different models. While a social selection hypothesis states that good health is a condition for employment, evidence shows stronger support for a social causation hypothesis where employment leads to improved health [4]. Job loss and unemployment is strongly associated with mental illness, while re-employment has been shown to reverse the negative effects of unemployment on mental health [4,9,10]. The relationship between employment and health may be partly explained by mechanisms of health behaviors such as alcohol and substance abuse, diet, physical activity, and smoking [1113]. A Norwegian study of alcohol disorders and re-employment suggested that although some selection to unemployment does occur, the high prevalence of harmful drinking among the unemployed is mainly a result of the unemployment rather than vice versa, and that reducing unemployment could reduce alcohol problems in Norway [14].

The Norwegian welfare system provides financial aid and security for individuals unable to work. It is however important to optimize the services provided to help people to remain in working life despite episodes of health problems or periodical troubles with functioning at work.

Vocational rehabilitation and training approaches generally fall within two traditions, train and place or place and train. In the former approach, the client undergoes targeted training in an adapted or sheltered environment to acquire necessary skills, before attempting to enter competitive employment in an arena relevant to the training. At present, this tradition dominates vocational rehabilitation in Norway, with programs such as Work with assistance (AB) and Traineeship in a sheltered business (APS).

In contrast, the place and train principle represents a novel approach where the primary goal is direct employment in real-life settings, without any preceding training. Individual Placement and Support (IPS) is a prime example of a model within this tradition, where the goal is to provide professional services to help people with disabilities participate in the competitive labor market [15]. The intervention is manualized, and integrates supported employment as a component of psychological treatment rather than a separate service. It focuses on the clients’ preferences, with the philosophy that anyone who wants to work can find a regular job in the community, and that no one should be deprived of that opportunity [1620]. A further characteristic of the IPS model is that clients are not screened for work readiness, but rather on expressed desire to work. It does not involve intermediate work experiences, transitional employment or sheltered workshops, but actively facilitates job acquisition and provides ongoing support once the client is employed. The model has got strong empirical support in the American context, with positive results in terms of both vocational and non-vocational outcomes for people with severe mental illness [2129], especially for young adults [30]. There is also favorable evidence for IPS from studies conducted in European countries, but these have generally not reached as strong results as the studies from the US [3133]. The IPS transportability outside the US thus remains unanswered [33]. As of yet, no studies have evaluated the effectiveness of IPS in Norway. The Norwegian context is characterized by high job security, low unemployment, and a generous welfare system, which stands out from most other contexts where IPS has been evaluated [34]. Furthermore, previous studies have all included people with severe mental illness, with no attempts to expand the target group to involve people with moderate mental illness as well.

Methods/design

Aims and objectives

The main aim of the study is to evaluate the effect of IPS compared to high quality TAU offered to people with moderate to severe mental illness in six IPS centers located in different Norwegian counties. We aim to address the following questions:

  • Is IPS more effective than high quality TAU in terms of increasing labor market participation?

  • Is IPS more effective than TAU in terms of improving mental health status and quality of life?

  • Are there specific Norwegian policy factors that will influence the effectiveness of IPS?

  • What are the challenges of implementing and disseminating IPS in a Norwegian context?

  • Is IPS cost-effective compared to TAU?

Outcome measures

The primary outcome of the study is increased labor market participation in ordinary paid employment or education. Employment and enrollment in education will be identified using register information, and will be analyzed separately, but also combined as a general indicator of increased activity on the pathways to work. Labor market participation will be operationalized by combining a) being registered in the Norwegian Labor and Welfare Administrations (NAV) State Register of Employers and Employees, and b) not receiving unemployment or sickness benefits, c) not receiving work assessment allowance or disability pension with a higher degree of disability than at study inclusion, and d) a registered annual income. This will align with the previous IPS literature, where competitive employment is defined as “permanent jobs paying commensurate wages in integrated community settings (i.e., employing nondisabled workers) and available to anyone (not just individuals with disabilities)” [33]. Educational activity will be operationalized as started or completed education as registered in the Education Statistics by Statistics Norway (SSB). To ensure comparability of results with previous IPS-studies [35], we will collect survey information to supplement the register data regarding measures of job acquisition (e.g. time from study entry to first job start), duration (e.g. cumulative numbers of weeks worked in all jobs), intensity (e.g. percentage working at least 20 hours a week), and productivity (e.g. total hours worked/wages).

The secondary outcomes, mental health status, disability and quality of life, will also be measured through survey questionnaires, in addition to questions on background and health-related variables:

  • Mental Health Status will be measured using the 14-item Hospital Anxiety and Depression Scale (HADS), consisting of 2 subscales: anxiety (7 items) and depression (7 items) [36], and the 35-item Beliefs About Voices Questionnaire-Revised (BAVQ-R), consisting of 5 subscales: malevolence (6 items), benevolence (6 items), omnipotence (6 items), resistance (9 items), and engagement (8 items) [37].

  • Disability will be measured using the 12-item version of the WHO Disability Assessment Schedule 2.0 (WHODAS 2.0), consisting of 6 different functioning domains: cognition (2 items), mobility (2 items), self-care (2 items), getting along (2 items), life activities (2 items), and participation (2 items) [38].

  • Health-related quality of life will be measured using the health index from the EuroQol questionnaire (EQ-5D) [39].

  • Alcohol abuse will be measured using the 3-item Alcohol Use Disorders Identification Test (AUDIT-C), screening test for heavy drinking and/or active alcohol abuse or dependence [40].

  • Drug abuse will be measured using the Drug Use Disorders Identification Test (DUDIT), screening for drug use, drug-related problems, and/or drug dependence [41].

  • Subjective Health Complaints will be measured by the 29-item Subjective Health Complaints Inventory (SHC), consisting of 5 subscales: musculoskeletal pain (8 items), pseudoneurology (7 items), gastrointestinal problems (7 items), allergy (5 items), and flu (2 items) [42].

  • Social support will be measured using a revised 11-item version of the Social Support Inventory [43,44] using 2 subscales as suggested by Øyeflaten et al. [45]: directive social support (4 items) and nondirective social support (7 items).

  • Fatigue will be measured by the 11-item Chalder Fatigue Questionnaire (CFQ) consisting of 2 subscales: physical fatigue (7 items) and mental fatigue (4 items) [46].

The questionnaire package was developed in collaboration with a client representative who provided input on the length, design and formulation of the information and questionnaires.

Data collection

Survey data will be collected from both groups at baseline, 6 and 12 month follow-up. Baseline questionnaires will be administered and collected at the IPS centers by the person conducting the recruitment interviews. Data will be collected using iPads with secure survey software (Qualtrics®), but paper questionnaires will also be available. Electronic data will be collected in offline mode, before being connected to the Internet at the IPS center and sent to a secure online database. Paper questionnaires will be temporarily stored at the IPS center and forwarded to Uni Research Health every three months. Follow-up questionnaires will be administered electronically to participants who provide their e-mail address at baseline, or on paper via regular mail if this is preferred.

Using data from the national social insurance register and the national employee-register in Norway allows for complete and objective data to be collected every month for every participant, with no loss to follow-up. Data will be collected retrospectively 3 years before baseline, and prospectively 4 years after baseline [47]. This information will be collected for each month of follow-up, to examine sensitivity of the primary 12-months results. Additionally, the long follow-up ensures comparison with a recent Swedish IPS study, where effectiveness was first seen at 18 months [32].

Study design

The project is designed as a randomized controlled trial (RCT) using mixed methods, and includes: 1) an effect evaluation, 2) a process evaluation, and 3) a cost/benefit-analysis.

The effect evaluation is the main focus of the project, accompanied by a cost/benefit analysis to provide an economic assessment of the effect. However, in order to explore different stakeholders’ experiences and various facilitating factors and barriers in the implementation of the project, there is also a need for a process evaluation involving both qualitative and quantitative data.

Effect evaluation

The effect evaluation is conducted as a RCT, which is the gold standard for clinical trials and ideal for achieving our aim of comparing the effect of different interventions to increase labor market participation.

Interventions

Participants will be randomly allocated to one of two groups, receiving different active interventions that aim to increase labor market participation and prevent withdrawal from the labor market. One group will receive Individual Placement and support (IPS) at their local IPS center, focusing on employment in the competitive labor market. IPS is a structured approach based on eight principles; competitive employment, eligibility based on client choice, integration of rehabilitation and mental health services, attention to client preferences, personalized benefits counseling, rapid job search (starting within one month), systematic job development, and time-unlimited and individualized support [19]. A pure control group with no intervention was considered to be neither feasible nor legally or ethically acceptable in this study. The other group will therefore be referred from the IPS center to NAV to receive a high quality version of treatment as usual (TAU). This involves being offered a prioritized spot in a vocational rehabilitation scheme, primarily Work with assistance (AB) and/or Traineeship in a sheltered business (APS). AB involves assistance by a personal facilitator, and includes finding suitable work, negotiating wage and employment conditions, modified duties, and follow-up at the work place. APS involves testing of work capability within a sheltered environment doing tasks that are modified to individual skills and challenges, with follow-up as necessary by an advisor. Participants in this group may also be offered additional interventions based on the individual needs, as they normally would in TAU.

Participants and recruitment

Eligible participants are patients currently undergoing treatment for moderate to severe mental illness, who are currently out of the labor market but have an expressed desire to work. They could be either unemployed, on sick leave benefits, or on other social benefits at the time of inclusion. Participants will primarily be recruited from the various District Psychiatric Centers (DPS), which are placed in secondary care, but could also be recruited from stepped-care initiatives located in primary care. All participants are or will be connected to a treatment-team linked to a job specialist (caseworker trained in IPS). We aim to recruit 200–250 participants in each group, with a total sample size of 400–500.

Sample size calculation

Our estimates of sample size are based on international input-data from previous IPS-studies. As a general comparison, the typical sample size in the previous IPS studies range from 41 to 312 participants [33]. The studies from countries most similar to the Norwegian context include Australia (n = 41), England (n = 188), the Netherlands (n = 151), and Sweden (n = 120) [32,33]. For the non-US studies, the mean competitive employment rate was 50% for IPS and 20% for controls [33]. The study showing the lowest effect of IPS to this date came from England, with competitive employment rates of 22% for IPS and 11% for controls [48].

If we use 50% and 20% as possible rates, we will need 39 participants in each group in order to demonstrate a statistically significant difference (with a 5% significance level and power of 80%), and in a potential scenario with rates of 22% and 11%, we will need 178 participants in each group (Figure 1).

Figure 1.

Figure 1

Sample size calculation with possible rates.

There is, however, reason to believe that the target group in the current project is more heterogeneous than in the international studies, involving people with both moderate and severe mental illness. Furthermore, we anticipate that the high quality treatment as usual will result in higher competitive employment rates in the control group than in the international studies, particularly compared to US studies. We therefore aim to recruit between 400 and 500 participants.

Secondary outcomes are measured with questionnaire data, and we expect an approximate response rate of no more than 60%. This may have consequences for the conclusions drawn from secondary outcome data. However, compared to a previous IPS study [22] that found a significant effect on quality of life (mean 5.4, SD = 1.9 vs 4.8, SD = 1.7), the same difference could be detected with 142 participants in each group with a power of 80%, which in this project should be feasible even with a response rate of 60%. The analyses of the secondary outcomes will be performed with inverse probability weights to account for possible attrition bias [49].

Sufficient inclusion and response rates are crucial for enabling robust main analyses and for the possibilities to document effects of IPS with statistical certainty, as well as for allowing additional subgroup analyses. Rates lower than the estimated total sample size of 400–500 will reduce the chance of detecting smaller effects that may be important on a larger scale, and will limit the possibilities to further investigate which groups may benefit most from the intervention.

Subgroups

Any significant main effects between the IPS intervention and control intervention group may allow for subgroup analyses. Regression analyses stratified on intervention group will additionally be conducted in order to study variables or sub-groups showing a stronger or weaker effect. The following a priori defined subgroups will be investigated: diagnostic groups (moderate vs. severe mental illness), work status at baseline (unemployed vs. disability benefits), and previous work history (previously employed vs. never been employed).

Inclusion and exclusion

Inclusion criteria involved not working (unemployed, on sick leave, or on social benefits), undergoing treatment for moderate to severe mental illness, having an expressed desire to work, and sufficient Norwegian reading and writing skills to be able to fill out the questionnaires.

Randomization

Upon receiving new eligible participants, trained and competent personnel at the IPS centers will perform an introductory interview with the participant, informing about the study, and asking the individual to fill out an informed consent form in order to be included in the study and receive an ID-number. When the participant has filled out the baseline-questionnaires, the person conducting the introductory interview contacts the research technician at Uni Research Health by email, stating the participants ID-number, gender, and year of birth. Using computer-generated randomization lists, the participant will be allocated to one of the two groups. A 2:1 randomization ratio will be applied the first months of recruitment to ensure that the IPS centers can run according to capacity. The randomization procedure will however strictly adhere to the formal requirements of adequate randomization at all times.

Statistical analyses

The analyses will follow the “intention to treat” principle. We will apply administrative register data from NAV and SSB in order to evaluate the primary outcome of the project; labor market participation in ordinary paid employment and educational activity. Beyond giving consent at inclusion, this part of the effect evaluation is not dependent upon participants’ willingness to respond to surveys, as register data on employment, education and use of social security benefits will be complete for all participants. Consequently, common problems related to self-report such as recall bias, justification bias, and attrition will be avoided for our primary outcomes. Randomization helps to assure that there are no systematic differences between the IPS intervention and control intervention groups at baseline, in terms of both observable and unobservable characteristics. The design allows for a comparison of proportions employed in each group over time before and after inclusion, including a test of whether differences are statistically significant. Additionally, we will perform regression analysis using logistic regression models in order to a) control for any remaining variation in observable characteristics between groups, b) investigate which factors, other than IPS intervention, have an impact on labor market participation, and c) analyze heterogeneity in the response to IPS. Groups will be compared on secondary outcome measures using survey data at baseline, and after 6 and 12 months.

Process evaluation

The purpose of the process evaluation is to investigate the quality and accuracy of the implementation of the IPS intervention. Furthermore, the results of a process evaluation may provide indications for weaknesses either in the implementation of the program, or theoretical weaknesses, in case of unexpected findings in the effect evaluation. Investigating the implementation of key components of the intervention will provide context for the interpretation of main results, as well as highlight any need for improvements in future intervention design, methods, and the implementation process of the intervention. Together, the results of process investigation will help to determine the feasibility of the intervention.

Following the framework of Steckler & Linnan [50], supplemented by the broader process evaluation literature of Baranowski & Stables [51] and Green & Glasgow [52], the process evaluation will report on the following:

  • Reach, referring to the participation rate of the target group and the representativeness of these [52], which affects the external validity of the study.

  • Dose delivered, which refers to the amount of the intended intervention that is actually offered to the participants [50].

  • Dose received may refer to the applicant’s use of teaching material, conducting home assignments or attending meetings [50].

  • Fidelity refers to the providers’ compliance with the IPS protocol, which is a standardized measurement [53]. The fidelity ratings are conducted regularly throughout the project period.

  • Satisfaction refers to the participants’ overall satisfaction with the program.

  • Perceived effectiveness is the participants’ perception of the usefulness of IPS in obtaining employment.

  • Facilitators and barriers will shed light on methodological or practical issues as well as factors in the local context that helps or hinders the implementation of the intervention.

The process evaluation will take place alongside the project implementation, and data will be collected throughout the project period in order to monitor how the intervention is established and adapted over time.

Quantitative material

The process evaluation includes collecting quantitative data that can describe how the different elements of the intervention were implemented. This information will be important in order to identify possible methodological challenges at the individual IPS centers, as expressed by the measures in the above framework: Reach, dose delivered and received, and fidelity. To explore local barriers towards successful implementation, we will also measure employers’ attitudes to hiring people who are at risk of being excluded from work life, as well as review characteristics of the local labor market.

  1. Questionnaire items at 6-month follow-up: 68 items will be included in the questionnaire at 6 months, measuring dose received, satisfaction, perceived efficacy, and perceived barriers and facilitators. The items are constructed based on process evaluation theory and adapted to the conditions of the current intervention.

  2. Other data sources: To determine the dose given, data will be collected from the job specialists’ register for each participant. To determine reach, the job specialists’ register of people who declined or accepted participation will be used. Publicly available statistical data will be used to examine the representativeness of the reached group in relation to the target group at large, using the variables age and gender.

  3. Fidelity measurements: The IPS fidelity scale is an established measurement [53], and the ratings will be carried out by a partly independent team that is trained, certified, and experienced in making such measurements. The measurements will be performed regularly throughout the project period. The fidelity ratings will evaluate the competence and methodology in conducting the intervention, as well as provide information on the frequency of contact and interaction with the participants. The qualitative interviews included in the fidelity measurements will provide a greater understanding and description of how the criteria have been attained, or why they may not have been attained. Although the process evaluation largely focuses on the IPS intervention group, qualitative interviews will also be conducted with participants in the control intervention group to get an idea of what control measures the ordinary follow-up has consisted of.

  4. Questionnaire for employers: The quality of the relationship between employer and employee can play an important role for commitment to the work place, job performance, and job satisfaction [54,55]. In order to examine attitudes towards hiring employees with various physical or mental illnesses and/or other limitations, researchers in the project group have developed a questionnaire that will be distributed to employers. In addition to providing a general overview of attitudes towards groups at risk of discrimination, we may also examine if any changes in attitudes occur after hiring employees with various challenges.

  5. Local labor market: The local labor market is likely to vary between the centers’ catchment areas, and availability of work can influence on the outcomes. Characteristics of the local labor market will therefore be controlled for, mainly by using county indicators such as structure and size of trade and industry, travel distances, unemployment rate according to gender and age group, and unemployment rate to vacant positions ratio.

Qualitative material

Firstly, the qualitative analysis will be based upon the key documents that form the basis for the planning, establishment, and running of IPS. This includes public policy documents, formal agreements, plans for the IPS centers, and reports from the organization. The document analysis will be an important part of the initial phase of the project, in order to establish an overview of the formal organization, background, and adaptation of the IPS-intervention. Reports will be collected and analyzed towards the end of the project period, to retain additional information of adaptations and alterations.

Secondly, semi-structured interviews with key informant groups will be conducted. Through the interviews, we will elaborate on the experiences of key persons and their views on barriers and facilitators in carrying out the implementation. Interviews with the various stakeholders will also help to identify the extent of cross-sectorial collaboration between NAV, specialist- and primary care, and its development throughout the project period. The following interviews will be conducted:

  1. Phone interview with key informants in NAV and the health services, regarding planning, management, and operation of IPS at central and county levels. This will be carried out in the first phase of the project, in order to get a broader idea of the background and foundation of the intervention and the main features at the initial phase. Scope: 5–8 informants. Time: Fall 2014.

  2. Focus groups consisting of staff and management from all IPS centers. We choose to utilize focus group interviews as a method, as they provide an efficient collection of qualitative data [56]. The strength of focus group approach is also that the form allows for the exchange of experiences in dialogue with others. Time: Fall 2014.

  3. Follow-up phone-interviews with the management of the IPS centers. The aim is to obtain information about local adaptations and adjustments, as well as specific challenges and barriers that have arisen in the IPS centers during the implementation. Scope: 3 informants. Time: Spring 2015.

  4. Phone interview with collaborators in NAV and DPS. This will help to identify how intersectoral collaboration has worked, and barriers and facilitators in this area. We will go in depth on cooperative relations between 2–3 selected IPS centers with different target groups of participants. Scope: 10–15 informants. Time: Spring 2015.

  5. In-depth interviews with participants. The qualitative material will include in-depth interviews with participants, in order to explore their experiences more elaborately. We will perform a purposeful sampling based on relevant characteristics of the target group combined with the responses to the questionnaires. The method of purposeful sampling is chosen in order to get insight into the heterogeneity rather than the frequency of perceived barriers. In-depth interviews will be conducted with participants giving positive versus negative evaluations in the questionnaire. Scope: 12 to 15 informants. Time: Fall 2014.

The 6-month follow-up questionnaires sent to the IPS intervention group will also include a separate set of open-ended questions about the experiences of the intervention, such as accessibility, coordination, and attitudes of service providers, which will be analyzed as part of the qualitative process evaluation.

Cost/benefit analysis

The third component of the project is an economic assessment of effect as compared to the resources spent on the intervention. IPS is offered in the public sector and financed by community resources, and a standard approach for assessing the profitability of public projects will be used [57].

The cost-benefit analysis will be based on the effect that the intervention has on labor market participation, and the effect that the intervention has on mental health/disability. In the first case, we calculate the economic benefit (measured in Norwegian Kroner, NOK) as a result of the employment effect of the intervention. The calculation compares income and costs of the IPS intervention with income and costs of the control intervention (TAU with AB or APS). In the second case, where the outcome goal represents health benefits as measured by functional improvement or improved quality of life, the costs of the intervention is seen in terms of health gains achieved. Effect may be compared to costs related to different interventions with the same purpose, in order to analyze which intervention provides the greatest health benefit per NOK. Using standardized conversion tools it is also possible to convert health benefits of the interventions to an index of health-related quality of life. This type of analysis also allows for a comparison of gain in quality of life across the different interventions.

The project aims to identify the economic cost and benefit of IPS, in addition to monitoring cost and benefit related to the TAU for the participants in the control intervention group, primarily AB and APS. Both in IPS and AB/APS, income constitutes the present value of the future production gains due to the participants being employed rather than receiving social security benefits. This must be seen in relation to the cost of the respective interventions. We will use a societal perspective, taking into account that the measures affect government budgets, and tax financing influences the adaptation of private actors. We will also take into account that the participants in the IPS intervention group may differ in probability of seeking out specialist in psychiatry in the follow-up period compared to the control intervention group, and we will estimate the costs of such treatment. An observation window of 18 months after inclusion will be used as a basis to assess the extent of treatment/follow-up in the two groups.

The main source of information is register data from NAV and the Norwegian Patient Register. Estimates for the costs associated with different types of treatment must then be calculated based on information about what different types of treatment/services cost, such as appointments with psychiatric specialists or hospitalization days at a psychiatric institution. This must be based both on information about operating expenses at the IPS centers, and pricing of other relevant services within and outside of NAV.

In order to calculate the cost of IPS, we need information on both fixed and variable operating expenses. How this is to be recorded during the project period, for example, if costs are to be registered on the individual level or, as an average per participant based on the annual total expenditure of the IPS centers, will be finalized when this information is available. Since the cost component in the calculations primarily should include additional costs of IPS, costs that would otherwise be incurred in TAU should be subtracted. The details of this must be decided in consultation with NAV and the IPS centers.

Ethical considerations

The project was submitted to the Norwegian Regional Ethical Committee and therefrom referred to the Norwegian Social Science Data Services, who approved the study (project number: 34989). All principles in the Helsinki declaration will be followed, personal confidentiality is guaranteed, and declarations of voluntary participation with detailed information on the processes will be signed by each participant upon inclusion. The declaration of informed consent emphasizes the right to withdraw from the project at any time without any explanation. We consider the randomization procedure to be ethically acceptable, and so do our collaborators in NAV. The project is registered in the international trial register ClinicalTrials.gov (NCT01964092).

Conclusion

The effect evaluation of Individual Placement and Support (IPS) is a large and comprehensive project, providing evidence-based information on the important issue of rehabilitating patients who are currently out of the labor market. It will be the first RCT to evaluate the effectiveness of IPS for patients with moderate to severe mental illness within a Norwegian context, and one of the largest RCTs to date investigating the effect of IPS on competitive employment.

Acknowledgements

The project was commissioned by the Norwegian Ministry of Health and Ministry of Labor, which also contributed with the main funding for the study. The funder will have an active role in the initiation and implementation of the project, but will have no role in the analyses of results or the decision to submit articles for publication. Uni Research Health contributed with 10% of the payroll expenses for two of the researchers involved. The Trial Steering Committee (TSC) is the scientific advisory board responsible for the general overview of the project and its progress. The Trial Management Group (TMG) is the project group responsible for the daily management and coordination of the trial, and involves researchers and other people of resource associated with the planning and implementation of the project.

The TSC consists of:

  • Ph.D. Silje Endresen Reme (principle investigator)

  • Ph.D. Karin Monstad (responsible for the effect evaluation and cost/benefit analysis)

  • Dr.polit. Kari Ludvigsen (responsible for the process evaluation)

  • Ph.D. Cécile Boot (international collaborator from the EMGO Institute for Health and Care Research at the University of Amsterdam, advisor and consultant, effect- and process evaluation)

  • Professor and statistician Stein Atle Lie (effect evaluation)

The TMG consists of:

  • Principal investigator:
    • Ph.D. Silje Endresen Reme
    • Psy.D. Camilla Løvvik (co-PI)
  • Trial coordinators:
    • M.Sc. Tonje Fyhn
    • Psy.D. Ingrid Blø Olsen (substitute)
  • Researchers, effect evaluation:
    • Professor Stein Atle Lie
    • Ph.D. Karin Monstad
    • Professor Simon Øverland
    • Dr. polit. Tor Helge Holmås
    • M.Sc. Vigdis Sveinsdottir
  • Researchers, process evaluation:
    • Dr.polit. Kari Ludvigsen
    • Dr.polit. Even Nilssen
  • Researchers, cost/benefit analysis:
    • Ph.D. Karin Monstad
  • Client perspective:
    • Client representative (not named)
  • Administrative personnel:
    • Mariann Apelseth (accountant)

Abbreviations

AB

Work with assistance

APS

Traineeship in a sheltered business

DPS

District Psychiatric Center

IPS

Individual placement and support

NAV

Norwegian labor and welfare administration

RCT

Randomized controlled trial

TAU

Treatment as usual

TMG

Trial management group

TSC

Trial steering committee

Footnotes

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

SER and VS conceived the study design and drafted the manuscript. SER is the principal investigator of the trial, while TF is the coordinator. CL, TF, KM and KL also drafted parts of the manuscript, while SØ participated in the design of the study, and revised and commented on the manuscript. All authors read and approved the final manuscript.

Contributor Information

Vigdis Sveinsdottir, Email: vigdis.sveinsdottir@uni.no.

Camilla Løvvik, Email: camilla.lovvik@uni.no.

Tonje Fyhn, Email: tonje.fyhn@uni.no.

Karin Monstad, Email: karin.monstad@uni.no.

Kari Ludvigsen, Email: kari.ludvigsen@uni.no.

Simon Øverland, Email: simon.overland@fhi.no.

Silje Endresen Reme, Email: silje.reme@uni.no.

References

  • 1.NAV . Recipients of disability pension by diagnosis, age, and gender, per 31.12.2011. Oslo: Norwegian Labour and Welfare Administration (NAV); 2012. [Google Scholar]
  • 2.Bond GR, Drake RE. Making the case for IPS Supported Employment. Adm Policy Ment Health. 2014;41(1):69–73. doi: 10.1007/s10488-012-0444-6. [DOI] [PubMed] [Google Scholar]
  • 3.Waddell G, Burton AK. Is Work Good for your Health and Well-being? London: The Stationery Office; 2006. [Google Scholar]
  • 4.Rueda S, Chambers L, Wilson M, Mustard C, Rourke SB, Bayoumi A, Raboud J, Lavis J. Association of returning to work with better health in working-aged adults: a systematic review. Am J Public Health. 2012;102(3):541–556. doi: 10.2105/AJPH.2011.300401. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Burns T, Catty J, White S, Becker T, Koletsi M, Fioritti A, Rossler W, Tomov T, van Busschbach J, Wiersma D, Lauber C. The impact of supported employment and working on clinical and social functioning: results of an international study of individual placement and support. Schizophr Bull. 2009;35(5):949–958. doi: 10.1093/schbul/sbn024. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Bond GR, Resnick SG, Drake RE, Xie H, McHugo GJ, Bebout RR. Does competitive employment improve nonvocational outcomes for people with severe mental illness? J Consult Clin Psychol. 2001;69(3):489–501. doi: 10.1037//0022-006x.69.3.489. [DOI] [PubMed] [Google Scholar]
  • 7.Kukla M, Bond GR, Xie H. A prospective investigation of work and nonvocational outcomes in adults with severe mental illness. J Nerv Ment Dis. 2012;200(3):214–222. doi: 10.1097/NMD.0b013e318247cb29. [DOI] [PubMed] [Google Scholar]
  • 8.Mueser KT, Becker DR, Torrey WC, Xie H, Bond GR, Drake RE, Dain BJ. Work and nonvocational domains of functioning in persons with severe mental illness: a longitudinal analysis. J Nerv Ment Dis. 1997;185(7):419–426. doi: 10.1097/00005053-199707000-00001. [DOI] [PubMed] [Google Scholar]
  • 9.Paul KI, Moser K. Unemployment impairs mental health: Meta-analyses. J Vocat Behav. 2009;74(3):264–282. [Google Scholar]
  • 10.Murphy GC, Athanasou JA. The effect of unemployment on mental health. J Occup Organ Psych. 1999;72:83–99. [Google Scholar]
  • 11.Pockrandt C, Coder B, Lau K, Hartmann B, John U, Freyer-Adam J. Health behaviour and health-risk behaviour among job-seekers: a screening at an employment agency. Gesundheitswesen. 2007;69(11):628–634. doi: 10.1055/s-2007-990306. [DOI] [PubMed] [Google Scholar]
  • 12.Virtanen P, Janlert U, Hammarström A. Health status and health behaviour as predictors of the occurrence of unemployment and prolonged unemployment. Public Health. 2013;127(1):46–52. doi: 10.1016/j.puhe.2012.10.016. [DOI] [PubMed] [Google Scholar]
  • 13.Bartley M. Unemployment and ill health: understanding the relationship. J Epidemiol Community Health. 1994;48(4):333–337. doi: 10.1136/jech.48.4.333. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Claussen B. Alcohol disorders and re-employment in a 5-year follow-up of long-term unemployed. Addiction. 1999;94(1):133–138. doi: 10.1046/j.1360-0443.1999.94113310.x. [DOI] [PubMed] [Google Scholar]
  • 15.Bond GR, Becker DR, Drake RE, Rapp CA, Meisler N, Lehman AF, Bell MD, Blyler CR. Implementing supported employment as an evidence-based practice. Psychiatr Serv. 2001;52(3):313–322. doi: 10.1176/appi.ps.52.3.313. [DOI] [PubMed] [Google Scholar]
  • 16.Wehman P, Moon MS. Vocational rehabilitation and supported employment. Paul Brookes: Baltimore; 1988. [Google Scholar]
  • 17.Corrigan PW. Place-then-train: An alternative service paradigm for persons with psychiatric disabilities. Clin Psychol-Sci Pract. 2001;8(3):334–349. [Google Scholar]
  • 18.NAV . Individual Placement and support (IPS). Manualer for igangsetting av IPS-metodikken. Oslo: Norwegian Labour and Welfare Administration (NAV); 2012. [Google Scholar]
  • 19.Drake RE, Bond GR, Becker DR. IPS supported employment: an evidence-based approach to supported employment. New York: Oxford University Press; 2012. [Google Scholar]
  • 20.Bond GR, Drake RE, Becker DR, Mueser KT. Effectiveness of psychiatric rehabilitation approaches for employment of people with severe mental illness. J Disabil Policy Stud. 1999;10(1):18–52. [Google Scholar]
  • 21.Drake RE, McHugo GJ, Becker DR, Anthony WA, Clark RE. The new hampshire study of supported employment for people with severe mental illness. J Consult Clin Psychol. 1996;64(2):391–399. doi: 10.1037//0022-006x.64.2.391. [DOI] [PubMed] [Google Scholar]
  • 22.Drake RE, McHugo GJ, Bebout RR, Becker DR, Harris M, Bond GR, Quimby E. A randomized clinical trial of supported employment for inner-city patients with severe mental disorders. Arch Gen Psychiatry. 1999;56(7):627–633. doi: 10.1001/archpsyc.56.7.627. [DOI] [PubMed] [Google Scholar]
  • 23.Lehman AF, Goldberg R, Dixon LB, McNary S, Postrado L, Hackman A, McDonnell K. Improving employment outcomes for persons with severe mental illnesses. Arch Gen Psychiatry. 2002;59(2):165–172. doi: 10.1001/archpsyc.59.2.165. [DOI] [PubMed] [Google Scholar]
  • 24.Mueser KT, Clark RE, Haines M, Drake RE, McHugo GJ, Bond GR, Essock SM, Becker DR, Wolfe R, Swain K. The Hartford study of supported employment for persons with severe mental illness. J Consult Clin Psychol. 2004;72(3):479–490. doi: 10.1037/0022-006X.72.3.479. [DOI] [PubMed] [Google Scholar]
  • 25.Gold PB, Meisler N, Santos AB, Carnemolla MA, Williams OH, Keleher J. Randomized trial of supported employment integrated with assertive community treatment for rural adults with severe mental illness. Schizophr Bull. 2006;32(2):378–395. doi: 10.1093/schbul/sbi056. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Bond GR, Salyers MP, Dincin J, Drake R, Becker DR, Fraser VV, Haines M. A randomized controlled trial comparing two vocational models for persons with severe mental illness. J Consult Clin Psychol. 2007;75(6):968–982. doi: 10.1037/0022-006X.75.6.968. [DOI] [PubMed] [Google Scholar]
  • 27.Twamley EW, Narvaez JM, Becker DR, Bartels SJ, Jeste DV. Supported Employment for middle-aged and older people with schizophrenia. Am J Psychiatr Rehabil. 2008;11(1):76–89. doi: 10.1080/15487760701853326. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Davis LL, Leon AC, Toscano R, Drebing CE, Ward LC, Parker PE, Kashner TM, Drake RE. A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder. Psychiatr Serv. 2012;63(5):464–470. doi: 10.1176/appi.ps.201100340. [DOI] [PubMed] [Google Scholar]
  • 29.Nuechterlein KH. 7th International Conference on Early Psychosis, Early Psychoses: A lifetime Perspective. Amsterdam: Blackwell Publishing Asia; 2010. Individual placement and support after an initial episode of schizophrenia: the UCLA randomized controlled trial; pp. 1–15. [Google Scholar]
  • 30.Bond GR, Drake RE, Campbell K. The effectiveness of the individual placement and support model of supported employment for young adults: results from four randomized controlled trials. Early Interv Psychiatry. 2012;6:30–30. [Google Scholar]
  • 31.Hoffmann H, Jackel D, Glauser S, Kupper Z. A randomised controlled trial of the efficacy of supported employment. Acta Psychiatr Scand. 2012;125(2):157–167. doi: 10.1111/j.1600-0447.2011.01780.x. [DOI] [PubMed] [Google Scholar]
  • 32.Bejerholm U, Areberg C, Hofgren C, Sandlund M, Rinaldi M: Individual placement and support in Sweden-A randomized controlled trial.Nord J Psychiatry 2014, 1–10 [Epub ahead of print]. [DOI] [PubMed]
  • 33.Bond GR, Drake RE, Becker DR. Generalizability of the Individual Placement and Support (IPS) model of supported employment outside the US. World Psychiatry. 2012;11(1):32–39. doi: 10.1016/j.wpsyc.2012.01.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Berge C, Johannesen JH, Næsheim H. Internasjonal sammenligning av sykefravær. Er Arbeidskraftundersøkelsene egnet som datakilde? Report 6/2012. Statistics Norway: Oslo; 2012. [Google Scholar]
  • 35.Bond GR, Campbell K, Drake RE. Standardizing measures in four domains of employment outcomes for individual placement and support. Psychiatr Serv. 2012;63(8):751–757. doi: 10.1176/appi.ps.201100270. [DOI] [PubMed] [Google Scholar]
  • 36.Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67(6):361–370. doi: 10.1111/j.1600-0447.1983.tb09716.x. [DOI] [PubMed] [Google Scholar]
  • 37.Chandwick P, Lees S, Birchwood M. The revised Beliefs About Voices Questionnaire (BAVQ-R) Br J Psychiatry. 2000;177:229–232. doi: 10.1192/bjp.177.3.229. [DOI] [PubMed] [Google Scholar]
  • 38.Üstün TB, Kostanjsek N, Chatterji S, Rehm J. Measuring Health and Disability: Manual for WHO Disability Assessment Schedule (WHODAS 2.0) Geneva: World Health Organization; 2010. [Google Scholar]
  • 39.The EuroQol Group EuroQol-a new facility for the measurement of health-related quality of life. Health Policy. 1990;16(3):199–208. doi: 10.1016/0168-8510(90)90421-9. [DOI] [PubMed] [Google Scholar]
  • 40.Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol Use Disorders Identification Test. Arch Intern Med. 1998;158(16):1789–1795. doi: 10.1001/archinte.158.16.1789. [DOI] [PubMed] [Google Scholar]
  • 41.Berman AH, Bergman H, Palmstierna T, Schlyter F. DUDIT (Drug Use Disorders Identification Test) Manual. Stockholm: Karolinska Institutet; 2003. [Google Scholar]
  • 42.Eriksen HR, Ihlebaek C, Ursin H. A scoring system for subjective health complaints (SHC) Scand J Public Health. 1999;27(1):63–72. [PubMed] [Google Scholar]
  • 43.Fisher EB, Bickle C, Harber K, Hughes CR, Jeffe DB, Kahl L, La Greca AM. Annual Meeting of Society of Behavioral Medicine, San Francisco, CA. 1997. Benefits of Directive and Nondirective Support are moderated by severity of circumstances. [Google Scholar]
  • 44.Fisher EB, La Greca AM, Greco P, Arfken C, Schneiderman N. Directive and nondirective social support in diabetes management. Int J Behav Med. 1997;4(2):131–144. doi: 10.1207/s15327558ijbm0402_3. [DOI] [PubMed] [Google Scholar]
  • 45.Øyeflaten IG, J M, Fisher EB, Eriksen HR. Social support and subjective health complaints in occupational rehabilitation. Int J Ther Rehabil. 2010;17(8):424–435. [Google Scholar]
  • 46.Chalder T, Berelowitz G, Pawlikowska T, Watts L, Wessely S, Wright D, Wallace EP. Development of a fatigue scale. J Psychosom Res. 1993;37(2):147–153. doi: 10.1016/0022-3999(93)90081-p. [DOI] [PubMed] [Google Scholar]
  • 47.Areberg C. Individual Placement and Support (IPS) for persons with severe mental illness. Outcomes of a randomised controlled trial in Sweden (PhD thesis) Sweden: Lund University; 2013. [Google Scholar]
  • 48.Heslin M, Howard L, Leese M, McCrone P, Rice C, Jarrett M, Spokes T, Huxley P, Thornicroft G. Randomized controlled trial of supported employment in England: 2 year follow-up of the Supported Work and Needs (SWAN) study. World Psychiatry. 2011;10(2):132–137. doi: 10.1002/j.2051-5545.2011.tb00035.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Seaman SR, White IR. Review of inverse probability weighting for dealing with missing data. Stat Methods Med Res. 2013;22(3):278–295. doi: 10.1177/0962280210395740. [DOI] [PubMed] [Google Scholar]
  • 50.Steckler AB, Linnan L. Process Evaluation for Public Health Interventions and Research. San Francisco, CA: Jossey-Bass; 2002. [Google Scholar]
  • 51.Baranowski T, Stables G. Process evaluations of the 5-a-day projects. Health Educ Behav. 2000;27(2):157–166. doi: 10.1177/109019810002700202. [DOI] [PubMed] [Google Scholar]
  • 52.Green LW, Glasgow RE. Evaluating the relevance, generalization, and applicability of research: issues in external validation and translation methodology. Eval Health Prof. 2006;29(1):126–153. doi: 10.1177/0163278705284445. [DOI] [PubMed] [Google Scholar]
  • 53.Bond GR, Peterson AE, Becker DR, Drake RE. Validation of the Revised Individual Placement and Support Fidelity Scale (IPS-25) Psychiatr Serv. 2012;63(8):758–763. doi: 10.1176/appi.ps.201100476. [DOI] [PubMed] [Google Scholar]
  • 54.Gerstner CR, Day DV. Meta-Analytic review of leader–member exchange theory: correlates and construct issues. J Appl Psychol. 1997;82(6):827–844. [Google Scholar]
  • 55.Ilies R, Nahrgang JD, Morgeson FP. Leader-member exchange and citizenship behaviors: a meta-analysis. J Appl Psychol. 2007;92(1):269–277. doi: 10.1037/0021-9010.92.1.269. [DOI] [PubMed] [Google Scholar]
  • 56.Malterud K. Fokusgrupper som forskningsmetode for medisin og helsefag. Oslo: Universitetsforlaget; 2012. [Google Scholar]
  • 57.Department of Finance . Veileder i samfunnsøkonomiske analyser. Oslo: Department of Finance; 2005. [Google Scholar]

Articles from BMC Psychiatry are provided here courtesy of BMC

RESOURCES