Skip to main content
BMC Psychiatry logoLink to BMC Psychiatry
. 2019 May 7;19:140. doi: 10.1186/s12888-019-2130-7

Exploring the potential cost-effectiveness of a vocational rehabilitation program for individuals with schizophrenia in a high-income welfare society

Stig Evensen 1,, Torbjørn Wisløff 2,5, June Ullevoldsæter Lystad 1, Helen Bull 1, Egil W Martinsen 1,3, Torill Ueland 1,4, Erik Falkum 1,3
PMCID: PMC6505225  PMID: 31064371

Abstract

Background

Over the past decades research has shown that employment has a positive impact on quality of life, global functioning and recovery in individuals with schizophrenia. However, access to vocational rehabilitation services for this group is limited and unemployment rates remain high. In this study we explore the potential cost-effectiveness of a novel vocational rehabilitation program (The Job Management Program – JUMP) earmarked for individuals with schizophrenia in Norway.

Methods

The JUMP study was a vocational rehabilitation program augmented with either cognitive behaviour therapy or cognitive remediation. In addition to the JUMP protocol, we extracted treatment cost data from comprehensive and mandatory health and welfare registers. The costs over a two-year follow-up period were compared with the costs over the two-year period prior to inclusion in the study. We also compared the cost-effectiveness of JUMP with a treatment as usual group (TAU).

Results

We identified significant reductions in inpatient services in the JUMP group, both for those who obtained employment and those who did not. Significant reductions were also found in the TAU group, but adjusted for baseline differences the total cost for JUMP participants were € 10,621 lower than in the TAU group during the follow-up period.

Conclusion

In addition to supporting individuals with schizophrenia obtain employment, JUMP appears to have reduced the reliance on mental health services, which should be of interest to stakeholders.

Trial registration

ClinicalTrials.gov Identifier: NCT01139502. Retrospectively registered on 6 February 2010.

Keywords: Schizophrenia, Vocational rehabilitation, Quality adjusted life years (QALY), Cognitive behaviour therapy, Cognitive remediation, Incremental cost-effectiveness ratio

Background

Employment is associated with improved quality of life and global functioning, and is an important part of recovery for individuals with schizophrenia [14]. Nevertheless, unemployment rates remain high [5, 6], and in Norway only 10% of the population with schizophrenia is employed [7]. This rate is stable across age groups, and the transition rate from disability benefits into employment is close to zero [8].

Supported employment programs have proven superior compared to sheltered workshops or day service programs in supporting individuals with severe mental illnesses attain competitive employment [913]. Benefits of employment include social integration, increased quality of life, higher self-esteem, and improved global functioning [4, 1416]. A few cost-effectiveness analyses have also been undertaken showing a favourable effect of supported employment in terms of increased employment rates and reduced health service costs [10, 1719]. However, due to large variations in costs of health and welfare services and income levels between countries it is difficult to generalise these results [20]. Thus, before implementation can be recommended, the cost-effectiveness of an intervention needs to be evaluated in its intended setting.

Vocational rehabilitation (VR) services in Norway are primarily provided by enterprises that offer both sheltered work and supported employment. These services are funded through the Norwegian Labour and Welfare Administration (NAV) and are typically combined with welfare schemes such as NAV paying the individuals’ salary for extended periods, or work placement with no salary beyond disability benefits [16, 21]. This practice has been described as the “benefit trap” [8], and is likely contributing to the high unemployment among individuals with schizophrenia in Norway [7, 8, 21]. Due to the ineffectiveness and limited access to these services for individuals with schizophrenia spectrum disorders, the Job Management Program (JUMP) was established as a VR program for this group with the primary aim of supporting participants obtain competitive employment. A secondary aim was to explore the effect of augmenting VR with cognitive behaviour therapy (CBT) or cognitive remediation (CR). At two-year follow-up 21.2% of the participants in the JUMP study had obtained competitive employment. A further 25.3% had work placements in competitive workplaces, and an additional 13.7% had sheltered work. Both intervention groups (CR and CBT) improved on global functioning, self-esteem, neurocognitive functioning and depression during the follow-up period [16, 22, 23].

Aims

The objective of the current study was to explore the potential cost-effectiveness of the JUMP intervention compared to a treatment as usual (TAU) group in terms of mental health service costs and effectiveness.

Methods

The JUMP study

The JUMP study was a multi-site VR program for adults with schizophrenia spectrum disorders conducted in six Norwegian counties. The program provided 10 months of standard VR services in competitive or sheltered workplaces, which involved assessments, writing job applications, and preparing for interviews. When required, participants also practiced skills, and had job tasks adapted to accommodate for difficulties at the workplace. In addition to the standard VR services the JUMP protocol included three add-ons: (1) there was a formalised collaboration between VR enterprises, NAV and the mental health services to ensure coordinated and ongoing support; (2) participants, collaborators, and in some cases employers received psychoeducation on common elements associated with schizophrenia spectrum disorders; and (3) either CR or use of CBT techniques provided by trained employment specialists twice a week for a 6 month period. Three counties were randomised to CR and three to CBT. Participants were given the intervention provided in their catchment area [16, 22, 24].

Participants

Participants were recruited from within the mental health services, NAV, and through self-referral in the six counties that were involved in the JUMP study. All participants provided written informed consent. Inclusion criteria were: age between 18 and 65; a diagnosis within the broad schizophrenia spectrum disorders (schizophrenia, schizoaffective disorder, psychotic disorder not otherwise specified and delusional disorder) [25]; sufficient understanding of the Norwegian language; and an IQ above 70. Individuals with neurological disorders, head trauma with more than ten minutes of unconsciousness, and medical conditions that interfered with cognitive function were excluded from the study. Also, individuals who displayed high risk of violent behaviour or severe suicidal ideation, and individuals with ongoing alcohol or substance abuse were not permitted to participate [16, 22, 2629].

A total of 148 participants were included in the JUMP study between August 2009 and March 2012, 84 and 64 respectively allocated to the CBT and CR interventions [16, 28] (Fig. 1).

Fig. 1.

Fig. 1

Subject flow in the JUMP study; referrals, starters and participants consenting to cost-effectiveness analysis

Economic evaluation

The economic evaluation was carried out from the perspective of the health and social care system. This included calculating the cost of mental health services, community care services, social security services, medications and primary health care services, in addition to the costs of the CR and CBT interventions. In accordance with the Norwegian Directorate of Health’s guidelines for economic evaluations in the health sector [30], the number of months employed were converted into quality adjusted life years (QALYs) and served as the measure of effectiveness for the cost-effectiveness analysis. Costs were summarised for two 24-month periods: T0 = the last 2 years prior to inclusion in the study and T1 = from inclusion in the study to two-year follow-up. Intervention costs were included in T1.

We examined the intervention costs and health- and welfare costs for T0 and T1. The mental health service costs in the JUMP group were compared to a control group that received treatment as usual (TAU). Effectiveness was measured in terms of QALYs gained during T1 as compared to T0.

Data sources

Data on services and costs were obtained from comprehensive health and welfare registers: The Norwegian Patient Register (NPR); The Norwegian Prescription Database (NorPD); The Norwegian Health Economics Administration (HELFO); The Individual-based Register of Care Services (IPLOS); and The Norwegian Labour and Welfare Administration’s (NAV) registers on social security benefits, sick leave payments, disability benefits, and competitive employment. The registers are described in detail elsewhere [7]. All data were collected based on the participants’ unique personal identification number. The cost-effectiveness analyses were not part of the original design of the JUMP study, thus a separate consent for extraction of register data after completion of the program was required. Participants were contacted during July – September 2014.

Intervention costs

The intervention costs included costs of employment specialists, a coordinator from the mental health services at each of the six sites, and overhead costs. Each participant was allocated 6 h of the employment specialists’ time per week, including 2 h of CR or CBT in addition to VR services and collaboration with other involved parties.

Treatment as usual

The TAU group was drawn from the NPR. Upon approval of extracting data from the NPR, all JUMP participants (n = 148) were excluded from the draw based on personal identification numbers. Statisticians at the NPR drew a random sample of 100 individuals with a primary diagnosis of schizophrenia that was matched with the JUMP group on age and sex categories (Table 2). The data were annualised for the period 2010–2012. Only individuals in active treatment in the specialised mental health services (Hospitals, Community Mental Health Centres, and private Psychiatrists and Psychologists with a provider licence) are included in the NPR.

Table 2.

Comparison on key baseline characteristics between JUMP and TAU

JUMP (N = 69) TAU (N = 100) Test Statistics Group comparison (p)
Age, mean (SD) 33.2 (7.7) 34.9 (9.1) t (n = 169) = − 1.32 Ns
Gender, male (%) 45 (65.2%) 65 (65.0%) Χ2 (1, n = 169) = 0.001 Ns
Diagnosis
 Schizophrenia 87.0% 100.0% .
 Schizoaffective disorder 8.7% Χ2 (3, n = 169) = 13.78 003
 Psychosis NOS 1.4%
 Delusional disorder 2.9%

Currency conversions

All costs were converted to 2015 Norwegian Kroner (NOK) based on the average consumer price index [31]. Costs are reported in €. For currency conversions we used The Central Bank of Norway’s average annual exchange rate for 2015 (8.95 NOK = 1 €) [32].

Employment data

Employment status for JUMP participants was recorded weekly by employment specialists during the intervention period. Employment status between the end of the intervention period and two-year follow-up were obtained through interviews with the participants and confirmed against NAV’s employee register. Baseline (T0) employment data were obtained through NAV’s employee register. No employment data was available for the TAU group as we did not have approval to merge the NPR with the employment register for this sample. Thus we assumed a stable employment rate of 10.2% for this group based on the national employment rate identified for individuals with schizophrenia in past studies using data from 2012 [7, 8, 3335].

Quality adjusted life years

Cost-effectiveness studies commonly use quality-adjusted life-years (QALYs) as a generic outcome measure [36]. QALYs are estimated on the bases of health related quality of life measures. Quality of life measures were not part of the JUMP protocol, thus QALYs were calculated by multiplying months of employment and unemployment with quality of life tariff scores associated with paid employment (0.87) and unemployment (0.79) from the Schizophrenia Health Outcomes (SOHO) study [2]. These scores were based on EuroQol-5D (EQ-5D) scores in individuals who had received 3 years of continuous treatment for schizophrenia. Paid employment was defined as part-time or full-time employment in competitive workplaces. Twenty-one (30.4%) of the JUMP participants (n = 69) had paid employment during the two-year follow-up period, and sixteen (23.2%) were employed at the time of the two-year follow-up.

Analyses

IBM SPSS Statistics version 21.0 [37] and Stata version 13.1 [38] were used for statistical analyses. All tests were two-tailed with a significance level of 5%. In order to examine group differences, baseline comparisons were conducted with Bootstrap Students t-tests or Chi-square tests. Generalized Linear models (GLM) with gamma family and identity link with baseline costs as a covariate were used to compare costs between groups during the two-year follow-up period. Cost data are often skewed as they are always > 0 and the variance is likely to increase with higher expected costs, and thus violate normality assumptions. The GLM approach provides robust estimates of the mean by accommodating for skewness in the data via 3 components: the random component (cost); the systematic component (treatment group); and the link function (relationship between the random and systematic components). In the gamma family the variance of cost is assumed to be proportional to the square of the mean, which gives a better fit than the normal distribution [39, 40]. To adjust for potential bias due to the lack of randomisation, we performed propensity score adjustments with age, sex, and baseline day treatment, inpatient and outpatient care as potential bias variables. The propensity score was included as a covariate in the GLM. In health economic evaluations, it is recommended to perform probabilistic sensitivity analysis to assess the uncertainty of the resulting cost-effectiveness. We performed probabilistic sensitivity analysis on resulting costs and effects and combined these to provide an estimate of the probability of JUMP being cost-effective compared to TAU.

Results

Baseline analysis

Sixty-nine (46.6%) participants from the JUMP study consented to extraction of register data for this study. There were no significant differences between those who consented and those who declined on key variables (diagnosis, age, sex, units of DDD of antipsychotic medication, psychotic symptoms, education, previous work experience, employment outcome (Table 1) at two-year follow-up, thus we assume the results are fairly representative for the participants in the JUMP study.

Table 1.

Comparison on key variables between participants who consented to obtaining register data and participants who declined at two-year follow-up

Consent (N = 69) Declined (N = 79) Test Statistics Group comparison (p)
Diagnosis
 Schizophrenia 87.0% 89.9%
 Schizoaffective disorder 8.7% 6.3% Χ2 (4, n = 148) = 1.68 Ns
 Psychosis NOS 1.4% 2.5%
 Delusional disorder 2.9% 1.3%
Age, mean (SD) 33.2 (7.7) 32.6 (8.2) t (n = 148) = 0.40 Ns
Gender, male (%) 45 (65.2%) 58 (73.4%) Χ2 (1, n = 148) = 1.17 Ns
Education, highest completed 32.9%
 Primary school 30.4% 38.0%
 High school 29.0% 13.9% Χ2 (5, n = 148) = 8.27 Ns
 Trade school 8.7% 8.9%
 College 21.7% 6.3%
 University 7.2%
 Not completed primary school 2.9%
Units of DDDb main anti-psychotic, mean (SD) 1.1 (0.9) 1.1 (0.7) t (140) = 0.83 Ns
Duration of illness, mean years (DOI) (SD) 8.0 (6.7) 6.5 (6.1) t (143) = 1.42 Ns
Previous work experience, mean months (SD) 64.15 (65.32) 66.69 (73.82) t (n = 146) = − 0,22 Ns
Psychotic Symptoms (PANSS total) (SD) 56.23 (15.35) 60.19 (15.34) t (n = 141) = − 1.52 Ns
Employment outcome
 Competitive employment 23.2% 21.4%
 Work placement 34.8% 18.6%
 Sheltered work 13.0% 15.7% Χ2 (3, n = 139) = 5.87 Ns
 Unemployed 29.0% 44.3%

b Defined daily Dose (DDD)

All JUMP participants had primary diagnoses in the schizophrenia spectrum (87% schizophrenia) while subjects in the TAU group had schizophrenia as their primary diagnosis. There were no significant differences in sex or age (Table 2).

Costs and service utilization

The mean cost of the JUMP intervention was € 9131 (SD 2123) per participant. The mean duration of the intervention was 26.52 weeks (SD 5.89).

There were significant reductions in inpatient services from T0 to T1 for both the JUMP participants (mean = € -90,944; 95CI -137,781, − 46,165; p < .012) and the TAU group (mean = € -78,116; 95% CI -126,941, − 33,275; p = .010). Combining inpatient and outpatient costs gives a mean reduction of € 87,809 in the JUMP group and € 76,386 in the TAU group (median: € -1335 and € 13,263 respectively). The reduction in the JUMP group was significant both for those who gained paid employment (n = 21; mean = € -80,776; 95% CI -140,112, − 21,467; p = .010) and for those who had work placement or sheltered work (n = 42; mean = € -90,885; 95% CI -153,873, − 27,897; p = .006). No significant changes were found for other health or welfare costs. Mean and median costs for each 24 - month period; T0 and T1 (inclusive of intervention costs) are detailed in Table 3.

Table 3.

Mean and median specialised mental health costs (€ 2015) for 24-month period at T0 and T1 (n JUMP = 69, n TAU = 100), and mean primary health and social care cost at T0 and T1 (JUMP)

JUMP T0 JUMP T1 TAU T0 TAU T1
SD SD SD SD
Inpatient services 126,493 235,513 35,549 96,502 168,915 330,530 90,798 177,827
Outpatient services 13,853 15,128 16,988 24,656 6251 10,917 7982 12,851
Total specialised mental health (mean) 140,345 236,516 66,519 102,942 175,165 331,739 98,779 179,602
Total specialised mental health (median + range) 30,590 1,067,387 29,255 642,030 7658 1,082,098 20,920 1,025,296
Primary health care 515 746 426 552
Community care incl. Accommodation 56,387 110,280 60,690 108,645
Medications 2999 3443 2958 3329
Social security 32,172 16,795 41,934 11,154
Intervention cost 13,982 3154
Total 232,419 263,821 172,527 148,587

In terms of utilisation of mental health services, the JUMP group had significantly more outpatient visits during both T0 and T1 compared to TAU. At T1 the JUMP group had significantly fewer days of hospitalisation than the TAU group (Table 4). Bootstrap paired samples t-tests revealed significant reductions in inpatient days for both JUMP (mean − 63.0; 95% CI -96.2, − 33.3; p = .006) and for TAU (mean − 53.8; 95% CI -87.5, − 23.1; p = .004). We found no significant differences in change scores between JUMP and TAU through bootstrap independent samples t-test (mean 9.2; 95% CI -39.9, 58.5; p = .71).

Table 4.

Comparison of mental health service utilization between JUMP and TAU at T0 and T1

JUMP (N = 69) TAU (N = 100) Test Statistics Group comparison (p)a
T0
 Days of hospitalisation T0 (SD) 88.5 (164.8) 118.4 (231.6) t (n = 169) = .922 Ns
 Days of day treatment T0 (SD) .54 (2.5) .28 (1.7) t (n = 169) = .784 Ns
 Outpatient visits T0 (SD) 48.5 (53.4) 22.0 (39.7) t (n = 169) = −3.708 <.001
T1
 Days of hospitalisation T1 (SD) 25.5 (69.3) 64.6 (126.5) t (n = 169) = 2.336 .021
 Days of day treatment T1 (SD) 1.1 (8.0) .51 (2.9) t (n = 169) = .687 Ns
 Outpatient visits T1 (SD) 59.9 (89.6) 28.1 (45.65) t (n = 169) = −3.027 .003

a Based on bootstrap t-tests with 1000 samples

We performed a generalized linear regression with costs at T0, group (JUMP/TAU) and the propensity score as covariates using gamma family and identity link to examine group differences in total costs at T1 (Table 5). We tested the assumptions with a linktest which was non-significant, indicating that the assumptions are reasonable. Total mean costs for the JUMP group (inclusive of intervention costs and adjusted for baseline differences) were € 10,621 lower than for TAU (95% CI: -29,979, 8735; p = .282). Costs at T0 was a significant predictor of costs at T1 (Table 5).

Table 5.

Effect of group (TAU vs JUMP), baseline costs and propensity score (age, sex, and baseline day treatment, inpatient and outpatient care) on treatment costs at T1 (GLM)

Coeff 95% CI P
Group – TAU vs JUMP −10,621.64 −29,979, 8735 0.282
Baseline cost .26 .18, .35 < 0.001
Propensity score 65,033.19 −24,799, 154,865 0.156

Cost-effectiveness

When assessing whether a program is cost-effective it is useful to use the cost-effectiveness plane (Fig. 2). If the mean value of the new program is more effective and less costly than the reference program, it is cost-effective and is typically denoted as a dominant strategy. Likewise, if the new program is less effective and more costly it is dominated [41]. New programs in the two other quadrants of the plane are evaluated against a cost-effectiveness threshold value suggested by the Norwegian Directorate of Health which is € 62,000 per QALY gained [42].

Fig. 2.

Fig. 2

The cost-effectiveness plane [48]

In terms of exploring the cost effectiveness of an intervention the effect is usually estimated as a general measure of gained health related quality of life from the new intervention compared to existing treatment, which is converted into quality adjusted life years (QALY).

The mean months of competitive employment in the JUMP group were 3.10 (N = 69, SD 7.27) at T0 and 4.30 (N = 69, SD 7.33) at T1 with corresponding QALYs being .8003 (SD .024) at T0 and .8043 (SD .024) at T1. Thus the incremental QALYs for competitive employment were .004 (SD .026; 95%CI −.002, .010) in the JUMP group, while we assumed a stable 10.2% employment rate in the TAU group.

Dividing the aggregate difference in average specialised mental health service costs (€ 10,621) by the aggregated improvement in QALYs yields a negative incremental cost-effectiveness ratio, which places the JUMP group in the bottom right quadrant of the cost-effectiveness plane (more effective and less costly) (Fig. 2). Although the difference is not significant there is a trend towards the JUMP program being more cost-effective. This is also the case if using incremental months of work as the effect measure. JUMP generated more months of employment than TAU at a lower cost. Probabilistic analyses indicate an 85% probability that JUMP is cost-effective compared to TAU.

Discussion

This study found reduced mental health service costs during a novel vocational rehabilitation program (JUMP) for individuals with schizophrenia spectrum disorders in Norway. Compared to a TAU group the mean mental health costs, adjusted for baseline differences (T0), were € 10,621 lower in the JUMP group (inclusive of intervention costs) during the two-year follow-up period (T1). Due to skewed data we also provided median costs for specialised mental health services. The median costs for the JUMP group reduced slightly from T0 to T1, while the median cost for the TAU group increased by € 13,261. This is further evidence in favour of the JUMP intervention [43]. A large mean reduction in mental health service use was also identified in the TAU group. One potential explanation for this reduction may be that only patients in active treatment within the specialised mental health services are registered in the NPR. Hence, the reduced reliance on mental health services in the TAU group is likely an effect of therapeutic interventions beyond our control. The service use variation was also greater in the TAU group with the median group difference being greater than the mean.

We also found that competitive employment during 24 months in the JUMP group increased from a mean 3.1 months at T0 to 4.3 months at T1. When including all types of employment the mean months of employment at T1 was 15.14 months. The assumed duration of competitive employment in the TAU group (based on previous studies [7, 8, 3335]) was 2.35 months. The incremental QALYs related to competitive employment were .006 higher in the JUMP group than the TAU group at T1. Despite the costly intervention, mental health service costs were reduced in the JUMP group and there was an increased effect measured in both QALYs and months worked.

The cost reductions in the current study were driven by a large reduction in inpatient care at T1. Similar reduced reliance on inpatient care for individuals who gain employment have also been documented in other studies [4446]. A commonly used argument for such results is that work in itself facilitates symptom improvement and enhanced self-esteem [4, 14, 15, 46], which in turn is likely to reduce hospitalisations. This is probably one of several factors in play, and some studies have displayed somewhat different results. In a study comparing supported employment with traditional VR across six European cities, Knapp and colleagues found that participants in the supported employment group utilised significantly less inpatient services than participants in the traditional VR group during the first 12 months of the study, while there was no difference during the six months thereafter [19]. In contrast, the current study found the reliance of inpatient care to remain significantly lower than in the TAU group throughout the 24 - month follow-up period. In a recent study comparing supported employment to traditional VR in Norway, Reme and colleagues found that supported employment did not have a significant effect on inpatient care [47]. Notably this study had broader inclusion criteria, thus the results are not directly comparable.

An interesting point when comparing the current study with supported employment studies is that we found no significant differences between those who gained competitive employment and those who had work placements or sheltered work in terms of reliance on mental health services. This is important as it indicates that vocational rehabilitation programs for individuals with schizophrenia can have positive health effects even when employing a broader definition of work than is normally the case in supported employment studies.

The reasons for the reduced inpatient care in the current study are likely multifaceted. One explanation may be that JUMP participants increased the use of outpatient mental health services, which probably contributed to fewer hospitalisations. Another important factor could be the close follow-up and two weekly CBT or CR sessions the participants received from the trained employment specialists. In addition to perhaps being therapeutic in itself, the close follow-up enabled the employment specialists to intervene, either directly or by alerting clinicians, if they observed signs of symptom increase.

Past cost-effectiveness studies have primarily examined programs where competitive employment has been the only employment outcome measured. Although competitive employment was the ultimate aim of the JUMP study, work placements and sheltered work were also considered a success in accordance with the Scandinavian model of vocational rehabilitation. It should be noted that the use of work placements and sheltered work was an important factor that enabled 77% of the participants in the JUMP study to maintain their job during the ten-month intervention period [22].

Apart from the reduction in mental health service costs all costs except social security remained stable between T0 and T1. We believe the change was primarily due to participants having their entitlements revised upon inclusion in the project. Consequently, many were shifted from a disability pension to a work assessment allowance, which provided them with a higher benefit. At two-year follow-up 16.4% of all JUMP participants had transitioned from disability benefits to paid employment as their primary source of income. Any long-term effect on social security costs will be explored in the forthcoming five-year follow-up of the JUMP study.

Strengths and weaknesses

A major strength of this study was the use of comprehensive and compulsory health- and welfare registers, which provided detailed records of participants’ societal costs over a period of four years. The main limitation of the study is the lack of a randomised control group. Due to recruitment problems we were forced to abandon the original design of including a control group and thus drew a TAU group from the NPR for this study. Although the TAU group consisted of a random selection, there were large mean differences in resource utilisation between the TAU and JUMP groups at baseline. This may indicate that there were clinical differences between the two groups but as we do not have any clinical information about the TAU group, we are unable to determine if such differences were, in fact, present. By controlling for baseline differences, the effect of this difference is likely to have been reduced. Due to the lack of a control group receiving VR only, we were unable to disentangle the effects of the CR and CBT interventions. Also, no direct measure of health related quality of life was included in the design of the study; hence tariff scores from the literature were used. Although this method is commonly used in health economic evaluations where measures of health-related quality of life are not available, the validity of this estimation should be interpreted with caution as health related quality of life can be influenced by a number of factors [20]. The lack of employment and quality of life data for the control group is also a limitation that affects the validity of the results. Another limitation is that less than half of the participants in the JUMP study consented to extraction of register data. There were, however no significant differences on key variables between those who consented and those who did not. Finally, the high intervention costs of the JUMP study as well as Norway’s high treatment costs and strong welfare system affect the generalisability of our results.

Conclusion

The current study identified non-significant cost reductions and improvements in QALYs among JUMP participants compared to TAU. The main cost-effect was driven by reduced inpatient services. The reductions in mental health costs were similar both for those who gained competitive employment and those who had work placements or sheltered work. This indicates that JUMP was a beneficial mental health treatment approach, which should be of great interest to service providers. This is particularly relevant given the current need in Norway to reduce the substantial economic burden of unemployment/risk of unemployment due to severe mental illness [8]. Although the point estimate indicates that JUMP both increased quality adjusted life years (QALY) and reduced costs, there is uncertainty concerning both variables.

Acknowledgments

The authors thank all participants who took part in the study and all their collaborators for making this research possible. We also thank the NPR, NorPD, NAV, and the IPLOS registers for providing data for this study.

Funding

This work was supported by The Norwegian Directorate of Health (14/4607–13), the Norwegian Labour and Welfare Administration, The South Eastern Norway Health Authority (9297), and The National Council for Mental Health/Health and Rehabilitation (2008/2/0310).

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CBT

Cognitive behaviour therapy

CR

Cognitive remediation

DDD

Defined daily dose

DSM-IV

Diagnostic and statistical manual - iv

EQ-5D

EuroQol – 5 dimensions

GLM

Generalized linear model

HELFO

The Norwegian Health Economics Administration

HoNOS

Health of the Nation Outcome Scales

IBM SPSS

IBM (International Business Machines) Statistical analysis software package

IPLOS

The Individual-based Register of Care Services

IQ

Intelligence quotient

JUMP

Job management program

NAV

The Norwegian Labour and Welfare Administration

NOK

Norwegian kroner

NorPD

The Norwegian Prescription Database

NPR

The Norwegian Patient Register

QALY

Quality adjusted life years

TAU

Treatment as usual

VR

Vocational Rehabilitation

Authors’ contributions

SE: Data collection; analysis and interpretation of data; drafting the manuscript; final approval of the manuscript. TW: Analysis and interpretation of data; critical revision of the manuscript; final approval of the manuscript. JL: Data collection; analysis and interpretation of data; critical revision of the manuscript; final approval of the manuscript. HB: Data collection; analysis and interpretation of data; critical revision of the manuscript; final approval of the manuscript. EM: Conceptualisation and design of the JUMP study; critical revision of the manuscript; final approval of the manuscript. TU: Conceptualisation and design of the JUMP study; critical revision of the manuscript; final approval of the manuscript. EF: Conceptualisation and design of the JUMP study; critical revision of the manuscript; final approval of the manuscript.

Ethics approval and consent to participate

The JUMP study was approved by the Regional Committee of Medical Research Ethics and the Norwegian Data Protection Authority. ClinicalTrials.gov Identifier: NCT01139502. The cost-effectiveness evaluation was approved by the Norwegian Data Protection Authority (14/00035–5/EOL). All participants provided written informed consent after a complete description of the study.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Stig Evensen, Phone: 47-45-43-28-85, Email: stigevensen74@gmail.com.

Torbjørn Wisløff, Email: torbjorn.wisloff@medisin.uio.no.

June Ullevoldsæter Lystad, Email: j.u.lystad@medisin.uio.no.

Helen Bull, Email: helen@oslomet.no.

Egil W. Martinsen, Email: e.w.martinsen@medisin.uio.no

Torill Ueland, Email: torill.ueland@psykologi.uio.no.

Erik Falkum, Email: erik.falkum@medisin.uio.no.

References

  • 1.McGurk SR, Mueser KT, Feldman K, Wolfe R, Pascaris A. Cognitive training for supported employment: 2-3 year outcomes of a randomized controlled trial. Am J Psychiatry. 2007;164(3):437–441. doi: 10.1176/ajp.2007.164.3.437. [DOI] [PubMed] [Google Scholar]
  • 2.Alonso J, Croudace T, Brown J, Gasquet I, Knapp MR, Suarez D, Novick D. Health-related quality of life (HRQL) and continuous antipsychotic treatment: 3-year results from the schizophrenia health outcomes (SOHO) study. Value Health. 2009;12(4):536–543. doi: 10.1111/j.1524-4733.2008.00495.x. [DOI] [PubMed] [Google Scholar]
  • 3.Bouwmans C, de Sonneville C, Mulder CL, Hakkaart-van Roijen L. Employment and the associated impact on quality of life in people diagnosed with schizophrenia. Neuropsychiatr Dis Treat. 2015;11:2125–2142. doi: 10.2147/NDT.S83546. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Burns T, Catty J, White S, Becker T, Koletsi M, Fioritti A, Rossler W, Tomov T, van Busschbach J, Wiersma D, et al. The impact of supported employment and working on clinical and social functioning: results of an international study of individual placement and support. Schizophr Bull. 2009;35(5):949–958. doi: 10.1093/schbul/sbn024. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Jonsdottir A, Waghorn G. Psychiatric disorders and labour force activity. Ment Health Rev J. 2015;20(1):13. [Google Scholar]
  • 6.Davidson M, Kapara O, Goldberg S, Yoffe R, Noy S, Weiser M. A nation-wide study on the percentage of schizophrenia and bipolar disorder patients who earn minimum wage or above. Schizophr Bull. 2015;42:443–447. doi: 10.1093/schbul/sbv023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Evensen S, Wisloff T, Lystad JU, Bull H, Ueland T, Falkum E. Prevalence, employment rate, and cost of schizophrenia in a high-income welfare society: a population-based study using comprehensive health and welfare registers. Schizophr Bull. 2016;42(2):476–483. doi: 10.1093/schbul/sbv141. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.OECD: Mental Health and Work: Norway. In.; 2013.
  • 9.Burns T, White SJ, Catty J. Individual placement and support in Europe: the EQOLISE trial. Int Rev Psychiatry. 2008;20(6):498–502. doi: 10.1080/09540260802564516. [DOI] [PubMed] [Google Scholar]
  • 10.Bond GR, Drake RE. Making the case for IPS supported employment. Admin Pol Ment Health. 2014;41(1):69–73. doi: 10.1007/s10488-012-0444-6. [DOI] [PubMed] [Google Scholar]
  • 11.Bond GR, Drake RE, Becker DR. An update on randomized controlled trials of evidence-based supported employment. Psychiatr Rehabil J. 2008;31(4):280–290. doi: 10.2975/31.4.2008.280.290. [DOI] [PubMed] [Google Scholar]
  • 12.Bond GR, Drake RE, Campbell K. Effectiveness of individual placement and support supported employment for young adults. Early Interv Psychiatry. 2014. [DOI] [PMC free article] [PubMed]
  • 13.Burns T, Catty J, Becker T, Drake RE, Fioritti A, Knapp M, Lauber C, Rossler W, Tomov T, van Busschbach J, et al. The effectiveness of supported employment for people with severe mental illness: a randomised controlled trial. Lancet. 2007;370(9593):1146–1152. doi: 10.1016/S0140-6736(07)61516-5. [DOI] [PubMed] [Google Scholar]
  • 14.Mueser KT, Becker DR, Torrey WC, Xie H, Bond GR, Drake RE, Dain BJ. Work and nonvocational domains of functioning in persons with severe mental illness: a longitudinal analysis. J Nerv Ment Dis. 1997;185(7):419–426. doi: 10.1097/00005053-199707000-00001. [DOI] [PubMed] [Google Scholar]
  • 15.Luciano A, Bond GR, Drake RE. Does employment alter the course and outcome of schizophrenia and other severe mental illnesses? A systematic review of longitudinal research. Schizophr Res. 2014;159(2–3):312–321. doi: 10.1016/j.schres.2014.09.010. [DOI] [PubMed] [Google Scholar]
  • 16.Evensen S, Ueland T, Lystad JU, Bull H, Klungsoyr O, Martinsen EW, Falkum E. Employment outcome and predictors of competitive employment at 2-year follow-up of a vocational rehabilitation programme for individuals with schizophrenia in a high-income welfare society. Nord J Psychiatry. 2017;71(3):180–187. doi: 10.1080/08039488.2016.1247195. [DOI] [PubMed] [Google Scholar]
  • 17.Marino LA, Dixon LB. An update on supported employment for people with severe mental illness. Curr Opin Psychiatry. 2014;27(3):210–215. doi: 10.1097/YCO.0000000000000058. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Salkever D. Social costs of expanding access to evidence-based supported employment: concepts and interpretive review of evidence. Psychiatr Serv. 2013;64(2):111–119. doi: 10.1176/appi.ps.201100499. [DOI] [PubMed] [Google Scholar]
  • 19.Knapp M, Patel A, Curran C, Latimer E, Catty J, Becker T, Drake RE, Fioritti A, Kilian R, Lauber C, et al. Supported employment: cost-effectiveness across six European sites. World Psychiatry. 2013;12(1):60–68. doi: 10.1002/wps.20017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, Augustovski F, Briggs AH, Mauskopf J, Loder E. Consolidated health economic evaluation reporting standards (CHEERS)--explanation and elaboration: a report of the ISPOR health economic evaluation publication guidelines good reporting practices task force. Value Health. 2013;16(2):231–250. doi: 10.1016/j.jval.2013.02.002. [DOI] [PubMed] [Google Scholar]
  • 21.Spjelkavik Ø. Supported employment in Norway and in the other Nordic countries. J Vocational Rehabil. 2012;37:163–172. [Google Scholar]
  • 22.Falkum E, Klungsøyr O, Lystad JU, Bull HC, Evensen S, Martinsen E, Friis S, Ueland T. Vocational rehabilitation for adults with psychotic disorders in a Scandinavian welfare society. BMC Psychiatry. 2017:17, 24. [DOI] [PMC free article] [PubMed]
  • 23.Lystad JU, Falkum E, Haaland VO, Bull H, Evensen S, McGurk SR, Ueland T. Cognitive remediation and occupational outcome in schizophrenia spectrum disorders: a 2year follow-up study. Schizophr Res. 2017;185:122–129. doi: 10.1016/j.schres.2016.12.020. [DOI] [PubMed] [Google Scholar]
  • 24.Lystad JU, Falkum E, Haaland VO, Bull H, Evensen S, Bell MD, Ueland T. Neurocognition and occupational functioning in schizophrenia spectrum disorders: the MATRICS consensus cognitive battery (MCCB) and workplace assessments. Schizophr Res. 2016;170(1):143–149. doi: 10.1016/j.schres.2015.12.002. [DOI] [PubMed] [Google Scholar]
  • 25.APA: Diagnostic and statistical manual of mental disorders: DSM-IV; 1994. [DOI] [PubMed]
  • 26.Bull H, Ueland T, Lystad JU, Evensen S, Friis S, Martinsen EW, Falkum E. Validation of the work behavior inventory. Nord J Psychiatry. 2015;69(4):300–306. doi: 10.3109/08039488.2014.973902. [DOI] [PubMed] [Google Scholar]
  • 27.Berge T, Falkum E. Se mulighetene: Arbeidsliv og psykisk helse. Oslo: Gyldendal Akademisk; 2013. [Google Scholar]
  • 28.Evensen S, Ueland T, Lystad JU, Bull H, Klungsoyr O, Martinsen EW, Falkum E. Employment outcome and predictors of competitive employment at 2-year follow-up of a vocational rehabilitation programme for individuals with schizophrenia in a high-income welfare society. Nord J Psychiatry. 2016:1–8. [DOI] [PubMed]
  • 29.Wing JK, Curtis RH, Beevor AS. HoNOS: health of the nation outcome scales: report on Research and Development July 1993–December 1995. London: Royal College of Psychiatrists; 1996. [Google Scholar]
  • 30.Helsedirektoratet . In: Guidelines for economic evaluation in the health sector. Divisjon helseøkonomi og finansiering A, DRG fo, editor. Oslo: Helsedirektoratet v/ Trykksaksekspedisjonen; 2012. [Google Scholar]
  • 31.StatisticsNorway . Consumer price index, February 2016. Oslo, Norway: Statistics Norway; 2016. [Google Scholar]
  • 32.NorgesBank . Annual exchange rates (from 1960) Oslo: Norges Bank; 2016. [Google Scholar]
  • 33.Helle S, Gråwe R. Employment and social benefit among persons with schizophrenia in Norway. J Norwegian Psychol Assoc. 2007;44(11):1358–1362. [Google Scholar]
  • 34.Tandberg M, Ueland T, Sundet K, Haahr U, Joa I, Johannessen JO, Larsen TK, Opjordsmoen S, Rund BR, Rossberg JI, et al. Neurocognition and occupational functioning in patients with first-episode psychosis: a 2-year follow-up study. Psychiatry Res. 2011;188(3):334–342. doi: 10.1016/j.psychres.2011.04.021. [DOI] [PubMed] [Google Scholar]
  • 35.Melle I, Friis S, Hauff E, Vaglum P. Social functioning of patients with schizophrenia in high-income welfare societies. Psychiatr Serv. 2000;51(2):223–228. doi: 10.1176/appi.ps.51.2.223. [DOI] [PubMed] [Google Scholar]
  • 36.Bobinac A, van Exel J, Rutten FF, Brouwer WB. The value of a QALY: individual willingness to pay for health gains under risk. Pharmacoeconomics. 2014;32(1):75–86. doi: 10.1007/s40273-013-0110-1. [DOI] [PubMed] [Google Scholar]
  • 37.IBM: IBM SPSS statistics for windows. 21.0 edn. Armonk, NY: IBM Corp; 2012.
  • 38.StataCorp . Stata for Windows. College Station: StataCorp LP; 2013. [Google Scholar]
  • 39.Kahn I. Design & Analysis of clinical trials for Economic Evaluation & Reimbursement: an applied approach using SAS & STATA. Boca Raton, Florida: CRC Press, Taylor & Francis Group; 2016. [Google Scholar]
  • 40.Mihaylova B, Briggs A, O'Hagan A, Thompson SG. Review of statistical methods for analysing healthcare resources and costs. Health Econ. 2011;20(8):897–916. doi: 10.1002/hec.1653. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Drummond MF, Schulpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care Programmes. 4. Oxford: Oxford University Press; 2015. [Google Scholar]
  • 42.Sælensminde K: Helseeffekter i samfunnsøkonomiske analyser Edited by Health NDo: Norwegian Directorate of Health; 2007.
  • 43.Bang H, Zhao H. Cost-effectiveness analysis: a proposal of new reporting standards in statistical analysis. J Biopharm Stat. 2014;24(2):443–460. doi: 10.1080/10543406.2013.860157. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Bush PW, Drake RE, Xie H, McHugo GJ, Haslett WR. The long-term impact of employment on mental health service use and costs for persons with severe mental illness. Psychiatr Serv. 2009;60(8):1024–1031. doi: 10.1176/ps.2009.60.8.1024. [DOI] [PubMed] [Google Scholar]
  • 45.Schneider J, Boyce M, Johnson R, Secker J, Slade J, Grove B, Floyd M. Impact of supported employment on service costs and income of people with mental health needs. J Ment Health. 2009;18(6):533–542. [Google Scholar]
  • 46.Perkins DV, Born DL, Raines JA, Galka SW. Program evaluation from an ecological perspective: supported employment services for persons with serious psychiatric disabilities. Psychiatr Rehabil J. 2005;28(3):217–224. doi: 10.2975/28.2005.217.224. [DOI] [PubMed] [Google Scholar]
  • 47.Reme S, Monstad K, Fyhn T, Øverland S, Ludvigsen K, Sveinsdottir V, Løvvik C, Lie SA: Effektevaluering av Individuell jobbstøtte (IPS). In.: Uni research Helse & Uni research Rokkansenteret; 2016.
  • 48.Black WC. The cost-effectiveness plane: a graphic representation of cost-effectiveness. Med Decis Mak. 1990;10(3):212–215. doi: 10.1177/0272989X9001000308. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.


Articles from BMC Psychiatry are provided here courtesy of BMC

RESOURCES