Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2024 Dec 1.
Published in final edited form as: Schizophr Res. 2023 Nov 16;262:149–155. doi: 10.1016/j.schres.2023.11.003

Effort-based decision-making as a determinant of supported employment outcomes in psychotic disorders

Thanh P Le a,b,c,*, Michael F Green b,c, Jonathan K Wynn c,b, Julio E Iglesias c, Richard L Franco b, Alex Kopelowicz b, Robert S Kern b,c
PMCID: PMC10923523  NIHMSID: NIHMS1964716  PMID: 37979418

Abstract

Schizophrenia is associated with a heavy economic burden in the United States that is partly due to the high rates of chronic unemployment. Individual Placement and Support (IPS) is an evidenced-based type of supported employment that can improve job obtainment and work outcomes in psychotic disorders. Outcomes vary widely and a persistent challenge for IPS is low levels of engagement in the initial job search phase. Past studies have focused on interview-based motivation deficits as a key determinant of poor treatment engagement and work outcomes in schizophrenia. New validated performance-based measures of motivation, including effort-based decision-making (EBDM) tasks, may explain supported employment outcomes and provide insights into individual differences in IPS outcomes. This study investigated the degree to which IPS engagement (i.e., number of sessions attended during the first four months of service delivery) was related to baseline interview-based motivation deficits and performance on three EBDM tasks – two tasks of physical effort and one of cognitive effort (i.e., Balloon Task, Effort Expenditure for Rewards Task, Deck Choice Effort Task) – in a sample (N = 47) of people with a psychotic disorder. Results indicated that the level of EBDM performance, specifically on the Balloon Task, predicted IPS engagement, accounting for an additional 17 % of the variance above and beyond interview-based motivation deficits (total R2 = 24 %). Overall, these findings suggest that addressing motivational deficits in effort-based decision-making may be beneficial to IPS engagement, which in turn may improve the trajectory of work outcomes.

Keywords: Individual Placement and Support, Effort valuation, Motivation, Employment, Work, Schizophrenia

1. Introduction

Schizophrenia is a major contributor to disability and is associated with an economic burden of more than $343.2 billion annually in direct and indirect costs in the United States (Kadakia et al., 2022). A significant portion of this cost is due to the high rates of chronic unemployment among individuals with schizophrenia. Unemployment also has adverse effects on the general population’s mental and physical health, including increased levels of depression, stress, and unhealthy behaviors such as smoking, overeating, and a sedentary lifestyle, which can lead to health problems such as heart disease (De Hert et al., 2011; Paul and Moser, 2009). In individuals with schizophrenia, the consequences of unemployment are pronounced and include increased severity of psychiatric symptoms, increased risk of suicide, higher rates of homelessness, and perpetuation of the stigma that mental illness is a debilitating condition that prevents participation in meaningful life activities (Bond et al., 2001; Mueser et al., 1997). Therefore, it is crucial to understand the determinants of unemployment to address this public health concern effectively. This study investigates the link between motivation and differences in employment outcomes, specifically engagement in supported employment services, among individuals with psychotic disorders.

Prolonged periods of unemployment are common for many individuals with schizophrenia and other psychotic disorders with unemployment rates peaking at 80–90 % (Lin et al., 2022). Supported employment is an evidence-based practice designed to help individuals with schizophrenia obtain and maintain competitive employment (Dixon et al., 2010). A leading type of supported employment is the Individual Placement and Support (IPS) model, which emphasizes integration with mental health treatment services and continuous individualized support (Drake et al., 2012). IPS recipients are 2–3 times more likely to get a job than those receiving traditional vocational rehabilitation (Bond et al., 2008), although outcomes vary widely. IPS places a strong emphasis on rapid job search activities, conducted with the guidance of an employment specialist, within weeks following enrollment into the program. This period is recognized as the most pivotal phase for achieving subsequent employment success. However, 20 to 60 % of IPS recipients do not obtain competitive work, and mean job tenure ranges from 10 weeks to over one year (Heslin et al., 2011; Hoffmann et al., 2014; Twamley et al., 2012; Waghorn et al., 2014). A key challenge for IPS is low levels of engagement, including poor attendance, in the initial job search phase (Drake et al., 2012). Furthermore, employment specialists estimate that 20–30 % of their clients fail to stay actively involved in IPS, despite expressing an interest in working. As observed in other studies (Dixon et al., 2016; Kukla et al., 2015; Le et al., 2022), this reduced vocational rehabilitation engagement is likely related to motivational deficits in schizophrenia.

Motivational deficits are typically assessed with clinical ratings of negative symptoms in schizophrenia, and they have been linked to poor role functioning and employment outcomes. For instance, in previous work from our group, we investigated the impact of negative symptoms on job obtainment and work outcomes in individuals with schizophrenia and observed modest associations between motivation and pleasure deficits (but not expressive deficits) and job obtainment, hours worked, and wages earned (Llerena et al., 2018). Further, we found that self-reported intrinsic motivation related to feeling valued and useful in a work role significantly predicted employment outcomes in individuals with schizophrenia who were enrolled in a supported employment program (Reddy et al., 2016). These studies, and work from other labs (Kukla et al., 2015; Mahmood et al., 2019), highlight the importance of motivational factors on job obtainment and work outcomes in schizophrenia.

Beyond clinical ratings of motivation in schizophrenia, there are now validated performance-based measures of motivation, including effort-based decision-making (EBDM) tasks. These types of tasks involve a cost-benefit analysis, such as weighing the potential benefits (e.g., rewards) of performing a task versus the costs of the task (e.g., task difficulty; Kring and Barch, 2014). EBDM paradigms are adapted from preclinical models of motivation and reward processing and operationalize motivation as the amount of effort an animal is willing to exert for different levels of reward (Young and Markou, 2015). Compared to controls, individuals with schizophrenia are less willing to exert effort for monetary rewards, especially when reward values are high (Culbreth et al., 2018; Green et al., 2015; Strauss et al., 2016). In schizophrenia, performance on these tasks sometimes (Barch et al., 2014; Chang et al., 2020; Cooper et al., 2019; Gold et al., 2013), though not always (Cathomas et al., 2021; Docx et al., 2015; Fervaha et al., 2013; Gold et al., 2015), correlates with negative symptoms and community functioning. While interview-based motivation deficits are a crucial factor in determining work outcomes, they do not explain most of the variance and include several drawbacks that can complicate assessments, including recall and introspection difficulties, vulnerabilities to biases, and an unwillingness to disclose (Cohen et al., 2019; Horan et al., 2015; Le et al., 2017). Performance-based measures of motivation are a potentially critical factor, and recently adapted EBDM paradigms may provide new insights into why some individuals receiving IPS services experience suboptimal outcomes and differ in their level of engagement with the program. Aberrant EBDM may explain why some individuals receiving IPS services are insufficiently engaged and experience subsequent poor work outcomes. Patients may perceive the physical and cognitive cost of active participation in IPS as outweighing the potential advantages of securing employment. Such paradigms may also enhance the ability to develop targeted treatments in this area.

With increasing calls for individually tailored interventions (Drake et al., 2022; Lenze et al., 2020; Velligan et al., 2008), it is critical to identify modifiable variables that can be targeted to enhance engagement in empirically based, vocational rehabilitation such as IPS. The current study used fine-grained measurements of motivation based on EBDM to provide new insights into the determinants of IPS engagement. To our knowledge, this type of translational approach has not been previously applied to understand the heterogeneity in supported employment outcomes. We investigated the degree to which IPS engagement (i.e., number of sessions attended) was related to baseline interview-based motivation and expression deficits and performance on three EBDM tasks – two tasks of physical effort and one task of cognitive effort (i.e., Effort Expenditure for Rewards Task, Balloon Task, Deck Choice Effort Task) – in a stabilized sample of people with psychotic disorders. We used both physical and cognitive EBDM tasks for two reasons. First, this approach allows us to have a more comprehensive assessment and there are very few comparisons of multiple types of effort paradigms within the same study. Second, most of the existing literature on schizophrenia and serious mental illnesses has predominantly focused on examining the relationship between performance on physical EBDM tasks and outcome measures. We expected to find a significant positive relationship between the level of EBDM performance and the degree of engagement over the initial four months of IPS services. We also expected that the level of EBDM performance would explain unique variance in engagement above and beyond interview-based motivation deficits.

2. Methods

2.1. Participants

The total sample included 47 veterans drawn from IPS programs at the VA Greater Los Angeles Healthcare System and the San Fernando Mental Health Center. All participants met SCID-based DSM-5 criteria for schizophrenia, schizoaffective disorder, or other psychotic disorder. Inclusion criteria were: minimum of 21 years of age, clinically stable (i.e., no psychiatric hospitalizations in the past three months, same antipsychotic medication for past two months), had no evidence of current or past neurological disorder (e.g., epilepsy), had no history of head trauma with loss of consciousness exceeding 1 h, had no moderate or severe substance use disorder in the past three months per DSM-5, and sufficient ability to understand spoken and written English. Antipsychotic medication type and dose were maintained by the participants’ treating psychiatrist. Diagnostic interviews and symptom ratings were carried out by clinical interviewers trained to UCLA certification standards (i.e., kappa >0.80 with a gold standard rater) and to standards established by the Treatment Unit of the Department of Veterans Affairs VISN 22 Mental Illness Research, Education, and Clinical Center (Ventura et al., 1993, 1998). The protocol received approval from the Institutional Review Boards at both UCLA and VA Greater Los Angeles Healthcare System. To ensure that participants provided informed consent, they were assessed for their capacity before proving written consent. Participants received financial compensation for their participation.

2.2. Measures

2.2.1. Interview-based motivation and expression

CAINS is the Clinical Assessment Interview for Negative Symptoms (CAINS; Kring et al., 2013). The CAINS is semi-structured and consists of 2 subscales. The Motivation and Pleasure (MAP) subscale includes 9 items based on patients’ reports of experienced motivation, interest, and emotional experiences, as well as reported engagement in relevant social (e.g., family, romantic, and friend relationships), vocational (e.g., work, school, and volunteer), and recreational (e.g., hobbies, free time) activities, over the past week. The Expression (EXP) subscale includes 4 items based on interviewer ratings of affective and verbal expression. Each item is rated by an interviewer on a scale ranging from 0 to 4 with higher scores reflecting greater impairment during the previous week. Both the MAP and EXP subscales scores were used in analyses.

2.2.2. Effort-based decision-making tasks

Detailed descriptions of each EBDM task, along with relevant modifications for individuals with psychotic disorders, are provided in prior publications (Reddy et al., 2015) and are briefly summarized here.

The Effort Expenditure for Rewards Task (EEfRT; Barch et al., 2014; Treadway et al., 2009) involves participants selecting between easy or hard button-pressing tasks for variable amounts of reward. The “hard” task required participants to make a specific number of button presses using their non-dominant pinkie finger on a computer keyboard within 30 s, which was calibrated individually for each participant. In contrast, the “easy” task required only one-third of the button presses to be made using their dominant index finger within 7 s. The task consisted of 50 trials, and the entire administration process took approximately 25 min. The easy task was always worth $1.00, and the hard task ranged in reward value from $1.24 to $4.30. The rewards for the hard task were grouped into low, medium, and high bins for analysis, and the key measure was the percentage of choices for the hard task comparing the low versus high level of reward. While probability manipulation was used in this adapted task, including 50 % and 88 % probability levels, we did not consider it as a factor in the current set of analyses.

The Balloon Effort Task (Gold et al., 2013), which is similar to the EEfRT, requires alternating button presses on a gamepad using the left and right index fingers to pop a computer image of a balloon. Participants were told that they would make decisions between 2 response alternatives: an easy option (trials that involved ten button presses) with a lower reward and a more difficult option (hard trials that involved 100 button presses) with a higher reward. There was no set time limit for completing the task. Participants underwent a total of 40 trials, with eight trials per reward level. On average, the task was completed in approximately 25 min. Participants were informed that three trials would be randomly selected from each task to determine their earnings, and the amount would be made known to the participant at the end of each task and paid at the end of the assessment. The easy trials were worth $1, and the hard trials ranged in value from $3 to $7. We calculated the percentage of hard choices at each of the reward levels.

The Deck Choice Effort Task (Kool et al., 2010; McGuire and Botvinick, 2010) is a cognitive effort task that requires participants to choose between easy or hard conditions of a mental operation task across three levels of rewards by selecting one of two decks of cards. The color of the card within a deck indicates the mental operation to be performed. For the “easy” deck, the cards are all the same color and thus require only a single mental operation to be performed such as determining whether a number is odd or even. For the “hard” deck, the cards alternate between two colors, thus requiring alternating mental operations, e.g., blue card = deciding whether a number is odd/even; red card = deciding whether a number is > or <5. Hard and easy trials were explicitly labeled as well. Participants practiced until they reached 70 % accuracy on the easy and hard tasks before choosing each of the 36 trials. The easy deck always earns a $0.10 reward, while the hard deck includes an equal number of trials worth $0.10, $0.20, and $0.40. Each trial consisted of ten cards, and the task took approximately 20 min to complete. We calculated the percentage of hard choices at each reward level.

For the EEfRT ($5) and Balloon Effort Task ($7), all participants received the same amount of financial reward at the end of the tasks period regardless of performance. For the Deck Choice Effort Task, compensation was tied to performance and participants received between $3 and $7.

2.2.3. Engagement in IPS services

All participants were newly enrolled in supported employment services provided under the IPS model. IPS is an evidence-based model that emphasizes rapid job search, integration within a multidisciplinary treatment team, attention to the individual’s job preferences, and continuous follow-along support. IPS engagement was defined behaviorally as the number of in-person sessions attended with participants’ supported employment specialists over the first four months after enrollment. We followed newly enrolled IPS participants for four months from program entry to measure engagement, which is similar to a definition used in a recent IPS study (Haslett et al., 2014). Per the IPS model, job search efforts with the assistance of the employment specialist begin within several weeks after enrollment. As seen in Table 1, participants averaged around 5 sessions with their IPS employment specialist (range: 1 to 12 sessions).

Table 1.

Descriptive and demographic data (N = 47).

Variable M (SD) or %
Demographics
 Age 44.2 (14.9)
 Gender (% identified male) 84 %
 Race
  White 46 %
  Black 36 %
  Asian 12 %
  Other 6 %
 Ethnicity - Hispanic 44 %
 Education 12.8 (1.3)
 Schizophrenia diagnosis 58 %
 Illness chronicity (years) 18.1 (12.9)
 MCCB composite score 38.1 (7.8)
 Antipsychotic medication
 Atypical 78 %
BPRS symptoms
 Positive symptoms 7.3 (2.9)
CAINS negative symptoms
 Motivation and pleasure 19.4 (8.0)
 Expression 6.7 (5.4)
 IPS attendance 5.0 (2.8)

Note. MCCB = MATRICS Consensus Cognitive Battery; BPRS = Brief Psychiatric Rating Scale; CAINS = Clinical Assessment Interview for Negative Symptoms; IPS = Individual Placement and Support.

2.3. Procedures

The assessments, including clinical symptoms (Brief Psychiatric Rating Scale; Ventura et al., 1993), negative symptoms, neurocognition (MATRICS Consensus Cognitive Battery; Nuechterlein and Green, 2006), and EBDM tasks, were conducted at baseline before the patients started IPS.

The primary measure for each task is a difference score which provides an index of the amount of effort exerted across varying reward levels: the number of hard choices out of the total possible at the highest reward level minus the number of hard choices out of the total possible at the lowest reward level [(no. hard / no. possible hard at highest reward level) – (no. hard / no. possible hard at lowest reward level)]. Higher scores indicate a greater willingness to exert effort for large vs. small rewards. These EBDM paradigms, adapted for use with psychotic disorders, were previously evaluated and shown to be reliable with good construct validity (Horan et al., 2015; Reddy et al., 2015). Specifically, the difference score showed acceptable test-retest reliability, negligible practice effects, and consistent external validity with measures of neurocognition, negative symptoms, and functioning. We counter-balanced the order of administration of the EBDM tasks. See Fig. S1 in supplementary materials for the distribution of data for the three EBDM tasks.

Of note, difference scores can be problematic due to inflexible responders who consistently choose either 100 % hard or 100 % easy tasks across all reward levels on each of the effort paradigms. In such cases, assigning both types of inflexible responders a value of “0” could be misleading since they represent subtypes of participants with different willingness to exert effort for rewards. To avoid this issue, we excluded participants who consistently selected hard tasks across all reward levels, thus eliminating subjects from the analysis who had no room to demonstrate increases in effort allocation with increased reward. The removal of these inflexible responders resulted in sample sizes of 38 for the Deck Choice Task, 38 for the Balloon Task, and 47 for the Effort Expenditure for Rewards Task. See supplementary materials for a table (Table S1) that summarizes the level of IPS sessions attended for inflexible responders who chose always hard, inflexible responders who chose always easy, and flexible responders.

2.4. Statistical analysis

Analyses were conducted in three steps. First, descriptive statistics were computed for each of the variables. Second, Pearson correlational analyses were to determine the degree to which IPS engagement (i.e., number of sessions attended) was related to baseline interview-based motivation and expression and performance on the three EBDM tasks. Third, follow-up hierarchical regressions were conducted to examine the amount of variance in IPS engagement that was explained by interview-based motivation and expression deficits (step 1), and then by motivation deficits along with any significant EBDM task variable from the previous correlational analyses (step 2). All tests were two-tailed, and all variables were normally distributed (skew <1.0, kurtosis <1.5).

3. Results

Table 1 presents the demographic, cognitive, and clinical characteristics of the sample. This outpatient sample was chronically ill and, on average, had moderate levels of symptoms. Mean MCCB scores are typical for this type of sample. Demographic characteristics (e.g., age, gender, race, ethnicity, education) and neurocognition were generally unrelated to IPS engagement.

Associations between IPS engagement and interview-based motivation and expression deficits are shown in Table 2. The relationship between CAINS MAP and IPS engagement approached significance, while CAINS EXP was linked with IPS engagement. Performance on the Balloon Effort Task (i.e., greater willingness to exert effort for large vs. small rewards) was significantly associated with a higher number of sessions attended. Performances on the Deck Choice Effort Task and EEfRT were not linked with IPS engagement. Also, CAINS MAP scores were not associated with the three EBDM tasks.

Table 2.

Correlations between motivation measures, expression, and IPS engagement (n = 38–47).

CAINS MAP CAINS EXP Effort Expenditure for Rewards Task Balloon Effort Task Deck Choice Effort Task IPS sessions
CAINS MAP 0.70** 0.01 −0.15 −0.06 −0.26 t
CAINS EXP −0.02 −0.39* 0.03 −0.34*
Effort Expenditure for Rewards Taska 0.34* 0.56** 0.03
Balloon Effort Taska 0.49** 0.38*
Deck Choice Effort Taska 0.02
IPS sessions

Note. Individual Placement and Support; CAINS = Clinical Assessment Interview for Negative Symptoms; MAP = Motivation and Pleasure; EXP = Expression. t < 0.10.

a

Difference scores were used as the primary measure for each task, with higher values indicating greater willingness to exert effort for large vs. small rewards.

*

p < .05.

**

p < .01.

Follow-up regression analyses are shown in Table 3. In Step 1, 16 % of the variance was explained by the CAINS MAP and EXP scores. CAINS MAP was not a statistically significant predictor of IPS engagement. The relationship between CAINS EXP and IPS engagement approached significance. The overall model also approached significance (F = 3.22, p = .06). In Step 2, performance on the Balloon Effort Task was added to the model because it was significantly linked with IPS engagement in the correlational analyses. An additional 10 % of the variance was explained (total R2 = 26 %) and the overall model for Step 2 was significant (F = 3.83, p = .02). Of the three variables in Step 2, only the Balloon Effort Task was significantly linked with IPS engagement.

Table 3.

Multiple regression for the prediction of IPS engagement by motivation measures.

R 2 R2 change F β t
Step 1 overall model 0.16 3.22t
 CAINS MAP   0.01   0.04
 CAINS EXP   0.41 −1.91t
Step 2 overall model 0.26 0.10 3.83*
 CAINS MAP −0.05 −0.24
 CAINS EXP −0.21 −0.97
 Balloon Effort Task   0.36   2.10*

Note. IPS = Individual and Placement Services, CAINS = Clinical Assessment Interview for Negative Symptoms, MAP = Motivation and Pleasure, EXP = Expression.

t

p < .10.

*

p < .05.

4. Discussion

This study examined interview-based motivation and performance-based measures of motivation (i.e., EBDM tasks) as determinants of engagement in IPS among a sample of individuals with psychotic disorders. The relationship between interview-based motivation and IPS engagement approached significance. This finding is inconsistent with prior studies that have shown interview-based motivation deficits as significant clinical correlates of work outcomes (e.g., job tenure, hours worked, wages) in psychotic disorders (McGurk et al., 2003; McGurk and Meltzer, 2000; Saperstein et al., 2011). Interestingly, interview-based expressive deficits were linked with fewer attended IPS sessions. Our primary finding was that the level of EBDM performance, specifically on the Balloon Effort Task, explained unique variance in IPS engagement above and beyond interview-based motivation deficits, accounting for an additional 10 % of the variance beyond interview-based motivation deficits (total R2 = 26 %). Overall, these findings help explain some of the unaccounted-for variance in supported employment outcomes, provide insight into potential neural mechanisms underlying suboptimal IPS engagement, and indicate modifiable personal variables that can improve outcomes in supported employment programs.

The Balloon Effort Task was the only EBDM task significantly associated with IPS engagement. It may be that effort-based measures of motivation that require physical (versus cognitive) effort are more closely associated with demands of attending the IPS sessions (i.e., physically leaving residence and going to the clinic). The EEfRT also involved physical effort, but the Balloon Effort Task might be experienced as more demanding than the EEfRT. Indeed, the overall mean difference score for the EEfRT task (0.32) was higher compared to the Balloon Effort Task (0.25), suggesting that patients were more willing to exert effort for large vs. small rewards in the EEfRT task compared to the Balloon Effort Task. Alternatively, differences in perceived certainty of receiving a reward on the EEfRT (i.e., probability manipulation) and Deck Choice Task (i.e., compensation tied to performance) may explain why the Balloon Effort Task was the only EDBM task linked with IPS engagement. Finally, it is worth noting that EBDM tasks, like the Balloon Effort Task, incorporate several distinct processes that may have contributed to poor IPS engagement. For example, a patient may have deficits in evaluating the subjective value of the potential reward (i.e., monetary rewards from work), predicting the likelihood of receiving the reward (i.e., obtaining a job), estimating the subjective effort cost (i.e., commuting to a clinic and participating in job interviews), and processing the perceived costs and benefits in decision making (Green et al., 2015). Any of these specific processes or combinations thereof may contribute to poor IPS engagement.

Abnormal effort-based decision-making may explain why some individuals receiving IPS services experience suboptimal engagement and subsequently poor work outcomes. Patients may perceive the cost of meaningful engagement in IPS to be greater than the potential benefit of securing a job. Such costs could include arranging transportation to scheduled sessions, commuting to their respective mental health center, navigating through the traffic of Los Angeles, the effort associated with searching for employment and discussing job preferences with the mental health treatment team. Interview-based motivation may not have been specifically related to IPS engagement because clinical interviews like the CAINS are broader in scope and measure interest and emotional experience, as well as reported engagement across multiple activities (e.g., social, vocational, and recreational activities). Interview-based expression was significantly linked to IPS engagement in correlational analyses, and trending in regression analyses. A previous study (Llerena et al., 2018) did not observe significant associations between expressive deficits and job obtainment. Additional research is needed to understand the precise relationships between expression deficits and work outcomes in patients with psychotic disorders.

Our results provide the support that performance-based measures of motivation can be used to identify patients with low motivation above and beyond measures that rely on a clinical interview of a patient’s self-report. Assessment of EBDM and motivation in patients with psychotic disorders before IPS may provide insight into initial and sustained engagement and an opportunity for focused discussions intended to enhance commitment (Mueser et al., 2016). For example, motivational interviewing, which is a person-centered therapeutic approach that strengthens intrinsic motivation for positive behavior change by resolving ambivalence and promoting self-efficacy, is an effective and brief method for enhancing task-specific motivation to engage in a behavioral intervention (Choi and Medalia, 2010). MI can enhance aberrant effort-based decision-making by exploring the participant’s views about his or her vocational functioning and abilities, providing information on how job obtainment and maintenance can be achieved through collaborative IPS, conducting a decisional balance activity to weigh the pros and cons of pursuing a job, and building motivation for change. In other psychosocial interventions for schizophrenia, particularly cognitive remediation, 2–3 sessions of motivational interviewing before cognitive training have also been found to increase both motivations attributed to cognitive learning and subsequent session attendance (Fiszdon et al., 2016, 2022). To our knowledge, no study has been conducted to augment IPS with systematic motivational enhancement techniques. However, recent efforts have been made to enhance the positive outcomes of IPS by supplementing it with social skills training (Christensen et al., 2015), cognitive remediation (McGurk et al., 2015), and digital tools that enhance direct service and streamlined workflow in the IPS process (Lord et al., 2014).

The study has several limitations. First, our sample size was modest, which limited the statistical power and generalizability of the findings. Relatedly, the Balloon Effort Task and Deck Choice Effort Task had a relatively high proportion of inflexible responders, which could have also impacted power and led to a bias in the sample. Second, we focused only on one supported employment outcome, namely the number of IPS sessions attended. Assessing the role of EBDM as a determinant of other important work outcomes, such as successful job obtainment, job tenure (measured by the number of weeks and hours worked), and wages earned, will require additional longitudinal assessments (i.e., beyond the four months used in this study). These potential analyses may reveal connections between performance on the EEfRT with work outcomes as Horan et al. (2015) previously observed links between EEfRT performance and the work functioning subscale of the Role Functioning Scale. Third, we were unable to assess the role of IPS program fidelity. Program variables may be as important in predicting supported employment outcomes as individual motivation levels (Becker et al., 2001). Fourth, the range of IPS sessions attended was low. However, this attendance level reflects engagement in community-based, service delivery settings with real-world challenges, conditions, and behaviors, thus enhancing the study’s ecological validity. Fifth, the study’s focus was on motivation as a determinant of IPS engagement. Hence, we did not assess other possible personal factors or practical logistical challenges that could influence employment in schizophrenia separate from a patient’s level of motivation. These factors could include internalized/externalized stigma, self-esteem, social support, transportation arrangement and costs, economic disincentives, or incarceration history (Evensen et al., 2017; Marwaha and Johnson, 2004; Rössler et al., 2019).

The findings of this study suggest that evaluating and addressing motivational deficits may be beneficial to IPS engagement, which in turn affects obtaining competitive employment and improving the trajectory of work outcomes. Specifically, individuals with aberrant EBDM may benefit from structured motivational enhancement interventions early in IPS delivery or other supported employment interventions to improve engagement, job obtainment, and job maintenance over time. These findings highlight the importance of motivation deficits to understanding the heterogeneity in work outcomes observed in IPS and supported employment services more broadly.

Supplementary Material

SS1

Acknowledgment

The authors would like to thank the study participants for volunteering their time, and the research staff for their aid in collecting and processing data.

Financial support

This study was supported by the National Institute of Mental Health (R21 MH110753; RSK – Principal Investigator). TPL is supported by an institutional training grant from the National Institutes of Health (T32 MH122395). The funding sources were not involved in study design, collection, analysis and interpretation of data, or writing of the manuscript.

Footnotes

CRediT authorship contribution statement

TPL: conceptualization, formal analysis, writing - original draft, writing - review, and editing, MFG: conceptualization, supervision, resources, writing - review and editing, JKW: assistance with data interpretation, writing - review and editing, JEI: project administration, RLF: project administration, AK: project administration, RSK: funding acquisition, study design and conceptualization, investigation, project administration, data curation, writing - review and editing.

Declaration of competing interest

RSK is a consultant for MATRICS Assessment, Inc., a non-profit organization formed after the selection of the final MATRICS Consensus Cognitive Battery (MCCB) to allow its distribution and receives financial compensation for his efforts in this role. The rest of the authors report no biomedical financial interests or potential conflicts of interest.

Appendix A. Supplementary data

Supplementary data to this article can be found online at https://doi.org/10.1016/j.schres.2023.11.003.

References

  1. Barch DM, Treadway MT, Schoen N, 2014. Effort, anhedonia, and function in schizophrenia: reduced effort allocation predicts amotivation and functional impairment. J. Abnorm. Psychol 123, 387–397. 10.1037/A0036299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Becker DR, Smith J, Tanzman B, Drake RE, Tremblay T, 2001. Fidelity of supported employment programs and employment outcomes. Psychiatr. Serv 52, 834–836. 10.1176/APPI.PS.52.6.834. [DOI] [PubMed] [Google Scholar]
  3. Bond GR, Resnick SG, Drake RE, Xie H, McHugo GJ, Bebout RR, 2001. Does competitive employment improve nonvocational outcomes for people with severe mental illness? J. Consult. Clin. Psychol 69, 489–501. 10.1037//0022-006X.69.3.489. [DOI] [PubMed] [Google Scholar]
  4. Bond GR, Drake RE, Becker DR, 2008. An update on randomized controlled trials of evidence-based supported employment. Psychiatr. Rehabil. J 31, 280–290. 10.2975/31.4.2008.280.290. [DOI] [PubMed] [Google Scholar]
  5. Cathomas F, Klaus F, Guetter K, Seifritz E, Hartmann-Riemer MN, Tobler PN, Kaiser S, Kaliuzhna M, 2021. Associations between negative symptoms and effort discounting in patients with schizophrenia and major depressive disorder. Schizophr. Bull. Open 2. 10.1093/SCHIZBULLOPEN/SGAB022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Chang WC, Westbrook A, Strauss GP, Chu AOK, Chong CSY, Siu CMW, Chan SKW, Lee EHM, Hui CLM, Suen YM, Lo TL, Chen EYH, 2020. Abnormal cognitive effort allocation and its association with amotivation in first-episode psychosis. Psychol. Med 50, 2599–2609. 10.1017/S0033291719002769. [DOI] [PubMed] [Google Scholar]
  7. Choi J, Medalia A, 2010. Intrinsic motivation and learning in a schizophrenia spectrum sample. Schizophr. Res 118, 12–19. 10.1016/J.SCHRES.2009.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Christensen TN, Nielsen IG, Stenager E, Morthorst BR, Lindschou J, Nordentoft M, Eplov LF, 2015. Individual placement and support supplemented with cognitive remediation and work-related social skills training in Denmark: study protocol for a randomized controlled trial. Trials 16, 1–10. 10.1186/S13063-015-0792-0/TABLES/5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Cohen AS, Schwartz E, Le TP, Fedechko T, Kirkpatrick B, Strauss GP, 2019. Using biobehavioral technologies to effectively advance research on negative symptoms. World Psychiatry 18, 103. 10.1002/wps.20593. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Cooper JA, Barch DM, Reddy LF, Horan WP, Green MF, Treadway MT, 2019. Effortful goal-directed behavior in schizophrenia: computational subtypes and associations with cognition. J. Abnorm. Psychol 128, 710. 10.1037/ABN0000443. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Culbreth AJ, Moran EK, Barch DM, 2018. Effort-based decision-making in schizophrenia. Curr. Opin. Behav. Sci 22, 1–6. 10.1016/J.COBEHA.2017.12.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. De Hert M, Correll CU, Bobes J, Cetkovich-Bakmas M, Cohen DAN, Asai I, Detraux J, Gautam S, Möller HJ, Ndetei DM, Newcomer JW, Uwakwe R, Leucht S, 2011. Physical illness in patients with severe mental disorders. I. Prevalence, impact of medications and disparities in health care. World Psychiatry 10, 52–77. 10.1002/J.2051-5545.2011.TB00014.X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Dixon LB, Dickerson F, Bellack AS, Bennett M, Dickinson D, Goldberg RW, Lehman A, Tenhula WN, Calmes C, Pasillas RM, Peer J, Kreyenbuhl J, 2010. The 2009 schizophrenia PORT psychosocial treatment recommendations and summary statements. Schizophr. Bull 36, 48–70. 10.1093/SCHBUL/SBP115. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Dixon LB, Holoshitz Y, Nossel I, 2016. Treatment engagement of individuals experiencing mental illness: review and update. World Psychiatry 15, 13–20. 10.1002/WPS.20306. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Docx L, De La Asuncion J, Sabbe B, Hoste L, Baeten R, Warnaerts N, Morrens M, 2015. Effort discounting and its association with negative symptoms in schizophrenia. Cogn. Neuropsychiatry 20, 172–185. 10.1080/13546805.2014.993463. [DOI] [PubMed] [Google Scholar]
  16. Drake RE, Bond GR, Becker DR, 2012. Individual placement and support: an evidence-based approach to supported employment. In: Individ. Place. Support An Evidence-Based Approach to Support. Employ 9780199734016, pp. 1–204. 10.1093/ACPROF:OSO/9780199734016.001.0001. [DOI] [Google Scholar]
  17. Drake RE, Cimpean D, Torrey WC, 2022. Shared Decision Making in Mental Health: Prospects for Personalized Medicine, vol. 11, pp. 455–463. 10.31887/DCNS.2009.11.4/REDRAKE. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Evensen S, Ueland T, Lystad JU, Bull H, Klungsøyr O, Martinsen EW, Falkum E, 2017. Employment outcome and predictors of competitive employment at 2-year follow-up of a vocational rehabilitation programme for individuals with schizophrenia in a high-income welfare society. Nord. J. Psychiatry 71, 180–187. 10.1080/08039488.2016.1247195. [DOI] [PubMed] [Google Scholar]
  19. Fervaha G, Agid O, Foussias G, Remington G, 2013. Impairments in both reward and punishment guided reinforcement learning in schizophrenia. Schizophr. Res 150, 592–593. 10.1016/J.SCHRES.2013.08.012. [DOI] [PubMed] [Google Scholar]
  20. Fiszdon JM, Kurtz MM, Choi J, Bell MD, Martino S, 2016. Motivational interviewing to increase cognitive rehabilitation adherence in schizophrenia. Schizophr. Bull 42, 327–334. 10.1093/SCHBUL/SBV143. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Fiszdon JM, Choi J, Wang K, Parente LT, Hallinan S, Burton E, Bell MD, Martino S, 2022. Motivational interviewing to enhance psychosocial treatment attendance in people with SMI. Schizophr. Res 246, 165–171. 10.1016/J.SCHRES.2022.06.015. [DOI] [PubMed] [Google Scholar]
  22. Gold JM, Strauss GP, Waltz JA, Robinson BM, Brown JK, Frank MJ, 2013. Negative symptoms of schizophrenia are associated with abnormal effort-cost computations. Biol. Psychiatry 74, 130–136. 10.1016/j.biopsych.2012.12.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Gold JM, Waltz JA, Frank MJ, 2015. Effort cost computation in schizophrenia: a commentary on the recent literature. Biol. Psychiatry 1–7. 10.1016/j.biopsych.2015.05.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Green MF, Horan WP, Barch DM, Gold JM, 2015. Effort-based decision making: a novel approach for assessing motivation in schizophrenia. Schizophr. Bull 41, 1035–1044. 10.1093/schbul/sbv071. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Haslett WR, McHugo GJ, Bond GR, Drake RE, 2014. Use of software for tablet computers to promote engagement with supported employment: results from an RCT. Psychiatr. Serv 65, 954–956. 10.1176/APPI.PS.201300275. [DOI] [PubMed] [Google Scholar]
  26. Heslin M, Howard L, Leese M, McCrone P, Rice C, Jarrett M, Spokes T, Huxley P, Thornicroft G, 2011. Randomized controlled trial of supported employment in England: 2 year follow-up of the Supported Work and Needs (SWAN) study. World Psychiatry 10, 132–137. 10.1002/J.2051-5545.2011.TB00035.X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Hoffmann H, Jäckel D, Glauser S, Mueser KT, Kupper Z, 2014. Long-term effectiveness of supported employment: 5-year follow-up of a randomized controlled trial. Am. J. Psychiatry 171, 1183–1190. 10.1176/APPI.AJP.2014.13070857. [DOI] [PubMed] [Google Scholar]
  28. Horan WP, Reddy LF, Barch DM, Buchanan RW, Dunayevich E, Gold JM, Marder SR, Wynn JK, Young JW, Green MF, 2015. Effort-based decision-making paradigms for clinical trials in schizophrenia: part 2-external validity and correlates. Schizophr. Bull 41, 1055–1065. 10.1093/schbul/sbv090. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Kadakia A, Catillon M, Fan Q, Williams GR, Marden JR, Anderson A, Kirson N, Dembek C, 2022. The economic burden of schizophrenia in the United States. J. Clin. Psychiatry 83. 10.4088/JCP.22M14458. [DOI] [PubMed] [Google Scholar]
  30. Kool W, McGuire JT, Rosen ZB, Botvinick MM, 2010. Decision making and the avoidance of cognitive demand. J. Exp. Psychol. Gen 139, 665–682. 10.1037/A0020198. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Kring AM, Barch DM, 2014. The motivation and pleasure dimension of negative symptoms: neural substrates and behavioral outputs. Eur. Neuropsychopharmacol 24, 725–736. 10.1016/J.EURONEURO.2013.06.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Kring AM, Gur RE, Blanchard JJ, Horan WP, Reise SP, 2013. The Clinical Assessment Interview for Negative Symptoms (CAINS): final development and validation. Am. J. Psychiatry 170, 165–172. 10.1176/appi.ajp.2012.12010109. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Kukla M, McGuire AB, Salyers MP, 2015. Barriers and Facilitators Related to Work Success for Veterans in Supported Employment: A Nationwide Provider Survey, vol. 67, pp. 412–417. 10.1176/APPI.PS.201500108. [DOI] [PubMed] [Google Scholar]
  34. Le TP, Najolia GM, Minor KS, Cohen AS, 2017. The effect of limited cognitive resources on communication disturbances in serious mental illness. Psychiatry Res. 248, 98–104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Le TP, Ventura J, Ruiz-Yu B, McEwen SC, Subotnik KL, Nuechterlein KH, 2022. Treatment Engagement in First-episode Schizophrenia: Associations Between Intrinsic Motivation and Attendance During Cognitive Training and an Aerobic Exercise Program. Manuscr. Submitt. Publ [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Lenze EJ, Rodebaugh TL, Nicol GE, 2020. A framework for advancing precision medicine in clinical trials for mental disorders. JAMA Psychiatry 77, 663–664. 10.1001/JAMAPSYCHIATRY.2020.0114. [DOI] [PubMed] [Google Scholar]
  37. Lin D, Kim H, Wada K, Aboumrad M, Powell E, Zwain G, Benson C, Near AM, 2022. Unemployment, homelessness, and other societal outcomes in patients with schizophrenia: a real-world retrospective cohort study of the United States Veterans Health Administration database: societal burden of schizophrenia among US veterans. BMC Psychiatry 22, 1–11. 10.1186/S12888-022-04022-X/TABLES/2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Llerena K, Reddy LF, Kern RS, 2018. The role of experiential and expressive negative symptoms on job obtainment and work outcome in individuals with schizophrenia. Schizophr. Res 192, 148–153. 10.1016/J.SCHRES.2017.06.001. [DOI] [PubMed] [Google Scholar]
  39. Lord SE, McGurk SR, Nicholson J, Carpenter-Song EA, Tauscher JS, Becker DR, Swanson SJ, Drake RE, Bond GR, 2014. The potential of technology for enhancing individual placement and support supported employment. Psychiatr. Rehabil. J 37, 99. 10.1037/PRJ0000070. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Mahmood Z, Keller AV, Burton CZ, Vella L, Matt GE, McGurk SR, Twamley EW, 2019. Modifiable Predictors of Supported Employment Outcomes Among People With Severe Mental Illness, vol. 70, pp. 782–792. 10.1176/APPI.PS.201800562. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Marwaha S, Johnson S, 2004. Schizophrenia and employment - a review. Soc. Psychiatry Psychiatr. Epidemiol 39, 337–349. 10.1007/S00127-004-0762-4. [DOI] [PubMed] [Google Scholar]
  42. McGuire JT, Botvinick MM, 2010. Prefrontal cortex, cognitive control, and the registration of decision costs. Proc. Natl. Acad. Sci. U. S. A 107, 7922–7926. 10.1073/PNAS.0910662107/SUPPL_FILE/PNAS.200910662SI.PDF. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. McGurk SR, Meltzer HY, 2000. The role of cognition in vocational functioning in schizophrenia. Schizophr. Res 45, 175–184. 10.1016/S0920-9964(99)00198-X. [DOI] [PubMed] [Google Scholar]
  44. McGurk SR, Mueser KT, Harvey PD, LaPuglia R, Marder J, 2003. Cognitive and symptom predictors of work outcomes for clients with schizophrenia in supported employment. Psychiatr. Serv 54, 1129–1135. 10.1176/APPI.PS.54.8.1129/ASSET/IMAGES/LARGE/ID14T3.JPEG. [DOI] [PubMed] [Google Scholar]
  45. McGurk SR, Mueser KT, Xie H, Welsh J, Kaiser S, Drake RE, Becker DR, Bailey E, Fraser G, Wolfe R, McHugo GJ, 2015. Cognitive enhancement treatment for people with mental illness who do not respond to supported employment: a randomized controlled trial. Am. J. Psychiatry 172, 852–861. 10.1176/APPI.AJP.2015.14030374. [DOI] [PubMed] [Google Scholar]
  46. Mueser KT, Becker DR, Torrey WC, Xie H, Bond GR, Drake RE, Dain BJ, 1997. Work and nonvocational domains of functioning in persons with severe mental illness: a longitudinal analysis. J. Nerv. Ment. Dis 185, 419–426. 10.1097/00005053-199707000-00001. [DOI] [PubMed] [Google Scholar]
  47. Mueser KT, Drake RE, Bond GR, 2016. Recent advances in supported employment for people with serious mental illness. Curr. Opin. Psychiatry 29, 196–201. 10.1097/YCO.0000000000000247. [DOI] [PubMed] [Google Scholar]
  48. Nuechterlein KH, Green MF, 2006. MATRICS Consensus Cognitive Battery Manual. MATRICS Assessment Inc, Los Angeles, CA. [Google Scholar]
  49. Paul KI, Moser K, 2009. Unemployment impairs mental health: meta-analyses. J. Vocat. Behav 74, 264–282. 10.1016/J.JVB.2009.01.001. [DOI] [Google Scholar]
  50. Reddy LF, Horan WP, Barch DM, Buchanan RW, Dunayevich E, Gold JM, Lyons N, Marder SR, Treadway MT, Wynn JK, Young JW, Green MF, 2015. Effort-based decision-making paradigms for clinical trials in schizophrenia: part 1-psychometric characteristics of 5 paradigms. Schizophr. Bull 41, 1045–1054. 10.1093/schbul/sbv089. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Reddy LF, Llerena K, Kern RS, 2016. Predictors of employment in schizophrenia: the importance of intrinsic and extrinsic motivation. Schizophr. Res 176, 462–466. 10.1016/J.SCHRES.2016.08.006. [DOI] [PubMed] [Google Scholar]
  52. Rössler W, Ujeyl M, Kawohl W, Nordt C, Lasalvia A, Haker H, Hengartner MP, 2019. Predictors of employment for people with mental illness: results of a multicenter randomized trial on the effectiveness of placement budgets for supported employment. Front. Psychol 10 10.3389/FPSYT.2019.00518. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Saperstein AM, Fiszdon JM, Bell MD, 2011. Intrinsic motivation as a predictor of work outcome after vocational rehabilitation in schizophrenia. J. Nerv. Ment. Dis 199, 672–677. 10.1097/NMD.0B013E318229D0EB. [DOI] [PubMed] [Google Scholar]
  54. Strauss GP, Whearty KM, Morra LF, Sullivan SK, Ossenfort KL, Frost KH, 2016. Avolition in schizophrenia is associated with reduced willingness to expend effort for reward on a Progressive Ratio task. Schizophr. Res 170, 198–204. 10.1016/J.SCHRES.2015.12.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Treadway MT, Buckholtz JW, Schwartzman AN, Lambert WE, Zald DH, 2009. Worth the ‘EEfRT’? The effort expenditure for rewards task as an objective measure of motivation and anhedonia. PLoS One 4. 10.1371/JOURNAL.PONE.0006598. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Twamley EW, Vella L, Burton CZ, Becker DR, Bell MD, Jeste DV, 2012. The efficacy of supported employment for middle-aged and older people with schizophrenia. Schizophr. Res 135, 100–104. 10.1016/J.SCHRES.2011.11.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Velligan DI, Diamond PM, Mintz J, Maples N, Li X, Zeber J, Ereshefsky L, Lam YWF, Castillo D, Miller AL, 2008. The use of individually tailored environmental supports to improve medication adherence and outcomes in schizophrenia. Schizophr. Bull 34, 483–493. 10.1093/SCHBUL/SBM111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Ventura J, Lukoff D, Nuechterlein KH, Liberman RP, Green MF, Shaner A, 1993. Brief Psychiatric Rating Scale expanded version 4.0: scales anchor points and administration manuale. Int. J. Methods Psychiatr. Res 3, 227–243. [Google Scholar]
  59. Ventura J, Liberman RP, Green MF, Shaner A, Mintz J, 1998. Training and quality assurance with the Structured Clinical Interview for DSM-IV (SCID-I/P). Psychiatry Res. 79, 163–173. 10.1016/S0165-1781(98)00038-9. [DOI] [PubMed] [Google Scholar]
  60. Waghorn G, Dias S, Gladman B, Harris M, Saha S, 2014. A multi-site randomised controlled trial of evidence-based supported employment for adults with severe and persistent mental illness. Aust. Occup. Ther. J 61, 424–436. 10.1111/1440-1630.12148. [DOI] [PubMed] [Google Scholar]
  61. Young JW, Markou A, 2015. Translational rodent paradigms to investigate neuromechanisms underlying behaviors relevant to amotivation and altered reward processing in schizophrenia. Schizophr. Bull 41, 1024–1034. 10.1093/SCHBUL/SBV093. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

SS1

RESOURCES