Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2019 Mar 1.
Published in final edited form as: Schizophr Res. 2017 Jun 30;193:69–76. doi: 10.1016/j.schres.2017.06.042

Relationship Between Effortful Motivation and Neurocognition in Schizophrenia

Andrew W Bismark 1,2, Michael L Thomas 2, Melissa Tarasenko 1, Alexandra L Shiluk 2, Sonia Y Rackelmann 2, Jared W Young 1,2,*, Gregory A Light 1,2
PMCID: PMC5754266  NIHMSID: NIHMS889926  PMID: 28673753

Abstract

Effortful motivation and reward valuation learning deficits are associated with negative symptoms and impaired cognition in schizophrenia (SZ) patients. Whereas clinical assessments of motivation and reward value typically rely upon clinician ratings or self-report scales, behavioral measures often confound these constructs. Simple reverse-translated behavioral tasks that independently quantify motivation and reward valuation—which could then be linked to cognition—may facilitate the development of pro-cognitive therapeutics by bridging the “preclinical-to-clinical” gap. This study determined whether novel behavioral measures of effortful motivation and reward valuation are associated with impaired cognition in SZ patients (n=36). Patients completed the Progressive Ratio Breakpoint task (PRBT; physical effort motivation) and the Probabilistic Learning Task (PLT; reward learning/valuation) in conjunction with the MATRICS Consensus Cognitive Battery (MCCB). SZ patients exhibited statistically significant deficits in global cognition and all individual MCCB subdomains. Significant correlations were observed between PRBT and MCCB global cognition (r=0.52), speed of processing (r=0.56) and attention vigilance (r=0.48) subdomains, but not with PLT or clinical symptoms. Results indicate that effort and reward learning deficits are dissociable targets that can improve our understanding of cognitive impairments associated among patients with SZ. More importantly, the results support the long-standing notion that the measurement of cognitive impairments in SZ is highly linked to a willingness to expend effort. The availability of a PRBT designed for use in both rodents and humans could improve our understanding of the nature of cognitive impairments in neuropsychiatric disorders and accelerate the development of novel pro-cognitive therapeutics.

Keywords: Physical effort, cognition, MCCB, translational, reward

INTRODUCTION

Schizophrenia (SZ) is a neuropsychiatric disorder characterized by marked cognitive deficits and psychosocial disability, with limited responses to the currently available treatments. To date, the only treatments approved for SZ address positive symptoms but not negative symptoms or cognitive deficits, despite the latter two predicting outcome (Green et al, 2000; Thomas et al, in press). The MATRICS Consensus Cognitive Battery (MCCB) was designed to provide researchers with a common set of standardized endpoints to be used in clinical trials targeting cognitive impairments associated with SZ. Unfortunately, no treatments have been approved that remediate cognitive deficits as measured by the MCCB, at least partially attributable to the widely recognized a “translational gap” between behaviorally informed animal models of pathology and human clinical ratings in patients (Hyman and Fenton, 2003; Young and Geyer, 2015). The Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS) and the NIMH Research Domain Criteria (RDoC) initiatives have sought to bridge this gap via dimensional classification of mental disorders within functional domains and thereby enable greater cross-species translation of paradigms of relevance for therapeutic development (Young & Geyer 2015; Cuthbert & Insel 2013; Geyer et al 2012, Markou et al 2009).

The negative symptoms of SZ, and amotivation specifically, have been linked to poor cognition (Fervaha et al, 2014, Foussais et al, 2015, Lin et al. 2013), decreased functional outcome (Fervaha et al, 2015, Lin et al. 2013), and represent an unmet therapeutic target. Despite a growing literature demonstrating the centrality of motivational impairments in SZ, clinical assessment is predominantly reliant upon self-report measures or clinician ratings, with few performance-based tasks available (Fervaha et al, 2014, 2015). To this end, animal work is beginning to drive effort-based clinical assessment tool development (Reddy et al, 2016; Horan et al, 2015; Green et al, 2015; Young and Markou, 2015) and leverage pre-clinical findings to translate paradigms across species. Disentangling the contribution of motivational impairments to cognitive test performances in SZ is a challenging undertaking, given that many existing behavioral assays of motivation (e.g. Effort-Expenditure for Rewards Task [EEfRT], or probabilistic learning tasks [PLTs]) impose additional cognitive task demands, e.g. reward learning, and/or working memory—domains impaired in SZ and significantly related to global cognitive performance (Markou et al 2013; Lewandowski et al, 2016). Thus, decreased performance on tasks that conflate measures of cognitive and motivational functioning, and limit interpretive clarity necessary for understanding a patient’s cognitive ability vs. observed performance. The potential impact of motivation on cognitive performance was raised previously by CNTRICS (Markou et al, 2013), but has only just begun to be assessed (Foussias et al 2015).

PLTs are commonly used to assess the motivation to pursue rewards and have been used as a principle model for experimentally testing motivation in SZ (Waltz et al, 2007). PLTs use explicit trial-by-trial feedback learning to shape choice behavior to approximate implicit stimulus reward contingencies (reward learning). The ability to accurately choose stimuli with frequencies approximating the reward contingencies is based upon internal assignment of the value of the competing choices (reward valuation). Research has demonstrated intact implicit memory in SZ (Soler et al, 2015; Perry et al, 2000) while showing differential relationships between reward anticipation and reward enjoyment in SZ, such that patients show reduced responses during reward anticipation and responses similar to non-psychiatric controls once reward in received (Barch & Dowd 2010, Dowd & Barch, 2013). However, recent research has shown that SZ patients have problems learning the differing values of rewarding choice alternatives (reward valuation) (Gold et al 2013). This failure to associate differing reward values to choices may be due to impairments in reward associative learning or to deficits in higher-level cognitive processes such as attentional or working memory mechanisms (Collins et al 2014, Gold et al 2013). Therefore, observed decreased performance on commonly used PLTs may be due to motivational, reward valuation, or higher-order cognitive dysfunction, obscuring interpretations of specific deficits. This lack of interpretive clarity may be limiting the development of more domain-specific preclinical assays for screening novel therapeutics.

Other methods used to quantify motivation have focused on measuring the effort expended to achieve a task-relevant reward (Robbins 2002, Kurniawan et al 2010, McCarthy et al, 2016). A recent set of papers highlighted the psychometric properties of several of these new effort-based decision-making paradigms and their utility for assessing relationships between motivation, negative symptoms, and cognition in SZ (Reddy et al 2015, Horan et al 2015, Green et al 2015, Markou et al 2013). Unfortunately, SZ performance deficits in these paradigms may derive from a failure to accurately value future rewards (reward valuation) and bias the effort/cost calculation for pursuing that reward. To minimize reward-related contributions to motivation measurements, a paradigm commonly used in animal studies to quantify effort, the progressive ratio breakpoint task (PRBT), has been recently adapted for human testing (Wolf et al 2014, Strauss et al 2016). A PRBT identifies the maximum effort a person/animal is willing to expend to achieve a “reward” by progressively increasing the number of responses required to attain that reward. The ‘breakpoint’ is the highest level of reward achieved before the animal ceases to make further responses to achieve additional rewards and is thought to be a direct behavioral measure of motivation. Although widely used in animal studies, the PRBT also has great potential in clinical research for quantifying effortful motivation without the reliance on heavy cognitive load, self-reports, or clinical rating scales.

Studies utilizing cognitive effort tasks in SZ have indicated that patients display decreased effort compared to healthy individuals and neurological controls; with decreased cognitive effort predicting changes in cognitive test performance in SZ (Morra et al 2015, Foussias et al 2015; Gorissen et al 2005; van Beilen et al 2005). Overlapping cognitive and motivational deficits in SZ highlight the growing concern that cognitive test performance in SZ may encapsulate both actual cognitive ability and the effort expended during assessment (Foussias et al 2015). Although cognitive and physical effort tasks may share some overlap in quantifying motivation, the current PRBT was explicitly designed to measure physical effort and minimize cognitive contributions. Using paradigms with minimal cognitive load can more clearly disentangle effort/motivation as a contributor to the assessment of cognition in SZ.

The PRBT and modified PLT were reverse-translated directly from established animal paradigms to provide more specific metrics of their measured constructs and more independently assess the contribution of effort and reward valuation to marked cognitive impairments of SZ patients. Since motivation is quantified as the amount of effort (behavioral or cognitive) an individual is willing to expend to gain some reward, untangling the core deficits in effort and reward valuation in SZ and how they independently relate to cognitive test performance, is particularly important. If the behavioral measures of effortful motivation and/or reward valuation are related to global cognition, they may be sensitive to changes in cognition in response to treatments. Characterization of impaired behavioral performance of SZ patients in these cross-species tasks could therefore accelerate the development of pro-cognitive therapeutics that target motivational and reward related systems. As it is unclear the role that effort or reward valuation play in cognitive test performance, this study was designed to determine if behavioral measures of effortful motivation and reward valuation are dissociable and independently associated with cognitive test performance in SZ. Given their measurement of motivation and reward valuation respectively, we hypothesized that performance on the PRBT and PLT would be independently and significantly associated with global cognitive performance in people with SZ.

METHODS

Participants

Thirty-six SZ patients between the ages of 18 and 61 years were recruited from a transitional care facility that primarily serves adults with diagnoses of SZ or schizoaffective disorder. Exclusion criteria for the study included: history of neurological disease, history of major head injury (LOC >15 mins), substance dependence within the last six months, severe systemic medical illness (e.g. Hepatitis C, HIV, insulin-dependent diabetes), IQ below 70, and difficulty with hearing, vision or English language comprehension that may interfere with the patient understanding consent, screening questions, and task directions. The Institutional Review Board of University of California, San Diego, has approved all experimental procedures (IRB#130874). All participants underwent an informed consent procedure, structured clinical diagnostic assessments including a modified Structured Clinical Interview for DSM-V Axis I disorders (SCID-I), and the Scales for the Assessment of Positive and Negative Symptoms (SAPS and SANS; Andreason 1983, 1984). All participants then underwent a cognitive assessment using the MCCB (the Mayer-Salovey-Caruso Emotional Intelligence Test was not administered due to concerns of fatigue and time limitations). The MCCB neurocognitive composite score was calculated using the mean of the domain T-scores as is consistent with prior publications (Lystad et al 2014). All experimental tasks were completed after cognitive testing with PLT administered prior to the PRBT. Participant demographics and mean clinical ratings are reported in Table 1.

Table 1.

Participant demographics.

Demographics (± s.d., Range) (n=36)
Mean Age (yrs.) 36.7(±12.5, 19–61)
Education 12.0(±2.1, 8–18)
Sex (% male) 52.8%
Smoking 0%*
Right Handedness 63.9%
Age of Onset (yrs.) 19.0 (±5.2, 4–30)
Illness Duration
(yrs.) 17.7 (±13.5, 1–47)
SAPS Total Score 5.31 (±4.7, 0–16)
SANS Total Score 6.42 (±4.1, 0–16)
*

The treatment facility is tobacco free, thus all participants were nicotine free for at least two months prior to study enrollment.

Progressive Ratio Breakpoint Task (PRBT)

Effortful motivation was quantified using the Progressive Ratio Breakpoint task (PRBT). This task required patients to rotate a digital 4-switch USB joystick handle in an indicated direction to receive a “reward” (50 points/level) on a progressive ratio schedule. Task instructions indicated that each participant was: 1. required to rotate the joystick in the indicated direction; 2. they would see a small white dot after 4 successful rotations as feedback for correctly completing the task; and 3. they were to earn as many points as possible, but that they could quit at any time. Participants were given no indication that “points” accumulated during the task held any value, explicit use, or were given otherwise encouraging words based on their point accumulation. Participants were given a short practice session to acclimate to the joystick rotations and task feedback. After completing the required number of rotations to complete each reward level, a screen appeared indicating they had earned 50 points, and the direction of the rotations alternated (i.e. clockwise to counter-clockwise). This alternation was meant to reduce perseverative motor effects. The task ended when patients completed all possible reward levels, verbally indicated they no longer wanted to continue the task, or failed to make a response for five minutes. The breakpoint was quantified as the largest number of levels completed before the subject chose to disengage with the task (i.e., “when the juice is no longer worth the squeeze”). The full task duration lasting approximately 10 minutes (Figure 1).

Figure 1.

Figure 1

Task structure of the Progressive Ratio Breakpoint Task (PRBT). Task began with instructions to rotate the joystick in direction indicated and that participants would earn points for completing levels. Participants were told to try to earn as many points as possible, but also explicitly told they could stop whenever they wanted.

Probabilistic Learning (PLT) Task

Reward value learning was quantified using a modified probabilistic learning task (PLT) that requires adapting behavior in response to feedback after choosing between two stimuli with differing reward/punishment probabilities (e.g. 80/20%). Stimulus reward probabilities included (80/20%, 70/30%, 60/40%, and 50/50%) and were presented in block format. The participant was required to indicate, via directional joystick level-press, which stimulus they thought was the most rewarding (target stimulus). For each stimulus pair, the target stimulus presentation side was pseudorandomized. Prior to the start of the task, each participant was instructed to choose which stimulus was the “better option,” and that they would receive feedback (“correct” vs. “incorrect”) on their choices. No other instructions were provided. Each of the four blocks consisted of 50 trials and total task time was approximately 10 minutes. Accuracy for choosing the more rewarding stimulus at the 80/20, 70/30, and 60/40 probability reward levels was calculated separately, and then averaged to provide a task-level measure of accuracy. Behavioral metrics for the 50/50 reward probability block were not used in the current analysis. Task-level accuracy was the primary outcome measure of reward valuation (Figure 2).

Figure 2.

Figure 2

Trial layout for the Probabilistic Learning Task (PLT). The task consisted of 200 trials (4 blocks of 50 trials each) with randomly assigned response size (L vs R).

Statistics

Univariate and multivariate linear regression models (see Cohen, Aiken, Aiken & West, 2013) including PRBT breakpoint scores and PLT accuracy scores as predictors were used to determine the unique contribution of each behavioral measure to cognition (MCCB total score). Estimates of variance explained (R2), standardized regression slopes (β) and Pearson correlations between predictors are reported. Correlations among PRBT breakpoint scores and PLT accuracy scores with MCCB scores and symptom ratings were examined for significance using a Bonferroni-corrected significance level of α = 0.0024 to adjust for multiple comparisons (Blanchard & Cohen 2006; Sayers et al. 1996). Single-sample t-tests were used to compare patients’ MCCB scores against the standardization sample. All statistical analyses were conducting using SPSS (IBM Corp., Armonk, NY, USA).

RESULTS

As shown in Figure 3, patients with SZ exhibited significant deficits in MCCB global cognition composite score as well as each of the individual cognitive domains: MCCB composite (t(35)=−11.9, p<0.001, d=1.82), speed of processing: (t(35)=−10.6, p<0.001, d=1.90), attention and vigilance (t(35)=−8.5, p<0.001, d=1.6), visual learning (t(35)=−11.9, p<0.001, d=1.80), verbal learning (t(35)=−16.1, p<0.001, d=1.97), working memory (t(35)=−7.9, p<0.001, d=1.50), and reasoning and problem solving (t(35)=−6.3, p<0.001, d=0.94) (Figure 3). Correlations among PRBT breakpoint scores, PLT accuracy scores, MCCB scores, and symptom ratings are reported in Table 2. There was a large significant positive correlation between PRBT breakpoint scores and MCCB composite scores. Bonferroni-corrected significance values for the correlations between the PRBT scores, PLT scores, and MCCB domain T-scores indicated the PRBT scores were positively and significantly correlated only with speed of processing (SOP; large effect) domain scores. A follow-up r-to-z comparison of correlations between the PBRT and PLT to the MCCB and all subtests yielded significantly higher intercorrelations between PRBT and MCCB composite and SoP compared to the PLT-cognition relationships (Supplementary Table 1). Additional correlations between PRBT and SoP subtests (Trials Making Test: Part A; Category Fluency: Animal Naming; and Symbol Coding) yielded significant correlations between PRBT and Trials A (r=0.52, p<0.01) and Symbol Coding (r=0.51, p<0.01), but no significant correlation with category fluency. PLT accuracy scores were not significantly correlated with PRBT scores or any of the MCCB measures. SANS and SAPS total scores were not significantly correlated with PRBT scores, but SAPS total scores were modestly and negatively correlated with PLT performance scores (but did not survive correction).

Figure 3.

Figure 3

Figure represents T-score comparisons between SZ patients in the current sample and normative data for MCCB total and domain scores.

Table 2.

Pearson correlations between behavioral tasks, MCCB composite, all subscale T-Scores, and SANS and SAPS total scores. Solid outlines indicate significant correlations with dashed outlines indicating trend level significance based on Bonferroni corrected p-values. Note: Relationships between behavioral task performance metrics, cognitive scores, and symptom ratings were the primary foci for the study. Although stronger inter-correlations between MCCB composite and subdomain scores are present, they have been highlighted in previous research and shown here merely for completeness.

graphic file with name nihms889926f5.jpg

MCCB composite scores were next regressed onto PRBT breakpoint scores and PLT accuracy scores independently and in a combined model. The combined model accounted for 29.0% of the variance in MCCB composite scores (F(2,33)=6.734, p<0.005). PBRT scores uniquely accounted for 23.9% of the variance in MCCB composite scores (b=2.09, β=0.488, p<0.004), while PLT accuracy scores uniquely accounted for 3.2% (b=0.091, β=0.156, p=0.302), with only 2.7% of the variance shared between PRBT scores, PLT scores, and MCCB composite scores (Figure 4).

Figure 4.

Figure 4

Behavioral measure variance components predicting cognition. Total model variance in cognition (MCCB Total score) accounted for was 29.0%. Overlapping areas depict the unique variance proportion for each predictor, PRBT 23.9%, PLT accuracy 3.2%, with the shared variance accounted for 2.7% of the variance in cognition. The PRBT and PLT share 0.5% of the variance with each other, independent of cognition.

DISCUSSION

Using reverse-translated tasks, the present study demonstrated that effortful motivation uniquely accounted for over a quarter of the variance in global cognition and was significantly associated with measures of processing speed and attention/vigilance in SZ patients. Significant correlations between SoP subtests (Trials A, Symbol Coding) indicate that PRBT is more heavily related to the physical effort components of SoP than the cognitive components (Category Fluency). Results further suggest that SZ patients’ willingness to exert physical effort is globally linked to performance on MCCB cognitive scales. In contrast, reward valuation only explained 3.2% of the variance in cognition. Hence, these data additionally demonstrate the domains of physical effort and reward valuation are dissociable.

To date, studies have either quantified motivation through clinician/self-report ratings or behaviorally via effort-cost paradigms. Clinical ratings of motivation typically consist of single-items, or a small subset of items drawn from other assessments. Although some studies have demonstrated inter-correlations within and across negative symptoms and motivation items (Fervaha et al 2015), follow-up correlations observed no significant correlations (all rs <0.25, ps>0.16) between PRBT and global or individual SANS items related to anhedonia or apathy scores were observed in the present study.

To increase the validity of motivational assessment and bridge the pre-clinical to clinical gap, research has begun to translate animal effort-cost decision-making paradigms to quantify motivation in humans. Previous clinical decision-making research has shown effort-cost calculations to be important in assessing motivation and cognition in SZ (Fervaha et al 2013, Reddy et al 2015, Fervaha et al 2015, Foussias et al 2015). Recent studies indicate that SZ patients display deficits on cognitive effort tasks, and that decreased cognitive effort is related to higher negative symptoms and overall lower cognitive test performance (Morra et al 2015, Gorissen et al 2015). Reduced performance on existing cognitive effort tasks may however be due to motivational deficits, cognitive impairments, or potentially malingering. The use of reverse translated behavioral effort tasks with minimal cognitive demands may begin to disentangle these relationships between motivational effort and cognitive test performance in SZ. Two recent studies have used reverse-translated progressive ratio tasks to behaviorally quantify motivation in SZ patients (Wolf et al 2014, Strauss et al, 2016). One study used trials comparing pairs of three- or four-digit numbers to assess which number was larger – potentially a cognitive effort task (Wolf et al, 2014), while the other involved trials where participants alternated button presses to inflate a balloon – a physical effort task (Strauss et al, 2016). Both tasks utilized progressive ratio schedules for monetary reinforcements but also explicitly told participants the number of trials required to reach the next reinforcement. The explicit notification of required effort for reinforcement is a key distinction from the current PRBT, and likely allowed subjects to make cognitive effort-cost appraisals but potentially weakening the direct translatability. Importantly, Strauss et al (2016) found that although task performance was moderately related to clinician rated motivation and functional outcomes, performance did not distinguish SZ from controls or relate to global cognition. Thus, despite positive strides toward behavioral characterization of motivation in SZ, the reliance on self-reports, clinician ratings, or more explicit measures of cognitive effort tasks may still undermine translatability. The findings of robust relationships among behavioral measures of physical effort and measures of cognition, support the view that cognitive performance deficits observed in SZ do not purely reflect ability but may likely be confounded by deficits in intrinsic motivation, producing inaccurate measures of cognition. Thus, behavioral measures of effortful motivation with minimal or no cognitive task demands could: 1) Maintain cross-species validity; 2) Provide more specific metrics of motivation; and 3) Provide a more valid basis for estimating the effects of motivation on cognitive performance in SZ.

This study used a reverse-translated progressive ratio task with primarily behavioral demands and little to no cognitive engagement. This quantification of effortful motivation refines its characterization by minimizing cognitive task demands, and so can theoretically leverage information from the animal literature. The current version of the PRBT has been used to evaluate aspects of motivation in healthy mice (Young et al, 2011; Young and Geyer, 2010) and amotivation in animal models of SZ (Cope et al, 2016; Young et al, 2015; Ward, 2015). Since the PRBT is reverse translated from animal work (where food is the primary reward for completing a level), this task was designed to balance participant engagement with cross-species validity. As prior studies using PRB tasks (Wolf et al 2014, Strauss et al 2016) explicitly utilize monetary rewards during task completion, this greatly increases the reward salience through explicit value of the rewards. By using “points,” it is our hope that by decreasing the reward salience and explicit value of potentially rewarding feedback, that we can begin to separate the overlapping constructs of effort and reward. This is supported by the weak correlation between the PRBT and the PLT (r=0.18), a task driven by rewarding feedback (correct vs incorrect). By using behavioral measures (such as the PRBT) to disentangle effortful motivation from highly interrelated constructs (e.g. reward valuation, working memory), we can more objectively quantify motivation and investigate how the willingness to exert effort may affect other measures. If objective and direct behavioral measures of motivation - which are less prone to human self-report or clinical rating biases - can be reliably linked to measures of cognition, learning, or functional outcomes in SZ; motivational biomarkers can be used as targets for pharmacological interventions designed to improve cognitive test performance via motivational enhancement.

Cross-species findings have demonstrated similarities in dopaminergic activity that may underlie motivational deficits. Recent research has shown that striatal-specific increases in mouse dopamine D2 receptors decreases breakpoints (Simpson et al 2012), and the administration of the dopamine D2 receptor antagonist haldoperidol, a commonly used antipsychotic, decreased breakpoints in mice during a progressive ratio choice task (Randall et al 2012). Human imaging work has further demonstrated that changes in striatal dopamine transmission were related to individual differences of effort exertion (Treadway et al., 2012b). It is therefore necessary to develop/utilize cross-species tasks with clearly defined behavioral metrics of effortful motivation and reward valuation with independent links to dopaminergic signaling. By establishing biomarkers indexing underlying neurochemistry that are sensitive to cognitive performance, we can begin to clarify the relationships between dopaminergic function, motivation, and cognition in SZ. Targeted interventions at the underlying neurochemical dysfunction in SZ could then be developed. The current data also indicate that drugs that increase breakpoint across species (e.g., modafinil, Young and Geyer, 2010; Stip et al, 2005) may well improve global cognitive functioning in patients with SZ. Additionally, improving effortful motivation in patients with SZ could synergistically enhance behavioral therapy training (Swerdlow 2012; Acheson et al, 2013). Likewise, we have shown that amphetamine potentiates the amount of perceptual learning during cognitive training exercises (Swerdlow et al, in press). Future studies using Structural Equation Modeling (SEM) may also be used to disentangle causal pathways (Thomas et al 2017) between effort and cognitive dysfunction in SZ. Therefore, the PRBT and PLT hold great utility for precision medicine by using simple laboratory based behavioral measures and help bridge the translational gap in the develop pro-cognitive therapeutics for cognitive impairments associated with SZ.

Several study limitation deserve discussion, most notably the lack of control comparison group. Although we have existing data for each of these tasks performed by healthy subjects, it comes from separate populations without similarly collected cognitive data and thus is unsuitable for direct comparison. Future studies will use these tests across both SZ and healthy subjects to ascertain specific behavioral relationships with cognition for between group comparisons. Whereas thee current study evaluated negative symptoms using the SANS, a well-established measure used in previous effort-cost studies in SZ (Gold et al, 2015, Treadway et al 2015, Foussias et al 2015), the small number of anhedonia-specific items may limit the ability to detect relationships among symptoms and behavioral performance. Other more recently developed measures of negative symptoms such as the Clinical Assessment Interview for Negative Symptoms (CAINS) may provide more sensitivity to detecting symptom-behavior relationships (Kring et al 2013). As in the vast majority of SZ studies, all patients were medicated at the time of testing, with most treated on a combination of typical and atypical antipsychotic mediation along with other psychotropics. While we did not include medication status/type as a factor in our analysis, behavioral measures were still sensitive to cognition with this medication-heterogeneous sample. Nonetheless, we cannot rule out the impact of antipsychotic medications on our findings; future randomized controlled trials are needed to disentangle potential medication effects (c.f. Light et al 2015; Rissling et al 2012). Fortunately, given the availability of this task in rodents the impact of chronic antipsychotic treatment on PRBT has begun to be examined (Heath et al 2015; Randall et al 2012; Wiley et al 2004). Finally, it is possible that the seemingly innocuous “points earned” running tally on the PRBT was more motivationally salient as a “reward” than anticipated and contributed to the effortful motivation relationships with cognition. Although it’s possible that the inclusion of this “feedback” may introduce some slight reward valuation component to the task, the small overlap in variance between the PRBT and the PLT, a specific measure of reward valuation, suggests minimal contribution. We acknowledge the PRBT is not a “reward free” measure of effort, but by minimizing reward salience and value, we hope to minimize the reward related contributions to PRBT performance. Additionally, the non-significant relationship between reward valuation and cognitive performance also indicates the relationship of effortful motivation to cognition would in fact be higher in the absence of potential reward valuation contributions to the PRBT.

In conclusion, the strategy of using novel reverse-translated laboratory measures like the PRBT and PLT together with existing gold standard measures of cognition can provide more direct cross-species relationships to aid development of pro-cognitive therapeutics. This translational approach may provide further utility by identifying individuals likely to benefit from treatment and identify those who may benefit from additional targeted pharmacological or psychosocial pre-treatments to help boost treatment gains and long-term functional outcomes. These data support our contention that quantifying physical effort is a missing piece in the neurocognitive assessment toolkit. Lastly, as motivational deficits may be present prior to full disease onset and signal poor outcomes, this approach may also facilitate early identification of individuals at elevated risk for developing pathologies with prominent amotivational phenotypes.

Supplementary Material

1
2
3
4

Acknowledgments

We would like to thank Mrs. Joyce Sprock, Ms. Wendy Zhang for their aid in the studies. We would also like to thank all of the patients and their families for their aid in participation.

Funding Disclosure: This work was supported by Sidney R. Baer Jr. Foundation, Brain and Behavioral Research Foundation, the Veteran’s Administration VISN 22 Mental Illness Research, Education, and Clinical Center, and R01MH104344.

Conflict of Interest: No other funding provided any input for this manuscript. Dr. Young has received funding from Cerca Insights and Lundbeck Ltd, and has received consulting compensation for Amgen, and honoraria from Arena Pharmaceuticals and Sunovian. Dr. Light has consulted for Astellas, Boehringer-Ingelheim, Heptares, Lundbeck, Merck, NeuroSig, and Takeda unrelated to this work. Drs. Bismark, Thomas, and Tarasenko, as well as Ms. Shiluk and Ms. Rackelmann report no extra funding sources.

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Contributors: Dr. Bismark aided in data collection, analysis, and was the primary writer. Dr. Thomas aided in statistical analysis and manuscript preparation. Dr. Tarasenko aided in data collection. Ms. Shiluk and Rackelman aided in data collection. Dr. Young aided in study design, analysis, and manuscript preparation. Dr. Light oversaw all study design, data collection, statistical analysis, and manuscript preparation.

References

  1. Acheson DT, Twamley EW, Young JW. Reward learning as a potential target for pharmacological augmentation of cognitive remediation for schizophrenia: a roadmap for preclinical development. Frontiers in Neuroscience. 2013;7 doi: 10.3389/fnins.2013.00103. http://doi.org/10.3389/fnins.2013.00103/abstract. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Andreason NC. Scale for the assessment of negative symptoms (SANS) University of Iowa; Iowa City: 1983. [Google Scholar]
  3. Andreason NC. Scale for the assessment of positive symptoms (SAPS) University of Iowa; Iowa City: 1984. [Google Scholar]
  4. Barch DM, Dowd EC. Goal Representations and Motivational Drive in Schizophrenia: The Role of Prefrontal-Striatal Interactions. Schizophrenia Bulletin. 2010;36(5):919–934. doi: 10.1093/schbul/sbq068. http://doi.org/10.1093/schbul/sbq068. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Berman I, Viegner B, Merson A, Allan E, Pappas D, Green AI. Differential relationships between positive and negative symptoms and neuropsychological deficits in schizophrenia. Schizophrenia Research. 1997;25(1):1–10. doi: 10.1016/S0920-9964(96)00098-9. [DOI] [PubMed] [Google Scholar]
  6. Blanchard JJ, Cohen AS. The Structure of Negative Symptoms Within Schizophrenia: Implications for Assessment. Schizophrenia Bulletin. 2006;32(2):238–245. doi: 10.1093/schbul/sbj013. http://doi.org/10.1093/schbul/sbj013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Buchanan RW, Javitt DC, Marder SR, Schooler NR, Gold JM, McMahon RP, Carpenter WT. The Cognitive and Negative Symptoms in Schizophrenia Trial (CONSIST): the efficacy of glutamatergic agents for negative symptoms and cognitive impairments. American Journal of Psychiatry. 2007 doi: 10.1176/appi.ajp.2007.06081358. [DOI] [PubMed] [Google Scholar]
  8. Collins AGE, Brown JK, Gold JM, Waltz JA, Frank MJ. Working Memory Contributions to Reinforcement Learning Impairments in Schizophrenia. The Journal of Neuroscience : the Official Journal of the Society for Neuroscience. 2014;34(41):13747–13756. doi: 10.1523/JNEUROSCI.0989-14.2014. http://doi.org/10.1523/JNEUROSCI.0989-14.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Cohen J, Cohen P, West SG, Aiken LS. Applied multiple regression/correlation analysis for the behavioral sciences. Routledge; 2013. [Google Scholar]
  10. Cope ZA, Powell SB, Young JW. Modeling neurodevelopmental cognitive deficits in tasks with cross-species translational validity. Genes, Brain and Behavior. 2016;15(1):27–44. doi: 10.1111/gbb.12268. http://doi.org/10.1111/gbb.12268. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Cuthbert BN, Insel TR. Toward the future of psychiatric diagnosis: the seven pillars of RDoC. BMC Medicine. 2013 May 14;11:126. doi: 10.1186/1741-7015-11-126. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Dowd EC, Barch DM. Pavlovian Reward Prediction and Receipt in Schizophrenia: Relationship to Anhedonia. PloS One. 2012;7(5):e35622–12. doi: 10.1371/journal.pone.0035622. http://doi.org/10.1371/journal.pone.0035622. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Fervaha G, Foussias G, Agid O, Remington G. Motivational deficits in early schizophrenia: Prevalent, persistent, and key determinants of functional outcome. Schizophrenia Research. 2015a;166(1–3):9–16. doi: 10.1016/j.schres.2015.04.040. http://doi.org/10.1016/j.schres.2015.04.040. [DOI] [PubMed] [Google Scholar]
  14. Fervaha G, Foussias G, Takeuchi H, Agid O, Remington G. Measuring motivation in people with schizophrenia. Schizophrenia Research. 2015b;169(1–3):423–426. doi: 10.1016/j.schres.2015.09.012. http://doi.org/10.1016/j.schres.2015.09.012. [DOI] [PubMed] [Google Scholar]
  15. Fervaha G, Graff-Guerrero A, Zakzanis KK, Foussias G, Agid O, Remington G. Journal of Psychiatric Research. Journal of Psychiatric Research. 2013;47(11):1590–1596. doi: 10.1016/j.jpsychires.2013.08.003. http://doi.org/10.1016/j.jpsychires.2013.08.003. [DOI] [PubMed] [Google Scholar]
  16. Fervaha G, Zakzanis KK, Foussias G, Graff-Guerrero A, Agid O, Remington G. Motivational Deficits and Cognitive Test Performance in Schizophrenia. JAMA Psychiatry. 2014;71(9):1058–8. doi: 10.1001/jamapsychiatry.2014.1105. http://doi.org/10.1001/jamapsychiatry.2014.1105. [DOI] [PubMed] [Google Scholar]
  17. Foussias G, Siddiqui I, Fervaha G, Mann S, McDonald K, Agid O, et al. Motivated to do well: An examination of the relationships between motivation, effort, and cognitive performance in schizophrenia. Schizophrenia Research. 2015;166(1–3):276–282. doi: 10.1016/j.schres.2015.05.019. http://doi.org/10.1016/j.schres.2015.05.019. [DOI] [PubMed] [Google Scholar]
  18. Geyer MA, Olivier B, Joels M, Kahn RS. From antipsychotic to anti-schizophrenia drugs: role of animal models. Trends in Pharmacological Science. 2012 Oct;33(10):515–21. doi: 10.1016/j.tips.2012.06.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Gold JM, Strauss GP, Waltz JA, Robinson BM, Brown JK, Frank MJ. Negative Symptoms of Schizophrenia Are Associated with Abnormal Effort-Cost Computations. Biological Psychiatry. 2013;74(2):130–136. doi: 10.1016/j.biopsych.2012.12.022. http://doi.org/10.1016/j.biopsych.2012.12.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Gorissen M, Sanz JC, Schmand B. Effort and cognition in schizophrenia patients. Schizophrenia research. 2005;78(2):199–208. doi: 10.1016/j.schres.2005.02.016. [DOI] [PubMed] [Google Scholar]
  21. Green MF. What are the functional consequences of neurocognitive deficits in schizophrenia? The American Journal of Psychiatry. 1996;153(3):321. doi: 10.1176/ajp.153.3.321. [DOI] [PubMed] [Google Scholar]
  22. Green MF, Kern RS, Braff DL, Mintz J. Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the “right stuff”? Schizophrenia Bulletin. 2000;26(1):119–136. doi: 10.1093/oxfordjournals.schbul.a033430. [DOI] [PubMed] [Google Scholar]
  23. Green MF, Horan WP, Barch DM, Gold JM. Effort-Based Decision Making: A Novel Approach for Assessing Motivation in Schizophrenia. Schizophrenia Bulletin. 2015;41(5):1035–1044. doi: 10.1093/schbul/sbv071. http://doi.org/10.1093/schbul/sbv071. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Heath CJ, Bussey TJ, Saksida LM. Motivational assessment of mice using the touchscreen operant testing system: effects of dopaminergic drugs. Psychopharmacology, (Berl) 2015;232:4043–4057. doi: 10.1007/s0213-015-4009-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Hyman SE, Fenton WS. Medicine. What are the right targets for psychopharmacology? Science (New York, NY) 2003;299(5605):350–351. doi: 10.1126/science.1077141. http://doi.org/10.1126/science.1077141. [DOI] [PubMed] [Google Scholar]
  26. Kring AM, Gur RE, Blanchard JJ, Horan WP, Reise SP. The clinical assessment interview for negative symptoms (CAINS): final development and validation. American Journal of Psychiatry. 2013;170(2):165–172. doi: 10.1176/appi.ajp.2012.12010109. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Kurniawan IT, Seymour B, Talmi D, Yoshida W, Chater N, Dolan RJ. Choosing to make an effort: the role of striatum in signaling physical effort of a chosen action. Journal of Neurophysiology. 2010;104:313–321. doi: 10.1152/jn.00027.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Lewandowski KE, Whitton AE, Pizzagalli DA, Norris LA, Öngür D, Hall MH. Reward Learning, Neurocognition, Social Cognition, and Symptomatology in Psychosis. Frontiers in Psychiatry. 2016;7(Suppl 9):3–9. doi: 10.3389/fpsyt.2016.00100. http://doi.org/10.3389/fpsyt.2016.00100. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Light GA, Swerdlow NR, Thomas ML, Calkins ME, Green MF, Greenwood TA, Pela M. Validation of mismatch negativity and P3a for use in multi-site studies of schizophrenia: characterization of demographic, clinical, cognitive, and functional correlates in COGS-2. Schizophrenia research. 2015;163(1):63–72. doi: 10.1016/j.schres.2014.09.042. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Lin CH, Huang CL, Chang YC, Chen PW, Lin CY, Tsai GE, Lane HY. Clinical symptoms, mainly negative symptoms, mediate the influence of neurocognition and social cognition on functional outcome of schizophrenia. Schizophrenia Research. 2013;146(1–3):231–237. doi: 10.1016/j.schres.2013.02.009. http://doi.org/10.1016/j.schres.2013.02.009. [DOI] [PubMed] [Google Scholar]
  31. Lystad JU, Falkum E, Mohn C, Haaland VØ, Bull H, Evensen S, Ueland T. The MATRICS consensus cognitive battery (MCCB): performance and functional correlates. Psychiatry research. 2014;220(3):1094–1101. doi: 10.1016/j.psychres.2014.08.060. [DOI] [PubMed] [Google Scholar]
  32. Markou A, Chiamulera C, Geyer MA, Tricklebank M, Steckler T. Removing obstacles in neuroscience drug discovery: the future path for animal models. Neuropsychopharmacology. 2009 Jan;34(1):74–89. doi: 10.1038/npp.2008.173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Markou A, Salamone JD, Bussey TJ, Mar AC, Brunner D, Gilmour G, Balsam P. Measuring reinforcement learning and motivation constructs in experimental animals: relevance to the negative symptoms of schizophrenia. Neuroscience Biobehavioral Reviews. 2013 Nov;37(9 Pt B):2149–65. doi: 10.1016/j.neubiorev.2013.08.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. McCarthy JM, Treadway MT, Bennett ME, Blanchard JJ. Inefficient effort allocation and negative symptoms in individuals with schizophrenia. Schizophrenia Research. 2016;170:278–284. doi: 10.1016/j.schres.2015.12.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Moran EK, Culbreth AJ, Barch DM. Ecological Momentary Assessment of Negative Symptoms in Schizophrenia: Relationships to Effort-Based Decision Making and Reinforcement Learning. Journal of Abnormal Psychology. 2016:1–12. doi: 10.1037/abn0000240. http://doi.org/10.1037/abn0000240. [DOI] [PMC free article] [PubMed]
  36. Morra LF, Gold JM, Sullivan SK, Strauss GP. Predictors of neuropsychological effort test performance in schizophrenia. Schizophrenia research. 2015;162(1):205–210. doi: 10.1016/j.schres.2014.12.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Perry W, Light GA, Davis H, Braff DL. Schizophrenia patients demonstrate a dissociation on declarative and non-declarative memory tests. Schizophrenia research. 2000;46(2):167–174. doi: 10.1016/s0920-9964(99)00229-7. [DOI] [PubMed] [Google Scholar]
  38. Randall PA, Pardo M, Nunes EJ, López Cruz L, Vemuri VK, Makriyannis A, et al. Dopaminergic Modulation of Effort-Related Choice Behavior as Assessed by a Progressive Ratio Chow Feeding Choice Task: Pharmacological Studies and the Role of Individual Differences. PloS One. 2012;7(10):1–10. doi: 10.1371/journal.pone.0047934. http://doi.org/10.1371/journal.pone.0047934. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Rissling AJ, Braff DL, Swerdlow NR, Hellemann G, Rassovsky Y, Sprock J, Pela M, Light GA. Disentangling early sensory information processing deficits in schizophrenia. Clinical Neurophysiology. 2012;123:1942–1949. doi: 10.1016/j.clinph.2012.02.079. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Robbins TW. The 5-choice serial reaction time task: behavioral pharmacology and functional neurochemistry. Psychopharmacology (Berl) 2002;163:362–380. doi: 10.1007/s00213-002-1154-7. [DOI] [PubMed] [Google Scholar]
  41. Sayers SL, Curran PJ, Mueser KT. Factor structure and construct validity of the Scale for the Assessment of Negative Symptoms. Psychological Assessment. 1996;8(3):269–280. http://doi.org/10.1037/1040-3590.8.3.269. [Google Scholar]
  42. Simpson EH, Waltz JA, Kellendonk C, Balsam PD. Schizophrenia in Translation: Dissecting Motivation in Schizophrenia and Rodents. Schizophrenia Bulletin. 2012;38(6):1111–1117. doi: 10.1093/schbul/sbs114. http://doi.org/10.1093/schbul/sbs114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Stip E, Trudeau LE. Glycine and D-serine improve the negative. Evidence Based Mental Health. 2005;8(82) doi: 10.1136/ebmh.8.3.82. [DOI] [PubMed] [Google Scholar]
  44. Strauss GP, Whearty KM, Morra LF, Sullivan SK, Ossenfort KL, Frost KH. Avolition in schizophrenia is associated with reduced willingness to expend effort for reward on a Progressive Ratio task. Schizophrenia Research. 2016;170(1):198–204. doi: 10.1016/j.schres.2015.12.006. http://doi.org/10.1016/j.schres.2015.12.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Soler MJ, Ruiz JC, Dasí C, Fuentes-Durá I. Implicit memory functioning in schizophrenia: Explaining inconsistent findings of word stem completion tasks. Psychiatry research. 2015;226(1):347–351. doi: 10.1016/j.psychres.2015.01.016. [DOI] [PubMed] [Google Scholar]
  46. Swerdlow NR. Beyond Antipsychotics: Pharmacologically-Augmented Cognitive Therapies (PACTs) for Schizophrenia. Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology. 2012;37(1):310–311. doi: 10.1038/npp.2011.195. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Swerdlow NR, Tarasenko M, Bhakta SG, Talledo J, Alvarez AI, Hughes EL, Rana B, Vinogradov S, Light GA. Amphetamine enhances gains in auditory discrimination training in adult schizophrenia patients. Schizophrenia Bulletin. doi: 10.1093/schbul/sbw148. (in press) [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Thomas ML, Green MF, Hellemann G, Sugar CA, Tarasenko M, Calkins ME, Light GA. Modeling Deficits From Early Auditory Information Processing to Psychosocial Functioning in Schizophrenia. JAMA Psychiatry. 2017;74(1):37–46. doi: 10.1001/jamapsychiatry.2016.2980.. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Treadway MT, Bossaller NA, Shelton RC, Zald DH. Effort-based decision-making in major depressive disorder: a translational model of motivational anhedonia. Journal of abnormal psychology. 2012;121(3):553. doi: 10.1037/a0028813. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. van Beilen M, van Zomeren EH, van den Bosch RJ, Withaar FK, Bouma A. Measuring the executive functions in schizophrenia: The voluntary allocation of effort. Journal of psychiatric research. 2005;39(6):585–593. doi: 10.1016/j.jpsychires.2005.02.001. [DOI] [PubMed] [Google Scholar]
  51. Waltz JA, Gold JM. Probabilistic reversal learning impairments in schizophrenia: further evidence of orbitofrontal dysfunction. Schizophrenia Research. 2007;93(1–3):296–303. doi: 10.1016/j.schres.2007.03.010. http://doi.org/10.1016/j.schres.2007.03.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Ward RD. Behavioral Neuroscience of Motivation. Springer International Publishing; 2015. Methods for Dissecting Motivation and Related Psychological Processes in Rodents; pp. 451–470. [DOI] [PubMed] [Google Scholar]
  53. Weiner E, Conley RR, Ball MP, Feldman S, Gold JM, Kelly DL, Buchanan RW. Adjunctive risperidone for partially responsive people with schizophrenia treated with clozapine. Neuropsychopharmacology. 2010;35(11):2274–2283. doi: 10.1038/npp.2010.101. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Wiley JL, Compton AD. Progressive ratio performance following challenge with antipsychotics, amphetamine, or NMDA antagonists in adult rats treated perinatally with phencyclidine. Psychopharmacology, (Berl) 2004;177:170–177. doi: 10.1007/s00213-004-1936-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Winstanley CA, Floresco SB. Deciphering Decision Making: Variation in Animal Models of Effort- and Uncertainty-Based Choice Reveals Distinct Neural Circuitries Underlying Core Cognitive Processes. The Journal of Neuroscience : the Official Journal of the Society for Neuroscience. 2016;36(48):12069–12079. doi: 10.1523/JNEUROSCI.1713-16.2016. http://doi.org/10.1523/JNEUROSCI.1713-16.2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Wolf DH, Satterthwaite TD, Kantrowitz JJ, Katchmar N, Vandekar L, Elliott MA, Ruparel K. Amotivation in Schizophrenia: Integrated Assessment With Behavioral, Clinical, and Imaging Measures. Schizophrenia Bulletin. 2014;40(6):1328–1337. doi: 10.1093/schbul/sbu026. http://doi.org/10.1093/schbul/sbu026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Young JW, Geyer MA. Action of Modafinil—Increased Motivation Via the Dopamine Transporter Inhibition and D1 Receptors? Biological Psychiatry. 2010;67(8):1–7. doi: 10.1016/j.biopsych.2009.12.015. http://doi.org/10.1016/j.biopsych.2009.12.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Young JW, Meves JM, Tarantino IS, Caldwell S, Geyer MA. Delayed procedural learning in α7-nicotinic acetylcholine receptor knockout mice. Genes, Brain and Behavior. 2011;10(7):720–733. doi: 10.1111/j.1601-183X.2011.00711.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Young JW, Geyer MA. Developing treatments for cognitive deficits in schizophrenia: the challenge of translation. Journal of Psychopharmacology (Oxford, England) 2015;29(2):178–196. doi: 10.1177/0269881114555252. http://doi.org/10.1177/0269881114555252. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Young JW, Markou A. Translational Rodent Paradigms to Investigate Neuromechanisms Underlying Behaviors Relevant to Amotivation and Altered Reward Processing in Schizophrenia. Schizophrenia Bulletin. 2015;41(5):1024–1034. doi: 10.1093/schbul/sbv093. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

1
2
3
4

RESOURCES