Skip to main content
PLOS One logoLink to PLOS One
. 2016 Apr 15;11(4):e0151299. doi: 10.1371/journal.pone.0151299

Cognitive Performance and Long-Term Social Functioning in Psychotic Disorder: A Three-Year Follow-Up Study

Claudia J P Simons 1,2,*, Agna A Bartels-Velthuis 3, Gerdina H M Pijnenborg 4,5; Genetic Risk and Outcome of Psychosis (GROUP) Investigators
Editor: Ruud van Winkel6
PMCID: PMC4833310  PMID: 27082629

Abstract

Objective

Studies have linked cognitive functioning to everyday social functioning in psychotic disorders, but the nature of the relationships between cognition, social cognition, symptoms, and social functioning remains unestablished. Modelling the contributions of non-social and social cognitive ability in the prediction of social functioning may help in more clearly defining therapeutic targets to improve functioning.

Method

In a sample of 745 patients with a non-affective psychotic disorder, the associations between cognition and social cognition at baseline on the one hand, and self-reported social functioning three years later on the other, were analysed. First, case-control comparisons were conducted; associations were subsequently further explored in patients, investigating the potential mediating role of symptoms. Analyses were repeated in a subsample of 233 patients with recent-onset psychosis.

Results

Information processing speed and immediate verbal memory were stronger associated with social functioning in patients than in healthy controls. Most cognition variables significantly predicted social functioning at follow-up, whereas social cognition was not associated with social functioning. Symptoms were robustly associated with follow-up social functioning, with negative symptoms fully mediating most associations between cognition and follow-up social functioning. Illness duration did not moderate the strength of the association between cognitive functioning and follow-up social functioning. No associations were found between (social) cognition and follow-up social functioning in patients with recent-onset psychosis.

Conclusions

Although cognitive functioning is associated with later social functioning in psychotic disorder, its role in explaining social functioning outcome above negative symptoms appears only modest. In recent-onset psychosis, cognition may have a negligible role in predicting later social functioning. Moreover, social cognition tasks may not predict self-reported social functioning.

Introduction

Although there is some variability in the literature, most studies suggest psychotic disorder is characterized by a stable, diminished performance on the majority of cognitive domains [1,2], which presents itself before the onset of psychosis, and becomes more pronounced around the first psychotic episode, so that cognitive performance drops from approximately 0.5 SD below the healthy control mean in the prodromal stage to 1 to 2 SD below the healthy control mean in the first episode [3,4]. However, the exact course and pattern of alteration in cognitive functioning, and its relationship to functional outcome, remain unclear.

The cognitive deficits associated with psychotic disorders are linked to everyday social functioning and may limit the rate of functional improvement [5]. Cognitive abilities [6] and social cognitive skills [7,8] are consistently associated with various domains of social functioning. Research suggests that cognitive abilities may have bottom-up causal influences on the acquisition of social or living skills and on the deployment of these skills in the real world [9] which influence social cognition, which in turn may influence social functioning [10,11]. Accumulating evidence supports the suggestion that social cognition may be a mediating link between cognition and social functioning (e.g. [1113], although social cognition may also explain unique variance in social functioning despite non-social cognitive underpinnings [7].

Despite the large body of evidence linking cognitive abilities to social functioning, literature shows mixed findings for the relevance of cognitive functioning as a prognostic factor for social functioning, that is, independent of clinical symptoms and negative symptoms in particular [1417]. Whereas some studies suggest that cognitive functioning and negative symptoms may be independent predictors of functional outcome, other studies suggest that a substantial part of the explained variance in functional outcome is shared between cognitive functioning and clinical symptoms [1416], with negative symptoms at least partially mediating the association between cognition [16], respectively social cognition [14], and functional outcome.

Additionally, the predictive value of cognitive functioning in the early phase of psychosis is unclear [18,19]. Although cognitive deficits are mostly seen as a stable trait in psychotic disorder, conflicting findings exist regarding the magnitude of cognitive underperformance during the first episode of schizophrenia compared with chronic schizophrenia, and some studies have found evidence for further cognitive decline after the onset of psychosis in at least some cognitive domains [20]. Modelling the prospective relations between cognition, social cognition and social functioning, and investigating the impact of clinical symptoms on these associations, may help to define therapeutic targets to improve functioning. Yet, most studies investigated associations between social cognition and functional outcome at a cross-sectional level, few studies investigated mediating effects of social cognition in the model of cognition–functional outcome longitudinally [11,13,21], and most studies focused on chronic schizophrenia, without comparing cognition-functional outcome associations with a healthy control sample. Therefore, it is unclear whether processes associated with social functioning differ from that of healthy controls.

Furthermore, processes may not be generalizable across different stages of the illness. Illness duration and treatment effects may influence associations between cognitive functioning and functional outcome and prognostic factors may have different predictive values in early psychosis [18,19]. Thus, studying these associations in patient samples differing in duration of illness may have implications for selecting appropriate therapeutic targets at various stages of the disorder. A recent systematic review [18] provides tentative evidence that cognitive functioning may be prognostic of functional outcome in early psychosis, nevertheless a meta-analysis suggests that illness chronicity does not moderate the association between cognition and social functioning [7]. The limited amount of studies conducted in recent-onset psychosis and the mixed results in more chronic samples warrant further research.

The aim of the present study was to investigate the contribution of cognition and social cognition in the prediction of social functioning, by first comparing the longitudinal association between baseline cognitive and social cognitive performance and three-year follow-up social functioning in patients with psychotic disorder versus healthy controls; and subsequently by analysing the associations in patients, integrating symptoms in a longitudinal model to account for the mediating role clinical symptoms may play in the cognition-social cognition-functional outcome relationships. To further clarify the associations, cross-sectional analyses were presented to explore concurrent associations with social functioning. We also investigated whether associations between cognitive functioning and social functioning varied in strength depending on illness duration.

Materials and Methods

Sample and measures

Data derive from the baseline (T0) and first follow-up (T1) measurements of the longitudinal ‘Genetic Risk and Outcome in Psychosis’ (GROUP) study (see [22] for further details). At baseline (T0), the full GROUP sample consisted of 1,119 patients with non-affective psychotic disorder and 589 control subjects. Inclusion criteria were: (i) age range 16 to 50 years, (ii) diagnosis of non-affective psychotic disorder, (iii) first mental health care contact for psychotic symptoms no longer than 10 years ago, and (iv) good command of Dutch language. Control subjects had no first or second degree relative with a psychotic disorder as established by the Family Interview for Genetic Studies [23] with the control subject as the informant. DSM-IV diagnoses, assessed with the Comprehensive Assessment of Symptoms and History (CASH) interview [24] or Schedules for Clinical Assessment for Neuropsychiatry (SCAN 2.1) [25], were: schizophrenia and related disorders (n = 945, 84%), other psychotic disorders (n = 149, 13%), and psychotic illness in the context of substance abuse or somatic illness (n = 9, 1%). At T1, three years after baseline, the GROUP sample consisted of 804 patients with non-affective psychotic disorder and 462 healthy controls.

Current severity of clinical symptoms was assessed in patients with the Positive and Negative Syndrome Scale (PANSS; [26]). Recent-onset psychosis was defined at baseline as duration of illness ≤ 2 years, consistent with definitions in the literature [2730].

The interviews and neuropsychological testing were conducted by research assistants (psychologists, psychiatrists, nurses and PhD students) who had received extensive and repeated training (see [22] for the assessment training procedure).

Ethical statement

The study protocol was approved centrally by the standing ethics committee (Medisch Ethische Toetsingscommissie, UMC Utrecht) and was conducted in accordance with the Helsinki Declaration of 1975, as revised in 2008. All participants gave written informed consent. Written informed consent was also obtained from the parents or guardians of those aged 16–17 years.

Cognitive functioning

All subjects were assessed with a cognitive test battery containing the following tasks: the Wechsler Adult Intelligence Scale-III Short form (IQ) [31] consisting of the subtests Digit Symbol–Coding (processing speed), Arithmetic (working memory), Block Design (reasoning and problem solving), and Information (acquired knowledge); the Continuous Performance Test-HQ (CPT) (attention/vigilance) [32]; the Word Learning Task (verbal learning and memory) [33]; and the Response Shifting Task (set-shifting), which is a modified version of the Competing Programs Task [34,35]. For the CPT, outcome variable was a sensitivity index (number of correct detections of targets minus the number of false alarms for non-target Q stimuli). For the Word Learning Task (WLT), immediate recall (number of words recalled over the three 15-word trials) and retention rate (delayed free recall after 20 minutes divided by the maximum score of immediate recall trials 1–3) were used. For the Response Shifting Task (RST), a set-shifting cost score was used (decrement in accuracy during a reversal response rule condition compared with an imitation response rule condition). Test performance in the GROUP study has been described previously [36].

Social cognition

Baseline assessment included two dimensions of social cognition: emotion perception and theory of mind (ToM). Emotion perception was measured using the Degraded Facial Affect Recognition task (DFAR; [37]). Outcome measure was the overall proportion correct.

ToM was assessed using the Hinting Task, which assesses the mentalizing capacity required to comprehend real intentions behind indirect speech [38]. Outcome measure was the sum of the ten item scores (range 0–20). The Hinting Task was administered at T0 only.

Social functioning

Self-reported social functioning was assessed with the Social Functioning Scale (SFS; [39]) at three-year follow-up. The SFS is a self-rating scale of community functioning of individuals with schizophrenia [39]. The scale consists of seven subscales: social engagement/withdrawal, interpersonal behaviour, independence—competence, independence—performance, recreation, pro-social behaviour, and employment. Outcome measure was the total score on the SFS calculated as the mean of the seven scaled subscale scores, with higher scores reflecting better social functioning (range 59.7–134.9). Cronbach’s alpha for these seven subscale scores was adequate (α = 0.80). The SFS was administered at T1 only.

Statistical analysis

Regression analyses were run in Stata version 13 [40] with T0 cognition and T0 social cognition variables as independent variables and T1 (three-year follow-up) social functioning as dependent variable, using age and sex as a priori covariates. Given that some families contributed more than one subject, hierarchical clustering of data was taken into account by including a family as a random effect in a linear mixed model, using the stata xtmixed command, fitted with restricted maximum likelihood estimation.

First, case-control analyses were conducted in which the interaction between status (patient vs. healthy control) and T0 cognition and T0 social cognition was tested in the longitudinal model with T1 social functioning as dependent variable, adjusting for sex and age.

Next, the longitudinal associations between cognition, social cognition, and social functioning were further explored in the patient sample, adjusting for sex and age. To further clarify T0-T1 longitudinal associations, T1-T1 cross-sectional analyses were presented to explore concurrent associations with social functioning.

To investigate whether cognition, social cognition, and symptoms may be independent predictors of social functioning or whether a mediational path can be distinguished, mediation analyses were planned using the Sobel–Goodman method (sgmediation in Stata). As advocated [41,42], we used non-parametric bootstrap resampling techniques to explore the indirect effects. In the case of significant main associations between (i) T1 social functioning–T0 cognition, and (ii) T0 social cognition–T1 social functioning, and/or T0 symptoms–T1 social functioning; each of the potential mediators (T0 social cognition and/or T0 symptoms) was added separately to the model of T0 cognition predicting T1 social functioning. The assumption-free bootstrap routine using case resampling (2000 iterations) was used to yield a percentile-based confidence interval for the indirect (i.e. mediated) effect.

Because associations between cognitive functioning and functional outcome may be influenced by illness phase and treatment effects, and prognostic factors may have different predictive values in early psychosis [18,19], illness duration was added to the model as a moderator, thus testing the cognitive measure × illness duration interaction. Furthermore, sensitivity analyses were conducted using the above mentioned linear regression models in recent-onset psychosis patients only.

Risk of type 1 error was addressed by applying Simes’ modification of the Bonferroni correction [43] to account for the multiple non-independent cognitive measures.

Release 3.02 of the GROUP database was used for the analyses.

Results

Sample

Of the 1,119 patients in the GROUP sample, 745 (67%) had three-year follow-up data for social functioning. Sample sizes for the main adjusted analyses ranged from n = 627–706. Of the 745 patients, 223 of were identified as patients with a recent onset psychosis. Of the 589 control subjects, 447 (76%) had follow-up data for social functioning. The control sample size for the comparison with the patient sample ranged from 398–462. Table 1 displays demographics of the patient and control sample and the clinical characteristics of the patient sample.

Table 1. Demographic and clinical characteristics.

Patients Controls
Mean SD range n Mean SD range n
Age (T1) 30.2 7.2 18–59 742 34.1 443
Sex, % male 76.0% 745 44.1% 447
Ethnicity, % white (Dutch/Belgian) 84% 730 93% 439
Residential status (%) 677 413
single 42% 21%
with parent(s) 24% 14%
with partner/family 15% 61%
sheltered living 14% 0%
Employment status, % 656
employed 74%
none 16%
study 7%
household 3%
T1 Social functioning (SFS) 112.5 9.3 84.6–134.9 745 123.9 5.6 99.5–133.6 447
Baseline (T0) estimated IQ 96.7 15.9 57–146 698 110.8 15.2 68–152 441
PANSS symptomsb
positive 1.76 0.75 1–5.29 719
negative 1.91 0.82 1–5.43 719
general 1.69 0.51 1–3.69 719
Dose antipsychotic medicationa 7.5 33.4 0–676 744
Illness duration (in years) 4.5 713
Recent-onset psychosis (illness ≤2 yrs) 31.3% 4.1 0.2–41.1 713

SFS = social functioning scale, PANSS = positive and negative syndrome scale

a in milligrams haloperidol equivalents

b Mean scores on three factors (positive, negative, and general symptoms) of the Positive And Negative Syndrome Scale (PANSS)

Patients with missing values on the T0 cognition, social cognition, or PANSS variables had similar T1 SFS scores compared with patients with non-missing values, with the exception that missing T0 CPT scores were significantly associated with lower T1 SFS scores. Patients with missing T1 social functioning scores had significantly lower scores on T0 cognition (except for RST and DFAR) and T0 social cognition variables and fewer T0 symptoms than patients with T1 social functioning data. S1 Table gives on overview of the demographic and clinical characteristic of included patients compared with patients with no T1 social functioning data.

Case-control

Patients had significantly lower T1 SFS scores than healthy control subjects (B = -10.62, 95% CI -11.66;-9.57, p<0.001) and had significantly lower T0 cognitive and social cognitive scores (p’s<0.001).

Status (patient vs. control) significantly moderated the association between T0 performance and T1 social functioning for T0 Digit Symbol–Coding (B = 0.06, 95% CI 0.005;0.12, p = 0.03) and T0 verbal memory immediate recall (B = 0.17, 95% CI 0.004;0.33, p = 0.04), suggesting that the association between performance on these tasks and follow-up social functioning was stronger in patients than in control subjects. For the other T0 (social) cognitive measures the interaction with Status was non-significant (p’s>0.10).

Predictors of social functioning in patients

Table 2 presents the results for the longitudinal analyses in patients. Except for verbal memory retention and the response shifting task, all cognitive measures were significantly associated with T1 social functioning, whereas the two social cognition variables were not significantly associated with T1 social functioning (Table 2). T0 PANSS positive, negative, and general symptoms were all significantly associated with T1 social functioning. For comparison, Table 3 gives the T1 cross-sectional associations.

Table 2. Longitudinal analyses: Regression analyses of baseline cognitive and social cognitive variables with three-year follow-up social functioning.

variable B 95% CI adjusted p a
Cognition
IQ 0.09 0.05; 0.14 <0.0001
Verbal memory immediate 0.19 0.08; 0.30 0.001
Verbal memory retention -2.05 -5.32; 1.21 0.26
Attention/vigilance (CPT) 0.08 0.04; 0.12 0.001
Set-shifting (RST) -1.16 -3.88; 1.57 0.43
Digit Symbol-Coding 0.11 0.07; 0.16 <0.0001
Arithmetic 0.30 0.16; 0.45 0.0001
Block Design 0.07 0.033; 0.11 0.0009
Information 0.21 0.08; 0.34 0.001
Social cognition
Affect recognition 0.04 -0.02; 0.11 0.24
Hinting task 0.22 -0.04; 0.48 0.09
PANSS symptoms
positive -2.97 -3.86; -2.08 <0.0001
negative -4.09 -4.87; -3.31 <0.0001
general -5.49 -6.77; -4.21 <0.0001

CPT = continuous performance test, RST = response shifting task, DFAR = degraded facial affect recognition task, PANSS = positive and negative syndrome scale

a p-value corrected for multiple testing using Simes’ modification of the Bonferroni correction

Table 3. Cross-sectional analyses: Regression analyses of three-year follow-up cognitive and social cognitive variables with three-year follow-up social functioning.

variable B 95% CI adjusted p a
Cognition
IQ 0.12 0.08; 0.16 <0.0001
Verbal memory immediate 0.27 0.16; 0.37 <0.0001
Verbal memory retention 6.39 2.96; 9.81 0.0003
Attention/vigilance (CPT) 0.06 0.01; 0.11 0.03
Set-shifting (RST) -0.83 -3.66; 2.01 0.57
Digit Symbol-Coding 0.16 0.12; 0.20 <0.0001
Arithmetic 0.33 0.19; 0.47 <0.0001
Block Design 0.09 0.05; 0.13 <0.0001
Information 0.27 0.15; 0.38 <0.0001
Social cognition
Affect recognition 0.06 -0.004; 0.13 0.07
Hinting task N/Ab
PANSS symptoms
positive -4.15 -5.15; -3.15 <0.0001
negative -6.21 -7.01; -5.40 <0.0001
general -8.98 -10.35; -7.61 <0.0001

CPT = continuous performance test, RST = response shifting task, DFAR = degraded facial affect recognition task, PANSS = positive and negative syndrome scale

a p-value corrected for multiple testing using Simes’ modification of the Bonferroni correction

b Hinting task was not administered at T1, therefore no cross-sectional data are reported for this task

Mediator analyses were planned for the T0 cognitive tasks for which p <0.05 (all cognitive variables except verbal memory retention and RST) with T0 symptoms (positive, negative and general) as mediators. Mediation analyses were conducted to test for the possibility that T0 symptoms mediate the relationship between T0 cognitive functioning and follow-up social functioning. Each mediation model tested the effect of one mediator variable (T0 symptom dimension) on the relation between one independent variable (T0 cognitive variable) and T1 social functioning, with age and sex as covariates. Given that likelihood-ratio tests indicated that multilevel random effects models did not provide a better fit than simple linear regression models (p>0.10) for these data, Sobel-Goodmann tests were used to test for indirect effects in the simple linear regression models.

Table 4 shows the results for the bootstrapped mediation analyses. All T0 cognition—T1 social functioning associations were significantly mediated by symptoms, except positive symptoms did not mediate the association between T0 CPT performance and T1 social functioning. Positive and general symptoms only partially mediated the associations, whereas negative symptoms fully mediated the association between most T0 cognitive variables and T1 social functioning, with only Digit Symbol−Coding and CPT having a significant direct effect on T1 social functioning independent of negative symptoms. The proportion of explained variance from an adjusted R2 of 0.09 for the model including verbal memory immediate recall, positive symptoms, age and sex to an adjusted R2 of 0.16 for the model including Digit Symbol−Coding, negative symptoms, age and sex.

Table 4. Mediation analyses.

Cognitive predictor Mediator Direct effect Indirect effect
B 95% CI B 95% CI
IQ Positive symptoms 0.07 0.03;0.11 0.02 0.01;0.03
Negative symptoms 0.04 -0.002;0.08 0.05 0.03;0.07
General symptoms 0.06 0.02;0.10 0.03 0.02;0.04
Verbal memory immediate Positive symptoms 0.15 0.04;0.26 0.04 0.01;0.07
Negative symptoms 0.09 -0.02; 0.19 0.10 0.06;0.15
General symptoms 0.13 0.02;0.24 0.06 0.03;0.10
Attention/Vigilance (CPT) Positive symptoms 0.07 0.03;0.11 0.01 -0.003;0.02
Negative symptoms 0.04 0.001;0.08 0.04 0.02;0.06
General symptoms 0.06 0.02;0.10 0.02 0.005;0.04
Digit Symbol-Coding Positive symptoms 0.09 0.04;013 0.02 0.01;0.03
Negative symptoms 0.06 0.01;0.10 0.05 0.03;0.07
General symptoms 0.07 0.03;0.12 0.03 0.02;0.05
Arithmetic Positive symptoms 0.23 0.08;0.37 0.07 0.03;011
Negative symptoms 0.13 -0.01;0.28 0.17 0.11;0.22
General symptoms 0.19 0.04;0.33 0.11 0.06;0.16
Block Design Positive symptoms 0.05 0.01;0.09 0.02 0.01;0.09
Negative symptoms 0.04 -0.003;0.08 0.03 0.02;0.05
General symptoms 0.05 0.001;0.09 0.02 0.01;0.04
Information Positive symptoms 0.16 0.04;0.29 0.04 0.01;0.07
Negative symptoms 0.07 -0.05;019 0.13 0.08;0.19
General symptoms 0.14 0.02;0.27 0.06 0.02;0.10

Recent-onset psychosis

Illness duration (continuous variable) was not associated with T1 social functioning (B = -0.12, 95% CI -0.29;0.04, p = 0.15) and did not moderate the association between T0 cognitive measures and T1 social functioning (p’s>0.20).

Table 5 displays the results of the sensitivity analyses conducted in recent-onset patients only (illness duration at baseline ≤ 2 years). No significant longitudinal associations were found between cognition or social cognition on the one hand and three-year follow-up social functioning on the other. In contrast, baseline negative and general symptoms were a significant predictor of three-year follow-up social functioning.

Table 5. Sensitivity analyses of baseline cognitive and social cognitive variables with three-year follow-up social functioning in patients with recent onset psychosis.

variable Longitudinal Cross-sectional
b 95% CI adjusted p a b adjusted p a
Cognition
IQ 0.06 -0.02; 0.14 0.43 0.12 0.01
Verbal memory immediate -0.03 -0.24; 0.19 0.86 0.08 0.46
Verbal memory retention -1.86 -8.21; 4.49 0.86 7.05 0.06
Attention/vigilance (CPT) 0.05 -0.04; 0.14 0.48 0.08 0.19
set-shifting (RST) -1.47 -7.55; 4.61 0.86 2.14 0.46
Digit Symbol-Coding 0.05 -0.03; 0.13 0.48 0.18 <0.0001
Arithmetic 0.29 0.02; 0.56 0.12 0.39 0.009
Block Design 0.04 -0.03; 0.12 0.48 0.06 0.18
Information 0.05 -0.20; 0.31 0.86 0.15 0.25
Social cognition
Affect recognition (DFAR) 0.02 -0.11; 0.15 0.86 0.13 0.09
Hinting task 0.03 -0.46; 0.51 0.92 N/Ab N/A
PANSS symptoms
 Positive -2.29 -4.09; -0.49 0.06 -4.64 0.0002
 Negative -4.64 -6.15; -3.12 <0.0001 -7.32 <0.0001
 General -4.60 -7.23; -1.96 0.005 -10.48 <0.0001

Analyses were a priori adjusted for age, sex, educational level (at T0 for longitudinal and T1 for cross-sectional analyses), antipsychotic dose ((at T0 for longitudinal and T1 for cross-sectional analyses)

CPT = continuous performance test, RST = response shifting task, DFAR = degraded facial affect recognition task, PANSS = positive and negative syndrome scale

a p-value corrected for multiple testing using Simes’ modification of the Bonferroni correction

b Hinting task was not administered at T1, therefore no cross-sectional data are reported for this task

Discussion

We examined longitudinal associations between cognition, social cognition and social functioning in a large sample of patients with a psychotic disorder. A longitudinal association with three-year follow-up social functioning was found for most cognitive variables, with information processing speed and verbal memory immediate recall showing stronger associations with social functioning outcome in patients compared with healthy controls. Thus, the findings tentatively suggest that cognitive functioning may be a predictor for social functioning. Of all cognitive variables, information processing speed showed the largest association with social functioning (r = 0.22). The latter finding is in line with previous literature [44]. However, the proportion of the variance in social functioning that was explained by baseline cognitive functioning (<5%) or by the model of baseline cognitive functioning and negative symptoms (approximately 15%) is smaller than previous estimates of 25–50% as proportion of the variance that was explained by neurocognition alone[6], but larger than the percentage of 7.3% that was reported by Couture and colleagues for the model that included neurocognition as well as negative symptoms. At a cross-sectional level, cognitive functioning, associations between cognition and social functioning were larger than at the longitudinal level, but the proportion of the variance explained is still considerably smaller than the previous estimate of 25–50%. These findings are in line with Jabben and colleagues [17] who found weak cross-sectional associations between information processing speed in the absence of specific and unconfounded longitudinal associations. Also, most cognitive measures did not uniquely contribute to the explained variance, as results showed that symptoms and particularly negative symptoms −in line with previous literature [14,16,17,45]− meditated the association between cognitive functioning and social functioning. This may imply that factors such as a motivational deficits, social withdrawal, and impaired initiative may be underlying variables in the association between cognition and social functioning, which is in line with a previous study [46] suggesting that levels of intrinsic motivation are robustly and reliably associated with performance on cognitive tests, suggesting that shared motivation-cognition mechanisms should be investigated to enhance efforts to improve social functioning. In contrast to the other cognitive variables that were fully mediated by negative symptoms, information processing speed and attention/vigilance were only partly mediated and thus explained some of the variance in social functioning over and above negative symptoms.

Unexpectedly, none of the social cognitive measures was associated with self-reported social functioning at follow-up, in contrast with previous studies that reported a mediating role for social cognition (e.g. [1113]), and with a recent study [47] that reported a mediating role for Hinting Task performance in the association between global cognition and self-reported daily functioning in patients with schizophrenia. Social cognition in the present sample was relatively mildly compromised, with affect recognition above impairment threshold (1 SD below control mean). Although the effect size for the Hinting Task was below 1 SD below control mean [36], patients were performing well above the level of patients in Couture and colleagues’ study [47]. This relatively good performance may explain why the association between Hinting Task performance and social functioning was stronger in Couture and colleagues’ study. Alternatively, the role of social cognition in predicting social functioning may not be robust, given that real-world social functioning is a complex construct that is likely determined by a complex interaction of several factors, including symptoms. Horan and colleagues [48] found social cognition to be predictive particularly for work functioning, whereas findings were less robust for the social functioning domain for which the predictive value was diminished after accounting for symptoms. In these first-episode patients, Horan and colleagues [48] found small and non-significant cross-sectional associations between social cognition and functional outcome at baseline, suggesting that clinical instability may have greater impact on social functioning than social cognitive skills. Social cognition research is hampered by inconsistent terminology and the lack of consensus on how to measure social cognition domains such as theory of mind and emotion perception, using well-validated, psychometrically sound instruments [49]. One important challenge is to construct a social cognition measure that is ecologically valid, that reflects the dynamic, interactive aspect of social skills applied to daily life social situations [50]. For example, the present measure of affect recognition, the DFAR, was not predictive of daily life social functioning in patients with psychotic disorders [51]. More ‘real-world’ indicators of social cognition may help enhance understanding of the path between cognitive performance and everyday social functioning, and may have the potential to improve current interventions to enhance functional improvement.

Illness duration did not significantly moderate the association between cognitive functioning and social functioning, suggesting that the associations are similar over the course of psychotic disorder. However, in contrast to the outcome in the patient group as a whole, sensitivity analyses in recent onset psychosis patients yielded inconclusive findings with respect to cognitive as longitudinal predictors of social functioning. In line with the latter findings, it has been suggested that cognition assessed within the first episode of the illness may not be a reliable predictor of functional outcome, explaining considerably less variance in outcome compared with previous cross-sectional studies with chronic patients [15]. Furthermore, a recent review showed that although most early psychosis studies did find an association between baseline cognitive functioning and follow-up functional outcome for at least one cognitive domain, more null associations than positive results were found for each cognitive domain [18]. A possible explanation for the lack of robust associations in recent onset samples may be that many psychosocial interventions are typically offered shortly after a first episode in early intervention programs and will therefore take place between baseline assessment and follow-up in this sub-sample. In this period, when illness course is very heterogeneous and several stages may be distinguished [52], patients may learn how to improve their daily functioning while compensating for cognitive impairments, or cognitive functioning may even improve with training. This may explain why associations between social functioning and cognition in the early stage of illness are few. Alternatively, the lack of associations in the recent-onset sample is in line with the findings in the complete sample that suggest that the amount of variance of social functioning explained by cognition is relatively small compared to previous findings.

The difference between the present results and previous findings may be related to differences in sample due to the recruitment procedures. Even though the majority of patients (84%) were diagnosed with schizophrenia-related disorders, the decision to include patients with other non-affective psychotic disorders may have attenuated effect sizes [36]. Furthermore, subjects were willing to participate in a demanding, longitudinal study protocol and may differ from subjects in research projects embedded within routine diagnostic or treatment procedures. Additionally, the study’s procedures to preferably include patients if at least one sibling was willing and able to participate, may have led to a selection excluding the more isolated and impaired patients. This may explain why overall cognitive deficits were relatively mild [36] compared with previous findings (e.g. [4,47]). It is possible that associations between cognitive functioning and social functioning may be more pronounced in samples that include only the more severe end of the spectrum of psychotic disorders or include patients in a more established phase of illness. Examining the longitudinal associations between relatively mild deficits and social functioning may explain why cognitive abilities failed to robustly predict social functioning, particularly in recent-onset patients where illness trajectories may be very heterogeneous [52].

Limitations

The present study is unique in its naturalistic cohort design, with a broad neuropsychological assessment in a large sample of patients with a psychotic disorder and healthy controls. Nevertheless, some limitations need to be taken into account. First, baseline social functioning was not assessed; therefore, crossed-lagged analyses could not be performed. Because we did not have the possibility to evaluate this, we could not establish whether cognitive functioning may predict decline in or recovery of social functioning nor can we exclude that poor social functioning negatively impacts on cognitive performance rather than cognition impacting negatively on social functioning.

Second, follow-up data were not available for a substantial number of patients. Drop-outs had significantly poorer social and non-social cognitive skills than patients who remained in the study. Moreover, not all subjects had complete baseline cognitive test scores. Finally, a self-report questionnaire was used to assess functional outcome. Self-report is inevitably subjective and may be driven in part by within-person factors such as psychopathology. However, self-report may arguably still be better than observer-rated social behaviour because the latter assessment method also comes with a degree of interpretation and may result in a substantial extent of missing data.

The association between negative symptoms and social functional outcome might be partially explained by measurement overlap, e.g., the PANSS item Passive/Apathetic Social withdrawal has conceptual overlap with the SFS subscale social engagement/withdrawal. Measurement overlap may have resulted in an inflated correlation between negative symptoms and social functioning outcome [16] and may have resulted in an inflated indirect effect of negative symptoms on the association between cognitive functioning and social functioning.

Thus, although neuropsychological assessment gives an impression of current strengths and weaknesses, the results of the present study suggest that the prognostic value appears limited for most cognitive domains. Neuropsychological assessment may predict longer-term social functioning, but the present findings suggest that for most cognitive domains, the predictive value is modest and only information processing speed and attention/vigilance may provide additional prognostic information above assessing current symptom severity.

Supporting Information

S1 Table. Demographic and clinical characteristics of the included patients versus the patients with no follow-up social functioning scores.

(DOCX)

Acknowledgments

We are grateful for the generosity of time and effort by the patients and their families, healthy subjects, and all researchers who make this GROUP project possible.

Contributors

Genetic Risk and Outcome of Psychosis (GROUP) investigators: Richard Bruggeman, Wiepke Cahn, Lieuwe de Haan, René S. Kahn, Carin Meijer, Inez Myin-Germeys, Jim van Os, Durk Wiersm.

Data Availability

Data are available upon request from researchers who meet the criteria for data access. Researchers can send their request to the coordinators of the GROUP study by sending an email to j.vanbaaren@umcutrecht.nl.

Funding Statement

The infrastructure for the GROUP study is funded through the Geestkracht programme of the Dutch Health Research Council (ZON-MW, grant number 10-000-1001); matching funds from participating pharmaceutical companies (Lundbeck, AstraZeneca, Eli Lilly, Janssen Cilag); and participating universities and mental health care organizations (Amsterdam: Academic Psychiatric Centre of the Academic Medical Centre and the mental health institutions: GGZ Ingeest, Arkin, Dijk en Duin, GGZ Rivierduinen, Erasmus Medical Centre, GGZ Noord Holland Noord. Maastricht: Maastricht University Medical Centre and the mental health institutions: GGZ Eindhoven en De Kempen, GGZ Breburg, GGZ Oost-Brabant, Vincent van Gogh voor geestelijke gezondheidszorg, Mondriaan Zorggroep, Prins Clauscentrum Sittard, RIAGG Roermond, Universitair Centrum Sint-Jozef Kortenberg, CAPRI University of Antwerp, PC Ziekeren Sint-Truiden, PZ Sancta Maria Sint-Truiden, GGZ Overpelt, OPZ Rekem. Groningen: University Medical Center Groningen and the mental health institutions: Lentis, GGZ Friesland, GGZ Drenthe, Dimence, Mediant, GGNet Warnsveld, Yulius Dordrecht and Parnassia psycho-medical centre The Hague. Utrecht: University Medical Centre Utrecht and the mental health institutions Altrecht, GGZ Centraal, Riagg Amersfoort and Delta). The research leading to these results has received funding from the European Community's Seventh Framework Program under grant agreement No. HEALTH-F2-2009-241909 (Project EU-GEI).

References

  • 1.Barder HE, Sundet K, Rund BR, Evensen J, Haahr U, Ten Velden Hegelstad W, et al. Neurocognitive development in first episode psychosis 5 years follow-up: associations between illness severity and cognitive course. Schizophr Res. 2013; 149(1–3): 63–69. 10.1016/j.schres.2013.06.016 [DOI] [PubMed] [Google Scholar]
  • 2.Hoff AL, Svetina C, Shields G, Stewart J, DeLisi LE. Ten year longitudinal study of neuropsychological functioning subsequent to a first episode of schizophrenia. Schizophr Res. 2005; 78(1): 27–34. 10.1016/j.schres.2005.05.010 [DOI] [PubMed] [Google Scholar]
  • 3.Dickinson D, Ramsey ME, Gold JM. Overlooking the obvious: a meta-analytic comparison of digit symbol coding tasks and other cognitive measures in schizophrenia. Arch Gen Psychiatry. 2007; 64(5): 532–542. 10.1001/archpsyc.64.5.532 [DOI] [PubMed] [Google Scholar]
  • 4.Heinrichs RW, Zakzanis KK. Neurocognitive deficit in schizophrenia: a quantitative review of the evidence. Neuropsychology. 1998; 12(3): 426–445. [DOI] [PubMed] [Google Scholar]
  • 5.Brekke JS, Hoe M, Green MF. Neurocognitive change, functional change and service intensity during community-based psychosocial rehabilitation for schizophrenia. Psychol Med. 2009; 39(10): 1637–1647. 10.1017/s003329170900539x [DOI] [PubMed] [Google Scholar]
  • 6.Green MF, Kern RS, Heaton RK. Longitudinal studies of cognition and functional outcome in schizophrenia: implications for MATRICS. Schizophr Res. 2004; 72(1): 41–51. [DOI] [PubMed] [Google Scholar]
  • 7.Fett A-KJ, Viechtbauer W, Dominguez M-d-G, Penn DL, van Os J, Krabbendam L. The relationship between neurocognition and social cognition with functional outcomes in schizophrenia: A meta-analysis. Neurosci Biobehav Rev. 2011; 35(3): 573–588. 10.1016/j.neubiorev.2010.07.001 [DOI] [PubMed] [Google Scholar]
  • 8.Pijnenborg GHM, Withaar FK, Evans JJ, Van den Bosch RJ, Timmerman ME, Brouwer WH. The predictive value of measures of social cognition for community functioning in schizophrenia: implications for neuropsychological assessment. J Int Neuropsychol Soc. 2009; 15(2): 239–247. 10.1017/S1355617709090341 [DOI] [PubMed] [Google Scholar]
  • 9.Bowie CR, Leung WW, Reichenberg A, McClure MM, Patterson TL, Heaton RK, et al. Predicting schizophrenia patients' real-world behavior with specific neuropsychological and functional capacity measures. Biol Psychiatry. 2008; 63(5): 505–511. 10.1016/j.biopsych.2007.05.022 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Green MF, Kern RS, Braff DL, Mintz J. Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the "right stuff"? Schizophr Bull. 2000; 26(1): 119–136. [DOI] [PubMed] [Google Scholar]
  • 11.Hoe M, Nakagami E, Green MF, Brekke JS. The causal relationships between neurocognition, social cognition and functional outcome over time in schizophrenia: a latent difference score approach. Psychol Med. 2012; 42(11): 2287–2299. 10.1017/S0033291712000578 [DOI] [PubMed] [Google Scholar]
  • 12.Schmidt SJ, Mueller DR, Roder V. Social cognition as a mediator variable between neurocognition and functional outcome in schizophrenia: empirical review and new results by structural equation modeling. Schizophr Bull. 2011; 2011(37): S41–54. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Brekke J, Kay DD, Lee KS, Green MF. Biosocial pathways to functional outcome in schizophrenia. Schizophr Res. 2005; 80(2–3): 213–225. [DOI] [PubMed] [Google Scholar]
  • 14.Lin CH, Huang CL, Chang YC, Chen PW, Lin CY, Tsai GE, et al. Clinical symptoms, mainly negative symptoms, mediate the influence of neurocognition and social cognition on functional outcome of schizophrenia. Schizophr Res. 2013; 146(1–3): 231–237. 10.1016/j.schres.2013.02.009 [DOI] [PubMed] [Google Scholar]
  • 15.Milev P, Ho BC, Arndt S, Andreasen NC. Predictive values of neurocognition and negative symptoms on functional outcome in schizophrenia: a longitudinal first-episode study with 7-year follow-up. Am J Psychiatry. 2005; 162(3): 495–506. [DOI] [PubMed] [Google Scholar]
  • 16.Ventura J, Hellemann GS, Thames AD, Koellner V, Nuechterlein KH. Symptoms as mediators of the relationship between neurocognition and functional outcome in schizophrenia: a meta-analysis. Schizophr Res. 2009; 113(2): 189–199. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Jabben N, van Os J, Burns T, Creed F, Tattan T, Green J, et al. Is processing speed predictive of functional outcome in psychosis? Soc Psychiatry Psychiatr Epidemiol. 2008; 43(6): 437–444. 10.1007/s00127-008-0328-y [DOI] [PubMed] [Google Scholar]
  • 18.Allott K, Liu P, Proffitt T-M, Killackey E. Cognition at illness onset as a predictor of later functional outcome in early psychosis: Systematic review and methodological critique. Schizophr Res. 2011; 125(2–3): 221–235. 10.1016/j.schres.2010.11.001 [DOI] [PubMed] [Google Scholar]
  • 19.Siegel SJ, Irani F, Brensinger CM, Kohler CG, Bilker WB, Ragland JD, et al. Prognostic variables at intake and long-term level of function in schizophrenia. Am J Psychiatry. 2006; 163(3): 433–441. 10.1176/appi.ajp.163.3.433 [DOI] [PubMed] [Google Scholar]
  • 20.McCleery A, Ventura J, Kern RS, Subotnik KL, Gretchen-Doorly D, Green MF, et al. Cognitive functioning in first-episode schizophrenia: MATRICS Consensus Cognitive Battery (MCCB) profile of impairment. Schizophr Res. 2014; 157(1–3): 33–39. 10.1016/j.schres.2014.04.039 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Bell M, Tsang HW, Greig TC, Bryson GJ. Neurocognition, social cognition, perceived social discomfort, and vocational outcomes in schizophrenia. Schizophr Bull. 2009; 35(4): 738–747. 10.1093/schbul/sbm169 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Korver N, Quee PJ, Boos HBM, Simons CJP, de Haan L, Group Investigators. Genetic Risk and Outcome of Psychosis (GROUP), a multi site longitudinal cohort study focused on gene–environment interaction: objectives, sample characteristics, recruitment and assessment methods. Int J Methods Psychiatr Res. 2012; 21(3): 205–221. 10.1002/mpr.1352 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.NIMH.Genetics.Initiative Family Interview for Genetic Studies (FIGS). Rockville, Md: National Institute of Mental Health; 1992. [Google Scholar]
  • 24.Andreasen NC, Flaum M, Arndt S. The Comprehensive Assessment of Symptoms and History (CASH). An instrument for assessing diagnosis and psychopathology. Arch Gen Psychiatry. 1992; 49(8): 615–623. 10.1001/archpsyc.1992.01820080023004 [DOI] [PubMed] [Google Scholar]
  • 25.Wing JK, Babor T, Brugha T, Burke J, Cooper JE, Giel R, et al. SCAN: Schedules for Clinical Assessment in Neuropsychiatry. Arch Gen Psychiatry. 1990; 47(6): 589–593. 10.1001/archpsyc.1990.01810180089012 [DOI] [PubMed] [Google Scholar]
  • 26.Kay SR, Fiszbein A, Opler LA. The Positive and Negative Syndrome Scale (PANSS) for schizophrenia. Schizophr Bull. 1987; 13(2): 261–276. [DOI] [PubMed] [Google Scholar]
  • 27.Nuechterlein KH, Subotnik KL, Green MF, Ventura J, Asarnow RF, Gitlin MJ, et al. Neurocognitive predictors of work outcome in recent-onset schizophrenia. Schizophr Bull. 2011; 37(suppl 2): S33–S40. 10.1093/schbul/sbr084 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Dickerson F, Stallings C, Vaughan C, Origoni A, Khushalani S, Dickinson D, et al. Cognitive functioning in recent onset psychosis. J Nerv Ment Dis. 2011; 199(6): 367–371. 10.1097/NMD.0b013e31821cd0ff [DOI] [PubMed] [Google Scholar]
  • 29.Holthausen EAE, Wiersma D, Cahn W, Kahn RS, Dingemans PM, Schene AH, et al. Predictive value of cognition for different domains of outcome in recent-onset schizophrenia. Psychiatry Res. 2007; 149(1–3): 71–80. 10.1016/j.psychres.2005.07.037 [DOI] [PubMed] [Google Scholar]
  • 30.Stirling J, White C, Lewis S, Hopkins R, Tantam D, Huddy A, et al. Neurocognitive function and outcome in first-episode schizophrenia: a 10-year follow-up of an epidemiological cohort. Schizophr Res. 2003; 65(2–3): 75–86. 10.1016/S0920-9964(03)00014-8 [DOI] [PubMed] [Google Scholar]
  • 31.Wechsler D. WAIS-III: Wechsler Adult Intelligence Scale (3rd ed.) Administration and Scoring Manual. San Antonio, TX: Psychological Corporation; 1997. [Google Scholar]
  • 32.Nuechterlein KHR, Dawson ME. Information processing and attentional functioning in the developmental course of schizophrenics disorders. Schizophr Bull. 1984; 10(2): 160–203. [DOI] [PubMed] [Google Scholar]
  • 33.Van der Elst W, Boxtel MPJ, Van Breukelen GJP, Jolles J. Rey's Verbal Learning Test: normative data for 1,855 healthy participants aged 24–81 years and the influence of age, sex, education, and mode of presentation. J Int Neuropsychol Soc. 2005; 11(3): 290–302. [DOI] [PubMed] [Google Scholar]
  • 34.Bilder RM, Turkel E, Lipschutz-Broch L, Lieberman JA. Antipsychotic medication effects on neuropsychological functions. Psychopharmacol Bull. 1992; 28(4): 353–366. [PubMed] [Google Scholar]
  • 35.Nolan KA, Bilder RM, Lachman HM, Volavka J. Catechol O-Methyltransferase Val158Met polymorphism in schizophrenia: differential effects of Val and Met alleles on cognitive stability and flexibility. Am J Psychiatry. 2004; 161(2): 359–361. 10.1176/appi.ajp.161.2.359 [DOI] [PubMed] [Google Scholar]
  • 36.Meijer J, Simons CJP, Quee PJ, Verweij K, Investigators G. Cognitive alterations in patients with non-affective psychotic disorder and their unaffected siblings and parents. Acta Psychiatr Scand. 2012; 125(1): 66–76. 10.1111/j.1600-0447.2011.01777.x [DOI] [PubMed] [Google Scholar]
  • 37.van 't Wout M, Aleman A, Kessels RPC, Larøi F, Kahn RS. Emotional processing in a non-clinical psychosis-prone sample. Schizophr Res. 2004; 68(2–3): 271–281. [DOI] [PubMed] [Google Scholar]
  • 38.Versmissen D, Janssen I, Myin-Germeys I, Mengelers R, à Campo J, van Os J, et al. Evidence for a relationship between mentalising deficits and paranoia over the psychosis continuum. Schizophr Res. 2008; 99(1–3): 103–110. [DOI] [PubMed] [Google Scholar]
  • 39.Birchwood M, Smith J, Cochrane R, Wetton S, Copestake S. The Social Functioning Scale. The development and validation of a new scale of social adjustment for use in family intervention programmes with schizophrenic patients. Br J Psychiatry. 1990; 157: 853–859. [DOI] [PubMed] [Google Scholar]
  • 40.StataCorp. Stata Statistical Software: release 13. College Station, TX: StataCorp LP; 2013. [Google Scholar]
  • 41.Shrout PE, Bolger N. Mediation in experimental and nonexperimental studies: new procedures and recommendations. Psychol Methods. 2002; 7(4): 422–445. [PubMed] [Google Scholar]
  • 42.Preacher K, Hayes A. SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behav Res Methods Instrum Comput. 2004; 36(4): 717–731. 10.3758/BF03206553 [DOI] [PubMed] [Google Scholar]
  • 43.Simes RJ. An improved Bonferroni procedure for multiple tests of significance. Biometrika. 1986; 73: 751–754. [Google Scholar]
  • 44.Dickinson D, Coursey RD. Independence and overlap among neurocognitive correlates of community functioning in schizophrenia. Schizophr Res. 2002; 56(1–2): 161–170. [DOI] [PubMed] [Google Scholar]
  • 45.Couture SM, Penn DL, Roberts DL. The functional significance of social cognition in schizophrenia: a review. Schizophr Bull. 2006; 32(1): 17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Fervaha G, Zakzanis KK, Foussias G, Graff-Guerrero A, Agid O, Remington G. Motivational deficits and cognitive test performance in schizophrenia. JAMA psychiatry. 2014; 71(9): 1058–1065. 10.1001/jamapsychiatry.2014.1105 [DOI] [PubMed] [Google Scholar]
  • 47.Couture SM, Granholm EL, Fish SC. A path model investigation of neurocognition, theory of mind, social competence, negative symptoms and real-world functioning in schizophrenia. Schizophr Res. 2011; 125(2–3): 152–160. 10.1016/j.schres.2010.09.020 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Horan WP, Green MF, DeGroot M, Fiske A, Hellemann G, Kee K, et al. Social cognition in schizophrenia, part 2: 12-month stability and prediction of functional outcome in first-episode patients. Schizophr Bull. 2012; 38(4): 865–872. 10.1093/schbul/sbr001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Green MF, Penn DL, Bentall R, Carpenter WT, Gaebel W, Gur RC, et al. Social Cognition in Schizophrenia: an NIMH Workshop on Definitions, Assessment, and Research Opportunities. Schizophr Bull. 2008; 34(6): 1211–1220. 10.1093/schbul/sbm145 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Stouten LH, Veling W, Laan W, van der Helm M, van der Gaag M. Psychotic symptoms, cognition and affect as predictors of psychosocial problems and functional change in first-episode psychosis. Schizophr Res. 2014; 158(1–3): 113–119. 10.1016/j.schres.2014.06.023 [DOI] [PubMed] [Google Scholar]
  • 51.Janssens M, Lataster T, Simons CJP, Oorschot M, Lardinois M, van Os J, et al. Emotion recognition in psychosis: No evidence for an association with real world social functioning. Schizophr Res. 2012; 142(1–3): 116–121. 10.1016/j.schres.2012.10.003 [DOI] [PubMed] [Google Scholar]
  • 52.McGorry PD. Issues for DSM-V: Clinical staging: a heuristic pathway to valid nosology and safer, more effective treatment in psychiatry. Am J Psychiatry. 2007; 164(6): 859–860. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

S1 Table. Demographic and clinical characteristics of the included patients versus the patients with no follow-up social functioning scores.

(DOCX)

Data Availability Statement

Data are available upon request from researchers who meet the criteria for data access. Researchers can send their request to the coordinators of the GROUP study by sending an email to j.vanbaaren@umcutrecht.nl.


Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES