Abstract
Depressive symptoms are highly prevalent in psychotic populations and result in significant functional impairment. Limited knowledge of whether depressive symptoms are invariant across stages of illness curtails our ability to understand how these relate to illness progression. Clarifying the latent structure of depressive symptoms across stages of illness progression would aid etiological conceptualizations and preventive models. In the present study, one-factor (including all items) and two-factor (depression/hopelessness and guilt/self-depreciation) solutions were specified through confirmatory factor analysis (CFA). Measurement invariance analyses were undertaken across schizophrenia (SCZ; n = 312) and clinical high-risk (CHR; n = 175) groups to estimate whether the same construct is being measured across groups. Clinical correlates of the factors were examined. Results indicated that CHR individuals had a greater proportion of mood disorder diagnoses. Metric invariance held for the one-factor solution, and scalar invariance held for the two-factor solution. Notably, negative symptoms did not correlate with depressive symptoms in the SCZ group, though strong correlations were observed in CHR individuals. Positive symptoms were comparably associated with depressive symptoms in both groups. Results suggest depressive symptoms are more prevalent in CHR individuals. Targeting these symptoms may aid future efforts to identify risk of conversion. Further, some depressive symptoms may be systematically more endorsed in CHR individuals. Separating into depression/hopelessness and guilt/self-depreciation scores may aid comparability across stages of illness progression, though this issue deserves careful attention and future study.
Subject terms: Schizophrenia, Human behaviour
Introduction
Depressive symptoms are highly prevalent in psychotic populations, in both first episode and chronic phases of illness1,2. These have been closely linked to psychotic symptom severity, distress, and content, as well as to symptom development, illness prognosis, and relapse3.
Importantly, they have also been associated with poor psychological well-being and functional outcomes3,4. There is evidence that clinical high-risk (CHR) individuals (i.e., those showing emergent attenuated positive symptoms and corresponding cognitive/functional decline, that are at imminent risk for transitioning to a psychotic disorder) also exhibit high rates of depressive symptoms5–9; these symptoms have been associated with poor clinical outcomes in this group10–12. CHR syndromes are notable in that only a minority (an estimated 10–35%) of individuals go on to eventually convert to a psychotic disorder6,13. In addition, rates of depression among this population may be higher than in schizophrenia7. Thus, it is critical to understand depressive symptoms in the context of the broader psychosis spectrum, including CHR individuals. However, it is currently unclear whether depressive phenomenology manifests similarly across groups (e.g. with regard to factor structure, symptom presentation, frequency, severity, and trajectory). Determining whether the latent structure of depressive symptoms is similar across stages of illness progression is paramount to informing efforts aimed at intervention and prevention, as differences in presentation across phases of illness would require different target approaches and conceptualizations.
Depressive symptoms within psychosis spectrum populations play a critical role in the development, maintenance, and exacerbation of negative symptoms (i.e., reductions in motivation and emotional expression relative to one’s own demographic)5,7–9,14. These can be primary (i.e. idiopathic to the disorder) or secondary (i.e., the result of factors other than disease processes related to psychotic disorders, such as depression)14. Depression is a common secondary source of negative symptoms in those with psychotic disorders, though it is unclear whether this manifests similarly in CHR individuals14–17. Elucidating this is key because negative symptoms can emerge years before attenuated positive symptoms, being among the strongest predictors of conversion to a psychotic disorder5,18–20. One might expect depression to be a significant secondary negative symptom source in CHR individuals given that rates of depression are high in this population (e.g., 41% of CHR individuals are estimated to be diagnosed with a comorbid depressive disorder)7. If this is the case, there are important resulting treatment implications, as a focus on depression may be critical for prevention at the earliest stages of the prodrome and as a means of halting functional deterioration.
Differing sources of negative symptoms are also important to consider from an etiological standpoint. For example, a wide body of research suggests that primary negative symptoms are distinct and not associated with depressive symptoms in individuals with psychotic disorders14,21–24. Predominant theoretical models accept that there are facets that are distinct to depressive (low mood, suicidal ideation, and pessimism) and negative symptoms (alogia, blunted affect), respectively, which may account for the lack of correlation in psychotic disorders25. However, some models suggest there may also be some overlap in symptom presentation between the two, especially with regard to anhedonia, anergia, and avolition. Thus, identifying distinct and unique latent factors for depressive and negative symptoms among CHR individuals is a necessary avenue of investigation. This may be crucial in terms of predicting disease course: depressive symptoms have previously been found to strongly correlate with patient-rated illness severity in schizophrenia26. Further, schizophrenia spectrum (SCZ) patients who present with predominantly primary negative symptoms have been observed to experience greater social and occupational function deficits, despite exhibiting less severe depressive symptoms16,27–30. This divergence suggests that primary and secondary negative symptoms may differentially predict distinct outcomes. Taking this into consideration is particularly important in CHR populations, as the presence of distinct primary/secondary negative symptom sources has not been as well examined in this critical period.
Understanding whether primary and secondary sources of negative symptoms are distinguishable in CHR individuals (as they are in SCZ individuals) would aid in conceptualizing risk models and understanding negative symptom etiology. CHR individuals by definition exhibit attenuated psychotic features. Though a majority of them may not convert to a psychotic disorder, determining whether secondary negative symptoms (i.e. depression) manifest similarly (with regard to factor structure, symptom presentation, frequency, severity, and trajectory) to chronic psychosis individuals in this group would increase our understanding of risk and negative symptom etiology. Perhaps primary negative symptoms emerge only after psychotic disorder onset, or perhaps attenuated primary negative symptoms emerge beforehand, at the CHR stage. Or, perhaps only secondary negative symptoms (i.e. depressive symptoms) are observable before psychotic disorder onset. These questions have yet to be definitively answered and establishing the latent structure of depressive symptoms across groups is a necessary first step. Further, negative symptoms separate into volitional and expressive factors in adults with psychotic disorders and CHR youth20,31–33. Therefore, it will also be important to determine whether depressive symptoms have different patterns of correlations with these factors, which are thought to have unique pathophysiological mechanisms34.
The distinct presence of primary and secondary negative symptoms is well-established in chronic stages of psychotic illness. This is not the case for CHR populations. Determining whether primary and secondary sources of negative symptoms manifest similarly in CHR individuals is crucial for etiological conceptualizations, intervention, and prevention treatments. The present investigation used confirmatory factor analysis (CFA) to compare competing models regarding the latent structure of depressive symptoms in psychotic disorders and CHR individuals. The Calgary Depression Scale for Schizophrenia (CDSS), a commonly implemented clinical rating scale, was used to address these questions35–37. While it is widespread clinical and research practice to calculate a single total score for the CDSS, a range of factor solutions have been found, with a two-factor solution receiving the greatest support in the empirical literature (with factors reflecting guilt and depression/hopelessness)22–24. In CHR populations, only a single study has examined the factor structure of the CDSS to date. The authors also found a two-factor solution, with separate dimensions for guilt/self-depreciation and depression/hopelessness38. However, to date, no studies have formally tested factorial invariance between the psychotic disorder and CHR samples for either a single factor or multiple-factor solutions. Thus, it is unclear whether the latent structure of depressive symptoms is comparable across phases of illness.
First, a uni-dimensional model was evaluated given the common practice of calculating a single CDSS total score. Second, a more complex model indicating two dimensions consisting of items related to depression/hopelessness and guilt/self-depreciation was tested, in line with previous studies23,38. To examine whether previous literature finding weak correlations with negative symptoms in schizophrenia populations would also apply to CHR populations, depression sum scores within diagnoses were correlated with positive and negative symptoms21,22,24. Finally, given that negative symptoms separate into volition and expression factors in SCZ patients, correlations were explored between these specific dimensions20,31–33. It was hypothesized that the two-factor solution would indicate a better fit than the one-factor solution, given that this two-factor structure has been found across CHR and SCZ groups. Further, it was hypothesized that positive symptoms would correlate with depressive symptoms, and that negative symptoms would not correlate with depressive symptoms in the SCZ group. We were agnostic as to the relationship between negative symptoms and depressive symptoms in CHR individuals.
Methods
Participants
The present study is a well-powered, multi-site collaboration, spanning across four collection sites using archival data39. SCZ inpatient and outpatient individuals (n = 312) who met DSM criteria for schizophrenia (n = 258) or schizoaffective disorder (n = 54) were recruited at the outpatient clinics at the Maryland Psychiatric Research Center (MPRC). CHR individuals meeting criteria for a psychosis risk syndrome (described below) were recruited through the North American Prodrome Longitudinal Study (NAPLS) site at Emory University (n = 76), and the Adolescent Development and Preventive Treatment (ADAPT) locations at Northwestern University (n = 25) and University of Colorado Boulder (n = 74). Affective disorders were defined as follows for analytic purposes: SCZ patients with a current mood diagnosis included schizoaffective disorder, and CHR individuals with a current mood diagnosis included persistent depressive disorder, major depressive disorder, and bipolar disorder (see Table 1). All protocols were approved by respective local IRBs. Informed consent was obtained from all subjects. Participants under 18 gave written assent, in addition to their guardians giving informed consent.
Table 1.
Entire sample | CHR | SCZ | χ 2 | df | p | ||||
---|---|---|---|---|---|---|---|---|---|
n | % | n | % | n | % | ||||
Sex | |||||||||
Female | 178 | 36.6 | 76 | 43.4 | 102 | 32.7 | 5.6 | 1 | 0.018 |
Male | 309 | 63.5 | 99 | 56.6 | 210 | 67.3 | |||
Mood Dx | 107 | 22 | 53 | 30.3 | 54 | 17 | 11 | 1 | 0.001 |
Antipsychotics | 294 | 60.4 | 26 | 15 | 268 | 85.9 | |||
Racea | 73.5 | 2 | <0.001 | ||||||
White | 273 | 56.1 | 104 | 59.4 | 169 | 54.2 | |||
Black | 149 | 30.6 | 22 | 12.6 | 127 | 40.7 | |||
Other | 65 | 13.3 | 49 | 28 | 16 | 5.1 | |||
M | SD | M | SD | M | SD | t | df | p | |
Age | 32.8 | 14.3 | 19.2 | 3.5 | 40.6 | 12.1 | −29 | 380.5 | <0.001 |
Years of education | 12.2 | 2.4 | 13 | 10 | −1.5 | 483 | 0.12 | ||
Depressive symptomsb | 6 | 4.8 | 2.5 | 2.8 | |||||
Positive symptomsc | 13 | 4.1 | 10 | 4.9 | |||||
Negative symptomsd | 11 | 6.3 | 7.5 | 3.2 | |||||
CPZ equivalent dosagee | — | — | 139.3 | 68.1 | 676.9 | 514.3 |
Chi-square tests and independent sample t-tests, when appropriate, were used to test demographic differences across groups
aSelf-reported race
bMeasured by the CDSS for both groups
cMeasured by the BPRS for the SCZ group, and the SIPS for the CHR group
dMeasured by the BPRS for the SCZ group, and the SIPS for the CHR group
eDosage reported for those on neuroleptics, converted to CPZ equivalents72
Measures
The CDSS was used to assess depressive symptoms as secondary sources of negative symptoms. This scale has shown excellent psychometric properties in regard to inter-rater reliability, sensitivity, specificity, and discriminant/convergent validity, as well as internal consistency in schizophrenia populations35,36,40–44. Further, it has been found to have advantages relative to depression rating scales not specialized for schizophrenia21,45–47. The presence of negative symptoms endemic to psychosis can often complicate efforts to assess depressive symptoms15. Notably, the CDSS was also specifically designed and validated for this purpose of separating primary negative symptoms from depressive symptoms in schizophrenia37, and is widely recommended for assessing the severity of depressive symptoms in psychotic populations38,48,49.
In the SCZ patient sample, consensus diagnosis was established via a best-estimate approach based on psychiatric history and multiple interviews and subsequently confirmed using the SCID50. All patients met DSM-IV lifetime diagnostic criteria for a psychotic disorder. A clinical interview was also performed, and patients were rated on the Brief Psychiatric Rating Scale (BPRS)51, Scale for the Assessment of Negative Symptoms (SANS)52, and CDSS. Ratings were made by clinicians with multiple years of clinical experience who were trained to reliability standards of alpha > 0.80 on each scale using internal gold-standard trainings conducted monthly to prevent rater drift and ensure standardization of rating procedures.
For CHR individuals, the Structured Interview for Psychosis risk Syndromes (SIPS)53 was administered to diagnose a psychosis risk syndrome. The SIPS rates the severity of several attenuated psychotic symptoms on 7-point scales. Positive symptoms are rated absent (0) to psychotic (6), and negative symptoms are rated absent (0) to severe (6). For the purposes of this study, SIPS ratings ranged from 0 to 5, as ratings of 6 indicate psychotic level symptoms, which would signal the individual to be “too far along” for a CHR diagnosis. Sum scores were used to quantify positive and primary negative symptoms. In addition, the Structured Clinical Interview for DSM-IV and 5 (SCID)54 was used to assess for the presence of a formal psychotic disorder and/or the presence of any non-psychotic psychiatric diagnoses. Both of these measures have been used extensively in studies with CHR individuals, and previous research has shown that the SCID has excellent inter-rater reliability55. All interviews were conducted by experienced researchers who underwent extensive gold-standard training; Kappas of at least 0.8 for SIPS and 0.9 for psychosis risk and psychiatric diagnoses were obtained, consistent with previous lab investigations20.
Data analyses
Preliminary analyses
Data were checked for skew using SPSS. The CDSS sum score was skewed in both groups (median = 2, interquartile range = 3 in SCZ patients and median = 5, interquartile range = 9 in CHR individuals). Given that the use of the CDSS as a total sum score in the literature assumes a one-factor solution, a one-factor model was tested including all CDSS items using CFA. As indicator variables share components, correlations were allowed between residual terms56–58. The Maximum Likelihood estimator was applied with robust standard errors (MLR) in order to obtain appropriate fit indices for skewed data57. The Comparative Fit Index (CFI), Tucker Lewis Index (TLI), Root Mean Square Error of Approximation (RMSEA), and Standardized Root Mean Square Residual (SRMR) were used to evaluate model fit. CFI and TLI values ≥0.90, RMSEA ≤ 0.10, and SRMR ≤ 0.06 were considered indicative of acceptable model fit59,60.
Multi-group CFA analyses
Measurement invariance was tested across groups using multi-group CFA, and involved four consecutive steps: configural, metric/weak, scalar/strong, and strict invariance. These steps iteratively constrain the number of factors, loadings, intercepts, and residuals to equality. At each step, the fit of the more constrained model is tested against the previous model through a chi-square difference test. For this test, an alpha of 0.05 was used as a threshold for statistical significance, in keeping with the conventional threshold. Given sample sizes of n > 300, a change of CFI ≤ −0.10 along with a change in RMSEA of ≤0.015 was indicative of invariance61.
Measurement invariance analyses
Configural invariance was first tested and determined whether the factor structure was similar in both diagnoses. Configural invariance testing assumes that a set of observed measures evoke the same conceptual frame of reference in each group at the most basic level62. That is, whether a measure evaluates a given latent construct similarly across groups. If configural invariance held, metric (weak) invariance would then be tested. Metric invariance models constrain the item factor loadings to be equal across groups. If metric invariance holds, structural relations between groups, such as factor correlations, may be examined and compared across groups63. In that case, scalar invariance would be tested, which constrains the intercepts to be equal across groups. This is the minimum level of invariance required to allow for the comparison of latent means and regression parameters between groups64. A lack of scalar invariance indicates differential item functioning between groups. If strong invariance holds, strict invariance would be tested by also constraining residuals to equality between groups. If the measure is not invariant at any level prior to strict invariance, more constrained models are not tested63,64.
Unifactorial and two-factor analyses
A one-factor solution was first tested. Then, a two-factor solution was tested separating depression/hopelessness and guilt/self-depreciation items, in line with previous studies21,23,38. The first depression/hopelessness factor included five items (depression, hopelessness, morning depression, suicide, and observed depression). The second guilt/self-depreciation factor included three items (self-depreciation, guilty ideas of reference, and pathological guilt). Item 7, early wakening, showed very low or absent correlations with other items (Supplementary Tables 1 and 2). Thus, in line with other studies of two-factor models showing its removal improved internal consistency, it was excluded from analyses; see Fig. 1 for diagram of models tested23,38. For reliability information, please see Supplementary Material and Supplementary Table 1. CFA, measurement invariance, and reliability analyses were conducted using the R packages psych, lavaan, and semTools57,65–67. Finally, all analyses were re-run excluding individuals with affective disorders in the SCZ and CHR groups. This was done to determine whether results were driven by individuals with a diagnosed affective disorder, as we were also interested in depressive symptom measurement at “sub-threshold” levels not severe enough to qualify for an affective disorder diagnosis.
Analyses examining associations with positive and negative symptomatology
To explore clinical correlates of depressive factors across phases of psychotic illness, point-biserial correlations were used to predict CDSS sum score with presence or absence of an affective disorder diagnosis. In this vein, CDSS sum score and two factors were correlated with positive symptoms in SCZ and CHR groups using Spearman correlations (due to data skew; Pearson correlation results are similar and presented in Supplementary Table 3); this is given previous studies finding associations between positive symptom severity, illness severity, and CDSS sum score26,49. As a test of discriminant validity, Spearman correlations were used to test associations between negative symptoms and CDSS sum score within SCZ and CHR groups separately. Finally, associations with primary negative symptom subdimensions of volition and emotional expression (measured by the SANS and the SIPS in SCZ and CHR samples, respectively) were tested. Finally, in an exploratory fashion, Spearman correlations were run between antipsychotic dosage (among those individuals on neuroleptics), total depressive symptoms (secondary sources of negative symptoms), and total primary negative symptoms.
Results
Expectedly (and rather unavoidably for any investigations comparing across CHR and SCZ stages), the SCZ group had a greater proportion of males, higher neuroleptic usage, and greater age compared to CHR individuals. A large majority of the CHR sample was neuroleptic free (85%), while a majority of the SCZ sample was medicated (14% neuroleptic free). There were no significant associations between antipsychotic dosage, depressive symptoms, and negative symptoms across groups (p = 0.08–0.76), except for an association between total CDSS score and antipsychotic dosage in the SCZ group (r = 0.12, p = 0.04). This could be due to increased illness severity in those with greater neuroleptic dosages, which has been correlated with depressive symptoms in SCZ26. The prevalence of depressive diagnoses was roughly 22% across groups, with a higher proportion in the CHR group (see Table 1). In terms of reliability of the scale as a whole, using a confirmatory one-factor model with SEM across the whole sample, total = 0.91. For the CHR group, ω total = 0.86. For the SCZ group, ω total = 0.8 (see Supplementary Table 3).
Measurement invariance
The one-factor CFA model showed an adequate fit, Robust χ2 = 69.10, df = 27, p < 0.001, Robust TLI = 0.93, CFI = 0.95, RMSEA = 0.07, SRMR = 0.04. When individuals with an affective disorder were removed from analysis (remaining n = 258 for SCZ, n = 122 for CHR), the one-factor model remained an adequate fit (Robust TLI = 0.91, CFI = 0.93, RMSEA = 0.08, SRMR = 0.05; see Table 2). The model met for metric invariance, indicating that the loadings were similar between groups.
Table 2.
Model | χ 2 | df | χ 2 | p | CFI | CFI | RMSEA | RMSEA |
---|---|---|---|---|---|---|---|---|
Thresholds | ≤−0.010 | ≤0.015 | ||||||
One-factor model | ||||||||
Configural invariance | 103.99 | 54 | — | — | 0.94 | — | 0.05 | — |
Metric invariance | 118.21 | 62 | 12.59 | 0.13 | 0.93 | 0.01 | 0.05 | 0 |
Scalar invariance | 137.36 | 70 | 19.16 | 0.01 | 0.91 | 0.02 | 0.05 | 0 |
Two-factor model | ||||||||
Configural invariance | 104.43 | 40 | — | — | 0.94 | — | 0.06 | — |
Metric invariance | 122.20 | 47 | 9.58 | 0.21 | 0.94 | 0.003 | 0.06 | 0.003 |
Scalar invariance | 135.24 | 54 | 12.54 | 0.08 | 0.93 | 0.01 | 0.06 | <0.001 |
Strict invariance | 312.76 | 62 | 66.61 | <0.001 | 0.76 | 0.168 | 0.1 | 0.04 |
The CFA specifying a two-factor structure was a good fit, Robust χ2 = 44.29, df = 19, p = 0.001, TLI = 0.94, CFI = 0.96, RMSEA = 0.05, SRMR = 0.04. The two-factor model remained an adequate fit when schizoaffective disorder individuals were excluded (TLI = 0.92, CFI = 0.95, RMSEA = 0.08, SRMR = 0.05). The correlation between the two factors was r = 0.90. The model met for scalar invariance, indicating that the loadings and intercepts were similar between groups (see Tables 2 and 3).
Table 3.
CHR | SCZ | |||||
---|---|---|---|---|---|---|
Intercepts | Variances | Latent variables | Intercepts | Variances | Latent variables | |
One-factor model | ||||||
Depression | 1.09 | 0.42 | 1.0 | 0.47 | 0.24 | 1.0 |
Hopelessness | 0.57 | 0.28 | 0.73 | 0.28 | 0.20 | 0.87 |
Self-depreciation | 0.86 | 0.61 | 0.93 | 0.33 | 0.28 | 0.85 |
Guilty ideas of reference | 0.47 | 0.56 | 0.35 | 0.18 | 0.21 | 0.40 |
Pathological guilt | 0.77 | 0.52 | 0.79 | 0.39 | 0.30 | 0.61 |
Morning depression | 0.57 | 0.24 | 0.61 | 0.26 | 0.21 | 0.77 |
Early wakening | 0.57 | 0.76 | 0.21 | 0.21 | 0.28 | 0.02 |
Suicide | 0.32 | 0.26 | 0.48 | 0.1 | 0.14 | 0.25 |
Observed depression | 0.52 | 0.27 | 0.71 | 0.24 | 0.14 | 0.63 |
Two-factor model: depression/hopelessness factor | ||||||
Depression | 1.09 | 0.39 | 1.00 | 0.47 | 0.24 | 1.0 |
Hopelessness | 0.57 | 0.27 | 0.72 | 0.28 | 0.20 | 0.87 |
Morning Depression | 0.57 | 0.23 | 0.60 | 0.26 | 0.21 | 0.77 |
Suicide | 0.32 | 0.27 | 0.46 | 0.10 | 0.14 | 0.25 |
Observed Depression | 0.52 | 0.26 | 0.70 | 0.24 | 0.14 | 0.63 |
Two-factor model: guilt/self-depreciation factor | ||||||
Self-depreciation | 0.86 | 0.53 | 1.00 | 0.33 | 0.27 | 1.00 |
Guilty ideas of reference | 0.47 | 0.53 | 0.42 | 0.18 | 0.21 | 0.48 |
Pathological guilt | 0.77 | 0.43 | 0.87 | 0.39 | 0.29 | 0.72 |
Correlations between depression, symptoms and affective disorder diagnosis
In CHR individuals, there were strong correlations between depressive symptoms and primary negative symptoms, which was not the case for SCZ. For both CHR and SCZ groups, there were correlations between depressive symptoms and positive symptoms (see Table 4). As expected, having an affective disorder diagnosis predicted higher CDSS sum score for SCZ [r = 0.22, p < 0.001] and CHR [r = 0.42, p < 0.001] groups. Finally, for the SCZ sample neither the volition [r = 0.07, p = 0.27] nor the emotional expression [r = −0.01, p = 0.83] domains correlated with total depressive symptoms. This was also the case for the depression/hopelessness and guilt/self-depreciation factors (p = 0.12–0.89). For the CHR sample both the volition [r = 0.47, p < 0.001] and the emotional expression [r = 0.17, p = 0.03] domains correlated with total depressive symptoms. This was also the case for depression/hopelessness ([r = 0.46, p < 0.001] for volition and [r = 0.19, p = 0.01] for emotion expression) and partially for guilt/self-depreciation ([r = 0.32, p < 0.001] for volition and [r = 0.09, p = 0.23] for emotion expression).
Table 4.
CHR | SCZ | ||||||
---|---|---|---|---|---|---|---|
Sum score | Guilt/self- depreciation | Depression/hopelessness | Sum score | Guilt/self-depreciation | Depression/hopelessness | ||
Positive symptoms | |||||||
SIPS | r = 0.31** | r = 0.31** | r = 0.23** | ||||
p < 0.001 | p < 0.001 | p = 0.003 | |||||
BPRS | r = 0.24** | r = 0.25** | r = 0.15** | ||||
p < 0.001 | p < 0.001 | p = 0.008 | |||||
SIPS | r = 0.45** | r = 0.34** | r = 0.43** | ||||
p < 0.001 | p < 0.001 | p < 0.001 | |||||
Negative symptoms | |||||||
BPRS | r = −0.03 | r = −0.01 | r = 0.02 | ||||
p = 0.66 | p = 0.81 | p = 0.68 | |||||
SANS | r = 0.05 | r = 0.08 | r = 0.05 | ||||
p = 0.47 | p = 0.20 | p = 0.43 |
*p < 0.05; **p < 0.01
Discussion
The present investigation is the first to apply a measurement invariance approach to the critical question of secondary influences on negative symptoms (i.e. depressive symptoms) across stages of severity within the psychosis spectrum. The one-factor model demonstrated metric/weak invariance across SCZ and CHR groups, suggesting that depressive symptoms are systematically more likely to be present in CHR individuals. Notably, the two-factor solution that was explored separating depression and guilt/self-depreciation factors met for scalar invariance (p = 0.08; see Table 2), indicating a better fit across groups than the one-factor solution. Further, excluding individuals with an affective disorder diagnosis did not alter fit substantially. Associating depression measures with positive and negative symptom scales allowed for exploring critical questions regarding clinical correlates of depressive factors across phases of psychotic illness. Of particular interest, depressive symptoms were highly correlated with negative symptoms in CHR individuals, but not significantly correlated with negative symptoms across two separate scales in SCZ patients. In summary, this investigation suggests that sum scores/one-factor models for depression may not be comparable in magnitude across the psychosis spectrum. In addition, current measures of negative symptoms in CHR individuals may not be fully distinguishing secondary negative symptoms (depression) from primary negative symptoms (i.e. symptoms idiopathic to the disorder) prior to psychosis onset. It is also a possibility that primary and secondary negative symptoms are not distinguishable at this stage. However, it may prove useful to separate depression/hopelessness and guilt/self-depreciation factors if one is to compare across stages of illness progression. Present results are critical for etiological conceptualizations, as well as for informing treatment and prevention efforts.
Findings with regard to measurement invariance of a one-factor model for depression yielded a lack of similarity in intercepts. This was apparent for all items, though particularly so for depression (item 1) and hopelessness (item 2), such that compared to the SCZ group, the CHR group had a higher likelihood of endorsing these items (see Tables 2 and 3). Further, in the present sample, CHR individuals had a significantly greater proportion of individuals diagnosed with a depressive disorder. Results support the literature, namely the notion that depressive disorders are highly prevalent in the CHR period, with estimates as high as almost half of the population having a diagnosis6,7,11,18. However, excluding individuals diagnosed with a mood disorder did not alter the fit of the one-factor model. Thus, findings suggest that even sub-threshold mood symptoms may be systematically more present in CHR individuals versus SCZ patients. Therefore, sum depression scores may not be directly comparable in frequency or intensity across stages of psychotic illness.
The tested two-factor structure yielded compelling results, adding complexity to interpretation (see Tables 2 and 3). Consistent with prior studies in schizophrenia22–24 and CHR38 populations, support for a two-factor solution was found, with factors of depression/hopelessness and guilt/self-depreciation. This met for scalar invariance, constituting a better fit than that of the one-factor structure. However, the model did not meet for strict invariance, meaning the residuals were not equal across groups. Demographic differences across groups may be contributing to this lack of equality in residuals. Notably, associations of depression with negative symptom measures remained non-significant in SCZ patients, and strong for both factors in CHR individuals. Taken together, these results suggest that the field may benefit from separating depression/hopelessness and guilt/self-depreciation items, as this may aid comparability across CHR and psychotic disorder groups. However, it is worth emphasizing that the model only narrowly met for scalar invariance (p = 0.08; see Table 2). Further, given the latent factor correlation was rather high (r = 0.9), perhaps the distinction is not substantial between the models, despite metrics indicating a slightly better fit. Thus, concerns remain regarding possible systematic differences in item endorsement between groups.
Clinical correlates of depressive factors across phases of psychotic illness were explored. Of note, there were strong positive associations between depressive symptoms and positive symptoms, in line with previous studies finding depression to be associated with illness severity26, course, and prognosis3. Additional findings raise relevant considerations with regard to differentiating sources of negative symptoms (primary versus secondary) in CHR populations. Barring one highly informative investigation suggesting differential trajectories of primary versus secondary negative symptoms in CHR individuals5, this question has been largely understudied. In the present sample, negative symptoms as assessed by the SIPS were highly correlated with depressive symptoms in CHR individuals. This is in contrast to the SCZ group, where depressive symptoms were not associated with negative symptoms across two different scales (the SANS and the BPRS). Results in the SCZ group are consistent with the wider literature finding a lack of correlation between secondary sources of negative symptoms (depression) and primary negative symptoms21–24. Though further research is needed, results suggest that secondary negative symptoms such as depression may not only be more prevalent in CHR populations, but they may also not be as easily differentiated from primary negative symptoms relative to SCZ patients5,15,16,68. It is also key to note, however, that because depressive symptom endorsement frequencies were much higher in CHR individuals, this could have increased variance, contributing to the strength of the correlations.
Results suggest there is a possibility that primary negative symptoms are not meaningfully distinguishable from secondary negative symptoms at the CHR stage of illness progression. This is a critical question to address, especially given that the literature has yet to reach a conclusion on when primary negative symptoms emerge5. Future investigations will be needed to further clarify whether the distinction of primary and secondary negative symptoms is meaningful at CHR stages of illness progression68. The literature suggests that whereas secondary negative symptoms may change across illness trajectory, primary negative symptoms may be relatively stable5,15. Research attempting to differentiate primary and secondary negative symptoms in CHR individuals is rather limited, though a previous study has reported differences in trajectories between primary and secondary symptoms in this group, suggesting these may differentially predict risk of conversion to psychosis5,69. If sources of negative symptoms are distinguishable in CHR individuals, perhaps those CHR participants that have higher primary negative symptoms at baseline are more likely to convert, or alternatively, those whose secondary negative symptoms increase over time could be more likely to convert. It could also be of great benefit to determine whether those who exhibit greater primary negative symptoms are at higher risk of conversion relative to those that present chiefly with secondary negative symptoms. Present study results highlight the need for future investigations interested in the phenomenology of depression and negative symptoms in CHR individuals, in order to develop novel measurement techniques aiming to differentiate depressive from primary negative symptoms in this group.
Previous psychometric studies in CHR individuals have found volition and emotional expression as separate factors as assessed by the SIPS (linked to distinct functional outcomes, consistent with findings in chronic psychosis), with the emotional expression factor comprising emotional expression, emotional experience, and social anhedonia items, and the volition factor comprising occupational functioning and avolition20. In the present study, exploratory correlations of depression with these negative symptom dimensions yielded a lack of association in SCZ patients. In CHR individuals, however, significant associations were found in the same direction for both dimensions, though the strength of the association for volition was greater than that found for emotion expression. Perhaps current measures of negative symptoms in CHR groups (i.e. SIPS) are picking up more overlapping components of volition-related symptoms and depressive etiology. Future studies are needed to determine whether volition in CHR individuals manifests in a systematically distinct way from SCZ patients, as well as whether this dimension differentially predicts illness progression.
Unfortunately, in the present study sample sizes did not permit forming primary negative symptom subgroups in each population. Further, standardized means of delineating secondary negative symptoms and their specific sources on any rating scales are not available at the present time. These circumstances limit our ability to answer more refined questions with regards to negative symptom dimensions. Also, it is critical to consider that though widely used and thoroughly validated in CHR groups, extant SIPS negative symptom items contain some limitations surrounding content validity. For example, SIPS social anhedonia rating does not explicitly evaluate pleasure, while also conflating asociality, social anxiety and social skill70. In addition, the SIPS negative symptom domains (social anhedonia, avolition, expression of emotion, experience of emotions and self, ideational richness, and occupational functioning) do not entirely map onto the negative symptom domains identified by the NIMH for psychosis disorder individuals (anhedonia, avolition, asociality, blunted affect, alogia)70. This further highlights the need for scale development for negative symptoms in CHR individuals. Scales of primary negative symptoms that are invariant across CHR and chronic psychosis have yet to be developed, and so we were limited to using separate negative symptom scales for CHR and chronic psychosis groups respectively. Future studies could also benefit from combining expert ratings (as in the present study) with patient self-reported ratings. In addition, due to sample size restrictions, this investigation was unable to evaluate the roles of ethnicity, gender and culture.
We undertook a cross-sectional approach. However, a longitudinal approach examining whether measurement invariance holds across time for prodromal individuals converting to a psychotic disorder would be informative. It would also be beneficial in tracking the progression of depression along with negative symptoms. Including a first episode psychosis group would also have been greatly informative in more fully depicting the psychosis spectrum. The present investigation included primary psychotic disorder individuals (schizophrenia and schizoaffective disorder). It will be informative for future investigations to also include individuals with affective disorders with psychotic features, such as depression or bipolar disorder with psychotic features. This will allow us to broaden the breadth of representation of the psychosis spectrum, as the lack of inclusion of these individuals may have influenced current results. Given the greater prevalence of mood disorders among females71, future studies with larger samples allowing properly powered analyses may benefit from grouping based on gender. Future studies with available data would also benefit from examining duration of illness across groups. Finally, all chronic psychosis individuals were recruited at the same site, and CHR individuals were administered the same interviews following equivalent procedure, with no significant differences in demographic characteristics between the three recruitment sites. Nonetheless, ideally future investigations would use data from the same site in order to minimize heterogeneity.
In all, present results provide valuable information for treatment of CHR populations, as well as for increasing our understanding of the etiology of negative symptoms with relation to depressive symptoms. Further, findings offer useful measurement information for groups seeking to assess negative and depressive symptoms across the psychosis spectrum. Possible systematic differences in endorsement of depressive symptoms in CHR may suggest that depression could be an apt target for intervention at this stage of illness progression. Treating depressive symptoms early in the prodrome may aid in halting functional deterioration. Finally, the present results highlight the need for future measurement efforts addressing the question of at which stage of illness progression primary negative symptoms emerge. Further focus on this critical question may aid us in better understanding the etiological roots of psychosis and inform symptom targets for early intervention and treatment efforts.
Supplementary information
Acknowledgements
This work was supported by a Binghamton University Translational Areas of Excellence Grant (to G.P.S), grants R01MH112545, R21/R33MH103231, R21MH110374, R21MH115231 (to V.A.M.), U01MH081988 (E.F.W.), and 5P30MH068580 (to R.W.B. and J.M.G).
Conflict of interest
The authors declare that they have no conflict of interest.
Ethics approval
All studies were approved by IRB and complied with ethical standards for research with human subjects.
Footnotes
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Supplementary Information accompanies this paper at (10.1038/s41398-019-0563-x).
References
- 1.Majadas S, Olivares J, Galan J, Diez T. Prevalence of depression and its relationship with other clinical characteristics in a sample of patients with stable schizophrenia. Compr. Psychiatry. 2012;53:145–151. doi: 10.1016/j.comppsych.2011.03.009. [DOI] [PubMed] [Google Scholar]
- 2.Diwan S, et al. Depression in older adults with schizophrenia spectrum disorders: prevalence and associated factors. Am. J. Geriatr. Psychiatry. 2007;15:991–998. doi: 10.1097/JGP.0b013e31815ae34b. [DOI] [PubMed] [Google Scholar]
- 3.Hartley S, Barrowclough C, Haddock G. Anxiety and depression in psychosis: a systematic review of associations with positive psychotic symptoms. Acta Psychiatr. Scand. 2013;128:327–346. doi: 10.1111/acps.12080. [DOI] [PubMed] [Google Scholar]
- 4.Strauss GP, Sandt AR, Catalano LT, Allen DN. Negative symptoms and depression predict lower psychological well-being in individuals with schizophrenia. Compr. Psychiatry. 2012;53:1137–1144. doi: 10.1016/j.comppsych.2012.05.009. [DOI] [PubMed] [Google Scholar]
- 5.Azar Marleine, Pruessner Marita, Baer Lawrence H., Iyer Srividya, Malla Ashok K., Lepage Martin. A study on negative and depressive symptom prevalence in individuals at ultra-high risk for psychosis. Early Intervention in Psychiatry. 2016;12(5):900–906. doi: 10.1111/eip.12386. [DOI] [PubMed] [Google Scholar]
- 6.Hengartner MP, et al. Course of psychotic symptoms, depression and global functioning in persons at clinical high risk of psychosis: results of a longitudinal observation study over three years focusing on both converters and non-converters. Schizophr. Res. 2017;189:19–26. doi: 10.1016/j.schres.2017.01.040. [DOI] [PubMed] [Google Scholar]
- 7.Fusar-Poli P, Nelson B, Valmaggia L, Yung AR, McGuire PK. Comorbid depressive and anxiety disorders in 509 individuals with an at-risk mental state: impact on psychopathology and transition to psychosis. Schizophr. Bull. 2014;40:120–131. doi: 10.1093/schbul/sbs136. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Hui C, et al. Psychiatric morbidity, functioning and quality of life in young people at clinical high risk for psychosis. Schizophr. Res. 2013;148:175–180. doi: 10.1016/j.schres.2013.05.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Rosen JL, Miller TJ, D’Andrea JT, McGlashan TH, Woods SW. Comorbid diagnoses in patients meeting criteria for the schizophrenia prodrome. Schizophr. Res. 2006;85:124–131. doi: 10.1016/j.schres.2006.03.034. [DOI] [PubMed] [Google Scholar]
- 10.Rutigliano G, et al. Persistence or recurrence of non-psychotic comorbid mental disorders associated with 6-year poor functional outcomes in patients at ultra high risk for psychosis. J. Affect. Disord. 2016;203:101–110. doi: 10.1016/j.jad.2016.05.053. [DOI] [PubMed] [Google Scholar]
- 11.Rietdijk J, et al. Depression and social anxiety in help-seeking patients with an ultra-high risk for developing psychosis. Psychiatry Res. 2013;209:309–313. doi: 10.1016/j.psychres.2013.01.012. [DOI] [PubMed] [Google Scholar]
- 12.Fulford D, et al. Symptom dimensions and functional impairment in early psychosis: more to the story than just negative symptoms. Schizophr. Res. 2013;147:125–131. doi: 10.1016/j.schres.2013.03.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Fusar-Poli P. The hype cycle of the clinical high risk state for psychosis: the need of a refined approach. Schizophrenia Bull. 2018;44:250–253. doi: 10.1093/schbul/sbx181. [DOI] [Google Scholar]
- 14.Kirkpatrick B, Buchanan RW, Ross DE, Carpenter WT., Jr. A separate disease within the syndrome of schizophrenia. Arch. Gen. Psychiatry. 2001;58:165–171. doi: 10.1001/archpsyc.58.2.165. [DOI] [PubMed] [Google Scholar]
- 15.Peralta V, Cuesta MJ, Martinez-Larrea A, Serrano JF. Differentiating primary from secondary negative symptoms in schizophrenia: a study of neuroleptic-naive patients before and after treatment. Am. J. Psychiatry. 2000;157:1461–1466. doi: 10.1176/appi.ajp.157.9.1461. [DOI] [PubMed] [Google Scholar]
- 16.Kirkpatrick B, Buchanan RW, Breier A, Carpenter WT., Jr. Depressive symptoms and the deficit syndrome of schizophrenia. J. Nerv. Ment. Dis. 1994;182:452–455. doi: 10.1097/00005053-199408000-00005. [DOI] [PubMed] [Google Scholar]
- 17.Carpenter WT, Jr., Heinrichs DW, Wagman AM. Deficit and nondeficit forms of schizophrenia: the concept. Am. J. Psychiatry. 1988;145:578–583. doi: 10.1176/ajp.145.7.902. [DOI] [PubMed] [Google Scholar]
- 18.Piskulic D, et al. Negative symptoms in individuals at clinical high risk of psychosis. Psychiatry Res. 2012;196:220–224. doi: 10.1016/j.psychres.2012.02.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Lee SJ, Kim KR, Lee SY, An SK. Impaired social and role function in ultra-high risk for psychosis and first-episode schizophrenia: its relations with negative symptoms. Psychiatry Investig. 2017;14:539–545. doi: 10.4306/pi.2017.14.5.539. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Azis Matilda, Strauss Gregory P, Walker Elaine, Revelle William, Zinbarg Richard, Mittal Vijay. Factor Analysis of Negative Symptom Items in the Structured Interview for Prodromal Syndromes. Schizophrenia Bulletin. 2018;45(5):1042–1050. doi: 10.1093/schbul/sby177. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Addington D, Addington J, Atkinson M. A psychometric comparison of the Calgary Depression Scale for Schizophrenia and the Hamilton Depression Rating Scale. Schizophr. Res. 1996;19:205–212. doi: 10.1016/0920-9964(95)00070-4. [DOI] [PubMed] [Google Scholar]
- 22.Maggini C, Raballo A. Exploring depression in schizophrenia. Eur. Psychiatry. 2006;21:227–232. doi: 10.1016/j.eurpsy.2005.07.001. [DOI] [PubMed] [Google Scholar]
- 23.Rabany L, Weiser M, Levkovitz Y. Guilt and depression: two different factors in individuals with negative symptoms of schizophrenia. Eur. Psychiatry. 2013;28:327–331. doi: 10.1016/j.eurpsy.2012.02.008. [DOI] [PubMed] [Google Scholar]
- 24.Schennach R, et al. Evaluating depressive symptoms in schizophrenia: a psychometric comparison of the Calgary Depression Scale for Schizophrenia and the Hamilton Depression Rating Scale. Psychopathology. 2012;45:276–285. doi: 10.1159/000336729. [DOI] [PubMed] [Google Scholar]
- 25.Krynicki CR, Upthegrove R, Deakin J, Barnes TR. The relationship between negative symptoms and depression in schizophrenia: a systematic review. Acta Psychiatr. Scand. 2018;137:380–390. doi: 10.1111/acps.12873. [DOI] [PubMed] [Google Scholar]
- 26.Fervaha G, et al. Determinants of patient-rated and clinician-rated illness severity in schizophrenia. J. Clin. Psychiatry. 2015;76:924–930. doi: 10.4088/JCP.14m09128. [DOI] [PubMed] [Google Scholar]
- 27.Fenton WS, McGlashan TH. Antecedents, symptom progression, and long-term outcome of the deficit syndrome in schizophrenia. Am. J. Psychiatry. 1994;151:351–356. doi: 10.1176/ajp.151.3.351. [DOI] [PubMed] [Google Scholar]
- 28.Kirkpatrick B, Ram R, Bromet E. The deficit syndrome in the Suffolk County Mental Health Project. Schizophr. Res. 1996;22:119–126. doi: 10.1016/S0920-9964(96)00057-6. [DOI] [PubMed] [Google Scholar]
- 29.Kirkpatrick B, et al. The deficit syndrome in the DSM-IV Field Trial: I. Alcohol and other drug abuse. Schizophr. Res. 1996;20:69–77. doi: 10.1016/0920-9964(95)00102-6. [DOI] [PubMed] [Google Scholar]
- 30.Kirkpatrick B, Buchanan RW, Breier A, Carpenter WT., Jr. Case identification and stability of the deficit syndrome of schizophrenia. Psychiatry Res. 1993;47:47–56. doi: 10.1016/0165-1781(93)90054-K. [DOI] [PubMed] [Google Scholar]
- 31.Blanchard JJ, Cohen AS. The structure of negative symptoms within schizophrenia: implications for assessment. Schizophr. Bull. 2006;32:238–245. doi: 10.1093/schbul/sbj013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Kring AM, Gur RE, Blanchard JJ, Horan WP, Reise SP. The Clinical Assessment Interview for Negative Symptoms (CAINS): final development and validation. Am. J. Psychiatry. 2013;170:165–172. doi: 10.1176/appi.ajp.2012.12010109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Strauss GP, et al. Factor structure of the Brief Negative Symptom Scale. Schizophr. Res. 2012;142:96–98. doi: 10.1016/j.schres.2012.09.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Strauss GP, Cohen AS. A transdiagnostic review of negative symptom phenomenology and etiology. Schizophr. Bull. 2017;43:712–719. doi: 10.1093/schbul/sbx066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Addington D, Addington J, Maticka-Tyndale E. Specificity of the Calgary Depression Scale for schizophrenics. Schizophr. Res. 1994;11:239–244. doi: 10.1016/0920-9964(94)90017-5. [DOI] [PubMed] [Google Scholar]
- 36.Addington D, Addington J, Maticka-Tyndale E, Joyce J. Reliability and validity of a depression rating scale for schizophrenics. Schizophr. Res. 1992;6:201–208. doi: 10.1016/0920-9964(92)90003-N. [DOI] [PubMed] [Google Scholar]
- 37.Addington D, Addington J, Schissel B. A depression rating scale for schizophrenics. Schizophr. Res. 1990;3:247–251. doi: 10.1016/0920-9964(90)90005-R. [DOI] [PubMed] [Google Scholar]
- 38.Rekhi G, Ng WY, Lee J. Clinical utility of the Calgary Depression Scale for Schizophrenia in individuals at ultra-high risk of psychosis. Schizophr. Res. 2018;193:423–427. doi: 10.1016/j.schres.2017.06.056. [DOI] [PubMed] [Google Scholar]
- 39.Kyriazos TA. Applied psychometrics: sample size and sample power considerations in factor analysis (EFA, CFA) and SEM in general. Psychology. 2018;9:2207. doi: 10.4236/psych.2018.98126. [DOI] [Google Scholar]
- 40.Bernard D, Lancon C, Auquier P, Reine G, Addington D. Calgary Depression Scale for Schizophrenia: a study of the validity of a French-language version in a population of schizophrenic patients. Acta Psychiatr. Scand. 1998;97:36–41. doi: 10.1111/j.1600-0447.1998.tb09960.x. [DOI] [PubMed] [Google Scholar]
- 41.Lancon C, Auquier P, Reine G, Toumi M, Addington D. Evaluation of depression in schizophrenia: psychometric properties of a French version of the Calgary Depression Scale. Psychiatry Res. 1999;89:123–132. doi: 10.1016/S0165-1781(99)00097-9. [DOI] [PubMed] [Google Scholar]
- 42.Lancon C, Auquier P, Reine G, Bernard D, Toumi M. Study of the concurrent validity of the Calgary Depression Scale for Schizophrenics (CDSS) J. Affect. Disord. 2000;58:107–115. doi: 10.1016/S0165-0327(99)00075-0. [DOI] [PubMed] [Google Scholar]
- 43.Muller MJ, et al. The Calgary Depression Rating Scale for Schizophrenia: development and interrater reliability of a German version (CDSS-G) J. Psychiatr. Res. 1999;33:433–443. doi: 10.1016/S0022-3956(99)00018-7. [DOI] [PubMed] [Google Scholar]
- 44.Sarro S, et al. Cross-cultural adaptation and validation of the Spanish version of the Calgary Depression Scale for Schizophrenia. Schizophr. Res. 2004;68:349–356. doi: 10.1016/S0920-9964(02)00490-5. [DOI] [PubMed] [Google Scholar]
- 45.Collins AA, Remington G, Coulter K, Birkett K. Depression in schizophrenia: a comparison of three measures. Schizophr. Res. 1996;20:205–209. doi: 10.1016/0920-9964(95)00107-7. [DOI] [PubMed] [Google Scholar]
- 46.Kim SW, et al. Diagnostic validity of assessment scales for depression in patients with schizophrenia. Psychiatry Res. 2006;144:57–63. doi: 10.1016/j.psychres.2005.10.002. [DOI] [PubMed] [Google Scholar]
- 47.Muller MJ, et al. The Calgary Depression Rating Scale for schizophrenia in a healthy control group: psychometric properties and reference values. J. Affect. Disord. 2005;88:69–74. doi: 10.1016/j.jad.2005.04.005. [DOI] [PubMed] [Google Scholar]
- 48.Grover S, Sahoo S, Dua D, Chakrabarti S, Avasthi A. Scales for assessment of depression in schizophrenia: factor analysis of calgary depression rating scale and hamilton depression rating scale. Psychiatry Res. 2017;252:333–339. doi: 10.1016/j.psychres.2017.03.018. [DOI] [PubMed] [Google Scholar]
- 49.Addington J, Shah H, Liu L, Addington D. Reliability and validity of the Calgary Depression Scale for Schizophrenia (CDSS) in youth at clinical high risk for psychosis. Schizophr. Res. 2014;153:64–67. doi: 10.1016/j.schres.2013.12.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.First M. B., Spitzer, R. L., Robert, L., Gibbon M. & Williams, J. B. W. Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Patient Edition (Biometrics Research, New York State Psychiatric Institute, New York, 2002).
- 51.Overall JE, Gorham DR. The Brief Psychiatric Rating Scale. Psychological Rep. 1962;10:799–812. doi: 10.2466/pr0.1962.10.3.799. [DOI] [Google Scholar]
- 52.Andreasen NC. The Scale for the Assessment of Negative Symptoms (SANS) Iowa City: The University of Iowa; 1983. [Google Scholar]
- 53.Miller TJ, et al. Symptom assessment in schizophrenic prodromal states. Psychiatr. Q. 1999;70:273–287. doi: 10.1023/A:1022034115078. [DOI] [PubMed] [Google Scholar]
- 54.First M., Williams, J., Karg, R. & Spitzer, R. Structured Clinical Interview for DSM-5—Research Version (SCID-5 for DSM-5, research version; SCID-5-RV) (American Psychiatric Association Publishing, 2015).
- 55.Martin CS, Pollock NK, Bukstein OG, Lynch KG. Inter-rater reliability of the SCID alcohol and substance use disorders section among adolescents. Drug Alcohol Depend. 2000;59:173–176. doi: 10.1016/S0376-8716(99)00119-2. [DOI] [PubMed] [Google Scholar]
- 56.Cole DA, Ciesla JA, Steiger JH. The insidious effects of failing to include design-driven correlated residuals in latent-variable covariance structure analysis. Psychol. Methods. 2007;12:381–398. doi: 10.1037/1082-989X.12.4.381. [DOI] [PubMed] [Google Scholar]
- 57.Rosseel Y. Lavaan: an R package for structural equation modeling. J. Stat. Softw. 2012;48:1–36. doi: 10.18637/jss.v048.i02. [DOI] [Google Scholar]
- 58.Hermida R. The problem of allowing correlated errors in structural equation modeling: concerns and considerations. Computational Methods Soc. Sci. 2015;3:5. [Google Scholar]
- 59.Byrne BM. Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming. New York, NY: Routledge; 2010. [Google Scholar]
- 60.Browne MW, Cudeck R. Alternative ways of assessing model fit. Sociol. Methods Res. 1992;21:230–258. doi: 10.1177/0049124192021002005. [DOI] [Google Scholar]
- 61.Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equ. Modeling. 2007;14:464–504. doi: 10.1080/10705510701301834. [DOI] [Google Scholar]
- 62.Vandenberg RJ, Lance CE. A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research. Organ. Res. Methods. 2000;3:4–70. doi: 10.1177/109442810031002. [DOI] [Google Scholar]
- 63.van de Schoot R, Schmidt P. Measurement Invariance. Lausanne: Frontiers Media SA; 2015. [Google Scholar]
- 64.Little TD. Longitudinal Structural Equation Modeling. Methodology in the Scoial Sciences. New York: Guildford; 2013. [Google Scholar]
- 65.Oberski D. Iavaan. survey: an R package for complex survey analysis of structural equation modeling. J. Stat. Softw. 2014;57:1–27. doi: 10.18637/jss.v057.i01. [DOI] [Google Scholar]
- 66.Revelle W. psych: Procedures for Personality and Psychological Research (Northwestern University, Evanston, 2012). https://cran.r-project.org/web/packages/psych/index.html.
- 67.Jorgensen T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. semTools: Useful Tools for Structural Equation Modeling. R package version 0.5-0 (2018).
- 68.Flaum M, Andreasen N. The reliability of distinguishing primary versus secondary negative symptoms. Compr. Psychiatry. 1995;36:421–427. doi: 10.1016/S0010-440X(95)90249-X. [DOI] [PubMed] [Google Scholar]
- 69.Marshall C., et al. Changes in symptom content from a clinical high-risk state to conversion to psychosis. Early Interv. Psychiatry13, 257–263 (2017). [DOI] [PMC free article] [PubMed]
- 70.Pelletier-Baldelli A, Strauss GP, Visser KH, Mittal VA. Initial development and preliminary psychometric properties of the Prodromal Inventory of Negative Symptoms (PINS) Schizophr. Res. 2017;189:43–49. doi: 10.1016/j.schres.2017.01.055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Piccinelli M, Wilkinson G. Gender differences in depression: critical review. Br. J. Psychiatry. 2000;177:486–492. doi: 10.1192/bjp.177.6.486. [DOI] [PubMed] [Google Scholar]
- 72.Leucht S, et al. Dose equivalents for second-generation antipsychotics: the minimum effective dose method. Schizophr. Bull. 2014;40:314–332. doi: 10.1093/schbul/sbu001. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.