Abstract
Aim
The Scale of Prodromal Symptoms (SOPS) was developed to identify individuals experiencing early signs of psychosis, a critical first step towards early intervention. Preliminary dimension reduction analyses suggested that psychosis-risk symptoms may deviate from the traditional symptom structure of schizophrenia, but findings have been inconsistent. This study investigated the phenomenology of psychosis risk symptoms in a large sample from a multi-site, national study using rigorous factor analysis procedure.
Methods
Participants were 334 help-seeking youth (age: 17.0 ± 3.3) from the Early Detection and Intervention for the Prevention of Psychosis Program (EDIPPP), consisting of 203 participants at clinically higher risk (sum of P scores ≥ 7), 87 with clinically lower risk (sum of P scores < 7) and 44 in very early first-episode psychosis (< 30 days of positive symptoms). Baseline SOPS data were subjected to Principal Axis Factoring (PAF), estimating factors based on shared variance, with Oblimin rotation.
Results
PAF yielded 4 latent factors explaining 36.1% of total variance: Positive Symptoms; Distress; Negative Symptoms; and Deteriorated Thought Process. They showed reasonable internal consistency and good convergence validity, and were not orthogonal.
Conclusions
The empirical factors of the SOPS showed similarities and notable differences compared with the existing SOPS structure. Regrouping the symptoms based on the empirical symptom dimensions may improve the diagnostic validity of the SOPS. Relative prominence of the factors and symptom frequency support early identification strategies focusing on positive symptoms and distress. Future investigation of long-term functional implications of these symptom factors may further inform intervention strategies.
Keywords: factor analysis, prodrome, psychosis, schizophrenia, ultra high risk
Introduction
Schizophrenia is a severe and chronic mental disorder that often requires long-term treatment and care. Data accumulated over the past decades have shown that duration of untreated psychosis is a reliable predictor of poor prognosis and long-term outcome,1-4 providing a strong argument for early intervention. Treatment of psychosis at first episode or early on during the course has shown promising results, including reduced relapse rate and better psychosocial functioning.5 More recently, it has been shown that prolonged untreated illness, including the symptomatic period just before the onset of frank psychosis (i.e., the prodrome), also significantly predicts poorer outcome,6 calling for efforts to identify and deliver treatment even earlier in order to prevent schizophrenia and improve outcome.7
A critical first step towards early identification and intervention is the development of a reliable and valid assessment tool. The Structured Interview for Prodromal Syndrome (SIPS) was one of several instruments developed to diagnose those at a high risk of developing psychosis.8-10 It was renamed as Structured Interview for Psychosis-Risk Syndromes in 200911 to better reflect its function of prospectively identifying at-risk individuals (i.e., those displaying subtle psychotic-like symptoms who may or may not eventually develop psychosis). The North American Prodrome Longitudinal Study (NAPLS) used the SIPS in a cohort of 291 individuals, finding a prospective conversion rate of 35% at 2 ½ years, supporting the predictive validity of the SIPS.12 However, the modest positive predictive value of a Psychosis Risk Syndrome diagnosis by the SIPS, along with other controversies on the diagnostic reliability in clinical practice, potential overuse of antipsychotics and stigma, led to heavy debates on the appropriateness of including Psychosis Risk Syndrome as a diagnostic category in the DSM-5.13 In the end, “Attenuated Psychosis Syndrome” was adopted and included in Section III of the DSM-5 as a condition for further study.14 Distinguished from Psychosis Risk Syndrome (which primarily emphasizes the risk of developing full-blown psychosis), Attenuated Psychosis Syndrome is “a currently relevant clinical condition leading to help seeking, with many more clinical outcomes other than conversion to psychosis.”14 The idea builds upon a common observation in clinical high risk studies that although the majority of these individuals do not eventually develop psychosis, many of them otherwise present significant clinical symptoms, distress and/or functional impairment that fulfill DSM's general criteria for mental disorders and should receive clinical care.15, 16
This shift, from preventing psychosis conversion to addressing the diverse clinical needs of at-risk individuals to improve outcome, necessitates a better understanding of the phenomenology of the clinical high risk state. The current structure of the Scale of Prodromal Symptoms (SOPS),11, 17 a major diagnostic component of the SIPS, implies that the symptom structure of psychosis risk is similar to that of schizophrenia. Specifically, the SOPS consists of 19 items divided into 4 subscales—Positive Symptoms (P; 5 items), Negative Symptoms (N; 6 items), Disorganization Symptoms (D; 4 items), and General Symptoms (G; 4 items)—with only the Positive Symptoms being considered diagnostic of psychosis risk. The empirical support for this symptom structure is unclear. Thus far we are aware of only 3 studies published in English that examined the factor structure of the SOPS,18-20 and the results varied remarkably. Hawkins et al.18 reported a 3-component (Negative/General/Positive Symptoms) and a 2-component (Positive/Negative Symptoms) solution. Klaassen et al.19 reported a 4-component solution similar to the 4 dimensions inherent to the SOPS, though with 4 items failing to load satisfactorily on any components. Comparelli et al.20 reported a 3-component solution (Negative/General/Positive Symptoms), but the constituent items of the 3 components were remarkably different from those reported by Hawkins et al.18
One source of these inconsistent results may be sample sizes. For principal component analysis (PCA), the dimension reduction method used in these 3 studies, a general rule of thumb is a sample size of at least 300,21 or a subject-to-item ratio of at least 10:1.22 This means at least 190 subjects are required given the 19 SOPS items. The sample sizes of these 3 studies were only between 77 and 128. Inadequate sample size and subject-to-item ratio are known to cause over-fitting of data, resulting in unstable factor loadings, unreplicable factors, and lack of generalizability to the population.23 Thus, a larger sample is needed to reveal the factor structure of psychosis risk that is more stable and generalizable to the population.
Another limitation of previous studies is their use of PCA and varimax (orthogonal) rotation. While PCA is a useful dimension reduction method, it is not truly a factor analysis. PCA is an extraction method that uses all variance, including random errors unique to individual items, thus producing inflated total variance explained and factor loadings compared with exploratory factor analysis that uses only shared variance to estimate latent factors. Further, since some of the symptom dimensions (e.g., positive symptoms and distress) are likely to be correlated rather than completely orthogonal, oblique rotation would be more appropriate than varimax rotation because it allows factors to correlate, and it will produce nearly identical solutions if the factors are truly orthogonal.24
With the above considerations in mind, we investigated the phenomenology of psychosis risk by examining the factor structure of the SOPS using Principal Axis Factoring (PAF) with Oblimin rotation, based on a large sample from the Early Detection and Intervention for the Prevention of Psychosis Program (EDIPPP).
Methods
Participants
The participants of this study were enrolled in the EDIPPP, a national research program modeled after the Portland (Maine) Identification and Early Referral (PIER) program.25 EDIPPP included 6 participating sites: 1) PIER, Portland, ME; 2) Recognition and Prevention (RAP) Program, Queens, NY; 3) Michigan Prevents Prodromal Progression (M3P) Program, Ann Arbor, MI; 4) Early Assessment and Support Team (EAST) Program, Salem, OR; 5) Early Diagnosis and Preventive Treatment (EDAPT) Clinic, Sacramento, CA; and 6) Early Assessment and Resource Linkage for Youth (EARLY), Albuquerque, NM. The program included a research protocol that consisted of clinical and neuropsychological assessments as well as clinical interventions including psychopharmacology, psychoeducational multi-family group therapy, and supported education/employment interventions.26, 27
Participants of EDIPPP were help-seeking youth aged 12-25 years and having at least a ‘1′ on any of the Positive symptoms or a ‘3′ on any of the Negative symptoms of the SOPS. Participants with a current psychotic episode > 30 days, a prior psychotic episode, prior antipsychotic treatment > 30 days, psychotic symptoms due to an acute medical or toxic etiology, or an IQ < 70 were excluded. More details on identification methods and inclusion/exclusion criteria can be found in McFarlane et al.28
Participants and their families attended a research orientation and preliminary screening session in which they were provided with information about the research protocol and informed consent was obtained from participants (and their parents/guardians if under age 18). Comprehensive clinical and neuropsychological research assessments were conducted at baseline and multiple longitudinal follow-ups, but only the baseline data are reported in this paper.
A total of 520 participants were enrolled between September 2007 and June 2010, out of which 337 met the inclusion criteria. Based on a risk-based allocation study design, qualified participants were then classified, according to their SOPS scores, as Clinically Lower-Risk (CLR; sum of P scores < 7), Clinically Higher-Risk (CHR; sum of P scores ≥ 7), and Early First-Episode Psychosis (EFEP; at least one P symptom rated 6, and all P symptoms rated 6 lasted < 30 days)20. EFEP consisted of subjects who met criteria for the Presence of Psychotic Symptoms, modified to include subjects with less than 1 month of psychotic symptoms, but with greater duration and frequency than seen for Brief Intermittent Psychotic Syndrome. This sample was included because EDIPPP aimed at improving role and social functional outcomes in addition to the traditional emphasis of delaying/preventing psychosis.25, 28, 29 SCID-derived diagnoses30 showed that 84% of this sample met criteria for one or more current or lifetime Axis-I diagnoses, including major depressive disorder (42%), anxiety disorder (36%), psychosis (current only; 13%), substance abuse (8%), and other (5%) (see for detail 28). Three participants did not have complete SOPS scores and were excluded from the analysis. Characteristics of the remaining 334 participants are summarized in Table 1.
Table 1. Participant Characteristics.
| Clinical Lower-risk (n = 87) | Clinical Higher-risk (n = 203) | Early First-episode Psychosis (n = 44) | All (N = 334) | |
|---|---|---|---|---|
| Mean ± SD | Mean ± SD | Mean ± SD | Mean ± SD | |
| Age | 16.7 ± 3.2 | 16.8 ± 3.3 | 18.4 ± 3.2 | 17.0 ± 3.3 |
| Sex (Male/Female) | 61/26 | 115/88 | 26/18 | 202/132 |
| Racea | ||||
| African-American | 5 (5.7%) | 16 (7.9%) | 10 (22.7%) | 31 (9.3%) |
| Asian American | 4 (4.6%) | 9 (4.4%) | -- | 13 (3.9%) |
| Caucasian | 62 (71.3%) | 124 (61.1%) | 20 (45.5%) | 206 (61.7%) |
| American Indian/Alaskan Native | 2 (2.3%) | 2 (1.0%) | -- | 4 (1.2%) |
| Native Hawaiian or other Pacific Islander | 1 (1.1%) | -- | 1 (2.3%) | 2 (0.6%) |
| Other | 4 (4.6%) | 17 (8.4%) | 4 (9.1%) | 25 (7.5%) |
| More than one race | 6 (6.9%) | 25 (12.3%) | 7 (15.9%) | 38 (11.4%) |
| Global Functioning b | ||||
| Social | 6.45 ± 1.53 | 6.11 ± 1.39 | 5.97 ± 1.49 | 6.18 ± 1.46 |
| Role | 5.67 ± 2.31 | 5.46 ± 2.32 | 4.35 ± 2.73 | 5.41 ± 2.36 |
< 7% missing data
15 cases missing.
Assessments
The baseline assessment of EDIPPP included a developmental and treatment history interview, clinical research interviews, cognitive testing, family history interviews, a substance use survey, and current functioning assessments. For the purpose of this report, only data of the SOPS, the Positive and Negative Syndrome Scales (PANSS),31 and the Global Functioning (GF) Scales32 were used in the analyses. All assessments were administered by trained and independent research interviewers. Inter-rater reliability for SOPS is summarized in Table 2.
Table 2.
Inter-rater reliability (intraclass correlation) of the SOPS across the six EDIPPP sites.
| Site | |||||||
|---|---|---|---|---|---|---|---|
|
|
|||||||
| PIER (ME) | RAP (NY) | M3P (MI) | EDAPT (CA) | EAST (OR) | EARLY (NM) | All | |
| Positive symptoms | .94 | .88 | .89 | .93 | .90 | .82 | .91 |
| Negative symptoms | .90 | .93 | .91 | .91 | .90 | .92 | .92 |
Statistical Analyses
Baseline data on the SOPS from the entire EDIPPP sample were subjected to Principal Axis Factoring (PAF) with Oblimin rotation. Solutions were obtained based on the screeplot, residuals of reproduced correlations, and conceptual interpretability of the factors. The decision to include CLR and EFEP in addition to CHR participants was based on our theoretical assumption that psychosis is a continuum, cutting across normal experiences and pathology.33, 34 Separate PAF's were also performed for CHR participants only (n = 203), CHR plus EFEP participants (n = 247), and CHR plus CLR participants (n = 290) for comparison purposes. However, no satisfactory solutions were obtained using these sub-samples due to suboptimal Measures of Sample Adequacy (many items < .7), high proportion of residuals of reproduced correlations > .05, poor factor loadings of several items, and questionable interpretability of the extracted factors. These quality control measures suggested that factor analysis was inappropriate with the subsamples, likely due to the reduced sample size and restricted range of scores. Therefore, these results are not included in this report.
Convergence validity of the factors yielded in the PAF was examined by correlating with their corresponding empirical factors of the PANSS based on a large recent-onset psychosis sample35—Positive (P1, G9, P3, P6, P5, G12, G15), Anxiety & Depression (G6, G3, G1, G2, G4), Negative (N4, N2, N3, G16, N6, N1, G13), and Disorganized (G10, G11, N5, P2, N7). See Supplementary Information for item content of the PANSS.
Finally, symptom frequency among the CHR participants was examined. Only symptoms rated moderate or above (≥3) on the SOPS were included.
Results
Item Distributions
The distribution of the SOPS items of the whole sample, as well as broken down by CLR, CHR, and EFEP, are displayed in Table 3. Overall, the mean and SD of the SOPS items of our sample showed remarkable resemblance to those reported in Hawkins et al.18 and Klaassen et al.19 The mean of D2 (Bizarre Thinking) in our sample (1.10 ± 1.32) was lower than that in Hawkins et al.18 (2.10 ± 1.62), t(426) = 6.12, P < .001, but similar to that in Klaassen et al.19 (0.92 ± 1.49), t(409) = 1.05, P = .29. In addition, G2 (Dysphoric Mood) was higher in our sample (3.91 ± 1.57) than in both Hawkins et al.18 (2.95 ± 1.67), t(426) = 5.16, P < .001, and Klaassen et al.19 (3.06 ± 1.51), t(409) = 4.31, P < .001. This may be due to the high prevalence of Mood Disorders in our sample, but direct comparisons were infeasible because these two studies did not report the scores or rate of depression.
Table 3. SOPS Item Distribution.
| Clinical Lower-risk (n = 87) | Clinical Higher-risk (n = 203) | Early First-episode Psychosis (n = 44) | All (N = 334) | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
|
|
|
||||||||||
| Mean | SD | Range | Mean | SD | Range | Mean | SD | Range | Mean | SD | Range | ||
| P1. | Unusual thought content/delusional ideas | 0.93 | 0.95 | 0 – 3 | 3.05 | 1.36 | 0 – 5 | 5.07 | 1.69 | 0 – 6 | 2.76 | 1.83 | 0 – 6 |
| P2. | Suspiciousness/persecutory ideas | 1.02 | 1.13 | 0 – 5 | 2.72 | 1.35 | 0 – 5 | 4.75 | 1.83 | 0 – 6 | 2.54 | 1.77 | 0 – 6 |
| P3. | Grandiosity | 0.43 | 0.80 | 0 – 3 | 1.12 | 1.28 | 0 – 5 | 2.11 | 1.92 | 0 – 6 | 1.07 | 1.37 | 0 – 6 |
| P4. | Perceptual abnormalities/hallucinations | 1.10 | 1.09 | 0 – 4 | 3.33 | 1.36 | 0 – 5 | 4.61 | 1.79 | 0 – 6 | 2.92 | 1.79 | 0 – 6 |
| P5. | Conceptual Disorganization | 0.67 | 0.90 | 0 – 4 | 1.72 | 1.25 | 0 – 5 | 3.02 | 1.82 | 0 – 6 | 1.62 | 1.44 | 0 – 6 |
| N1. | Social isolation and withdrawal | 2.32 | 2.07 | 0 – 6 | 2.62 | 1.68 | 0 – 6 | 2.59 | 1.86 | 0 – 6 | 2.54 | 1.81 | 0 – 6 |
| N2. | Avolition | 2.84 | 1.83 | 0 – 6 | 2.92 | 1.62 | 0 – 6 | 2.80 | 1.65 | 0 – 5 | 2.88 | 1.67 | 0 – 6 |
| N3. | Decreased expression of emotion | 1.25 | 1.59 | 0 – 5 | 1.39 | 1.51 | 0 – 6 | 1.80 | 1.62 | 0 – 5 | 1.41 | 1.55 | 0 – 6 |
| N4. | Decreased experience of emotion and self | 1.11 | 1.49 | 0 – 5 | 2.06 | 1.65 | 0 – 6 | 1.80 | 1.76 | 0 – 5 | 1.78 | 1.67 | 0 – 6 |
| N5. | Decreased ideational richness | 1.08 | 1.31 | 0 – 4 | 1.50 | 1.43 | 0 – 5 | 1.86 | 1.46 | 0 – 4 | 1.44 | 1.42 | 0 – 5 |
| N6. | Deterioration in role functioning | 3.23 | 1.95 | 0 – 6 | 3.31 | 1.99 | 0 – 6 | 3.70 | 1.95 | 0 – 6 | 3.34 | 1.97 | 0 – 6 |
| D1. | Odd behavior or appearance | 0.57 | 1.05 | 0 – 4 | 0.84 | 1.20 | 0 – 5 | 1.84 | 1.83 | 0 – 6 | 0.90 | 1.32 | 0 – 6 |
| D2. | Bizarre thinking | 0.31 | 0.65 | 0 – 3 | 1.15 | 1.18 | 0 – 5 | 2.45 | 1.69 | 0 – 6 | 1.10 | 1.32 | 0 – 6 |
| D3. | Trouble with focus and attention | 2.02 | 1.31 | 0 – 5 | 2.79 | 1.25 | 0 – 6 | 3.57 | 1.30 | 0 – 6 | 2.69 | 1.35 | 0 – 6 |
| D4. | Impairment in personal hygiene | 0.74 | 1.21 | 0 – 5 | 0.76 | 1.21 | 0 – 5 | 1.14 | 1.61 | 0 – 5 | 0.81 | 1.27 | 0 – 5 |
| G1. | Sleep disturbances | 2.21 | 1.86 | 0 – 6 | 2.75 | 1.66 | 0 – 6 | 3.57 | 2.02 | 0 – 6 | 2.72 | 1.80 | 0 – 6 |
| G2. | Dysphoric Mood | 3.47 | 1.70 | 0 – 6 | 4.00 | 1.49 | 0 – 6 | 4.32 | 1.46 | 1 – 6 | 3.91 | 1.57 | 0 – 6 |
| G3. | Motor disturbances | 0.75 | 1.04 | 0 – 5 | 0.83 | 1.11 | 0 – 6 | 1.36 | 1.60 | 0 – 6 | 0.88 | 1.18 | 0 – 6 |
| G4. | Impaired tolerance to normal stress | 2.55 | 2.14 | 0 – 6 | 2.99 | 1.87 | 0 – 6 | 3.50 | 1.66 | 0 – 6 | 2.94 | 1.94 | 0 – 6 |
Factor Structure of SOPS
PAF yielded a 4-factor solution with the most acceptability based on fit statistics and conceptual interpretability of the factors. Since item G3 (Motor Disturbances) had loadings < .30 on all of the factors, it was removed from the analysis. PAF was re-performed and, again, a 4-factor solution was yielded, explaining 36.1% of total variance (Table 4a). The factors were labeled as: 1) Positive Symptoms (P1, P2, P3, P4, D2; variance explained = 18.7%); Distress (G1, G2, G4; variance explained = 9.1%); Negative Symptoms (N1, N2, N3, N4, D1, D4; variance explained = 5.3%); and Deteriorated Thought Process (P5, N5, N6, D3; variance explained = 3.0%). The 4 factors showed small to medium correlations with each other (r ranged from .14 to .32), and had fair to good internal consistency (Cronbach's α ranged from .53 to .75) (Table 4b).
Table 4a. Rotated Structure Matrix of SOPS Items (N = 334).
| Factor | |||||
|---|---|---|---|---|---|
|
|
|||||
| Positive Symptoms | Distress | Negative Symptoms | Deteriorated Thought Process | ||
| P1. | Unusual thought content/delusional ideas | .80 | |||
| D2. | Bizarre thinking | .74 | |||
| P2. | Suspiciousness/persecutory ideas | .60 | |||
| P4. | Perceptual abnormalities/hallucinations | .51 | |||
| P3. | Grandiosity | .47 | |||
| G2. | Dysphoric Mood | .76 | |||
| G4. | Impaired tolerance to normal stress | .62 | |||
| G1. | Sleep disturbances | .47 | |||
| N1. | Social isolation and withdrawal | .62 | |||
| N3. | Decreased expression of emotion | .61 | |||
| N2. | Avolition | .51 | .48 | .39 | |
| D1. | Odd behavior or appearance | .37 | .41 | ||
| N4. | Decreased experience of emotion and self | .39 | .40 | ||
| D4. | Impairment in personal hygiene | .39 | |||
| P5. | Conceptual Disorganization | .45 | .58 | ||
| N5. | Decreased ideational richness | .46 | |||
| D3. | Trouble with focus and attention | .43 | .46 | ||
| N6. | Deterioration in role functioning | .37 | .32 | .41 | |
Note. Item G3 was removed from the analysis due to poor loading on all of the factors. Kaiser-Meyer-Olkin Measure of Sampling Adequacy = .78. Items with loadings > .32 on more than one factor are assigned to factors that are most theoretically consistent. Factor loadings < .32 are not displayed for clarity.
Table 4b. Factor Correlation Matrix.
| Positive Symptoms | Distress | Negative Symptoms | Deteriorated Thought Process | |
|---|---|---|---|---|
| Positive Symptoms | (.75) | |||
| Distress | .16 | (.64) | ||
| Negative Symptoms | .14 | .25 | (.66) | |
| Deteriorated Thought Process | .24 | .18 | .32 | (.53) |
Note. Numbers in parentheses are Cronbach's alpha based on items assigned to the corresponding factor.
Convergence validity of the 4 factors was supported by the finding that they showed strongest correlations with their corresponding empirically-derived PANSS factors,35 with r ranging from .63 to .84 (Table 5).
Table 5. Convergence validity of the 4 empirical factors of SOPS (N = 334).
| Factor 1 | Factor 2 | Factor 3 | Factor 4 | ||
|---|---|---|---|---|---|
| Positive Symptoms | Distress | Negative Symptoms | Deteriorated Thought Process | ||
| PANSSa | Positive | .84 | .24 | .27 | .34 |
| Anxiety & Depression | .41 | .63 | .26 | .22 | |
| Negative | .17 | .31 | .73 | .32 | |
| Disorganized | .37 | .14 | .31 | .63 |
Note. Shaded cells are correlations that are expected to be strongest (relative to other cells in the same row or column) in order to support convergence validity of the 4 empirical factors of SOPS.
Empirical factors of the Positive and Negative Syndrome Scales reported in Emsley et al.35
Symptom Frequency
Frequency of symptoms rated 3 or above on the SOPS in the CHR sample was examined. The most prevalent symptoms were mostly those loaded on the Positive Symptoms factor, including P4 (Perceptual Abnormalities/Hallucinations; n = 122), P1 (Unusual Thought Content/Delusional Ideas; n = 104), and P2 (Suspiciousness/Persecutory Ideas; n = 81). In addition, G2 (Dysphoric Mood; n = 109) of the Distress factor, N6 (Deterioration in Role Functioning; n = 106) of the Deteriorated Thought Process factor, and N2 (Avolition; n = 82) of the Negative Symptoms factor were also quite common.
Discussion
Using a large sample from EDIPPP, we found 4 latent factors (Positive Symptoms, Distress, Negative Symptoms, and Deteriorated Thought Process) explaining 36% of total variance in the symptoms measured by the SOPS. Since the factors were estimated using shared variance only (i.e., excluding random errors unique to individual items), the % of total variance explained is bound to be smaller compared with PCA, which uses all (including measurement error) variance in component extraction. Given this, the amount of variance explained reported in this study is quite comparable to the 55% of total variance explained by the 5 principal components of PANSS reported in Emsley et al.35 These 4 latent factors showed reasonable to good internal consistency and convergence validity, and they were not completely orthogonal. This 4-factor solution resembles closely the 4-factor structure implied by the SOPS and the widely accepted symptom structure of schizophrenia: positive symptoms (P), negative symptoms (N), disorganization (D), and general symptoms (G). However, we noted two major differences that have diagnostic and conceptual implications for SOPS and the phenomenology of psychosis risk. First, the constituent items of the 4 empirical factors differ from those making up the 4 subscales of the SOPS. While the Positive Symptoms, Distress, and Negative Symptoms factors consisted of mostly items from their corresponding SOPS subscales, they also consisted of items from other SOPS subscales. In addition, the Deteriorated Thought Process factor consisted of a mixture of P, G, N, and D items. Since the Positive Symptom subscale of the SOPS is the only subscale considered to be diagnostic of psychosis risk, its inclusion of an item (P5) that failed to load onto the Positive Symptoms factor and that the Positive Symptoms factor included a D item suggested that reassigning some SOPS symptoms to other subscales may improve the diagnostic validity of the SIPS.
Another noted difference was the relative prominence of the symptom dimensions. Consistent with the SOPS/schizophrenia symptom structure, positive symptoms were found to be the most prominent symptoms in this study, explaining 18.7% of total variance. However, while negative symptoms are considered a symptom dimension as important as positive symptoms in schizophrenia, our results showed that the Distress factor (9.1%) accounted for more variance than the Negative Symptoms factor (5.3%) in this population. This was not surprising, given that 42% of this sample had a comorbid major depressive disorder and 36% had a comorbid anxiety disorder, similar to figures previously reported.36 Dysphoric mood, in addition to functional decline and positive symptoms, was also one of the most common signs in our CHR sample. Loewy et al.37 found that assessing distress associated with endorsed positive symptoms significantly increased the specificity of their psychosis risk syndrome screening tool, supporting the importance of assessing distress in early identification. Although baseline anxiety and depression do not seem to predict transition to psychosis,36 they are associated with long-term functional outcome in psychosis risk syndrome.38 Distress may reflect a failure to effectively regulate emotional response to psychotic symptoms, thus adversely affecting role and social functioning. Taken together, our findings lend further support to early identification and intervention strategies focusing on positive and distress symptoms (see also 39).
As noted above, the Deteriorated Thought Process factor consisted of a mixture of P, N, and D items. Examination of the content of these items reveals that these items together tap into compromised but rather non-specific thought and attention functions. This suggests that disorganization symptoms manifest in a milder and more unspecific manner in psychosis risk compared with schizophrenia. Nevertheless, there is evidence that disorganized symptoms are highly predictive of functional outcome in a clinical high risk sample, suggesting that subtle disorganized symptoms warrants equal attention and monitoring as do other symptoms in psychosis risk.40
One potential limitation of this study was the characteristic of the sample. It consisted of CLR and EFEP individuals in addition to CHR, differing from the traditional approach of treating psychosis risk as a distinct entity.18, 19 Technically, for the factor analysis result to be considered reflective of the phenomenology of psychosis risk, it should be based on a CHR sample. However, despite the relatively large sample size of this study, the CHR sample was still not large enough to produce adequate statistical fit for valid factor analysis results. The validity of the factor analysis in this heterogeneous sample rests on the assumption that the latent factor structure is continuous across the range of symptoms assessed. Testing this assumption will require a much larger sample from the low-risk and very early psychosis groups. However, given the premise that pathology is continuous with normal variation, the current study provides a good first-pass analysis capturing a wider range of scores in a sufficiently powered sample. The results based on the entire EDIPPP sample should be considered as reflecting the phenomenology among help-seeking youth with suspected psychosis risk or very early psychosis.
To conclude, the empirical factor structure of the SOPS showed similarities but significant differences compared with the current SOPS structure as well as the traditional symptom structure of schizophrenia. This suggests that regrouping the SOPS items according to the underlying symptom dimensions may help refine the diagnostic validity of the instrument. Examination of the relative prominence of the empirical factors of the SOPS and symptom frequency supported the importance of early identification strategies focusing on positive symptoms and distress. Future investigation of long-term functional implications of these symptom factors may further inform intervention strategies.
Supplementary Material
Acknowledgments
This work was supported by the Robert Wood Johnson Foundation [grant number #67525 to W.R.M.], with additional institutional support from the Maine Medical Center Research Institute and the State of Maine. Dr. Tso receives funding from the National Institutes of Health [5KL2TR000434]. Dr. Taylor receives funding from the Boledovich Schizophrenia Fund, the Drake Family Fund, and the National Institute of Mental Health [R21 MH101676)]. Dr. Cornblatt receives funding from the National Institute of Mental Health [R01 MH061523; U01 MH081857]. Dr. Ragland receives funding from the National Institute of Mental health [R01 MH084895]. The funders of the study had no role in the study implementation, data collection, analysis, interpretation or reporting of the results in this article. The authors are solely responsible for its contents.
Dr. McFarlane discloses that he provides on-request training and consulting to public and not-for-profit agencies implementing the clinical services being tested in EDIPPP. Dr. Carter discloses that he has served as a consultant for Merck, Lilly, Pfizer and Servier and has received research funding from Glaxo Smith Kline. Dr. Taylor discloses receiving research support from St. Jude Medical and Neuronetics.
The authors wish to acknowledge the contributions from the staff and clinicians of the participating sites of the EDIPPP, and the participants who volunteered for the study.
Footnotes
An earlier version of this study was presented at the Society of Biological Psychiatry Annual Meeting; San Francisco, California; May 17, 2013.
No other author discloses competing interests.
References
- 1.Fraguas D, Del Rey-Mejias A, Moreno C, Castro-Fornieles J, Graell M, Otero S, et al. Duration of untreated psychosis predicts functional and clinical outcome in children and adolescents with first-episode psychosis: a 2-year longitudinal study. Schizophr Res. 2014 Jan;152(1):130–8. doi: 10.1016/j.schres.2013.11.018. 2013/12/18. [DOI] [PubMed] [Google Scholar]
- 2.Hill M, Crumlish N, Clarke M, Whitty P, Owens E, Renwick L, et al. Prospective relationship of duration of untreated psychosis to psychopathology and functional outcome over 12 years. Schizophr Res. 2012 Nov;141(2-3):215–21. doi: 10.1016/j.schres.2012.08.013. 2012/09/26. [DOI] [PubMed] [Google Scholar]
- 3.Marshall M, Lewis S, Lockwood A, Drake R, Jones P, Croudace T. Association between duration of untreated psychosis and outcome in cohorts of first-episode patients: a systematic review. Archives of General Psychiatry. 2005;62(9):975–83. doi: 10.1001/archpsyc.62.9.975. [DOI] [PubMed] [Google Scholar]
- 4.Schimmelmann BG, Huber CG, Lambert M, Cotton S, McGorry PD, Conus P. Impact of duration of untreated psychosis on pre-treatment, baseline, and outcome characteristics in an epidemiological first-episode psychosis cohort. Journal of Psychiatric Research. 2008 Oct;42(12):982–90. doi: 10.1016/j.jpsychires.2007.12.001. [DOI] [PubMed] [Google Scholar]
- 5.Alvarez-Jimenez M, Parker AG, Hetrick SE, McGorry PD, Gleeson JF. Preventing the second episode: a systematic review and meta-analysis of psychosocial and pharmacological trials in first-episode psychosis. Schizophrenia Bulletin. 2011 May;37(3):619–30. doi: 10.1093/schbul/sbp129. 2009/11/11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Keshavan MS, Haas G, Miewald J, Montrose DM, Reddy R, Schooler NR, et al. Prolonged untreated illness duration from prodromal onset predicts outcome in first episode psychoses. Schizophrenia Bulletin. 2003;29(4):757–69. doi: 10.1093/oxfordjournals.schbul.a007045. [DOI] [PubMed] [Google Scholar]
- 7.Fusar-Poli P, Borgwardt S, Bechdolf A, Addington J, Riecher-Rossler A, Schultze-Lutter F, et al. The psychosis high-risk state: a comprehensive state-of-the-art review. JAMA Psychiatry. 2013 Jan;70(1):107–20. doi: 10.1001/jamapsychiatry.2013.269. 2012/11/21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.McGlashan TH. Psychosis treatment prior to psychosis onset: ethical issues. Schizophrenia Research. 2001 Aug 1;51(1):47–54. doi: 10.1016/s0920-9964(01)00238-9. 2001/08/02. [DOI] [PubMed] [Google Scholar]
- 9.Miller TJ, McGlashan TH, Rosen JL, Somjee L, Markovich PJ, Stein K, et al. Prospective diagnosis of the initial prodrome for schizophrenia based on the Structured Interview for Prodromal Syndromes: preliminary evidence of interrater reliability and predictive validity. American Journal of Psychiatry. 2002 May;159(5):863–5. doi: 10.1176/appi.ajp.159.5.863. 2002/05/03. [DOI] [PubMed] [Google Scholar]
- 10.Rosen JL, Woods SW, Miller TJ, McGlashan TH. Prospective observations of emerging psychosis. Journal of Nervous and Mental Disease. 2002 Mar;190(3):133–41. doi: 10.1097/00005053-200203000-00001. 2002/03/30. [DOI] [PubMed] [Google Scholar]
- 11.McGlashan T, Walsh B, Woods S. The Psychosis-Risk Syndrome: Handbook for Diagnosis and Follow-Up. 1st. New York: Oxford University Press; 2010. [Google Scholar]
- 12.Cannon TD, Cadenhead K, Cornblatt B, Woods SW, Addington J, Walker E, et al. Prediction of psychosis in youth at high clinical risk: a multisite longitudinal study in North America. Archives of General Psychiatry. 2008 Jan;65(1):28–37. doi: 10.1001/archgenpsychiatry.2007.3. 2008/01/09. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Carpenter WT, Anticipating DSMV. should psychosis risk become a diagnostic class? Schizophrenia Bulletin. 2009 Sep;35(5):841–3. doi: 10.1093/schbul/sbp071. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Tsuang MT, Van Os J, Tandon R, Barch DM, Bustillo J, Gaebel W, et al. Attenuated psychosis syndrome in DSM-5. Schizophrenia Research. 2013 Oct;150(1):31–5. doi: 10.1016/j.schres.2013.05.004. 2013/06/19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Ruhrmann S, Schultze-Lutter F, Klosterkotter J. Probably at-risk, but certainly ill--advocating the introduction of a psychosis spectrum disorder in DSM-V. Schizophrenia Research. 2010 Jul;120(1-3):23–37. doi: 10.1016/j.schres.2010.03.015. [DOI] [PubMed] [Google Scholar]
- 16.Yung AR, Woods SW, Ruhrmann S, Addington J, Schultze-Lutter F, Cornblatt BA, et al. Whither the attenuated psychosis syndrome? Schizophrenia Bulletin. 2012 Nov;38(6):1130–4. doi: 10.1093/schbul/sbs108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Miller TJ, McGlashan TH, Rosen JL, Cadenhead K, Cannon T, Ventura J, et al. Prodromal assessment with the structured interview for prodromal syndromes and the scale of prodromal symptoms: predictive validity, interrater reliability, and training to reliability. Schizophrenia Bulletin. 2003;29(4):703–15. doi: 10.1093/oxfordjournals.schbul.a007040. [DOI] [PubMed] [Google Scholar]
- 18.Hawkins KA, McGlashan TH, Quinlan D, Miller TJ, Perkins DO, Zipursky RB, et al. Factorial structure of the Scale of Prodromal Symptoms. Schizophrenia Research. 2004 Jun 1;68(2-3):339–47. doi: 10.1016/S0920-9964(03)00053-7. 2004/04/22. [DOI] [PubMed] [Google Scholar]
- 19.Klaassen RM, Velthorst E, Nieman DH, de Haan L, Becker HE, Dingemans PM, et al. Factor analysis of the scale of prodromal symptoms: differentiating between negative and depression symptoms. Psychopathology. 2011;44(6):379–85. doi: 10.1159/000325169. 2011/08/19. [DOI] [PubMed] [Google Scholar]
- 20.Comparelli A, Savoja V, Kotzalidis GD, Woods SW, Mosticoni S, Vassallo F, et al. Factor-structure of the Italian version of the Scale Of Prodromal Symptoms (SOPS): a comparison with the English version. Epidemiol Psychiatr Sci. 2011 Mar;20(1):45–54. doi: 10.1017/s2045796011000114. 2011/06/11. [DOI] [PubMed] [Google Scholar]
- 21.Comfrey AL, Lee HB. A first course in factor analysis. Hillsdale, NJ: Lawrence Erlbaum Associates; 1992. [Google Scholar]
- 22.Nunnally J. Psychometric theory. New York, NY: McGraw-Hill; 1978. [Google Scholar]
- 23.Osborne JW, Costello AB. Sample size and subject to item ratio in principal components analysis. Practical Assessment, Research, and Evaluation. 2004;9(11) [Google Scholar]
- 24.Costello AB, Osborne JW. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Practical Assessment, Research, and Evaluation. 2005;10(7) [Google Scholar]
- 25.McFarlane W, Cook W, Downing D, Verdi M, Woodberry K, Ruff A. Portland identification and early referral: a community-based system for identifying and treating youths at high risk of psychosis. Psychiatric Services. 2010;61(5):512–5. doi: 10.1176/appi.ps.61.5.512. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.McFarlane WR, Lynch S, Melton RP. Family Psychoeducation in Clinical High Risk and First-Episode Psychosis. Adolescent Psychiatry. 2012;2(2):182–94. [Google Scholar]
- 27.McFarlane WR. Prevention of the first episode of psychosis. Psychiatric Clinics of North America. 2011 Mar;34(1):95–107. doi: 10.1016/j.psc.2010.11.012. 2011/02/22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.McFarlane WR, Levin B, Travis L, Lucas FL, Lynch S, Verdi M, et al. Clinical and Functional Outcomes After 2 Years in the Early Detection and Intervention for the Prevention of Psychosis Multisite Effectiveness Trial. Schizophrenia Bulletin. 2014 Jul 26; doi: 10.1093/schbul/sbu108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Cornblatt BA, Lencz T, Smith CW, Correll CU, Auther AM, Nakayama E. The schizophrenia prodrome revisited: a neurodevelopmental perspective. Schizophrenia Bulletin. 2003;29(4):633–51. doi: 10.1093/oxfordjournals.schbul.a007036. [DOI] [PubMed] [Google Scholar]
- 30.First MB, Spitzer RL, Gibbon M, Williams JBW. Structured Clinical Interview for DSM-IV Axis I Disorders SCIDI: Clinician Version Administration Booklet. American Psychiatric Press; 1997. [Google Scholar]
- 31.Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophrenia Bulletin. 1987;13(2):261–76. doi: 10.1093/schbul/13.2.261. 1987/01/01. [DOI] [PubMed] [Google Scholar]
- 32.Cornblatt BA, Auther AM, Niendam T, Smith CW, Zinberg J, Bearden CE, et al. Preliminary findings for two new measures of social and role functioning in the prodromal phase of schizophrenia. Schizophrenia Bulletin. 2007 May;33(3):688–702. doi: 10.1093/schbul/sbm029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Johns LC, van Os J. The continuity of psychotic experiences in the general population. Clinical Psychology Review. 2001 Nov;21(8):1125–41. doi: 10.1016/s0272-7358(01)00103-9. 2001/11/13. [DOI] [PubMed] [Google Scholar]
- 34.McFarlane W, Levin B, Travis L, Lucas F, Lynch S, Verdi M, et al. Clinical and functional outcomes after 2 years in the Early Detection and Intervention for the Prevention of Psychosis multisite effectiveness trial. Schizophrenia Bulletin. doi: 10.1093/schbul/sbu108. resubmitted. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Emsley R, Rabinowitz J, Torreman M. The factor structure for the Positive and Negative Syndrome Scale (PANSS) in recent-onset psychosis. Schizophrenia Research. 2003;61(1):47–57. doi: 10.1016/s0920-9964(02)00302-x. [DOI] [PubMed] [Google Scholar]
- 36.Fusar-Poli P, Nelson B, Valmaggia L, Yung AR, McGuire PK. Comorbid depressive and anxiety disorders in 509 individuals with an at-risk mental state: impact on psychopathology and transition to psychosis. Schizophrenia Bulletin. 2014 Jan;40(1):120–31. doi: 10.1093/schbul/sbs136. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Loewy RL, Pearson R, Vinogradov S, Bearden CE, Cannon TD. Psychosis risk screening with the Prodromal Questionnaire--brief version (PQ-B) Schizophrenia Research. 2011 Jun;129(1):42–6. doi: 10.1016/j.schres.2011.03.029. 2011/04/23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Fulford D, Niendam TA, Floyd EG, Carter CS, Mathalon DH, Vinogradov S, et al. Symptom dimensions and functional impairment in early psychosis: more to the story than just negative symptoms. Schizophrenia Research. 2013 Jun;147(1):125–31. doi: 10.1016/j.schres.2013.03.024. 2013/04/17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Stafford MR, Jackson H, Mayo-Wilson E, Morrison AP, Kendall T. Early interventions to prevent psychosis: systematic review and meta-analysis. BMJ. 2013;346:f185. doi: 10.1136/bmj.f185. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Ziermans T, de Wit S, Schothorst P, Sprong M, van Engeland H, Kahn R, et al. Neurocognitive and clinical predictors of long-term outcome in adolescents at ultra-high risk for psychosis: a 6-year follow-up. PloS One. 2014;9(4):e93994. doi: 10.1371/journal.pone.0093994. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
