Skip to main content
Schizophrenia Bulletin logoLink to Schizophrenia Bulletin
. 2014 Aug 6;41(2):419–428. doi: 10.1093/schbul/sbu099

Towards a Psychosis Risk Blood Diagnostic for Persons Experiencing High-Risk Symptoms: Preliminary Results From the NAPLS Project

Diana O Perkins 1,*,14, Clark D Jeffries 2,14, Jean Addington 3, Carrie E Bearden 4, Kristin S Cadenhead 5, Tyrone D Cannon 6,7, Barbara A Cornblatt 8, Daniel H Mathalon 9, Thomas H McGlashan 7, Larry J Seidman 10, Ming T Tsuang 11, Elaine F Walker 12, Scott W Woods 7, Robert Heinssen 13
PMCID: PMC4332942  PMID: 25103207

Abstract

Introduction: A barrier to preventative treatments for psychosis is the absence of accurate identification of persons at highest risk. A blood test that could substantially increase diagnostic accuracy would enhance development of psychosis prevention interventions. Methods: The North American Prodrome Longitudinal Study project is a multisite endeavor that aims to better understand predictors and mechanisms for the development of psychosis. In this study, we measured expression of plasma analytes reflecting inflammation, oxidative stress, hormones, and metabolism. A “greedy algorithm” selected analytes that best distinguished persons with clinical high-risk symptoms who developed psychosis (CHR-P; n = 32) from unaffected comparison (UC) subjects (n = 35) and from those who did not develop psychosis during a 2-year follow-up (CHR-NP; n = 40). Results: The classifier included 15 analytes (selected from 117), with an area under the receiver operating curve for CHR-P vs UC of 0.91 and CHR-P vs CHR-NP of 0.88. Randomly scrambled group membership followed by reconstructions of the entire classifier method yielded consistently weak classifiers, indicating that the true classifier is highly unlikely to be a chance occurrence. Such randomization methods robustly imply the assays contain consistent information distinguishing the groups which was not obscured by the data normalization method and was revealed by classifier construction. These results support the hypothesis that inflammation, oxidative stress, and dysregulation of hypothalamic-pituitary axes may be prominent in the earliest stages of psychosis. Conclusion: If confirmed in other groups of persons at elevated risk of psychosis, a multiplex blood assay has the potential for high clinical utility.

Key words: clinical high risk, psychosis, prodrome, multiplex, risk prediction, malondialdehyde-modified low-density lipoprotein (MDA-LDL), immune, inflammation, oxidative stress

Introduction

It is well established that early intervention is associated with better clinical outcomes in persons with schizophrenia,1 raising the hope that treatment during the prodromal phase of illness could prevent the development of a psychotic disorder and thus reduce risk of chronic symptoms and disability. Substantial progress has been made in establishing clinical criteria to identify persons at high risk (CHR) for psychosis, with about 20%–25% developing psychosis within a year and 30%–35% within 2 years.2–4 An “attenuated psychosis syndrome” was considered for inclusion in the most recent Diagnostic and Statistical Manual, Fifth Edition (DSM-5).5 However, the expert panel decided to place the syndrome in the DSM-5 Appendix due to concerns that specificity would be low and that a minority of persons meeting syndrome criteria would actually progress to develop a psychotic disorder.6,7 This decision reinforces the need for further research to identify biological validators of a high-risk state for psychosis warranting preventative interventions.

In general, biomarker tests are most useful for persons at elevated risk for a disease because the proportion of patients who test positive and who actually get the disease (positive predictive value, PPV) varies dramatically depending on the actual rate of disease in the tested population.8 If the rate of disease is low, eg, if 1% of tested persons are actually at risk, then even a test with high sensitivity and specificity (~0.80) will have 20 times as many false positives as true positive (supplement S1). To minimize the risk of embarking on an inappropriate treatment program, any biomarker test with less than perfect specificity needs be applied in a relatively high-risk population. Applied to persons meeting CHR criteria, a biomarker test with reasonable sensitivity and specificity (~0.8) can achieve a PPV of about 0.63; equivalently, about two-thirds of persons identified by such a test as at risk would truly be on a trajectory to develop psychosis. Of, perhaps, equal significance is that such a diagnostic test could have a negative predictive power of about 0.90, increasing a clinician’s confidence in predicting who is likely not to develop psychosis.

Patients with schizophrenia are reported to have anomalous levels of markers of inflammation, oxidative stress, metabolism, and hormonal status.9–15 For this reason, we investigated whether plasma analytes representing these components could be used to construct a classifier that distinguishes persons with CHR risk symptoms who developed psychosis from persons with CHR symptoms who did not develop psychosis during a 2-year follow-up period, as well as from unaffected comparison subjects.

Methods

Subjects

The aims and methods of North American Prodrome Longitudinal Study (NAPLS 2) were described in detail previously.16 To summarize, NAPLS 2 is an 8-site observational study of the predictors and mechanisms of conversion to psychosis in persons meeting the Criteria of Prodromal States (COPS).17 The NAPLS 2 cohort includes 765 clinical high-risk and 280 demographically similar unaffected comparison (UC) subjects aged between 12 and 35. The study was approved by the Institutional Review Board at each site, and each subject provided written informed consent or assent, with a parent or guardian also consenting for minor subjects.

The plasma analysis reported here was conducted in March 2012. We included all CHR subjects with plasma samples either who had progressed to psychosis (CHR-P, n = 32) or who had been followed 2 years and not progressed to psychosis (CHR-NP, n = 40) as of February 2012. Note that because this is a nested case-control study conducted before completion of study follow-up, no inference can me made about conversion rates in this report. The unaffected comparison subjects (UC, n = 35) did not meet CHR criteria or have a history of a psychotic disorder and were chosen to be demographically similar to the CHR subjects.

Assessments

Clinical assessments were done every 6 months and subjects followed for up to 2 years. Participants were screened using the Structured Interview for Prodromal Syndromes (SIPS) and rated with the Scale of Prodromal Symptoms (SOPS) for the presence of one or more prodromal syndromes: attenuated psychotic symptoms, brief intermittent psychotic symptoms, substantial functional decline combined with a first-degree relative with a psychotic disorder, or schizotypal personality disorder in individuals younger than 18 years.17 Details regarding the SIPS, SOPS, and COPS are included in supplementary methods. The Structured Clinical Interview for DSM IV18 was used to determine psychiatric diagnoses.

Depressive symptoms were evaluated with the Calgary Depression Scale for Schizophrenia19 (CDSS) and anxiety symptoms with the Self-Rated Anxiety Scale20 (SAS). Data on prescription medications were based on self-reports. Socioeconomic status was estimated by maximum years of education of mother or father. Substance use was evaluated with the Alcohol/Drug Use Scales21 as a dichotomous variable, and by frequency of use (0 = no use, 5 = daily use, or for cigarettes > 25 per day).

Plasma Collection

Blood samples used in this analysis were drawn at the baseline visit in Becton Dickenson P100 blood collection tubes with ethylene diamine tetra-acetic acid as anticoagulant, proprietary protein stabilizers, and a mechanical separator. All samples were processed within 120 minutes (mean time to freezer = 28 minutes, SD = 2 minutes) and stored at −80°C until analysis.

Plasma Assay

Plasma samples were sent on dry ice to Myriad Rules Based Medicine, a biomarker testing laboratory that has maintained clinical laboratory improvement amendments-accreditation by the Commission on Office Laboratory Accreditation since 2006. Samples were analyzed with the Human Discovery Map assay, a Luminex bead-based multiplex immunoassay that included 185 analytes involved in hormonal responses, inflammation, growth, oxidative stress, and metabolism, all according to Rules-Based Medicine standard operating procedures. Technicians ran assays without knowledge of clinical status of the subjects.

Exclusion of Analytes

The assay included185 analytes. We excluded 23 analytes that were not detected in ≥ 20% of the subjects. Most remaining analytes (80%) were detected in at least 90% of the 107 subjects (supplement S2).

Persons exhibiting CHR symptoms are often prescribed various medications by their health care provider,22,23 and in our CHR subjects, 19% were prescribed antipsychotics and 28% were prescribed antidepressants (table 1). In addition CHR subjects were more likely to use marijuana and nicotine, compared with UC subjects, and alcohol use occurred in almost half of subjects (table 1). Antipsychotics, antidepressants, marijuana, nicotine, and alcohol may impact inflammation, oxidative stress, and hormonal pathways,10,15,24–31 raising the possibility that drug use could confound differences in analyte expression comparisons between groups. To minimize risk of confounding, we excluded analytes with a possible relation to prescription of antipsychotics or antidepressants, or with self-reported current use of marijuana, nicotine, or alcohol, based on comparisons of analyte expression levels between persons using vs not using the substance. Consequently, 45 additional analytes were excluded (supplement S2). We conducted further analyses in the remaining 117 analytes.

Table 1.

Demographic and Clinical Characteristics of Study Subjects

Unaffected Comparison (UC) N = 35 Clinical High Risk, Not Psychotic (CHR-NP) N = 40 Clinical High Risk, Psychotic (CHR-P) N = 32
Age, average (SD) 20 (4.5) 19.5 (4.6) 19.2 (3.7)
Ancestry
 Caucasian, % 60 65 55
 African, % 31 17.5 21
 Asian, % 9 17.5 24
Sex, female, % 34 37.5 30.3
Socioeconomic status, average (SD) 4.8 (1.8) 4.5 (2.3) 4.5 (1.8)
Scale of Prodromal Symptom scores, average (SD)
 Totala 5.06 (5.11) 36.63 (13.03) 43.81 (14.11)
 Positivea 1.46 (1.84) 12.28 (4.74) 14.22 (3.92)
 Negativea 1.23 (1.72) 11.38 (6.32) 13.58 (6.23)
 Disorganizeda 0.91 (1.17) 5.05 (2.79) 6.45 (3.88)
 Generala,b 1.46 (1.80) 7.93 (4.46) 10.52 (4.44)
Calgary Depression Scale for Schizophrenia scores,a average (SD) 0.89 (1.71) 5.00 (4.72) 6.88 (4.88)
Zung Self-Rated Anxiety Scale,a average (SD) 28.79 (4.15) 45.80 (13.35) 48.39 (12.55)
Time blood draw, average (SD) 12:12 pm (1.85h) 12:39 pm (2.0h) 11:59 am (1.79h)
Prescription medication
 Antipsychoticc 0% 25% 13%
 Antidepressantd 1% 30% 25%
 Stimulant 0% 8% 6%
 Mood stabilizer 0% 5% 3%
 Benzodiazepinee 0% 5% 13%
 Nonsteroidal anti-inflammatory drug 0% 0% 0%
 Antibiotic 0% 0% 0%
Substance use
 Tobacco usef 9% 30% 44%
 Alcohol use 46% 48% 38%
 Marijuana useg 9% 25% 31%
Current comorbid Diagnostic and Statistical Manual of Mental Disorders IV diagnosis
 Depression disordersh,i 0% 45% 50%
 Anxiety disordersi,j 3% 60% 56%

aCHR-P vs UC t test P value < .0001, CHR-NP vs UC t test P value < .0001.

bCHR-P vs CHR-NP t test P value = .02.

cCHR-P vs UC Fisher Exact Test (FET) P value = .047, CHR-NP vs UC FET P value = .001.

dCHR-P vs UC FET P value = .011, CHR-NP vs UC FET P value = .002.

eCHR-P vs UC FET P value = .047.

fCHR-P vs UC FET P value = .001, CHR-NP vs UC FET P value = .02.

gCHR-P vs UC FET P value = .020, CHR-NP vs UC FET P value = .056.

hCHR-P vs UC FET P value < .0001, CHR-NP vs UC FET P value < .0001.

iDepression disorders include major depression, depressive disorder not otherwise specified, and dysthymic disorder. Anxiety disorders include obsessive compulsive disorder, post-traumatic stress disorder, panic disorder, agoraphobia, social phobia, specific phobia, and generalized anxiety disorder.

jCHR-P vs UC FET P value < .0001, CHR-NP vs UC FET P value < .0001.

Normalization

The normal plasma concentrations varied analyte-to-analyte up to 1 000 000-fold. So that results could be viewed on the same scale, we standardized (z score) the results for each analyte to the average and SD values of the unaffected comparison subjects.

Reproducibility

We had resources to analyze one technical replicate. The intraclass correlation coefficient (ICC) of the 117 analyte levels for the duplicate samples was 0.83; for the 15 analytes selected by the greedy algorithm described below, the ICC was 0.87 (supplement S3).

Data Analyses

Statistical analyses were performed with Excel (Microsoft), Unscrambler (CAMO Software AS), SAS (SAS), or MedCalc Statistical Software. We used EasyFit to test for rejection of Gaussian (normal) distribution by Kolmogorov-Smirnov (K-S) and Anderson-Darling (A-D) tests. We used the Excel add-in significance analysis of microarrays (SAM)32 to compare expression using the Wilcoxon statistic with 5000 permutations, and the Excel add-in Real Statistics Using Excel33 to calculate ICCs and Fisher Exact Tests.

Greedy algorithms are extensively used in bioinformatics to solve a variety of problems. In particular, they are well known to be capable of selecting collectively informative markers from large candidate sets.34 They linearly build marker selections and avoid brute force examination of all possible subsets of markers. In addition, with greedy algorithms weighting of individual analytes can be avoided, thus minimizing the risk of overfitting that can occur from techniques such as machine learning or statistical modeling that develop real-number weights for each analyte to optimize prediction.35

The program first selected the very best single analyte for distinguishing the 3 groups. Then a second analyte was added that best improved performance, if possible. Additional analytes were selected and added until no further selection of any analyte improved performance. The chosen set of analytes created an “index” defined as the sum of the z scores of selected analytes. In effect, this was a weighted sum with all weights being 1; this was possible because most of analytes that moderately distinguished the 3 groups had higher values in CHR-P than CHR-NP and higher values in CHR-NP than UC. Performance was defined to be minimization of the sum of the squares of the Student’s t test P values for CHR-P vs CHR-NP and CHR-P vs UC.

Noting the general principles and pitfalls of classifier construction,35–37 classifier analyses on the results of the greedy algorithm were executed using 5-by-5-by-5-fold cross-validation38–40 with repeated random subsampling, implemented in Excel with macros and add-ins. Subjects in each group were randomly partitioned into ~20% subgroups. Four of the CHR-P, 4 of the CHR-NP, and 4 of the UC subgroups were used to train a classifier that was tested on the complementary subgroups. There are 125 possible different combinations of such tests (see supplementary methods). The entire process was repeated 20 times with 20 initial selections of the random 20% subgroups, for a total of 20 × 125 or 2500 executions of the greedy algorithm. A review of all the preliminary classifiers easily led to a final, integrated classifier because in the 125 tests several analytes were repeatedly selected, while other analytes were seldom or never selected. To evaluate consistency, we also applied a leave-one-out cross-validation procedure and compared results with those of the 5-fold cross-validation methods.

The area under the resulting receiver operating curve (AUC) assessed the capacity of the index to distinguish CHR-P from the other 2 groups using the exact (no smoothing) Hand-Till method41 with calculations of SE following the methods of Handley-McNeil.42 A receiver operating curve (ROC) is a plot of sensitivity (ie, test correctly predicts true positive declarations/all positives) vs the false positive rate (ie, 1 specificity, test correctly predicts true negative declarations/all negatives). Various threshold settings yield the points along the curve.

An AUC of 1.0 indicates perfect classification, and for large samples (> 100), an AUC of 0.5 indicates random classification. For 30 cases and controls, uniformly random numbers yield Hand-Till AUCs averaging 0.54 (SD = 0.03). Moreover, any classifier method applied to real data even after random relabeling of cases and controls can be expected to find weak patterns with AUCs > 0.5. This implies the necessity of checking a proposed classifier as follows.

Randomly reassigning our raw samples into bins of the sizes of the 3 groups and applying the very same classifier construction used in true classification should repeatedly lead to AUCs smaller than that of true classification. Such permutation tests of classifiers have a lengthy history43 and are considered powerful techniques of model validation.44

Evaluating Analyte Function

The RBM panel of analytes was chosen because of its focus on inflammation, oxidative stress, metabolism, and hormonal status, factors consistently associated with schizophrenia.9–14 Thus, it is not appropriate to use tools that discover “enrichment” of chosen analytes when interpreting these results. Instead, we considered it reasonable to review the published literature for each selected analyte to evaluate the function of the analyte, relationships between the analytes (eg, cytokines regulating hypothalamic-pituitary function), and reports of associations with schizophrenia or psychosis. We also found overlap with previously published reports on plasma analytes that distinguished persons with schizophrenia using the same multianalyte platform45–47 (reported in supplements S4 and S5).

Results

Participant Characteristics

Table 1 provides study subject characteristics. All CHR subjects met attenuated positive symptom diagnostic criteria. The psychosis diagnoses at follow-up of the 32 CHR-P subjects included 13 with psychosis, not otherwise specified, 14 with schizophrenia, 2 with major depression with psychotic features, and 1 each with schizoaffective, delusional, or bipolar disorder.

Plasma Analytes and Development of Psychosis

Controlling for multiple comparisons, there were no analytes that were differentially expressed for CHR-P subjects compared with CHR-NP or UC subjects (supplement S6). Comparison of CHR-P with UC subjects using permutation analyses with SAM32 assuming a false discovery rate of less than 10% identified 18 analytes as differentially expressed (supplement S5). We can thus expect that of the 18 analytes about 2 are false positives. Conducting the same permutation analysis for CHR-P to CHR-NP identified only 2 differentially expressed analytes (supplement S5).

Plasma Analytes and Psychosis Risk Prediction

An analyte could be chosen up to 125 times with each of the 20 runs (2500 total executions) in the cross-validation procedure. While somewhat different combinations of analytes were chosen every time, certain analytes were frequently chosen (figure 1, supplement S7). Likely, the most confidence in the informativeness of analytes should attend those most frequently chosen. For example, malondialdehyde-modified low-density lipoprotein was selected in almost all of the 2500 executions of the greedy algorithm. However, after the 15th most popular analyte, the frequency fell by 15%, suggesting a cut-off point and hence a selection of 15 analytes.

Fig. 1.

Fig. 1.

Shown analytes were the most frequently appearing in 20 5-by-5-by-5 cross-validation trials, each trial testing 125 partitions to generate ~80% subsets of UC, CHR-NP, and CHR-P samples.

Best practices of classifier development mandate use of an external test set that is not used to derive the classifier, with a minimum of 20 subjects in each group.39 The number of subjects in this study was too small to set aside an external test set, so we applied the 15-analyte index to the full data for all 107 subjects (figures 2A and 2B). As shown in table 2, using the true data the sum of the most frequently chosen 15 analytes gave the highest AUC, followed closely by AUCs using just the 9 or even 6 most frequently chosen analytes.

Fig. 2.

Fig. 2.

Fifteen-analyte receiver operating curves and 95% confidence intervals: (A) for CHR-P vs UC and (B) CHR-P vs CHR-NP.

Table 2.

Area Under the Receiver Operating Curve (AUC) Using Cut-off Points Chosen Based On Clustering of Number of Times Selected by Greedy Algorithm for Analytes Included in the Blood Analyte Classifier

Real Data CHR-P vs CHR-NP AUC (SE) CHR-P vs UC AUC (SE)
Sum best 15 analytes 0.88 (0.043) 0.91 (0.036)
Sum best 9 analytes 0.86 (0.046) 0.87 (0.045)
Sum best 6 analytes 0.83 (0.051) 0.84 (0.048)

Classifier methods generally can find patterns in random data, but the AUCs of pseudo-classification should be weak compared with the AUC of a true classifier of true data. Thus, we repeatedly applied exactly the same classifier development to pseudo-data obtained by randomly scrambling all the 107 samples into bins of sizes 35, 40, and 32 (based on the number of subjects in each group). As shown in figures 3A and 3B, the AUCs of the true classifiers of UC vs CHR-P and CHR-NP vs CHR-P were greater than all AUCs of 100 pseudo-classifiers, respectively, applied to their pseudo-data. Fitting data with beta distributions yielded extrapolations with low P values, as shown.

Fig. 3.

Fig. 3.

Distribution of AUCs for 100 classifiers built with random data. Shown is a beta distribution fit and P value (A) for UC vs CHR-P and (B) CHR-NP vs CHR-P. For UC vs P: the alpha values were >.2 for both Kolmogorov-Smirnov and Anderson-Darling tests of fit with beta distributions. Using the top 15, the area under the receiver operating curve (AUC) for true classifier on true data was 0.91. For the beta fit, this value is out of range and has a P value = 0. For NP vs P: the alpha values were >.2 for both Kolmogorov-Smirnov and Anderson-Darling tests of fit with beta distributions. Using the top 15, the AUC for true classifier on true data was 0.88. For the beta fit, this value has a P value = 6.51E-05.

The results of the leave-one-out validation procedure were essentially the same as the 5-fold cross-validation (supplement S8).

Correlation of 15-Analyte Index With Symptoms

Within the CHR subjects, the 15-analyte index was significantly correlated (Pearson) with baseline scores from the SOPS for total (r = .26, P = .03) and positive (r = .23, P = .05) scales, with trends for disorganized (r = .22, P = .07), general (r = .19, P = .10), and negative scales (r = .19, P = .11). Specific symptoms from the SOPS with strong correlations with the 15-analyte index included P1-unusual thought content/delusional ideas (r = .28, P = .02), D3-trouble with focus and attention, (r = .25, P = .03), G1-sleep disturbance (r = .23, P = .05), and G2-dysphoric (depressive, irritable, or anxious) moods (r = .24, P = .04). There was no relation between the 15-analyte index and severity of anxiety symptom as measured by the SAS (r = .11, P = .36) or depressive symptoms as measured by the CDSS (r = .14, P = .25).

Confounder Analyses

Baseline demographic variables (age, sex, ancestry, SES) and time of blood draw did not differ between groups and did not confound the relationship of the 15-analyte index with group status, nor did baseline measures of anxiety or depression or baseline (supplement S9). Given how common comorbid depression and anxiety disorders are in CHR persons,48 we also evaluated the potential confound of current diagnosis with a depression or anxiety disorder and found none (supplement S9).

There was no influence of cannabis, nicotine, or alcohol use of on the strength of the relationship of the 15-analyte index to distinguish CHR-P vs CHR-NP or UC subjects, or antipsychotic, or antidepressant drug use with the strength of the relationship of the 15-analyte index in classifying CHR-P vs CHR-NP subjects. Only 3 UC subjects used marijuana or nicotine, only 1 UC subject was prescribed antidepressant, and none were prescribed antipsychotics, making evaluation of confounding of drug use and the 15-analyte index impossible to evaluate in CHR-P vs UC comparisons.

Investigation of Analyte Functions

A summary of functions of the 15 analytes included in the index is given in supplement S4 together with references. From the original panel of immune, hormonal, oxidative stress, and metabolism biomarkers, most of the analytes included in the 15-analyte index are immunomodulatory: as cytokines (interleukin-1B, growth hormone, KIT ligand, interleukin-8, interleukin-7, resistin, chemokine [c-c motif] ligand 8) or as proteins involved in modulating inflammation including blood-brain barrier integrity (matrix metalloproteinase-7, immunoglobulin E, and coagulation factor VII). Three of the analytes (thyroid stimulating hormone, growth hormone, and cortisol) are part of hypothalamic-pituitary axes. Interestingly, 5 of the included cytokines (interleukin-1B, interleukin-7, interleukin-8, KIT ligand, and resistin) are known to regulate hypothalamic-pituitary axes. These findings indicate some dysregulation of immune-hypothalamic-pituitary interactions in the emergence of psychosis.

The most frequently chosen analyte, malondialdehyde-modified low-density lipoprotein, measures a lipoprotein damaged by free radicals and is thus a measure of oxidative stress.49 Elevation of apolipoprotein D, found at higher levels in CHR-P relative to CHR-NP and UC subjects, is also associated with oxidative stress.50 Oxidative stress and inflammation are intricately linked, and both are associated with schizophrenia. In summary, the above selection of 15 analytes may reflect interacting alterations in immune system function, hypothalamic-pituitary function, and oxidative stress.

Discussion

We report preliminary findings of a blood biomarker assay that, if confirmed, could improve determination of psychosis risk in persons experiencing the attenuated psychosis risk syndrome. Thus, given a new patient, the index value of a blood sample processed for 15 analytes as above could be compared with historic data to help evaluate likelihood of psychosis. For example, the ROC (figure 2B) suggests that if we accept a sensitivity of ~0.6, the index would have a specificity of ~0.9. As applied to persons meeting COPS criteria, who have a ~30% risk of psychosis in the next 2 years, this yields a PPV of 0.72, meaning that 72% of persons identified by the test as at high risk are truly at risk, and a negative predictive value (NPV) of 0.84, meaning that 84% of persons identified by the test as at low risk are truly at low risk of psychosis. Persons above this high-risk cut-off could be considered eligible for interventions where the benefits are high but the risks/costs may also be high, eg, antipsychotic medications or relatively intense individual/family therapies. Other cut-off scores could also have clinical utility. For example, using a cut-off score with a sensitivity of ~0.95 and thus a specificity of ~0.4, yields a PPV of 0.40 and a NPV of 0.95; persons scoring below the “high risk” cut-off score, but above the lower cut-off score, might appropriately receive brief counseling and more intense clinical monitoring. Thus, this index could provide a framework for segmenting the clinical high-risk population along a dimension of biological risk and then testing step-wise approaches to care.

There are several unique aspects regarding data analysis that warrant comment. Given that the analyte concentrations vary 1 000 000-fold, we created a z score for each analyte, based on the average and SD of the UC subjects. The z score normalization allows the creation of an unweighted scale. We propose that the elimination of weighting minimizes the problem of overfitting sometimes encountered with more complex algorithms that use various weighting schemes.35 Also, we recognize that the relevant patient population will frequently be treated with various medications, especially antidepressants and antipsychotics22,51 or used nicotine, marijuana, and alcohol, and that such drugs may influence analyte levels. Thus, we elected to eliminate analytes that showed a possible relation to these substances and furthermore verified that substance use did not confound relationships with the 15-analyte index. An alternative could be to develop different classifiers for persons depending on prescription medication treatment, but larger numbers of subjects would be required.

A major strength of this study is the prospective design. However, the parent project was not designed around plasma biomarker discovery, thus there are several methodological issues that could impact results, causing type 1 error if biased and underestimation of true difference (Type II error) if not biased.52 Relation to meals, physical exertion, menstrual cycle, body weight, and presence of a cold or allergy were not considered or measured during data collection. While all samples were run in duplicate, limited resources allowed the analysis of only one occult technical replicate. Finally, with larger samples, normalization could be refined to include sex, age, and other factors that could impact analyte expression.45

The results support our initial hypothesis that activation/dysregulation of the immune system may play a central role in the development of psychosis. Our findings are consistent with the emerging body of evidence linking inflammation and schizophrenia.14,15 Hypothalamic-pituitary axis dysregulation is also implicated by our results, although we found elevations of growth and thyroid hormones, in contrast to studies in schizophrenia subjects that report reductions.53 In support of the involvement of hypothalamus and pituitary in the onset of psychosis, imaging studies find increases in hypothalamic54 and pituitary55 volumes in persons at elevated risk for psychosis compared with unaffected subjects. In addition, activation of the hypothalamic-pituitary-adrenal axis, as evidenced by elevated salivary cortisol, has also been reported in CHR who developed psychosis.11,56,57 Finally, our finding that elevations in low-density lipoprotein damaged by oxidative stress predict psychosis is in concert with the substantial literature documenting oxidative damage in persons with schizophrenia.10

A critical step is testing in other subjects at high risk for psychosis, as well as establishing the reproducibility of the assay. More work is needed, however, as there are likely many other combinations of analytes with utility in psychosis risk prediction, and a blood assay could be combined with other clinical, imaging, or electrophysiological measures associated with progression to psychosis in clinical high-risk subjects.58 A better understanding of biomarkers predictive of psychosis could advance our ability to discriminate symptomatic persons truly at high risk for psychosis from those with minimally elevated risk. If confirmed, blood biomarkers have potential to influence strategies for preventative interventions, eg, targeting inflammation, stress reactivity, or oxidative stress directly. Our results highlight the potential promise to identify new targets for prevention for psychosis and support the need for further research in this area.

Supplementary Material

Supplementary material is available at http://schizophreniabulletin.oxfordjournals.org.

Funding

National Institute of Mental Health grants (U01MH0818902 to T.D.C., U01MH081984 to J.M.A., P50MH066286 to C.E.B., U01MH082022 to K.S.C., U01MH081857 to B.A.C., U01MH082004 to D.O.P., U01MH081928 to L.J.S., U01MH081988 to E.F.W., U01MH066160 to S.W.W.). The analysis of plasma samples was funded by a gift from an anonymous donor administered through the San Francisco Foundation (Perkins).

Supplementary Material

Supplementary Data

Acknowledgments

We acknowledge and thank the study participants and their family members. We also thank Katie Lansing, Nicholas Walter, and Kees Frelinger for their contributions toward the NAPLS plasma biobank. D.O.P., C.D.J., J.M.A., C.E.B., K.S.C., T.D.C., B.A.C., D.H.M., T.H.M., L.J.S., M.T.T., E.F.W., and S.W.W. are listed as inventors on a provisional patent application based in part on the work presented in this manuscript. R.H. has no financial disclosures or conflict of interests to declare.

References

  • 1. Perkins DO, Gu H, Boteva K, Lieberman JA. Relationship between duration of untreated psychosis and outcome in first-episode schizophrenia: a critical review and meta-analysis. Am J Psychiatry. 2005;162:1785–1804. [DOI] [PubMed] [Google Scholar]
  • 2. Fusar-Poli P, Bonoldi I, Yung AR, et al. Predicting psychosis: meta-analysis of transition outcomes in individuals at high clinical risk. Arch Gen Psychiatry. 2012;69:220–229. [DOI] [PubMed] [Google Scholar]
  • 3. Cannon TD, Cadenhead K, Cornblatt B, et al. Prediction of psychosis in youth at high clinical risk: a multisite longitudinal study in North America. Arch Gen Psychiatry. 2008;65:28–37. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Woods SW, Addington J, Cadenhead KS, et al. Validity of the prodromal risk syndrome for first psychosis: findings from the North American Prodrome Longitudinal Study. Schizophr Bull. 2009;35:894–908. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 5th ed. Washington, DC: American Psychiatric Association Press; 2013. [Google Scholar]
  • 6. Carpenter WT, Tandon R. Psychotic disorders in DSM-5: summary of changes. Asian J Psychiatr. 2013;6:266–268. [DOI] [PubMed] [Google Scholar]
  • 7. Tsuang MT, Van Os J, Tandon R, et al. Attenuated psychosis syndrome in DSM-5. Schizophr Res. 2013;150:31–35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Meehl PE, Rosen A. Antecedent probability and the efficiency of psychometric signs, patterns, or cutting scores. Psychol Bull. 1955;52:194–216. [DOI] [PubMed] [Google Scholar]
  • 9. Anderson G, Berk M, Dodd S, et al. Immuno-inflammatory, oxidative and nitrosative stress, and neuroprogressive pathways in the etiology, course and treatment of schizophrenia. Prog Neuropsychopharmacol Biol Psychiatry. 2013;42:1–4. [DOI] [PubMed] [Google Scholar]
  • 10. Flatow J, Buckley P, Miller BJ. Meta-analysis of oxidative stress in schizophrenia. Biol Psychiatry. 2013;74:400–409. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Walker EF, Trotman HD, Pearce BD, et al. Cortisol levels and risk for psychosis: initial findings from the North American prodrome longitudinal study. Biol Psychiatry. 2013;74:410–417. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Schwarz E, van Beveren NJ, Ramsey J, et al. Identification of subgroups of schizophrenia patients with changes in either immune or growth factor and hormonal pathways. Schizophr Bull. 2014;40:787–795. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Schwarz E, Guest PC, Rahmoune H, et al. Identification of a biological signature for schizophrenia in serum. Mol Psychiatry. 2012;17:494–502. [DOI] [PubMed] [Google Scholar]
  • 14. Kirkpatrick B, Miller BJ. Inflammation and schizophrenia. Schizophr Bull. 2013;39:1174–1179. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Miller BJ, Buckley P, Seabolt W, Mellor A, Kirkpatrick B. Meta-analysis of cytokine alterations in schizophrenia: clinical status and antipsychotic effects. Biol Psychiatry. 2011;70:663–671. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Addington J, Cadenhead KS, Cornblatt BA, et al. North American Prodrome Longitudinal Study (NAPLS 2): overview and recruitment. Schizophr Res. 2012;142:77–82. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Miller TJ, McGlashan TH, Rosen JL, et al. Prospective diagnosis of the initial prodrome for schizophrenia based on the Structured Interview for Prodromal Syndromes: preliminary evidence of interrater reliability and predictive validity. Am J Psychiatry. 2002;159:863–865. [DOI] [PubMed] [Google Scholar]
  • 18. First MB, Spitzer RL, Givvon M, Williams JBW. Structured Clinical Interview for DSM-IV TR Axis I Disorders, Non-patient Edition (SCID-I/NP). New York, NY: Biometrics Research, New York State Psychiatric Institute; 2002. [Google Scholar]
  • 19. Müller MJ, Brening H, Gensch C, Klinga J, Kienzle B, Müller KM. The Calgary Depression Rating Scale for schizophrenia in a healthy control group: psychometric properties and reference values. J Affect Disord. 2005;88:69–74. [DOI] [PubMed] [Google Scholar]
  • 20. Knight RG, Waal-Manning HJ, Spears GF. Some norms and reliability data for the State–Trait Anxiety Inventory and the Zung Self-Rating Depression scale. Br J Clin Psychol. 1983;22 (Pt 4):245–249. [DOI] [PubMed] [Google Scholar]
  • 21. Drake RE, Mueser KT, McHugo GJ. Clinician rating scale: Alcohol Use Scale (AUS), Drug Use Scale (DUS), and Substance Abuse Treatment Scale (SATS). In: Sederer LI, Dickey B, eds. Outcomes Assessment in Clinical Practice. Baltimore, MD: Williams and Wilkins; 1996:113–116. [Google Scholar]
  • 22. Cadenhead KS, Addington J, Cannon T, et al. Treatment history in the psychosis prodrome: characteristics of the North American Prodrome Longitudinal Study Cohort. Early Interv Psychiatry. 2010;4:220–226. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Woods SW, Addington J, Bearden CE, et al. Psychotropic medication use in youth at high risk for psychosis: comparison of baseline data from two research cohorts 1998-2005 and 2008-2011. Schizophr Res. 2013;148:99–104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Venkatasubramanian G, Chittiprol S, Neelakantachar N, Shetty T, Gangadhar BN. Effect of antipsychotic treatment on Insulin-like Growth Factor-1 and cortisol in schizophrenia: a longitudinal study. Schizophr Res. 2010;119:131–137. [DOI] [PubMed] [Google Scholar]
  • 25. Mukhopadhyay P, Rajesh M, Horváth B, et al. Cannabidiol protects against hepatic ischemia/reperfusion injury by attenuating inflammatory signaling and response, oxidative/nitrative stress, and cell death. Free Radic Biol Med. 2011;50:1368–1381. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Sarafian TA, Magallanes JA, Shau H, Tashkin D, Roth MD. Oxidative stress produced by marijuana smoke. An adverse effect enhanced by cannabinoids. Am J Respir Cell Mol Biol. 1999;20:1286–1293. [DOI] [PubMed] [Google Scholar]
  • 27. Ranganathan M, Braley G, Pittman B, et al. The effects of cannabinoids on serum cortisol and prolactin in humans. Psychopharmacology (Berl). 2009;203:737–744. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Vargas HO, Nunes SO, de Castro MR, et al. Oxidative stress and inflammatory markers are associated with depression and nicotine dependence. Neurosci Lett. 2013;544:136–140. [DOI] [PubMed] [Google Scholar]
  • 29. Hruškovičová H, Dušková M, Simůnková K, et al. Effects of smoking cessation on hormonal levels in men. Physiol Res. 2013;62:67–73. [DOI] [PubMed] [Google Scholar]
  • 30. Míguez MJ, Rosenberg R, Burbano-Levy X, Carmona T, Malow R. The effect of alcohol use on IL-6 responses across different racial/ethnic groups. Future Virol. 2012;7:205–213. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Schrieks IC, van den Berg R, Sierksma A, Beulens JW, Vaes WH, Hendriks HF. Effect of red wine consumption on biomarkers of oxidative stress. Alcohol Alcohol. 2013;48:153–159. [DOI] [PubMed] [Google Scholar]
  • 32. Tusher VG, Tibshirani R, Chu G. Significance analysis of microarrays applied to the ionizing radiation response. Proc Natl Acad Sci U S A. 2001;98:5116–5121. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Zaiontz C. Real Statistics Using Excel. http://www.real- statistics.com/ Accessed January 26, 2014.
  • 34. Liu X, Krishnan A, Mondry A. An entropy-based gene selection method for cancer classification using microarray data. BMC Bioinformatics. 2005;6:76. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Hand DJ. Classifier technology and the illusion of progress. Statistical Science. 2006;21:1––34.17906740 [Google Scholar]
  • 36. Moons KG, Kengne AP, Grobbee DE, et al. Risk prediction models: II. External validation, model updating, and impact assessment. Heart. 2012;98:691–698. [DOI] [PubMed] [Google Scholar]
  • 37. Moons KG, Kengne AP, Woodward M, et al. Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker. Heart. 2012;98:683–690. [DOI] [PubMed] [Google Scholar]
  • 38. Kohavi R. A study of cross-validation and bootstrap for accuracy estimation and model selection. Proc Fourteenth Intl Joint Conf Artif Intell. 1995;12:1137––1143. [Google Scholar]
  • 39. Tropsha A. Best Practices for QSAR model development, validation, and exploitation. Mol Inform. 2010;29:476––488. [DOI] [PubMed] [Google Scholar]
  • 40. Leidinger P, Keller A, Borries A, et al. High-throughput miRNA profiling of human melanoma blood samples. BMC Cancer. 2010;10:262. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. Hand DJ. Evaluating diagnostic tests: The area under the ROC curve and the balance of errors. Stat Med. 2010;29:1502–1510. [DOI] [PubMed] [Google Scholar]
  • 42. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36. [DOI] [PubMed] [Google Scholar]
  • 43. Lindgren F, Hansen B, Karcher W, Sjostrom M, Eriksson L. Model validation by permutation tests. Journal of Chemometrics 1996;10:521––532. [Google Scholar]
  • 44. Smit S, Hoefsloot HC, Smilde AK. Statistical data processing in clinical proteomics. J Chromatogr B Analyt Technol Biomed Life Sci. 2008;866:77–88. [DOI] [PubMed] [Google Scholar]
  • 45. Ramsey JM, Schwarz E, Guest PC, et al. Distinct molecular phenotypes in male and female schizophrenia patients. PLoS One. 2013;8:e78729. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Schwarz E, Guest PC, Rahmoune H, et al. Identification of a biological signature for schizophrenia in serum. Mol Psychiatry. 2011;17:1––9. [DOI] [PubMed] [Google Scholar]
  • 47. Schwarz E, Guest PC, Rahmoune H, et al. Identification of a blood-based biological signature in subjects with psychiatric disorders prior to clinical manifestation. World J Biol Psychiatry. 2012;13:627–632. [DOI] [PubMed] [Google Scholar]
  • 48. Fusar-Poli P, Nelson B, Valmaggia L, Yung AR, McGuire PK. Comorbid depressive and anxiety disorders in 509 individuals with an at-risk mental state: impact on psychopathology and transition to psychosis. Schizophr Bull. 2014;40:120–131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49. Del Rio D, Stewart AJ, Pellegrini N. A review of recent studies on malondialdehyde as toxic molecule and biological marker of oxidative stress. Nutr Metab Cardiovasc Dis. 2005;15:316–328. [DOI] [PubMed] [Google Scholar]
  • 50. Ganfornina MD, Do Carmo S, Lora JM, et al. Apolipoprotein D is involved in the mechanisms regulating protection from oxidative stress. Aging Cell. 2008;7:506–515. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Walker EF, Cornblatt BA, Addington J, et al. The relation of antipsychotic and antidepressant medication with baseline symptoms and symptom progression: a naturalistic study of the North American Prodrome Longitudinal Sample. Schizophr Res. 2009;115:50–57. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52. Perkins DO, Wyatt RJ, Bartko JJ. Penny-wise and pound-foolish: the impact of measurement error on sample size requirements in clinical trials. Biol Psychiatry. 2000;47:762–766. [DOI] [PubMed] [Google Scholar]
  • 53. Guest PC, Schwarz E, Krishnamurthy D, et al. Altered levels of circulating insulin and other neuroendocrine hormones associated with the onset of schizophrenia. Psychoneuroendocrinology. 2011;36:1092–1096. [DOI] [PubMed] [Google Scholar]
  • 54. Goldstein JM, Seidman LJ, Makris N, et al. Hypothalamic abnormalities in schizophrenia: sex effects and genetic vulnerability. Biol Psychiatry. 2007;61:935–945. [DOI] [PubMed] [Google Scholar]
  • 55. Nordholm D, Krogh J, Mondelli V, Dazzan P, Pariante C, Nordentoft M. Pituitary gland volume in patients with schizophrenia, subjects at ultra high-risk of developing psychosis and healthy controls: a systematic review and meta-analysis. Psychoneuroendocrinology. 2013;38:2394–2404. [DOI] [PubMed] [Google Scholar]
  • 56. Walder DJ, Trotman HD, Cubells JF, Brasfield J, Tang YL, Walker EF. Catechol-O-methyltransferase modulation of cortisol secretion in psychiatrically at-risk and healthy adolescents. Psychiatr Genet. 2010;20:166–170. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57. Walker EF, Brennan PA, Esterberg M, Brasfield J, Pearce B, Compton MT. Longitudinal changes in cortisol secretion and conversion to psychosis in at-risk youth. J Abnorm Psychol. 2010;119:401–408. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58. Fusar-Poli P, Borgwardt S, Bechdolf A, et al. The psychosis high-risk state: a comprehensive state-of-the-art review. JAMA Psychiatry. 2013;70:107–120. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Data

Articles from Schizophrenia Bulletin are provided here courtesy of Oxford University Press

RESOURCES