Skip to main content
Schizophrenia Bulletin logoLink to Schizophrenia Bulletin
. 2016 May 24;43(1):133–141. doi: 10.1093/schbul/sbw067

The Psychosis Continuum: Testing a Bifactor Model of Psychosis in a General Population Sample

Mark Shevlin 1,*, Eoin McElroy 1, Richard P Bentall 2, Ulrich Reininghaus 3,4, Jamie Murphy 1
PMCID: PMC5216850  PMID: 27220965

Abstract

Although the factor structure of psychosis continues to be debated by taxonomists, recent studies have supported a bifactor model consisting of a general psychosis factor and 5 uncorrelated symptom-specific factors. While this model has received support in clinical samples, it has not been tested at the general population level. Analysis was conducted on Wave 2 of the National Epidemiologic Survey on Alcohol and Related Conditions (N = 34 653). Twenty-two psychotic symptoms were used as observed indicators of psychosis. These items were chosen based on their conceptual similarity to the items used in a similar study based on clinical samples. Confirmatory factor analysis and confirmatory bifactor modeling were used to test a variety of competing models. The best fitting model consisted of a general psychosis factor that was uncorrelated with 5 specific factors: positive, negative, disorganization, mania, and depression. These findings suggest that the bifactor model can be extended to general population samples, supporting the continuity between clinical and subclinical psychotic experiences. Theoretical and practical implications are discussed.

Introduction

Difficulty in defining the psychosis phenotype has long been recognized as an impediment to both biological and psychological research into severe mental illness. Conventional diagnostic systems such as the DSM1 and ICD2 reflect Kraepelin’s3 original division of psychosis into the 2 main categories of dementia praecox/schizophrenia and the affective psychoses. However, critics of categorical classification have pointed to the poor reliability and disjunctive nature of these diagnoses,4,5 as for example revealed in the recent DSM-5 field trials,6 the high level of comorbidity between different diagnostic categories such as schizophrenia and bipolar disorder,7 the failure of diagnoses to clearly segregate into non-shared genetic and environmental risks in either family8 or molecular genetic9,10 studies, and poor validity in terms of prediction of outcome or response to treatment.11

One approach to overcoming these problems has been to attempt to develop empirically-derived classification systems. These efforts have focused on 2 questions: first, whether there are interpretable structures of covariation between different psychotic symptoms and experiences; second, whether these experiences lie on a continuum with subclinical expressions of psychosis, sometimes known as psychotic-like experiences (PLEs). Resolving these issues will potentially open new avenues for aetiological research, facilitate new ways of assessing patients with severe mental illness, and, ultimately, may lead to the identification of new targets for therapeutic intervention.

The Structure of Psychosis

Research on the first question has yielded several apparently contradictory solutions. On the one hand, the use of factor analytic methods to explore the comorbidity between different diagnoses has converged on 3 main spectra of psychiatric disorders: the internalizing spectra (anxiety and mood disorders), the externalizing disorders (behavior and substance disorders) and the psychoses.12–16 Within this framework, the psychoses appear as one spectrum of disorder, an idea that is consistent with pre-Kraepelinian ideas of unitary psychosis (or “Einheitspsychose”)17 and with recent research supporting a schizophrenia-bipolar spectrum without a clear separation between the 2 diagnoses on phenomenological or neuroscientific measures.18 A major limitation of this approach is that, at the aetiological level, although there appear to be common mechanisms, different diagnoses and symptoms appear to be related to different social and other risk factors.19–22

On the other hand, factor analyses of psychotic symptoms have most often converged on 5 separate factors of symptomatology: positive symptoms (hallucinations and delusions), negative symptoms, cognitive disorganization, depression and mania. For example, an exploratory factor analysis (EFA) of the Positive and Negative Syndrome Scale (PANSS) in a sample of recent-onset schizophrenia patients reported a correlated 5 factor solution.23 More recently, Stefanovics et al24 compared 3 different factor models of the PANSS using 4 samples of diagnosed patients. Using confirmatory factor analysis (CFA) they found that a 5-factor model (negative, positive, disorganized, mania, and depression) provided the best fit in each of the samples. More complex solutions have also been proposed, for example by combining symptoms with categories in the hope that this will lead to better predictive validity than the symptom dimensions alone.25 An obvious limitation of such schemes, however, is that they are too complex for many practical purposes.

Bifactor modeling provides a possible means of resolving the apparent inconsistency between the results of these 2 approaches while creating an understanding of the structure of psychosis that is not too complex for practical purposes. This approach is comparable to second-order modeling in that both methods acknowledge the multidimensionality of a construct while simultaneously retaining the idea that a single construct is being measured.26 With second-order modeling, the latent trait represents the variance shared by a number of more basic traits (ie, subdomains). Bifactor modeling differs in that the general and specific factors compete to explain item variance.26 Put simply, bifactor modeling allows researchers to directly test whether specific dimensions explain a nonredundant amount of variance amongst items that is not accounted for by the general factor.26,27

In a preliminary test of the bifactor approach, we analyzed data from 309 patients admitted to psychiatric services for acute, first or second episode psychosis and 507 patients with enduring psychosis who were in the care of community mental health teams.27 In this study, the bifactor model consisting of one general psychosis factor and 5 symptom dimensions provided a better fit than a unitary psychosis model or the 5 symptom dimensions alone. However, a major limitation of this analysis was that it was carried out only on patients with diagnoses in the schizophrenia spectrum. We therefore recently replicated this analysis with data from 1168 patients with diagnoses of either schizophrenia spectrum disorder or bipolar disorder, again finding that a bifactor model with one general, transdiagnostic psychosis dimension underlying affective and non-affective psychotic symptoms and 5 specific dimensions of positive, negative, disorganized, manic, and depressive symptoms provided the best model fit and diagnostic utility for categorical classification.28

The Continuum Between Psychosis and Healthy Functioning

The question of whether psychotic symptoms lie on a continuum with subclinical PLEs in the healthy population has been the subject of considerable debate,29,30 stimulated by studies of schizotypal traits in healthy individuals,31,32 and by the discovery that large numbers of individuals in the population experience PLEs without seeking psychiatric treatment.33 Whereas the existence of a phenomenological continuum running from eccentricity, through PLEs to full-blown psychotic symptoms is difficult to question, some reviewers have concluded that a fully dimensional structural model of psychotic traits and experiences remains unproven.34 However, there is evidence that those who experience PLEs are at high risk of making the transition to a fully-fledged psychotic disorder,35,36 especially following exposure to environmental risk factors.37 Recent evidence that the risk of psychosis is highly polygenic,10,38 with risk shared across schizophrenia, bipolar disorder, and other diagnoses10 is also consistent with a structural continuum. Although early taxometric research on psychometric measures of PLEs seemed to indicate a taxon of about 10 percent of individuals at elevated risk of psychosis,39 recent rigorous taxometric studies have supported a fully dimensional model.40

If PLEs lie on a continuum with psychotic illness, they should have a similar structure to psychotic symptoms in patients. To date, studies which have addressed this issue have mostly used EFA or CFA methods, and have consistently reported structures that correspond to the positive and negative factors revealed in similar studies carried out with patients, but with an additional factor that has been interpreted as indicating cognitive disorganization41,42 or social impairment,43,44 and sometimes with a fourth impulsivity factor.45

To our knowledge, the validity of the bifactor model in relation to PLEs has only been tested once. In a study with undergraduate students encompassing both schizotypal and affective traits, Preti et al46 administered the Schizotypal Traits Questionnaire47 and the Temperament Evaluation of Memphis, Pisa, Paris, and San Diego,48 finding that a bifactor model, with independent sub-domains of positive and negative schizotypal traits and a further sub-domain of affective traits, was the best fit to the data. However bifactor models have not been tested using community samples.

This study aims to test a large range of competing factor analytic models, including both general and specific dimensions, using data from a large general population sample (the National Epidemiologic Survey on Alcohol and Related Conditions; NESARC). It was hypothesized that models with both general and specific dimensions (bifactor) would provide better fit than correlated (ie, first-order) models and hierarchical (second-order) models.

Method

Sample

Analysis was conducted on the second wave of the National Epidemiologic Survey on Alcohol and Related Conditions (NESARC).49 The NESARC is a longitudinal survey that was designed to be representative of the civilian, noninstitutionalized adult population of the United States, including residents of the District of Columbia, Alaska, and Hawaii.49 Descriptions of the survey design, and data collection processes are available in greater detail elsewhere,49–52 but will be summarized here. Wave 1 of the NESARC was conducted between 2001 and 2002, while Wave 2 took place between 2004 and 2005. Respondents included those living in private households, boarding or rooming houses, nontransient hotels and motels, shelters, facilities for housing workers, college quarters, group homes, and military personnel living off base.49 One adult was randomly selected from each dwelling. Potential respondents were informed in writing of the nature of the study, the confidentiality procedures that were in place, the intended use for the data and the voluntary nature of their participation.49

Face-to-face, computer-assisted personal interviews were conducted by trained laypersons.49 In Wave 1, 43 093 adults were interviewed (81% response rate). In Wave 2, 34 653 available respondents (ie, those who were not deceased, deported, on active military duty, or mentally or physically impaired throughout the follow-up period) were reinterviewed (86.7% response rate). The cumulative response rate for both waves combined was 70.2%. Blacks, Hispanics and young adults aged 18–24 years were oversampled in both waves of the NESARC. As such, data were weighted to adjust for this oversampling. In order to be representative of the US population the data was also adjusted for region, age, sex, race, and ethnicity, based on the 2000 Decennial Census.49 This study focused solely on data collected as part of Wave 2.

Measures

The NESARC made use of the Alcohol Use Disorder and Associated Disabilities Interview Schedule—DSM-IV version (AUDADIS-IV).53 The AUDADIS-IV is a fully-structured, self-report, diagnostic interview designed to be administered by clinicians or trained laypersons.53 The AUDADIS-IV assesses both past year and lifetime occurrence of a variety of psychiatric disorders, including substance use disorders, major depression, anxiety disorders, psychosis and personality disorders.52 The AUDADIS-IV measures of substance use and other psychiatric disorders have high reliability in general population samples.52,54

Procedure

The best fitting model tested by Reininghaus, Priebe and Bentall27 grouped the 30 items of the PANSS into 5 factors of positive, negative, disorganization, mania and depression. An examination was conducted of the entire AUDADIS-IV and individual items were selected based on their conceptual similarity to the items from the PANSS55 as used by Reininghaus et al.27 The AUDADIS-IV was deemed suitable for this purpose, as taxometric research supports a dimensional structure to PLEs within this measure.56 Items were taken primarily from Section 10, “Usual Feelings and Actions,” of the AUDADIS-IV. Other items were taken from Section 4a (“Low Mood”), Section 5 (“High Mood”), Section 7 (“Social Situations”), and Section 9 (“General Anxiety”). Overall, 22 individual items were identified under the broad groupings of positive, negative, mania, disorganization and depression factors (supplementary table 1).

The first 3 questions from sections 4a, 5, 6, 7 and 9 were screener questions used to determine whether respondents should proceed to answer questions about specific symptoms.57 Items were recoded into binary variables in which responses were coded with a 1 if they endorsed both the screener question and the specific symptom. If respondents did not endorse both, they were coded with a 0. Section 10 (“Usual Feelings and Actions”) does not include screener questions, however, each specific symptom item has a follow-up question indicating distress or impaired functionality associated with that symptom (“Did this ever trouble you or cause problems at work or school, or with your family or other people”). To ensure a more stringent selection criteria, data were recoded into binary variables in which respondents endorsed both the symptom and associated distress/impaired functionality with said item (1) or did not (0).

Statistical Analysis

CFA and confirmatory bifactor modeling (CBM) were used to test 20 separate factor models, including both general and specific dimensions, based on previous theory. A unitary factor model was specified in which all 22 items loaded onto one single psychosis factor. For models encompassing 2 specific factors (positive, negative), 4 permutations were specified; (1) a first-order correlated traits model, (2) a first-order uncorrelated traits model, (3) a bifactor model with orthogonal specific factors, (4) a bifactor model with oblique specific factors. For models encompassing 3 (positive, negative, mania), 4 (positive, negative, mania, disorganization) and 5 (positive, negative, mania, disorganization, depression) specific factors, 5 permutations were specified; (1) a first-order correlated traits model, (2) a first-order uncorrelated traits model, (3) a second-order model, (4) a bifactor model with orthogonal specific factors, (5) a bifactor model with oblique specific factors. The model specifications for the alternative models are summarized in table 1. To avoid capitalizing on chance, the sample was randomly split in half; the 20 models were fitted to the first half of the sample, and the best fitting model cross-validated using the second half of the sample.

Table 1.

Model Specifications for the Alternative Models of Psychosis

Unitary Factor First-Order, Second-Order,a and Bifactorb Models
2-Factor 3-Factor 4-Factor 5-Factor
Delusions PSY POS POS POS POS
Hallucinations PSY POS POS POS POS
Grandiosity PSY POS POS POS POS
Suspiciousness PSY POS POS POS POS
Unusual thought content PSY POS POS POS POS
Blunted affect PSY NEG NEG NEG NEG
Emotional withdrawal PSY NEG NEG NEG NEG
Poor rapport PSY NEG NEG NEG NEG
Passive social withdrawal PSY NEG NEG NEG NEG
Motor retardation PSY NEG NEG NEG NEG
Disturbance of volition PSY NEG NEG NEG NEG
Active social withdrawal PSY NEG NEG NEG NEG
Tension/anxiety PSY NEG NEG NEG DEPR
Guilt PSY NEG NEG NEG DEPR
Depression PSY NEG NEG NEG DEPR
Excitement PSY POS MAN MAN MAN
Hostility PSY POS MAN MAN MAN
Uncooperativeness PSY POS MAN MAN MAN
Impulsivity PSY POS MAN MAN MAN
Conceptual disorganization PSY NEG NEG DIS DIS
Mannerisms and posturing PSY NEG NEG DIS DIS
Conceptual disorganization (2) PSY NEG NEG DIS DIS

Note: POS, Positive; NEG, Negative; MAN, Mania; DIS, Disorganization; DEPR, Depression.

aFor second-order models, specific factors were explained by a higher order psychosis factor.

bFor bifactor models, each item also had a nonzero loading on a general psychosis factor (PSY) that was uncorrelated with specific factors.

Models were specified and estimated using Mplus version 6.0,58 using the robust weighted least squares (WLSMV) estimator based on the polychoric correlation matrix of latent continuous response variables. The WLSMV estimator is the most appropriate statistical treatment of categorical indicators in a CFA context.59,60 Goodness of fit for each model was assessed with a range of fit indices including the chi-square, the comparative fit index (CFI),61 and the Tucker-Lewis Index (TLI).62 A nonsignificant χ2 and values greater than 0.90 for the CFI and TLI were considered to reflect acceptable model fit. Additionally, the Root Mean Square Error of Approximation (RMSEA)63 was reported, where a value less than 0.05 indicated close fit and values up to 0.08 indicated reasonable errors of approximation.64 The Weighted Root Mean Square Residual (WRMR) was designed to be used when modeling categorical data and values closer to 1 are indicative of better model fit.65

Results

The fit statistics of the competing models are reported in table 2. Uncorrelated first-order models fit the data extremely poorly. Unitary, correlated first-order and hierarchical models provided an acceptable approximation of the data, regardless of whether the models consisted of 2, 3, 4, or 5 specific factors. For these models, both the CFI and TLI values were above the acceptable cut-off point of 0.90.

Table 2.

Fit Statistics of the CFA and Bifactor Models in First Half of Sample

Factors Model χ2 df CFI TLI RMSEA WRMR
1 unitary 2672.858* 209 0.931 0.924 0.026 3.751
2 correlated 2537.522* 208 0.935 0.928 0.025 3.646
uncorrelated 14778.662* 209 0.592 0.549 0.063 10.530
bifactor orthogonal 790.076* 187 0.983 0.979 0.014 1.785
bifactor oblique 535.156* 186 0.990 0.988 0.010 1.345
3 correlated 2538.428* 206 0.935 0.927 0.026 3.644
uncorrelated 16091.871* 209 0.556 0.509 0.066 11.284
bifactor orthogonal 796.691* 187 0.983 0.979 0.014 1.825
bifactor oblique 520.216* 184 0.991 0.988 0.010 1.326
second-order 2538.431* 206 0.935 0.927 0.026 3.644
4 correlated 2175.656* 203 0.945 0.937 0.024 3.285
uncorrelated 17243.569* 209 0.523 0.473 0.069 12.116
bifactor orthogonal 688.078* 187 0.986 0.983 0.012 1.697
bifactor oblique 358.122* 181 0.995 0.994 0.008 1.053
second-order 2142.621* 205 0.946 0.939 0.023 3.294
5 correlated 1715.270* 199 0.958 0.951 0.021 2.868
uncorrelated 23397.312* 209 0.351 0.283 0.080 14.479
bifactor orthogonal 1847.421* 187 0.954 0.943 0.023 2.996
bifactor oblique 342.373* 177 0.995 0.994 0.007 1.024
second-order 2018.649* 204 0.949 0.942 0.023 3.194

Note: N = 17 327. CFA, confirmatory factor analysis; χ2, Chi-Square Goodness of Fit Statistic; df, degrees of freedom; CFI, Comparative Fit Index; TLI, Tucker Lewis Index; RMSEA, Root-Mean-Square Error of Approximation; WRMR, Weighted Root Mean Square Residual. Bifactor orthogonal = correlations between specific factors fixed to zero. Bifactor oblique = correlations between specific factors freely estimated.

*Statistical significance (P < .01).

Overall, bifactor models consisting of a general factor and 2, 3, 4 or 5 specific factors provided excellent fit. Models consisting of a general factor and either 4 (positive, negative, disorganization, and mania) or 5 (positive, negative, disorganization, mania, and depression) correlated specific (ie, oblique) factors provided almost identical fit, and were the best fitting models overall. Although the 4-factor model was more parsimonious, the 5-factor model was preferred based on previous literature which has distinguished between negative and depressive psychotic factors.23–25 This model was cross-validated in the second half of the sample (N = 17 327), and again the model provided excellent fit to the data (χ2 = 417.4; df = 177; CFI = 0.992; TLI = 0.990; RMSEA = 0.009; WRMR = 1.159).

Standardized factor loadings for the best model, fit to the second half of the data, are presented in table 3. Loadings were higher on the general psychosis factor compared with the specific factors for positive, disorganization, and mania (with the exception of excitement). For the negative symptoms, blunted affect and emotional withdrawal loaded more strongly on the general factor, whereas motor retardation, disturbance of volition and active social withdrawal loaded more strongly on the specific negative factor. While each individual item loaded significantly onto the general factor, not all items loaded onto the specific factors. Grandiosity did not significantly load onto the positive dimension, while poor rapport and passive social withdrawal failed to load onto the negative dimension. Moreover, uncooperativeness did not significantly load onto the mania factor. Items reflecting the depression dimension had stronger loadings on the specific depression factor compared with loadings on the general psychosis factor.

Table 3.

Standardized Factor Loadings, Internal Consistency and Average Variance Extracted (AVE) for the General Factor and Correlated 5 Specific Factors in Second Half of Sample

Item General Positive Negative Mania Disorganization Depression
Delusions 0.721** 0.428**
Hallucinations 0.710** 0.533**
Grandiosity 0.731** −0.040
Suspiciousness 0.682** 0.473**
Unusual thought 0.642** 0.504**
Blunted affect 0.662** 0.303**
Emotional withdrawal 0.654** 0.587**
Poor rapport 0.786** 0.019
Passive social withdrawal 0.836** −0.013
Motor retardation 0.193* 0.800**
Disturbance of volition 0.292** 0.755**
Active social withdrawal 0.370** 0.485**
Excitement 0.293** 0.521**
Hostility 0.674** 0.469**
Uncooperativeness 0.720** 0.058
Impulsivity 0.746** 0.301**
Conceptual disorganization (1) 0.707** 0.598**
Mannerisms and posturing 0.693** 0.693**
Conceptual disorganization (2) 0.670** 0.531**
Tension/anxiety 0.318** 0.669**
Guilt 0.276** 0.884**
Depression 0.262** 0.930**
AVEa 0.371 0.189 0.269 0.146 0.373 0.698

Note: N = 17 326.

aAverage variance extracted.

*P < .05; **P < .01.

Table 3 also provides the average variance extracted (AVE) for each factor in the best fitting model. The AVE was highest for the depression factor, followed by the disorganization factor and the general psychosis factor. The AVE was lowest for the mania factor. Correlations between the specific factors are presented in table 4. Correlations were generally high, particularly for the depression and negative factors.

Table 4.

Correlations Between Specific Psychosis Factors

Positive Negative Mania Disorganization Depression
Positive 0.810 0.774 0.749 0.650
Negative 0.920 0.511 0.997
Mania 0.489 0.800
Disorganization 0.408

Note: All correlations significant at P < .01.

Discussion

A better understanding of the latent structure of psychosis may ultimately lead to improvements in the assessment and treatment of those presenting with psychotic symptoms. With this in mind, the present study aimed to test a large range of competing factor analytic models of psychosis, including hierarchical, general and specific dimensions, using data from a large general population sample. Specifically, it was predicted that bifactor models would provide better fit than correlated traits (first-order) or (second-order) hierarchical models. Results indicated that bifactor models comprised of general and specific dimensions provided superior model fit to unidimensional, correlated traits and hierarchical models, regardless of the number of specific factors included in the model. As such, the main hypothesis was supported.

The best fitting factor structure in the present study consisted of a general psychosis factor and 5 specific factors of positive, negative, disorganization, mania, and depression. Similar structures have been identified in previous factor analytic studies utilizing clinical samples.27,28 Inspection of the AVE of each factor suggested that the specific factors explained a nonredundant amount of variance that was not explained by the general psychosis factor. As such, scores on both general and specific dimensions may be used to inform diagnostic and treatment decisions (see Reininghaus et al25 for suggested guidelines).

It must be noted, however, that the correlation between the depression and negative factors was extremely high, raising the question of whether these factors collapse into a single factor in community samples. This issue may have arose due to the measures used to assess psychosis; the ratings on the PANSS and the OPCRIT system used in previous studies27,28 were informed by observation of the patients during the interviews, and hence sampled a broader range of information relevant to negative symptoms compared to the present study. Indeed, it could be argued that a number of items from the present study that were used as proxies for negative symptoms were affective in nature eg, (“emotional withdrawal” was assessed using the question “Have you often felt empty inside?”), likely accounting for the high correlation between the negative and depressive factors. These observations suggest that further research using measures specifically designed to assess distinct psychotic dimensions may be required to substantiate this model. However, it could also be argued that other factors that distinguish community and clinical samples will lead to clearer separation of the factors in the latter, for example antipsychotic medication which may produce a loss of hedonic functioning66; indeed antipychotics produce negative-type symptoms when taken by healthy volunteers.67

Overall, the findings of the present study give further credence to the argument that the dementia praecox/affective psychosis differentiation is arbitrary. Indeed, the results of this study suggest that a transdiagnostic psychosis factor underlies the affective and non-affective symptoms that are reflected in putatively distinct disorders such as schizophrenia and bipolar disorder. While this general psychosis factor appears relatively robust, the precise nature of this factor remains open to interpretation. Plausible interpretations of this factor require further research before they can be substantiated. One possible explanation is that the general psychosis factor reflects elements of aetiology (eg, genetic vulnerability) that are shared amongst the psychotic disorders. Similar explanations have been put forward in other transdiagnostic studies of psychopathology. For example, recent epidemiological research has suggested that a single psychopathological factor may underlie and account for comorbidity between all psychiatric disorders.68,69 It has been speculated that this factor, dubbed p, may reflect a genetic predisposition to experience any and all psychiatric disorders, and that specific factors of psychopathology (broad domains of internalizing, externalizing and psychosis) may reflect non-shared environmental factors that ultimately differentiate between what we have traditionally viewed as distinct diagnoses.68,69 The findings of the present study could fit within this “generalist genes/specialist environment” theoretical framework.70 It is possible that the general psychosis factor reflects shared aetiological agents that put individuals at risk of experiencing any and all psychotic disorders, whereas the specific factors may be experience-dependent and lead to unique expressions of symptoms amongst individuals. The role of genetic influences in the development of psychosis, however, remains a hotly debated issue.10,11 In order to substantiate this hypothesis, further research would be required examining the specificity of the associations between genetic and environmental risk factors and the common and specific psychosis factors.

Alternatively, it is possible that the general psychosis factor could be capturing emotional and behavioral outcomes that are common facets of discrete psychotic disorders.46,70 In other words, all psychotic disorders are likely to result in psychological distress and impaired functionality (ie, need for treatment), which may account for the variance shared amongst these purportedly discrete disorders. This interpretation may be contradicted by the findings of Reininghaus et al,27 who found that patients with early onset psychotic disorders scored significantly higher on the general psychosis factor, whereas those with chronic disorders scored significantly higher on the specific factors. One would assume that if the general psychosis factor captures common elements of psychological distress and functional impairment, then patients with chronic psychoses would score higher on this dimension due to their greater need for treatment. Further research examining the association between general and specific dimensions of psychosis and treatment requirements would be required before this interpretation could be substantiated.

Whether a fully dimensional structural model of psychosis can be sustained is still debated.29,30,34 The factor structure of psychotic symptoms in clinical and general population samples serves as a key argument of the continuum hypothesis; if a continuum exists, it is logical to assume that the psychotic symptoms would cluster together in similar ways at both the clinical and subclinical levels. Previous studies employing general population samples have identified 2, 3 and 4 factor structures that were analogous to the factors identified in clinical research.41–43,45,46 The present study is the first to test a bifactor model in a general population sample. The factor structure identified in this study was broadly similar to that identified in the clinical samples.27,28 This suggests that psychotic symptoms tend to cluster together in similar ways at both clinical and subclinical levels. This adds further support to the hypothesis that psychosis reflects an extended phenotype, with clinically relevant psychoses such as schizophrenia representing the extreme upper end of a continuum that occurs naturally within the general population.

Strengths, Limitations and Future Directions

The main strengths of the present study were the large, representative sample and the analytical approach adopted. Indeed, bifactor modeling allowed us not only to test whether a general dimension underpinned psychosis, but also to directly compare the validity and utility of this general dimension with specific dimensions. The findings of the present study, however, should be considered in light of the following limitations. First, it must be noted that not all of the psychotic symptoms included in previous studies27,28 could be mapped onto items in the AUDADIS-IV. As such, a number of psychotic symptoms assessed in previous studies27,28 were excluded from the present analysis. Second, the analysis was cross-sectional, therefore it was not possible to assess the stability of this model within individuals over time. Third, replication of this model in diverse samples is required. Finally, these analyses did not control for common method bias, where shared variance among indicators of different dimensions may be attributable to the same measurement procedure rather than the latent variables of interest (see Maul71 for discussion on the nature of method effects). However theoretically predictable associations between the general psychosis factor and clinical, neurocognitive, and social factors27 would suggest that it’s unlikely that the general factor is due entirely to method effects.

Conclusion

In conclusion, the present study aimed to test the validity of a bifactor model of psychosis in a large, representative sample. The results indicated that bifactor models of psychosis provided superior model fit to unidimensional, correlated and second-order models. The optimal model consisted of a general psychosis factor independent of 5 correlated specific factors; positive, negative, mania, depression, and disorganization. These findings are in line with previous studies which have found similar results in clinical samples.27,28 Taken together, these results support the idea of a psychosis continuum, as it appears that psychotic symptoms cluster together in similar patterns at both clinical and subclinical levels. The bifactor model of psychosis may be useful in informing clinical diagnoses and treatment plans.

Supplementary Material

Supplementary material is available at http://schizophreniabulletin.oxfordjournals.org.

Supplementary Data

Acknowledgment

The authors have declared that there are no conflicts of interest in relation to the subject of this study.

References

  • 1. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (5th ed.). Arlington, VA: American Psychiatric Publishing; 2013. [Google Scholar]
  • 2. World Health Organization. ICD-10: International Statistical Classification of Diseases and Related Health Problems (10th revision ed.). Geneva, Switzerland: World Health Organization; 1992. [Google Scholar]
  • 3. Kraepelin E. Psychiatry: A Textbook for Students and Physicians. Volume 1: General Psychiatry. Canton, MA: Watson Publishing International; 1899/1990. [Google Scholar]
  • 4. Read J, Dillon J. Models of Madness. Hove, East Sussex: Routledge; 2013. [Google Scholar]
  • 5. van Os J. “Schizophrenia” does not exist. BMJ. 2016;352:i375. [DOI] [PubMed] [Google Scholar]
  • 6. Regier DA, Narrow WE, Clarke DE, et al. DSM-5 field trials in the United States and Canada, Part II: test-retest reliability of selected categorical diagnoses. Am J Psychiatry. 2013;170:59–70. [DOI] [PubMed] [Google Scholar]
  • 7. Kessler RC, Chiu WT, Demler O, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62:617–627. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Lichtenstein P, Yip BH, Bjork C, et al. Common genetic determinants of schizophrenia and bipolar disorder in Swedish families: a population-based study. Lancet. 2009;373:234–239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Craddock N, Owen M. The beginning of the end for the Kraepelinian dichotomy. Br J Psychiatry. 2005;186:364–366. [DOI] [PubMed] [Google Scholar]
  • 10. Psychiatric Genomics Consortium. Biological insights from 108 schizophrenia-associated genetic loci. Nature. 2014;511:421–427. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Bentall RP. Madness Explained: Psychosis and Human Nature. London, UK: Penguin; 2003. [Google Scholar]
  • 12. Fleming S, Shevlin M, Murphy J, Joseph S. Psychosis within dimensional and categorical models of mental illness. Psychosis. 2014;6:4–15. [Google Scholar]
  • 13. Kotov R, Chang SW, Fochtmann LJ, et al. Schizophrenia in the internalizing-externalizing framework: a third dimension? Schizophr Bull. 2011;37:1168–1178. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Wright AGC, Krueger R, Hobbs MJ, Markon KE, Eaton NR, Slade T. The structure of psychopathology: toward an expanded quantitative empirical model. J Abnorm Psychol. 2013;122:281–294. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Eaton NR, Rodriguez-Seijas C, Carragher N, Krueger RF. Transdiagnostic factors of psychopathology and substance use disorders: a review. Soc Psychiatry Psychiatr Epidemiol. 2015;50:171–182. [DOI] [PubMed] [Google Scholar]
  • 16. Carragher N, Krueger RF, Eaton NR, Slade T. Disorders without borders: current and future directions in the meta-structure of mental disorders. Soc Psychiatry Psychiatr Epidemiol. 2015;50:339–350. [DOI] [PubMed] [Google Scholar]
  • 17. Berrios GE, Beer D. Unitary psychosis concept. In: Berrios G, Porter R, eds. A History of Clinical Psychiatry. London, UK: Athlone Press; 1995: 280–291. [Google Scholar]
  • 18. Tamminga CA, Pearlson G, Keshavan M, Sweeney J, Clementz B, Thaker G. Bipolar and schizophrenia network for intermediate phenotypes: outcomes across the psychosis continuum. Schizophr Bull. 2014;40(suppl 2):S131–S137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Torrey EF, Miller J, Rawlings R, Yolken RH. Seasonality of births in schizophrenia and bipolar disorder: a review of the literature. Schizophr Res. 1997;28:1–38. [DOI] [PubMed] [Google Scholar]
  • 20. Cannon M, Jones PB, Murray RM. Obstetric complications and schizophrenia: historical and meta-analytic review. Am J Psychiatry. 2002;159:1080–1092. [DOI] [PubMed] [Google Scholar]
  • 21. Bentall RP, de Sousa P, Varese F, et al. From adversity to psychosis: pathways and mechanisms from specific adversities to specific symptoms. Soc Psychiatry Psychiatr Epidemiol. 2014;49:1011–1022. [DOI] [PubMed] [Google Scholar]
  • 22. Johnstone E, Crow T, Frith CD, Owens D. The Northwick Park ‘functional psychosis’ study: diagnosis and treatment response. Lancet. 1988;ii:119–125. [DOI] [PubMed] [Google Scholar]
  • 23. Emsley R, Rabinowitz J, Torreman M. The factor structure for the Positive and Negative Syndrome Scale (PANSS) in recent-onset psychosis. Schizophr Res. 2003;61:47–57. [DOI] [PubMed] [Google Scholar]
  • 24. Stefanovics EA, Elkis H, Zhening L, Zhang XY, Rosenheck RA. A cross-national factor analytic comparison of three models of PANSS symptoms in schizophrenia. Psychiatry Res. 2014;219:283–289. [DOI] [PubMed] [Google Scholar]
  • 25. Demjaha A, Morgan K, Morgan C, et al. Combining dimensional and categorical representation of psychosis: the way forward for DSM-V and ICD-11? Psychol Med. 2009;39:1943–1955. [DOI] [PubMed] [Google Scholar]
  • 26. Reise SP, Moore TM, Haviland MG. Bifactor models and rotations: exploring the extent to which multidimensional data yield univocal scale scores. J Pers Assess. 2010;92:544–559. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Reininghaus U, Priebe S, Bentall RP. Testing the psychopathology of psychosis: evidence for a general psychosis dimension. Schizophr Bull. 2013;39:884–895. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Reininghaus U, Böhnke JR, Hosang GM, et al. Probing the boundaries of the Kraepelinian dichotomy: evidence for a transdiagnostic psychosis spectrum encompassing schizophrenia and bipolar disorder [published online ahead of print March 17, 2016]. Brit J Psychiatry. doi:10.1192/bjp.bp.115.167882. [Google Scholar]
  • 29. David AS. Why we need more debate on whether psychotic symptoms lie on a continuum with normality. Psychol Med. 2010;40:1935–1942. [DOI] [PubMed] [Google Scholar]
  • 30. Lawrie SM, Hall J, Owens DGC, Johnstone EC. The ‘continuum of psychosis’: scientifically unproven and clinically impractical. Br J Psychiatry. 2010;197:423–425. [DOI] [PubMed] [Google Scholar]
  • 31. Chapman LJ, Chapman JP. Scales for rating psychotic and psychotic-like experiences as continua. Schizophr Bull. 1980;6:477–489. [PubMed] [Google Scholar]
  • 32. Claridge GS. Can a disease model of schizophrenia survive? In: Bentall RP, ed. Reconstructing Schizophrenia. London, UK: Routledge; 1990:157–183. [Google Scholar]
  • 33. van Os J, Hanssen M, Bijl RV, Ravelli A. Strauss (1969) revisited: a psychosis continuum in the general population? Schizophr Res. 2000;45:11–20. [DOI] [PubMed] [Google Scholar]
  • 34. Linscott RJ, van Os J. Systematic reviews of categorical versus continuum models in psychosis: evidence for discontinuous subpopulations underlying a psychometric continuum. Implications for DSM-V, DSM-VI, and DSM-VII. Annu Rev Clin Psychol. 2010;6:391–419. [DOI] [PubMed] [Google Scholar]
  • 35. Chapman LJ, Chapman JP, Kwapil TR, Eckblad M, Zinser MC. Putatively psychosis-prone subjects 10 years later. J Abnorm Psychol. 1994;103:171–183. [DOI] [PubMed] [Google Scholar]
  • 36. Linscott RJ, van Os J. An updated and conservative systematic review and meta-analysis of epidemiological evidence on psychotic experiences in children and adults: on the pathway from proneness to persistence to dimensional expression across mental disorders. Psychol Med. 2013;43:1133–1149. [DOI] [PubMed] [Google Scholar]
  • 37. van Os J, Linscott RJ, Myin-Germeys I, Delespaul P, Krabbendam L. A systematic review and meta-analysis of the psychosis continuum: evidence for a psychosis proneness-persistence-impairment model of psychotic disorder. Psychol Med. 2009;39:179–195. [DOI] [PubMed] [Google Scholar]
  • 38. The International Schizophrenia Consortium. Common polygenic variation contributes to risk of schizophrenia and bipolar disorder. Nature. 2009;460:748–752. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Lenzenwenger MF. Schizotypy and Schizophrenia. New York, NY: Guilford; 2010. [Google Scholar]
  • 40. Daneluzzo E, Stratta P, Di Tommaso S, Pacifico R, Riccardi I, Rossi A. Dimensional, non-taxonic latent structure of psychotic symptoms in a student sample. Soc Psychiatry Psychiatr Epidemiol. 2009;44:911–916. [DOI] [PubMed] [Google Scholar]
  • 41. Bentall RP, Claridge GS, Slade PD. The multidimensional nature of schizotypal traits: a factor analytic study with normal subjects. Br J Clin Psychol. 1989;28:363–375. [DOI] [PubMed] [Google Scholar]
  • 42. Claridge G, McCreery C, Mason O, et al. The factor structure of “schizotypal’ traits: a large replication study. Br J Clin Psychol. 1996;35:103–115. [DOI] [PubMed] [Google Scholar]
  • 43. Reynolds CA, Raine A, Mellingen K, Venables PH, Mednick SA. Three-factor model of schizotypal personality: invariance across culture, gender, religious affiliation, family adversity, and psychopathology. Schizophr Bull. 2000;26:603–618. [DOI] [PubMed] [Google Scholar]
  • 44. Venables PH, Rector NA. The content and structure of schizotypy: a study using confirmatory factor analysis. Schizophr Bull. 2000;26:587–602. [DOI] [PubMed] [Google Scholar]
  • 45. Mason O. A confirmatory factor analysis of the structure of schizotypy. Eur J Personal. 1995;9:271–281. doi:10.1002/per.2410090404. [Google Scholar]
  • 46. Preti A, Corrias I, Gabbrielli M, et al. The independence of schizotypy from affective temperaments–a combined confirmatory factor analysis of SPQ and the short TEMPS-A. Psychiatry Res. 2015;225:145–156. [DOI] [PubMed] [Google Scholar]
  • 47. Raine A. The SPQ: a scale for the assessment of schizotypal personality based on DSM-III-R criteria. Schizophr Bull. 1991;17:555–564. [DOI] [PubMed] [Google Scholar]
  • 48. Akiskal HS, Benazzi F, Perugi G, Rihmer Z. Agitated “unipolar” depression re-conceptualized as a depressive mixed state: implications for the antidepressant-suicide controversy. J Affect Disord. 2005;85:245–258. [DOI] [PubMed] [Google Scholar]
  • 49. Grant BF, Dawson DA. Introduction to the national epidemiologic survey on alcohol and related conditions. Alcohol Health Res World. 2006;29:74. [Google Scholar]
  • 50. Grant B, Kaplan K. Source and Accuracy Statement for the Wave 2 National Epidemiologic Survey on Alcohol and Related Conditions (NESARC). Rockville, MD: National Institute on Alcohol Abuse and Alcoholism; 2005. [Google Scholar]
  • 51. Grant B, Kaplan K, Shepard J, Moore T. Source and Accuracy Statement for Wave 1 of the 2001–2002 National Epidemiologic Survey on Alcohol and Related Conditions. Bethesda, MD: National Institute on Alcohol Abuse and Alcoholism; 2003. [Google Scholar]
  • 52. Grant BF, Dawson DA, Stinson FS, Chou PS, Kay W, Pickering R. The Alcohol Use Disorder and Associated Disabilities Interview Schedule-IV (AUDADIS-IV): reliability of alcohol consumption, tobacco use, family history of depression and psychiatric diagnostic modules in a general population sample. Drug Alcohol Depend. 2003;71:7–16. [DOI] [PubMed] [Google Scholar]
  • 53. Grant BF, Dawson D. The Alcohol Use Disorder and Associated Disabilities Interview Schedule-IV (AUDADIS-IV). Rockville, MD: National Institute on Alcohol Abuse and Alcoholism; 2000. [Google Scholar]
  • 54. Grant BF, Harford TC, Dawson DA, Chou PS, Pickering RP. The Alcohol Use Disorder and Associated Disabilities Interview schedule (AUDADIS): reliability of alcohol and drug modules in a general population sample. Drug Alcohol Depend. 1995;39:37–44. [DOI] [PubMed] [Google Scholar]
  • 55. Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull. 1987;13:261. [DOI] [PubMed] [Google Scholar]
  • 56. Ahmed AO, Green BA, Buckley PF, McFarland ME. Taxometric analyses of paranoid and schizoid personality disorders. Psychiatry Res. 2012;196:123–132. [DOI] [PubMed] [Google Scholar]
  • 57. Ruan WJ, Goldstein RB, Chou SP, et al. The Alcohol Use Disorder and Associated Disabilities Interview Schedule-IV (AUDADIS-IV): reliability of new psychiatric diagnostic modules and risk factors in a general population sample. Drug Alcohol Depend. 2008;92:27–36. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58. Muthén LK, Muthen B. Mplus 6.0. Los Angeles, CA: Muthén & Muthén; 2010. [Google Scholar]
  • 59. Brown TA. Confirmatory Factor Analysis for Applied Research. New York, NY: Guilford Press; 2006. [Google Scholar]
  • 60. Flora DB, Curran PJ. An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol Methods. 2004;9:466–491. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61. Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107:238–246. [DOI] [PubMed] [Google Scholar]
  • 62. Tucker LR, Lewis C. A reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973;38:1–10. [Google Scholar]
  • 63. Steiger JH. Structural model evaluation and modification: an interval estimation approach. Multivariate Behav Res. 1990;25:173–180. [DOI] [PubMed] [Google Scholar]
  • 64. Jöreskog KG, Sörbom D. LISREL 8: Structural Equation Modeling With the SIMPLIS Command Language. Chicago, IL: Scientific Software; 1993. [Google Scholar]
  • 65. Yu CY. Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes [Doctoral dissertation]. Los Angeles, CA: University of California Los Angeles; 2002. [Google Scholar]
  • 66. Voruganti L, Awad AG. Neuroleptic dysphoria: towards a new synthesis. Psychopharmacology. 2004;171:121–132. [DOI] [PubMed] [Google Scholar]
  • 67. Artaloytia JF, Arango C, Lahti A, et al. Negative signs and symptoms secondary to antipsychotics: a double-blind, randomized trial of a single dose of placebo, haloperidol, and risperidone in healthy volunteers. Am J Psychiatry. 2006;163:488–493. [DOI] [PubMed] [Google Scholar]
  • 68. Caspi A, Houts RM, Belsky DW, et al. The p Factor: One General Psychopathology Factor in the Structure of Psychiatric Disorders? Clin Psychol Sci. 2014;2:119–137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69. Lahey BB, Applegate B, Hakes JK, Zald DH, Hariri AR, Rathouz PJ. Is there a general factor of prevalent psychopathology during adulthood? J Abnorm Psychol. 2012;121:971–977. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70. Kovas Y, Plomin R. Learning abilities and disabilities: generalist genes, specialist environments. Curr Dir Psychol Sci. 2007;16:284–288. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71. Maul A. Method effects and the meaning of measurement. Front Psychol. 2013;4:169. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Data

Articles from Schizophrenia Bulletin are provided here courtesy of Oxford University Press

RESOURCES