Abstract
Objectives
The main goal of the present study was to analyze the network structure of schizotypy dimensions in a representative sample of adolescents from the general population. Moreover, the network structure between schizotypy, mental health difficulties, subjective well-being, bipolar-like experiences, suicide ideation and behavior, psychotic-like experiences, positive and negative affect, prosocial behavior, and IQ was analyzed.
Method
The study was conducted in a sample of 1,506 students selected by stratified random cluster sampling. The Oviedo Schizotypy Assessment Questionnaire, the Personal Wellbeing Index–School Children, the Paykel Suicide Scale, the Mood Disorder Questionnaire, the Strengths and Difficulties Questionnaire, the Prodromal Questionnaire–Brief, the Positive and Negative Affect Schedule for Children Shortened Version, and the Matrix Reasoning Test were used.
Results
The estimated schizotypy network was interconnected. The most central nodes in terms of standardized Expected Influence (EI) were ‘unusual perceptual experiences’ and ‘paranoid ideation’. Predictability ranged from 8.7% (‘physical anhedonia’) to 52.7% (‘unusual perceptual experiences’). The average predictability was 36.27%, implying that substantial variability remained unexplained. For the multidimensional psychosis liability network predictability values ranged from 9% (estimated IQ) to 74.90% (‘psychotic-like experiences’). The average predictability was 43.46%. The results of the stability and accuracy analysis indicated that all networks were accurately estimated.
Conclusions
The present paper points to the value of conceptualizing psychosis liability as a dynamic complex system of interacting cognitive, emotional, behavioral, and affective characteristics. In addition, provide new insights into the nature of the relationships between schizotypy, as index of psychosis liability, and the role played by risk and protective factors.
Keywords: clinical high risk, schizotypal, schizotypy, network, complex dynamic system
Introduction
The leitmotiv of psychosis high-risk paradigms [i.e., psychometric, genetic and Clinical High Risk (CHR)] is based on the ability to identify those individuals potentially at risk of developing psychosis in order to conduct prevention and prophylactic interventions (1, 2). Psychosis high risk approaches attempt to capturing early clinical (micro) phenotypes at early stages before care is needed and disability ensues. With these objectives in mind, proliferation of programs and centers specialized in early intervention in psychosis have emerged in the last twenty years (3–5). However, the “ultra-high risk” concept and “transition” paradigm have been questioned (6).
Psychosis high risk approaches assume (explicitly or implicitly) the idea of psychosis liability continuum (7). The construct that harbors the latent liability for schizophrenia and related manifestations is called schizotypy (8). At the phenotypic level, schizotypy can manifest itself, in a range variety of expressions, such us schizotypal traits, psychotic-like experiences, subclinical psychotic symptoms (i.e., CHR), frank psychotic symptoms, schizotypal personality disorder, or psychosis-spectrum disorders (2, 9). At population level, the non-clinical (or “soft”) expression of psychosis phenotype may represent the behavioral manifestation of risk for psychosis (7, 10–12) and psychopathology. In fact, schizotypy probably represents the most clearly tractable risk factor for schizophrenia spectrum disorders (13). In its structure, schizotypy is a multidimensional construct, composed basically of three factors (Cognitive-Perceptual, Negative, and Disorganization), which is consistent with the factor structure found in patients with psychosis and CHR samples (14–16).
Modern approaches of psychosis promote a developmental, staging, and transdiagnostic approach which takes into account the different dimensions of risk, as well as protective factors, that influence liability to psychopathology (3, 6, 17, 18). In addition, clinical and subclinical psychosis phenotypes can be seen as complex dynamic systems of interacting cognitive, emotional, behavioral, social, and affective traits (19, 20). This viewpoint, named network model, represents a recent theoretical approach in the psycho(patho)logy arena, although it is not new in the scientific field (21–23). Basically, the network model is evolving as a response to the biomedical model, which is being disseminated by the leading nosological systems (e.g., DSM and ICD). Thus, new psychopathological and psychometric approaches, like network framework or chaos theory (24), might provide new insights in psychosis and mental health fields. In addition, a dynamic approach of psychopathology can complement and give new insight to a traditionally DSM categorical viewpoint.
From network approach, mental disorders, like psychosis, can be seen as emergent properties that arise from mutual interactions between mental states (or symptoms, signs, traits, etc.) (25–29).These findings can be considered within the network model of onset of psychotic disorders proposed by Linscott and van Os (30). The onset for the outcome of these mental health problems can be understood in part as: a) different psychotic-like experiences and schizotypal traits (e.g., psychosis proneness) that causally impact on each other over time (within phenotype domain), becoming persistent and leading then to clinical impairment, and b) many factors from multiple levels of analysis (e.g., trauma, cannabis, bullying, genetic background, brain function, etc.) that also causally impact on each other over time within and across - vertically and horizontally- domains in psychosis expression (31).
A wide variety of issues still remain to be resolved in psychosis research. It is necessary to gain a deeper understanding of the nature and structure of multidimensional psychosis liability beyond diagnostic systems (based on macrophenotypes) and in early stages of developmental disorders. At the same time, it would be interesting considering both risk (i.e. suicide ideation, emotional problems) and protective factors (i.e. well-being, positive affect) in the individual, as dynamic complex systems. Overall, these studies might be relevant in order to improve our knowledge about etiological mechanisms as well as early detection and intervention strategies in mental health. In addition, network model provides an informative way to describe the complex relationships between a set of key variables, focusing on the local interactions at the level of smaller units that compose the psychological problems, such as emotional and behaviors manifestations, and not at the disorder level. Based on this developmental, staging, non-clinical, and transdiagnostic approach, adolescence is a relevant developmental period where many changes at bio-psycho-social level take place. Therefore, it becomes a crucial stage to identify and intercept the unfolding of mental health problems. Moreover, if it is considered that almost 75% of all mental disorders begin in the first two decades of life and many of these individuals start with subclinical phenomena and/or report prodromal symptoms before to clinical outcome (32, 33).
To date, there has been no in-depth examination about the network structure of schizotypy and its relationship with cognitive, emotional, social, and behavioral indicators. Interestingly, no previous studies have analyzed the role of protective factors, such as personal well-being, prosocial behavior, or positive affect in psychosis liability network. Within this research framework, the main goals of the present study were: a) To analyze the network structure of schizotypy dimensions (within domain), as indirect indicator of psychosis liability in a representative sample of adolescents from the general population; and b) To estimate the network structure of schizotypy dimensions, mental health difficulties, subjective well-being, bipolar-like experiences, suicide ideation and behavior, psychotic-like experiences, positive and negative affect, prosocial behavior, and IQ (between domains).
Methods
Participants
Stratified random cluster sampling was conducted at the classroom level, in an approximate population of 15,000 students selected from a region located in northern Spain. The students belonged to different public and concerted Educational Centers of Compulsory Secondary Education and Vocational Training, as well as to different socio-economic levels. The layers were created as a function of the geographical zone and the educational stage.
The initial sample consisted of 1,881 students, eliminating those participants who presented a high score in the Oviedo Infrequency Response Scale (more than 3 points) (n = 104), an age older than 19 (n = 170) or did not complete the tests or the neurocognitive battery (n = 101). A total of 1506 students, 667 men (44.3%), belonging to 34 schools and 98 classrooms participated in the study. The mean age was 16.1 years (SD = 1.36), ranging from age 14 to 19 years.
Nationality distribution of the participants was as follows: 89.9% Spanish, 3.7% Latin American (Bolivia, Argentina, Colombia, and Ecuador), 2.4% Romanian, 1% Moroccan, 0.7% Portuguese, 0.7% Pakistani, and 2% other nationalities.
Instruments
The Oviedo Schizotypy Assessment Questionnaire-Revised (ESQUIZO-Qr) (34). The ESQUIZO-Qr is a self-report measure developed for the assessment of schizotypal traits in adolescents. It comprises a total of 62 items with Likert type response format in five categories (from 1 “totally disagree” to 5 “totally agree”). Its 10 subscales are derived empirically by means of factor analysis, which in turn are grouped into three general dimensions: Reality Distortion (e.g., Ideas of Reference, Magical Thinking, Unusual Perceptual Experiences, and Paranoid Ideation), Anhedonia (Physical Anhedonia and Social Anhedonia), and Social Disorganization (Odd Thinking and Speech, Odd Behavior, Lack of Close Friends, and Excessive Social Anxiety). In this revised version new items of Anhedonia dimension were added. Internal consistency levels for the subscales ranged from 0.62 to 0.90 and several sources of validity evidence with other psychopathology measures were gathered (34).
The Personal Wellbeing Index- School Children (PWI-SC) (35). The PWI-SC contains eight items of satisfaction, corresponding to different quality of life domains: standard of living, personal health, achievement in life, personal relationships, personal safety, feeling part of the community and future security. The PWI-SW has been validated in Spanish samples of adolescents (36). In the present study, the internal consistency, estimated with Cronbach’s alpha, was 0.81.
The Paykel Suicide Scale (PSS) (37). The PSS is a self-report tool designed for the evaluation of suicidal ideation and behavior (lifetime prevalence). It consists of a total of 5 items with a dichotomous response system Yes/No (score, 1 and 0, respectively). The scores range from 0 to 5. The Spanish adaptation of the PSS has demonstrated adequate psychometric properties (38, 39). In the present study, the internal consistency, estimated with Cronbach’s alpha, was 0.90.
The Mood Disorder Questionnaire (MDQ) (40). The MDQ consists of 13 yes/no items based on the DSM-IV criteria for bipolar disorder. A result is considered positive if the participant replies affirmatively to 7 or more items of the 13 proposed and if, in addition, the symptoms described occurred during the same time period (Criterion 2) and represented moderate or severe problems (Criterion 3). The Spanish version of the MDQ has demonstrated adequate psychometric properties (41). In the present study, the internal consistency, estimated with Cronbach’s alpha, was 0.85.
The Strengths and Difficulties Questionnaire (SDQ) (42). The SDQ is a self-report tool that is widely used for the assessment of different emotional and behavioral problems related to mental health in adolescents. The SDQ is made up of a total of 25 statements distributed across five subscales: Emotional symptoms, Conduct problems, Hyperactivity, Peer problems, and Prosocial behavior. In this study we used a Likert-type response format with three options (0 = “Not true”, 1 = “Somewhat true”, 2 = “Certainly true”). The Spanish version of the SDQ was used (43) (see https://www.sdqinfo.com/a0.html). In the present study, internal consistency levels for the SDQ subscales ranged from 0.72 to 0.87.
The Prodromal Questionnaire–Brief (PQ-B) (44). The PQ-B is a psychosis-risk screening measure containing 21-items that are answered in a dichotomous response format (true/false). The PQ-B asks additional questions regarding frequency/severity of impairment and distress, rated on a Likert-type (1 “strongly disagree” to 5 “strongly agree”). The Spanish validation of the PQ-B has demonstrated adequate psychometric properties (45). In the present study, the internal consistency of PQ-B total score, estimated with Cronbach’s alpha, was 0.89.
The 10-Item Positive and Negative Affect Schedule for Children Shortened Version (46). The PANAS-10, is a self-reported adjective checklist that contains two 5-item subscales designed to measure positive (i.e., joyful, cheerful, happy, lively, proud) and negative affect (i.e., miserable, mad, afraid, scared, sad). The PANAS-10 uses a Likert-type scale (ranging from 1, very slightly or not at all, to 5, extremely or very much). Evidences of internal consistency of the PANAS in Spanish population range from 0.86 to 0.90 for positive affect, and from 0.84 to 0.87 for negative affect (47). In the present study, internal consistency values for the PANAS ranged from 0.84 to 0.89.
The Penn Matrix Reasoning Test (PMRT) (48, 49). This is a task of the Penn Computerized Neurocognitive Battery-Child version developed to measure non-verbal reasoning within complex cognition domain. This task is composed by 20 items that can be considered as estimated IQ. The battery includes different neurobehavioral tasks adapted to youth samples that have demonstrated adequate psychometric properties (48, 49).
The Oviedo Infrequency Scale (INF-OV) (50). INF-OV was administered to the participants to detect those who responded in a random, pseudorandom or dishonest manner. The INF-OV instrument is a self-report composed of 12 items in a 5-point Likert- scale format (1 = completely disagree; 5 = completely agree). Students with more than three incorrect responses were eliminated from the present study.
Procedure
The research was approved by the Educational Government of La Rioja and the Ethical Committee of Clinical Research of La Rioja (CEICLAR). The self-reports and neurocognitive battery were administered collectively through personal computers in groups of 10 to 30 students during normal school hours, and in a classroom specially prepared for this purpose. Administration took place under the supervision of researchers previously trained in a standard protocol. No incentive was provided for their participation. For participants under 18, parents were asked to provide a written informed consent in order for their child to participate in the study. Participants were informed about the confidentiality of their responses and the voluntary nature of the study.
Data Analyses
General Network Estimation
The details of network analysis were documented in-depth elsewhere (51, 52). Two networks were estimated. First, within schizotypy dimensions. Second, between schizotypy, mental health difficulties, subjective well-being, bipolar-like experiences, suicide behaviors, psychotic-like experiences, positive and negative affect, prosocial behavior, and estimated IQ.
A network consists of nodes (e.g., ESQUIZO-Qr domains) and edges (unknown statistical relationships between nodes that need to be estimated). For the domains, which were constructed by summing items per domain and then standardizing the resulting variable, we estimated a Gaussian Graphical Model (GGM) (53). This model resulted in conditional dependence relations which are akin to partial correlations: if two nodes are connected in the resulting graph via an edge, they are statistically related after controlling for all other variables in the network; if they are unconnected, they are conditionally independent. For the layout, the Fruchterman-Reingold algorithm was used, placing the strongly connected nodes closer to each other and the least connected nodes far apart (51).
Network Inference
Concordantly to previous studies examining network (54), we estimated two measures: Expected Influence (EI) and predictability.
EI is the sum of all edges of a node (55). We use EI instead of strength centrality (56), that has been used in prior works, because strength centrality uses the sum of absolute weights (i.e. negative edges are turned into positive edges before summing), which distorts the interpretation if negative edges are present.
Predictability is an absolute measure of interconnectedness: it provides us with the variance of each node that is explained by all its neighbors (57). Predictability can be understood as an upper bound of controllability: assuming that all undirected edges connected to a node point towards this node, predictability quantifies how much impact neighbors have on a focal node by intervening on them. In the figures, dark areas in the circle around nodes can be interpreted akin to R2 (% of explained variance) (57).
Network Stability
To test network stability and accuracy, we used bootstrapping routines implemented in the R-package bootnet (58).
SPSS 22.0 (59), R (60), and FACTOR (61) were used for these analyses.
Results
Network Structure of Schizotypy
The estimated schizotypy network was interconnected. Results are shown in Figure 1 . Strong edges within Positive (‘odd/magical beliefs’, ‘unusual perceptions’, and ‘ideas of reference’), Negative (‘physical anhedonia’ and ‘social anhedonia’), and Disorganization domains (‘no close friends’, ‘constricted affect’, ‘odd behavior’, ‘excessive social anxiety’, and ‘odd speech’) were found.
Figure 2 depicts standardized EI values. The most central nodes in terms of standardized EI were ‘unusual perceptual experiences’ and ‘paranoid ideation’. Predictability ranged from 8.7% (‘physical anhedonia’) to 52.7% (‘unusual perceptual experiences’). The average predictability was 36.27%. The correlation between predictability and EI was 0.92.
Network Structure of Multidimensional Psychosis Liability
Figure 3 shows the estimated network for schizotypy dimensions and related psychopathological, affective, cognitive, and behavioral phenomena. First, strong and positive edges between nodes ‘odd/magical beliefs’, ‘unusual perceptual experiences’, ‘ideas of reference’, ‘suspiciousness’ and ‘psychotic-like experiences’ were found. Second, the majority connections between estimated IQ and other nodes are absent; this implies that these variables can be statistically independent when conditioning on all other nodes, or that there was not sufficient power to detect an edge between these nodes. Third, strong connections emerge among ‘psychotic-like experiences’ and ‘bipolar-like experiences’ nodes. Fourth, protective factors like ‘prosocial behavior’, ‘positive affect’, and ‘subjective well-being’ were positive associated. Especially, strong connections emerge among Node D17 (Positive affect) and Node D16 (personal well-being).
The most central nodes in terms of standardized EI were ‘unusual perceptions’, ‘suspiciousness’, and ‘psychotic-like experiences’ (both frequency and distress). Results are depicted in Figure 4 . Interestingly, ‘prosocial behavior’, ‘positive affect’, and ‘subjective well-being’ were the least central domains. Predictability ranged from 9% (estimated IQ) to 74.90% (‘psychotic-like experiences’, both frequency and distress associated). The average predictability was 43.46%. The correlation between predictability and EI was 0.62.
Network Stability
The results of the stability and accuracy analysis (58) indicated that all networks were accurately estimated. Stability analyses revealed that the networks were accurately estimated, with moderate confidence intervals around the edge weights. The outputs for schizotypy network are presented in the online Supplemental Materials .
Discussion
Here, we proposed to understand schizotypy, a multidimensional psychosis liability index, as a complex system of cognitive, emotional, and behavioral traits. To date, the network structure of schizotypy, as well as its links with other risk and protective indicators, have not been clearly delimited and analyzed. To the best of our knowledge, this is the first study to examine the empirical network structure of schizotypy during adolescence. In addition, no previous studies have examined the multidimensional psychosis liability with a large number of cognitive, affective, behavioral, and social indicators (e.g., mental health difficulties, subjective well-being, bipolar-like experiences, suicide ideation, psychotic-like experiences, positive and negative affect, and IQ). Thus, new approaches, such as network model, may provide new insights in the delimitation and conceptualization of psychosis liability, as well as psychopathology or mental health before clinical outcome and functional impairment. Furthermore, this novel conceptualization, as a complex system, is the first step in embracing the dynamic and complexity of early stages of psychopathology and emerging micro-phenotypes. In addition, this approach might help for the identification, prognosis, prevention, diagnosis, and prophylactic interventions.
The schizotypy domains were strongly interconnected. In particular, the relationship between nodes showed a three-cluster named Cognitive-Perceptual, Interpersonal (Negative), and Disorganized. The average predictability was 36.27%, implying that substantial variability remained unexplained. This network structure found was quite compatible with the three-dimensional model proposed schizotypy/schizotypal research (14, 62, 63). These results are also congruent with previous studies. Network models have also been used to analyze, amongst others, schizotypal personality traits in a multinational sample (54), psychotic like-experiences in cross-cultural study (64), and psychotic-like experiences in a large U.S. sample (65). For instance, Fonseca-Pedrero et al., (54), using the Schizotypal Personality Questionnaire (66), indicated that schizotypal traits were strongly interconnected in the domain-level network. Predictability ranged from 31% (magical thinking) to 55% (restricted affect), with a mean of 43.7%. In another study, Murphy et al. (65) found that psychosis network revealed strong interconnectivity between psychotic-like experiences, where nodes indicating paranoia were among the most central in the estimated network. In addition, the viewpoint of psychosis phenotype, as a network system, is congruent with previous research that demonstrated how negative/disorganized symptoms predicted positive symptoms (67) or how hallucinations gave rise to delusions (68).
The network structure between schizotypy, mental health difficulties, subjective well-being, bipolar-like experiences, suicide ideation and behavior, psychotic-like experiences, positive and negative affect, prosocial behavior, and estimated IQ was analyzed. Variables showed relations both within and across domains, although within-domain associations were generally stronger. The network predictability values ranged from 9% (estimated IQ) to 74.90% (‘psychotic-like experiences’), where the mean value of predictability was 43.46%. The psychosis-like experiences in terms of frequency and distress associated were the most central nodes in this estimated network. Also, suicide ideation and behavior were connected to negative affect and psychotic-like experiences. These results are consistent with previous studies conducted in other samples and with other measuring instruments (69–71). For instance, Zhang et al. (71) investigated the network structure between schizotypal traits and autistic traits, obsessive-compulsive traits, depressive symptoms, and anxiety symptoms in a college sample. They found that schizotypal features were highly overlap with depressive symptoms, however anxiety symptoms only connected with interpersonal traits. In addition, the network estimated showed high predictability, similar to the value yielded in the present study, where interpersonal traits had the highest expected influence. Interestingly, beyond to traditional psychopathology viewpoint, protective factors like prosocial behavior, positive affect, and subjective well-being were, on the one hand, more closely associated with each other than with other dimensions and, on the other hand, negative related with psychosis liability dimensions (e.g., ‘ideas of reference’, ‘unusual perceptual experiences’) and mental health difficulties (e.g., peer problems, emotional symptoms). To date, no previous studies have analyzed the psychosis liability network using both risk and protective factors. In this sense, it is plausible to argue that good subjective quality of life, positive emotions, or prosocial conduct might act as protective factors, leading to more resilient networks and becoming a less interconnected symptom network (22). This estimated network might be an example of the emerging psychopathology as a mixture picture of affective dysregulation, aberrant salience, cognitive impairments, and behavioral difficulties. Future studies should analyze the role of protective factors in psychosis extended phenotype as key elements to promoting well-being in young people, whether at risk or not.
Another relevant point in the present research is the role played by the estimated IQ in the multidimensional psychosis liability network. In the overall network, the associations between IQ and other nodes were generally low. Nonetheless, several issues have to be mentioned. First, IQ was measured by only a short task of complex reasoning (i.e., matrices test). Second, IQ was measured by an objective task while other indicators where measured by self-report tools. Third, adolescence is a developmental stage where executive and cognitive functions may develop at different pace. Fourth, the data were recollected both from different levels of analyses and measured with different tools. These facts might affect to the results found. However, we have to recognize that IQ (by extension cognitive abilities) is a key factor in the psychosis picture (both clinical and subclinical). Previous studies have demonstrated that people with psychosis have deficits in a wide variety of cognitive domains, in particular intelligence (72). In addition, such deficits are present in the premorbid stage and in the prodromal or at-risk mental phase, and predict the emergence of full-blown psychosis (73, 74). Therefore, to real understanding the psychosis liability it is relevant to gather information of IQ, because it is a multidimensional phenotype that requires cognitive, affective, psychophysiological, social, and behavioral variables. In addition, it is possible that accessing and analyzing data on multiple indicators, simultaneously, and from several levels of analyses, might accelerate the prediction of disease progression, as well as contribute to a better understanding of etiological mechanisms. To date, no previous studies have examined the network multidimensional structure of psychosis liability using IQ estimators. Thus, future studies in this line are still necessary.
These findings are congruent with the idea of transdiagnostic psychosis spectrum encompassing both non-affective and affective psychotic experiences (7) as well as with the psychosis proneness-persistence-impairment model (75). In particular, this model posits that the developmental expression of psychosis may become abnormally persistent and subsequently clinically relevant if there is a combination of other genetic, environmental, and psychological factors (7, 12). Thus, the presence of schizotypal traits or subclinical psychotic symptoms is not a necessary or sufficient condition for the later development of a psychotic disorder or other mental disorders (10, 12). Worth noting, the psychosis liability may interact synergistically or additively with genetic (e.g., unaffected family members of patients with psychosis), environmental (e.g., trauma, cannabis use), and/or psychological factors (e.g., affective dysregulation, avoidance coping). In addtion, this latent liability could causally impact on each other over time in a network of dynamic interactions, becoming abnormally persistent, help-seeking, and eventually give rise to transition to a psychotic spectrum disorder and impairment (12, 30, 7). For instance, Isvoranu et al. (76) demonstrated that psychosis symptom networks were more strongly connected for people exposed to environmental risk factors (e.g., cannabis use, developmental trauma, urban environment), indicating that environmental exposure may lead to a more strongly connected network structure and less resilient symptom networks. As Lenzenweger (2) pointed out, mental disorders represent complex configural outcomes of multiple interacting systems that cannot be reduced to a mere collection of constituent parts.
Some limitations of this study should be acknowledged. First, adolescence is a developmental period in which brain, cognition, and personality are still consolidating. Second, in the present study, we only investigated the schizotypy through self-report screening measures. These measures have been associated with stigmatization and negative labeling. Third, it should be borne in mind that this study was of a cross-sectional nature, so we cannot make cause-effect inferences. Fourth, the results found in the present study needs longitudinal confirmation. Fifth, regarding the structure of the estimated network, a correct interpretation of it should not only focus on the visual inspection of its topography. A problem to avoid in the estimated networks, is precisely the over-interpretation on its visualization (77). This aspect refers especially to the design and placement of nodes in the graph, for example, when the nodes of the network are grouped in a cluster. However, it is relevant to know that the location of the node within a network is only one of the many equally ‘correct’ ways of placing the nodes in it, that is, with the same one showing the distribution of the nodes in the network. This network, in a new estimate, could be different. Also, the fact that a node is at the center of the network does not necessarily indicate that it is the most “central” node in it. We must be cautious when making a visual interpretation of the nodes and the analysis of their importance depending on the position in the estimated network. Therefore, for a better interpretation of the psychological network, and in order to avoid incorrect inferences, it is relevant to use other indicators as: predictability (78) or other statistical procedures (77). Finally, research in network analysis is currently in its infancy, and is not free of tentative limitations (e.g., generalizability and reproducibility of network estimation) (79, 80), so it is necessary to continue working on the construction of a solid and refutable scientific model and to incorporate new scientific evidence (22).
Conclusions
This study is the first to comprehensively examine the network structure of schizotypy, as an indicator of psychosis liability, using a large sample of adolescents. The results are consistent with the conceptual notion of schizotypy, understood as a complex network structure of cognitive, emotional, and behavioral traits. This study also offers a deeper understanding of the subclinical psychosis expression (psychosis liability) and its links with psychopathology, affective, personality, and cognitive domains. The understanding of the network structures of psychosis liability in general population may help to prevent psychotic-spectrum and mental health disorders. Finally, network analyses represent a data-driven approach allowing the investigation of the complex relationships of psychosis liability expressions and processes, including not only risk factors but also protective factors. Future studies should incorporate different scale levels of observation, like environmental and genetic variables, into network models.
Data Availability Statement
The datasets generated for this study are available on request to the corresponding author.
Ethics Statement
The research was approved by the Educational Government of La Rioja and the Ethical Committee of Clinical Research of La Rioja (CEICLAR). For participants under 18, parents were asked to provide a written informed consent in order for their child to participate in the study. Participants were informed of the confidentiality of their responses and of the voluntary nature of the study.
Author Contributions
EF-P designed the research and contributed with data analysis, and text writing. JO-S contributed with data analysis and text writing. FI contributed with text writing. JR-T contributed with text writing and helped in the design of the research. MD contributed with data analysis and text writing.
Funding
EF-P was supported by la Convocatoria 2015 de “Ayudas Fundación BBVA a Investigadores y Creadores Culturales”, by “Ayudas Fundación BBVA a equipos de investigación científica 2017”, and FEDER La Rioja 2014-2020 (SRS 6FRSABC026). MD was supported by a grant from the Swiss National Science Foundation (100019_159440).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2019.00967/full#supplementary-material
References
- 1. Fusar-Poli P, Carpenter WT, Woods SW, McGlashan TH. Attenuated Psychosis syndrome: ready for DSM-5.1? Annu Rev Clin Psychol (2014) 10:155–92. 10.1146/annurevclinpsy-032813-153645 [DOI] [PubMed] [Google Scholar]
- 2. Lenzenweger MF. Schizotypy and schizophrenia: The view from experimental psychopathology. New York: Guilford Press; (2010). [Google Scholar]
- 3. Fusar-Poli P, McGorry P, Kane J. Improving outcomes of first-episode psychosis: an overview. World Psychiatry (2017) 16:251–65. 10.1002/wps.20446 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. McGorry P, Johanessen JO, Lewis S, Birchwood M, Malla A, Nordentoft M, et al. Early intervention in psychosis: keeping faith with evidence-based health care. Psychol Med (2010) 40:399–404. 10.1017/S0033291709991346 [DOI] [PubMed] [Google Scholar]
- 5. McGorry PD, Ratheesh A, O’Donoghue B. Early intervention—an implementation challenge for 21st century mental health care. JAMA Psychiatry (2018) 75:545–6. 10.1001/jamapsychiatry.2018.0621 [DOI] [PubMed] [Google Scholar]
- 6. van Os J, Guloksuz S. A critique of the “ultra-high risk” and “transition” paradigm. World Psychiatry (2017) 16:200–6. 10.1002/wps.20423 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. van Os J, Reininghaus U. Psychosis as a transdiagnostic and extended phenotype in the general population. World Psychiatry (2016) 15:118–24. 10.1002/wps.20310 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Meehl PE. Schizotaxia, schizotypy, schizophrenia. Am Psychol (1962) 17:827–38. 10.1037/h0041029 [DOI] [Google Scholar]
- 9. Lenzenweger MF. Thinking clearly about schizotypy: hewing to the schizophrenia liability core, considering interesting tangents, and avoiding conceptual quicksand. Schizophr Bull (2015) 41:Suppl 2:S483–491. 10.1093/schbul/sbu184 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Debbané M, Eliez S, Badoud D, Conus P, Flückiger R, Schultze-Lutter F. Developing psychosis and its risk states through the lens of schizotypy. Schizophr Bull (2015) 41:S396–407. 10.1093/schbul/sbu176 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Barrantes-Vidal N, Grant P, Kwapil T. The role of schizotypy in the study of the etiology of schizophrenia spectrum disorders. Schizophr Bull (2015) 41:S408–416. 10.1093/schbul/sbu191 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Linscott RJ, van Os J. An updated and conservative systematic review and meta-analysis of epidemiological evidence on psychotic experiences in children and adults: on the pathway from proneness to persistence to dimensional expression across mental disorders. Psychol Med (2013) 43:1133–49. 10.1017/S0033291712001626 [DOI] [PubMed] [Google Scholar]
- 13. Radua J, Ramella-Cravaro V, Ioannidis JPA, Reichenberg A, Phiphopthatsanee N, Amir T, et al. What causes psychosis? An umbrella review of risk and protective factors. World Psychiatry (2018) 17:49–66. 10.1002/wps.20490 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Fonseca-Pedrero E, Debbané M, Ortuño-Sierra J, Chan RCK, Cicero DC, Zhang LC, et al. The structure of schizotypal personality traits: a cross-national study. Psychol Med (2017) 48(3):451–62. 10.1017/S0033291717001829 [DOI] [PubMed] [Google Scholar]
- 15. Fonseca-Pedrero E, Ortuño-Sierra J, Lucas-Molina B, Debbané M, Chan RCK, Cicero DC, et al. Brief assessment of schizotypal traits: a multinational study. Schizophr Res (2017) 197:182–91. 10.1016/j.schres.2017.10.043 [DOI] [PubMed] [Google Scholar]
- 16. Fonseca Pedrero E, Debbané M. Schizotypal traits and psychotic-like experiences during adolescence: an update. Psicothema (2017) 29:5–17. 10.7334/psicothema2016.209 [DOI] [PubMed] [Google Scholar]
- 17. McGorry P, van Os J. Redeeming diagnosis in psychiatry: Timing versus specifi city. Lancet (2013) 381:343–5. 10.1016/S0140-6736(12)61268-9 [DOI] [PubMed] [Google Scholar]
- 18. Fumero A, Marrero RJ, Fonseca-Pedrero E. Well-being in schizotypy: The effect of subclinical psychotic experiences. Psicothema (2018) 30(2):177–82. 10.7334/psicothema2017.100 [DOI] [PubMed] [Google Scholar]
- 19. Christensen AP, Kenett YN, Aste T, Silvia PJ, Kwapil TR. Network structure of the Wisconsin Schizotypy Scales–Short Forms: Examining psychometric network filtering approaches. Behav Res Methods (2018) 50(6):2531–50. 10.3758/s13428-018-1032-9 [DOI] [PubMed] [Google Scholar]
- 20. Fonseca-Pedrero E. Análisis de redes en psicología [network analysis in psychology]. Papeles del Psicólogo (2018) 39:1–12. 10.23923/pap.psicol2018.2852 [DOI] [Google Scholar]
- 21. Borsboom D, Cramer AO. Network analysis: an integrative approach to the structure of psychopathology. Annu Rev Clin Psychol (2013) 9:91–121. 10.1146/annurev-clinpsy-050212-185608 [DOI] [PubMed] [Google Scholar]
- 22. Borsboom D. A network theory of mental disorders. World Psychiatry (2017) 16:5–13. 10.1002/wps.20375 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Fried EI, van Borkulo CD, Cramer AOJ, Boschloo L, Schoevers RA, Borsboom D. Mental disorders as networks of problems: a review of recent insights. Soc Psychiatry Psychiatr Epidemiol (2016) 58:7250–7. 10.1007/s00127-016-1319-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Nelson B, McGorry PD, Wichers M, Wigman JTW, Hartmann JA. Moving from static to dynamic models of the onset of mental disorder. JAMA Psychiatry (2017) 75(5):528–34. 10.1001/jamapsychiatry.2017.0001 [DOI] [PubMed] [Google Scholar]
- 25. McNally RJ, Robinaugh DJ, Wu GWY, Wang L, Deserno MK, Borsboom D, et al. Mental disorders as causal systems: a network approach to posttraumatic stress disorder. Clin Psychol Sci (2014) 3:1–14. 10.1177/2167702614553230 [DOI] [Google Scholar]
- 26. Fried EI. Problematic assumptions have slowed down depression research: why symptoms, not syndromes are the way forward. Front Psychol (2015) 6:309. 10.3389/fpsyg.2015.00309 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Schmittmann VD, Cramer AOJ, Waldorp LJ, Epskamp S, Kievit RA, Borsboom D. Deconstructing the construct: a network perspective on psychological phenomena. New Ideas Psychol (2013) 31:43–53. 10.1016/j.newideapsych.2011.02.007 [DOI] [Google Scholar]
- 28. Mõttus R, Allerhand M. The underlying trait and network approaches. In: Zeigler-Hill V, Shackelford T, editors. SAGE handbook of personality and individual differences: Volume 1. The science of personality and individual differences. SAGE: London: (2018) p. 1–22. [Google Scholar]
- 29. Fonseca-Pedrero E. Análisis de redes: ¿una nueva forma de comprender la psicopatología? Rev Psiquiatr Salud Ment (2017) 10:206–15. 10.1016/j.rpsm.2017.06.004 [DOI] [PubMed] [Google Scholar]
- 30. van Os J, Linscott RJ. Introduction: the extended psychosis phenotype - relationship with schizophrenia and with ultrahigh risk status for psychosis. Schizophr Bull (2012) 38:227–30. 10.1093/schbul/sbr188 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Looijestijn J, Blom JD, Aleman A, Hoek HW, Goekoop R. An integrated network model of psychotic symptoms. Neurosci Biobehav Rev (2015) 59:238–50. 10.1016/j.neubiorev.2015.09.016 [DOI] [PubMed] [Google Scholar]
- 32. Copeland W, Shanahan L, Costello EJ, Angold A. Cumulative prevalence of psychiatric disorders by young adulthood: a prospective cohort analysis from the Great Smoky Mountains Study. J Am Acad Child Adolesc Psychiatry (2011) 50:252–61. 10.1016/j.jaac.2010.12.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Copeland WE, Adair CE, Smetanin P, Stiff D, Briante C, Colman I, et al. Diagnostic transitions from childhood to adolescence to early adulthood. J Child Psychol Psychiatry Allied Discip (2013) 54(7):791–9. 10.1111/jcpp.12062 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Fonseca-Pedrero E, Muñiz J, Lemos-Giráldez S, Paino M, Villazón-García U. ESQUIZO-Q: Cuestionario Oviedo para la Evaluación de la Esquizotipia [ESQUIZO-Q: Oviedo Questionnaire for Schizotypy Assessment]. TEA ediciones: Madrid: (2010). [Google Scholar]
- 35. Cummins RA, Lau ALD. Personal Wellbeing Index – School Children, 3rd Edition Melbourne: Deakin University: (2005). [Google Scholar]
- 36. Fonseca-Pedrero E. Bienestar emocional en adolescentes riojanos [Personal wellbeing in adolescents from La Rioja]. La Rioja: Universidad de La Rioja; (2017). [Google Scholar]
- 37. Paykel ES, Myers JK, Lindenthal JJ, Tanner J. Suicidal feelings in the general population: a prevalence study. Br J Psychiatry (1974) 214:460–9. 10.1192/bjp.124.5.460 [DOI] [PubMed] [Google Scholar]
- 38. Bousoño M, Al-Halabí S, Burón P, Garrido M, Díaz-Mesa EM, Galván G, et al. Uso y abuso de sustancias psicotrópicas e internet, psicopatología e ideación suicida en adolescentes. Adicciones (2017) 29:97–104. 10.20882/adicciones.811 [DOI] [PubMed] [Google Scholar]
- 39. Fonseca-Pedrero E, Inchausti F, Pérez L, Aritio A, Ortuño-Sierra J, Sánchez-García A, et al. Ideación suicida en una muestra representativa de adolescentes españoles. Rev Psiquiatr Salud Ment (2017) 11(2):76–85. 10.1016/j.rpsm.2017.07.004 [DOI] [PubMed] [Google Scholar]
- 40. Hirschfeld RM, Williams JB, Spitzer RL, Calabrese JR, Flynn L, Keck PEJ, et al. Development and validation of a screening instrument for bipolar spectrum disorder: the mood disorder questionnaire. Am J Psychiatry (2000) 157:1873–5. 10.1176/appi.ajp.157.11.1873 [DOI] [PubMed] [Google Scholar]
- 41. Fonseca-Pedrero E, Ortuno-Sierra J, Paino M, Muniz J. Screening the risk of bipolar spectrum disorders: validity evidence of the mood disorder questionnaire in adolescents and young adults. Rev Psiquiatr Salud Ment (2016) 9:4–12. 10.1016/j.rpsm.2015.04.003 [DOI] [PubMed] [Google Scholar]
- 42. Goodman R. The strengths and difficuties questionnaire: a research note. J Child Psychol Psychiatry (1997) 38:581–6. 10.1111/j.1469-7610.1997.tb01545.x [DOI] [PubMed] [Google Scholar]
- 43. Ortuño-Sierra J, Chocarro E, Fonseca-Pedrero E, Riba SSI, Muñiz J. The assessment of emotional and behavioural problems: internal structure of the strengths and difficulties questionnaire. Int J Clin Heal Psychol (2015) 15:265–73. 10.1016/j.ijchp.2015.05.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Loewy RL, Pearson R, Vinogradov S, Bearden CE, Cannon TD. Psychosis risk screening with the prodromal questionnaire–brief version (PQ-B). Schizophr Res (2011) 129:42–6. 10.1016/j.schres.2011.03.029 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Fonseca-Pedrero E, Gooding DC, Ortuño-Sierra J, Paino M. Assessing self-reported clinical high risk symptoms in community-derived adolescents: a psychometric evaluation of the prodromal questionnaire-brief. Compr Psychiatry (2016) 66:201–8. 10.1016/j.comppsych.2016.01.013 [DOI] [PubMed] [Google Scholar]
- 46. Ebesutani C, Regan J, Smith A, Reise S, Higa-Mcmillan C, Chorpita BF. The 10-item positive and negative affect schedule for children, child and parent shortened versions: application of item response theory for more efficient assessment. J Psychopathol Behav Assess (2012) 34:191–203. 10.1007/s10862-011-9273-2 [DOI] [Google Scholar]
- 47. Ortuño-Sierra J, Santarén-Rosell M, de Albéniz AP, Fonseca-Pedrero E. Dimensional structure of the Spanish version of the positive and negative affect schedule (PANAS) in adolescents and young adults. Psychol Assess (2015) 27(3): e1–9. 10.1037/pas0000107 [DOI] [PubMed] [Google Scholar]
- 48. Moore TM, Reise SP, Gur RE, Hakonarson H, Gur RC. Psychometric properties of the penn computerized neurocognitive battery. Neuropsychology (2015) 29:235–46. 10.1037/neu0000093 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49. Gur RC, Richard J, Calkins ME, Chiavacci R, Hansen JA, Bilker WB, et al. Age group and sex differences in performance on a computerized neurocognitive battery in children age 8-21. Neuropsychology (2012) 26:251–65. 10.1037/a0026712 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50. Fonseca-Pedrero E, Lemos-Giráldez S, Paino M, Villazón-García U, Muñiz J. Validation of the schizotypal personality questionnaire brief form in adolescents. Schizophr Res (2009) 111:53–60 10.1016/j.schres.2009.03.006 [DOI] [PubMed] [Google Scholar]
- 51. Epskamp S, Cramer AOJ, Waldorp LJ, Schmittmann VD, Borsboom D. qgraph: network visualizations of relationships in psychometric data. J Stat Softw (2012) 48:1–18. 10.18637/jss.v048.i04 [DOI] [Google Scholar]
- 52. Epskamp S, Kruis J, Marsman M. Estimating psychopathological networks: be careful what you wish for. PLoS One (2017) 23;12(6):e0179891. 10.1371/journal.pone.0179891 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53. Epskamp S, Fried E. A tutorial on regularized partial correlation networks. Psychol Methods (2018) 23:617–34. 10.1037/met0000167 [DOI] [PubMed] [Google Scholar]
- 54. Fonseca-Pedrero E, Ortuño J, Debbané M, Chan RCK, Cicero D, Zhang LC, et al. The network structure of schizotypal personality traits. Schizophr Bull (2018) 44:S468–79. 10.1093/schbul/sby044 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55. Robinaugh DJ, Millner AJ, McNally RJ. Identifying highly influential nodes in the complicated grief network. J Abnorm Psychol (2016) 125:747–57. 10.1037/abn0000181 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56. Opsahl T, Agneessens F, Skvoretz J. Node centrality in weighted networks: generalizing degree and shortest paths. Soc Networks (2010) 50(1):195–212. 10.1016/j.socnet.2010.03.006 [DOI] [Google Scholar]
- 57. Haslbeck JMB, Fried EI. How predictable are symptoms in psychopathological networks? A reanalysis of 17 published datasets. Psychol Med (2017) 47:2767–76. 10.1017/S0033291717001258. [DOI] [PubMed] [Google Scholar]
- 58. Epskamp S, Borsboom D, Fried EI. Estimating psychological networks and their accuracy: a tutorial paper. Behav Res Methods (2018) 50(1):195–212. 10.3758/s13428-017-0862-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59. IBM Corp Released IBM SPSS Statistics for Windows, Version 22.0. IBM Corp: Armonk, NY: (2013). [Google Scholar]
- 60. R Core Team R: a language and environment for statistical computing. Viena, Austria: (2016). [Google Scholar]
- 61. Ferrando PJ, Lorenzo-seva U. Program FACTOR at 10: origins, development and future directions. Psicothema (2017) 29:236–40. 10.7334/psicothema2016.304 [DOI] [PubMed] [Google Scholar]
- 62. Christensen A, Gross G, Golino H, Silvia P, Kwapil T. Exploratory Graph Analysis of the Multidimensional Schizotypy Scale. Schizophr Res (2018) 206:43–51. 10.1016/j.schres.2018.12.018 [DOI] [PubMed] [Google Scholar]
- 63. Dodell-Feder D, Saxena A, Rutter L, Germine L. The network structure of schizotypal personality traits in a population-based sample. Schizophr Res (2019) 208:258–67. 10.1016/j.schres.2019.01.046 [DOI] [PubMed] [Google Scholar]
- 64. Wüsten C, Schlier B, Jaya ES, Fonseca-Pedrero E, Peters E, Verdoux H, et al. Psychotic experiences and related distress: a cross-national comparison and network analysis based on 7141 participants from 13 countries. Schizophr Bull (2018) 44:1185–94. 10.1093/schbul/sby087 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65. Murphy J, McBride O, Fried E, Shevlin M. Distress, impairment and the extended psychosis phenotype: a network analysis of psychotic experiences in a US general population sample. Schizophr Bull (2017) 44(4):768–77. 10.1093/schbul/sbx134 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66. Raine A. The SPQ: a scale for the assessment of schizotypal personality based on DSM-III-R criteria. Schizophr Bull (1991) 17:555–64. [DOI] [PubMed] [Google Scholar]
- 67. Dominguez MD, Saka MC, Lieb R, Wittchen HU, van Os J. Early expression of negative/disorganized symptoms predicting psychotic experiences and subsequent clinical psychosis: a 10-year study. Am J Psychiatry (2010) 167:1075–82. [DOI] [PubMed] [Google Scholar]
- 68. Krabbendam L, Myin-Germeys I, Hanssen M, Bijl RV, de Graaf R, Vollebergh W, et al. Hallucinatory experiences and onset of psychotic disorder: evidence that the risk is mediated by delusion formation. Acta Psychiatr Scand (2004) 110:264–72 Available at :l.krabbendam@sp.unimaas.nl. [DOI] [PubMed] [Google Scholar]
- 69. Kelleher I, Corcoran P, Keeley H, Wigman JT, Devlin N, Ramsay H, et al. Psychotic symptoms and population risk for suicide attempt: a prospective cohort study. JAMA Psychiatry (2013) 70:940–8. 10.1001/jamapsychiatry.2013.140 [DOI] [PubMed] [Google Scholar]
- 70. Schimanski ID, Mouat KL, Billinghurst BL, Linscott RJ. Preliminary evidence that schizophrenia liability at age 15 predicts suicidal ideation two years later. Schizophr Res (2017) 181:60–2. 10.1016/j.schres.2016.08.030 [DOI] [PubMed] [Google Scholar]
- 71. Zhang R, Zhou H, Wang Y, Yang Z, Wang Y, So S, et al. Network analysis of schizotypal personality traits and their association with other subclinical psychiatric features. Asian J Psychiatr (2019) 44:209–2016. 10.1016/j.ajp.2019.08.005 [DOI] [PubMed] [Google Scholar]
- 72. Kahn RS, Keefe RS. Schizophrenia is a cognitive illness: time for a change in focus. JAMA Psychiatry (2013) 70:1012–107. 10.1001/jamapsychiatry.2013.155 [DOI] [PubMed] [Google Scholar]
- 73. Fusar-Poli P, Deste G, Smieskova R, Barlati S, Yung AR, Howes O, et al. Cognitive functioning in prodromal psychosis: a meta-analysis. Arch Gen Psychiatry (2012) 69:562–71. 10.1001/archgenpsychiatry.2011.1592 [DOI] [PubMed] [Google Scholar]
- 74. Sheffield JM, Karcher NR, Barch DM. Cognitive deficits in psychotic disorders: a lifespan perspective. Neuropsychol Rev (2018) 28(4):509–33. 10.1007/s11065-018-9388-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75. van Os J, Linscott RJ, Myin-Germeys I, Delespaul P, Krabbendam L. A systematic review and meta-analysis of the psychosis continuum: evidence for a psychosis proneness-persistence-impairment model of psychotic disorder. Psychol Med (2009) 39:179–95. 10.1017/S0033291708003814 [DOI] [PubMed] [Google Scholar]
- 76. Isvoranu A-M, Borsboom D, van Os J, Guloksuz S. A network approach to environmental impact in psychotic disorder: brief theoretical framework. Schizophr Bull (2016) 42:870–3. 10.1093/schbul/sbw049 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77. Jones PJ, Mair P, McNally RJ. Visualizing psychological networks: a tutorial in R. Front Psychol (2018) 9:1742. 10.3389/fpsyg.2018.01742 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78. Haslbeck J. Mgm: estimating time-varying k-order mixed graphical models. https://www.jstatsoft.org/index (2019). [Google Scholar]
- 79. Guloksuz S, Pries L-K, van Os J. Application of network methods for understanding mental disorders: pitfalls and promise. Psychol Med (2017), 1–10. 10.1017/S0033291717001350 [DOI] [PubMed] [Google Scholar]
- 80. Hoffman M, Steinley D, Trull TJ, Lane SP, Wood PK, Sher KJ. The influence of sample selection on the structure of psychopathology symptom networks: an example with alcohol use disorder. J Abnorm Psychol (2019) 128(5):473–86. 10.1037/abn0000438 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets generated for this study are available on request to the corresponding author.