Skip to main content
Frontiers in Psychology logoLink to Frontiers in Psychology
. 2019 Nov 1;10:2448. doi: 10.3389/fpsyg.2019.02448

The Differential Role of Central and Bridge Symptoms in Deactivating Psychopathological Networks

Daniel Castro 1,2, Filipa Ferreira 1,2, Inês de Castro 1, Ana Rita Rodrigues 1,2, Marta Correia 1, Josefina Ribeiro 1, Tiago Bento Ferreira 1,2,*
PMCID: PMC6849493  PMID: 31827450

Abstract

The network model of psychopathology suggests that central and bridge symptoms represent promising treatment targets because they may accelerate the deactivation of the network of interactions between the symptoms of mental disorders. However, the evidence confirming this hypothesis is scarce. This study re-analyzed a convenience sample of 51 cross-sectional psychopathological networks published in previous studies addressing diverse mental disorders or clinically relevant problems. In order to address the hypothesis that central and bridge symptoms are valuable treatment targets, this study simulated five distinct attack conditions on the psychopathological networks by deactivating symptoms based on two characteristics of central symptoms (degree and strength), two characteristics of bridge symptoms (overlap and bridgeness), and at random. The differential impact of the characteristics of these symptoms was assessed in terms of the magnitude and the extent of the attack required to achieve a maximum impact on the number of components, average path length, and connectivity. Only moderate evidence was obtained to sustain the hypothesis that central and bridge symptoms constitute preferential treatment targets. The results suggest that the degree, strength, and bridgeness attack conditions are more effective than the random attack condition only in increasing the number of components of the psychopathological networks. The degree attack condition seemed to perform better than the strength, bridgeness, and overlap attack conditions. Overlapping symptoms evidenced limited impact on the psychopathological networks. The need to address the basic mechanisms underlying the structure and dynamics of psychopathological networks through the expansion of the current methodological framework and its consolidation in more robust theories is stressed.

Keywords: vulnerability, central symptoms, bridge symptoms, psychopathology, network analysis

Introduction

Traditional models of psychopathology (e.g., categorical and dimensional) continue to display a vast array of limitations, including a lack of explanation for high rates of comorbidity (Kessler et al., 2005; Goldberg, 2015) and the diversity of clinical presentations (Boschloo et al., 2015; Nuijten et al., 2016). They have also been unable to explain the direct interactions between symptoms (Cramer and Borsboom, 2015) and offer poor support for the identification of etiopathogenic mechanisms and biomarkers of mental disorders (Fried and Nesse, 2015). In recent years, the network theory of mental disorders (Cramer et al., 2010; Borsboom and Cramer, 2013; Borsboom, 2017; Borsboom et al., 2019) has received increased attention as an alternative model that may overcome such persistent limitations. Instead of assuming that symptoms are the effects and measures of a latent dimension (psychological, genetic, neurophysiological, or otherwise) at the origin of mental disorders, this perspective theorizes that mental disorders emerge from a complex network of causal interactions between symptoms (Cramer et al., 2010; Hofmann et al., 2016; Borsboom et al., 2019). Figure 1A presents a typical illustration of these psychopathological networks. In it, the nodes (circles) represent symptoms and the edges (lines) connecting the nodes represent the multiple interactions that constitute the causal structure that is the origin of mental disorders (see Epskamp and Fried, 2018 for a brief discussion on the issue of causality in psychopathological networks). On this basis, it is hypothesized (Borsboom, 2017), and current evidence supports this hypothesis (Cramer et al., 2016), that in an asymptomatic state, this structure remains inactive, but as some symptoms are activated, for example by external events, this generates a cascading effect that spreads through the network, activating the other symptoms to which they are connected. As symptom activation spreads following the paths defined by the structure of interactions between symptoms, the symptoms become increasingly connected until the system transitions into a disease state in which the strongly connected network of symptoms sustains itself, even in the absence of the original activating event (Cramer et al., 2016).

FIGURE 1.

FIGURE 1

Illustrative example of network attack. Symptom networks are usually represented in a graph comprised of nodes representing symptoms (blue circles in A–C) and edges representing the interactions between symptoms (gray lines in A–C; line width represents the strength of the interaction). The complete graph represents the causal structure of the interactions between the symptoms. Its exploration provides information regarding the centrality of diverse symptoms (e.g., the number of interactions with other symptoms), as well as the network characteristics (e.g., the number of symptoms, or groups of symptoms, disconnected from the remainder). (A) Represents the original psychopathological network. Under attack, the symptoms (nodes) were sequentially removed, one at a time, in the decreasing order of two centrality measures – (1) degree and (2) strength – and two bridging measures – (3) bridgeness and (4) overlap. (B,C) Represent the evolution of the initial network as symptoms are removed. At each point, network characteristics were measured (average path length, number of components, connectivity, and diameter). The evolution of these measures throughout the attack is represented in (D). The blue rectangles signal the moments to which the networks represented in (A–C) correspond. Finally, the attack extent and the magnitude of its impact were measured considering the number of symptoms that had to be removed to achieve peak average path length, number of components, connectivity, and diameter, as well as the difference between peak and initial values.

This perspective changes the focus from the syndromatic boundaries of mental disorders or their shared causes to the intricate interplay between symptoms. Inspection of the network of interactions between symptoms has resulted in new understandings of the nosography and comorbidity structures of different mental disorders such as, for example, depression and anxiety (Beard et al., 2016), complex post-traumatic stress disorder (Knefel et al., 2019), or borderline personality disorder and bipolar disorder (Castro et al., 2018). To a significant extent, these advances have been made via the identification of central and bridge symptoms (e.g., Robinaugh et al., 2014; Bekhuis et al., 2016; Knefel et al., 2016; Borsboom, 2017; Levinson et al., 2017; Marcus et al., 2018; Smith et al., 2018).

Central and Bridge Symptoms

Central symptoms are defined and identified through a set of centrality measures, namely degree, strength, closeness, and betweenness (Opsahl et al., 2010). Degree centrality corresponds to the number of connections a symptom has with the other symptoms in a network and strength to the sum of the absolute weights of these connections (Fried et al., 2017; Epskamp et al., 2018a). Closeness refers to the average proximity of a given symptom to all other symptoms, and betweenness measures the number of times a symptom is on the shortest path between two other symptoms (Epskamp et al., 2018a). However, recent research has concluded that closeness and betweenness may be affected by sampling variability and spurious covariance between symptoms (Hallquist et al., 2019) and are not always adequately stable (Epskamp et al., 2018a). It was also concluded that strength centrality might signal the association of a symptom with a latent variable instead of its role in the network (Hallquist et al., 2019). Moreover, the theoretical foundation for centrality measures in psychopathological networks is still limited (Bringmann et al., 2018). This constrains the meaningful interpretation of high-scoring symptoms in these measures, and the determination of central symptoms remains mostly restricted to those identified via degree or strength centralities.

In turn, bridge symptoms are broadly defined as symptoms that connect different clusters of symptoms corresponding to different mental disorders or subgroups of symptoms within the same mental disorder. In the early stages of the field, Cramer et al. (2010) defined bridge symptoms as those symptoms that overlap perfectly between mental disorders, meaning that bridge symptoms are those that belong to the diagnostic criteria of distinct disorders. For example, fatigue belongs to the diagnostic criteria of major depression disorder and generalized anxiety disorder (American Psychiatric Association [APA], 2013) and should therefore constitute a bridge symptom between these two disorders. Although this initial formulation, as well as subsequent studies that have utilized it Borsboom et al. (2011) and Afzali M. et al. (2017), continue to be generative, other conceptualizations of bridge symptoms have emerged. Some authors have defined bridge symptoms as those that connect different disorders, regardless of any overlap between them (e.g., Robinaugh et al., 2014; Levinson et al., 2017; McNally R. J. et al., 2017; Marcus et al., 2018; Smith et al., 2018). For example, Levinson et al. (2017) suggested that symptoms related to physical sensations might constitute the bridge symptoms between bulimia and anxiety because they are the symptoms of anxiety that are connected to the symptoms of bulimia. These different conceptualizations imply two different kinds of bridge symptoms: (1) those that belong to two or more mental disorders (overlapping symptoms), and (2) those that belong to just one disorder, or alternatively are not specific symptoms of a disorder, but nevertheless still play an important role in connecting different disorders (bridging symptoms). Significantly, the conceptual distinction between overlapping and bridging symptoms has a correspondence in the alternative methodological approaches that have addressed the problem of identifying bridge symptoms. Advances in the identification of bridge symptoms have been achieved by exploring the concept of network communities or modules (e.g., McNally R. J. et al., 2017). Network modules (Fortunato, 2010; Fortunato and Hric, 2016) are sets of symptoms that tend to interact more strongly and therefore exert a greater influence on each other than on the rest of the symptoms in the network. In psychopathological networks, these modules correspond to a mental disorder or to subgroups of symptoms within the same disorder. Jones et al. (2018) proposed a set of measures of the bridge centrality of symptoms that were specifically designed to detect and quantify interacting symptoms between modules. They found that deactivating symptoms based on their bridge strength was more effective for preventing symptom activation from spreading than deactivating symptoms based on their strength or betweenness. This provides evidence in support of the theoretical proposal that bridge symptoms are implicated in the emergence of comorbidity structures between mental disorders (Cramer et al., 2010). By assuming that modules do not overlap, this method implies a concept of bridge symptoms that is closer to that of bridging symptoms. To date, studies characterizing the modular structure of psychopathological networks have mostly followed this perspective, as they typically involve module-detection algorithms (for example, walktrapp Price et al., 2019; spin-glass Birkeland and Heir, 2017) that result in non-overlapping modules. Blanken et al. (2018) have assumed an alternative perspective in exploring the usefulness of the Clique Percolation Method (CPM; Palla et al., 2005; Adamcsek et al., 2006) to detect overlapping modules in psychopathological networks. In the CPM, modules may share overlapping symptoms, which means that one symptom can belong simultaneously to more than one module (Blanken et al., 2018), and therefore it endorses a concept of bridge symptoms that coincides with that of overlapping symptoms. On this basis, Blanken et al. (2018) illustrated how the symptoms that communicate between different modules may explain the diversity of possible pathways resulting in the clinical heterogeneity of mental disorders.

Although differences between these two conceptualizations are not always apparent, preliminary evidence suggests that these types of bridge symptoms may perform different functions on psychopathological networks. In a previous study (Castro et al., 2018) on the modularity of the network of bipolar and borderline personality disorders, an alternative algorithm – ModuLand (Kovács et al., 2010) – was used to explore the comorbidity structure of these mental disorders and differentiate the functions of symptoms in that structure. ModuLand also allows the modules to overlap and computes two different measures – modular overlap and modular bridgeness – each of which enables the identification of different types of bridge symptoms. Akin to the proposal of Jones et al. (2018), modular bridgeness focuses on the inter-modular role of symptoms and provides the effective number of modules to which a symptom is connected (Szalay-Beko et al., 2012). In parallel with the proposal of Blanken et al. (2018), modular overlap focuses on the trans-modular role of symptoms and specifies the overlap of a given symptom between two or more modules relative to all other symptoms (Szalay-Beko et al., 2012). In that study, Castro et al. (2018) found a moderate correlation between the strength centrality and modular bridgeness of symptoms but not between strength centrality and modular overlap. This suggests that the distinction between bridging and overlapping symptoms may increase the conceptual clarity of the construct of bridge symptoms and stimulate further theoretical refinement of the network theory of mental disorders.

Despite these initial observations and the potential pathways that they open up for the further development of the network theory on mental disorders, more studies are needed that compare both types of bridge symptoms. In this regard, an integrated framework that provides a coherent rationale for the identification of both types of bridge symptoms is still required. Without it, the theoretical potential of this construct will remain limited. In order to contribute to consolidating an integrated methodological framework for the measurement of bridge symptoms, this study further explores the ModuLand algorithm (Kovács et al., 2010). Kovács et al. (2010) found Moduland to be robust in characterizing the modular network structure over a number of benchmark networks representing different phenomena (social, biological, semantic) and to be more sensitive and also provide more detailed functional specificity than CPM.

Central and Bridge Symptoms as Psychotherapeutic Targets

As mentioned, central and bridge symptoms play an important part in the analysis of psychopathological networks and are, on the basis of some of the most promising hypotheses, pertinent to treatments of mental disorders that are currently emerging within the field. From the network theory perspective, treatments of mental disorders exert some influence on the network of interactions between symptoms by deactivating symptoms, inhibiting their interactions, or removing external events that trigger activation cascades (see Borsboom, 2017; Isvoranu et al., 2018). Irrespective of the pathway through which treatments exert their influence, psychopathological networks, as they unfold, are expected to follow a trajectory similar to the one depicted in Figures 1A–C. As represented in those figures, inhibition of the interactions between symptoms should be associated with a general decrease in the connectivity of the network (number of interactions present in the network) due to the decrease in the number of active interactions. Similarly, symptom deactivation should also contribute to this decrease, since it also deactivates the interactions in which symptoms are involved. As network connections become sparser, the number of interactions needed to connect the symptoms that remain active is expected to increase (i.e., the pathways between them become longer). Finally, the decrease in network connectivity and the increase in the length of the pathways between symptoms should cause some symptoms to become isolated, and it should therefore be accompanied by an increase in the number of disconnected components. In addition to being theoretically coherent, this proposal is also consistent with routine clinical observations since recovered patients, by definition, report a minimal number of mild residual symptoms to no symptoms at all. It is therefore surprising that studies comparing the connectivity of psychopathological networks at treatment admission and discharge or follow-up have provided mixed evidence for a decrease in the connectivity of the network. Some studies revealed a pattern of network transformation consistent with the one described above, with decreased connectivity at discharge (and, in some samples, isolated symptoms; Snippe et al., 2017), but no statistically significant differences compared to admission (Snippe et al., 2017) and placebo or wait-list control groups (Snippe et al., 2017) were found. A previous study also found higher connectivity in a group of poor-responders to treatment but no statistically significant difference compared to a group of good-responders (Schweren et al., 2018). In addition, other studies observed an increase in connectivity from admission to discharge (Beard et al., 2016; Bos et al., 2018). These studies have proposed a number of possible explanations (see also Fried E. I. et al., 2016) related, for example, to the persistence of an underlying vulnerability to the development of mental disorders associated with network connectivity even after symptoms decrease (Snippe et al., 2017), naturalistic versus controlled (Schweren et al., 2018) or within- versus between-subject (Bos et al., 2018) designs, and response bias arising from the repeated administration of symptom measures and changes in the interpretation of the items in the measure as treatment unfolds (Fried E. I. et al., 2016; Bos et al., 2018). Additionally, some of the previous studies (Beard et al., 2016; Snippe et al., 2017; Bos et al., 2018) are based on complete samples at discharge. These samples are likely to include participants who did not respond to treatment, other participants who responded to treatment but did not recover, participants who deteriorated, and also participants who recovered across treatment. Other studies (Schweren et al., 2018) are based on participants who responded to treatment but for whom it is unclear that they have recovered. Consequently, in some of these studies, post-treatment samples displayed average symptom severity within the clinically relevant realm (Beard et al., 2016; Snippe et al., 2017; Bos et al., 2018; Kraft et al., 2019) or minimal change in relation to admission (Kraft et al., 2019), and studies analyzing clearly recovered participants are still lacking. The lack of a distinction between different therapeutic trajectories may contribute to explain the observation that despite no statistically significant differences being found in network connectivity from pre- to post-treatment, participants whose networks display higher connectivity at admission also display a poorer response to treatment (Smith et al., 2019). It is also increasingly recognized that these studies pose significant challenges (see Terluin et al., 2016). Reports from recovered participants will necessarily be highly skewed and display a restriction of range that affects both network estimation due to deviations from normality (Epskamp et al., 2018a) and comparison due to the impact of differential variance on the network connectivity (Terluin et al., 2016). Although the precise impacts of these (and other) possible explanations remain to be further clarified, it has been recognized that exploration of the assumption that higher connectivity characterizes psychopathological states is warranted (Schweren et al., 2018) and consistent with existing evidence (Snippe et al., 2017), suggesting that it is in fact associated with a transition to a psychopathological state (Cramer et al., 2016). Also, in natural settings, it has been observed that higher connectivity of cross-sectional psychopathological networks is associated with symptom persistence (compared to remittance; van Borkulo et al., 2015; van Rooijen et al., 2018) and that this connectivity is higher in clinical populations than in healthy populations (Santos et al., 2017; Stone et al., 2017), as well as differing between individuals diagnosed with a mental disorder but displaying distinct clinical presentations (DuBois et al., 2017) and course types (Koenders et al., 2015). The analysis of the global connectivity of longitudinal dynamic networks has produced mixed results. Two studies concluded that the networks of individuals diagnosed with mental disorders displayed higher connectivity (Pe et al., 2015; Wichers et al., 2016), but these results may be dependent on the methodological options during data pre-processing and network estimation (de Vos et al., 2017). Another study (Groen et al., 2019) did not observe differences in the connectivity of the dynamic networks of individuals with persisting symptoms compared to individuals displaying symptom remission. However, in this study (Groen et al., 2019), differences between those groups were observed in the structure of interactions between symptoms (network topological structure), suggesting that the role of specific symptoms may be relevant beyond the global connectivity of the network. This is consistent with the results of other studies that observed changes in the network structure but not in its global connectivity after a brief intervention in remitted symptoms (Kraft et al., 2019) and underlined that treatments impact some specific symptoms (Blanken et al., 2019; Mullarkey et al., 2019). Similar results were obtained when comparing healthy individuals or community-based samples with individuals diagnosed with mental disorders or other medical conditions, both on dynamic (Curtiss et al., 2019) and cross-sectional (Hartung et al., 2019; Montazeri et al., 2019; Silk et al., 2019) networks; and also the cross-sectional networks of individuals displaying low versus high behavioral risk for medical conditions (Choi et al., 2017). Together, these results suggest that the specific role each symptom plays within the network (as defined by the centrality and bridgeness of the symptom) may carry particular significance independently of the global connectivity of the network. This is consistent with an early hypothesis within this research field that central and bridge symptoms constitute priority therapeutic targets (Cramer et al., 2010). Central symptoms were hypothesized to be responsible for maintaining mental disorders, as they are involved in stronger interactions or in the majority of interactions that constitute psychopathological networks (Borsboom and Cramer, 2013). For this reason, it has often been proposed that these symptoms can provide valuable psychotherapeutic targets because they may accelerate the deactivation of the network and consequently catalyze treatments (e.g., Borsboom and Cramer, 2013; McNally et al., 2015; Bekhuis et al., 2016; Knefel et al., 2016; Robinaugh et al., 2016; Bryant et al., 2017; Martel et al., 2017; Richetin et al., 2017; Goldschmidt et al., 2018; Olatunji et al., 2018; Montazeri et al., 2019; see also Fried et al., 2017 for a general overview). Simultaneously, bridge symptoms were hypothesized to be associated with the emergence of comorbidity structures (Cramer et al., 2010; Borsboom, 2017) that are known to hamper the progress of a treatment (Kessler et al., 2005). Accordingly, as with central symptoms, bridge symptoms are considered important treatment targets because the deactivation of these symptoms might prevent the development of comorbidity between mental disorders (e.g., Cramer et al., 2010; Afzali M. et al., 2017; Borsboom, 2017; Choi et al., 2017; DuBois et al., 2017; Levinson et al., 2017; Jones et al., 2018; Rouquette et al., 2018; Garabiles et al., 2019; Solmi et al., 2019). Studies that specifically addressed symptom centrality have noted that it predicts changes in the remaining symptoms (Robinaugh et al., 2016), and facilitates evolution to a psychopathological condition (Boschloo et al., 2016b), whereas others did not find evidence to support the hypothesis that symptom centrality, estimated from cross-sectional networks, is associated with changes in symptoms over time (Bos et al., 2017). To date, the study to most closely test this hypothesis was conducted by Rodebaugh et al. (2018), who explored whether central symptoms in a cross-sectional network of social anxiety disorder predicted changes in symptoms across treatment in another sample of individuals who undertook treatment for the same disorder. They found only moderate support for this hypothesis, as the symptom centrality was not generalized across measures and the frequency of symptom endorsement also predicted change and was generalized across measures of social anxiety disorder. Therefore, the initial hypothesis remains open, and its evaluation will contribute to an increase in the utility and validity of psychopathological networks for routine practice (see Contreras et al., 2019). In this paper, we offer an alternative perspective by focusing on the actual impact of symptom deactivation. In order to deepen our comprehension of the mechanisms that promote the deactivation of psychopathological networks, this study simulates symptom deactivation by removing symptoms from the network according to different regimes dependent on various centrality measures and their roles as bridge symptoms (for studies following similar modeling methods, see Robinaugh et al., 2016; Afzali M. H. et al., 2017; Jones et al., 2018). As is typical of network science, we evaluated the impact of the removal of these symptoms on the global properties of the networks compared with the removal of random symptoms (e.g., Albert et al., 2000; Latora and Marchiori, 2001; Costa et al., 2007) in order to explore the differential efficacy of central and bridge symptoms in deactivating psychopathological networks.

Materials and Methods

Networks

In order to collect a sample of networks from the published literature, the databases PsychInfo, Web of Knowledge, Academic Search Complete, and Google Scholar were searched for studies addressing cross-sectional networks of symptoms of mental disorders or other clinically relevant problems (e.g., hopelessness, alexithymia) using a combination of keywords including the names of mental disorders and “psychopathological networks” or “network analysis.” Studies addressing the personality structure or other psychological phenomena that are not directly related to mental disorders or clinically relevant problems were not included. Studies meeting the above criteria were checked for supporting data availability. An initial sample of 34 networks was collected. Seventeen additional networks were included, having been made available in a previous review by Haslbeck and Fried (2017). A convenience sample of 51 cross-sectional networks from 36 previous studies addressing mental disorders or clinically relevant problems was reanalyzed. These networks and the original studies are presented in Supplementary Materials. They are also identified with an asterisk in the reference list.

From the 51 networks, 19 (37.3%) pertained to clinical samples and the remainder to community-based samples; 18 (35.3%) included symptoms from different mental disorders or psychological problems. The network descriptives are presented in Table 1, and the distributions of the network characteristics are summarized in Figure 2.1.

TABLE 1.

Network descriptives.

Network characteristics Networks (N = 51)

M (SD) Mtrimmed (SE) Minimum–maximum
Nodes 22.725 (20.576) 17.419 (1.335) 5.000–120.000
Edges 99.392 (129.186) 65.645 (8.492) 8.000–756.000
Density 0.475 (0.221) 0.485 (0.035) 0.067–0.861
Components 1.333 (0.973) 1.000 (0.000) 1.000–5.000
Average path length 1.658 (0.454) 1.544 (0.053) 1.139–3.283

FIGURE 2.

FIGURE 2

Boxplots summarizing the distributions of the network characteristics, impact magnitude, and attack extent.

Data Analyses

Originally, networks were estimated using correlation matrices (e.g., Goekoop and Goekoop, 2014; Robinaugh et al., 2014; Koenders et al., 2015), partial correlation matrices (e.g., Anderson et al., 2015), the PC algorithm (Ruzzano et al., 2015), Gaussian Graphical Models (GGM; e.g., Fried E. et al., 2016; Fried et al., 2018), or Ising models (e.g., Boschloo et al., 2015; Kendler et al., 2017). Following current standards in psychopathological network estimation (Epskamp et al., 2018a), where raw data or correlation matrixes were available, networks were re-estimated using GGM (Epskamp and Fried, 2018) or Ising models (van Borkulo et al., 2014) in the case of continuous and binary data, respectively. GGM implemented in the qgraph package (version 1.5; Epskamp et al., 2012) for R (version 3.5.1; R Core Team, 2019) represents the most widely used method for estimating psychopathological networks from continuous data. This model estimates a network of partial correlation coefficient (Epskamp et al., 2018b). The Ising model is based on logistic regressions and is a commonly used procedure for estimating networks from binary data (van Borkulo et al., 2014). This model is implemented through the IsingFit package (version 0.3.1; van Borkulo et al., 2014) for R (version 3.5.1; R Core Team, 2019). Both methods use the Least Absolute Shrinkage and Selection Operator (LASSO) regularization technique (Tibshirani, 1996) in order to control for spurious interactions and the Extended Bayesian Information Criterion (EBIC; Chen and Chen, 2008) for model selection (see Epskamp et al., 2018a for a detailed discussion of these methods for psychopathological network estimation).

Where previous studies have analyzed different networks estimated from the same sample (e.g., DuBois et al., 2017; Santos et al., 2017; Smith et al., 2018), only one was included in the current study. Analyses were based on the adjacency matrixes provided by the original authors or by Haslbeck and Fried (2017) when raw data or correlation matrixes were unavailable.

The graphical representation of the networks was performed using the qgraph package (version 1.5; Epskamp et al., 2012) for R (version 3.5.1; R Core Team, 2019). The measures of symptom centrality, namely degree and strength, were also computed using the qgraph package. Degree corresponds to the number of connections a symptom has with the other symptoms. Strength corresponds to the sum of the weight of all connections from one symptom to the remainder. These measures were selected because they are consistently stable across studies, unlike other measures like betweenness and closeness, which are frequently unstable (Epskamp et al., 2018a).

The ModuLand algorithm (Szalay-Beko et al., 2012), implemented in Cytoscape 3.5.1 (Shannon et al., 2003), was used to measure the two types of bridge symptoms discussed above. ModuLand allocates each symptom to a module based on assignment values that represent how much a symptom belongs to each module. Thus, this framework permits the identification of modular overlap, which is a trans-modularity measure of the number of modules to which a symptom is assigned, and modular bridgeness, an inter-modularity measure of the effective number of modules to which a symptom is connected (Szalay-Beko et al., 2012).

In order to explore the characteristics of the deactivation of psychopathological networks, symptom deactivation was simulated by removing symptoms successively, one at a time, and the network characteristics were measured after the removal of each symptom (see Barabási, 2016; also see Albert et al., 2000; Latora and Marchiori, 2001; Mishkovski et al., 2011 for examples of the same procedure in different domains of network science). The differential impact of the central and bridge symptoms was examined by simulating five attack conditions. Symptoms were removed in the decreasing order of (1) degree, (2) strength, (3) bridgeness, and (4) overlap. These were also compared to a fifth condition, in which symptoms were randomly removed from the network. This was performed using the ProNet package (version 1.0.0; Wu and Xia, 2015) for R (version 3.5.1; R Core Team, 2019). The number of simulations for the random attack was set at 2,000. At each time, three characteristics of the networks were measured: connectivity, components, and average path length. The igraph package (version 1.2.2; Csárdi and Nepusz, 2006) for R (version 3.5.1; R Core Team, 2019) was used to compute the characteristics of the network. Connectivity measures the sum of the number of interactions between all symptoms in the network. Components refer to portions (symptoms or groups of symptoms) of the network that are disconnected from the rest of the network. Finally, the average path length is the mean of the shortest paths in the network (Costa et al., 2007).

The impact generated by each attack condition was measured by computing the magnitude of the impact and the extent of the attack required to achieve maximum impact. First, we computed the difference between the average path length and the maximum value of the number of components and the initial values displayed by the network. Second, the proportion of symptoms that had to be removed to achieve the maximum average path length and number of components was computed. Finally, the impact on network connectivity was measured by computing the proportion of symptoms that needed to be removed to achieve a 50% drop in network connectivity. This procedure is illustrated in Figure 1.

The analysis of the distributions of the characteristics of the networks, impact magnitude, and attack extent (summarized in Figures 2.2, 2.3) revealed high dispersion, extreme values, and skewed distributions. For this reason, the robust bootstrap-t method proposed by Wilcox (2017; see also Field and Wilcox, 2017 for an introduction to this method) for comparing multiple dependent trimmed means was used to compare the effect of the attack conditions on the magnitude of the impact as well as the extent of the attack on the number of components, average path length, and connectivity. The robust test includes the test statistic and the critical value for the test statistic (at α = 0.05). Robust post hoc tests display the difference between trimmed means (psihat), its bootstrap 95% confidence interval, the test statistics for this difference, and the critical value for the test. Psihat is negative if the trimmed mean for the first element in the comparison (for example, the trimmed mean number of components in the random versus degree attack conditions) is lower than the trimmed mean for the second element and is positive if it is higher. The test is considered statistically significant (p < 0.05) if the test statistic exceeds the critical value. The amount of trim in computing trimmed means was set at 0.2, and 2,000 bootstrap samples were considered. The R package WRS2 (version 0.10-0; Mair and Wilcox, 2018) was used to compute robust statistics. All data analysis on R was performed in RStudio 1.1.379 (RStudio Team, 2017). R-code is available from the corresponding author upon request.

Results

The extent of the attack and the magnitude of its impact under the different attack conditions are presented in Table 2. (The evolution of the characteristics of each network under the different attack conditions is included in the Supplementary Materials). The distributions of the attack extent and impact magnitude for the different attack conditions are summarized in Figures 2.2, 2.3.

TABLE 2.

Descriptives of impact magnitude and attack extent.

Network characteristics/attack condition Impact magnitude Attack extent


M (SD) Mtrimmed (SE) Minimum–maximum M (SD) Mtrimmed (SE) Minimum–maximum
Components
Random 1.300 (1.469) 0.926 (0.089) 0.060–7.096 0.568 (0.093) 0.577 (0.013) 0.323–0.718
Degree 3.098 (3.183) 2.290 (0.295) 0.000–15.000 0.587 (0.213) 0.623 (0.027) 0.000–0.889
Strength 2.471 (2.701) 1.806 (0.291) 0.000–12.000 0.523 (0.316) 0.582 (0.058) 0.000–0.921
Bridgeness 2.412 (2.401) 1.774 (0.198) 0.000–12.000 0.527 (0.245) 0.574 (0.032) 0.000–0.893
Overlap 1.608 (1.866) 1.194 (0.190) 0.000–10.000 0.493 (0.327) 0.545 (0.074) 0.000–0.868
Path length
Random 0.855 (0.502) 0.801 (0.054) 0.000–2.588 0.315 (0.119) 0.326 (0.016) 0.000–0.493
Degree 0.735 (0.629) 0.576 (0.052) 0.000–2.820 0.459 (0.200) 0.482 (0.031) 0.000–0.812
Strength 0.511 (0.521) 0.391 (0.052) 0.000–2.904 0.454 (0.208) 0.467 (0.031) 0.000–0.857
Bridgeness 0.575 (0.650) 0.382 (0.057) 0.001–3.345 0.420 (0.191) 0.436 (0.034) 0.059–0.800
Overlap 0.431 (0.398) 0.333 (0.041) 0.010–1.879 0.503 (0.182) 0.526 (0.028) 0.091–0.786
Connectivity
Random 0.201 (0.067) 0.187 (0.007) 0.127–0.501
Degree 0.236 (0.036) 0.235 (0.005) 0.167–0.333
Strength 0.270–0.044 0.275 (0.007) 0.167–0.350
Bridgeness 0.260 (0.039) 0.259 (0.007) 0.167–0.333
Overlap 0.306 (0.051) 0.300 (0.006) 0.222–0.536

The robust bootstrap-t method for comparing multiple dependent means was conducted to compare the effect of the attack conditions on the magnitude of the impact on the number of components and average path length in the network. A statistically significant difference was observed between the attack conditions on the trimmed mean impact on the number of components, Ft = 14.514, Fcrit = 2.499, p < 0.05. The post hoc comparisons between attack conditions reported in Table 3 suggest that the degree, strength, and bridgeness attack conditions (but not overlap attack) yielded a significantly higher impact than the random attack on the number of components. No significant differences were observed between these three conditions as to the magnitude of the impact on the number of components. Degree and bridgeness attack conditions also yielded a significantly higher impact than overlap attack on the number of components. A statistically significant difference between attack conditions on the trimmed mean impact on the average path length was also observed, Ft = 28.790, Fcrit = 2.387, p < 0.05. The post hoc comparisons between attack conditions, reported in Table 4, suggest that the random attack condition had a higher impact on the average path length than the remaining attack conditions; moreover, degree attack had a stronger impact on the average path length than the strength, bridgeness, and overlap conditions.

TABLE 3.

Post hoc comparisons between attack conditions of the magnitude of the impact on the number of components.

Pairwise comparisons psihat 95% CI Test statistics Critical value of the test
Random vs. Degree –1.364 [−2.124, −0.604] −5.624 3.132
Random vs. Strength –0.880 [−1.627, −0.134] −3.694 3.132
Random vs. Bridgeness –0.848 [−1.330, −0.366] −5.513 3.132
Random vs. Overlap –0.2671 [−0.787, 0.253] –1.610 3.132
Degree vs. Strength 0.484 [−0.084, 1.052] 2.668 3.132
Degree vs. Bridgeness 0.516 [−0.015, 1.047] 3.044 3.132
Degree vs. Overlap 1.097 [0.373, 1.821] 4.745 3.132
Strength vs. Bridgeness 0.032 [−0.572, 0.637] 0.167 3.132
Strength vs. Overlap 0.613 [−0.098, 1.324] 2.700 3.132
Bridgeness vs. Overlap 0.581 [0.022, 1.140] 3.250 3.132

Statistically significant, p < 0.05.

TABLE 4.

Post hoc comparisons between attack conditions of the magnitude of the impact on the average path length.

Pairwise comparisons psihat 95% CI Test statistics Critical value of the test
Random vs. Degree 0.225 [0.079, 0.372] 4.346 2.826
Random vs. Strength 0.410 [0.250, 0.570] 7.242 2.826
Random vs. Bridgeness 0.419 [0.260, 0.579] 7.437 2.826
Random vs. Overlap 0.468 [0.312, 0.625] 8.447 2.826
Degree vs. Strength 0.185 [0.038, 0.332] 3.554 2.826
Degree vs. Bridgeness 0.194 [0.065, 0.323] 4.237 2.826
Degree vs. Overlap 0.243 [0.090, 0.396] 4.479 2.826
Strength vs. Bridgeness 0.009 [−0.122, 0.140] 0.195 2.826
Strength vs. Overlap 0.058 [−0.078, 0.194] 1.202 2.826
Bridgeness vs. Overlap 0.049 [−0.068, 0.166] 1.186 2.826

Statistically significant, p < 0.05.

The robust bootstrap-t method for comparing multiple dependent means was also utilized to compare the effect of the attack conditions on the extent of the attack required to achieve maximum impact on the number of components, average path length, and connectivity of the network. A non-statistically significant difference was observed between the trimmed mean extent of the attack on the number of components between attack conditions, Ft = 0.446, Fcrit = 3.912, p > 0.05. A statistically significant difference was observed between the trimmed mean extent of the attack on the average path length between attack conditions, Ft = 17.752, Fcrit = 2.511, p < 0.05. The post hoc comparisons between attack conditions, reported in Table 5, suggest that the random attack performs better than all of the remaining attack conditions in extending the average path length. A statistically significant difference between attack conditions on the trimmed mean extent of the attack on the network connectivity was observed, Ft = 57.293, Fcrit = 2.808, p < 0.05. The post hoc comparisons between attacks, reported in Table 6, suggest that the random attack condition performed better than any of the remaining attack conditions in reducing the network connectivity. They also suggest that degree attack performed better than strength, bridgeness, and overlap conditions and that bridgeness attack performed better than overlap attack.

TABLE 5.

Post hoc comparisons between attack conditions of the extent of the attack on the average path length in the network.

Pairwise comparisons psihat 95% CI Test statistics Critical value of the test
Random vs. Degree –0.155 [−0.215, −0.096] −7.702 2.970
Random vs. Strength –0.141 [−0.204, −0.078] −6.618 2.970
Random vs. Bridgeness –0.110 [−0.189, −0.030] −4.111 2.970
Random vs. Overlap –0.200 [−0.270, −0.130] −8.498 2.970
Degree vs. Strength 0.015 [−0.052, 0.081] 0.655 2.970
Degree vs. Bridgeness 0.046 [−0.024, 0.115] 1.953 2.970
Degree vs. Overlap –0.045 [−0.123, 0.034] –1.686 2.970
Strength vs. Bridgeness 0.031 [−0.044, 0.106] 1.220 2.970
Strength vs. Overlap –0.059 [−0.148, 0.030] –1.972 2.970
Bridgeness vs. Overlap –0.090 [−0.181, 0.001] –2.943 2.970

Statistically significant, p < 0.05.

TABLE 6.

Post hoc comparisons between attack conditions of the impact of the extent of the attack on network connectivity.

Pairwise comparisons psihat 95% CI Test statistics Critical value of the test
Random vs. Degree –0.049 [−0.075, −0.022] −5.506 3.017
Random vs. Strength –0.088 [−0.122, −0.054] −7.894 3.017
Random vs. Bridgeness –0.073 [−0.101, −0.044] −7.711 3.017
Random vs. Overlap –0.114 [−0.135, −0.092] −16.200 3.017
Degree vs. Strength –0.039 [−0.059, −0.020] −6.015 3.017
Degree vs. Bridgeness –0.024 [−0.041, −0.008] −4.422 3.017
Degree vs. Overlap –0.065 [−0.084, −0.046] −10.289 3.017
Strength vs. Bridgeness 0.015 [−0.005, 0.035] 2.298 3.017
Strength vs. Overlap –0.026 [−0.054, 0.003] –2.740 3.017
Bridgeness vs. Overlap –0.041 [−0.065, −0.016] −5.026 3.017

Statistically significant, p < 0.05.

Discussion

The network theory of psychopathology has suggested that central and bridge symptoms might constitute priority therapeutic targets due to their ability to accelerate the deactivation of the network of interactions between symptoms (Cramer et al., 2010; Borsboom and Cramer, 2013; Borsboom, 2017). This hypothesis had a strong impact on the field, and it is common for studies using cross-sectional networks to detail the nosographic structure of mental disorders to conclude that the most central or bridge symptoms in those networks could constitute important therapeutic targets. However, few studies have directly tested this hypothesis, and the actual impact of manipulating central and bridge symptoms on the psychopathological networks remains unclear. Mapping this impact will have important consequences for the field, as it may support current innovations in diverse domains, such as treatment personalization (see, e.g., Fisher et al., 2019), and therefore contribute to increasing the relevance of psychopathological networks to routine practice, which has been recognized to remain limited (Contreras et al., 2019; see also Bringmann and Eronen, 2018). In order to contribute to this effort, this study compared the impact of deactivating symptoms (as is assumed to occur during treatment; Borsboom, 2017) according to different conditions corresponding to the different definitions of bridge symptoms and the most common measures of symptom centrality. Given that, in the case of bridge symptoms, different definitions coexist in the literature, we explored an alternative method for their identification based on the modular properties of psychopathological networks. Through ModuLand (Kovács et al., 2010), it was possible to specify both the inter-modular and trans-modular roles that bridge symptoms have been proposed to play in psychopathological networks, which may offer a framework for future studies that directly compare these roles of bridge symptoms.

Globally, the results suggest that attacks based on bridge and central symptoms are less proficient than random attacks in transforming the path length and connectivity of the network but tend (with the exception of overlapping symptoms) to generate a higher number of isolated symptoms. They also suggest that symptoms with the highest degree are more efficient (than symptoms with the highest strength, bridgeness, or overlap) in increasing the path lengths and in decreasing the connectivity of the network. In contrast, overlapping symptoms had the smallest impact on the network. As in previous studies (Rodebaugh et al., 2018), these results provide only moderate evidence in support of the hypothesis that central and bridge symptoms constitute priority treatment targets and are consistent with the observation that common centrality measures (degree, strength, closeness, and betweenness) are only weakly correlated with the causal influence of symptoms on the network (Dablander and Hinne, 2018).

However, they also add to a small number of studies (Robinaugh et al., 2016; Dablander and Hinne, 2018) that converge in highlighting that distinct centrality measures perform differently and that there are measures of network operation and symptom centrality other than those most commonly used in the field that constitute relevant alternatives. For example, psychopathological networks have been explored with emphasis placed on the global connectivity of the network, such as through comparisons between pre-treatment and post-treatment connectivity (Beard et al., 2016; Snippe et al., 2017; Bos et al., 2018). Although results from these studies are not always consistent (e.g., van Borkulo et al., 2015; Bos et al., 2018), the suggestion remains that network connectivity is the prime property for detecting changes in networks. This is grounded in strong theoretical assumptions (Borsboom, 2017) and empirical evidence (Cramer et al., 2016), but the results from this study suggest that other characteristics of psychopathological networks should be further explored, since changes in the number of components appear to be easier to accomplish with targeted attacks (guided by symptom degree, strength, and bridgeness), and therefore this might represent a better indicator for detecting changes in psychopathological networks. Nonetheless, the number of components is an unexplored measure of psychopathological networks, and the meaning of these changes does not currently have a theoretical foundation to enable us to derive a decisive conclusion regarding its importance for psychopathological networks. In fact, in most cases, after a successful therapeutic process, the remission of symptoms is not total (see Rottenberg et al., 2018 for an example in depression), so it is fair to assume that these symptoms might still be forming separate components. Connectivity within these components might still be high, so the change in connectivity is not particularly noticeable, and an increase in the number of components might be a better measure for therapeutic success.

Another example stems from the finding that attacks based on symptoms with higher overlap do not produce significant changes in the characteristics of the network, in contrast to the other attack conditions. This is consistent with another study (Castro et al., 2018) that reported a moderate correlation between symptom strength and bridgeness but not between strength and overlap. Although this suggests that overlapping symptoms may not be of special relevance to inform developments in psychotherapeutic treatments based on psychopathological networks, since they do not seem to pinpoint a vulnerability of these networks, it does not exclude the hypothesis that they may play an important role in their constitution. In fact, recent studies have proposed methods for the identification of these symptoms on the basis that they might be more akin to the nature of psychopathological processes (Blanken et al., 2018). The two types of bridge symptoms may therefore play distinctive roles on the psychopathological networks, and future research should aim to provide further knowledge on the roles of bridging and overlapping symptoms. It is reasonable to hypothesize, since symptoms displaying higher modular bridgeness also seem to display stronger connections to other symptoms in the network, that bridging symptoms may be more involved in aggregating symptoms and maintaining the integrity of the network of interactions between them than the overlapping symptoms. If this is the case, then bridging symptoms may be implicated in the vulnerability of a network to transition to a mental disorder state since vulnerability is associated with stronger connectivity (Cramer et al., 2016) and bridge symptoms may regulate the flux of information in psychopathological networks (Jones et al., 2018). On the other hand, it has been suggested that overlapping elements in complex networks that have few and weak links to other elements but connect nodes in distinct regions of the network contribute to the flexibility and adaptability of the network (Csermely, 2008); this may help to explain the variability of the clinical presentations and subtypes of mental disorders (e.g., Galatzer-Levy and Bryant, 2013; Fried and Nesse, 2015). If the different functions of bridging and overlapping symptoms are confirmed in future studies, it would add to that general hypothesis the possibility that they contribute to the constitution of comorbidity structures through distinct mechanisms: bridging symptoms by connecting otherwise distinct modules from distant regions of the network and overlapping symptoms by creating a shared vulnerability for the synchronized activation of several modules.

The type of attack is another important aspect of this study. We have only computed the symptom centrality and bridge measures for the initial network, and the order for the symptom removal was established based on this first estimation. This approach was used because most research identifies the central and bridge symptoms and proposes them as therapeutic targets based only on a single time-point estimation of the network. However, considering the particularities of psychopathological networks, such as the high density and small number of symptoms, this might not be the most appropriate approach to modeling symptom deactivation. In some cases, these characteristics of psychopathological networks result in the removal of a symptom without the ability to meaningfully affect the characteristics of the network. If all of the highest-scoring symptoms have high degree values mostly due to the connections between them, the removal of these symptoms based on the first estimation will arrive at a point where the symptom being removed is no longer relevant for the network. Given that removing one symptom also removes the existing connections, with the symptoms being largely interconnected, their removal after the initial attack leaves the remaining network unaffected. In these cases, the random attack has a higher probability of removing a more connected symptom after the initial attack. In order to overcome this limitation, future research should test other types of targeted attacks, such as cascading attacks (Motter and Lai, 2002; Wang and Rong, 2009). In a cascading attack, symptom centrality is re-estimated after the deactivation of each symptom. Consequently, at each step, the symptom with the highest centrality reflects the network state at that point and not the initial state of the network. These attacks are more harmful to certain networks (Holme et al., 2002), and, in light of the results of this study, this may be a more appropriate strategy for exploring the vulnerability of the network.

Another limitation of this study is that it tested a restricted range of centrality measures. We have excluded two commonly used measures in psychopathological networks (betweenness and closeness) based on the lack of stability they have exhibited in psychopathological networks (Epskamp et al., 2018a) and opted for the inclusion of only the most frequently used centrality measures in the field. This was also done in favor of better consistency and interpretability of the results. However, other measures of symptom impact have emerged within the field (Robinaugh et al., 2016; Jones, 2018), and network science offers a vast array of centrality measures (e.g., Wang et al., 2014) that might be generative in the study of the vulnerability of psychopathological networks but remain unexplored. This suggestion to use alternative centrality measures has recently been proposed by Bringmann et al. (2018). It is consistent with the findings that alternative centrality measures (e.g., eigenvector centrality) reveal higher correlations with the causal role of symptoms than the most common measures (Dablander and Hinne, 2018) and that these common measures may not adequately account for some of the characteristics of psychopathological networks (e.g., the negative weights of some of the connections between symptoms; Robinaugh et al., 2016). The examination of alternative measures is necessary for the continued development of the network theory of psychopathology, but it should not be done in a random way. Evidence from other fields suggests that the nature of the network dictates its specific vulnerability to different types of attacks (Holme et al., 2002) and the most relevant centrality measures (Borgatti, 2005). An initial study (Borsboom et al., 2011) explored the topological structure of the network of DSM-IV (American Psychiatric Association [APA], 1994) symptoms, concluding that it is consistent with the characteristics of a general type of complex network termed a small-world network (Watts and Strogatz, 1998), meaning that most symptoms, even those from mental disorders traditionally considered distant, are connected by short paths. This was offered as an explanation to the pervasiveness of comorbidity between mental disorders and the unsuccessful search for causal mechanisms and biomarkers. No further attempts were made to replicate this study, and most of the recent networks in the field refer to smaller sets of symptoms pertaining to specific mental disorders. Therefore, the characteristics of the topological structure of psychopathological networks remain largely unknown. As these characteristics, as well as the specific processes unfolding within the network, determine the most relevant measures of its operation (Borgatti, 2005), increased efforts to clarify the characteristics of the topological structure of psychopathological networks could guide the principled identification of the most relevant centrality measures for psychopathological networks. It could also contribute to the study of the vulnerability of psychopathological networks and advance the identification of the characteristics that may more productively be explored by psychotherapeutic treatments.

It should also be noted that all of the networks used in this study were based on cross-sectional data, which has been pointed out as a limitation in the identification of central symptoms (Robinaugh et al., 2014; Fried et al., 2015; van Borkulo et al., 2015). In fact, previous studies found differences in the central symptoms of cross-sectional and of longitudinal networks (e.g., Bos et al., 2017; see also Contreras et al., 2019 for a review). In this study, cross-sectional networks were used because, to date, research suggesting central and bridge symptoms are important therapeutic targets is mostly based on cross-sectional networks. However, replication studies based on longitudinal networks are needed.

Finally, this study examined a convenience sample of previously published data sets that encompass different mental disorders. Its findings aggregate all of the networks, potentially resulting in the omission of specific mechanisms associated with the differential vulnerabilities of distinct mental disorders. Whether the psychopathological networks characterizing different mental disorders have different characteristics and therefore display different vulnerabilities remains unknown.

In summary, psychological networks appear to demonstrate greater complexity than suggested by previous studies. This study concludes that the hypothesis that central and bridge symptoms are good therapeutic targets based solely on a single time-point identification of these symptoms might not be the most fruitful road for network-guided interventions. Moreover, in order to understand the specific processes behind psychological networks, we must explore the full spectrum of network properties and centrality measures that are already available in network science.

Author Contributions

DC, FF, and TF conceived the study, wrote the initial draft, and edited and revised the manuscript. TF developed the code, prepared the Supplementary Material, and supervised the project. The remaining authors participated in the initial draft of the manuscript and in data collection.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Footnotes

Funding. This work was funded by the Center for Psychology at the University of Porto, Portuguese Science Foundation (FCT UID/PSI/00050/2013), and EU FEDER through COMPETE 2020 program (POCI-01-0145-FEDER-007294). FF was supported by the Portuguese Science Foundation through Ph.D. grant (SFRH/BD/133231/2017).

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2019.02448/full#supplementary-material

DATA SHEET S1

Plots displaying attack results for each individual network, comparison of the number of modules identified through the Clique Percolation and ModuLand algorithms, and description of the original networks and studies.

References

  1. Adamcsek B., Palla G., Farkas J., Derényi I., Vicsek T. (2006). CFinder: locating cliques and overlapping modules in biological networks. Bioinformatics 22 1021–1023. 10.1093/bioinformatics/btl039 [DOI] [PubMed] [Google Scholar]
  2. Afzali M., Sunderland M., Teesson M., Carragher N., Mills K., Slade T. (2017). A network approach to the comorbidity between posttraumatic stress disorder and major depressive disorder: the role of overlapping symptoms. J. Affect. Disord. 208 490–496. 10.1016/j.jad.2016.10.037 [DOI] [PubMed] [Google Scholar]
  3. Afzali M. H., Sunderland M., Batterham P. J., Carragher N., Calear A., Slade T. (2017). Network approach to the symptom-level association between alcohol use disorder and posttraumatic stress disorder. Soc. Psychiatry Psychiatr. Epidemiol. 52 329–339. 10.1007/s00127-016-1331-3 [DOI] [PubMed] [Google Scholar]
  4. Albert R., Jeong H., Barabási A. (2000). Error and attack tolerance of complex networks. Nature 406 378–382. 10.1038/35019019 [DOI] [PubMed] [Google Scholar]
  5. American Psychiatric Association [APA] (1994). DSM-IV Diagnostic and Statistical Manual of Mental Disorders, 4th Edn Washington, DC: Psychiatric Publishing. [Google Scholar]
  6. American Psychiatric Association [APA] (2013). DSM-5 Diagnostic and Statistical Manual of Mental Disorders, 5th Edn Washington, DC: Psychiatric Publishing. [Google Scholar]
  7. Anderson M., Montazeri F., de Bildt A. (2015). Network approach to autistic traits: group and subgroup analyses of ADOS item scores. J. Autism Dev. Disord. 45 3115–3132. 10.1007/s10803-015-2537-z [DOI] [PubMed] [Google Scholar]
  8. Barabási A. L. (2016). Network Science. Cambridge: Cambridge University Press. [Google Scholar]
  9. Beard C., Millner A. J., Forgeard M. J., Fried E., Hsu K. J., Treadway M. T., et al. (2016). Network analysis of depression and anxiety symptom relationships in a psychiatric sample. Psychol. Med. 46 3359–3369. 10.1017/S0033291716002300 [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Bekhuis E., Schoevers R., Van Borkulo D., Rosmalen M., Boschloo L. (2016). The network structure of major depressive disorder generalized anxiety disorder and somatic symptomatology. Psychol. Med. 46 2989–2998. 10.1017/S0033291716001550 [DOI] [PubMed] [Google Scholar]
  11. Birkeland S., Heir T. (2017). Making connections: exploring the centrality of posttraumatic stress symptoms and covariates after terrorist attack. Eur. J. Psychotraumatol. 8:1333387. 10.1080/20008198.2017.1333387 [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Blanken T. F., Deserno M. K., Dalege J., Borsboom D., Blanken P., Kerkhof G. A., et al. (2018). The role of stabilizing and communicating symptoms given overlapping communities in psychopathology networks. Sci. Rep. 8:5854. 10.1038/s41598-018-24224-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Blanken T. F., Van Der Zweerde T., Van Straten A., Van Someren E. J., Borsboom D., Lancee J. (2019). Introducing network intervention analysis to investigate sequential, symptom-specific treatment effects: a demonstration in co-occurring insomnia and depression. Psychother. Psychosom. 88 52–54. 10.1159/000495045 [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Borgatti S. P. (2005). Centrality and network flow. Soc. Netw. 27 55–71. 10.1016/j.socnet.2004.11.008 [DOI] [Google Scholar]
  15. Borsboom D. (2017). A network theory of mental disorders. World Psychiatry 16 5–13. 10.1002/wps.20375 [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Borsboom D., Cramer A., Kalis A. (2019). Brain disorders? Not really…Why network structures block reductionism in psychopathology research. Behav. Brain Sci. 10.1017/S0140525X17002266 [Epub ahead of print]. [DOI] [PubMed] [Google Scholar]
  17. Borsboom D., Cramer A. O. (2013). Network analysis: an integrative approach to the structure of psychopathology. Annu. Rev. Clin. Psychol. 9 91–121. 10.1146/annurev-clinpsy-050212-185608 [DOI] [PubMed] [Google Scholar]
  18. Borsboom D., Cramer A. O. J., Schmittmann V. D., Epskamp S., Waldorp L. J. (2011). The small world of psychopathology. PLoS One 6:27407. 10.1371/journal.pone.0027407 [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Bos F. M., Snippe E., de Vos S., Hartmann J. A., Simons C. J. P., van der Krieke L., et al. (2017). Can we jump from cross-sectional to dynamic interpretations of networks? Implications for the network perspective in psychiatry. Psychother. Psychosom. 86 175–177. 10.1159/000453583 [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Bos M., Fried E., Hollon D., Bringmann L. F., Dimidjian S., DeRubeis R. J., et al. (2018). Cross-sectional networks of depressive symptoms before and after antidepressant medication treatment. Soc. Psychiatry Psychiatr. Epidemiol. 53 617–627. 10.1007/s00127-018-1506-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Boschloo L., van Borkulo C. D., Borsboom D., Schoevers R. A. (2016b). A prospective study on how symptoms in a network predict the onset of depression. Psychother. Psychosom. 85 183–184. 10.1159/000442001 [DOI] [PubMed] [Google Scholar]
  22. Boschloo L., van Borkulo C. D., Rhemtulla M., Keyes K. M., Borsboom D., Schoevers R. A. (2015). The network structure of symptoms of the diagnostic and statistical manual of mental disorders. PLoS One 10:137621. 10.1371/journal.pone.0137621 [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Bringmann L., Elmer T., Epskamp S., Krause W., Schoch D., Wichers M., et al. (2018). What do Centrality Measures Measure in Psychological Networks? Available at: 10.13140/RG.2.2.25024.58884 (accessed November, 2018). [DOI] [PubMed] [Google Scholar]
  24. Bringmann L. F., Eronen M. I. (2018). Don’t blame the model: reconsidering the network approach to psychopathology. Psychol. Rev. 125 606–615. 10.1037/rev0000108 [DOI] [PubMed] [Google Scholar]
  25. Bryant R. A., Creamer M., O’Donnell M., Forbes D., McFarlane A. C., Silove D., et al. (2017). Acute and chronic posttraumatic stress symptoms in the emergence of posttraumatic stress disorder: a network analysis. JAMA Psychiatry 74 135–142. 10.1001/jamapsychiatry.2016.3470 [DOI] [PubMed] [Google Scholar]
  26. Castro D., Ferreira F., Mendes A. S., Ferreira T. B. (2018). Bridges between bipolar and borderline personality disorders: clarifying comorbidity through the analysis of the complex network of connections between symptoms. Psychologist 1 30–45. [Google Scholar]
  27. Chen J., Chen Z. (2008). Extended bayesian information criteria for model selection with large model spaces. Biometrika 95 759–771. 10.1093/biomet/asn034 [DOI] [Google Scholar]
  28. Choi K. W., Batchelder A. W., Ehlinger P. P., Safren S. A., O’Cleirigh C. (2017). Applying network analysis to psychological comorbidity and health behavior: depression, PTSD, and sexual risk in sexual minority men with trauma histories. J. Consul. Clin. Psychol. 85 1158–1170. 10.1037/ccp0000241 [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Contreras A., Nieto I., Valiente C., Espinosa R., Vazquez C. (2019). The study of psychopathology from the network analysis perspective: a systematic review. Psychother. Psychosom. 88 71–83. 10.1159/000497425 [DOI] [PubMed] [Google Scholar]
  30. Costa L., Rodrigues F., Travieso G., Villas-Boas P. (2007). Characterization of complex networks: a survey of measurements. Adv. Phys. 56 167–242. 10.1080/00018730601170527 29984821 [DOI] [Google Scholar]
  31. Cramer A. O., Waldorp L. J., van der Maas H. L. J., Borsboom D. (2010). Comorbidity: a network perspective. Behav. Brain Sci. 33 137–193. 10.1017/S0140525X09991567 [DOI] [PubMed] [Google Scholar]
  32. Cramer A. O. J., Borsboom D. (2015). “Problems attract problems: a network perspective on mental disorders,” in Emerging Trends in the Social and Behavioral Sciences: An Interdisciplinary, Searchable, and Linkable Resource, eds Scott R. A., Kosslyn S. M. (Hoboken, NJ: John Wiley & Sons Inc; ), 1–15. 10.1002/9781118900772.etrds0264 [DOI] [Google Scholar]
  33. Cramer A. O. J., van Borkulo C. D., Giltay E. J., van der Maas H. L. J., Kendler K. S., Scheffer M., et al. (2016). Major depression as a complex dynamic system. PLoS One 11:e0167490. 10.1371/journal.pone.0167490 [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Csárdi G., Nepusz T. (2006). The igraph software package for complex network research. InterJ. Complex Syst. 5 1–9. [Google Scholar]
  35. Csermely P. (2008). Creative elements: network-based predictions of active centres in proteins and cellular and social networks. Trends Biochem. Sci. 33 569–576. 10.1016/j.tibs.2008.09.006 [DOI] [PubMed] [Google Scholar]
  36. Curtiss J., Fulford D., Hofmann S. G., Gershon A. (2019). Network dynamics of positive and negative affect in bipolar disorder. J. Affect. Disord. 249 270–277. 10.1016/j.jad.2019.02.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Dablander F., Hinne M. (2018). Node centrality measures are a poor substitute for causal inference. PsyArXiv[Preprint] 10.31234/osf.io/nue4z [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. de Vos S., Wardenaar K. J., Bos E. H., Wit E. C., Bouwmans M. E., de Jonge P. (2017). An investigation of emotion dynamics in major depressive disorder patients and healthy persons using sparse longitudinal networks. PLoS One 12:e0178586. 10.1371/journal.pone.0178586 [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. DuBois H., Rodgers F., Franko L., Eddy T., Thomas J. (2017). A network analysis investigation of the cognitive-behavioral theory of eating disorders. Behav. Res. Ther. 97 213–221. 10.1016/j.brat.2017.08.004 [DOI] [PubMed] [Google Scholar]
  40. Epskamp S., Borsboom D., Fried E. I. (2018a). Estimating psychological networks and their accuracy: a tutorial paper. Behav. Res. Methods 50 195–212. 10.3758/s13428-017-0862-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Epskamp S., Waldorp L. J., Mõttus R., Borsboom D. (2018b). The gaussian graphical model in cross-sectional and time-series data. Multivariate Behav. Res. 53 453–480. 10.1080/00273171.2018.1454823 [DOI] [PubMed] [Google Scholar]
  42. Epskamp S., Cramer A. O., Waldorp L. J., Schmittmann V. D., Borsboom D. (2012). qgraph: network visualizations of relationships in psychometric data. J. Stat. Softw. 48 1–18. 10.18637/jss.v048.i04 [DOI] [Google Scholar]
  43. Epskamp S., Fried E. (2018). A tutorial on regularized partial correlations networks. Psychol. Methods 23 617–634. 10.1037/met0000167 [DOI] [PubMed] [Google Scholar]
  44. Field A. P., Wilcox R. R. (2017). Robust statistical methods: a primer for clinical psychology and experimental psychopathology researchers. Behav. Res. Ther. 98 19–38. 10.1016/j.brat.2017.05.013 [DOI] [PubMed] [Google Scholar]
  45. Fisher A. J., Bosley H. G., Fernandez K. C., Reeves J. W., Soyster P. D., Diamond A. E., et al. (2019). Open trial of a personalized modular treatment for mood and anxiety. Behav. Res. Ther. 116 69–79. 10.1016/j.brat.2019.01.010 [DOI] [PubMed] [Google Scholar]
  46. Fortunato S. (2010). Community detection in graphs. Phys. Rep. 486 75–174. 10.1016/j.physrep.2009.11.002 [DOI] [Google Scholar]
  47. Fortunato S., Hric D. (2016). Community detection in networks: a user guide. Phys. Rep. 659 1–44. 10.1016/j.physrep.2016.09.002 [DOI] [Google Scholar]
  48. Fried E., Bockting C., Arjadi R., Borsboom D., Amshoff M., Cramer A. O., et al. (2015). From loss to loneliness: the relationship between bereavement and depressive symptoms. J. Abnorm. Psychol. 124 256–265. 10.1037/abn0000028 [DOI] [PubMed] [Google Scholar]
  49. Fried E., Eidhof B., Palic S., Costantini G., Huisman-van Dijk H. M., Bockting C. L., et al. (2018). Replicability and generalizability of posttraumatic stress disorder (PTSD) networks in a cross-cultural multisite study of PTSD symptoms in four trauma patient samples. Clin. Psychol. Sci. 6 335–351. 10.1177/2167702617745092 [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Fried E., Epskamp S., Nesse R. M., Tuerlinckx F., Borsboom D. (2016). What are good depression symptoms? Comparing the centrality of DSM and non-DSM symptoms of depression in a network analysis. J. Affect. Disord. 189 314–320. 10.1016/j.jad.2015.09.005 [DOI] [PubMed] [Google Scholar]
  51. Fried E., Nesse R. M. (2015). Depression sum-scores don’t add up: why analyzing specific depression symptoms is essential. BMC Med. 13:1–11. 10.1186/s12916-015-0325-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Fried E., van Borkulo C. D., Cramer A. O., Boschloo L., Schoevers R. A., Borsboom D. (2017). Mental disorders as networks of problems: a review of recent insights. Soc. Psychiatry Psychiatr. Epidemiol. 52 1–10. 10.1007/s00127-016-1319-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Fried E. I., van Borkulo C. D., Epskamp S., Schoevers R. A., Tuerlinckx F., Borsboom D. (2016). Measuring depression over time. Psychol. Assess. 28 1354–1367. 10.1037/pas0000275 [DOI] [PubMed] [Google Scholar]
  54. Galatzer-Levy I., Bryant R. (2013). 636,120 ways to have posttraumatic stress disorder. Perspect. Psychol. Sci. 8 651–662. 10.1177/1745691613504115 [DOI] [PubMed] [Google Scholar]
  55. Garabiles M. R., Lao C. K., Xiong Y., Hall B. J. (2019). Exploring comorbidity between anxiety and depression among migrant Filipino domestic workers: a network approach. J. Affect. Disord. 250 85–93. 10.1016/j.jad.2019.02.062 [DOI] [PubMed] [Google Scholar]
  56. Goekoop R., Goekoop J. G. (2014). A network view on psychiatric disorders: network clusters of symptoms as elementary syndromes of psychopathology. PLoS One 9:e112734. 10.1371/journal.pone.0112734 [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Goldberg D. (2015). Psychopathology and classification in psychiatry. Soc. Psychiatry Psychiatr. Epidemiol. 50 1–5. 10.1007/s00127-014-0924-y [DOI] [PubMed] [Google Scholar]
  58. Goldschmidt B., Crosby R. D., Cao L., Moessner M., Forbush K. T., Accurso E. C., et al. (2018). Network analysis of pediatric eating disorder symptoms in a treatment-seeking, transdiagnostic sample. J. Abnorm. Psychol. 127 251–264. 10.1037/abn0000327 [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Groen R. N., Snippe E., Bringmann L. F., Simons C. J., Hartmann J. A., Bos E. H., et al. (2019). Capturing the risk of persisting depressive symptoms: a dynamic network investigation of patients’ daily symptom experiences. Psychiatry Res. 271 640–648. 10.1016/j.psychres.2018.12.054 [DOI] [PubMed] [Google Scholar]
  60. Hallquist M., Wright A. G., Molenaar P. C. M. (2019). Problems with centrality measures in psychopathology symptom networks: why network psychometrics cannot escape psychometric theory. Multivariate Behav. Res. 12 1–25. 10.31234/osf.io/pg4mf [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Hartung T. J., Fried E. I., Mehnert A., Hinz A., Vehling S. (2019). Frequency and network analysis of depressive symptoms in patients with cancer compared to the general population. J. Affect. Disord. 256 295–301. 10.31234/osf.io/8r569 [DOI] [PubMed] [Google Scholar]
  62. Haslbeck J. M. B., Fried E. I. (2017). How predictable are symptoms in psychopathological networks? A reanalysis of 18 published datasets. Psychol. Med. 47 2767–2776. 10.1017/S0033291717001258 [DOI] [PubMed] [Google Scholar]
  63. Hofmann S. G., Curtiss J., McNally R. J. (2016). A complex network perspective on clinical science. Perspect. Psychol. Sci. 11 597–605. 10.1177/1745691616639283 [DOI] [PMC free article] [PubMed] [Google Scholar]
  64. Holme P., Kim B., Yoon N., Han S. K. (2002). Attack vulnerability of complex networks. Phys. Rev. E Stat. Phys. Plasmas Fluids Relat. Interdiscip. Topics 65(5 pt 2):056109. 10.1103/PhysRevE.65.056109 [DOI] [PubMed] [Google Scholar]
  65. Isvoranu A., Boyette L., Guloksuz S., Borsboom D. (2018). “Symptom network models of psychosis,” in Dimensions of Psychosis, eds Tamminga C., Ivleva E., Reininghaus U., van Os J. (Oxford: Oxford University Press; ). [Google Scholar]
  66. Jones P. (2018). networktools: Tools for Identifying Important Nodes in Networks. R Package Version 1.1.0. [Google Scholar]
  67. Jones P., Ma R., McNally R. (2018). Bridge Centrality: A Network Approach to Understanding Comorbidity. Available at: https://osf.io/c5dkj (accessed June, 2018). [DOI] [PubMed] [Google Scholar]
  68. Kendler S., Aggen H., Flint J., Borsboom D., Fried E. I. (2017). The centrality of DSM and non-DSM depressive symptoms in Han Chinese women with major depression. J. Affect. Disord. 227 739–744. 10.1016/j.jad.2017.11.032 [DOI] [PMC free article] [PubMed] [Google Scholar]
  69. Kessler R. C., Chiu W. T., Demler O., Walters E. E. (2005). Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the national comorbidity survey replication. Arch. Gen. Psychiatry 62 617–627. 10.1001/archpsyc.62.6.617 [DOI] [PMC free article] [PubMed] [Google Scholar]
  70. Knefel M., Karatzias T., Ben-Ezra M., Cloitre M., Lueger-Schuster B., Maercker A. (2019). The replicability of ICD-11 complex post-traumatic stress disorder symptom networks in adults. Br. J. Psychiatry 214 361–368. 10.1192/bjp.2018.286 [DOI] [PubMed] [Google Scholar]
  71. Knefel M., Tran U. S., Lueger-Schuster B. (2016). The association of posttraumatic stress disorder, complex posttraumatic stress disorder, and borderline personality disorder from a network analytical perspective. J. Anxiety Disord. 43 70–78. 10.1016/j.janxdis.2016.09.002 [DOI] [PubMed] [Google Scholar]
  72. Koenders A., De Kleijn R., Giltay E. J., Elzinga B. M., Spinhoven P., Spijker A. T. (2015). A network approach to bipolar symptomatology in patients with different course types. PLoS One 10:0141420. 10.1371/journal.pone.01414201 [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. Kovács I. A., Palotai R., Szalay M. S., Csermely P. (2010). Community landscapes: an integrative approach to determine overlapping network module hierarchy, identify key nodes and predict network dynamics. PLoS One 5:e12528. 10.1371/journal.pone.0012528 [DOI] [PMC free article] [PubMed] [Google Scholar]
  74. Kraft B., Jonassen R., Heeren A., Harmer C., Stiles T., Landrø N. I. (2019). Attention bias modification in remitted depression is associated with increased interest and leads to reduced adverse impact of anxiety symptoms and negative cognition. Clin. Psychol. Sci. 7 530–544. 10.1177/2167702618822480 [DOI] [Google Scholar]
  75. Latora V., Marchiori M. (2001). Efficient behavior of small-world networks. Physical Rev. Lett. 87:198701. 10.1103/PhysRevLett.87.198701 [DOI] [PubMed] [Google Scholar]
  76. Levinson C. A., Zerwas S., Calebs B., Kordy H., Hofmeier S., Collaborative V., et al. (2017). The core symptoms of bulimia nervosa, anxiety, and depression: a network analysis. J. Abnorm. Psychol. 126 340–354. 10.1037/abn0000254 [DOI] [PMC free article] [PubMed] [Google Scholar]
  77. Mair P., Wilcox R. (2018). WRS2: A Collection of Robust Statistical methodsrobust Statistics Methods Using WRS2. R Package Version 0.10-0. Available at: https://CRAN.R-project.org/package=WRS2 (accessed July, 2019). [Google Scholar]
  78. Marcus D., Preszler J., Zeigler-Hill V. (2018). A network of dark personality traits: what lies at the heart of darkness? J. Res. Pers. 73 56–62. 10.1016/j.jrp.2017.11.003 [DOI] [Google Scholar]
  79. Martel M. M., Levinson C. A., Lee C. A., Smith T. E. (2017). Impulsivity symptoms as core to the developmental externalizing spectrum. J. Abnorm. Child Psychol. 45 83–90. 10.1007/s10802-016-0148-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  80. McNally R., Robinaugh D. J., Wu G. W. Y., Wang L., Deserno M. K., Borsboom D. (2015). Mental disorders as causal systems: a network approach to posttraumatic stress disorder. Clin. Psychol. Sci. 3 836–849. 10.1177/2167702614553230 26635639 [DOI] [Google Scholar]
  81. McNally R. J., Mair P., Mugno B. L., Riemann B. C. (2017). Co-morbid obsessive-compulsive disorder and depression: a Bayesian network approach. Psychol. Med. 47 1204–1214. 10.1017/S0033291716003287 [DOI] [PubMed] [Google Scholar]
  82. Mishkovski I., Biey M., Kocarev L. (2011). Vulnerability of complex networks. Commun. Nonlinear Sci. Numer. Simul. 16 341–349. 10.1016/j.cnsns.2010.03.018 [DOI] [Google Scholar]
  83. Montazeri F., de Bildt A., Dekker V., Anderson G. M. (2019). Network analysis of behaviours in the depression and autism realms: inter-relationships and clinical implications. J. Autism Dev. Disord. 10.1007/s10803-019-03914-4 [Epub ahead of print]. [DOI] [PubMed] [Google Scholar]
  84. Motter A. E., Lai Y. C. (2002). Cascade-based attacks on complex networks. Phys. Rev. E Stat. Nonlin. Soft. Matter Phys. 66(6 pt 2):65102. 10.1103/PhysRevE.66.065102 [DOI] [PubMed] [Google Scholar]
  85. Mullarkey M. C., Stein A., Pearson R., Beevers C. G. (2019). Network analyses reveal which symptoms improve (or not) following an Internet intervention (Deprexis) for depression. PsyArXiv [Preprint] 10.31234/osf.io/ca5dg [DOI] [PMC free article] [PubMed] [Google Scholar]
  86. Nuijten M. B., Deserno M. K., Cramer A. O., Borsboom D. (2016). Mental disorders as complex networks: an introduction and overview of a network approach to psychopathology. Clin. Neuropsychiatry 13 68–76. [Google Scholar]
  87. Olatunji B. O., Levinson C., Calebs B. (2018). A network analysis of eating disorder symptoms and characteristics in an inpatient sample. Psychiatry Res. 262 270–281. 10.1016/j.psychres.2018.02.027 [DOI] [PubMed] [Google Scholar]
  88. Opsahl T., Agneessens F., Skvoretz J. (2010). Node centrality in weighted networks: generalizing degree and shortest paths. Soc. Netw. 32 245–251. 10.1016/j.socnet.2010.03.006 [DOI] [Google Scholar]
  89. Palla G., Derényi I., Farkas I., Vicsek T. (2005). Uncovering the overlapping community structure of complex networks in nature and society. Nature 435 814–818. 10.1038/nature03607 [DOI] [PubMed] [Google Scholar]
  90. Pe M. L., Kircanski K., Thompson R. J., Bringmann L. F., Tuerlinckx F., Mestdagh M., et al. (2015). Emotion-network density in major depressive disorder. Clin. Psychol. Sci. 3 292–300. 10.1177/2167702614540645 [DOI] [PMC free article] [PubMed] [Google Scholar]
  91. Price M., Legrand A., Brier Z., Hébert-Dufresne L. (2019). The symptoms at the center: examining the comorbidity of posttraumatic stress disorder, generalized anxiety disorder, and depression with network analysis. J. Psychiatric Res. 109 52–58. 10.1016/j.jpsychires.2018.11.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
  92. R Core Team (2019). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing. [Google Scholar]
  93. Richetin J., Preti E., Costantini G., De Panfilis C. (2017). The centrality of affective instability and identity in borderline personality disorder: evidence from network analysis. PLoS One 12:0186695. 10.1371/journal.pone.0186695 [DOI] [PMC free article] [PubMed] [Google Scholar]
  94. Robinaugh D., LeBlanc N., Vuletich H., McNally R. (2014). Network analysis of persistent complex bereavement disorder in conjugally bereaved adults. J. Abnorm. Psychol. 123 510–522. 10.1037/abn0000002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  95. Robinaugh J., Millner J., McNally R. (2016). Identifying highly influential nodes in the complicated grief network. J. Abnorm. Psychol. 125 747–757. 10.1037/abn0000181 [DOI] [PMC free article] [PubMed] [Google Scholar]
  96. Rodebaugh L., Tonge A., Piccirill L., Fried E., Horenstein A., Morrison A. S., et al. (2018). Does centrality in a cross-sectional network suggest intervention targets for social anxiety disorder? J. Consult. Clin. Psychol. 86 831–844. 10.1037/ccp0000336 [DOI] [PMC free article] [PubMed] [Google Scholar]
  97. Rottenberg J., Devendorf A. R., Kashdan T. B., Disabato D. J. (2018). The curious neglect of high functioning after psychopathology: the case of depression. Perspect. Psychol. Sci. 13 549–566. 10.1177/1745691618769868 [DOI] [PubMed] [Google Scholar]
  98. Rouquette A., Pingault J. B., Fried E. I., Orri M., Falissard B., Kossakowski J. J., et al. (2018). Emotional and behavioral symptom network structure in elementary school girls and association with anxiety disorders and depression in adolescence and early adulthood: a network analysis. JAMA Psychiatry 75 1173–1181. 10.1001/jamapsychiatry.2018.2119 [DOI] [PMC free article] [PubMed] [Google Scholar]
  99. RStudio Team (2017). RStudio: Integrated Development for R. Boston, MA: RStudio, Inc. [Google Scholar]
  100. Ruzzano L., Borsboom D., Geurts H. M. (2015). Repetitive behaviors in autism and obsessive–compulsive disorder: new perspectives from a network analysis. J. Autism Dev. Disord. 45 192–202. 10.1007/s10803-014-2204-9 [DOI] [PubMed] [Google Scholar]
  101. Santos H., Fried E., Asafu-Adjei J., Ruiz R. J. (2017). Network structure of perinatal depressive symptoms in Latinas: relationship to stress and reproductive biomarkers. Res. Nurs. Health 40 218–228. 10.1002/nur.21784 [DOI] [PMC free article] [PubMed] [Google Scholar]
  102. Schweren L., van Borkulo C. D., Fried E., Goodyer I. M. (2018). Assessment of symptom network density as a prognostic marker of treatment response in adolescent depression. JAMA Psychiatry 75 98–100. 10.1001/jamapsychiatry.2017.3561 [DOI] [PMC free article] [PubMed] [Google Scholar]
  103. Shannon P., Markiel A., Ozier O., Baliga N. S., Wang J. T., Ramage D., et al. (2003). Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome Res. 13 2498–2504. 10.1101/gr.1239303.metabolite [DOI] [PMC free article] [PubMed] [Google Scholar]
  104. Silk T. J., Malpas C. B., Beare R., Efron D., Anderson V., Hazell P., et al. (2019). A network analysis approach to ADHD symptoms: more than the sum of its parts. PLoS One 14:e0211053. 10.1371/journal.pone.0211053 [DOI] [PMC free article] [PubMed] [Google Scholar]
  105. Smith K. E., Crosby R. D., Wonderlich S. A., Forbush K. T., Mason T. B., Moessner M. (2018). Network analysis: an innovative framework for understanding eating disorder psychopathology. Int. J. Eat. Disord. 51 214–222. 10.1002/eat.22836 [DOI] [PMC free article] [PubMed] [Google Scholar]
  106. Smith K. E., Mason T. B., Crosby R. D., Cao L., Leonard R. C., Wetterneck C. T., et al. (2019). A comparative network analysis of eating disorder psychopathology and co-occurring depression and anxiety symptoms before and after treatment. Psychol. Med. 49 314–324. 10.1017/S0033291718000867 [DOI] [PMC free article] [PubMed] [Google Scholar]
  107. Snippe E., Viechtbauer W., Geschwind N., Klippel A., De Jonge P., Wichers M. (2017). The impact of treatments for depression on the dynamic network structure of mental states: two randomized controlled trials. Sci. Rep. 7:46523. 10.1038/srep46523 [DOI] [PMC free article] [PubMed] [Google Scholar]
  108. Solmi M., Collantoni E., Meneguzzo P., Tenconi E., Favaro A. (2019). Network analysis of specific psychopathology and psychiatric symptoms in patients with anorexia nervosa. Eur. Eat. Disord. Rev. 27 24–33. 10.1002/erv.2633 [DOI] [PubMed] [Google Scholar]
  109. Stone D. I. G., DuBois R., DeJesus B., Rodgers R. F., Rizzo C. (2017). A network analysis of self-cutting risk among late adolescent girls exposed to dating violence. J. Adolesc. 61 12–16. 10.1016/j.adolescence.2017.09.002 [DOI] [PubMed] [Google Scholar]
  110. Szalay-Beko M., Palotai R., Szappanos B., Kovács I. A., Papp B., Csermely P. (2012). ModuLand plug-in for cytoscape: determination of hierarchical layers of overlapping network modules and community centrality. Bioinformatics 28 2202–2204. 10.1093/bioinformatics/bts352 [DOI] [PubMed] [Google Scholar]
  111. Terluin B., de Boer M. R., de Vet H. C. (2016). Differences in connection strength between mental symptoms might be explained by differences in variance: reanalysis of network data did not confirm staging. PLoS One 11:e0155205. 10.1371/journal.pone.0155205 [DOI] [PMC free article] [PubMed] [Google Scholar]
  112. Tibshirani R. (1996). Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Series B Stat. Methodol. 58 267–288. 10.1111/j.2517-6161.1996.tb02080.x [DOI] [Google Scholar]
  113. van Borkulo C., Boschloo L., Borsboom D., Penninx B. W. J. H., Lourens J. W., Schoevers R. A. (2015). Association of symptom network structure with the course of longitudinal depression. JAMA Psychiatry 72 1219–1226. 10.1001/jamapsychiatry.2015.2079 [DOI] [PubMed] [Google Scholar]
  114. van Borkulo D., Borsboom D., Epskamp S., Blanken T., Boschloo L., Schoevers R. A., et al. (2014). A new method for constructing networks from binary data. Sci. Rep. 4 1–10. 10.1038/srep05918 [DOI] [PMC free article] [PubMed] [Google Scholar]
  115. van Rooijen G., Isvoranu A. M., Kruijt O. H., van Borkulo C. D., Meijer C. J., Wigman J. T., et al. (2018). A state-independent network of depressive, negative and positive symptoms in male patients with schizophrenia spectrum disorders. Schizophr. Res. 193 232–239. 10.1016/j.schres.2017.07.035 [DOI] [PubMed] [Google Scholar]
  116. Wang H., Huang J., Xu X., Xiao Y. (2014). Damage attack on complex networks. Physica A 408 134–148. 10.1016/j.physa.2014.04.001 [DOI] [Google Scholar]
  117. Wang J. W., Rong L. L. (2009). Cascade-based attack vulnerability on the US power grid. Safety Science 47 1332–1336. 10.1016/j.ssci.2009.02.002 [DOI] [Google Scholar]
  118. Watts D. J., Strogatz S. H. (1998). Collective dynamics of ‘small-world’ networks. Nature 393 440–442. 10.1038/30918 [DOI] [PubMed] [Google Scholar]
  119. Wichers M., Groot P. C., Group E. S. M. (2016). Critical slowing down as a personalized early. Psychother. Psychosom. 85 114–116. 10.1159/000441458 [DOI] [PubMed] [Google Scholar]
  120. Wilcox R. R. (2017). Introduction to Robust Estimation and Hypothesis Testing. London: Academic Press. [Google Scholar]
  121. Wu X., Xia X. (2015). Biological Network Construction, Visualization and Analysis. R Package Version 1.0.0. Available at: https://github.com/cran/ProNet (accessed November 2018). [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

DATA SHEET S1

Plots displaying attack results for each individual network, comparison of the number of modules identified through the Clique Percolation and ModuLand algorithms, and description of the original networks and studies.


Articles from Frontiers in Psychology are provided here courtesy of Frontiers Media SA

RESOURCES