Abstract
Purpose
The network perspective on psychopathology understands mental disorders as complex networks of interacting symptoms. Despite its recent debut, with conceptual foundations in 2008 and empirical foundations in 2010, the framework has received considerable attention and recognition in the last years.
Methods
This paper provides a review of all empirical network studies published between 2010 and 2016 and discusses them according to three main themes: comorbidity, prediction, and clinical intervention.
Results
Pertaining to comorbidity, the network approach provides a powerful new framework to explain why certain disorders may co-occur more often than others. For prediction, studies have consistently found that symptom networks of people with mental disorders show different characteristics than that of healthy individuals, and preliminary evidence suggests that networks of healthy people show early warning signals before shifting into disordered states. For intervention, centrality—a metric that measures how connected and clinically relevant a symptom is in a network—is the most commonly studied topic, and numerous studies have suggested that targeting the most central symptoms may offer novel therapeutic strategies.
Conclusions
We sketch future directions for the network approach pertaining to both clinical and methodological research, and conclude that network analysis has yielded important insights and may provide an important inroad towards personalized medicine by investigating the network structures of individual patients.
Electronic supplementary material
The online version of this article (doi:10.1007/s00127-016-1319-z) contains supplementary material, which is available to authorized users.
Keywords: Comorbidity, Early warning signals, Mental disorders, Network analysis, Treatment
Introduction
In the last years, a growing number of publications have studied mental disorders, such as Major Depressive Disorder (MDD), Post-Traumatic Stress Disorder (PTSD), and psychosis as networks of interacting symptoms. Although this scientific discipline is young, with its conceptual roots in 2008 [1] and its empirical foundations in 2010 [2], it is fast-moving and has gained considerable recognition. The big step forward within the last years has been the development of statistical models that allow for the estimation of empirical psychopathology networks. The present paper aims to provide a review of the contemporary empirical literature on this network conceptualization of psychopathology. For more information on the methodology behind these empirical papers—network psychometrics—we refer the interested reader elsewhere [3–9].
According to the network perspective on psychopathology, a mental disorder can be viewed as a system of interacting symptoms. From this perspective, the causal interplay between symptoms constitutes mental disorders [2, 10, 11]. Taking Major Depressive Disorder (MDD) as an example, depressed patients often experience symptoms, such as sadness, anhedonia, fatigue, insomnia, concentration problems, and suicidal ideation [12], and it is easy to envision causal relationships among these problems, for instance, fatigue → insomnia → concentration problems, or sadness → anhedonia → suicidal ideation. Figure 1a shows an example of such a directed network for a hypothetical depressed patient Susan. Figure 1b, on the other hand, depicts an undirected network estimated in a group of people in cross-sectional data (the syntax to reproduce all figures is available in the Supplementary Materials).
The remainder of the paper is organized into four sections. First, we review publications that aim to explain the comorbidity rates among mental disorders using the network approach. Second, we summarize network studies that have been conducted with the aim of predicting the course of disorders, and to identify indicators of a worse prognosis. Third, we discuss what insights network studies have yielded for clinical intervention. Finally, we discuss implications for future clinical practice and how the network perspective can move forward.
Comorbidity
The presence of multiple disorders at the same time is extremely common in the realm of psychopathology [13]. Comorbidity has received considerable attention in the clinical literature, because patients diagnosed with multiple disorders have poorer prognosis, worse treatment outcomes, and higher suicide rates [14, 15].
Comorbidity from a network perspective
Traditionally, comorbid mental disorders are understood as different disorders, while the network approach hypothesizes that they may co-occur due to mutual interactions among symptoms [2]. Comorbidity, in that view, arises when there are symptoms that bridge two disorders. These so-called bridge symptoms can spread activation from one disorder to the other. Figure 2 represents such a case where a person first develops disorder X (in response to an environmental stressor E), then the bridge symptoms B, and finally disorder Y. X could be MDD, Y could be Generalized Anxiety Disorder (GAD) that often occurs together with MDD, and the bridge symptoms B could be sleep problems, fatigue, concentration problems, or psychomotor agitation that are part of both MDD and GAD DSM-5 criteria [12].
Note that there are numerous other possibilities from a network perspective to explain the comorbidity between X and Y: activation may go the other way around (Y → B → X), or a person could also develop the bridge symptoms B first, and then at the same time both X and Y.
Comorbidity in empirical data
Several cross-sectional studies have investigated how symptoms are related across disorders. In the first empirical network study on the subject, Cramer et al. [2] found that the empirical network structure of MDD and GAD symptoms in a general population sample was entangled. A recent paper replicated these findings in a large clinical sample, also concluding that MDD and GAD symptoms are strongly interconnected [16]. Another team of researchers studied the comorbidity of MDD and complicated grief [17], and showed that symptoms form two distinct clusters that are connected through the symptoms loneliness, emotional pain, and emotional numbing. The authors suggested that emotional pain may be a promising target for psychotherapeutic interventions.
Boschloo et al. [18] used a network analysis in a data set with over 34,000 patients interviewed on 120 symptoms of 12 major DSM-IV disorders. In the resulting network, no sharp boundaries were found between the 12 disorders (i.e., symptoms of different diagnoses were related to each other across diagnoses), and there was substantial symptom overlap across diagnoses. The authors repeated this analysis in a community sample of 2175 preadolescents with 95 emotional and behavioral problems, with similar results [19].
Comorbidity research from a network perspective has also generated new hypotheses for Autism Spectrum Disorder (ASD) and Obsessive–Compulsive Disorder (OCD), both of which share repetitive behaviors. A study in a clinical sample of 213 children revealed that repetitive behaviors seem to connect ASD and OCD symptom clusters, and the authors also found evidence that repetitive behaviors may differ somewhat in people with ASD and people with OCD [20].
One implication of the network view on comorbidity is that diagnoses may co-occur as a function of their number of shared symptoms. As described above, MDD and GAD should have relatively high comorbidities, whereas disorders that share no symptoms, such as schizophrenia and specific phobias, should rarely co-occur because of the lack of bridge symptoms that can transport information. Interestingly, this implication does not derive from the traditional conceptualization of mental disorders as medical conditions, where disorders cause their symptoms [21, 22]. The fact that diagnoses for HIV, cancer, and tuberculosis may share more or less symptoms should not impact strongly on their rates of comorbidity, seeing that they have independent common causes. One study tested that prediction and measured how related the networks of different mental disorders are. They found that empirical comorbidity rates were related to distances between disorders in an analysis of symptom overlap in the DSM [23].1 This means that when two disorders, such as MDD and Dysthymia, share multiple symptoms, the distance between these disorders in the DSM network is small and one can easily travel from one disorder to the other.2
To conclude, zooming in on disorders at symptom level [25, 26], as the network perspective does, reveals how comorbidity might come about. Currently, this issue is empirically unresolved, and the way comorbidity arises may very well be different for different people with the same comorbid diagnoses and different for different types of comorbid diagnoses.
Prediction
While many people experience single symptoms, only part of them develop a mental disorder. One of the most important areas of clinical research is thus the prediction of psychopathology onset, which would allow clinicians earlier interventions. The network literature on prediction has, thus far, focused on two aspects: (1) so-called early warning signals that may indicate the upcoming onset of psychopathology for a specific patient and (2) characteristics of group-level networks that may help predict the future course of psychopathology. It is of note that the work on prediction has mostly investigated emotion dynamics [27]—the temporal associations between emotions, such as sadness, anger, fear, or being content—while little research has been conducted on the dynamics among a broader set of problems or symptoms like insomnia, fatigue, and concentration problems. Such investigations are a topic of future research [28].
Early warning signals
The conceptualization of mental disorders as networks of interacting symptoms allows utilizing insights from scientific fields in which complex systems are well known. One of the most important features of complex systems in this regard is that they can display phase transitions [29] which mark the transitions between healthy and ‘disordered’ states [30]. Identifying early warnings of such transitions is a promising line of research known from other fields, such as ecology or financial markets, where systems can reach a tipping point [29–31]. Lakes, for example, can shift from a clear state to a turbid state, and it is an important question how to best predict such tipping points. Interestingly, right before such phase transitions from one state to another, a system displays early warning signals. Specifically, transitions are preceded by a phenomenon referred to as critical slowing down [29, 32, 33], which means that it takes longer for a system to recover from perturbations. This is reflected by the fact that the system becomes more predictable by its previous states: when close to a transition, the dynamics slow down.
We can use the network of Susan (Fig. 1a) as an example of a bi-stable system with two attractor states: a healthy and a sick state. Assume Susan is now in a healthy state, and an early warning signal would indicate an upcoming tipping point, where her system may suddenly move from healthy to sick. Before a transition occurs, the system slows down, which implies that we can more reliably predict the state of the system at the next time point. In statistical terms, one such sign is increasing autoregressive coefficients (i.e., the self-predictive pathways from a symptom or emotion to itself across time).
Van de Leemput et al. [30] estimated emotion dynamics during critical transitions from healthy to depressed states to see whether these are preceded by early warning signals. Analyzing a large time-series data set, the authors showed that systems exhibited signs of critical slowing down before critical transitions [30]. A second study on early warning signals was published recently on one depressed patient that was measured over 239 days (1474 measurements). This intensive idiographic study, in which the patient decreased his antidepressant intake, also shows evidence for early warning signals before he transitioned into a depressive episode [34]. There is also some work showing that individuals with higher levels of inertia in their emotion dynamics are more likely to develop depression 2.5 years later [35]. Inertia also refers to auto-correlations and implies that emotion networks of individuals at higher risk to develop depression on the long term are characterized by a slower recovery from a given perturbation (i.e., the emotion networks of people at higher risk might recover more slowly from the effect of external influences than those at lower risk). While further investigations are required to understand the nature of emotional inertia, it has been considered “a hallmark of maladaptive emotion dynamics” [27] (p. 984).
An interesting topic in this context is the observation that phase transitions may be more pronounced with increasing levels of connectivity. That is, for weakly connected symptom networks, negative external conditions (i.e., stressful events) lead to a gradual increase in symptoms, whereas for strongly connected networks, external stress leads to a sudden shift from a healthy to depressed state [30]; simulation studies with depression networks support this notion [28, 36]. This may shed new light on a long-standing discussion whether psychopathology is dimensional or categorical [37]: networks with weak connectivity may behave as a continuum in response to stress (i.e., no sudden phase transition; psychopathology is dimensional), while networks with strong connectivity may behave as either healthy or disordered (i.e., sudden phase transitions; psychopathology is categorical). This implies that different people may have the same diagnosis, for instance MDD, but that the connectivity of the network structure would determine whether the disorder is a continuum or a dimension for them.
Prediction via network characteristics
Another important aspect of network research is the prediction of the course of psychopathology from network characteristics of groups of individuals. Two studies showed that the temporal emotion networks of patients with MDD and psychosis [38, 39] were more strongly connected than the temporal emotion networks of healthy controls. Stronger temporal connections between emotions mean that the state of an emotion at a certain timepoint depends strongly on the state of emotions at the previous timepoint. In another study, van Borkulo et al. [40] hypothesized that higher levels of connectivity in depressed patients at baseline are associated with worse outcomes at 2-year follow-up. They found that patients with persistent depression at follow-up had a more densely connected cross-sectional network at baseline compared to remitted patients at follow-up—even after controlling for differences in severity [40]. This is consistent with other work arguing that more densely connected temporal network structures may be more vulnerable to psychopathology [41]. Whether this also applies to particular individuals (in contrast to network structures at the group level), however, remains to be investigated with within-person analyses [42, 43].
Another study on predicting the future course of psychopathology showed that the most interconnected or central depression symptoms in the baseline network were the ones most predictive of future MDD onset (Boschloo et al. [44]). Fatigue and depressed mood, for example, were more predictive of MDD than other symptoms. This implies that the nature of symptoms may play an important role above and beyond the number of symptoms [45].
Clinical intervention
Network analysis may provide promising leads towards improving clinical prevention and intervention strategies by investigating which symptoms are more strongly connected or more central than others. In this section, we will first explain the concept of centrality, and then discuss the results of research that points to possible targets for intervention.
The concept of centrality
If a symptom (e.g., depressed mood) has many connections to other symptoms in a psychopathological system, it may cause the development of these symptoms. The number of connections of a symptom is known as degree centrality. This type of centrality is illustrated in Fig. 3: the red symptom is connected to six other symptoms, whereas all other nodes have a lower number of connections (as indicated by the numbers in each node). The red node thus has a high (degree) centrality and, consequently, may be seen as a risk factor for developing further symptoms [4, 10, 46–48].
That is, if someone develops a symptom that is central, the probability of developing other symptoms will increase more than when someone develops a peripheral symptom.
Degree centrality can be understood to quantify the importance of a node in the network. Other common centrality measures are closeness and betweenness [24], and several papers have described and calculated these centrality measures for psychopathological networks [46, 48]. In directed networks (e.g., longitudinal network models, where nodes predict other nodes over time), degree can be further specified with indegree being the number of connections pointing towards the focal symptom and outdegree being the number of connections pointing from the focal symptom to other symptoms (cf. [4]. Especially, symptoms with a high outdegree might be viable targets for intervention, since they influence many other symptoms.
What are good symptoms for clinical intervention?
Providing an overview of which symptoms are more central than others across studies turns out to be a challenging task for several reasons. Different studies used different variables, making comparisons across studies challenging. For MDD, for instance, different questionnaires were used to assess symptomatology, or researchers analyzed other types of variables, such as emotions or mental states [38, 39, 49]. Other factors that vary across studies are the temporal nature of the data (cross-sectional vs. time-series data), the particular samples studied (e.g., healthy, moderately depressed, and severely depressed samples), and the network estimation methods (e.g., [4, 50]). With these caveats in mind, it seems that the two DSM-5 [12] core symptoms of MDD episode—depressed mood and loss of interest/pleasure—along with energy/fatigue consistently appear as central symptoms and could thus be understood as potential targets for intervention [2, 19, 46, 51, 52].
Since other disorders have not been investigated as frequently, it is not possible to identify similarities across studies. Therefore, we summarize the available literature, urging researchers to replicate these results before translating them into clinical settings. A cross-sectional network study of 2405 adults with different substance abuse disorders revealed that using the substance longer than planned and that the drug interferes with life significantly were highly central [53]. Interestingly, these problems appear in the later course of the disorder, and provide a great example for central symptoms that may not prove to be the best targets for clinical intervention. The symptoms may be central in the cross-sectional substance abuse study primarily because they often develop as a consequence of other symptoms. Rhemtulla et al. also found that the most central symptoms in the full sample differed considerably in their centrality across subgroups of people with different types of substance use disorders (cannabis, sedatives, stimulants, cocaine, opioids, and hallucinogens). For PTSD, McNally et al. concluded from analyzing cross-sectional data that hypervigilance, impaired concentration, and physiological reactivity to reminders of the trauma are promising targets for intervention [54]. Sleep difficulty was also among the most central symptoms, and aiming to stabilize patients’ sleep might be a promising strategy (even before initiating other forms of psychotherapy), which could induce a cascade of symptom deactivation.
Researchers have also included variables other than the symptoms of the disorder itself in networks. First, a cross-sectional study on psychosis included information on childhood trauma in the network of psychosis and psychopathology symptoms, such as anxiety and depression. Different types of childhood trauma were related to psychosis symptoms, but only through general psychopathology symptoms, such as anxiety [55]. Second, protective (resilience) variables might also be included in psychopathological networks (for a brief discussion, see [23]). To our knowledge, only one cross-sectional study investigated this, though not on a symptom level [56]. The authors found resilience to be related to remission of depression and showed it was central in a network with composite scores of other cognitive processes, such as cognitive control, experienced cognitive functioning, maladaptive emotion regulation, and residual depressive symptomatology. Third, Heeren and McNally [57] investigated the cross-sectional network structure of the core symptoms (fear and avoidance) of Social Anxiety Disorder (SAD) with laboratory measures on attention bias. They found that attention bias played an important role in the network, arguing that process-level measures from laboratory tasks can shed more light on the mechanisms of SAD (Heeren and McNally [57].
Future directions
Much exploratory network research has been conducted in the field of psychopathology network research: but where do we go from here? In this section, we will discuss some future perspectives, structured into clinical and methodological research.
Clinical research
From a clinical perspective, we suggest to investigate four topics. First, the network framework generates specific hypotheses about treating disorders that should be explored. In treating comorbid disorders, such as MDD and GAD, for example, targeting bridge symptoms that transfer influence from one part of the network to the other should be the strategy of choice. A related hypothesis is that targeting central symptoms should reduce patients’ symptomatology [46].3 As the majority of research on finding possible targets for intervention is based on cross-sectional data, it is unclear whether an undirected edge between symptoms A and B implies A → B, A ← B, or A ⟷ B.4 Longitudinal analyses allow for an estimation of directed networks which reveal the direction of the association between symptoms, such as A and B (e.g., [51]), and present a more promising route to investigate possible targets for clinical intervention.
Second, and related to the previous point, it should be investigated whether intervening on central symptoms will actually bring benefits to patients. Although studies have collected ESM data in therapeutic settings to provide feedback on patterns of affect [58–60], these data have not been analyzed using network models to derive, for instance, the most central symptoms—and a large crowdsourcing study that does provide feedback via personalized dynamic networks does so only outside a therapeutic setting [61]. Merging these two approaches may provide valuable insights, and we are aware of one such pioneering case study that investigated personalized feedback based on network models within a therapeutic setting [62]. In addition to treatment as usual, the patient received feedback on symptom dynamics and explored the feasibility, acceptability, and usability of such an integrated individualized network approach. This initiated a therapeutic dialogue about possible causes of treatment resistance and may provide new directions towards personalized medicine [63, 64]. While it may not always be feasible or possible to target a specific symptom, establishing that the network framework provides good explanatory and predictive models of psychopathology may imply the need for developing new approaches for targeting specific symptoms.
Third, it would be worthwhile to apply the network perspective to yet unexplored mental disorders. The temporal dynamics of symptoms of Binge Eating Disorder (BED), for example, may be a suitable candidate [12]. One causal pathway could be between the symptoms eating until one feels uncomfortably full and feeling disgusted, depressed, or guilty, which could provide insights into risk factors for the development of BED episodes.
Fourth, besides looking at the interactions of problems (e.g., symptoms), studying factors that contribute to resilience may be worthwhile pursuing [65, 66]. Investigating the role of protective factors in psychopathology networks might inform us how these two opposing forces relate to each other, and eventually inform clinical practice. For example, Alice may benefit from more social interactions in case social isolation leads to sad mood, while Bob may benefit from physical activity in case sad mood is preceded by lack of activity.
Methodological research
Exploring the above questions relies on the accurate and reliable estimation of psychopathological networks. When patients apply for treatment,5 there is often a waiting period in which one could assess the emotion and symptom dynamics with modern phone technology within an idiographic momentary assessment study, and results could inform treatment. Similarly, relapse prevention in remitted patients may benefit from repeated assessment of core symptoms and related factors over time to foresee relapse in an early phase and take preventive measures to counteract its course. This all sounds promising, but before this can be put into effect, there are some methodological issues that need to be addressed of which we will discuss three.
A first issue is what variables to study in psychopathological networks. While cross-sectional network studies have focused on analyzing associations among symptoms, ESM studies have focused on mood states, such as sadness, happiness, anxiety, or anger [4, 38, 49, 67]. It is unclear at present what level of variables is best to study psychopathology.
A second issue is the time frame on which to measure symptoms or emotions. In most ESM studies, the time frame between measurements is a few hours. However, do symptoms or affects change within hours or minutes or days? This might differ for different pairs of symptoms: experiencing somatic arousal (e.g., increased heart rate and sweating) might lead to anticipating a panic attack [43], which will occur within minutes. Sleep problems, on the other hand, might build up for a few days before influencing a person’s irritability. It is currently unknown what the best timeframe is to capture dynamics.
Third, an important point is the generalization of group-level results to the individual level, since many group-level network studies have implied that the identified network structure of the population is more or less reflective of the networks of all individual participants (e.g., [68, 69]). A well-known example of this phenomenon, known as Simpson’s Paradox, is the speed–accuracy tradeoff. At a group-level, a negative relationship exists between typing speed and typing accuracy: people with higher typing speed make fewer errors, likely because experience leads to faster typing and fewer mistakes. At the individual level, however, a person who types faster will make more, not less errors [70]. While this is an extreme example—it seems unlikely that symptoms of mental disorders are predominantly positively associated at group-level, but negatively in the individual—we currently do not know to what extent group-level networks differ from individual networks [43]. A related point was made by Bos and Jonge [71] and Bos and Wanders [42] who warn that between-person effects should not be confused with within-person effects. Taken together, this implies that we need future studies that investigate to which degree idiographic networks match group-level networks, and to disentangle between-person from within-person effects.
Finally, numerous network papers analyzed data that contained a skip structure. This is often the case when large populations are screened via the DSM diagnostic criteria. For a diagnosis of MDD, for instance, subjects need to endorse at least one of the two core symptoms depressed mood or anhedonia. If that is not the case, the remaining seven MDD symptoms are skipped. In statistical analyses, such skipped items are usually recoded as 0s (e.g., [10, 19, 53]), but just because someone does not endorse the core symptoms does not mean that the person cannot exhibit other MDD symptoms. The recoding of missing data to 0s may pose a considerable problem, because it introduces spurious correlations among items (for many people, the seven remaining items will be coded as 0s and thus be highly correlated, although this may not reflect the true correlations among items). Although Boschloo et al. [18] showed similarity of the network structure based on the original data with 49% missing and a subsample with less than 20% missing, it still may have introduced bias. Future research is required to investigate imputation strategies for skip data that go beyond recoding them as 0s.
Summary
In contrast to current categorical diagnostic classifications that hardly fit clinical reality, the network approach offers a model that captures both complexity and individual variation in psychopathology that clinicians and patients immediately recognize. Due to recent statistical advances, these networks and the resulting hypotheses can now be empirically tested and validated, both in nomothetic and idiographic (n = 1) designs. Electronic devices, such as smartphones, watches, and other ‘wearable tech’ offer the possibility of continuous/repeated data collection to address important clinical issues regarding vulnerability for and onset of psychopathology as well as relapse prevention. However, it is also likely to be helpful in regular therapy as it enhances patients’ insight into their own symptom dynamics and how these relate to contextual and behavioral factors that they themselves may be able to influence. Pilot studies suggest that this type of objective and differentiated feedback attributes to traditional ‘talking therapy’ and may also lead to more informed pharmacotherapy [72]. Taken together, the network approach offers a promising conceptual framework to further develop personalized medicine in psychiatry.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Acknowledgements
This paper was supported by European Research Council Consolidator Grant No. 647209.
Compliance with ethical standards
Conflict of interest
None.
Footnotes
Note that this DSM network is not based on empirical data, but each node in the network is a symptom as listed in the DSM. Overlapping symptoms are depicted as one and the same node.
The network distance between symptoms of different disorders is based on the average shortest path length. This measure is calculated by averaging the number of steps (i.e., the number of connections) to travel from each symptom of one disorder to each symptom of the other disorder [24].
The simulation tool "vax" provides a beautiful explanation of centrality and shows how such treatment should work by targeting the most central nodes: http://vax.herokuapp.com/game.
Note that there are two further possibilities that can explain an undirected edge between A and B: an unmodeled influence of a (set of) latent variables C (A ← C → B); and conditioning on a common effect D such that A → D ← B. The latter can arise if D is a variable included in the network, but also when it is not, for instance when the investigated sample has been selected on (a function of) a common effect of the variables in the network.
For an ongoing study on this topic, see http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=5707.
E. I. Fried and C. D. van Borkulo contributed equally to this manuscript.
References
- 1.Borsboom D. Psychometric perspectives on diagnostic systems. J Clin Psychol. 2008;64(9):1089–1108. doi: 10.1002/jclp.20503. [DOI] [PubMed] [Google Scholar]
- 2.Cramer AOJ, Waldorp LJ, van der Maas HLJ, Borsboom D. Comorbidity: a network perspective. Behav Brain Sci. 2010;33(2–3):137–150. doi: 10.1017/S0140525X09991567. [DOI] [PubMed] [Google Scholar]
- 3.Bringmann LF, Hamaker EL, Vigo DE, Aubert A, Borsboom D, Tuerlinckx F (2016) Changing dynamics: time-varying autoregressive models using generalized additive modeling. Psychol Methods. doi:10.1037/met0000085 [DOI] [PubMed]
- 4.Bringmann LF, Vissers N, Wichers M, Geschwind N, Kuppens P, Peeters F, Tuerlinckx F. A network approach to psychopathology: new insights into clinical longitudinal data. PLoS One. 2013;8(4):e60188. doi: 10.1371/journal.pone.0060188. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Epskamp S, Borsboom D, Fried EI (2016) Estimating psychological networks and their accuracy: a tutorial paper. (Arxiv Preprint), 1–27. Retrieved from http://arxiv.org/abs/1604.08462 [DOI] [PMC free article] [PubMed]
- 6.Epskamp S, Maris G, Waldorp LJ, Borsboom D. Network Psychometrics. In: Irwing P, Hughes D, Booth T, editors. Handbook of Psychometrics. New York: Wiley; 2016. [Google Scholar]
- 7.Schuurman NK, Ferrer E, de Boer-Sonnenschein M, Hamaker EL. How to compare cross-lagged associations in a multilevel autoregressive model. Psychol Methods. 2016;21(2):206–221. doi: 10.1037/met0000062. [DOI] [PubMed] [Google Scholar]
- 8.Haslbeck JMB, Waldorp LJ (2015) Structure estimation for mixed graphical models in high-dimensional data. J Stat Softw, VV(Ii). Retrieved from http://arxiv.org/abs/1510.05677
- 9.van Borkulo CD, Borsboom D, Epskamp S, Blanken TF, Boschloo L, Schoevers RA, Waldorp LJ. A new method for constructing networks from binary data. Sci Rep. 2014;4(5918):1–10. doi: 10.1038/srep05918. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Borsboom D, Cramer AOJ. Network analysis: an integrative approach to the structure of psychopathology. Annu Rev Clin Psychol. 2013;9:91–121. doi: 10.1146/annurev-clinpsy-050212-185608. [DOI] [PubMed] [Google Scholar]
- 11.Kendler KS, Zachar P, Craver C. What kinds of things are psychiatric disorders? Psychol Med. 2011;41(6):1143–1150. doi: 10.1017/S0033291710001844. [DOI] [PubMed] [Google Scholar]
- 12.APA (2013) Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition. American Psychiatric Association. Washington, D. Retrieved from http://books.google.com/books?id=S8p3lwEACAAJ&pgis=1
- 13.Kessler RC, Chiu WT, Demler O, Merikangas KR, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):617–627. doi: 10.1001/archpsyc.62.6.617. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Nock MK, Hwang I, Sampson NA, Kessler RM. Mental disorders, comorbidity and suicidal behavior: results from the National Comorbidity Survey Replication. Mol Psychiatry. 2010;15(8):868–876. doi: 10.1038/mp.2009.29. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Schoevers RA, Deeg DJH, van Tilburg W, Beekman ATF. Depression and generalized anxiety disorder: co-occurrence and longitudinal patterns in elderly patients. Am J Geriatr Psychiatry. 2005;13(1):31–39. doi: 10.1097/00019442-200501000-00006. [DOI] [PubMed] [Google Scholar]
- 16.Beard C, Millner AJ, Forgeard MJC, Fried EI, Hsu KJ, Treadway M, Leonard CV, Kertz S, Björgvinsson T. Network analysis of depression and anxiety symptom relations in a psychiatric sample. Psychol Med. 2016;46(16):3359–3369. doi: 10.1017/S0033291716002300. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Robinaugh DJ, Leblanc NJ, Vuletich HA, McNally RJ. Network analysis of persistent complex bereavement disorder in conjugally bereaved adults. J Abnorm Psychol. 2014;123(3):510–522. doi: 10.1037/abn0000002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Boschloo L, van Borkulo CD, Rhemtulla M, Keyes KM, Borsboom D, Schoevers RA. The network structure of symptoms of the diagnostic and statistical manual of mental disorders. PLoS One. 2015;10(9):e0137621. doi: 10.1371/journal.pone.0137621. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Boschloo L, van Borkulo CD, Borsboom D, Schoevers RA. A Prospective Study on How Symptoms in a Network Predict the Onset of Depression. Psychother Psychosom. 2016;85(3):183–184. doi: 10.1159/000442001. [DOI] [PubMed] [Google Scholar]
- 20.Ruzzano L, Borsboom D, Geurts HM. Repetitive behaviors in autism and obsessive-compulsive disorder: new perspectives from a network analysis. J Autism Dev Disord. 2014;45(1):192–202. doi: 10.1007/s10803-014-2204-9. [DOI] [PubMed] [Google Scholar]
- 21.Fried EI. Problematic assumptions have slowed down depression research: why symptoms, not syndromes are the way forward. Front Psychol. 2015;6(306):1–11. doi: 10.3389/fpsyg.2015.00309. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Schmittmann VD, Cramer AOJ, Waldorp LJ, Epskamp S, Kievit RA, Borsboom D. Deconstructing the construct: a network perspective on psychological phenomena. New Ideas in Psychology. 2013;31(1):43–53. doi: 10.1016/j.newideapsych.2011.02.007. [DOI] [Google Scholar]
- 23.Borsboom D, Cramer AOJ, Schmittmann VD, Epskamp S, Waldorp LJ. The small world of psychopathology. PLoS One. 2011;6(11):e27407. doi: 10.1371/journal.pone.0027407. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Opsahl T, Agneessens F, Skvoretz J. Node centrality in weighted networks: generalizing degree and shortest paths. Soc Netw. 2010;32(3):245–251. doi: 10.1016/j.socnet.2010.03.006. [DOI] [Google Scholar]
- 25.Fried EI, Boschloo L, van Borkulo CD, Schoevers RA, Romeijn J-W, Wichers M, Borsboom D. Commentary: “Consistent superiority of selective serotonin reuptake inhibitors over placebo in reducing depressed mood in patients with major depression”. Front Psychol. 2015;6(117):1–3. doi: 10.3389/fpsyt.2015.00117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Persons JB (1986) The advantages of studying psychological phenomena rather than psychiatric diagnoses. Am Psychol 41(11): 1252–60. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/3813184 [DOI] [PubMed]
- 27.Kuppens P, Allen NB, Sheeber LB. Emotional inertia and psychological maladjustment. Psychol Sci. 2010;21(7):984–991. doi: 10.1177/0956797610372634. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Cramer AOJ, van Borkulo CD, Giltay EJ, van der Maas HLJ, Kendler KS, Scheffer M, Borsboom D (2016) Major depression as a complex dynamical system. Arxiv Preprint (ID 1606.00416), 1–38. Retrieved from https://arxiv.org/abs/1606.00416 [DOI] [PMC free article] [PubMed]
- 29.Scheffer M, Bascompte J, Brock WA, Brovkin V, Carpenter SR, Dakos V, Sugihara G. Early-warning signals for critical transitions. Nature. 2009;461(7260):53–59. doi: 10.1038/nature08227. [DOI] [PubMed] [Google Scholar]
- 30.van de Leemput IA, Wichers M, Cramer AOJ, Borsboom D, Tuerlinckx F, Kuppens P, Scheffer M. Critical slowing down as early warning for the onset and termination of depression. Proc Natl Acad Sci USA. 2014;111(1):87–92. doi: 10.1073/pnas.1312114110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Dakos V, Carpenter SR, Brock WA, Ellison AM, Guttal V, Ives AR, Scheffer M. Methods for detecting early warnings of critical transitions in time series illustrated using simulated ecological data. PLoS One. 2012 doi: 10.1371/journal.pone.0041010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Strogatz S (2001) Nonlinear dynamics and chaos: with applications to physics, biology, chemistry, and engineering. Westview Press
- 33.van Nes EH, Scheffer M. Implications of spatial heterogeneity for catastrophic regime shifts in ecosystems. Ecology. 2005;86(7):1797–1807. doi: 10.1890/04-0550. [DOI] [Google Scholar]
- 34.Wichers M, Groot PC, Psychosystems, ESM Group, EWS Group Critical slowing down as a personalized early warning signal for depression. Psychother Psychosom. 2016;85:114–116. doi: 10.1159/000441458. [DOI] [PubMed] [Google Scholar]
- 35.Kuppens P, Sheeber LB, Yap MBH, Whittle S, Simmons JG, Allen NB (2012) Emotional inertia prospectively predicts the onset of depressive disorder in adolescence. Emotion (Washington, D.C.), 12(2), 283–289. http://doi.org/10.1037/a0025046 [DOI] [PubMed]
- 36.van Borkulo CD, van der Maas HLJ, Borsboom D, Cramer AOJ (2014) Vulnerability to depression. http://ccl.northwestern.edu/netlogo/models/community/Vulnerability_To_Depression. Retrieved 20 June 2016
- 37.Borsboom D, Rhemtulla M, Cramer AOJ, van der Maas HLJ, Scheffer M, Dolan CV. Kinds versus continua: a review of psychometric approaches to uncover the structure of psychiatric constructs. Psychol Med. 2016 doi: 10.1017/S0033291715001944. [DOI] [PubMed] [Google Scholar]
- 38.Pe ML, Kircanski K, Thompson RJ, Bringmann LF, Tuerlinckx F, Mestdagh M, Gotlib IH. Emotion-network density in major depressive disorder. Clin Psychol Sci. 2015;3(2):292–300. doi: 10.1177/2167702614540645. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Wigman JTW, van Os J, Borsboom D, Wardenaar KJ, Epskamp S, Klippel A, Wichers M. Exploring the underlying structure of mental disorders: cross-diagnostic differences and similarities from a network perspective using both a top-down and a bottom-up approach. Psychol Med. 2015 doi: 10.1017/S0033291715000331. [DOI] [PubMed] [Google Scholar]
- 40.van Borkulo CD, Boschloo L, Borsboom D, Penninx BWJH, Waldorp LJ, Schoevers RA. Association of symptom network structure with the course of longitudinal depression. JAMA Psychiatry. 2015;72(12):1219. doi: 10.1001/jamapsychiatry.2015.2079. [DOI] [PubMed] [Google Scholar]
- 41.Wichers M, Wigman JTW, Myin-Germeys I. Micro-level affect dynamics in psychopathology viewed from complex dynamical system theory. Emot Rev. 2015;7(4):362–367. doi: 10.1177/1754073915590623. [DOI] [Google Scholar]
- 42.Bos EH, Wanders RBK. Group-level symptom networks in depression. JAMA Psychiatry. 2016;73(4):411. doi: 10.1001/jamapsychiatry.2015.3103. [DOI] [PubMed] [Google Scholar]
- 43.van Borkulo CD, Borsboom D, Schoevers RA. Group-level symptom networks in depression—reply. JAMA Psychiatry. 2016;73(4):411–412. doi: 10.1001/jamapsychiatry.2015.3157. [DOI] [PubMed] [Google Scholar]
- 44.Boschloo L, Schoevers RA, van Borkulo CD, Borsboom D, Albertine J, Oldehinkel AJ. The network structure of psychopathology in a community sample of preadolescents. J Abnorm Psychol. 2016;125(4):599–606. doi: 10.1037/abn0000150. [DOI] [PubMed] [Google Scholar]
- 45.Fried EI, Nesse RM. Depression sum-scores don’t add up: why analyzing specific depression symptoms is essential. BMC Med. 2015;13(72):1–11. doi: 10.1186/s12916-015-0325-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Fried EI, Epskamp S, Nesse RM, Tuerlinckx F, Borsboom D. What are “good” depression symptoms? Comparing the centrality of DSM and non-DSM symptoms of depression in a network analysis. J Affect Disord. 2016;189:314–320. doi: 10.1016/j.jad.2015.09.005. [DOI] [PubMed] [Google Scholar]
- 47.Goekoop R, Goekoop JG. A network view on psychiatric disorders: network clusters of symptoms as elementary syndromes of psychopathology. PLoS One. 2014;9(11):e112734. doi: 10.1371/journal.pone.0112734. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.van Bork R, van Borkulo CD, Waldorp LJ, Cramer AOJ, Borsboom D (2016) Network models for clinical psychology. In: The Stevens’ Handbook of Experimental Psychology and Cognitive Neuroscience (Fourth edn)
- 49.Bringmann LF, Pe ML, Vissers N, Ceulemans E, Borsboom D, Vanpaemel W, Tuerlinckx F, Kuppens P. Assessing temporal emotion dynamics using networks. Assessment. 2016;23(4):425–435. doi: 10.1177/1073191116645909. [DOI] [PubMed] [Google Scholar]
- 50.Epskamp S, Fried EI (2016) A tutorial on regularized partial correlation networks. Arxiv Preprint (ID 1607.01367), 1–21. Retrieved from https://arxiv.org/abs/1607.01367 [DOI] [PubMed]
- 51.Bringmann LF, Lemmens LHJM, Huibers MJH, Borsboom D, Tuerlinckx F. Revealing the dynamic network structure of the beck depression inventory-II. Psychol Med. 2015;45(4):747–757. doi: 10.1017/S0033291714001809. [DOI] [PubMed] [Google Scholar]
- 52.Koenders MA, de Kleijn R, Giltay EJ, Elzinga BM, Spinhoven P, Spijker AT. A network approach to bipolar symptomatology in patients with different course types. PLoS One. 2015;10(10):e0141420. doi: 10.1371/journal.pone.0141420. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Rhemtulla M, Fried EI, Aggen SH, Tuerlinckx F, Kendler KS, Borsboom D. Network analysis of substance abuse and dependence symptoms. Drug Alcohol Depend. 2016;161:230–237. doi: 10.1016/j.drugalcdep.2016.02.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Mcnally RJ, Robinaugh DJ, Wu GWY, Wang L, Deserno MK, Borsboom D. Mental disorders as causal systems: a network approach to posttraumatic stress disorder. Clin Psychol Sci. 2015;3(3):836–849. doi: 10.1177/2167702614553230. [DOI] [Google Scholar]
- 55.Isvoranu A-M, van Borkulo CD, Boyette L-L, Wigman JTW, Vinkers CH, Borsboom D; Group Investigators (2016) A network approach to psychosis: pathways between childhood trauma and psychotic symptoms. Schizophr Bull 1–10. doi:10.1093/schbul/sbw055 [DOI] [PMC free article] [PubMed]
- 56.Hoorelbeke K, Marchetti I, De Schryver M, Koster EHW. The interplay between cognitive risk and resilience factors in remitted depression: a network analysis. J Affect Disord. 2016;195:96–104. doi: 10.1016/j.jad.2016.02.001. [DOI] [PubMed] [Google Scholar]
- 57.Heeren A, McNally RJ. An integrative network approach to social anxiety disorder: the complex dynamic interplay among attentional bias for threat, attentional control, and symptoms. J Anxiety Disord. 2016;42:95–104. doi: 10.1016/j.janxdis.2016.06.009. [DOI] [PubMed] [Google Scholar]
- 58.Aan het Rot M, Hogenelst K, Schoevers RA. Mood disorders in everyday life: a systematic review of experience sampling and ecological momentary assessment studies. Clin Psychol Rev. 2012;32(6):510–523. doi: 10.1016/j.cpr.2012.05.007. [DOI] [PubMed] [Google Scholar]
- 59.Hartmann JA, Wichers M, Menne-Lothmann C, Kramer I, Viechtbauer W, Peeters F, Simons CJP. Experience sampling-based personalized feedback and positive affect: a randomized controlled trial in depressed patients. PLoS One. 2015;10(6):e0128095. doi: 10.1371/journal.pone.0128095. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Kramer I, Simons C, Hartmann JA, Menne-Lothmann C, Viechtbauer W, Peeters F, Wichers M (2014) A therapeutic application of the experience sampling method in the treatment of depression: a randomized controlled trial. World Psychiatry, 13: 68–77. Retrieved from http://onlinelibrary.wiley.com/doi/10.1002/wps.20090/full [DOI] [PMC free article] [PubMed]
- 61.van der Krieke L, Jeronimus BF, Blaawu FJ, Wanders RBK, Emerencia AC, Schenk HM, de Jonge P. HowNutsAreTheDutch (HoeGekIsNL): a crowdsourcing study of mental symptoms and strengths. Int J Methods Psychiatric Res. 2016;25(2):123–144. doi: 10.1002/mpr.1495. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Kroeze R, van Veen DC, Servaas MN, Bastiaansen JA, Oude Voshaar R, Borsboom D, Riese H (2016) Personalized feedback on symptom dynamics of psychopathology: a proof-of-principle study [DOI] [PMC free article] [PubMed]
- 63.Molenaar P (2004) A manifesto on psychology as idiographic science: bringing the person back into scientific psychology, this time forever. Measurement, p 37–41. http://doi.org/10.1207/s15366359mea0204
- 64.Myin-Germeys I, Oorschot M, Collip D, Lataster J, Delespaul P, van Os J. Experience sampling research in psychopathology: opening the black box of daily life. Psychol Med. 2009;39(9):1533–1547. doi: 10.1017/S0033291708004947. [DOI] [PubMed] [Google Scholar]
- 65.Garmezy N. Stress, competence, and development: continuities in the study of schizophrenic adults, children vulnerable to psychopathology, and the search for stress-resistant children. Am J Orthopsychiatry. 1987;57(2):159–174. doi: 10.1111/j.1939-0025.1987.tb03526.x. [DOI] [PubMed] [Google Scholar]
- 66.Luthar SS, Cicchetti D, Becker B. The construct of resilience: a critical evaluation and guidelines for future work. Child Dev. 2000;71(3):543–562. doi: 10.1111/1467-8624.00164. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Wichers M. The dynamic nature of depression: a new micro-level perspective of mental disorder that meets current challenges. Psychol Med. 2014;44(7):1349–1360. doi: 10.1017/S0033291713001979. [DOI] [PubMed] [Google Scholar]
- 68.Kievit RA, Frankenhuis WE, Waldorp LJ, Borsboom D. Simpson’s paradox in psychological science: a practical guide. Front Psychol. 2013 doi: 10.3389/fpsyg.2013.00513. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Robinson WS. Ecological correlations and the behavior of individuals. Am Sociol Rev. 1950;15(3):351–357. doi: 10.2307/2087176. [DOI] [Google Scholar]
- 70.Hamaker EL. Handbook of research methods for studying daily life. Guilford: New York, NY; 2012. Why researchers should think “within-person”: a paradigmatic rationale; pp. 43–61. [Google Scholar]
- 71.Bos EH, De Jonge P. “Critical slowing down in depression” is a great idea that still needs empirical proof. Proc Natl Acad Sci. 2014;111(10):E878. doi: 10.1073/pnas.1323672111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Bos FM, Schoevers RA, aan het Rot M. Experience sampling and ecological momentary assessment studies in psychopharmacology: a systematic review. Eur Neuropsychopharmacol. 2015;25(11):1853–1864. doi: 10.1016/j.euroneuro.2015.08.008. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.