Abstract
Background
Improving the psychotherapies for generalized anxiety disorder (GAD) is dependent on a deeper understanding of the relations between GAD and its associated cognitive factors. In the present study, we investigate how the core feature of GAD (i.e., worry) and its associated cognitive factors, such as meta-worry, intolerance of uncertainty, and attention bias towards threat, relate to each other in men at high risk for GAD.
Methods
We used network analysis to explore the relations among these variables in a cross-sectional sample of 122 men at high risk for generalized anxiety disorder. Specifically, we computed the expected influence and predictability of each variable.
Results
In the final network, we found that worry and meta-worry had the highest expected influence and predictability. In contrast, attention bias towards threat showed the lowest expected influence and predictability. The estimates of the expected influence of the nodes were stable (correlation stability coefficient = 0.52).
Conclusions
The present study is the first to investigate the relations among worry, meta-worry, intolerance of uncertainty, and attention bias towards threat in men at high risk for generalized anxiety disorder. These findings indicate that worry and meta-worry may play important roles in the present network. The implications for clinical interventions and future studies are discussed.
Keywords: Generalized anxiety disorder, High risk, Network analysis, Attention bias, Meta-worry, Intolerance of uncertainty, Worry
Background
Generalized anxiety disorder (GAD) is characterized by excessive and uncontrollable worry about a series of events or activities and is usually accompanied by other nonspecific psychological and physical symptoms that last at least 6 months [1]. This chronic anxiety disorder is one of the most common mental health problems and some representative epidemiological surveys show that the lifetime prevalence is 4.3–5.9% [2]. Additionally, GAD is particularly prevalent in primary care settings and occurs in 7–8% of patients [3]. Individuals with GAD have considerable role impairment and a high comorbidity with depression [4]. If GAD is not treated promptly, its prognosis is poor [5].
Both pharmacotherapies and psychotherapies have shown efficacy in the treatment of GAD [6, 7]. However, with GAD, clinicians and patients are more likely to consider psychotherapies than pharmacotherapies [2]. Among these psychotherapies, cognitive behavioral therapy (CBT) is often considered a first-line therapy because the evidence for the use of CBT is strongest compared with other psychotherapies [7]. Although CBT can effectively reduce symptoms in as many as 50% patients with GAD, it is unclear how best to treat patients who do not respond to these therapies or who respond only partially [8]. Improving the psychotherapies for GAD is dependent on a deeper understanding of the relations between GAD and its associated cognitive factors [9].
There are several cognitive models that focus on cognitions as key factors driving the development and maintenance of GAD (specifically, the core symptom of GAD: worry) [9]. These models include the intolerance of uncertainty model (IUM) [10, 11], the metacognitive model (MCM) [12], and the cognitive-motivational framework (CMF) [13]. These three cognitive models interpret generalized anxiety from different cognitive perspectives, with relevant empirical supports and theory-based treatment strategies [9].
The IUM emphasizes intolerance of uncertainty (IU) as a crucial factor in the development and maintenance of GAD [14, 15]. Previous studies have found that there is a strong correlation between IU and worry [9, 15]. IU is defined as “a dispositional characteristic that arises from a set of negative beliefs about uncertainty and its connotations and consequences” [16]. IU often triggers a chain reaction of worry, negative problem orientation, and cognitive avoidance [17]. Furthermore, individuals who have high IU are more inclined to treat ambiguous phenomena as unacceptable and threatening, thus causing a negative problem orientation, an inability to take action, and an avoidance response style [18, 19]. Thus, they will be more likely to fall into the process of worry. Under this model, the main goals of GAD therapy are increasing the patient’s tolerance and acceptance of uncertainty [20]. Some randomized clinical trial results with moderate to large effects also support this intervention [21–23].
The MCM proposes negative metacognitive beliefs that consist of the uncontrollability of worry and the dangerousness of worry (e.g., “I can’t control my worries” or “my worries will make me ill”) as a central component in the development and maintenance of GAD [24]. In the MCM, two different types of worry exist in individuals with GAD [24–26]. Type-1 worry is worry about external events and internal noncognitive events. It is a strategic choice to cope with a potentially threatening situation, dependent on the activation of positive meta-beliefs about worrying (e.g., “My worries prompt me to prepare in advance”) [24, 27]. In general, these positive beliefs are normal and not necessarily pathological. In the process of Type-1 worry, negative meta-beliefs about worry can be activated because of social learning experiences, internal emotional regulation, and external sources of information [25]. Individuals with GAD may begin to worry that their Type-1 worries are uncontrollable and dangerous. Such “worry about worry” is designated as meta-worry, or Type-2 worry [9, 25]. A large number of researchers have confirmed that there is a strong correlation between negative meta-beliefs (especially “worries are uncontrollable and dangerous”) and worry frequency or severity [9, 26]. These results have important implications for psychotherapy for individuals with GAD, where the uncontrollability and dangerousness of worries should be regarded as a priority target, as in metacognitive therapy (MCT) [12, 19, 28]. Encouragingly, an increasing number of studies indicate that MCT is an effective therapy for individuals with GAD [27, 29, 30] and that it may be more effective than the current “gold-standard” therapies, pharmacotherapies and CBT [27, 31], as well as other psychotherapies such as intolerance-of-uncertainty therapy (IUT) and applied relaxation (AR) [32, 33].
The CMF indicates that attention bias (AB) towards threat is a key process in the causation and maintenance of anxiety [13, 34]. AB towards threat is considered a steady trait-like characteristic that runs automatically, outside the process of consciousness [13, 35, 36]. By strengthening the worrier’s ability to detect and selectively deal with threat cues, AB can lead to excessive and uncontrollable worries [37]. In addition, individuals with GAD or high worries show a significant AB compared with healthy control samples [38]. Hence, attention bias modification training (ABMT) has been developed to decrease anxiety by applying implicit training programs and hundreds of repeated trials that aim to decrease AB [35, 39]. However, conventional ABMT shows disappointing clinical efficacy in reducing anxiety [13, 34]. The complex relations between AB and anxiety require further investigation to improve ABMT for individuals with GAD or high worries [38].
The network approach is an important and innovative approach for mathematically analyzing and visually displaying the relations among complex variables [40, 41]. It is driven by data and is not dependent on prior assumptions of causality among variables [41, 42]. The network consists of two components: nodes, which stand for objects, and edges, which represent the relations between objects [43]. In light of the research conducted using this approach, mental disorders are believed to arise from the direct interplay between symptoms [44–46]. This approach can also give several centrality and predictability indicators for each node to quantify their importance and controllability in the entire network [47, 48]. Thus, the network approach has become increasingly popular in the field of psychopathology in the past few years because it allows people to explore the complex interplay among the symptoms of mental disorders, provides an alternative way to conceptualize mental disorders, and could have direct implications for more accurate and effective treatment [44, 45, 47]. Recently, an increasing number of studies have shown that adding important and meaningful nonsymptom components such as attention bias towards threat [49], resilience factors [50], emotion regulation [51], reproductive biomarkers [52], and genetic risk scores [53] as nodes in related networks is both empirically feasible and theoretically enriching [47, 54]. Therefore, by relying on the methodological advantages of network analysis (especially the centrality and predictability indicators of each node), we hope to clarify how the core symptom of GAD and its associated cognitive factors relate to each other in men at high risk for GAD, and we hope to quantify the importance and predictability of each variable in the present network, so as to provide some references for related interventions and future research.
Research shows that women and men report significant gender differences in their worry and associated cognitive variables [55, 56]. Theoretical research and psychological care regarding men’s mental health are all in the early stage of development [57, 58]. Therefore, this study focuses on men’s mental health and investigates these variables in individuals at high risk for GAD.
In the present study, we use network analysis to investigate how the core feature of GAD (i.e., worry) and its associated cognitive factors, such as meta-worry, intolerance of uncertainty, and attention bias towards threat relate to each other in men at high risk for generalized anxiety disorder. We are particularly interested in the expected influence and predictability of each variable.
Methods
Ethics statement
The independent Ethics Committee of the First Affiliated Hospital of the Fourth Military Medical University approved the implementation of this study (number: KY20182047-F-1). In addition, all participants signed a written informed consent form before participation. They were informed that the present study involved one computer-based task and three scales, and they were ensured that there was no risk of harm in this study and that the results would be kept strictly confidential. As thanks for their participation, we compensated them (approximately 7 US dollars) and taught some simple and practical methods (e.g., breathing relaxation) to ease their anxiety when they experience such feelings.
Participants
The present study is a cross-sectional study. An initial sample of 1286 men undergraduate students majoring in clinical medicine at the Fourth Military Medical University completed the Generalized Anxiety Disorder 7-Item Questionnaire (GAD-7), a brief and valid scale for screening for GAD and evaluating its severity in clinical practice and research [59]. A total of 127 potential participants with no self-reported diagnosis of any mental illness and sum-scores going beyond the clinical cut-off point (GAD-7 ≥ 10) of Spitzer et al. [59] were preliminarily selected to participate in our study, and we defined these potential participants as people who were at high risk for GAD [60]. Then, we contacted all of them, and 124 individuals expressed their willingness to take part in further investigations. Finally, 122 individuals completed our study (GAD-7: range = 10–21, M = 12.50, SD = 2.74, and internal consistency = 0.72).
Measures
The Penn State Worry Questionnaire (PSWQ) is a widely used, reliable, and well-validated assessment that measures the degree to which worry (WO) is general, excessive, and uncontrollable in respondents [61, 62]. The PSWQ has 16 items and each item ranges from 1 (“not at all typical of me”) to 5 (“very typical of me”). The internal consistency of these 16 items in the present study was good (α = 0.83).
The Meta-worry Questionnaire (MWQ) consists of 7 items that typically reflect the common danger themes of mental and physical catastrophe because of worry [24]. Moreover, each item has two response scales: one for measuring the frequency of meta-worry and another for measuring the degree to which the respondents believe the meta-worry at the time of meta-worry occurrence. There is a direct association between meta-worry frequency and the presence of GAD, whilst the influence of meta-worry belief on the presence of GAD is mediated by meta-worry frequency [24]. Thus, we used the meta-worry frequency scale to measure meta-worry (MW). The frequency scale is a four-point scale and each item ranges from 1 to 4 (point marked as “never”, “sometimes”, “often”, and “almost always”, respectively). The internal consistency of this scale in the present study was good (α = 0.80).
The 12-item Intolerance of Uncertainty Scale (IUS-12) is a short, efficient, psychometrically sound scale for measuring IU [63, 64]. Items are rated on a five-point Likert scale ranging from 1 (“not at all characteristic of me”) to 5 (“entirely characteristic of me”). The internal consistency of this scale in the present study was good (α = 0.82).
To capture AB among the respondents, we implemented the dot-probe task (DPT), one of the most commonly utilized tasks for this purpose [65–67]. The DPT in the present study was designed by materials provided by Tel Aviv University/National Institute of Mental Health (https://people.socsci.tau.ac.il/mu/anxietytrauma/research.html). The stimuli for the DPT were 20 pictures consisting of 5 men and 5 women (each individual had one neutral face picture and one angry face picture), and the whole process was programmed in E-Prime 2.0.
In the course of each trial, two pictures of the same individual appeared on the screen in pairs (either neutral-neutral face pairs or angry-neutral face pairs). These 55-mm × 55-mm pictures were presented above and below the fixed cross with a 14-mm gap between them. The present DPT consisted of 120 trials in total (40 neutral-neutral and 80 angry-neutral face pairs). Each trial consisted of four steps: (1) a 500-ms fixation, (2) a 500-ms face-pair cue, (3) an arrow with a direction (probe) that appeared in the position of one of the faces and continued until the participants made a response using the left or right button on the mouse, and (4) a 500-ms intertrial interval. The participants were required to press the left or right button on the mouse as quickly and accurately as possible based on the direction of the arrow shown on the screen. Probes had the same probability of appearing on the top or the bottom for neutral or angry face cues and pointing to the right or the left.
We obtained the AB score by comparing the reaction times (RTs) in the trials for the two probe conditions described as follows. In the angry probe condition, the probe appeared in the position of the angry face in the angry-neutral face pairs, whereas in the neutral probe condition, the probe appeared in the position of the neutral face in the angry-neutral face pairs. The AB score was computed as the average RTs for neutral probes–angry probes. A higher positive score represented a faster response speed when the probe replaced the angry face versus the neutral face, indicating a greater AB towards threatening cues [68]. Before calculating the AB score, we dealt with outliers and errors in the DPT of each participant as follows. Trials with incorrect responses and RTs < 150 ms or > 2000 ms were excluded (0.73% of the trials in the neutral probe condition; 1.26% of the trials in the angry probe condition). Then, RTs that were more than 2.5 SDs below or above each participant’s mean for each probe condition were excluded (2.52% of the trials in the neutral probe condition; 2.96% of the trials in the angry probe condition) [69]. The split-half reliability (first-half/second-half split method) with Spearman–Brown correction of the DPT in the present study was poor (r = 0.18).
This study process was conducted in the following order: DPT, PSWQ, MWQ, and IU-12.
Network analysis
Gaussian graphical models (GGMs) were used to fit our data [70, 71]. GGMs are undirected networks in which an edge depicts a partial correlation between two nodes after the influence of all other variables in the dataset has been controlled for [72]. We tested the assumption of normality using the Kolmogorov-Smirnov test. Unfortunately, the significance levels of MW and IU were still p < 0.05 after the huge transformation. Therefore, we have taken the suggestion of a reviewer and used nonparametric Spearman rho correlations as input for our analyses (for more related details, see Epskamp and Fried, 2018) [72]. In addition, sparse networks should be preferred because they are easier to interpret and are more stable [42, 50]. The graphical least absolute shrinkage and selection operator (LASSO) was run to regularize the partial correlation network [73]. This process causes small partial correlations to be driven to zero, thereby causing them to not appear in the final graph. Thus, the final network is a parsimonious and sparse network. We used the R package qgraph to calculate this network [74]. The qgraph package provides an extended Bayesian information criterion (EBIC) to identify the tuning parameter that optimizes the fit and parsimony of the model, and it gives a specific hyperparameter gamma value [75]. We set gamma to 0.5, as suggested by a previous study, which should effectively balance the sensitivity and specificity in selecting true edges [76].
The network was graphed based on Fruchterman-Reingold algorithm (“spring” layout from package qgraph). This algorithm locates the nodes with stronger correlations near the center of the network, with the nodes with weaker correlations being located near the periphery of the network [77]. The blue edges in the network represent positive partial correlations, whereas the red edges in the network represent negative partial correlations. The thicker the edges are, the greater the partial correlations between two nodes.
Recent studies have shown that strength is the most reliable centrality index, and the centrality indices of betweenness and closeness seem especially unsuitable for assessing the importance of nodes in psychological networks [78, 79]. Node strength is the sum of the absolute value of the edge weights attached to a node, and it may misinterpret the actual effect of nodes on the rest of the network when there are negative edge weights in the network [42, 80]. Thus, we calculated the expected influence (EI). This measure has replaced node strength in the most recent studies due to the evidence that it effectively considers both positive and negative edges within the network [80, 81]. EI was z-scored and computed with the R package qgraph [74]. Higher EI values indicate greater importance in the network [51]. We also calculated the predictability of each node by using the R package mgm [48]. Predictability is defined as the variance in a node that is explained by all its neighboring nodes (i.e., how the value of a node is determined by all of its neighbors on an interpretable absolute scale). Predictability characterizes the controllability of the network: nodes with high predictability indicate that we can control them through their neighboring nodes in the network while nodes with low predictability indicate that we have to look for other variables out of the network or directly intervene on the node itself [48, 82].
We estimated the robustness of our network by using the R package bootnet [83, 84]. First, we evaluated the accuracy of our edge weights by computing 95% confidence intervals (CIs) using a nonparametric bootstrap approach (2000 bootstrap samples). A narrower CI leads to more accurate estimation of edge weights, thereby increasing the accuracy of the centrality index. Second, we estimated the stability of the centrality metrics by computing the correlation stability (CS) coefficient using a case-dropping bootstrap approach. The CS coefficient is the largest number of cases that can be dropped from the entire study to maintain the correlation between the original centrality index and the subsample for at least 0.70 with 95% probability. The value of the CS coefficient should not be below 0.25 and should preferably be higher than 0.50 [83]. Third, bootstrapped difference tests (2000 bootstrap samples and α = 0.05) for the edge weights and node EIs were performed to evaluate whether there is a significant difference between two edge weights or two node EIs.
Results
The demographic data and descriptive statistics of each variable are shown in Table 1.
Table 1.
M | SD | EI | Pre | |
---|---|---|---|---|
Age | 21.01 | 1.57 | ||
Level of education | 14.83 | 1.15 | ||
Worry (WO) | 59.07 | 6.99 | 0.64 | 0.53 |
Meta-worry (MW) | 13.07 | 3.26 | 0.82 | 0.50 |
Intolerance of uncertainty (IU) | 42.63 | 5.86 | −0.08 | 0.39 |
Dot-probe task (DPT) | ||||
Neutral probe condition | 502 | 86 | ||
Angry probe condition | 497 | 92 | ||
Attention bias towards threat (AB) | 4.62 | 15.88 | −1.38 | 0.10 |
Abbreviations: M mean, SD standard deviation, EI expected influence, Pre predictability
The final network is shown in Fig. 1. An edge in this network represents a partial correlation between two nodes after the influence of all other nodes has been controlled for. Moreover, we regularized the partial correlation network by running the graphical LASSO to obtain a parsimonious and sparse network. Several characteristics were immediately obvious. There was a correlation between each variable and the other variables. The regularized partial correlations between WO and MW, between WO and IU, between MW and IU, between MW and AB, between AB and WO, and between AB and IU were 0.41, 0.31, 0.22, 0.11, − 0.04, and − 0.12, respectively. The predictability of each node was shown as a ring around the node and this ring represented the percentage of the variance in a node explained by all its neighboring nodes. The predictability of WO, MW, IU, and AB was 0.53, 0.50, 0.39 and 0.10 respectively, and the average predictability was 0.38 (see Table 1).
The z-scored EI values for each variable in our network (see Table 1; Fig. 2) were calculated to assess their relative importance. The two variables having the greatest expected influence value were MW and WO. This result indicated that, from a statistical perspective, they were the most important nodes in the present network. AB exhibited the lowest expected influence value. This result indicated that, from a statistical perspective, AB was the least important node in the present network. The correlation between EI and predictability was 0.99.
Figure 3 shows the relatively small CIs of the edge weights obtained from the 2000 bootstrap samples. Considering that our network had 122 participants and only 4 nodes, these CIs indicated that the edge weight estimation was accurate. The CS coefficient of EI was 0.52, indicating that the node EI estimation was sufficiently stable (see Fig. 4). The bootstrapped difference tests for the edge weights suggested that the edge weights between WO and MW were significantly different from those between AB and IU, between AB and WO, and between AB and MW; the edge weights between WO and IU were significantly different from those between AB and IU and between AB and WO; and the edge weights between MW and IU were significantly different from those between AB and IU and between AB and WO (see Fig. S1 in Additional file 1). The bootstrapped difference tests for the node EIs suggested that the node EIs of AB were significantly different from those of WO, MW and IU; there are no significant differences among the EIs of WO, MW and IU (see Fig. S2 in Additional file 1).
Discussion
Our analysis is the first to use a regularized partial correlation network approach to investigate the relations among WO, MW, IU, and AB in men at high risk for generalized anxiety disorder. In this regularized partial correlation network, we identified the network structure and assessed the expected influence and predictability of each variable. Putting the core symptom of GAD and its meaningful cognitive factors in one network could provide novel insights for us to understand the related aspects of psychopathology as well as some references for interventions for men at high risk for GAD [47, 49].
The regularized partial correlations between WO and MW and between WO and IU are the strongest in the present network. These findings are consistent with those of many previous studies that indicate strong associations between worry and worry-relevant cognitive constructs, specifically negative meta-beliefs and IU [9, 19, 85]. These results may also indicate that the MCM and IUM are good theoretical conceptualizations of GAD (specifically, the core symptom of GAD: worry). Moreover, the regularized partial correlation between WO and MW is larger than that between WO and IU even though there is no significant difference between these two edges. This result indicates that the MCM may have a higher ability to conceptualize GAD (specifically, the core symptom of GAD: worry) than the IUM. WO shows a large EI in the present network (only lower than MW), which suggests that targeting WO could lead to general benefits in the rest of the other cognitive factors considered in the network. Notably, there are no significant differences among the EIs of WO, MW and IU, which indicates that there may be no significant differences among the general benefits arising from targeting any one of these three variables. In addition, WO has the highest predictability, which suggests that WO is strongly influenced by its neighboring nodes in the network. This result may provide some important insights for future interventions for worry. For example, this research suggests that we could intervene on WO not only via other related factors that are not included in the network or by intervening on WO itself but also via strong neighboring nodes (MW and IU). In particular, it should be noted that predictability is the upper bound estimation [48]. Previous studies have disclosed bidirectional relationships between worry and IU and MW in which a change in one variable partially explained the change in another variable [24, 86]. Some clinical trials have proven that both MCT and IUT are effective treatments for GAD, and both of them can decrease IU and negative beliefs about worrying [32, 33]. Given that MCT primarily utilizes common CBT interventions and that IUT primarily increases tolerance and acceptance of uncertainty and given the positive results of a previous study and the average predictability of WO, MW and IU in the present study [20, 27], we propose that it is practical and not difficult for cognitive behavioral therapists to integrate CBT, MCT, and IUT in their practice for men. Such integration may lead to a better therapeutic effect. Future research can explore how to effectively integrate these three therapies.
MW has the largest EI in the present network, which suggests that targeting MW could lead to general benefits in the rest of the other variables considered in the network. However, it should be noted that there are no significant differences among the EIs of WO, MW and IU. In addition, MW shows a high predictability (only lower than WO), which suggests that MW is strongly influenced by its neighboring nodes in the network. This may provide some important insight, as it suggests we can control MW not only though other related factors that are not included in the network or intervening on MW itself but also via its strong neighboring nodes (WO and IU). In particular, it should be noted that predictability is within the upper bound estimation [48]. According to MCM, it is very feasible to change MW by intervening on WO [24]. A previous study has shown that IUT can decrease negative beliefs about worrying significantly [32]. It should be noted that the MW in our study only reflects negative metacognitive belief that worry is dangerous [24]. As Wells suggested, a cross-sectional study of the relationship between meta-worry and worry must depend on measurement of the meta-worry danger instead of uncontrollability domain when using PSWQ to capture the generality, excessiveness, and uncontrollability domains of worry [24, 61, 62].
IU shows a lower EI when compared with WO and MW. It should be noted that there are no significant differences among the EIs of WO, MW and IU. A significant body of research has proven that IU plays an important role in the development and maintenance of WO [15, 87]. This body of research is bolstered by the fact that IUT has achieved positive clinical effects in treating WO in individuals with GAD [32]. However, more studies are needed to determine the relative importance of IU in GAD symptoms and associated cognitive factors.
AB has the only EI that differs significantly (and is significantly lower) from the other nodes in the network, which suggests that targeting AB could lead to few benefits in the rest of the other variables considered in the network. In fact, AB keeps directly related to all other variables even though these connections are slight. This result indicates that the CMF may have a limited ability to conceptualize GAD (specifically, the core symptom of GAD: worry). On the one hand, this may be due to method variance, where the regularized procedure shrinks the smallest edges to zero. On the other hand, it may be because all the variables with the exception of the AB measure are self-report measures, which are likely to show stronger relations. In addition, AB shows a low predictability, which suggests that AB is slightly influenced by its neighboring nodes in the network. It should be noted that the reliability of related results and conclusions regarding AB are greatly reduced due to the poor split-half reliability of the DPT in the present study. Moreover, an increasing number of studies show that the reliability of the DPT is poor, which means that the DPT may not be suitable for assessing AB [88, 89]. Therefore, more fine-grained and reliable AB estimates such as eye-tracking, event-related potentials and functional magnetic resonance imaging, can be used in future studies [13, 90–93]. Nonetheless, we tested whether participants exhibited AB towards threat significantly greater than 0, and the result, t(121) = 3.417, p < 0.001, means that there is a significant difference. However, it remains hard to explain these data without healthy and clinical control groups.
There are several limitations in the present study worth mentioning. First, all the participants were male undergraduate students majoring in clinical medicine, which limits the universality of our conclusions. Medical students may be more sensitive to MW because of their professional knowledge and they are more aware of the dangers. Moreover, as mentioned above, research shows that women and men report significant gender differences in their worry and associated cognitive variables [55, 56]. The resulting network structure and related indicators (such as the expected influence and predictability of each node) could differ when tested in women. Therefore, the discussion of the findings and the derived potential implications of the present study should be limited to men. Second, this study sampled only individuals at high risk for GAD, rather than clinical samples. It is urgently necessary to verify our results in clinical samples. Third, as suggested by a reviewer, expanding the network to include the full set of GAD symptoms in the GAD-7 as nodes might indeed provide a more integrative view of the relative contribution of different cognitive factors to worry and other GAD symptom levels as well as the relations among the different symptoms. However, due to the current sample size and the heterogeneity of the symptom measures, we did not include the full set of GAD symptoms as nodes in the present network. Future studies can further explore such networks. Fourth, the relationship discussed here cannot be considered causal in our cross-sectional study, and longitudinal data are needed. Recently, experience sampling methodology (ESM) has become increasingly popular in the field of mental health because of its ability to capture variables over time [94, 95]. Future studies can use ESM to explore the time causality of these variables and obtain personalized network models for personalized intervention. Finally, the reliability of the related results and conclusions regarding AB is greatly reduced due to the poor split-half reliability of the DPT in the present study. More fine-grained and reliable AB estimates, such as eye-tracking, event-related potentials and functional magnetic resonance imaging, can be used in future studies [13, 90–93].
Conclusions
The present study is the first to use network analysis to investigate the relations among worry, meta-worry, intolerance of uncertainty, and attention bias towards threat in men at high risk for generalized anxiety disorder. The results indicate that the largest partial correlation is between worry and meta-worry and that worry and meta-worry have the highest expected influence and predictability in the present work. These findings indicate that worry and meta-worry may play important roles in the present network. The implications for clinical interventions and future studies are discussed.
Supplementary information
Acknowledgements
Not applicable.
Abbreviations
- GAD
Generalized anxiety disorder
- CBT
Cognitive behavioral therapy
- IUM
Intolerance of uncertainty model
- MCM
Metacognitive model
- CMF
Cognitive-motivational framework
- IU
Intolerance of uncertainty
- MW
Meta-worry
- MCT
Metacognitive therapy
- IUT
Intolerance-of-uncertainty therapy
- AR
Applied relaxation
- AB
Attention bias towards threat
- ABMT
Attention-bias modification training
- GAD-7
Generalized anxiety disorder 7-item Questionnaire
- PSWQ
Penn state worry questionnaire
- WO
Worry
- MWQ
Meta-worry questionnaire
- IUS-12
12-item Intolerance of uncertainty scale
- DPT
Dot-probe task
- RT
Reaction times
- GGM
Gaussian graphical models
- LASSO
least absolute shrinkage and selection operator
- EBIC
Extended Bayesian information criterion
- EI
Expected influence
- CIs
Confidence intervals
- CS
Correlation stability
- M
Mean
- SD
Standard deviation
- Pre
Predictability
- ESM
Experience sampling methodology
Authors’ contributions
LR, ZY, YDW, LBC, YCJ, ZJM, QTZ, ZYW, HNW and QY conceived and designed the study and interpreted the study results. LR and ZY analysed the data. LR, ZY and YDW wrote the paper. LBC, YCJ, ZJM, QTZ, ZYW, HNW and QY critically reviewed drafts of the paper. All authors approved the final version of the manuscript.
Funding
This study was supported by grant 2020SF-245 from the Key Research and Development Program of Shaanxi Province (to Dr. Long-Biao Cui). The funding body had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
Written informed consent was obtained from all individual participants included in the study. The independent Ethics Committee, First Affiliated Hospital of Fourth Military Medical University approved the conductance of this study. (Number:KY20182047-F-1).
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Lei Ren, Zhou Yang and Yidi Wang contributed equally to this work.
Contributor Information
Hua-Ning Wang, Email: xskzhu@fmmu.edu.cn.
Qun Yang, Email: yangqun1125@hotmail.com.
Supplementary information
Supplementary information accompanies this paper at 10.1186/s12888-020-02849-w.
References
- 1.American Psychiatric Association . Diagnostic and statistical manual of mental disorders. 5. Washington DC: American Psychiatric Association; 2013. [Google Scholar]
- 2.Tyrer P, Baldwin D. Generalised anxiety disorder. Lancet. 2006;368(9553):2156–2166. doi: 10.1016/S0140-6736(06)69865-6. [DOI] [PubMed] [Google Scholar]
- 3.Kroenke K, Spitzer RL, Williams JBW, Monahan PO, Lowe B. Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med. 2007;146(5):317–325. doi: 10.7326/0003-4819-146-5-200703060-00004. [DOI] [PubMed] [Google Scholar]
- 4.Kessler RC, DuPont RL, Berglund P, Wittchen HU. Impairment in pure and comorbid generalized anxiety disorder and major depression at 12 months in two national surveys. Am J Psychiatry. 1999;156(12):1915–1923. doi: 10.1176/ajp.156.12.1915. [DOI] [PubMed] [Google Scholar]
- 5.Yonkers KA, Warshaw MG, Massion AO, Keller MB. Phenomenology and course of generalised anxiety disorder. Br J Psychiatry. 1996;168(3):308–313. doi: 10.1192/bjp.168.3.308. [DOI] [PubMed] [Google Scholar]
- 6.Bandelow B, Reitt M, Rover C, Michaelis S, Gorlich Y, Wedekind D. Efficacy of treatments for anxiety disorders: a meta-analysis. Int Clin Psychopharmacol. 2015;30(4):183–192. doi: 10.1097/YIC.0000000000000078. [DOI] [PubMed] [Google Scholar]
- 7.Cuijpers P, Sijbrandij M, Koole S, Huibers M, Berking M, Andersson G. Psychological treatment of generalized anxiety disorder: a meta-analysis. Clin Psychol Rev. 2014;34(2):130–140. doi: 10.1016/j.cpr.2014.01.002. [DOI] [PubMed] [Google Scholar]
- 8.Stein MB, Sareen J. Generalized Anxiety Disorder. New Engl J Med. 2015;373(21):2059–2068. doi: 10.1056/NEJMcp1502514. [DOI] [PubMed] [Google Scholar]
- 9.Behar E, DiMarco ID, Hekler EB, Mohlman J, Staples AM. Current theoretical models of generalized anxiety disorder (GAD): conceptual review and treatment implications. J Anxiety Disord. 2009;23(8):1011–1023. doi: 10.1016/j.janxdis.2009.07.006. [DOI] [PubMed] [Google Scholar]
- 10.Dugas MJ, Hélène L, Josée R, Freeston MH, Ladouceur R. Worry and problem solving: evidence of a specific relationship. Cognitive Ther Res. 1995;19(1):109–120. [Google Scholar]
- 11.Dugas MJ, Robichaud M. Cognitive-behavioral treatment for generalized anxiety disorder: from science to practice. 1. New York: Routledge; 2007. [Google Scholar]
- 12.Wells A. Cognitive therapy of anxiety disorders: a practice manual and conceptual guide. UK: Wiley; 1997. [Google Scholar]
- 13.Mogg K, Bradley BP. Anxiety and threat-related attention: cognitive-motivational framework and treatment. Trends Cogn Sci. 2018;22(3):225–240. doi: 10.1016/j.tics.2018.01.001. [DOI] [PubMed] [Google Scholar]
- 14.Dugas MJ, Buhr K, Ladouceur R. The role of intolerance of uncertainty in etiology and maintenance. In: Heimberg RG, Turk CL, Mennin DS, editors. Generalized anxiety disorder: advances in research and practice. New York: Guilford; 2004. pp. 143–163. [Google Scholar]
- 15.Buhr K, Dugas MJ. Investigating the construct validity of intolerance of uncertainty and its unique relationship with worry. J Anxiety Disord. 2006;20(2):222–236. doi: 10.1016/j.janxdis.2004.12.004. [DOI] [PubMed] [Google Scholar]
- 16.Koerner N, Dugas MJ. An investigation of appraisals in individuals vulnerable to excessive worry: the role of intolerance of uncertainty. Cognitive Ther Res. 2008;32(5):619–638. [Google Scholar]
- 17.Dugas MJ, Gagnon F, Ladouceur R, Freeston MH. Generalized anxiety disorder: a preliminary test of a conceptual model. Behav Res Ther. 1998;36(2):215–226. doi: 10.1016/s0005-7967(97)00070-3. [DOI] [PubMed] [Google Scholar]
- 18.Hock M, Krohne HW. Coping with threat and memory for ambiguous information: testing the repressive discontinuity hypothesis. Emotion. 2004;4(1):65–86. doi: 10.1037/1528-3542.4.1.65. [DOI] [PubMed] [Google Scholar]
- 19.Thielsch C, Andor T, Ehring T. Do metacognitions and intolerance of uncertainty predict worry in everyday life? An ecological momentary assessment study. Behav Ther. 2015;46(4):532–543. doi: 10.1016/j.beth.2015.05.001. [DOI] [PubMed] [Google Scholar]
- 20.Robichaud M, Dugas MJ. A cognitive-behavioral treatment targeting intolerance of uncertainty. In: Davey G, Wells A, editors. Worry and its psychological disorders: theory, assessment and treatment. West Sussex: Wiley; 2006. pp. 289–304. [Google Scholar]
- 21.Dugas MJ, Brillon P, Savard P, Turcotte J, Gaudet A, Ladouceur R, et al. A randomized clinical trial of cognitive-behavioral therapy and applied relaxation for adults with generalized anxiety disorder. Behav Ther. 2010;41(1):46–58. doi: 10.1016/j.beth.2008.12.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Gosselin P, Ladouceur R, Morin CM, Dugas MJ, Baillargeon L. Benzodiazepine discontinuation among adults with GAD: a randomized trial of cognitive-behavioral therapy. J Consult Clin Psych. 2006;74(5):908–919. doi: 10.1037/0022-006X.74.5.908. [DOI] [PubMed] [Google Scholar]
- 23.Robichaud M. Cognitive behavior therapy targeting intolerance of uncertainty: application to a clinical case of generalized anxiety disorder. Cogn Behav Pract. 2013;20(3):251–263. [Google Scholar]
- 24.Wells A. The metacognitive model of GAD: assessment of meta-worry and relationship with DSM-IV generalized anxiety disorder. Cognitive Ther Res. 2005;29(1):107–121. [Google Scholar]
- 25.Wells A. Meta-cognition and worry: a cognitive model of generalized anxiety disorder. Behav Cogn Psychoth. 1995;23(3):301–320. [Google Scholar]
- 26.Wells A. A cognitive model of GAD: metacognitions and pathological worry. In: Heimberg RG, Turk CL, Mennin DS, editors. Generalized anxiety disorder: advances in research and practice. New York: Guilford; 2004. pp. 164–186. [Google Scholar]
- 27.van der Heiden C. Metacognitions in generalized anxiety disorder: theoretical and practical perspectives. Expert Rev Neurother. 2013;13(2):135–141. doi: 10.1586/ern.12.161. [DOI] [PubMed] [Google Scholar]
- 28.Wells A. Metacognitive therapy for anxiety and depression. New York: Guilford; 2009. [Google Scholar]
- 29.Normann N, Morina N. The efficacy of metacognitive therapy: a systematic review and meta-analysis. Front Psychol. 2018. 10.3389/fpsyg.2018.02211. [DOI] [PMC free article] [PubMed]
- 30.McEvoy PM. Metacognitive therapy for anxiety disorders: a review of recent advances and future research directions. Curr Psychiat Rep. 2019. 10.1007/s11920-019-1014-3. [DOI] [PubMed]
- 31.Nordahl HM, Borkovec TD, Hagen R, Kennair LEO, Hjemdal O, Solem S, et al. Metacognitive therapy versus cognitive-behavioural therapy in adults with generalised anxiety disorder. BJPsych Open. 2018;4(5):393–400. doi: 10.1192/bjo.2018.54. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.van der Heiden C, Muris P, van der Molen HT. Randomized controlled trial on the effectiveness of metacognitive therapy and intolerance-of-uncertainty therapy for generalized anxiety disorder. Behav Res Ther. 2012;50(2):100–109. doi: 10.1016/j.brat.2011.12.005. [DOI] [PubMed] [Google Scholar]
- 33.Wells A, Welford M, King P, Papageorgiou C, Wisely J, Mendel E. A pilot randomized trial of metacognitive therapy vs applied relaxation in the treatment of adults with generalized anxiety disorder. Behav Res Ther. 2010;48(5):429–434. doi: 10.1016/j.brat.2009.11.013. [DOI] [PubMed] [Google Scholar]
- 34.Mogg K, Bradley BP. Anxiety and attention to threat: cognitive mechanisms and treatment with attention bias modification. Behav Res Ther. 2016;87:76–108. doi: 10.1016/j.brat.2016.08.001. [DOI] [PubMed] [Google Scholar]
- 35.MacLeod C, Clarke PJF. The attentional bias modification approach to anxiety intervention. Clin Psychol Sci. 2015;3(1):58–78. [Google Scholar]
- 36.Cisler JM, Koster EHW. Mechanisms of attentional biases towards threat in anxiety disorders: an integrative review. Clin Psychol Rev. 2010;30(2):203–216. doi: 10.1016/j.cpr.2009.11.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Mathews A. Why worry? The cognitive function of anxiety. Behav Res Ther. 1990;28(6):455–468. doi: 10.1016/0005-7967(90)90132-3. [DOI] [PubMed] [Google Scholar]
- 38.Goodwin H, Yiend J, Hirsch CR. Generalized anxiety disorder, worry and attention to threat: a systematic review. Clin Psychol Rev. 2017;54:107–122. doi: 10.1016/j.cpr.2017.03.006. [DOI] [PubMed] [Google Scholar]
- 39.Bar-Haim Y. Research review: attention bias modification (ABM): a novel treatment for anxiety disorders. J Child Psychol Psyc. 2010;51(8):859–870. doi: 10.1111/j.1469-7610.2010.02251.x. [DOI] [PubMed] [Google Scholar]
- 40.Galderisi S, Rucci P, Kirkpatrick B, Mucci A, Gibertoni D, Rocca P, et al. Interplay among psychopathologic variables, personal resources, context-related factors, and real-life functioning in individuals with schizophrenia a network analysis. Jama Psychiatry. 2018;75(4):396–404. doi: 10.1001/jamapsychiatry.2017.4607. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Beard C, Millner AJ, Forgeard MJC, Fried EI, Hsu KJ, Treadway MT, et al. Network analysis of depression and anxiety symptom relationships in a psychiatric sample. Psychol Med. 2016;46(16):3359–3369. doi: 10.1017/S0033291716002300. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Costantini G, Epskamp S, Borsboom D, Perugini M, Mõttus R, Waldorp LJ, et al. State of the aRt personality research: a tutorial on network analysis of personality data in R. J Res Pers. 2015;54(1):13–29. [Google Scholar]
- 43.Boccalettia S, Latora V, Moreno Y, Chavez M, Hwang D-U. Complex networks: structure and dynamics. Phys Rep. 2006;424(4–5):175–308. [Google Scholar]
- 44.Hofmann SG, Curtiss J, Mcnally RJ. A complex network perspective on clinical science. Perspect Psychol Sci. 2016;11(5):597–605. doi: 10.1177/1745691616639283. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Borsboom D. A network theory of mental disorders. World Psychiatry. 2017;16(1):5–13. doi: 10.1002/wps.20375. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Borsboom D, Cramer A, Kalis A. Brain disorders? Not really why network structures block reductionism in psychopathology research. Behav Brain Sci. 2019;42(e2):1–63. [DOI] [PubMed]
- 47.Contreras A, Nieto I, Valiente C, Espinosa R, Vazquez C. The study of psychopathology from the network analysis perspective: a systematic review. Psychother Psychosom. 2019;88(2):71–83. doi: 10.1159/000497425. [DOI] [PubMed] [Google Scholar]
- 48.Haslbeck JMB, Fried EI. How predictable are symptoms in psychopathological networks? A reanalysis of 18 published datasets. Psychol Med. 2017;47(16):2767–2776. doi: 10.1017/S0033291717001258. [DOI] [PubMed] [Google Scholar]
- 49.Heeren A, McNally RJ. An integrative network approach to social anxiety disorder: the complex dynamic interplay among attentional bias for threat, attentional control, and symptoms. J Anxiety Disord. 2016;42:95–104. doi: 10.1016/j.janxdis.2016.06.009. [DOI] [PubMed] [Google Scholar]
- 50.Hoorelbeke K, Marchetti I, De Schryver M, Koster EHW. The interplay between cognitive risk and resilience factors in remitted depression: a network analysis. J Affect Disorders. 2016;195:96–104. doi: 10.1016/j.jad.2016.02.001. [DOI] [PubMed] [Google Scholar]
- 51.Everaert J, Joormann J. Emotion regulation difficulties related to depression and anxiety: a network approach to model relations among symptoms, positive reappraisal, and repetitive negative thinking. Clin Psychol Sci. 2019;7(6):1304–1318. [Google Scholar]
- 52.Santos H, Fried EI, Asafu-Adjei J, Ruiz RJ. Network structure of perinatal depressive symptoms in Latinas: relationship to stress and reproductive biomarkers. Res Nurs Health. 2017;40(3):218–228. doi: 10.1002/nur.21784. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Isvoranu A-M, Guloksuz S, Epskamp S, van Os J, Borsboom D. Group Investigators. Toward incorporating genetic risk scores into symptom networks of psychosis. Psychol Med. 2019;50(4):636–43. [DOI] [PMC free article] [PubMed]
- 54.Jones PJ, Heeren A, Mcnally RJ. Commentary: a network theory of mental disorders. Front Psychol. 2017;8:1305–1307. doi: 10.3389/fpsyg.2017.01305. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Robichaud M, Dugas MJ, Conway M. Gender differences in worry and associated cognitive-behavioral variables. J Anxiety Disord. 2003;17(5):501–516. doi: 10.1016/s0887-6185(02)00237-2. [DOI] [PubMed] [Google Scholar]
- 56.McLean CP, Anderson ER. Brave men and timid women? A review of the gender differences in fear and anxiety. Clin Psychol Rev. 2009;29(6):496–505. doi: 10.1016/j.cpr.2009.05.003. [DOI] [PubMed] [Google Scholar]
- 57.Bilsker D, Fogarty AS, Wakefield MA. Critical issues in Men's mental health. Can J Psychiatr. 2018;63(9):590–596. doi: 10.1177/0706743718766052. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Whitley R. Men's mental health: beyond victim-blaming. Can J Psychiatr. 2018;63(9):577–580. doi: 10.1177/0706743718758041. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Spitzer RL, Kroenke K, Williams JBW, Lowe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–1097. doi: 10.1001/archinte.166.10.1092. [DOI] [PubMed] [Google Scholar]
- 60.Kapoor A, Si K, Yu AYX, Lanctot KL, Herrmann N, Murray BJ, et al. Younger age and depressive symptoms predict high risk of generalized anxiety after stroke and transient ischemic attack. Stroke. 2019;50(9):2359–2363. [Google Scholar]
- 61.Meyer TJ, Miller ML, Metzger RL, Borkovec TD. Development and validation of the Penn State worry questionnaire. Behav Res Ther. 1990;28(6):487–495. doi: 10.1016/0005-7967(90)90135-6. [DOI] [PubMed] [Google Scholar]
- 62.Zhong J, Wang C, Li J, Liu J. Penn State worry questionnaire: structure and psychometric properties of the Chinese version. J Zhejiang Univ Sci B. 2009;10(3):211–218. doi: 10.1631/jzus.B0820189. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Carleton RN, Norton MAPJ, Asmundson GJG. Fearing the unknown: a short version of the intolerance of uncertainty scale. J Anxiety Disord. 2007;21(1):105–117. doi: 10.1016/j.janxdis.2006.03.014. [DOI] [PubMed] [Google Scholar]
- 64.Birrell J, Meare K, Wilkinson A, Freeston M. Toward a definition of intolerance of uncertainty: a review of factor analytical studies of the intolerance of uncertainty scale. Clin Psychol Rev. 2011;31(7):1198–1208. doi: 10.1016/j.cpr.2011.07.009. [DOI] [PubMed] [Google Scholar]
- 65.MacLeod C, Mathews A, Tata P. Attentional bias in emotional disorders. J Abnorm Psychol. 1986;95(1):15–20. doi: 10.1037//0021-843x.95.1.15. [DOI] [PubMed] [Google Scholar]
- 66.Bar-Haim Y, Lamy D, Pergamin L, Bakermans-Kranenburg MJ, van Ijzendoorn MH. Threat-related attentional bias in anxious and nonanxious individuals: a meta-analytic study. Psychol Bull. 2007;133(1):1–24. doi: 10.1037/0033-2909.133.1.1. [DOI] [PubMed] [Google Scholar]
- 67.van Rooijen R, Ploeger A, Kret ME. The dot-probe task to measure emotional attention: a suitable measure in comparative studies? Psychon B Rev. 2017;24(6):1686–1717. doi: 10.3758/s13423-016-1224-1. [DOI] [PubMed] [Google Scholar]
- 68.Dennis TA, O'Toole LJ. Mental health on the go: effects of a Gamified attention-Bias modification Mobile application in trait-anxious adults. Clin Psychol Sci. 2014;2(5):576–590. doi: 10.1177/2167702614522228. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Sipos ML, Bar-Haim Y, Abend R, Adler AB, Bliese PD. Postdeployment threat-related attention bias interacts with combat exposure to account for PTSD and anxiety symptoms in soldiers. Depress Anxiety. 2014;31(2):124–129. doi: 10.1002/da.22157. [DOI] [PubMed] [Google Scholar]
- 70.Lauritzen SL, Wermuth N. Graphical models for associations between variables, some of which are qualitative and some quantitative. Ann Stat. 1989;17(1):31–57. [Google Scholar]
- 71.Epskamp S, Waldorp LJ, Mottus R, Borsboom D. The Gaussian graphical model in cross-sectional and time-series data. Multivar Behav Res. 2018;53(4):453–480. doi: 10.1080/00273171.2018.1454823. [DOI] [PubMed] [Google Scholar]
- 72.Epskamp S, Fried EI. A tutorial on regularized partial correlation networks. Psychol Methods. 2018;23(4):617–634. doi: 10.1037/met0000167. [DOI] [PubMed] [Google Scholar]
- 73.Friedman J, Hastie T, Tibshirani R. Sparse inverse covariance estimation with the graphical lasso. Biostatistics. 2008;9(3):432–441. doi: 10.1093/biostatistics/kxm045. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Epskam S, Cramer AOJ, Waldorp LJ, Schmittmann VD, Borsboom D. Qgraph: network visualizations of relationships in psychometric data. J Stat Softw. 2012;48(4):1–18. [Google Scholar]
- 75.Chen JH, Chen ZH. Extended Bayesian information criteria for model selection with large model spaces. Biometrika. 2008;95(3):759–771. [Google Scholar]
- 76.Foygel R, Drton M. Extended Bayesian information criteria for Gaussian graphical models. Adv Neural Inform Process Syst. 2010;23:2020–2028. [Google Scholar]
- 77.Fruchterman TMJ, Reingold EM. Graph drawing by force-directed placement. Software Pract Exper. 1991;21(11):1129–1164. [Google Scholar]
- 78.Epskamp S, Rhemtulla M, Borsboom D. Generalized network psychometrics: combining network and latent variable models. Psychometrika. 2017;82(4):904–927. doi: 10.1007/s11336-017-9557-x. [DOI] [PubMed] [Google Scholar]
- 79.Bringmann LF, Elmer T, Epskamp S, Krause RW, Schoch D, Wichers M, et al. What do centrality measures measure in psychological networks? J Abnorm Psychol. 2019;128(8):892–903. doi: 10.1037/abn0000446. [DOI] [PubMed] [Google Scholar]
- 80.Robinaugh DJ, Millner AJ, McNally RJ. Identifying highly influential nodes in the complicated grief network. J Abnorm Psychol. 2016;125(6):747–757. doi: 10.1037/abn0000181. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Ge FF, Yuan ML, Li Y, Zhang J, Zhang W. Changes in the network structure of posttraumatic stress disorder symptoms at different time points among youth survivors: a network analysis. J Affect Disoreders. 2019;259:288–295. doi: 10.1016/j.jad.2019.08.065. [DOI] [PubMed] [Google Scholar]
- 82.Haslbeck JMB, Waldorp LJ. How well do network models predict observations? On the importance of predictability in network models. Behav Res Methods. 2018;50(2):853–861. doi: 10.3758/s13428-017-0910-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Epskamp S, Borsboom D, Fried EI. Estimating psychological networks and their stability: a tutorial paper. Behav Res Methods. 2018;50(1):195–212. doi: 10.3758/s13428-017-0862-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Borsboom D, Robinaugh DJ, Rhemtulla M, Cramer AOJ, Psychosyst G. Robustness and replicability of psychopathology networks. World Psychiatry. 2018;17(2):143–144. doi: 10.1002/wps.20515. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Britton GI, Neale SE, Davey GCL. The effect of worrying on intolerance of uncertainty and positive and negative beliefs about worry. J Behav Ther Exp Psy. 2019;62:65–71. doi: 10.1016/j.jbtep.2018.09.002. [DOI] [PubMed] [Google Scholar]
- 86.Dugas MJ, Laugesen N, Bukowski WM. Intolerance of uncertainty, fear of anxiety, and adolescent worry. J Abnorm Child Psychol. 2012;40(6):863–870. doi: 10.1007/s10802-012-9611-1. [DOI] [PubMed] [Google Scholar]
- 87.Bomyea J, Ramsawh H, Ball TM, Taylor CT, Paulus MP, Lang AJ, et al. Intolerance of uncertainty as a mediator of reductions in worry in a cognitive behavioral treatment program for generalized anxiety disorder. J Anxiety Disord. 2015;33:90–94. doi: 10.1016/j.janxdis.2015.05.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.MacLeod C, Grafton B, Notebaert L. Anxiety-linked Attentional Bias: is it reliable? Annu Rev Clin Psycho. 2019;15:529–554. doi: 10.1146/annurev-clinpsy-050718-095505. [DOI] [PubMed] [Google Scholar]
- 89.Chapman A, Devue C, Grimshaw GM. Fleeting reliability in the dot-probe task. Psychol Res. 2019;83(2):308–320. doi: 10.1007/s00426-017-0947-6. [DOI] [PubMed] [Google Scholar]
- 90.Sanchez-Lopez A, Koster EHW, Van Put J, De Raedt R. Attentional disengagement from emotional information predicts future depression via changes in ruminative brooding: a five-month longitudinal eye-tracking study. Behav Res Ther. 2019;118:30–42. doi: 10.1016/j.brat.2019.03.013. [DOI] [PubMed] [Google Scholar]
- 91.Sanchez-Lopez A, Everaert J, Van Put J, De Raedt R, Koster EHW. Eye-gaze contingent attention training (ECAT): examining the causal role of attention regulation in reappraisal and rumination. Biol Psychol. 2019;142:116–125. doi: 10.1016/j.biopsycho.2019.01.017. [DOI] [PubMed] [Google Scholar]
- 92.Holmes A, Mogg K, Fockert JD, Nielsen MK, Bradley BP. Electrophysiological evidence for greater attention to threat when cognitive control resources are depleted. Cogn Affect Behav Neurosci. 2014;14(2):827–835. doi: 10.3758/s13415-013-0212-4. [DOI] [PubMed] [Google Scholar]
- 93.White LK, Sequeira S, Britton JC, Brotman MA, Gold AL, Berman E, et al. Complementary features of attention bias modification therapy and cognitive-behavioral therapy in pediatric anxiety disorders. Am J Psychiatry. 2017;174(8):775–784. doi: 10.1176/appi.ajp.2017.16070847. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 94.Myin-Germeys I, Kasanova Z, Vaessen T, Vachon H, Kirtley O, Viechtbauer W, et al. Experience sampling methodology in mental health research: new insights and technical developments. World Psychiatry. 2018;17(2):123–132. doi: 10.1002/wps.20513. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.Myin-Germeys I, Oorschot M, Collip D, Lataster J, Delespaul P, van Os J. Experience sampling research in psychopathology: opening the black box of daily life. Psychol Med. 2009;39(9):1533–1547. doi: 10.1017/S0033291708004947. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.