Abstract
Background
The present study aimed to investigate the pandemic stage differences of mental health helpline help-seekers emotional responses, psychiatric symptoms, and related network structures during the COVID-19 pandemic in China.
Methods
The data was collected by a large-scale psychological helpline in response to the COVID-19 pandemic in mainland China. Counselor-reported information about the help-seekers pandemic-related emotional responses and psychiatric symptoms were recorded. A total of 26,870 callers' data from February 28, 2020, to April 23, 2021, were collected in the present study. A linear probability model and network analysis were conducted to determine the differences in help-seekers mental health concerns and network structures between the pandemic (stage I, from February 28, 2020, to April 28, 2020, N = 9821) and the regular prevention and control period (stage II, from April 29, 2020, to April 23, 2021, N = 17,049).
Results
Results revealed that anger, sadness, and obsession symptoms increased in stage II while symptoms of anxiety, somatization, and feelings of fear and stress were relieved. The network analysis results demonstrated both stage I and II networks centered on anxiety firmly. In stage II, the connection between anxiety and hypochondria and fear's strength centrality descended significantly.
Limitations
The mental health outcomes of callers only included the counselor-reported data.
Conclusions
The mental health concerns of helpline callers showed pandemic-related stage differences.
Keywords: Psychological network, Mental health, COVID-19, Stage
1. Introduction
The emergence of the COVID-19 pandemic has raised many mental health concerns worldwide (Pfefferbaum and North, 2020). COVID-19 symptoms, worry about being infected, economic pressure and social isolation have resulted in unprecedented mental problems such as anxiety, depression and trauma-related disorders (Luo et al., 2020). Meta-analyses have demonstrated that the prevalence of anxiety (6.33 % to 50.9 %), depression (14.6 % to 48.3 %), and post-traumatic stress symptoms (7 % to 53.8 %) is relatively high in the general population during the COVID-19 pandemic across various countries (Liu et al., 2021; Xiong et al., 2020). Longitudinal evidence also demonstrated that people's mental health deteriorated after the pandemic. In a large-scale longitudinal survey conducted in the United Kingdom, researchers found that mental health had deteriorated compared with pre-COVID-19 trends by late April 2020 (Brunoni et al., 2021). The results are consistent with other longitudinal studies, which revealed that mental problems increased significantly at the start of the COVID-19 outbreak (Daly et al., 2020; Kim et al., 2021; Penner et al., 2021). Santomauro et al. (2021) directly related COVID-19 impact indicators to anxiety and depressive disorders by a meta-regression. They found that decreased human mobility and daily SARS-CoV-2 infection rate predicted increases in the prevalence of major depressive disorder and anxiety disorders, indicating that the COVID-19 pandemic had a negative impact on mental health. In contrast, persons with pre-existing mood disorders were at higher risk of COVID-19 hospitalization and death (Ceban et al., 2021).
There is mixed evidence despite the abundant research on pandemic-related deterioration in psychopathology. For instance, the results of Dutch longitudinal population-based surveys revealed no increase in the prevalence of anxiety and depression symptoms (van der Velden et al., 2022). Brunoni et al. (2021) evaluated the rates of common psychiatric symptoms and depressive, anxiety, and common anxiety disorders between pre-pandemic waves (i.e., 2008–2010, 2012–2014, and 2016–2018) and three pandemic assessments in 2020 (i.e., May–July, July–September, and October–December) based on a Brazilian longitudinal study. They found no consistent evidence of the increasing prevalence of mental disorders, and the psychiatric symptoms slightly decreased in 2020. One possible reason is that the impacts of COVID-19 on mental health are different in various countries, which may be influenced by government responses (Lee et al., 2021; Wang et al., 2021). Moreover, the influences of the pandemic may be changeable over time. A recent meta-analysis of longitudinal cohort studies showed an overall increase in mental health symptoms observed during March–April 2020 that significantly declined over time and became non-significant compared with pre-pandemic levels (May–July) (Robinson et al., 2022).
This result may represent an acute and normal response of the help-seekers to an unforeseen and distressing traumatic event, followed by a period of psychological adaptation and recovery (Robinson and Daly, 2021). However, it's noted that the changes in symptoms over time vary depending on the type of mental health concerns. For example, in contrast to anxiety and general mental health, increases in depression and mood disorder symptoms after the pandemic tended to be larger and remained significantly elevated in the late pandemic (Robinson et al., 2022). Renaud-Charest et al. (2021) also found a high frequency of clinically significant depression and depressive symptoms associated with post-COVID-19 syndrome following recovery from COVID-19 for >12 weeks. Consistently, another longitudinal survey in April and September 2020 showed that depressive symptoms and suicidal thoughts and behaviors increased significantly, but acute stress symptoms decreased over time (Veldhuis et al., 2021). This indicated patterns of the pandemic's short-term and long-lasting psychological impacts on different mental health concerns.
Nevertheless, Robinson and Daly (2021) observed a high degree of unexplained heterogeneity among the studies investigating mental health changes during the COVID-19 pandemic. Besides, most previous research only focused on the individual changes in several mental health symptoms or emotional responses and ignored the interconnections among symptoms and emotions. C. Wang et al. (2020), J. Wang et al. (2020), and Y. Wang et al. (2020) conducted a network analysis across anxiety and depression symptoms during the outbreak and the after-peak stages. They found that psychomotor symptoms had high centrality in both stages and irritability and loss of energy played an essential role in the network after the pandemic's peak, indicating some possible changes of interconnections among symptoms with stages. Therefore, more research is needed to determine the progress of various mental problems and the overall psychological structures with the development of the COVID-19 pandemic, which is vital to understanding the public's mental health concerns integrally and applying proper mental health care in various stages of the COVID-19 pandemic.
Recent research has demonstrated that psychological helplines are effective sources of real-time information on public mental health (Brülhart et al., 2021; Brülhart and Lalive, 2020). Due to the easy availability and low cost, the helplines have been widely applied in response to the COVID-19 pandemic in many countries (Bu et al., 2021; Choi and Ko, 2020; Presti et al., 2020; J. Wang et al., 2020). Brülhart et al. (2021) collected data on 8 million calls from 19 countries, focusing on the change in total call volumes and call topics. They found that the call volumes exceeded the pre-pandemic level by 35 %, and the increase was driven mainly by fear, loneliness, and concerns about physical health. However, this study only compared the call volumes and topics before and after the pandemic without tracking the changes in different stages and capturing the interconnections among callers' emotional responses and symptoms.
Network theory proposes that symptoms should be conceptualized as mutually interacting and reinforcing components of a complex network rather than a common latent factor (Borsboom and Cramer, 2013). Compared with traditional methods, the network approach is good at analyzing and visualizing complex relationships among psychopathology symptoms (McNally, 2021). In addition, network analysis is particularly useful for finding the main symptom, which has the strongest overall connectivity with other symptoms in a network. The central symptom may have a more significant influence on the system than the peripheral symptoms (Levinson et al., 2017). To sum up, it's necessary to investigate the changes in mental health help-seekers' symptoms or emotions from a network perspective.
As the first country to respond to the pandemic that was still in its early stages, China showed typical features of pandemic-related mental health. During the initial phase of the COVID-19 outbreak in China, more than half of the respondents rated the psychological impact as moderate-to-severe, and about one-third reported moderate-to-severe anxiety (C. Wang et al., 2020). Especially, COVID-19 and psychiatric patients had higher levels of depression, anxiety and stress, also higher acceptance and willingness to pay for the COVID-19 vaccine than healthy controls (Hao, Tam, et al., 2020; Hao, Tan, et al., 2020; Hao et al., 2021). A longitudinal study revealed a significant reduction in psychological impact 4 weeks after the COVID-19 outbreak. Returning to work had not caused a high level of psychiatric symptoms in the workforce following the recovery from COVID-19 (Tan et al., 2020). However, more research is needed on the changes in specific psychiatric symptoms and network structures, for persons with mental problems, particularly.
The present study utilized extensive sample data collected from a psychological helpline in response to the COVID-19 pandemic in China to explore the changes in callers' emotional reactions and psychiatric symptoms from the early pandemic to the stage of regular prevention and control. A linear probability model was used to explore individual emotion and symptom changes across stages. Additionally, network analysis was utilized to investigate the relationship changes among emotions and symptoms with time.
2. Methods
2.1. Data collection
The data was collected by The Ministry of Education-Central China Normal University (MOE-CCNU) Mental Health Service Platform, which was established and guided by the Ministry of Education in China. The platform was formally built on 24th February 2020 in Wuhan and provided free psychological support to the public, especially the medical staff, patients and their relatives, police officers, and security professionals. The MOE-CCNU platform also offered counselors training and professional supervision. See Zhao et al. (2020) for more details about the platform.
A total of 1968 professional mental health counselors and 133 registered supervisors from universities and institutions were recruited based on qualifications from 4492 candidate volunteers. The Inclusion criteria for counselors include (1) having counseling-related qualification certificates; (2) having professional study and training, adequate counseling experience (over 200 h) and supervised experience; (3) engaging in counseling works at the moment. Most counselors were female (79.07 %). They all had ethics training, and most had training about trauma and crisis intervention (96.7 %). The counselors were well-experienced in counseling (≥2000 h: 35.25 %, 1000–1999 h: 27.66 %, 500–999 h: 28.56 %, 300–499 h: 7.28 %, <300 h: 0.24 %). Most of them were aged 40–49 (38.07 %) and 30–39 (37.70 %), following those over 50 years old (20.26 %).
Each time the counselor ended a conversation with a help-seeker, they got an internet link to questionnaires to record the caller's information. Except for the primary demographic data of age, gender, and identities, the counselors were asked about the callers' direct emotional responses and psychiatric symptoms. Eight common emotional reactions (including anger, hopelessness, guilt, sadness, stress, fatigue, fearworry) and six types of psychiatric symptoms (including obsession, insomnia, somatization, depression, anxiety, hypochondria) were contained in the questionnaires. Each emotion or symptom was treated as a forced binary item with two choices (0 = No related, 1 = Related). Binary questions were common in psychopathology measurements with simplicity, stability, and validity (Dolnicar et al., 2011; Rothaug et al., 2013). We used Kuder and Richardson Formula 20 (KR-20) to evaluate the reliability of the binary measurements (Carey and Gottesman, 1978). The KR-20 was 0.70 in the present study, representing a reasonable internal consistency reliability level.
According to the whitepaper titled “Fighting COVID-19: China in Action.” published by China's State Council Information Office on June 7, 2020 (State Council of The People's Republic of China, n.d.), during the period from December 27, 2019, to April 28, 2020, China was in a challenging and critical battle with the COVID-19 pandemic and had an initial victory. Since April 29, 2020, China has entered the stage of regular prevention and control. Only sporadic cases were reported on the mainland, and inbound cases were generally under control. The positive momentum in COVID-19 control has thus been locked in, and nationwide virus control was being conducted on an ongoing basis. China has made vigorous efforts to resume work and reopen schools. Therefore, we divided the helpline calls into two stages. Stage I was the pandemic period (from February 28, 2020, to April 28, 2020), and stage II (from April 29, 2020, to April 23, 2021) referred to the regular prevention and control period. In sum, a total of 26,870 callers' data was included in the present study (62.90 % female). We excluded the data with a very short answer duration that may be invalid (N = 1368). The mean age of callers was 26.83 (SD = 10.66). There were 9821 calls in stage I and 17,049 calls in stage II.
2.2. Data analysis
2.2.1. Linear probability model
Take Brülhart et al. (2021) for references, we defined an indicator variable W denoting two stages (0 = stage I, 1 = stage II). We defined the dependent variable O as equal to ‘1’ for call i on day t if the outcome was related to the respective emotions or symptoms (anger, hopelessness, guilt, sadness, stress, fatigue, fear, worry, obsession, insomnia, somatization, depression, anxiety, hypochondria). The model included secular trends and seasonal patterns by including year, week-of-year, and day-of-week indicators summarized in the vector Θt. Standard errors were clustered at the week level (see Eq. (1)). The analysis was conducted using STATA 17.0.
| (1) |
2.2.2. Network analysis
The linear probability model above didn't focus on the interactions among emotions and symptoms. We further applied network analysis to determine the multivariate dependency psychological structures of the help-seekers during the COVID-19 pandemic. We conducted the following steps according to the reporting standards of psychological network analysis (Burger et al., 2022). (1) Check deterministic relations. To reduce the overlaps between variables that influence inferences, we examined bivariate correlations with phi correlation coefficients between all binary variables. (2) Choose estimated methods. We estimated two partial correlation networks for stage I, and stage II samples, respectively. We used Ising models, combining l1-regularized logistic regression with Bayesian neighborhood selection to define connections between variables, implemented in the bootnet package (Epskamp and Fried, 2015). (3) Estimate centrality. Node strength centrality, closeness and betweenness are three common centrality metrics to measure the core symptoms in networks (Opsahl et al., 2010). Strength centrality denotes the sum of all associations of a given node with all other nodes. Closeness measures the average distance from a node to all other nodes in a network by counting the reciprocal of all shortest path lengths between a given node and all other nodes. Betweenness is the number of times that a node lies on the shortest path connecting two other nodes, and symptoms with high betweenness can be thought of as a bridge to other symptoms. Previous network analysis studies have shown that the stability of closeness and betweenness is often low (Soares et al., 2021), so in this study, we will mainly report the results of strength and closeness and betweenness will be presented in the supplementary materials. The centrality metrics were calculated by the qgraph package (Epskamp et al., 2021). (4) Group comparisons. We used Network Comparison Test (Van Borkulo et al., 2022) to investigate the differences between the stage I and the stage II networks. This technique assesses the differences in global connectivity and local edges between two networks. (5) Estimate accuracy and stability of networks. Firstly, we conducted non-parametric bootstrapping with 2000 samples to estimate the accuracy of edge-weights by drawing bootstrapped CIs. Secondly, we investigate the stability of centrality indices by case-dropping subset bootstrap with 2000 iterations. We used the correlation stability coefficient (CS-coefficient), a quantified metric, to measure the stability of centrality indices. The previous simulation study showed that a CS-coefficient above 0.25 indicated good centrality stability, and above 0.50 was preferable. The accuracy and stability analyses were also conducted in the bootnet package. All the analysis was performed in R 4.0.2 (R Core Team, 2020).
3. Results
3.1. The changes in callers' emotional responses and psychiatric symptoms
The results of the linear probability model are shown in Table 1 and illustrated in Fig. 1 . The emotional responses of anger (coefficient = 0.084, 95%CI: 0.068, 0.099, p < 0.001), sadness (coefficient = 0.061, 95%CI: 0.046, 0.076, p < 0.001), and symptoms of obsession (coefficient = 0.011, 95%CI: 0.003, 0.019, p < 0.01) increased significantly in stage II compared to stage I. While symptoms of anxiety (coefficient = −0.097, 95%CI: −0.117, −0.077, p < 0.001), somatization (coefficient = −0.029, 95%CI: −0.037, −0.021, p < 0.001), and emotions of fear (coefficient = −0.051, 95%CI: −0.065, −0.037, p < 0.001) and stress (coefficient = −0.031, 95%CI: −0.044, −0.019, p < 0.001) decreased significantly. There were no significant changes in depression, hypochondria, worry, guilt, insomnia, fatigue, or hopelessness across the stages.
Table 1.
The change of the helpline calls for dependent emotions and symptoms across stages.
| Outcome | Coefficients | SD | 95 % CI | t | p |
|---|---|---|---|---|---|
| Emotional responses | |||||
| Anger | 0.084 | 0.008 | 0.068, 0.099 | 10.686 | <0.001 |
| Hopelessness | 0.006 | 0.006 | −0.005, 0.018 | 1.144 | 0.257 |
| Guilt | 0.001 | 0.005 | −0.009, 0.012 | 0.288 | 0.774 |
| Sadness | 0.061 | 0.008 | 0.046, 0.076 | 8.006 | <0.001 |
| Stress | −0.031 | 0.006 | −0.044, −0.019 | −5.000 | <0.001 |
| Fatigue | 0.006 | 0.006 | −0.006, 0.018 | 1.005 | 0.319 |
| Fear | −0.051 | 0.007 | −0.065, −0.037 | −7.104 | <0.001 |
| Worry | 0.001 | 0.009 | −0.016,0.018 | 0.156 | 0.876 |
| Psychiatric symptoms | |||||
| Obsession | 0.011 | 0.004 | 0.003, 0.019 | 2.851 | <0.01 |
| Insomnia | 0.006 | 0.005 | −0.005, 0.016 | 1.033 | 0.306 |
| Somatization | −0.029 | 0.004 | −0.037, −0.021 | −7.376 | <0.001 |
| Depression | −0.016 | 0.011 | −0.037, 0.006 | −1.464 | 0.149 |
| Anxiety | −0.097 | 0.010 | −0.117, −0.077 | −9.572 | <0.001 |
| Hypochondria | −0.005 | 0.006 | −0.016, 0.006 | −0.894 | 0.375 |
Fig. 1.
The changes of caller's emotions and symptoms from stage I to stage II.
Note. The ‘E_’ prefix indicates emotional responses, and ‘S_’ represents psychiatric symptoms.
3.2. Psychological networks of callers
The phi correlation coefficients across variables ranged from −0.15 to 0.38, showing no very high overlaps between variables (see Supplementary Material, Table 1). The psychological networks of subgroups and total samples are displayed in Fig. 2(a)–(c). The stages I, II, and entire networks showed relatively consistent psychological structures of help-seekers, including two hubs (Depression centered and anxiety-fear centered). Edge weights ranged from −0.78 (worry – anger) to 1.76 (fear – hypochondria) in the stage I network. Edge weights ranged from −0.86 (worry – anger) to 1.65 (worry – anxiety) in the stage II network.
Fig. 2.
The psychological networks of callers for stage I and stage II.
Note. Green edges represent significant positive correlations, and red edges represent substantial negative correlations. (For interpretation of the references to color in this figure legend, the reader is referred to the web version of this article.)
The centrality indices of the networks are shown in Fig. 3 . Anxiety is the most vital center of emotional responses and psychiatric symptoms, with the highest strength, betweenness, and closeness in stage I or II (see Supplementary Material, Fig. 1). The global invariance test within the NCT procedure demonstrated no significant difference in global connectivity between stage I and stage II networks (Estimate = 4.42, p = 0.158). The local edge of hypochondria-anxiety had the maximum differences between stage I and stage II networks, showing decreasing connection over time (Estimate = 0.74, p < 0.05). Besides, the strength centrality of fear is more prominent in stage I than that in stage II (p < 0.001) (see Supplementary Material, Table 2).
Fig. 3.
The strength centrality of stage I and II networks.
Bootstrapped edge weights CIs are drawn in Fig. 4 . The weak overlaps of weights CIs among edges indicated stable networks. Besides, the CS-coefficients were 0.67 and 0.75 for stage I and stage II networks, respectively. Results also revealed good stability of the networks (see Supplementary Material, Fig. 2).
Fig. 4.
Bootstrapped CIs of edge weights.
4. Discussion
The present study tracked the changes in large-sample psychological helpline callers' mental health concerns over time in China. Various pandemic-related emotional responses, psychiatric symptoms, and inter-connections were captured, revealing a more comprehensive picture of the callers' mental health concerns in different stages of the COVID-19 pandemic.
4.1. The changes in callers' various mental health concerns over stages
In line with previous research, the current results showed that callers' anxiety, fear, stress, and somatization decreased over time (Bendau et al., 2021; Robinson et al., 2022). At the initial stage of the pandemic, most psychological helpline callers seek help to fight against the negative mental impacts of the COVID-19 crisis (Shakya, 2020; Zhao et al., 2020). The pandemic-related acute stress responses such as fear, anxiety, and somatization were the public's primary mental health concerns, which triggered people to seek online mental health services (Humer et al., 2021; Usher et al., 2020). For instance, the share of calls related to ‘fear’ (including fear of infection) increased by 2.2 percentage points in Germany and by 2.7 percentage points in France after the outbreak of the COVID-19 pandemic (Brülhart et al., 2021). As reported by some helpline psychological counselors, the most of the callers knew how to regulate their emotions, maintain an organized life, and receive support from their family and partner during the pandemic (Hervalejo et al., 2020). However, the pandemic-related acute stress responses wouldn't last long. With psychological adaption and resilience, people would gradually recover from the crisis's hit (Kimhi et al., 2020; Kaye-Kauderer et al., 2021). Additionally, the government's success in managing pandemics could alleviate people's stress (Lim et al., 2021; Malesza and Kaczmarek, 2021).
Surprisingly, anger, sadness, and obsession increased over time. One possible reason is that when the country enters a stable stage of regular prevention and control, online mental health help-seekers may seek help for more common problems like love relationships and learning issues instead of pandemic-related problems (Wu et al., 2021). The emotions of anger and sadness are common reactions to these topics (Guerrero et al., 2008; Hughes, 1998). For obsession, a systematic review concluded that obsessive-compulsive symptoms worsened during the early stages of the pandemic (Guzick et al., 2021). In contrast to the current study, a longitudinal survey conducted in China with three measurement time points (February 7, March 25 and April 28, 2020) reported decreasing obsessive-compulsive symptoms over time (Jia et al., 2021). Another one-year follow-up study showed that the pandemic-related obsession symptoms, anxiety, and depression of obsessive-compulsive disorder patients persisted after one year (Liao et al., 2021). One explanation is that though the overall prevalence and obsession decreased with the easing pandemic, some people may maintain the symptoms. Obsession symptoms in a stable stage may lead to more distress, so these people may be more likely to seek help in the late phase of the pandemic.
Several emotional responses and psychiatric symptoms didn't show significant changes across stages of the pandemic, including symptoms of depression, hypochondria, insomnia, and emotions of hopelessness, fatigue, worry and guilt. Acute stress may be relieved rapidly over time. Still, some chronic stress of COVID-19 would last longer because of the deterioration in the living environment with the economic crisis and unemployment caused by the pandemic (Borio, 2020; Polizzi et al., 2020). Robinson et al. (2022) also found that depression didn't change significantly over time. China adopted the dynamic zero COVID-19 strategies, with sporadic cases rising and subsiding there (Liu et al., 2022). Thus, Chinese people may maintain higher sensitivity and stronger emotional reactions to the pandemic. Other common topics may cause these emotions and symptoms in the late stage of the pandemic except for pandemic-related problems. Therefore, though the negative pandemic-related impacts on mental health were relieved in the late stage, some mental health concerns were still pronounced because the callers were always biased toward the people with “problems.”
4.2. The psychological network structures of callers and stage differences
The psychological networks of the callers in stage I and stage II displayed similarities and differences. Anxiety had the highest centrality, strongly linked to other emotional responses and psychiatric symptoms in stage I or II. Taylor et al. (2020) conducted a network analysis of COVID-19-related worry, avoidance, and coping and found that concerns about the dangerousness of COVID-19 formed the core of the previously identified COVID Stress Syndrome. Another study also revealed that anxiety was the most central problem among anxiety, depression, subjective well-being, and academic performance among students with COVID-19-infected relatives (Ventura-León et al., 2022). Considerable research has reported that anxiety was the most prevalent mental problem during the COVID-19 pandemic (Saeed et al., 2022). And anxiety showed high comorbidity with a lot of mental disorders such as depression (Galyamina et al., 2017; Pollack, 2005), obsessive-compulsive disorder (Renna et al., 2018), and somatization disorder (Meuret et al., 2020), so it's easy to understand its high centrality among psychological networks. Furthermore, our study indicated that the strength centrality of anxiety in callers didn't change significantly over time. Despite the mitigation of the pandemic, people with anxiety may tend to seek help than people with depression due to the clinical features (Roness et al., 2005).
However, the stage I and II networks were somewhat different. The relationship between anxiety and hypochondria became weaker over time. As the first hit of the COVID-19 pandemic, China was confronted with more stress and uncertainty in the initial stage. High-level health anxiety triggered hypochondria before the disease was well-known and controlled effectively (Sauer et al., 2020). In the regular prevention and control stage, the risk of infection has been dramatically reduced, thus weakening the association between anxiety and hypochondria. In addition, it's seen that the fear had lower strength centrality among emotional responses and psychiatric symptoms in stage II, indicating that the people may have recovered from the initial fear of the pandemic over time, which can be supported by a previous study (Mertens et al., 2020). The previous survey collected data from 34 countries and found that fear steadily decreased after a peak in April 2020 (Mertens et al., 2020). Fear is an evolutionary adaptive emotion that protects people from harm. Once a threat diminishes, fear dissipates as well.
4.3. Strengths and limitations
The present study has several strengths that are worth noting. Firstly, the psychological helpline data is a vital and valuable source to reflect the public's mental health concerns in a natural setting (Brülhart et al., 2021). Despite numerous research on mental health during the COVID-19 pandemic, few work insights the helpline callers. Compared with previous studies on helplines (Brülhart et al., 2021; Brülhart and Lalive, 2020), we captured more emotional responses and psychiatric symptoms of the callers and explored the changes in mental health concerns between the pandemic stage and following sound stage of the COVID-19 pandemic, which can help better understand the COVID-19 impacts. Besides, we focused on the individual mental health concerns of the callers. We investigated the connections between various emotional responses and psychiatric symptoms from a network perspective and how the network changed over time. To our knowledge, our study was the first to use network analysis to figure out the map of the psychological helpline callers' mental health concerns. Moreover, we used a large sample sufficient to reveal the changes in mental problems and detect their inter-relationships. Overall, the large-sample data of psychological helplines represent the public's psychological needs, indicating what problems should be focused on. The findings can help the government and professionals provide better mental health services and adjust policies and interventions in different pandemic stages. There are many digital mental health psychotherapy options besides helpline, which can be applied during the COVID-19 pandemic (Rauschenberg et al., 2021). For example, internet cognitive behavioral therapy (I-CBT) has shown cost-effectiveness and efficacy for psychiatric symptoms (Ho et al., 2020; Soh et al., 2020; Zhang and Ho, 2017). Depending on the clients' symptoms and pandemic stage, personalized treatment selection can be further investigated client's.
In terms of limitations, firstly, the data collected by the helpline were counselor-reported. Although the counselors involved were qualified and had rich experience, their reports of the callers' mental health concerns may be biased. Secondly, the measurements were forced binary questions and non-standardized because the data collection need short and straightforward without influencing the counselors' main works. The measurement formats may impact the reliability and stability of the outcomes though the measurement in the present study showed acceptable reliability (Markon et al., 2011). Thirdly, the callers in stages I and II were different. This study didn't track the same participants' changes in mental health concerns. It should acknowledge that network analyses do not define the causal relationship between emotions and symptoms. Moreover, we didn't measure to what extent the emotional responses or psychiatric symptoms were caused by the pandemic, so inferences drawn from this study should be cautious. Nevertheless, the helpline data could reflect the natural psychological needs of the public during the COVID-19 pandemic. Finally, although multiple psychiatric symptoms and emotional responses were investigated in the present study, other essential constructs like pandemic-related burn out, should be further researched in future work (Lau et al., 2022).
5. Conclusions
The present study investigated the changes in callers' mental health concerns during the COVID-19 pandemic from the perspective of the helpline, providing valuable insights into how callers' emotional responses and psychiatric symptoms change over time. The results suggested that callers' acute stress responses, such as anxiety, fear, stress and somatization decreased while emotions of anger, sadness, and obsession symptoms increased over time. Other chronic reactions, including symptoms of depression, hypochondria, insomnia, and emotions of hopelessness, fatigue, worry, guilt, lasted in the late stage of the pandemic. The high strength centrality and high connectedness of anxiety in stages I and II demonstrated that anxiety-related interventions are vital in helpline services. The decreased connections among anxiety and hypochondria and decreased strength centrality of fear suggested that pandemic-related health anxiety and fear are relieved over time.
CRediT authorship contribution statement
Liuzu Lai and Zhihong Ren contributed to the manuscript's concept, design, analysis, and writing. Jingqiang Tong contributed to the data collection and management process. Yu-Tao Xiang and Lin Zhang contributed to the revision of the manuscript.
Funding
This work was supported by the Major Program of the National Social Science Foundation of China (grant No. 22&ZD187).
Conflict of Interest
All authors declare that they have no conflicts of interest.
Acknowledgements
None.
Footnotes
Supplementary data to this article can be found online at https://doi.org/10.1016/j.jad.2022.11.065.
Appendix A. Supplementary data
Supplementary material
References
- Bendau A., Kunas S.L., Wyka S., Petzold M.B., Plag J., Asselmann E., Ströhle A. Longitudinal changes of anxiety and depressive symptoms during the COVID-19 pandemic in Germany: the role of pre-existing anxiety, depressive, and other mental disorders. J. Anxiety Disord. 2021;79 doi: 10.1016/j.janxdis.2021.102377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Borio C. The Covid-19 economic crisis: dangerously unique. Bus. Econ. 2020;55(4):181–190. doi: 10.1057/s11369-020-00184-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Borsboom D., Cramer A.O. Network analysis: an integrative approach to the structure of psychopathology. Annu. Rev. Clin. Psychol. 2013;9:91–121. doi: 10.1146/annurev-clinpsy-050212-185608. [DOI] [PubMed] [Google Scholar]
- Brülhart M., Lalive R. Daily suffering: helpline calls during the Covid-19 crisis. Covid Econ. 2020;19:143–158. https://cepr.org/node/390459 [Google Scholar]
- Brülhart M., Klotzbücher V., Lalive R., Reich S.K. Mental health concerns during the COVID-19 pandemic as revealed by helpline calls. Nature. 2021;600(7887):121–126. doi: 10.1038/s41586-021-04099-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brunoni A.R., Suen P.J.C., Bacchi P.S., Razza L.B., Klein I., Dos Santos L.A., de Souza Santos I., Valiengo L.da C.L., Gallucci-Neto J., Moreno M.L. Prevalence and risk factors of psychiatric symptoms and diagnoses before and during the COVID-19 pandemic: findings from the ELSA-Brasil COVID-19 mental health cohort. Psychological Medicine. 2021:1–12. doi: 10.1017/S0033291721001719. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bu F., Mak H.W., Fancourt D. Rates and predictors of uptake of mental health support during the COVID-19 pandemic: an analysis of 26,720 adults in the UK in lockdown. Soc. Psychiatry Psychiatr. Epidemiol. 2021;56(12):2287–2297. doi: 10.1007/s00127-021-02105-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burger J., Isvoranu A.M., Lunansky G., Haslbeck J., Epskamp S., Hoekstra R.H., Blanken T.F. Reporting standards for psychological network analyses in cross-sectional data. Psychol. Methods. 2022 doi: 10.1037/met0000471. [DOI] [PubMed] [Google Scholar]
- Carey G., Gottesman I.I. Reliability and validity in binary ratings: areas of common misunderstanding in diagnosis and symptom ratings. Arch. Gen. Psychiatry. 1978;35(12):1454–1459. doi: 10.1001/archpsyc.1978.01770360058007. [DOI] [PubMed] [Google Scholar]
- Ceban F., Nogo D., Carvalho I.P., Lee Y., Nasri F., Xiong J., Lui L.M., Subramaniapillai M., Gill H., Liu R.N. Association between mood disorders and risk of COVID-19 infection, hospitalization, and death: a systematic review and meta-analysis. JAMA Psychiatry. 2021;78(10):1079–1091. doi: 10.1001/jamapsychiatry.2021.1818. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Choi Y.S., Ko J.Y. Operating a national hotline in Korea during the COVID-19 pandemic. Osong. Public Health Res. Perspect. 2020;11(6):380. doi: 10.1001/10.24171/J.PHRP.2020.11.6.06. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Daly M., Sutin A.R., Robinson E. Longitudinal changes in mental health and the COVID-19 pandemic: evidence from the UK household longitudinal study. Psychol. Med. 2020;1–10 doi: 10.1017/S0033291720004432. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dolnicar S., Grün B., Leisch F. Quick, simple and reliable: forced binary survey questions. Int. J. Mark. Res. 2011;53(2):231–252. doi: 10.2501/IJMR-53-2-231-252. [DOI] [Google Scholar]
- Epskamp S., Fried E.I. Bootstrap Methods for Various Network Estimation Routines. Vol. 5. 2015. Package ‘bootnet.’; pp. 0–1. [Google Scholar]
- Epskamp S., Costantini G., Haslbeck J., Isvoranu A., Cramer A.O., Waldorp L.J., Schmittmann V.D., Borsboom D. 2021. Package ‘qgraph.’. [Google Scholar]
- Galyamina A.G., Kovalenko I.L., Smagin D.A., Kudryavtseva N.N. Interaction of depression and anxiety in the development of mixed anxiety/depression disorder. Experimental studies of the mechanisms of comorbidity. Neurosci. Behav. Physiol. 2017;47(6):699–713. doi: 10.1007/s11055-017-0458-3. [DOI] [Google Scholar]
- Guerrero L.K., La Valley A.G., Farinelli L. The experience and expression of anger, guilt, and sadness in marriage: an equity theory explanation. J. Soc. Pers. Relat. 2008;25(5):699–724. doi: 10.1177/0265407508093786. [DOI] [Google Scholar]
- Guzick A.G., Candelari A., Wiese A.D., Schneider S.C., Goodman W.K., Storch E.A. Obsessive-compulsive disorder during the COVID-19 pandemic: a systematic review. Curr. Psychiatry Rep. 2021;23(11):1–10. doi: 10.1007/s11920-021-01284-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hao F., Tam W., Hu X., Tan W., Jiang L., Jiang X., Zhang L., Zhao X., Zou Y., Hu Y. A quantitative and qualitative study on the neuropsychiatric sequelae of acutely ill COVID-19 inpatients in isolation facilities. Transl. Psychiatry. 2020;10(1):1–14. doi: 10.1038/s41398-020-01039-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hao F., Tan W., Jiang L.I., Zhang L., Zhao X., Zou Y., Hu Y., Luo X., Jiang X., McIntyre R.S. Do psychiatric patients experience more psychiatric symptoms during COVID-19 pandemic and lockdown? A case-control study with service and research implications for immunopsychiatry. Brain Behav. Immun. 2020;87:100–106. doi: 10.1016/j.bbi.2020.04.069. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hao F., Wang B., Tan W., Husain S.F., McIntyre R.S., Tang X., Zhang L., Han X., Jiang L., Chew N.W. Attitudes toward COVID-19 vaccination and willingness to pay: comparison of people with and without mental disorders in China. BJPsych Open. 2021;7(5) doi: 10.1192/bjo.2021.979. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hervalejo D., Carcedo R.J., Fernández-Rouco N. Family and mental health during the confinement due to the COVID-19 pandemic in Spain: the perspective of the counselors participating in psychological helpline services. J. Comp. Fam. Stud. 2020;51(3–4):399–416. doi: 10.3138/jcfs.51.3-4.014. [DOI] [Google Scholar]
- Ho C.S., Chee C.Y., Ho R.C. Mental health strategies to combat the psychological impact of COVID-19 beyond paranoia and panic. Ann. Acad. Med. Singap. 2020;49(1):1–3. doi: 10.47102/annals-acadmedsg.202043. [DOI] [PubMed] [Google Scholar]
- Hughes J.D.C. Young children’s understanding of emotions within close relationships. Cognit. Emot. 1998;12(2):171–190. doi: 10.1080/026999398379709. [DOI] [Google Scholar]
- Humer E., Pieh C., Probst T., Kisler I.-M., Schimböck W., Schadenhofer P. Telephone emergency service 142 (TelefonSeelsorge) during the COVID-19 Pandemic–Cross-sectional survey among counselors in Austria. Int. J. Environ. Res. Public Health. 2021;18(5):2228. doi: 10.3390/ijerph18052228. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jia Q., Wu Z., Li Z., Zhang X., Luo L. Basic analysis of calls from Suzhou psychological aid hotline from 2010 to 2020. Curr. Psychiatry Rep. 2021;5(4):73–80. doi: 10.23977/aetp.2021.54011. [DOI] [Google Scholar]
- Kaye-Kauderer H., Feingold J.H., Feder A., Southwick S., Charney D. Resilience in the age of COVID-19. BJPsych Adv. 2021;27(3):166–178. doi: 10.1192/bja.2021.5. [DOI] [Google Scholar]
- Kim H., Rackoff G.N., Fitzsimmons-Craft E.E., Shin K.E., Zainal N.H., Schwob J.T., Eisenberg D., Wilfley D.E., Taylor C.B., Newman M.G. College mental health before and during the COVID-19 pandemic: results from a nationwide survey. Cogn. Ther. Res. 2021;1–10 doi: 10.1007/s10608-021-10241-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kimhi S., Marciano H., Eshel Y., Adini B. Recovery from the COVID-19 pandemic: distress and resilience. Int. J. Disaster Risk Reduct. 2020;50 doi: 10.1016/j.ijdrr.2020.101843. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lau S.S., Ho C.C., Pang R.C., Su S., Kwok H., Fung S., Ho R.C. COVID-19 burnout subject to the dynamic zero-COVID policy in Hong Kong: development and psychometric evaluation of the COVID-19 burnout frequency scale. Sustainability. 2022;14(14):8235. doi: 10.3390/su14148235. [DOI] [Google Scholar]
- Lee Y., Lui L.M., Chen-Li D., Liao Y., Mansur R.B., Brietzke E., Rosenblat J.D., Ho R., Rodrigues N.B., Lipsitz O. Government response moderates the mental health impact of COVID-19: a systematic review and meta-analysis of depression outcomes across countries. J. Affect. Disord. 2021;290:364–377. doi: 10.1016/j.jad.2021.04.050. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Levinson C.A., Zerwas S., Calebs B., Forbush K., Kordy H., Watson H., Hofmeier S., Levine M., Crosby R.D., Peat C. The core symptoms of bulimia nervosa, anxiety, and depression: a network analysis. J. Abnorm. Psychol. 2017;126(3):340. doi: 10.1037/abn0000254. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liao J., Liu L., Fu X., Feng Y., Liu W., Yue W., Yan J. The immediate and long-term impacts of the COVID-19 pandemic on patients with obsessive-compulsive disorder: a one-year follow-up study. Psychiatry Res. 2021;306 doi: 10.1016/j.psychres.2021.114268. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lim J.M., Tun Z.M., Kumar V., Quaye S.E.D., Offeddu V., Cook A.R., Lwin M.O., Jiang S., Tam C.C. Population anxiety and positive behaviour change during the COVID-19 epidemic: cross-sectional surveys in Singapore, China and Italy. Influenza Other Respir. Viruses. 2021;15(1):45–55. doi: 10.1111/irv.12785. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liu J., Liu M., Liang W. The dynamic COVID-zero strategy in China. China CDC Weekly. 2022;4(4):74–75. doi: 10.46234/ccdcw2022.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liu X., Zhu M., Zhang R., Zhang J., Zhang C., Liu P., Feng Z., Chen Z. Public mental health problems during COVID-19 pandemic: a large-scale meta-analysis of the evidence. Transl. Psychiatry. 2021;11(1):1–10. doi: 10.1038/s41398-021-01501-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Luo Y., Chua C.R., Xiong Z., Ho R.C., Ho C.S. A systematic review of the impact of viral respiratory epidemics on mental health: an implication on the coronavirus disease 2019 pandemic. Front. Psychiatry. 2020;11 doi: 10.3389/fpsyt.2020.565098. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Malesza M., Kaczmarek M.C. Predictors of anxiety during the COVID-19 pandemic in Poland. Personal. Individ. Differ. 2021;170 doi: 10.1016/j.paid.2020.110419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Markon K.E., Chmielewski M., Miller C.J. The reliability and validity of discrete and continuous measures of psychopathology: a quantitative review. Psychol. Bull. 2011;137(5):856. doi: 10.1037/a0023678. [DOI] [PubMed] [Google Scholar]
- McNally R.J. Network analysis of psychopathology: controversies and challenges. Annu. Rev. Clin. Psychol. 2021;17:31–53. doi: 10.1146/annurev-clinpsy-081219-092850. [DOI] [PubMed] [Google Scholar]
- Mertens G., Duijndam S., Lodder P., Smeets T. 2020. PandemicPanic? Results of a 6-Month Longitudinal Study on Fear of COVID-19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Meuret A.E., Tunnell N., Roque A. Anxiety disorders and medical comorbidity: treatment implications. Anxiety Disord. 2020;237–261 doi: 10.1007/978-981-32-9705-0_15. [DOI] [PubMed] [Google Scholar]
- Opsahl T., Agneessens F., Skvoretz J. Node centrality in weighted networks: generalizing degree and shortest paths. Soc. Networks. 2010;32(3):245–251. doi: 10.1016/j.socnet.2010.03.006. [DOI] [Google Scholar]
- Penner F., Ortiz J.H., Sharp C. Change in youth mental health during the COVID-19 pandemic in a majority Hispanic/Latinx US sample. J. Am. Acad. Child Adolesc. Psychiatry. 2021;60(4):513–523. doi: 10.1016/j.jaac.2020.12.027. [DOI] [PubMed] [Google Scholar]
- Pfefferbaum B., North C.S. Mental health and the Covid-19 pandemic. N. Engl. J. Med. 2020;383(6):510–512. doi: 10.1056/NEJMp2008017. [DOI] [PubMed] [Google Scholar]
- Polizzi C., Lynn S.J., Perry A. Stress and coping in the time of COVID-19: pathways to resilience and recovery. Clinical Neuropsychiatry. 2020;17(2) doi: 10.36131/CN20200204. 59. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pollack M.H. Comorbid anxiety and depression. J. Clin. Psychiatry. 2005;66:22–29. [PubMed] [Google Scholar]
- Presti G., Dal Lago B., Fattori A., Mioli G., Moderato P., Sciaretta L., Costantino M.A. Mental health support to staff in a major hospital in Milan (Italy) during the COVID-19 pandemic: a framework of actions. GeneralPsychiatry. 2020;33(4) doi: 10.1136/gpsych-2020-100244. [DOI] [PMC free article] [PubMed] [Google Scholar]
- R Core Team . Vol. 2. R Foundation for Statistical Computing; Vienna, Austria: 2020. R 4.0. [Google Scholar]
- Rauschenberg C., Schick A., Hirjak D., Seidler A., Paetzold I., Apfelbacher C., Riedel-Heller S.G., Reininghaus U. Evidence synthesis of digital interventions to mitigate the negative impact of the COVID-19 pandemic on public mental health: rapid meta-review. J. Med. Internet Res. 2021;23(3) doi: 10.2196/23365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Renaud-Charest O., Lui L.M., Eskander S., Ceban F., Ho R., Di Vincenzo J.D., Rosenblat J.D., Lee Y., Subramaniapillai M., McIntyre R.S. Onset and frequency of depression in post-COVID-19 syndrome: a systematic review. J. Psychiatr. Res. 2021;144:129–137. doi: 10.1016/j.jpsychires.2021.09.054. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Renna M.E., O’Toole M.S., Spaeth P.E., Lekander M., Mennin D.S. The association between anxiety, traumatic stress, and obsessive–compulsive disorders and chronic inflammation: a systematic review and meta-analysis. Depress. Anxiety. 2018;35(11):1081–1094. doi: 10.1002/da.22790. [DOI] [PubMed] [Google Scholar]
- Robinson E., Daly M. Explaining the rise and fall of psychological distress during the COVID-19 crisis in the United States: longitudinal evidence from the understanding America study. Br. J. Health Psychol. 2021;26(2):570–587. doi: 10.1111/bjhp.12493. [DOI] [PubMed] [Google Scholar]
- Robinson E., Sutin A.R., Daly M., Jones A. A systematic review and meta-analysis of longitudinal cohort studies comparing mental health before versus during the COVID-19 pandemic in 2020. J. Affect. Disord. 2022;296:567–576. doi: 10.1016/j.jad.2021.09.098. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Roness A., Mykletun A., Dahl A.A. Help-seeking behaviour in patients with anxiety disorder and depression. Acta Psychiatr. Scand. 2005;111(1):51–58. doi: 10.1111/j.1600-0447.2004.00433.x. [DOI] [PubMed] [Google Scholar]
- Rothaug J., Weiss T., Meissner W. How simple can it get? Measuring pain with NRS items or binary items. Clin. J. Pain. 2013;29(3):224–232. doi: 10.1097/AJP.0b013e31824c5d7a. [DOI] [PubMed] [Google Scholar]
- Saeed H., Eslami A., Nassif N.T., Simpson A.M., Lal S. Anxiety linked to COVID-19: a systematic review comparing anxiety rates in different populations. Int. J. Environ. Res. Public Health. 2022;19(4):2189. doi: 10.3390/ijerph19042189. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Santomauro D.F., Herrera A.M.M., Shadid J., Zheng P., Ashbaugh C., Pigott D.M., Abbafati C., Adolph C., Amlag J.O., Aravkin A.Y. Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic. Lancet. 2021;398(10312):1700–1712. doi: 10.1016/S0140-6736(21)02143-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sauer K.S., Jungmann S.M., Witthöft M. Emotional and behavioral consequences of the COVID-19 pandemic: the role of health anxiety, intolerance of uncertainty, and distress (in) tolerance. Int. J. Environ. Res. Public Health. 2020;17(19):7241. doi: 10.3390/ijerph17197241. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shakya D.R. Problems shared in psychiatry help-line of a teaching hospital in eastern Nepal during COVID-19 pandemic lockdown. Insights Depress Anxiety. 2020;4:37–39. doi: 10.29328/journal.ida.1001017. [DOI] [Google Scholar]
- Soares G.H., Santiago P.H.R., Biazevic M.G.H., Michel-Crosato E., Jamieson L. Do network centrality measures predict dental outcomes of indigenous children over time? Int. J. Paediatr. Dent. 2021;31(5):634–646. doi: 10.1111/ipd.12749. [DOI] [PubMed] [Google Scholar]
- Soh H.L., Ho R.C., Ho C.S., Tam W.W. Efficacy of digital cognitive behavioural therapy for insomnia: a meta-analysis of randomised controlled trials. Sleep Med. 2020;75:315–325. doi: 10.1016/j.sleep.2020.08.020. [DOI] [PubMed] [Google Scholar]
- State Council of The People's Republic of China, n.d.State Council of The People’s Republic of China. (n.d.). Full Text: Fighting COVID-19: China in Action. Retrieved March 2, 2022, from https://english.www.gov.cn/news/topnews/202006/07/content_WS5edc559ac6d066592a449030.html.
- Tan W., Hao F., McIntyre R.S., Jiang L., Jiang X., Zhang L., Zhao X., Zou Y., Hu Y., Luo X. Is returning to work during the COVID-19 pandemic stressful? A study on immediate mental health status and psychoneuroimmunity prevention measures of Chinese workforce. Brain Behav. Immun. 2020;87:84–92. doi: 10.1016/j.bbi.2020.04.055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Taylor S., Landry C.A., Paluszek M.M., Rachor G.S., Asmundson G.J. Worry, avoidance, and coping during the COVID-19 pandemic: a comprehensive network analysis. J. Anxiety Disord. 2020;76 doi: 10.1016/j.janxdis.2020.102327. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Usher K., Durkin J., Bhullar N. The COVID-19 pandemic and mental health impacts. Int. J. Ment. Health Nurs. 2020;29(3):315. doi: 10.1111/inm.12726. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Borkulo C.D., van Bork R., Boschloo L., Kossakowski J.J., Tio P., Schoevers R.A., Borsboom D., Waldorp L.J. Comparing network structures on three aspects: A permutation test. Psychological Methods. 2022 doi: 10.1037/met0000476. Advance online publication. [DOI] [PubMed] [Google Scholar]
- van der Velden P.G., Contino C., Das M., van Loon P., Bosmans M.W. Anxiety and depression symptoms, and lack of emotional support among the general population before and during the COVID-19 pandemic. A prospective national study on prevalence and risk factors. J. Affect. Disord. 2022:540–548. doi: 10.1016/j.jad.2020.08.026. 277. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Veldhuis C.B., Nesoff E.D., McKowen A.L.W., Rice D.R., Ghoneima H., Wootton A.R., Papautsky E.L., Arigo D., Goldberg S., Anderson J.C. Addressing the critical need for long-term mental health data during the COVID-19 pandemic: changes in mental health from April to September 2020. Prev. Med. 2021;146 doi: 10.1016/j.ypmed.2021.106465. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ventura-León J., Caycho-Rodríguez T., Talledo-Sánchez K., Casiano-Valdivieso K. Depression, COVID-19 anxiety, subjective well-being, and academic performance in university students with COVID-19-infected relatives: a network analysis. Front. Psychol. 2022;281 doi: 10.3389/fpsyg.2022.837606. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang C., Pan R., Wan X., Tan Y., Xu L., Ho C.S., Ho R.C. Immediate psychological responses and associated factors during the initial stage of the 2019 coronavirus disease (COVID-19) epidemic among the general population in China. Int. J. Environ. Res. Public Health. 2020;17(5):1729. doi: 10.3390/ijerph17051729. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang C., Tee M., Roy A.E., Fardin M.A., Srichokchatchawan W., Habib H.A., Tran B.X., Hussain S., Hoang M.T., Le X.T. The impact of COVID-19 pandemic on physical and mental health of Asians: a study of seven middle-income countries in Asia. PloS One. 2021;16(2) doi: 10.1371/journal.pone.0246824. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang J., Wei H., Zhou L. Hotline services in China during COVID-19 pandemic. J. Affect. Disord. 2020;275:125. doi: 10.1016/j.jad.2020.06.030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang Y., Hu Z., Feng Y., Wilson A., Chen R. Changes in network centrality of psychopathology symptoms between the COVID-19 outbreak and after peak. Mol. Psychiatry. 2020;25(12):3140–3149. doi: 10.1038/s41380-020-00881-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wu Z., Li Z., Zhang X., Luo L., Du X. Analysis on the characteristics of callers of psychological aid hotline in Suzhou City. Front. Med. Sci. Res. 2021;3(3) doi: 10.1016/10.25236/FMSR.2021.030310. [DOI] [Google Scholar]
- Xiong J., Lipsitz O., Nasri F., Lui L.M., Gill H., Phan L., Chen-Li D., Iacobucci M., Ho R., Majeed A. Impact of COVID-19 pandemic on mental health in the general population: a systematic review. J. Affect. Disord. 2020 doi: 10.1016/j.jad.2020.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang M.W., Ho R. Moodle: the cost effective solution for internet cognitive behavioral therapy (I-CBT) interventions. Technol. Health Care. 2017;25(1):163–165. doi: 10.3233/THC-161261. [DOI] [PubMed] [Google Scholar]
- Zhao C., Shi C., Zhang L., Zhai Z., Ren Z., Lin X., Jiang G. Establishment of online platform for psychological assistance during a public health emergency. Int. J. Ment. Health Promot. 2020;22(3):123–132. doi: 10.32604/IJMHP.2020.011077. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supplementary material




