Abstract
Background
The coronavirus disease 2019 (COVID-19) pandemic has had an impact on several aspects of life, including university students’ mental health. Mobile mental care applications (apps) comprise a form of online mental care that enables the delivery of remote mental care.
Objectives
This study aimed to explore the impact of COVID-19 on the mental health of university students in Spain and to explore their attitudes toward the use of mobile mental care apps.
Method
Respondents answered a survey, which comprised two sections. The first included the 12-item General Health Questionnaire (GHQ-12) that was employed to assess the students’ mental health. The second section included six questions developed by the authors to explore the students’ attitudes toward mental care apps.
Results
The results showed that the students suffered from anxiety and depression as well as social dysfunction. Further, 91.3 % of the students had never used a mobile app for mental health, 36.3 % were unaware of such apps, and 79.2 % were willing to use them in the future.
Conclusions
The COVID-19 pandemic had a significant impact on the psychological health of university students. Mobile mental care apps may be an effective and efficient way to access mental care, particularly during a pandemic.
Keywords: COVID-19, GHQ-12, Apps, Mobile health, Mental health, Attitudes
1. Introduction
Over 50 different epidemics and pandemics have had a considerable influence on the history of humankind [1] of which the most recent pandemic is the coronavirus disease 2019 (COVID-19) [2]. COVID-19 is caused by the novel 2019 coronavirus (2019-nCoV), which is associated with pneumonia [3]. The outbreak started in December 2019 in Wuhan, China [3]. By August 16, 2020, the disease had spread throughout the world, and more than 21,294,845 people had been infected; of these, 761,779 had died.
Individuals with limited protection from the disease [4] and with physical and mental illnesses are the most vulnerable [5]. Furthermore, the pandemic has had an adverse effect on the mental health of various social groups [6], including university students who were affected by the closure of universities.
Spain has been one of the most affected countries by the pandemic. On August 16, 2020, the country had the fastest rate of new cases in Europe [7] and the highest number of cases in Western Europe [8], with over 342,813 confirmed cases and over 28,617 deaths [9]. Spain was declared by the Center of Disease Control and Prevention (CDC) as a high-risk area with limited medical resources [10]. In March 2020, Spain closed all its schools and universities to 9.5 million students in accordance with government regulations to contain the disease [11].
Anxiety, depression, and stress have been common psychological reactions to the pandemic, with possible long-term psychological effects [12]. Several stressors associated with the pandemic have affected those in quarantine as well as healthcare providers [12].
First, this study explored the psychological impact of the COVID-19 pandemic on university students in Spain. The 12-item General Health Questionnaire (GHQ-12) was employed to assess the psychological state of students from Valladolid University [[13], [14], [15]]. Second, this study examined university students’ attitudes toward the use of mobile mental care applications (apps), such apps could help overcome mental health delivery obstacles including cost, stigmas, and a lack of mental healthcare professionals.
COVID-19 has exacerbated such barriers because traditional psychological care and monitoring have decreased substantially owing to the safety measures that have been implemented because of COVID-19 [16]. However, online care, such as mobile apps, has been adopted as an alternative [[17], [18], [19]]. Research has shown that mobile mental care apps are effective for several psychological difficulties, including anxiety, post-traumatic stress disorder, and depression [[20], [21], [22]].
2. Materials and methods
An online survey was employed in this study.
2.1. Methodology for sharing the questionnaire
Google Forms was employed to develop the online questionnaire. The Privacy Policy Service of the University of Valladolid evaluated the questionnaire to ensure the anonymity of the participants. Subsequently, an email with a link to the survey was sent to all students at the University of Valladolid. The survey was available online from July 7–20, 2020. It was estimated that it would take four minutes to complete; no incentives were offered to any respondents.
2.2. Survey structure
The survey comprised two sections, which are as follows. The first part includes the established GHQ-12 questionnaire to provide an assessment of the psychological state of the participants, while the second part aims to evaluate the participants’ opinion and willingness to use mobile apps to support mental care. In total, the survey consists of 21 questions. Three questions collecting basic information on the characteristics of the students (gender, age and field of study). Twelve questions evaluating the physiological state of the participants. And six questions investigating their attitudes towards mobile applications for mental health.
2.2.1. GHQ-12
This study employed the GHQ-12 to evaluate the participants’ psychological state. The GHQ-12 contains 12 questions, which are assessed on a four-point Likert scale, with 0 indicating that the indicator in question is not present and 3 indicating that it is more prevalent than usual (Appendix A). Higher scores indicate the probability of the respondents suffering from psychological difficulties. The scores can be classified into three severity categories: normal, high, and severe.
The GHQ-12 can be used to detect specific psychological factors; this study considered the following: anxiety and depression, social dysfunction, and loss of confidence. Each factor is associated with certain GHQ-12 items, and the evaluation thereof is calculated using the scores obtained from the specific items (Appendix B).
2.2.2. Assessment of mobile applications for mental health
The same approach as that of previous studies on similar topics was employed to design the questions [[23], [24], [25], [26]], namely, to explore the respondents’ awareness and prior experience of using mental care mobile apps, their willingness to use such apps, and their preferences and reasons thereof in comparison to consulting with a mental care professional (Appendix C). The participants’ preferred features and functionalities of mobile mental care apps were also examined.
2.3. Analysis
The respondents’ answers were only considered if they had answered all the questions. The data were analyzed via IBM SPSS v.26. The results were available in Google Sheet, which was downloaded as an Excel sheet.
The first part investigates the psychological state of the participants, if an item is indicating a better/healthier than normal or same as usual, then the issue investigated by the item is not present more than usual for the participant, and the associated scores are 0 and 1 respectively. However, if it is answered with answers indicating worse/more than usual or much worse/more than usual, then it reflects an abnormal presence of the issue at that period, and the scores would be 2 and 3, respectively.
In the second section, multiple-choice answers were quantified, and the answers to open-ended questions were analyzed and classified to determine the respondents’ attitudes.
3. Results
3.1. Participants’ characteristics
Of the 21,769 students at Valladolid University during the 2019/2020 academic year, 608 (2.79 %) completed the survey. Most respondents were women (74 %), which might be because the majority (56.63 %) of the Valladolid University students were female. Additionally, females have been found to be more willing to complete surveys in similar studies [27]. Of the total participants, 67.5 % were between 18 and 23 years old. During the 2019/2020 academic year, 72.87 % of the students at the university were 23 years old or younger, explaining their prevalence in the sample. Furthermore, 31.3 % of the respondents were studying social and legal sciences (Table 1 ).
Table 1.
Total | % | ||
---|---|---|---|
Gender | Female | 450 | 74 |
Male | 158 | 26 | |
Age | < = 18–19 | 92 | 15.1% |
20–21 | 182 | 29.9% | |
22–23 | 137 | 22.5% | |
≥24 | 197 | 32.4% | |
Field of Study | Naturals Science and Chemistry | 17 | 2.8% |
Mathematics and Physics | 32 | 5.3% | |
Health Sciences | 80 | 13.2% | |
Engineering and Architecture | 126 | 20.7% | |
Social and Legal Sciences | 190 | 31.3 % | |
Arts and Humanities | 61 | 10.0% | |
Others | 102 | 16.8% |
3.2. Results of the GHQ-12
The GHQ-12 results are displayed in Table 2 . Most respondents reported a worse/more than usual prevalence of the particular psychological issues in eight items. However, a majority indicated that their ability to make decisions and face problems had not changed (items 4 and 8). Furthermore, most noted that they did not experience a loss of confidence or feelings of self-worthlessness (items 10 and 11). Description of each item (1–12) and its possible answers are provided in Appendix A.
Table 2.
Item Nr | 0: Better/healthier than normal |
1: Same as usual |
2: Worse/more than usual |
3: Much worse/more than usual |
||||
---|---|---|---|---|---|---|---|---|
Count | % | Count | % | Count | % | Count | % | |
Item 1 | 55 | 9.0% | 101 | 16.6% | 270 | 44.4% | 182 | 29.9% |
Item 2 | 111 | 18.3% | 157 | 25.8% | 223 | 36.7% | 117 | 19.2% |
Item 3 | 64 | 10.5% | 173 | 28.5% | 208 | 34.2% | 163 | 26.8% |
Item 4 | 45 | 7.4% | 258 | 42.4% | 216 | 35.5% | 89 | 14.6% |
Item 5 | 75 | 12.3% | 110 | 18.1% | 253 | 41.6% | 170 | 28.0% |
Item 6 | 115 | 18.9% | 182 | 29.9% | 215 | 35.4% | 96 | 15.8% |
Item 7 | 31 | 5.1% | 86 | 14.1% | 227 | 37.3% | 264 | 43.4% |
Item 8 | 26 | 4.3% | 274 | 45.1% | 224 | 36.8 % | 84 | 13.8% |
Item 9 | 78 | 12.8% | 110 | 18.1% | 234 | 38.5% | 186 | 30.6% |
Item 10 | 208 | 34.2% | 153 | 25.2% | 146 | 24.0% | 101 | 16.6% |
Item 11 | 264 | 43.4% | 119 | 19.6% | 139 | 22.9% | 86 | 14.1% |
Item 12 | 49 | 8.1% | 219 | 36.0% | 236 | 38.8% | 104 | 17.1% |
The total GHQ-12 scores and the scores of the three investigated psychological factors were calculated and categorized into three scales according to the specifications presented in Appendix B.
The results in relation to the total number of respondents and their gender are presented in Appendix D. The results showed that 52.1 % of the respondents were classified as high, 30.1 % as severe, and 17.8 % as normal. Furthermore, the results revealed that female respondents had been critically affected. Regarding anxiety and depression, 44.7 %, 31.6 %, and 23.7 % of the respondents were classified as high, severe, and normal, respectively. Concerning social dysfunction, 53.6 % of the respondents were classified as high, 33.7 % as severe, and 12.7 % as normal. The most positive results concerned the loss of confidence scale: 57.4 % of the respondents were classified as normal.
3.3. Results of the assessment of mental health mobile applications
In total, 36.3 % of the respondents had not heard of mobile mental care apps. Furthermore, 91.3 % (N = 555) had never used such a mobile app for mental health. Their willingness to use mobile apps for mental health was directly assessed in Question 3. The results further demonstrated 55.4 % of the respondents were willing to use this type of app. Only 9.5 % indicated that they were unwilling to use a mental care mobile app. The Q1–Q4 results are displayed in Table 3 .
Table 3.
Question/Answer | Total (N = 608) |
Female (N = 450) |
Male (N = 158) (N = 158) |
||||
---|---|---|---|---|---|---|---|
Count | % | Count | Count | % | |||
Q1: Awareness of mobile mental care apps | Yes | 221 | 36.3 % | 173 | 38.4% | 48 | 30.4% |
No | 387 | 63.7% | 277 | 61.6% | 110 | 69.6% | |
Q2: Previous use of mobile mental care apps | Yes | 53 | 8.7 % | 41 | 9.1 % | 12 | 7.6 % |
No | 555 | 91.3% | 409 | 90.9% | 146 | 92.4% | |
Q3: Willingness to use mobile mental care apps in the future | Yes | 337 | 55.4 % | 268 | 59.6 % | 69 | 43.7% |
I do not know | 213 | 35.0% | 148 | 32.9% | 65 | 41.1 % | |
No | 58 | 9.5 % | 34 | 7.6 % | 24 | 15.2% | |
Q4: Preference of using a mobile mental care apps over consulting with a mental health professional | Yes | 117 | 19.2% | 86 | 19.1 % | 31 | 19.6% |
I do not know | 157 | 25.8% | 116 | 25.8% | 41 | 25.9% | |
No | 334 | 54.9 % | 248 | 55.1% | 86 | 54.4% |
The association between the users’ previous usage of mental care mobile apps and their willingness to use such apps in the future is presented in Appendix E. In total, 79.2 % of the respondents who had used mobile apps for mental health were receptive to using them in the future. Moreover, 53.2 % who did not have previous experiences with such apps were willing to use them in the future. However, 36.8 % were doubtful, and 10.1 % stated they would not use them. Finally, only two of the respondents who had used such apps did not want to use them in the future. It can be concluded that most of the individuals who have used mobile apps for mental health are open to using them again.
The willingness of the respondents who were classified as severe in relation to the GHQ-12 is presented in Appendix F. Of these, 62.3 % had no previous knowledge of mental care mobile apps, and 55.19 % had no intention of using them. This is noteworthy because these individuals may be regarded as those in need of such resources. Moreover, 159 individuals never have used a mobile application for mental health. In total, 54.64 % (N = 100) of the participants are receptive to the use of this kind of mobile applications. Nevertheless, 55.19 % (N = 101) of the participants who are categorized as Severe condition do not prefer the use of mobile applications for mental care.
The reasons the respondents preferred mobile apps over consultations with a mental health specialist are presented in Table 4 . In particular, 59 respondents were concerned with the cost, 22 cited stigmas, 17 did not have sufficient knowledge of mental health, and six cited distance. The reasons for preferring mobile apps included the limited number of available mental health professionals, previous negative experiences with mental specialists, privacy and security, the severity of the mental state, the access of and time-saving associated with mobile apps, the current social isolation required by the lockdown, and difficulties in obtaining an initial appointment.
Table 4.
Reason | Count | % |
---|---|---|
Cost problems | 59 | 50.4 % |
Stigma related to mental problems | 22 | 18.8% |
I don’t have enough knowledge (information) on mental health | 17 | 14.5% |
Distance from mental health professionals | 6 | 5.1% |
Shortage in mental health professionals | 3 | 2.6% |
Bad experiences with therapists | 2 | 1.7% |
Privacy and security of mental apps | 2 | 1.7% |
It is supportive if the problem is not serious | 2 | 1.7% |
Save time and access at any time | 2 | 1.7% |
For the state of isolation owing to the COVID-19 pandemic | 1 | 0.9% |
For a first assessment | 1 | 0.9% |
The functionalities that the respondents wanted in mental care mobile apps are displayed in Table 5 . In total, 174 of the participants did not have clear ideas regarding the features that they wanted in mobile apps, 105 wanted free guides that contained expert advice, and 67 wanted the app to include meditation exercises for stress and anxiety management. Finally, 29 stated such mobile apps should be endorsed by mental healthcare professionals.
Table 5.
Reason | Count | % |
---|---|---|
I do not know | 174 | 28.60% |
Free guides with expert advice | 105 | 17.20 % |
Online therapy with a specialist | 78 | 12.8% |
Meditation exercises to stress and anxiety management | 67 | 11.00% |
General answers | 58 | 9.70% |
Supported by professionals in psychiatry and psychology | 29 | 4.80% |
Exercises and daily support routines with a goal’s indicators | 28 | 4.60% |
Invalid answers | 24 | 3.90 % |
Tips to increase confidence in specific moments | 18 | 3.00% |
Overcoming interviews of people who have suffered problems | 14 | 2.30% |
Test that facilitates the detection of the issues and advice to solve them | 13 | 2.10% |
4. Discussion
4.1. GHQ-12
The GHQ-12 test revealed a substantial prevalence of psychological issues among university students in Spain during COVID-19. The results concurred with the expected prevalence of negative feelings, including fear, worry, and stress [28].
Globally, 322 million and 264 million individuals are estimated to be suffering from depression and anxiety, respectively [29]. Furthermore, 85 % of patients with depression have significant anxiety, and 90 % with anxiety disorder suffer from depression [30]. In this study, 44.7 % of the students were classified as having high anxiety and depression, 31.6 % as severe, and 23.7 % as normal.
Preliminary evidence suggests that depression, anxiety, and stress are common psychological responses to COVID-19 [31]. Several landmark studies have evinced the critical impact of COVID-19 on mental health. A systematic review on the impact of COVID-19 on mental health in the general population reported that symptoms of anxiety, depression, and stress were prevalent in several countries [32]. Studies conducted in China have yielded similar findings [32,33]; a significantly higher prevalence of anxiety and depression was found among young people [34]. Another study identified a higher prevalence of anxiety and depression among the Polish population compared to that of the Chinese, which was mainly associated with not wearing face masks; both populations had a high prevalence of post-traumatic stress disorder symptoms [35]. In the United Kingdom, the percentage of individuals with a probable anxiety disorder was found to have almost doubled during COVID-19, with a higher prevalence of anxiety and depression among the younger population [36]. Similar results were reported in Germany [37], with a high prevalence of anxiety and depression among the general population and particularly among young people. The results of the GHQ-12 test herein concur with other studies that have addressed COVID-19′s impact on university students. In France, a high prevalence of anxiety, depression, and stress among university students was identified [38,39]. Similar results were found in Bangladesh [40] and China [41].
Furthermore, there was a higher prevalence among students whose family members and relatives had COVID-19 [41]. In this study, the high prevalence of anxiety and depression may be related to the time of the research, which was conducted during the advanced stages of the pandemic in July 2020. In Spain, another study reported that levels of stress, anxiety, and depression were generally low during the initial stages of the pandemic; however, these levels increased when the period of confinement was extended [42]. The same study was repeated three weeks later and revealed significantly higher levels of anxiety, depression, and stress among the participants, with a higher prevalence among young people [43].
The results herein revealed that the prevalence of social dysfunction was high and severe in 53.6 % and 33.7 % of the students, respectively. Social dysfunction is related to individuals’ ability to execute and enjoy their normal daily activities. During the pandemic, almost all the students’ day-to-day activities were cancelled owing to the safety regulations, thereby explaining the students’ high scores on this measure.
Furthermore, 57.4 % of the respondents were classified as normal in relation to the loss of confidence. This factor in the GHQ-12 is mainly related to losing confidence and experiencing feelings of worthlessness, which are generally related to personality traits. Therefore, it was not expected to have a substantial effect on the results because the pandemic may not have had a considerable impact on this factor. However, it may indicate more serious psychological issues among those who had high scores for this factor. Feelings of worthlessness are indicators of serious psychological problems as individuals may feel imprisoned in their own life situations and not trust themselves and others. Consequently, it may lead to destructive feelings such as shame, guilt, stigmatization, alienation, and anguish [44]. Worthlessness is also associated with exposure to severe trauma and when combined with major depressive disorder may lead to suicide attempts [45].
4.2. Attitudes
Most of the participants had no previous knowledge of mental care mobile apps. Even if individuals are aware of such apps, they may lack knowledge concerning the functionalities thereof. Thus, it is essential to introduce these apps in the education system. Only 53 (8.7 %) of participants (9.1 % of females and 7.6 % of males) stated previous use of mobile mental care apps. This could be mainly linked to the identified lack of awareness. However, those participants constitute only 24 % of the 221 individuals who stated prior awareness of mobile mental care apps, which might be an indicator that even in cases of awareness on the existence of such apps, there might be the lack of knowledge on functionalities, treatment modalities, services offered by those apps, and effectiveness of such apps. Indeed, even when students are aware of mobile mental care apps existence, they are not using them, which might point to the need of not only increase awareness but also increase knowledge on their benefits in order to increase the trust in such apps and promote their use.
Research [45] has suggested that adolescents with depression spend more time using social networks than those without. Therefore, social networks could be used effectively to promote the use of mental care mobile apps, as studies have shown that they are widely used among young people [46,47]. Furthermore, concerning the individuals who do not have previous knowledge on this kind of mobile apps (N = 387), 51.4 % state that they do not prefer to use mobile applications for mental health. Therefore, the lack of awareness and knowledge is highly correlated with the unwillingness to use mobile apps for mental health.
Similar to previous studies [48,49], the results herein suggested that women are more open to using mobile apps than men. With females (59.6 %) being more open to using such apps in the future than males (41.1 %).
In this study, 54.9 % of the respondents reported that they would prefer consulting a professional over using an app. Although several studies have presented promising results for the use of mobile apps for mental health, human care is necessary to treat mental health problems. Moreover, mobile apps are not suitable for all psychological issues [48,50,51]. It is necessary to involve mental healthcare professionals in the co-design of these apps and apply psychological theories such as cognitive behavioral therapy and mindfulness based therapy [52].
Some respondents who indicated a preference for mobile apps over consultations with healthcare practitioners cited the reason as cost. Only 20 % of the population have access to professional care in high-income countries [45,53]. Families’ financial difficulties may force them to avoid professional care. Thus, improving access to mental healthcare is imperative.
The stigmas associated with psychological problems were also given as a reason for preferring mobile apps. Studies have found that stigmas are closely associated with a lack of treatment opportunities [54,55,56]. Although levels of education have improved in the last two decades, discrimination against those with psychological difficulties remains [57].
Access to specialists is also a relevant challenge. Several studies have revealed the impact of the accessibility or the lack of mental healthcare [[58], [59], [60]]. Smartphones are an integral part of individuals’ daily routine [61]. Therefore, a joint effort from interdisciplinary fields is necessary to develop new strategies to enhance their impact on society and the economy.
Mental care apps are considerably underused, which is closely related to an absence of information on the features of such apps. Several studies on meditation treatments delivered through mobile apps have reported effective results [[62], [63], [64]].
Studies conducted on the application of gamification on mental health apps have reported promising results [61,62,66]. Several participants in the present research noted the necessity of including gamification features to ensure that the app is used consistently. However, 24 respondents indicated they only trusted personal care.
Although mental care mobile apps are a practical approach validated by several studies [[63], [64], [65],68,69], their use has several limitations. Previous studies have revealed the need to develop guidelines to evaluate mental care mobile apps and to incorporate the citation of sources and privacy information to the end-users [70]. One study [71] concluded that more than 50 % of patients in all age groups had accepted the daily use of mental care mobile apps. Moreover, another study [72] suggested that such apps should be promoted because of their positive impact on public health. Furthermore, relevant recommendations for the development of such apps have been presented [67]. In summary, it is recommended that similar studies should be conducted in several locations to understand user requirements for these apps. Users’ needs are crucial to developing effective and efficient mobile apps for enhanced healthcare. These requirements may differ depending on the users’ location and age [70]. Therefore, it is imperative to ensure that such apps are designed and developed with the involvement of mental health professionals [73]. Furthermore, it is crucial to present scientifically validated content to the users and introduce enhanced features such as gamification.
5. Limitations
This study might have several limitations. First, most of the respondents were female. Second, the utilization of other satisfaction scales would have enhanced the findings on the students’ attitudes. Third, additional questions that examined attitudes toward mental care mobile apps would have extended the findings. Finally, conducting face-to-face interviews would have allowed the researchers to explore the respondents’ preferences and attitudes toward mental care apps in-depth.
6. Conclusions
COVID-19 has an impact on several aspects of life, including health, finance, and education. This study investigated its impact on the psychological state of Valladolid University students using the GHQ-12. Moreover, it explored students’ attitudes and willingness to use mobile apps for their mental care. This study shows that most of the participants are in the High scale concerning almost all psychological factors with exception to loss of confidence. In total, 52.1 %, 44.7 % and 53.6 % of the participants are in the High scale concerning GHQ-12, anxiety and depression, and social dysfunction, respectively. The results indicated that although students are in need of psychological support during this pandemic, it has been difficult to access mental help in the traditional manner (i.e., by consulting with a mental healthcare professional). Mobile mental care apps may prove beneficial in such situations. The findings herein could support future research activities on the design and development of mobile apps for mental health for university students in Spain. The reasons reported to prefer the use of mobile mental care apps instead of consulting with a specialist and the functionalities that the participants want to see on mobile applications are a critical base of knowledge to support the design of novel applications in this field. Future work will be conducted on the development of a mobile application for mental health.
Authors contributions
All authors contributed to the creation of the manuscript. GM and ND: design, conception, acquisition and interpretation of data, analysis of questionnaire answers, drafting of the manuscript, revision. SO: design, conception, statistical support, critical revision. ITD and BSA: distribution of the questionnaire, collection of Data and critical revision.
Summary Points:
-
•
The majority of the participants are females (74 %), 52.4 % of the participants are between 20–23 years old, and 31.3 % are from the social and legal sciences field.
-
•
The results show that most of the participants are in the High scale concerning almost all psychological factors with exception to loss of confidence.
-
•
In total, 52.1 %, 44.7 % and 53.6 % of the participants are in the High scale concerning GHQ-12, anxiety and depression, and social dysfunction, respectively.
-
•
387 (36.3 %) participants did not have heard of mobile applications for mobile health.
-
•
91.3 % (N = 555) of the individuals never use a mobile application for mental health.
-
•
79.2 % (N = 42) of the users who have used mobile applications for mental health are willing to use them in the future.
-
•
From the participants who prefer to use mobile applications in comparison to a consultation with a mental health specialist, 50.4 % state the cost as the main reason.
-
•
This work suggests that students are in need of psychological support during this crisis
;1;
Declaration of Competing Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Footnotes
Supplementary material related to this article can be found, in the online version, at doi:https://doi.org/10.1016/j.ijmedinf.2020.104369.
Appendix A. Supplementary data
The following are Supplementary data to this article:
References
- 1.Hays J.N. 2005. Epidemics and Pandemics: Their Impacts on Human History. [Google Scholar]
- 2.WHO . World Health Organization; 2020. Novel Coronavirus(2019-nCoV). Situation Report – 22; p. 22.https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200211-sitrep-22-ncov.pdf?sfvrsn=fb6d49b1_2 [Online]. Available: [Google Scholar]
- 3.WHO . World Health Organization; 2020. Novel Coronavirus (2019-nCoV). Situation Report - 1; p. 1.https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200121-sitrep-1-2019-ncov.pdf?sfvrsn=20a99c10_4 [Online]. Available: [Google Scholar]
- 4.Tan W., et al. Is returning to work during the COVID-19 pandemic stressful? A study on immediate mental health status and psychoneuroimmunity prevention measures of Chinese workforce. Brain Behav. Immun. 2020;87(July):84–92. doi: 10.1016/j.bbi.2020.04.055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Hao F., et al. Do psychiatric patients experience more psychiatric symptoms during COVID-19 pandemic and lockdown? A case-control study with service and research implications for immunopsychiatry. Brain Behav. Immun. 2020;87(July):100–106. doi: 10.1016/j.bbi.2020.04.069. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Talevi Dalila, et al. Mental health outcomes of the CoViD-19 pandemic. Riv. Psichiatr. 2020;(May) doi: 10.1708/3382.33569. no. 2020 May-June. [DOI] [PubMed] [Google Scholar]
- 7.Badcock J. BBC News; 2020. Coronavirus: Why Spain Is Seeing Second Wave.https://www.bbc.com/news/world-europe-53832981 [Google Scholar]
- 8.VOA News . US News; 2020. Spain Overtakes Britain for Most COVID-19 Cases in Europe.https://www.voanews.com/covid-19-pandemic/spain-overtakes-britain-most-covid-19-cases-europe [Google Scholar]
- 9.WHO . World Health Organization; 2020. Coronavirus Disease (COVID-19). Situation Report – 209.https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200816-covid-19-sitrep-209.pdf?sfvrsn=5dde1ca2_2 [Online]. Available: [Google Scholar]
- 10.CDC . Centers of Didease Control and Prevention; 2020. COVID-19 in Spain.https://wwwnc.cdc.gov/travel/notices/warning/coronavirus-spain [Google Scholar]
- 11.Smith C. 2020. Coronavirus: Spain Closes All Schools and Universities to 9.5 Million Students as Government Ministers Now Among the 3000 Infected.https://www.theolivepress.es/spain-news/2020/03/12/coronavirus-spain-closes-all-schools-and-universities-to-9-5-million-students-as-government-ministers-now-among-the-3000-infected/ [Google Scholar]
- 12.Brooks S.K., et al. The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet. 2020;395(March 10227):912–920. doi: 10.1016/S0140-6736(20)30460-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Zulkefly N.S., Baharudin R. vol. 2. 2010. pp. 73–80. (Using the 12-Item General Health Questionnaire (GHQ-12) to Assess the Psychological Health of Malaysian College Students). [Google Scholar]
- 14.Baksheev G.N., Robinson J., Cosgrave E.M., Baker K., Yung A.R. Validity of the 12-item General Health Questionnaire (GHQ-12) in detecting depressive and anxiety disorders among high school students. Psychiatry Res. 2011;187(May 1–2):291–296. doi: 10.1016/j.psychres.2010.10.010. [DOI] [PubMed] [Google Scholar]
- 15.Yaghubi H. vol. 6. 2012. pp. 153–160. (Validity and Factor Structure of the General Health Questionnaire (GHQ-12) in University Students). [Google Scholar]
- 16.Pfefferbaum B., North C.S. Mental health and the Covid-19 pandemic. N. Engl. J. Med. 2020;383(August 6):510–512. doi: 10.1056/NEJMp2008017. [DOI] [PubMed] [Google Scholar]
- 17.Liu S., et al. Online mental health services in China during the COVID-19 outbreak. Lancet Psychiatry. 2020;7(April 4):e17–e18. doi: 10.1016/S2215-0366(20)30077-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Cheng P., et al. COVID-19 epidemic peer support and crisis intervention via social media. Community Ment. Health J. 2020;56(July 5):786–792. doi: 10.1007/s10597-020-00624-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Rastegar Kazerooni A., Amini M., Tabari P., Moosavi M. Peer mentoring for medical students during the COVID‐19 pandemic via a social media platform. Med. Educ. 2020;54(August 8):762–763. doi: 10.1111/medu.14206. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Firth J., Torous J., Nicholas J., Carney R., Rosenbaum S., Sarris J. Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. J. Affect. Disord. 2017;218(August):15–22. doi: 10.1016/j.jad.2017.04.046. [DOI] [PubMed] [Google Scholar]
- 21.Wright J.H., Mishkind M., Eells T.D., Chan S.R. Computer-assisted cognitive-behavior therapy and mobile apps for depression and anxiety. Curr. Psychiatry Rep. 2019;21(July 7):62. doi: 10.1007/s11920-019-1031-2. [DOI] [PubMed] [Google Scholar]
- 22.Coulon S.M., Monroe C.M., West D.S. A systematic, multi-domain review of mobile smartphone apps for evidence-based stress management. Am. J. Prev. Med. 2016;51(July 1):95–105. doi: 10.1016/j.amepre.2016.01.026. [DOI] [PubMed] [Google Scholar]
- 23.Sreejith G., Menon V. Mobile phones as a medium of mental health care service delivery: perspectives and barriers among patients with severe mental illness. Indian J. Psychol. Med. 2019;41(September 5):428–433. doi: 10.4103/IJPSYM.IJPSYM_333_18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Sukmawati I., Ardi Z., Ifdil I., Zikra Z. Development and validation of acceptability of mental-health mobile app survey (AMMS) for android-based online counseling service assessment. J. Phys. Conf. Ser. 2019;1339(December):012124. doi: 10.1088/1742-6596/1339/1/012124. [DOI] [Google Scholar]
- 25.Miller K.E., et al. Use and perceptions of mobile apps for patients among VA primary care mental and behavioral health providers. Prof. Psychol. Res. Pract. 2019;50(June 3):204–209. doi: 10.1037/pro0000229. [DOI] [Google Scholar]
- 26.Atallah N., Khalifa M., El Metwally A., Househ M. The prevalence and usage of mobile health applications among mental health patients in Saudi Arabia. Comput. Methods Programs Biomed. 2018;156(March):163–168. doi: 10.1016/j.cmpb.2017.12.002. [DOI] [PubMed] [Google Scholar]
- 27.Drissi N., Alhmoudi A., Al Nuaimi H., Alkhyeli M., Alsalami S., Ouhbi S. Investigating the impact of COVID-19 lockdown on the psychological health of university students and their attitudes toward mobile mental health solutions: two-part questionnaire study. JMIR Form. Res. 2020;4(October 10):e19876. doi: 10.2196/19876. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.WHO . 2020. Mental Health & COVID-19.https://www.who.int/teams/mental-health-and-substance-use/covid-19 [Google Scholar]
- 29.WHO. Depression and Other Common Mental Disorders, World Health Organization https://www.who.int/publications/i/item/depression-global-health-estimates.
- 30.Tiller J.W.G. Depression and anxiety. Med. J. Aust. 2013;199(S6):S28–S31. doi: 10.5694/mja12.10628. [DOI] [PubMed] [Google Scholar]
- 31.Rajkumar R.P. COVID-19 and mental health: a review of the existing literature. Asian J. Psychiatry. 2020;52(August):102066. doi: 10.1016/j.ajp.2020.102066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Xiong J., et al. Impact of COVID-19 pandemic on mental health in the general population: a systematic review. J. Affect. Disord. 2020;277(December):55–64. doi: 10.1016/j.jad.2020.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Wang C., et al. A longitudinal study on the mental health of general population during the COVID-19 epidemic in China. Brain Behav. Immun. 2020;87(July):40–48. doi: 10.1016/j.bbi.2020.04.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Huang Y., Zhao N. Generalized anxiety disorder, depressive symptoms and sleep quality during COVID-19 outbreak in China: a web-based cross-sectional survey. Psychiatry Res. 2020;288(June):112954. doi: 10.1016/j.psychres.2020.112954. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Wang C., et al. The association between physical and mental health and face mask use during the COVID-19 pandemic: a comparison of two countries with different views and practices. Front. Psychiatry. 2020;11(September):569981. doi: 10.3389/fpsyt.2020.569981. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Kwong A.S.F., et al. Mental health during the COVID-19 pandemic in two longitudinal UK population cohorts. Psychiatry and Clin. Psychol. preprint. 2020;(June) doi: 10.1101/2020.06.16.20133116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Bäuerle A., et al. Increased generalized anxiety, depression and distress during the COVID-19 pandemic: a cross-sectional study in Germany. J. Public Health (Bangkok) 2020;(July):fdaa106. doi: 10.1093/pubmed/fdaa106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Husky M.M., Kovess-Masfety V., Swendsen J.D. Stress and anxiety among university students in France during Covid-19 mandatory confinement. Compr. Psychiatry. 2020;102(October):152191. doi: 10.1016/j.comppsych.2020.152191. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Essadek A., Rabeyron T. Mental health of French students during the Covid-19 pandemic. J. Affect. Disord. 2020;(August) doi: 10.1016/j.jad.2020.08.042. p. S0165032720326483. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Islam Md.A., Barna S.D., Raihan H., Khan Md.N.A., Hossain Md.T. Depression and anxiety among university students during the COVID-19 pandemic in Bangladesh: a web-based cross-sectional survey. PLoS One. 2020;15(August 8):e0238162. doi: 10.1371/journal.pone.0238162. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Wang Z.-H., et al. Prevalence of anxiety and depression symptom, and the demands for psychological knowledge and interventions in college students during COVID-19 epidemic: a large cross-sectional study. J. Affect. Disord. 2020;275(October):188–193. doi: 10.1016/j.jad.2020.06.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Ozamiz-Etxebarria N., Dosil-Santamaria M., Picaza-Gorrochategui M., Idoiaga-Mondragon N. Niveles de estrés, ansiedad y depresión en la primera fase del brote del COVID-19 en una muestra recogida en el norte de España. Cad. Saúde Pública. 2020;36(4):e00054020. doi: 10.1590/0102-311x00054020. [DOI] [PubMed] [Google Scholar]
- 43.Ozamiz-Etxebarria N., Idoiaga Mondragon N., Dosil Santamaría M., Picaza Gorrotxategi M. Psychological symptoms during the two stages of lockdown in response to the COVID-19 outbreak: an investigation in a sample of citizens in Northern Spain. Front. Psychol. 2020;11(June):1491. doi: 10.3389/fpsyg.2020.01491. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Margaretha Strandmark K. Ill health is powerlessness: a phenomenological study about worthlessness, limitations and suffering. Scand. J. Caring Sci. 2004;18(June 2):135–144. doi: 10.1111/j.1471-6712.2004.00275.x. [DOI] [PubMed] [Google Scholar]
- 45.Jeon H.J., et al. Feelings of worthlessness, traumatic experience, and their comorbidity in relation to lifetime suicide attempt in community adults with major depressive disorder. J. Affect. Disord. 2014;166(September):206–212. doi: 10.1016/j.jad.2014.05.010. [DOI] [PubMed] [Google Scholar]
- 46.Keresteš G., Štulhofer A. Adolescents’ online social network use and life satisfaction: a latent growth curve modeling approach. Comput. Hum. Behav. 2020;104(March):106187. doi: 10.1016/j.chb.2019.106187. [DOI] [Google Scholar]
- 47.Yahya Y., Rahim N.Z.Ab., Ibrahim R., Azmi N.F., Sjarif N.N.A., Sarkan H.M. Between habit and addiction: an overview of preliminary finding on social networking sites usage among teenagers. Proceedings of the 2019 5th International Conference on Computer and Technology Applications - ICCTA 2019; Istanbul, Turkey; 2019. pp. 112–116. [DOI] [Google Scholar]
- 48.Gunn J., et al. Uptake of mental health websites in primary care: insights from an Australian longitudinal cohort study of depression. Patient Educ. Couns. 2018;101(January 1):105–112. doi: 10.1016/j.pec.2017.07.008. [DOI] [PubMed] [Google Scholar]
- 49.Tlach L., Thiel J., Härter M., Liebherz S., Dirmaier J. Acceptance of the German e-mental health portal www.psychenet.de: an online survey. PeerJ. 2016;4(July):e2093. doi: 10.7717/peerj.2093. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Lee K., Bejerano I.L., Han M., Choi H.S. Willingness to use smartphone apps for lifestyle management among patients with schizophrenia. Arch. Psychiatr. Nurs. 2019;33(August 4):329–336. doi: 10.1016/j.apnu.2019.01.002. [DOI] [PubMed] [Google Scholar]
- 51.Fortuna K.L., et al. Smartphone ownership, use, and willingness to use smartphones to provide peer-delivered services: results from a national online survey. Psychiatr. Q. 2018;89(December 4):947–956. doi: 10.1007/s11126-018-9592-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Ho C.S., Chee C.Y., Ho R.C. Mental health strategies to combat the psychological impact of COVID-19 beyond paranoia and panic. Ann. Acad. Med. Singapore. 2020;49(3):155–160. [PubMed] [Google Scholar]
- 53.Singla D.R., Raviola G., Patel V. Scaling up psychological treatments for common mental disorders: a call to action: LETTERS TO THE EDITOR. World Psychiatry. 2018;17(June 2):226–227. doi: 10.1002/wps.20532. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Thornicroft G., et al. Undertreatment of people with major depressive disorder in 21 countries. Br. J. Psychiatry. 2017;210(February 2):119–124. doi: 10.1192/bjp.bp.116.188078. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Yang L.H., et al. A theoretical and empirical framework for constructing culture-specific stigma instruments for Chile. Cad. Saúde Coletiva. 2013;21(March 1):71–79. doi: 10.1590/S1414-462X2013000100011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Fox A.B., Earnshaw V.A., Taverna E.C., Vogt D. Conceptualizing and measuring mental illness stigma: the mental illness stigma framework and critical review of measures. Stigma Health. 2018;3(November 4):348–376. doi: 10.1037/sah0000104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Rodríguez-Almagro, Hernández-Martínez, Rodríguez-Almagro, Quiros-García, Solano-Ruiz, Gómez-Salgado Level of stigma among spanish nursing students toward mental illness and associated factors: a mixed-methods study. Int. J. Environ. Res. Public Health. 2019;16(December 23):4870. doi: 10.3390/ijerph16234870. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Chen C.K., et al. Implementation of Telemental Health (TMH) psychological services for rural veterans at the VA New York Harbor Healthcare System. Psychol. Serv. 2019;(February) doi: 10.1037/ser0000323. [DOI] [PubMed] [Google Scholar]
- 59.Watt P. Recommendations for the provision of psychological support in a rural inflammatory bowel disease clinic. Inflamm. Bowel Dis. 2019;25(October 11):e149–e150. doi: 10.1093/ibd/izz221. [DOI] [PubMed] [Google Scholar]
- 60.Hoeft T.J., Fortney J.C., Patel V., Unützer J. Task-sharing approaches to improve mental health care in rural and other low-resource settings: a systematic review: task-sharing rural mental health. J. Rural Health. 2018;34(January 1):48–62. doi: 10.1111/jrh.12229. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Parasuraman S., Sam A., Yee S.K., Chuon B.C., Ren L. Smartphone usage and increased risk of mobile phone addiction: a concurrent study. Int. J. Pharm. Investig. 2017;7(3):125. doi: 10.4103/jphi.JPHI_56_17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Daudén Roquet C., Sas C. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. Montreal QC Canada; 2018. Evaluating mindfulness meditation apps; pp. 1–6. Apr. [DOI] [Google Scholar]
- 63.Carissoli C., Villani D., Riva G. Does a meditation protocol supported by a mobile application help people reduce stress? Suggestions from a controlled pragmatic trial. Cyberpsychology Behav. Soc. Netw. 2015;18(January 1):46–53. doi: 10.1089/cyber.2014.0062. [DOI] [PubMed] [Google Scholar]
- 64.Flett J.A.M., Hayne H., Riordan B.C., Thompson L.M., Conner T.S. Mobile mindfulness meditation: a randomised controlled trial of the effect of two popular apps on mental health. Mindfulness. 2019;10(May 5):863–876. doi: 10.1007/s12671-018-1050-9. [DOI] [Google Scholar]
- 65.Fleming T.M., et al. Serious games and gamification for mental health: current status and promising directions. Front. Psychiatry. 2017;7(January) doi: 10.3389/fpsyt.2016.00215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Cheng V.W.S., Davenport T.A., Johnson D., Vella K., Mitchell J., Hickie I.B. An App That Incorporates Gamification, Mini-Games, and Social Connection to Improve Men’s Mental Health and Well-Being (MindMax): Participatory Design Process. JMIR Ment. Health. 2018;5(November 4):e11068. doi: 10.2196/11068. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Rajagopalan A., Shah P., Zhang M., Ho R. Digital platforms in the assessment and monitoring of patients with bipolar disorder. Brain Sci. 2017;7(November 12):150. doi: 10.3390/brainsci7110150. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Do T.T.T., et al. Receptiveness and preferences of health-related smartphone applications among Vietnamese youth and young adults. BMC Public Health. 2018;18(December 1):764. doi: 10.1186/s12889-018-5641-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Tran B.X., et al. What drives young vietnamese to use mobile health innovations? Implications for health communication and behavioral interventions. JMIR Mhealth Uhealth. 2018;6(November 11):e194. doi: 10.2196/mhealth.6490. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Nicholas J., Larsen M.E., Proudfoot J., Christensen H. Mobile apps for bipolar disorder: a systematic review of features and content quality. J. Med. Internet Res. 2015;17(August 8):e198. doi: 10.2196/jmir.4581. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Torous J., Friedman R., Keshavan M. Smartphone ownership and interest in mobile applications to monitor symptoms of mental health conditions. JMIR Mhealth Uhealth. 2014;2(January 1):e2. doi: 10.2196/mhealth.2994. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Becker D. Acceptance of mobile mental health treatment applications. Procedia Comput. Sci. 2016;98:220–227. doi: 10.1016/j.procs.2016.09.036. [DOI] [Google Scholar]
- 73.Ebenfeld L., et al. A mobile application for panic disorder and agoraphobia: insights from a multi-methods feasibility study. Internet Interv. 2020;19(March):100296. doi: 10.1016/j.invent.2019.100296. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.