Abstract
University students are particularly vulnerable to mental health issues, with anxiety and depression identified as the most common conditions. During the COVID-19 pandemic, social distancing, self-isolation, and difficulties linked to online teaching and learning have increased their burden of anxiety and depressive symptoms. Thus, the urgent need to intervene in favour of these vulnerable subjects, together with the difficulties in delivering in-person interventions because of lockdowns and restrictions, has led to prioritize digital mental health strategies. This study aimed at systematically reviewing the existing literature on digital mental health interventions targeting anxiety and depressive symptoms in university students during the COVID-19 emergency. Systematic searches of Medline, Embase, and PsycInfo databases identified eight randomized controlled trials. Regarding anxiety symptoms, digitally delivered cognitive behavioural therapy, dialectical behaviour therapy, and mind-body practice techniques emerged as valid strategies, while digital positive psychology and mindfulness-based interventions showed mixed results. On the other hand, digitally delivered dialectical behaviour therapy and positive psychology interventions have shown some efficacy in reducing depressive symptoms. Overall, the available literature, albeit of low quality, seems to support the role of digital interventions in promoting the mental health of university students during the COVID-19 pandemic.
Keywords: Anxiety, COVID-19, Depression, Digital mental health interventions, Mental health, University students
Abstract
Los estudiantes universitarios son particularmente vulnerables a los problemas de salud mental, siendo la ansiedad y la depresión las condiciones más comunes. Durante la pandemia de COVID-19, el distanciamiento social, el autoaislamiento y las dificultades relacionadas con la enseñanza y el aprendizaje en línea han aumentado su carga de ansiedad y síntomas depresivos. Así, la urgente necesidad de intervenir a favor de estos sujetos vulnerables, junto con las dificultades para realizar intervenciones presenciales a causa de los confinamientos y restricciones, ha llevado a priorizar estrategias de salud mental digital. Este estudio tuvo como objetivo revisar sistemáticamente la literatura existente sobre intervenciones digitales de salud mental dirigidas a la ansiedad y los síntomas depresivos en estudiantes universitarios durante la emergencia de COVID-19. Las búsquedas sistemáticas en las bases de datos Medline, Embase y PsycInfo identificaron ocho ensayos controlados aleatorios. Con respecto a los síntomas de ansiedad, la terapia cognitiva conductual, la terapia conductual dialéctica y las técnicas de práctica mente-cuerpo entregadas digitalmente surgieron como estrategias válidas, mientras que la psicología positiva digital y las intervenciones basadas en el mindfulness mostraron resultados mixtos. Por otro lado, la terapia conductual dialéctica y las intervenciones de psicología positiva proporcionadas digitalmente han demostrado cierta eficacia en la reducción de los síntomas depresivos. En general, la literatura disponible, aunque de baja calidad, parece respaldar el papel de las intervenciones digitales en la promoción de la salud mental de los estudiantes universitarios durante la pandemia de COVID-19.
Palabras clave: Ansiedad, COVID-19, Depresión, Estudiantes universitarios, Intervenciones digitales de salud mental, Salud mental
Introduction
Several challenges expose higher education students to increased vulnerability to psychological distress and mental illness, especially during the first years of academic courses.1, 2 The transition to university often leads to increased social, performance, and financial demands, as well as to major changes in lifestyle habits.3 A rising trend for psychological distress and mental health issues among university students, in terms of both incidence and severity, had been already highlighted in the past decades.4 Amongst these, anxiety and depressive features were identified as the most common, often turning into mental health burden.4, 5 Notwithstanding the efforts made by educational institutions to deploy more structured interventions and programmes for common mental disorders among students,6, 7 the relevant delivery is often complicated by their reluctance to access university counselling and supporting services, mainly because of barriers such as stigma or lack of adequate information.8, 9
However, during the last two years, social distancing and self-isolation attributable to the COVID-19 pandemic, together with the difficulties linked to online teaching and learning (at best blended with face-to-face support), have further amplified the psychological burden among higher-education students.10, 11, 12 Unfortunately, the prevalence of anxiety and depression in this population during the COVID-19 emergency has increased in comparison to pre-pandemic levels, with about one in three university students reporting anxiety and depressive symptoms.10 Thus, the urgency to provide them with adequate, personalized, evidence-based psychological support amid these difficult times has been advocated.13
However, in the previous few years, many digital mental health interventions had been developed and implemented for special populations such as youths and students with the aim of improving mental health care access.14 These are based not only on the online delivery of conventional psychotherapies – e.g., cognitive behavioural (CBT) and dialectical behaviour (DBT) therapies, or mindfulness-based interventions6, 15, 16 – but also on specific digital tools, including video-based and mobile health (mHealth) approaches,17, 18 and have been increasingly acknowledged as convenient, accessible, easy to use, and helpful options.19 A systematic review and meta-analysis run before the COVID-19 pandemic suggested that web-based and computer-delivered interventions might be effective, compared to inactive controls, in improving depression and anxiety of university students.20 Considering its efficacy and feasibility, the digitalization of interventions has been rapidly identified by educational institutions as suitable to overcome the many barriers encountered in the delivery of traditional, in-person interventions for higher-education students during periods of lockdowns and restrictions.21 Consistently, an increasing number of studies on digital interventions targeting the mental health of university students during the COVID-19 pandemic has been carried out.22 However, the available evidence on the efficacy of such interventions appears fragmented and has not been synthesized to date. To fill this gap, we performed a systematic review of randomized controlled trials (RCTs) testing digital mental health interventions for anxiety and depression in university students during the COVID-19 global emergency, both synthesizing the available evidence on their efficacy and assessing its quality.
Material and methods
This systematic review was carried out following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 Statement.23 A protocol was registered in Open Science Framework Registries on 12 January 2022 (https://doi.org/10.17605/OSF.IO/7UNV5).
Search strategy and inclusion criteria
Systematic searches of Embase, Ovid MEDLINE, and APA PsycInfo databases (via Ovid) were performed on 5 January 2022. The search phrase used was: “(student* or university or varsity or college or tertiary or higher or campus or undergrad* or postgrad* or freshm*) AND (psychotherap* or mindfulness or cognitive or CBT or dialectic* or DBT or psychoeducation or intervention*) AND (random* or controlled or RCT) AND (mental or psychiatr* or psychol* or depress* or anxi* or stress or resilien* or coping or wellbeing or well-being) AND (coronavirus or SARS-COV-2 or COVID-19 or nCoV or pandemic).mp” as a multiple purpose search of title, abstract, heading words, and keywords. Since the COVID-19 outbreak was declared a Public Health Emergency of International Concern by the World Health Organization on 30 January 2020,24 the search was restricted to articles published from 2020 onwards. No language restrictions were applied.
We included RCTs comparing any type of digital mental health interventions, i.e., interventions based on digital technology for mental health support, prevention, and treatment,21 and an appropriate control condition (e.g., wait-lists or psychoeducational/behavioural interventions) for anxiety and depression in individuals in higher education during the COVID-19 outbreak. Studies were considered eligible if they involved students enrolled in university or college courses. Both undergraduate and postgraduate students (e.g., doctoral or master students) were included. To be eligible, RCTs had to report measures of efficacy on anxiety and/or depressive symptoms, as estimated by the mean change difference between index and control interventions. To improve the consistency and comparability of data, we excluded: (i) studies with a non-randomized and/or non-controlled design; (ii) studies testing interventions which addressed other outcomes, such as stress, quality of life, or wellbeing; (iii) studies examining in-person interventions; (iv) “grey” literature, conference abstracts, dissertations, and all publications not having undergone a peer-review process.
After a preliminary screening based on titles and abstracts, full texts were retrieved to evaluate eligibility. Articles were independently screened and read in full text by four authors (IR, AC, CAC, SP), and reasons for exclusion were recorded (Table A.1). Any disagreement was resolved by discussion with the other authors.
Data extraction
Four authors (IR, AC, CAC, SP) independently extracted data and blindly cross-checked them for accuracy. A data extraction template was used to collect key information from the eligible studies, including author(s) and year of publication, country, setting, study design, main characteristics of experimental and control groups, type of interventions and comparators, tools used, outcomes assessed, and related measures. We extracted information on effect size measures, evaluating the magnitude of the effects according to standard cut-offs.25, 26
Quality assessment of the included studies
A formal quality assessment of the studies included in the systematic review was performed using the Randomized Controlled Trial of Psychotherapy Quality Rating Scale (RCT-PQRS), a 25-item validated tool, specifically designed to assess the quality of psychotherapy RCTs.27, 28 Items #1 through #24 refer to several domains including the description of subjects, treatment/intervention definition and assignment, and outcome measures, as well as data analysis and related reporting procedures with a score of 0, 1, or 2 for each. In addition, Item #25 represents an omnibus rating of the quality of the entire study ranging from 1 (“exceptionally poor”) to 7 (“exceptionally good”). A total score of 24 or more for the first 24 items (corresponding to an average value of 1 on each scale item) is assumed to represent the minimum adequate total quality-of-study score.27
The included studies were independently evaluated by two authors (IR, CAC), and disagreements were resolved by discussion involving all authors.
Results
Study selection
As a whole, our systematic search generated 1411 records (1138 from Embase, 218 from Ovid MEDLINE, and 55 from APA PsycInfo), reduced to 1204 unique articles after deduplication. After the screening of titles and abstracts, 25 articles were retrieved and examined in full text. Finally, eight articles29, 30, 31, 32, 33, 34, 35, 36 were found to be eligible. The study selection process is fully described in Fig. 1 .
Study characteristics
The eight studies included a total of 1403 participants. Three main clusters of digital interventions administered to study participants were identified: CBT-/DBT-based interventions33, 34; mindfulness-based interventions32, 35, 36; other types of interventions, i.e., positive psychology interventions (PPIs)30, 31 and mind-body interventions.29 Control conditions mostly consisted of wait-lists and behavioural/psychoeducational interventions. All studies assessed the efficacy of digital interventions on anxiety symptoms, while five31, 32, 33, 35, 36 also on depressive symptoms. The duration of interventions ranged from two to eight weeks. Main study characteristics are reported in Table 1 . Detailed descriptions of the various interventions are available in Table A.2.
Table 1.
Study | Country | Subjects |
Educational setting | Pandemic restrictions | EG intervention | CG intervention | Outcomes | Assessment tools | |||
---|---|---|---|---|---|---|---|---|---|---|---|
N tot | N EG | N CG | Female gender (%) | ||||||||
Cozzolino et al., 2021 | Italy | 266 | 144 | 122 | 78%a | University students from different educational levels | National lockdown (March–April 2020) | Mind-body practice named “Brain Wave Modulation Technique” | Online psychoeducational intervention | Anxiety | STAI-Y |
Datu et al., 2021 | Hong Kong | 107 | 69 | 38 | 72% | Undergraduate psychology students | N/R | Positive psychology intervention | Online behavioural intervention | Anxiety | CAS |
Krifa et al., 2021 | Tunisia | 161 | 88 | 73 | 94% | 1st–3rd year healthcare university students | Restrictions and quarantine (Spring 2020) | Positive psychology intervention | Wait-list | Anxiety Depression |
DASS-21 |
Lahtinen et al., 2021 | Finland | 406 | 195 | 211 | N/R | University students and staff | N/R | Mindfulness-based intervention | Online psychoeducational intervention | Anxiety Depression |
GAD-7 BDI-21 |
Liang et al., 2021 | China | 52 | 26 | 26 | 62% | Medical students | June-August 2020, when medical students were still at home | Dialectical behaviour therapy | Online psychoeducational intervention | Anxiety Depression |
GAD-7 PHQ-9 |
Shabahang et al., 2021 | Iran | 150 | 75 | 75 | 51% | Undergraduate- and graduate-level students | March–April 2020, during the second wave of COVID-19 | Cognitive behavioural therapy | Wait-list | Anxiety | CVAQ SHAI ASI-3 |
Simonsson et al., 2021 | United Kingdom | 162 | 77 | 85 | 70%b | Undergraduate- and graduate-level students | Third national lockdown (January–March 2021) | Mindfulness-based intervention | Wait-list | Anxiety Depression |
PROMIS |
Sun et al., 2021 | China | 99 | 52 | 47 | 74%c | Undergraduate- and graduate-level students | March–April 2020 (different restrictions across 27 provinces in China) | Mindfulness-based intervention | Online social support | Anxiety Depression |
GAD-7 PHQ-9 |
CG = control group; EG = experimental group; N = number of subjects; N/R = not reported; ASI-3 = Anxiety Sensitivity Index-3; BDI-21 = Beck Depression Inventory-21; CAS = COVID-19 Anxiety Scale; CVAQ = COVID-19 Anxiety Questionnaire; DASS-21 = Depression, Anxiety and Stress Scales; GAD-7 = Generalized Anxiety Disorder-7; PHQ-9 = Patient Health Questionnaire-9; PROMIS = Patient-Reported Outcome Measurement Information System; SHAI = Short Health Anxiety Inventory; STAI-Y = State-Trait Anxiety Inventory, form Y.
Data from the original eligible sample (N = 310).
Data from the original eligible sample (N = 177; 4/177 subjects preferred not to say; 2/177 non-binary; 1/177 genderfluid).
Data from the original eligible sample (N = 114).
Study findings
Table 2 shows a summary of findings of the effects of digital mental health interventions designed to support higher-education students’ mental health on relevant outcomes.
Table 2.
Study | Anxiety |
Depression |
||
---|---|---|---|---|
Results | Effect measures | Results | Effect measures | |
Cozzolino et al., 2021 | Greater reduction in STAI-Y scores in the EG compared to the CG. | Trait anxiety: η2 = 0.03; p < 0.01 State anxiety: η2 = 0.08; p < 0.001 |
N/A | N/A |
Datu et al., 2021 | No differences in CAS scores between the EG and the CG. | ηp2 = 0.003; p = 0.88 | N/A | N/A |
Krifa et al., 2021 | Greater reduction in DASS-21 anxiety scores in the EG compared to the CG. |
d = 0.21; p < 0.001 η2 = 0.02 |
Greater reduction in DASS-21 depression scores in the EG compared to the CG. |
d = 0.29; p < 0.001 η2 = 0.05 |
Lahtinen et al., 2021 | No differences in GAD-7 scores between the EG and the CG. | N/R | Greater reduction in BDI-21 scores in the EG compared to the CG. |
d = 0.45 in EG vs. d = 0.29 in CG† Post-test: p = 0.11 |
Liang et al., 2021 | Greater reduction in GAD-7 scores in the EG compared to the CG. | N/R; p < 0.001 | Greater reduction in PHQ-9 scores in the EG compared to the CG. | N/R; p = 0.014 |
Shabahang et al., 2021 | Greater reductions in CVAQ, SHAI, and ASI-3 scores in the EG compared to the CG. | COVID-19 anxiety: ηp2 = 0.49; p = 0.001 Health anxiety: ηp2 = 0.23; p = 0.001 Anxiety sensitivity: ηp2 = 0.22; p = 0.001 |
N/A | N/A |
Simonsson et al., 2021 | Greater reduction in PROMIS anxiety scores at the end of the intervention and at the 1-month FU in the EG compared to the CG. | Post-test: d = −0.39; p = 0.025 (FU: d = −0.20†) |
No differences in PROMIS depression scores between the EG and the CG at the end of the intervention period, nor at the 1-month FU. | Post-test: d = −0.26; p = 0.35 (FU: d = –0.06†) |
Sun et al., 2021 | Greater reduction in GAD-7 scores in the EG compared to the CG. | d = 0.72; p = 0.024 | No differences in PHQ-9 scores between the EG and the CG. | d = 0.36; p = 0.43 |
CG = control group; EG = experimental group; d = Cohen's d; FU = follow-up; p = p-value; N/A = not assessed; N/R = not reported; η2 = eta-squared; ηp2 = partial eta-squared; ASI-3 = Anxiety Sensitivity Index-3; BDI-21 = Beck Depression Inventory-21; CAS = COVID-19 Anxiety Scale; CVAQ = COVID-19 Anxiety Questionnaire; DASS-21 = Depression, Anxiety and Stress Scales; GAD-7 = Generalized Anxiety Disorder-7; PHQ-9 = Patient Health Questionnaire-9; PROMIS = Patient-Reported Outcome Measurement Information System; SHAI = Short Health Anxiety Inventory; STAI-Y = State-Trait Anxiety Inventory, form Y.
p-Value not reported.
CBT-/DBT-based digital interventions
Two studies tested CBT-/DBT-based digital interventions. Shabahang and colleagues investigated the efficacy of video-based CBT, including video clips and online booklets, in a sample of 150 students, divided in two equal-size groups.34 Different specific domains of anxiety were evaluated, including COVID-19 anxiety (assessed through the COVID-19 Anxiety Questionnaire – CVAS),37 health anxiety (i.e., anxiety related to the likelihood and severity of having an illness; Short Health Anxiety Inventory – SHAI38), and anxiety sensitivity (i.e., concern associated with negative consequences of anxiety-related symptoms; Anxiety Sensitivity Index-3 – ASI-339). The authors estimated a small-to-moderate effect of video-based CBT on all anxiety-related outcomes, i.e., COVID-19 anxiety (η p 2 = 0.49; p < 0.01), health anxiety (η p 2 = 0.23; p < 0.01), and anxiety sensitivity (η p 2 = 0.22; p < 0.01), as compared with the wait-list control condition.
Liang and colleagues33 administered an online DBT intervention, which included exercises aimed at improving emotion regulations skills and techniques of pain tolerance, to an experimental group of 26 medical students. This intervention was compared with an online psychoeducational programme administered to an equal-size sample. The authors uncovered that the Generalized Anxiety Disorder-7 (GAD-7)40 score reductions were greater in the DBT experimental group (p < 0.001). This intervention was also associated with a greater decrease in depressive symptoms assessed by the Patient Health Questionnaire-9 (PHQ-9),41 as compared with the control group, with a significant Time X Group interaction (p = 0.01).
Mindfulness-based digital interventions
Three studies32, 35, 36 explored the use of mindfulness-based digital interventions in higher education students. Lahtinen and colleagues32 tested a mindfulness programme carried out using a mobile app among university students and staff in Finland. The 4-week intervention trained 195 participants to recognize bodily signs of psychological stress and to manage it. The control condition group was involved in an online psychoeducational intervention based on mini-lectures on mindfulness practice. The authors showed that, despite a progressive decrease in anxiety symptoms during the intervention period, GAD-7 scale scores did not differ between the experimental and the control group at trial endpoint. Moreover, they estimated a greater reduction in depressive symptoms42 in the intervention group, even though the post-test between-group difference was not statistically significant (p = 0.11).
A different kind of online mindfulness programme,35 developed through an eight-week course, was carried out in the United Kingdom within a group of undergraduate- and graduate-level students, in comparison to a wait-list control group. The authors showed larger reductions in anxiety, as measured by the Patient-Reported Outcome Measurement Information System Scale (PROMIS)43 (d = −0.39), with a significant Time X Group interaction (p = 0.025). This was also true at 1-month follow-up (d = −0.20). Otherwise, no significant differences in the reduction of depressive symptoms on the same scale were found between the two groups (d = −0.26; p = 0.35), both immediately after the end of the experiment and at 1-month follow-up.
Finally, Sun and colleagues36 measured the efficacy of a mindfulness-based mHealth intervention in improving anxiety and depressive symptoms in 52 university students as compared with 47 students who were offered online social support. The authors reported a greater improvement in anxiety symptoms, as measured by GAD-7, in the experimental group, with a medium-to-large effect size (d = 0.72; p = 0.024), as well as a significant Time X Group interaction when considering the evaluations done at subsequent follow-ups (p = 0.024). Conversely, no differences between index and control interventions in depressive symptom improvement, as measured by PHQ-9 Scale, were estimated (p = 0.43).
Other interventions
Three studies29, 30, 31 tested other digital interventions for anxiety and depressive symptoms. Two distinct PPIs were examined.30, 31 Datu and colleagues30 introduced an intervention based on weekly tasks of gratitude and kindness to 69 psychology students. The comparison condition, an online behavioural intervention, was tested in a sample of 38 students from the same degree programme. No differences between the experimental and control groups were found in anxiety symptoms at study endpoint, as measured by the Coronavirus Anxiety Scale (CAS)44 (η p 2 = 0.003; p = 0.88).
Krifa et al.31 proposed an online PPI named “CARE program”, which was based on the reorientation of attention towards the positive and satisfying aspects of life and on the engagement in meaningful action. Each online session consisted of lectures, videos of experts, psychoeducation, positive psychology practices, and one or two weekly activities, which 88 healthcare students were asked to complete. This study revealed a small improvement of both anxiety (d = 0.21; p < 0.001) and depressive symptoms (d = 0.29, p < 0.001) as measured by the Depression Anxiety Stress Scale-21 (DASS-21)45 in subjects receiving the index intervention as compared with the wait-list control group.
Finally, Cozzolino et al.29 explored a new mind-body practice named brain wave modulation technique (BWM-T) in a pool of 144 students from an Italian university. This method consisted of an easy-to-implement 4-step finger movement procedure, while the control condition involved a video psychoeducational intervention that suggested 122 students how to reduce stress. The authors found a higher reduction of both trait-anxiety (η 2 = 0.03; p < 0.01) and state-anxiety (η 2 = 0.08; p < 0.001), measured by the State-Trait Anxiety Inventory (STAI-Y),46 in the experimental group as compared with the control group.
Quality assessment
The quality assessment of the included studies—performed using the RCT-PQRS—resulted in scores ranging from 13 to 29 (mean = 19.0; SD = 5.55), indicating that, on average, according to the cut-off of 24 points, trials failed to achieve a minimum adequate quality.27 Definition and delivery of treatment (i.e., the method to demonstrate that the treatment which is being studied is the treatment which is actually being delivered) and outcome measures (i.e., outcome assessment by raters blind to treatment group and with established reliability) were among the domains rated with the lowest score. The complete quality assessment is reported in Table 3 .
Table 3.
Author(s), year | RCT-PQRS items |
|||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | Totala | 25b | |
Cozzolino et al., 2021 | 1 | 0 | 0 | 1 | 1 | 0 | 1 | 2 | 0 | 2 | 1 | 0 | 0 | 0 | 0 | 1 | 1 | 1 | 0 | 1 | 2 | 2 | 0 | 1 | 18 | 3 |
Datu et al., 2021 | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 2 | 1 | 1 | 0 | 0 | 0 | 1 | 1 | 1 | 0 | 1 | 2 | 0 | 0 | 1 | 13 | 2 |
Krifa et al., 2021 | 0 | 0 | 0 | 1 | 2 | 0 | 0 | 0 | 0 | 2 | 2 | 0 | 0 | 1 | 0 | 0 | 1 | 2 | 0 | 2 | 2 | 1 | 0 | 1 | 17 | 3 |
Lahtinen et al., 2021 | 1 | 0 | 1 | 1 | 1 | 0 | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 1 | 0 | 1 | 1 | 1 | 0 | 1 | 2 | 2 | 2 | 1 | 22 | 3 |
Liang et al., 2021 | 1 | 1 | 0 | 1 | 2 | 0 | 0 | 0 | 0 | 2 | 1 | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 1 | 2 | 1 | 0 | 1 | 15 | 2 |
Shabahang et al., 2021 | 1 | 1 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 1 | 1 | 1 | 0 | 1 | 2 | 1 | 0 | 1 | 14 | 2 |
Simonsson et al., 2021 | 0 | 0 | 0 | 2 | 2 | 0 | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 0 | 2 | 2 | 1 | 2 | 0 | 1 | 2 | 1 | 2 | 1 | 24 | 4 |
Sun et al., 2021 | 2 | 1 | 0 | 2 | 2 | 0 | 2 | 0 | 2 | 2 | 2 | 1 | 0 | 0 | 2 | 1 | 1 | 1 | 0 | 2 | 2 | 2 | 1 | 1 | 29 | 5 |
RCT-PQRS = Randomized Controlled Trial of Psychotherapy Quality Rating Scale.24
The total quality-of-study score is obtained by summing items from #1 to #24 and ranges from 0 to 48. A total quality-of-study score equal or greater than 24 corresponds to the minimum adequate study quality.23
The omnibus score, which coincides with item #25, ranges from 1 (exceptionally poor study) to 7 (exceptionally good study).
Discussion
To our knowledge, this is the first systematic review aimed at synthesizing the existing evidence from RCTs on digital interventions designed to support higher-education students’ mental health during the COVID-19 pandemic. We comprehensively evaluated the efficacy of these interventions on two major outcomes, i.e., anxiety and depressive symptoms. With regard to anxiety, CBT, DBT, and mind-body practice techniques emerged as potentially effective strategies, while PPIs and mindfulness-based programmes showed mixed results, faring better than wait-list control conditions or unstructured online social support but not being superior to online behavioural/psychoeducational interventions in reducing anxiety symptoms. In addition, as far as depressive symptoms are concerned, DBT proved to be effective in reducing them in comparison to psychoeducation, while PPIs emerged as superior to wait-list condition to manage depression. Mindfulness-based interventions did not show any effects.
Overall, notwithstanding the small-to-medium magnitude of the effects and the average low quality of the included RCTs according to the RCT-PQRS, the available literature seems to support the promising role of different types of digital interventions and their possible benefits on crucial mental health outcomes for university students during the COVID-19 public health emergency.
CBT, DBT, and mindfulness-based techniques had previously proven to be effective options to reduce depressive and anxiety symptoms in university students, even independently of the pandemic.47, 48, 49 Similarly, PPIs50 and mind-body interventions51, 52 had been formerly tested in university settings, even if the existing evidence remains scarce. Clarifying their potential role as beneficial options for higher education students’ mental health is even more necessary during the COVID-19 pandemic and related waves. Telemental health services, which have been increasingly proposed in the past two years, hold several advantages over traditional, in-person, counselling, being easily provided, instantly accessible to several subjects at the same time, affordable, and highly customisable53: all these advantages seem particularly beneficial for university students.19, 54 Digital approaches for mental health may play a key role in supporting them by delivering remote mental health interventions when social contacts are limited due to COVID-19-related restrictions.55
The COVID-19 pandemic, determining lifestyle changes, poorer social relationships, and impoverishment of healthy behaviours,56 is likely to have a major impact on university students also over the coming months. One of the first measures universally adopted in all countries amid COVID-19 pandemic was a transition to remote care via phone, chat, or video calls,57 and the need for online services for mental well-being is anticipated to persist for several years. Findings of this systematic review could thus be useful to outline future directions on multiple levels, considering the peculiar needs of this special population. University students, whose traditional displacement from familiar environments has been made even more confused during the pandemic, through cyclic lockdowns and social distancing measures enforcements, have faced disrupted schooling and inequalities exacerbated by online education,58 as well as severe psychosocial distress due to isolation from peers, lack of interactivity with instructors, and difficulty adjusting to family needs.59 The implementation of effective telemental health interventions could thus empower university students and enhance their engagement. Key elements of digital interventions in terms of mental health promotion include increasing awareness, overcoming stigma related to help-seeking, and favouring adherence to psychotherapy, ultimately improving outcomes in university students.8, 60, 61, 62 On the other hand, universities should be encouraged to include within their policies for mental health and wellbeing support, also digital interventions as promising and feasible opportunities in emergency times such as the ongoing pandemic.63, 64 They should consider routinely providing students with adequate psychological support, based on interactive therapeutic interventions.65, 66, 67 In addition, social media platforms, albeit amenable of an excessive and uncontrolled use,68 are often deemed appropriate by higher-education students for self-disclosure or help-seeking. Therefore, relevant strategies should include social media-based mental health support tools as essential surveillance approaches, taking into account privacy and boundary regulation mechanisms to sustain healthy behaviours.69, 70, 71
Also, the current favourable conditions for the design of digital strategies72 and the related promising role of recently developed digital mental health interventions, both suggest the importance of making digital approaches more available in routine care and not only in response to the COVID-19 crisis.73
The findings of this systematic review should be interpreted with caution considering some limitations. First, heterogeneity issues across studies in terms of design, primary sampling units and related variations as of local COVID-19 lockdowns and restrictions measures, characteristics and length of interventions, assessment tools, outcome definition, and effect size measures, all must be considered when approaching this piece of work. This also precluded the possibility of a quantitative, meta-analytical, synthesis of the available data. Second, assessment via the RCT-PQRS showed on average moderately poor quality for the included studies: the lack of blinding, which is an intrinsic characteristic of these interventions, as well as the high attrition rates (a common phenomenon in online interventions),74 could have possibly influenced RCTs’ findings. Third, not all tools used in the studies included in our systematic review are validated for remote use, although there is mounting evidence supporting the adequacy of common instruments (e.g., the GAD-7) in terms of psychometric properties when used for online assessment.75 Fourth, available data did not allow us to verify if outcomes of digital interventions could be influenced by specific characteristics in terms of, for example, gender, year of course, or type of degree programme. Clarifying this issue would favour the development of more tailored digital mental-health interventions for university students.76, 77 Finally, only very few studies reported data on follow-up and long-term assessments, not allowing us to explore beneficial effects over time, rather than the need of periodical boosts, which is typical of psychoeducational interventions.78
Conclusions
Taken together, the findings of our review support the hypothesis that different types of digital mental health interventions could be effective in promoting the mental health and well-being of university students during the COVID-19 pandemic.79 Nonetheless, since the available body of evidence from RCTs is neither extensive nor of high quality, additional studies are needed before firmly advocating the application of such psychological strategies for higher-education students on a large scale. In particular, future rigorous research should provide additional insight into this important field, also in terms of special needs of more vulnerable groups, minorities, and frail populations.
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Conflict of interest
None.
Footnotes
Supplementary data associated with this article can be found, in the online version, at https://doi.org/10.1016/j.rpsm.2022.04.005.
Appendix A. Supplementary data
The following are the supplementary data to this article:
References
- 1.Pedrelli P., Nyer M., Yeung A., Zulauf C., Wilens T. College students: mental health problems and treatment considerations. Acad Psychiatry. 2015;39:503–511. doi: 10.1007/s40596-014-0205-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Briggs A.R.J., Clark J., Hall I. Building bridges: understanding student transition to university. Qual High Educ. 2012;18:3–21. doi: 10.1080/13538322.2011.614468. [DOI] [Google Scholar]
- 3.Auerbach R.P., Alonso J., Axinn W.G., Cuijpers P., Ebert D.D., Green J.G., et al. Mental disorders among college students in the World Health Organization World Mental Health Surveys. Psychol Med. 2016;46:1–16. doi: 10.1017/S0033291716001665. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Auerbach R.P., Mortier P., Bruffaerts R., Alonso J., Benjet C., Cuijpers P., et al. WHO World Mental Health Surveys International College Student Project: prevalence and distribution of mental disorders. J Abnorm Psychol. 2018;127:623–638. doi: 10.1037/abn0000362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Jenkins P.E., Ducker I., Gooding R., James M., Rutter-Eley E. Anxiety and depression in a sample of UK college students: a study of prevalence, comorbidity, and quality of life. J Am Coll Health. 2021;69:813–819. doi: 10.1080/07448481.2019.1709474. [DOI] [PubMed] [Google Scholar]
- 6.Barnett P., Arundell L.L., Saunders R., Matthews H., Pilling S. The efficacy of psychological interventions for the prevention and treatment of mental health disorders in university students: a systematic review and meta-analysis. J Affect Disord. 2021;280:381–406. doi: 10.1016/j.jad.2020.10.060. [DOI] [PubMed] [Google Scholar]
- 7.Mowbray C.T., Megivern D., Mandiberg J.M., Strauss S., Stein C.H., Collins K., et al. Campus mental health services: recommendations for change. Am J Orthopsychiatry. 2006;76:226–237. doi: 10.1037/0002-9432.76.2.226. [DOI] [PubMed] [Google Scholar]
- 8.Ennis E., McLafferty M., Murray E., Lapsley C., Bjourson T., Armour C., et al. Readiness to change and barriers to treatment seeking in college students with a mental disorder. J Affect Disord. 2019;252:428–434. doi: 10.1016/j.jad.2019.04.062. [DOI] [PubMed] [Google Scholar]
- 9.Hunt J., Eisenberg D. Mental health problems and help-seeking behavior among college students. J Adolesc Health. 2010;46:3–10. doi: 10.1016/j.jadohealth.2009.08.008. [DOI] [PubMed] [Google Scholar]
- 10.Deng J., Zhou F., Hou W., Silver Z., Wong C.Y., Chang O., et al. The prevalence of depressive symptoms, anxiety symptoms and sleep disturbance in higher education students during the COVID-19 pandemic: a systematic review and meta-analysis. Psychiatry Res. 2021;301:113863. doi: 10.1016/j.psychres.2021.113863. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Sampogna G., Giallonardo V., Del Vecchio V., Luciano M., Albert U., Carmassi C., et al. Loneliness in young adults during the first wave of COVID-19 lockdown: results from the multicentric COMET study. Front Psychiatry. 2021;12:788139. doi: 10.3389/fpsyt.2021.788139. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Wang C., Wen W., Zhang H., Ni J., Jiang J., Cheng Y., et al. Anxiety, depression, and stress prevalence among college students during the COVID-19 pandemic: a systematic review and meta-analysis. J Am Coll Health. 2021:1–8. doi: 10.1080/07448481.2021.1960849. [DOI] [PubMed] [Google Scholar]
- 13.Rudnik A., Anikiej-Wiczenbach P., Szulman-Wardal A., Conway P., Bidzan M. Offering psychological support to university students in poland during the COVID-19 pandemic: lessons learned from an initial evaluation. Front Psychol. 2021;12:635378. doi: 10.3389/fpsyg.2021.635378. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Orsolini L., Pompili S., Salvi V., Volpe U. A systematic review on TeleMental health in youth mental health: focus on anxiety, depression and obsessive–compulsive disorder. Medicina (Kaunas) 2021;57:793. doi: 10.3390/medicina57080793. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Rith-Najarian L.R., Boustani M.M., Chorpita B.F. A systematic review of prevention programs targeting depression, anxiety, and stress in university students. J Affect Disord. 2019;257:568–584. doi: 10.1016/j.jad.2019.06.035. [DOI] [PubMed] [Google Scholar]
- 16.Conley C.S., Shapiro J.B., Kirsch A.C., Durlak J.A. A meta-analysis of indicated mental health prevention programs for at-risk higher education students. J Couns Psychol. 2017;64:121–140. doi: 10.1037/cou0000190. [DOI] [PubMed] [Google Scholar]
- 17.Figueroa C.A., Aguilera A. The need for a mental health technology revolution in the COVID-19 pandemic. Front Psychiatry. 2020;11:523. doi: 10.3389/fpsyt.2020.00523. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Ryan M.L., Shochet I.M., Stallman H.M. Universal online interventions might engage psychologically distressed university students who are unlikely to seek formal help. Adv Ment Health. 2010;9:73–83. doi: 10.5172/jamh.9.1.73. [DOI] [Google Scholar]
- 19.Hadler N.L., Bu P., Winkler A., Alexander A.W. College student perspectives of telemental health: a review of the recent literature. Curr Psychiatry Rep. 2021;23:6. doi: 10.1007/s11920-020-01215-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Davies E.B., Morriss R., Glazebrook C. Computer-delivered and web-based interventions to improve depression, anxiety, and psychological well-being of university students: a systematic review and meta-analysis. J Med Internet Res. 2014;16:e130. doi: 10.2196/jmir.3142. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Wies B., Landers C., Ienca M. Digital mental health for young people: a scoping review of ethical promises and challenges. Front Digit Health. 2021;3:697072. doi: 10.3389/fdgth.2021.697072. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Rauschenberg C., Schick A., Hirjak D., Seidler A., Paetzold I., Apfelbacher C., et al. Evidence synthesis of digital interventions to mitigate the negative impact of the COVID-19 pandemic on public mental health: rapid meta-review. J Med Internet Res. 2021;23:e23365. doi: 10.2196/23365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Page M.J., McKenzie J.E., Bossuyt P.M., Boutron I., Hoffmann T.C., Mulrow C.D., et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi: 10.1136/bmj.n71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.World Health Organization (WHO) Statement on the second meeting of the International Health Regulations (2005) Emergency Committee regarding the outbreak of novel coronavirus (2019-nCoV); 2020. https://www.who.int/news/item/30-01-2020-statement-on-the-second-meeting-of-the-international-health-regulations-(2005)-emergency-committee-regarding-the-outbreak-of-novel-coronavirus-(2019-ncov).
- 25.Miles J., Shevlin M. 1st ed. SAGE Publications Ltd.; 2001. Applying regression and correlation. A guide for students and researchers. [Google Scholar]
- 26.Rosenthal J.A. Qualitative descriptors of strength of association and effect size. J Soc Serv Res. 1996;21:37–59. doi: 10.1300/J079v21n04_02. [DOI] [Google Scholar]
- 27.Gerber A.J., Kocsis J.H., Milrod B.L., Roose S.P., Barber J.P., Thase M.E., et al. A quality-based review of randomized controlled trials of psychodynamic psychotherapy. Am J Psychiatry. 2011;168:19–28. doi: 10.1176/appi.ajp.2010.08060843. [DOI] [PubMed] [Google Scholar]
- 28.Kocsis J.H., Gerber A.J., Milrod B., Roose S.P., Barber J., Thase M.E., et al. A new scale for assessing the quality of randomized clinical trials of psychotherapy. Compr Psychiatry. 2010;51:319–324. doi: 10.1016/j.comppsych.2009.07.001. [DOI] [PubMed] [Google Scholar]
- 29.Cozzolino M., Celia G., Girelli L., Limone P. Effects of the brain wave modulation technique administered online on stress, anxiety global distress, and affect during the first wave of the COVID-19 pandemic: a randomized clinical trial. Front Psychol. 2021;12:635877. doi: 10.3389/fpsyg.2021.635877. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Datu J., Valdez J., McInerney D.M., Cayubit R.F. The effects of gratitude and kindness on life satisfaction, positive emotions, negative emotions, and COVID-19 anxiety: an online pilot experimental study. Appl Psychol Health Well Being. 2021 doi: 10.1111/aphw.12306. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Krifa I., Hallez Q., van Zyl L.E., Braham A., Sahli J., Ben Nasr S., et al. Effectiveness of an online positive psychology intervention among Tunisian healthcare students on mental health and study engagement during the Covid-19 pandemic. Appl Psychol Health Well Being. 2021 doi: 10.1111/aphw.12332. [DOI] [PubMed] [Google Scholar]
- 32.Lahtinen O., Aaltonen J., Kaakinen J., Franklin L., Hyönä J. The effects of app-based mindfulness practice on the well-being of university students and staff. Curr Psychol. 2021;1:1–10. doi: 10.1007/s12144-021-01762-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Liang L., Feng L., Zheng X., Wu Y., Zhang C., Li J. Effect of dialectical behavior group therapy on the anxiety and depression of medical students under the normalization of epidemic prevention and control for the COVID-19 epidemic: a randomized study. J Palliat Med. 2021;10:10591–10599. doi: 10.21037/apm-21-2466. [DOI] [PubMed] [Google Scholar]
- 34.Shabahang R., Aruguete M.S., McCutcheon L. Video-based cognitive-behavioral intervention for COVID-19 anxiety: a randomized controlled trial. Trends Psychiatry Psychother. 2021;43:141–150. doi: 10.47626/2237-6089-2020-0056. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Simonsson O., Bazin O., Fisher S.D., Goldberg S.B. Effects of an eight-week, online mindfulness program on anxiety and depression in university students during COVID-19: a randomized controlled trial. Psychiatry Res. 2021;305:114222. doi: 10.1016/j.psychres.2021.114222. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Sun S., Lin D., Goldberg S., Shen Z., Chen P., Qiao S., et al. A mindfulness-based mobile health (mHealth) intervention among psychologically distressed university students in quarantine during the COVID-19 pandemic: a randomized controlled trial. J Couns Psychol. 2021 doi: 10.1037/cou0000568. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Shabahang R., Aruguete M.S., McCutcheon L.E. Online health information utilization and online news exposure as predictors of COVID-19 anxiety. N Am J Psychol. 2020;22:469–482. [Google Scholar]
- 38.Salkovskis P.M., Rimes K.A., Warwick H.M., Clark D.M. The Health Anxiety Inventory: development and validation of scales for the measurement of health anxiety and hypochondriasis. Psychol Med. 2002;32:843–853. doi: 10.1017/s0033291702005822. [DOI] [PubMed] [Google Scholar]
- 39.Taylor S., Zvolensky M.J., Cox B.J., Deacon B., Heimberg R.G., Ledley D.R., et al. Robust dimensions of anxiety sensitivity: development and initial validation of the Anxiety Sensitivity Index-3. Psychol Assess. 2007;19:176–188. doi: 10.1037/1040-3590.19.2.176. [DOI] [PubMed] [Google Scholar]
- 40.Spitzer R.L., Kroenke K., Williams J.B., Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166:1092–1097. doi: 10.1001/archinte.166.10.1092. [DOI] [PubMed] [Google Scholar]
- 41.Kroenke K., Spitzer R.L., Williams J.B. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–613. doi: 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Beck A.T., Steer R.A., Carbin M.G. Psychometric properties of the Beck depression inventory: twenty-five years of evaluation. Clin Psychol Rev. 1988;8:77–100. doi: 10.1016/0272-7358(88)90050-5. [DOI] [Google Scholar]
- 43.Pilkonis P.A., Choi S.W., Reise S.P., Stover A.M., Riley W.T., Cella D., et al. Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): depression, anxiety, and anger. Assessment. 2011;18:263–283. doi: 10.1177/1073191111411667. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Lee S.A. Coronavirus anxiety scale: a brief mental health screener for COVID-19 related anxiety. Death Stud. 2020;44:393–401. doi: 10.1080/07481187.2020.1748481. [DOI] [PubMed] [Google Scholar]
- 45.Lovibond P.F., Lovibond S.H. The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav Res Ther. 1995;33:335–343. doi: 10.1016/0005-7967(94)00075-u. [DOI] [PubMed] [Google Scholar]
- 46.Spielberger C.D., Gorsuch R.L., Lushene R. Consulting Psychologists press; Palo Alto, CA: 1983. The state-trait personality inventory STAI-Y, Form Y; p. 1983. [Google Scholar]
- 47.Dawson A.F., Brown W.W., Anderson J., Datta B., Donald J.N., Hong K., et al. Mindfulness-based interventions for university students: a systematic review and meta-analysis of randomised controlled trials. Appl Psychol Health Well Being. 2021;12:384–410. doi: 10.1111/aphw.12188. [DOI] [PubMed] [Google Scholar]
- 48.Huang J., Nigatu Y.T., Smail-Crevier R., Zhang X., Wang J. Interventions for common mental health problems among university and college students: a systematic review and meta-analysis of randomized controlled trials. J Psychiatr Res. 2018;107:1–10. doi: 10.1016/j.jpsychires.2018.09.018. [DOI] [PubMed] [Google Scholar]
- 49.Uliaszek A.A., Rashid T., Williams G.E., Gulamani T. Group therapy for university students: a randomized control trial of dialectical behavior therapy and positive psychotherapy. Behav Res Ther. 2016;77:78–85. doi: 10.1016/j.brat.2015.12.003. [DOI] [PubMed] [Google Scholar]
- 50.Guo Y.F., Zhang X., Plummer V., Lam L., Cross W., Zhang J.P. Positive psychotherapy for depression and self-efficacy in undergraduate nursing students: a randomized, controlled trial. Int J Ment Health Nurs. 2017;26:375–383. doi: 10.1111/inm.12255. [DOI] [PubMed] [Google Scholar]
- 51.Strehli I., Burns R.D., Bai Y., Ziegenfuss D.H., Block M.E., Brusseau T.A. Mind–body physical activity interventions and stress-related physiological markers in educational settings: a systematic review and meta-analysis. Int J Environ Res Public Health. 2020;18:224. doi: 10.3390/ijerph18010224. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Stillwell S.B., Vermeesch A.L., Scott J.G. Interventions to reduce perceived stress among graduate students: a systematic review with implications for evidence-based practice. Worldviews Evid Based Nurs. 2017;14:507–513. doi: 10.1111/wvn.12250. [DOI] [PubMed] [Google Scholar]
- 53.Dorsey E.R., Topol E.J. Telemedicine 2020 and the next decade. Lancet. 2020;395:859. doi: 10.1016/S0140-6736(20)30424-4. [DOI] [PubMed] [Google Scholar]
- 54.Becker T.D., Torous J.B. Recent developments in digital mental health interventions for college and university students. Curr Treat Opt Psychiatry. 2019;6:210–220. doi: 10.1007/s40501-019-00178-8. [DOI] [Google Scholar]
- 55.Oliveira C., Pereira A., Vagos P., Nóbrega C., Gonçalves J., Afonso B. Effectiveness of mobile App-based psychological interventions for college students: a systematic review of the literature. Front Psychol. 2021;12:647606. doi: 10.3389/fpsyg.2021.647606. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Fila-Witecka K., Senczyszyn A., Kołodziejczyk A., Ciułkowicz M., Maciaszek J., Misiak B., et al. Lifestyle changes among polish university students during the COVID-19 pandemic. Int J Environ Res Public Health. 2021;18:9571. doi: 10.3390/ijerph18189571. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Vieta E., Pérez V., Arango C. Psychiatry in the aftermath of COVID-19. Rev Psiquiatr Salud Ment (Engl Ed) 2020;13:105–110. doi: 10.1016/j.rpsm.2020.04.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Pwnall M., Harris R., Blundell-Birtill P. Supporting students during the transition to university in COVID-19: 5 key considerations and recommendations for educators. Psychol Learn Teach. 2021 doi: 10.1177/1475725721103248. [DOI] [Google Scholar]
- 59.Morris M.E., Kuehn K.S., Brown J., Nurius P.S., Zhang H., Sefidgar Y.S., et al. College from home during COVID-19: a mixed-methods study of heterogeneous experiences. PLOS ONE. 2021;16:e0251580. doi: 10.1371/journal.pone.0251580. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Johnson K.F., Kalkbrenner M.T. The utilization of technological innovations to support college student mental health: mobile health communication. J Technol Hum Serv. 2017;35:314–339. doi: 10.1080/15228835.2017.1368428. [DOI] [Google Scholar]
- 61.Carrà G., Crocamo C., Bartoli F., Carretta D., Schivalocchi A., Bebbington P.E., et al. Impact of a mobile e-health intervention on binge drinking in young people: the digital-alcohol risk alertness notifying network for adolescents and young adults project. J Adolesc Health. 2016;58:520–526. doi: 10.1016/j.jadohealth.2016.01.008. [DOI] [PubMed] [Google Scholar]
- 62.Wilansky P., Eklund J.M., Milner T., Kreindler D., Cheung A., Kovacs T., et al. Cognitive behavior therapy for anxious and depressed youth: improving homework adherence through mobile technology. JMIR Res Protoc. 2016;5:e209. doi: 10.2196/resprot.5841. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Schuh Teixeira A.L., Spadini A.V., Pereira-Sanchez V., et al. The urge to implement and expand telepsychiatry during the COVID-19 crisis: Early career psychiatrists’ perspective. Rev Psiquiatr Salud Ment (Engl Ed) 2020;13:174–175. doi: 10.1016/j.rpsm.2020.06.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Liu S., Yang L., Zhang C., Xiang Y.T., Liu Z., Hu S., et al. Online mental health services in China during the COVID-19 outbreak. Lancet Psychiatry. 2020;7:e17–e18. doi: 10.1016/S2215-0366(20)30077-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Browning M.H.E.M., Larson L.R., Sharaievska I., Rigolon A., McAnirlin O., Mullenbach L., et al. Psychological impacts from COVID-19 among university students: risk factors across seven states in the United States. PLOS ONE. 2021;16:e0245327. doi: 10.1371/journal.pone.0245327. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Elmer T., Mepham K., Stadtfeld C. Students under lockdown: comparisons of students’ social networks and mental health before and during the COVID-19 crisis in Switzerland. PLOS ONE. 2020;15:e0236337. doi: 10.1371/journal.pone.0236337. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Holmes E.A., O’Connor R.C., Perry V.H., Tracey I., Wessely S., Arseneault L., et al. Multidisciplinary research priorities for the COVID-19 pandemic: a call for action for mental health science. Lancet Psychiatry. 2020;7:547–560. doi: 10.1016/S2215-0366(20)30168-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Volpe U., Orsolini L., Salvi V., Albert U., Carmassi C., Carrà G., et al. COVID-19-related social isolation predispose to problematic Internet and online video gaming use in Italy. Int J Environ Res Public Health. 2022;19:1539. doi: 10.3390/ijerph19031539. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Crocamo C., Viviani M., Famiglini L., Bartoli F., Pasi G., Carrà G. Surveilling COVID-19 emotional contagion on twitter by sentiment analysis. Eur Psychiatry. 2021;64:e17. doi: 10.1192/j.eurpsy.2021.3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Viviani M., Crocamo C., Mazzola M., Bartoli F., Carrà G., Pasi G. Assessing vulnerability to psychological distress during the COVID-19 pandemic through the analysis of microblogging content. Future Gener Comput Syst. 2021;125:446–459. doi: 10.1016/j.future.2021.06.044. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Vornholt P., De Choudhury M. Understanding the role of social media-based mental health support among college students: survey and semistructured interviews. JMIR Ment Health. 2021;8:e24512. doi: 10.2196/24512. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Crocamo C., Bachi B., Cioni R.M., et al. Professionals’ digital training for child maltreatment prevention in the COVID-19 era: a pan-European model. Int J Environ Res Public Health. 2022;19:885. doi: 10.3390/ijerph19020885. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Taylor C.B., Fitzsimmons-Craft E.E., Graham A.K. Digital technology can revolutionize mental health services delivery: the COVID-19 crisis as a catalyst for change. Int J Eat Disord. 2020;53:1155–1157. doi: 10.1002/eat.23300. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Eysenbach G. The law of attrition. J Med Internet Res. 2005;7:e11. doi: 10.2196/jmir.7.1.e11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.van Ballegooijen W., Riper H., Cuijpers P., van Oppen P., Smit J.H. Validation of online psychometric instruments for common mental health disorders: a systematic review. BMC Psychiatry. 2016;16:45. doi: 10.1186/s12888-016-0735-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Wathelet M., Duhem S., Vaiva G., et al. Factors associated with mental health disorders among university students in france confined during the COVID-19 pandemic. JAMA Netw Open. 2020;3:e2025591. doi: 10.1001/jamanetworkopen.2020.25591. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Crocamo C., Bachi B., Calabrese A., Callovini T., Cavaleri D., Cioni R.M., et al. Some of us are most at risk: systematic review and meta-analysis of correlates of depressive symptoms among healthcare workers during the SARS-CoV-2 outbreak. Neurosci Biobehav Rev. 2021;131:912–922. doi: 10.1016/j.neubiorev.2021.10.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Carrà G., Montomoli C., Clerici M., Cazzullo C.L. Family interventions for schizophrenia in Italy: randomized controlled trial. Eur Arch Psychiatry Clin Neurosci. 2007;257:23–30. doi: 10.1007/s00406-006-0677-z. [DOI] [PubMed] [Google Scholar]
- 79.Cao W., Fang Z., Hou G., Han M., Xu X., Dong J., et al. The psychological impact of the COVID-19 epidemic on college students in China. Psychiatry Res. 2020;287:112934. doi: 10.1016/j.psychres.2020.112934. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.