Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2022 Sep 22;17(9):e0275167. doi: 10.1371/journal.pone.0275167

The impact of the COVID-19 epidemic on students’ mental health: A cross-sectional study

Nikola Mirilović 1, Janko Janković 2,*, Milan Latas 3,4
Editor: Aleksandra Barac5
PMCID: PMC9499216  PMID: 36137108

Abstract

Background

The COVID-19 pandemic is currently one of the biggest public health threats for people’s mental health. A particularly endangered group were students, who became highly affected by measures of social distance due to their active lifestyle. Therefore, the aim of this paper is to assess the level of self-reported stress, anxiety and depression of the student population in Serbia, in relation to demographic characteristics, living and studying conditions, students’ activities during the epidemic, potential coronavirus infection and general, mental and physical health.

Methods

We conducted a cross-sectional study of 580 undergraduate medical students from the University of Belgrade during the 2020/2021 school year. Mental health data were collected using the Depression Anxiety Stress Scales (DASS-21). Both bivariate and multivariate logistic regression analysis were used to examine the association between independent variables with the dependent variable mental health.

Results

Women made up the majority of the sample with 80.3%. A total of 64.5%, 66.8% and 66.7% of students between the ages of 21 and 30 had severe depressive symptoms, severe degree of anxiety, and a severe degree of stress, respectively. Women almost twice as often (OR = 1.89) assessed their anxiety as severe and almost two and a half times more (OR = 2.39) perceived stress as severe compared to men. Students who lived with their families during studies two and a half times (OR = 2.57) more often assessed their stress as severe, compared to students who lived alone. Fifth- and sixth-year students were less likely to rate depression and anxiety as serious than the first-year students.

Conclusions

Medical students reported their health as severely impaired in terms of depression, anxiety and stress reactions. The results indicate the need to launch a mental health program in the form of counseling and emotional support to students affected by the pandemic.

Introduction

The world has confronted the COVID-19 outbreak for the first time in December 2019, when a new SARS-CoV-2 coronavirus was identified in the Chinese province of Hubei, in the city of Wuhan [1]. The pandemic scale of this novel coronavirus has led to the world’s biggest public health crisis in over one hundred years and thus opened many unresolved issues. It has resulted in millions of dead people [2] and in the middle of 2020 there was an increase in COVID-19 cases among adults aged between 18 and 22 years [3].

As one of the main measures in the fight against this plague is physical distancing, along with the obligatory maintenance of hygienic measures and isolation from other people, the pandemic has caused a number of mental problems around the world. Italian researchers identified elevated levels of stress, anxiety and depression in the general population in response to the COVID-19 pandemic [4]. People with a history of psychiatric disorders were particularly affected during a pandemic [5], and their mental health is further impaired due to the long-term presence of the virus in the population. Also, single people showed severe symptoms of depression, while married people, especially females, showed high levels of anxiety [6].

The COVID-19 pandemic is currently one of the biggest public health threats and challenges for professionals’ mental health [7]. It caused the closure or reorganization of most educational institutions around the world, including higher education institutions, and had a negative effect on students’ mental health [8]. Among students in Italy, in addition to the concerns about the organization of studies and discomfort due to social distancing, results suggested that female students were more likely to complain of anxiety than male students [9]. A study from Serbia showed the negative impact of the COVID-19 disease pandemic on the psychological state of students [10]. Mental health problems and the occurrence of anxiety and affective emotional problems were also found in the student population of Slovakia [11]. A special problem was created among medical students who, due to the pandemic, could not have practical classes and contact with patients [12] and thus self-reported increased levels of anxiety and stress [6]. Their level of anxiety was even higher compared to the general population [13]. During the pandemic medical students from the Department of Public Health University in Northern New Jersey, US showed problems with mental health due to difficulty in coping with changed daily and student activities [14].

To our best knowledge, this is the first study in Serbia that examines the effects of the COVID-19 epidemic on students’ mental health and the first study to observe its effects on the mental health of the medical student population.

Therefore, the aim of this paper is to assess the level of self-reported stress, anxiety, and depression of the student population in Serbia in relation to the demographic characteristics, living and studying conditions, students’ activities during the epidemic, potential coronavirus infection, and general, mental and physical health.

Method

Study design and participants

This cross-sectional online survey included 580 medical students (who completely filled out the questionnaires) of integrated academic studies from the Medical Faculty University of Belgrade during the 2020/2021 school year. The questionnaire was posted on the online teaching platform of the Faculty of Medicine called Reticulum, where students could fill it out in the period from January to March 2021.

The subjects were selected according to the principle of stratified cluster sample. The entire target population of full-time medical students on the integrated studies course was observed as one cluster, while students from each of the six years of study were observed as a separate group. Approximately, the same number of respondents was taken from each stratum. There were 105 first-year students, 85 second-year students, 93 third-year students, 84 fourth-year students, 79 fifth-year students, and 134 sixth-year students. The sample selected in this way is a representative sample, and the representativeness was determined on the basis of a sufficient number of observation units to assess the proportions, as well as a random selection of observation units, which enabled the generalization of the obtained results.

The research was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Review Board of the Medical Faculty University of Belgrade by decision number 1322/III-22. All students gave written informed consent and after being informed about the purpose and procedure of the survey, they voluntarily started filling out anonymous questionnaires.

Instruments and variables

In total, three questionnaires were created using the online survey tool entitled LimeSurvey. The general questionnaire and the health self-assessment questionnaire were constructed specifically for the purpose of this study, while the DASS-21 questionnaire was used to assess depression, anxiety, and stress.

The general questionnaire was designed to collect personal data related to the students’ life before and during the COVID-19 epidemic. It collected data for eleven variables which, in addition to the demographic characteristics (gender–male/female; age; marital status–single/living with a partner; type of settlement–urban/rural; year of studies–I to VI and religious–yes/no) of the participants, also collected information about living and studying conditions before and after the outbreak of the COVID-19 epidemic (cohabitation during the studies—living alone/living with family or roommate; location during the state of emergency–in Belgrade/not in Belgrade or Serbia), information on the students’ activities during the epidemic (online classes–few/moderate/plenty; problems with online learning platform–yes/no), and data on coronavirus infection (yes/no). The age variable was transformed into a categorical variable for research purposes (< = 20, 21–30, 31+).

Regarding the health self-assessment questionnaire the participants were asked to assess general, physical, and mental health on the Likert five-point scale (1-poor health, 5-good health). All three components of health were transformed into variables with three categories: poor, average, and good health.

The Depression Anxiety Stress Scales (DASS-21) is a questionnaire that was previously constructed and linguistically and culturally validated for the Serbian language, whose reliability measured by Cronbach’s alpha was 0.92 [15]. It has 21 questions and three subscales that measure the level of depression, anxiety, and stress during the week before the survey [16]. Each subscale contains seven questions, and participants express their own degree of depression, anxiety and stress by selecting one of the four offered options (never, sometimes, often and always). Very severe depression was detected in subjects with a score of 28+, severe in subjects with a score of 21–27, moderate in subjects with a score of 14–20, mild in those with a score of 10–13, while a normal depressive reaction was in students with a score ≤9. Students with a score of 20–49 had very severe anxiety, those with a score of 15–19 had severe anxiety, those with a score of 10–14 had moderate anxiety, and those with a score of 7–9 had mild anxiety, while normal anxiety was scored ≤ 6. Students with a score of 35–42 had a very severe stress reaction, 27–34 had severe stress, those with a score of 19–26 had moderate stress, those with a score of 11–18 had mild stress, while subjects with a score ≤10 had a normal stress reaction in the one-week period prior to testing. The score limits presented in this paper have been used in previous research [17]. For the purposes of this study, all three subscales were transformed to obtain variables with three categories: severe, moderate, and mild depression/anxiety/stress response.

Statistical analysis

Data were described by descriptive statistics–categorical variables were reported as percentages (%) and frequencies (n), while means and standard deviation (SD) were calculated for numerical ones. The difference between the groups was analyzed using Chi-square test. Bivariate and multivariate logistic regressions were used to examine the correlation between independent and outcome variables and presented with odds ratio (OR) and confidence intervals (CIs). All variables were first included in the bivariate regression analyses, and then, regardless of whether they were statistically significant or not, included in the multivariate regression analyses (because of the possibility that might be a significant association between variables and because of their significance for the study topic according to the literature and authors’ opinion). The level of statistical significance in all used analyses was set at p<0.05. Data were processed using the statistical package IBM SPSS V.24.0 (SPSS Inc. Chicago, Illinois, USA).

Results

Table 1 shows the distribution of demographic variables, as well as variables related to both study and living conditions and the health status of the study participants.

Table 1. Distribution of demographic variables, variables related to students medical studies and health status during the coronavirus epidemic, as well as, scales of depression, anxiety and stress.

Variables n %
Gender
Male 114 19.7
Female 466 80.3
Age
≤20 174 30
21–30 397 68.4
31+ 9 1.6
Year of studies
First 105 18.1
Second 85 14.7
Third 93 16
Fourth 84 14.5
Fifth 79 13.6
Sixth 134 23.1
Marital status
Single 456 78.6
Married/Living with a partner 124 21.4
Religious
Yes 367 63.3
No 213 36.7
Settlement type
Urban 498 85.9
Rural 82 14.1
Cohabitation during the studies
Alone 117 20.2
With family/room mate 463 79.8
Location during the state of emergency
In Belgrade 237 40.9
Not in Belgrade/Serbia 343 59.1
Online classes
Few 215 37.1
Moderate 235 40.5
Plenty 130 22.4
Problems with online learning platform
Yes 188 32.4
No 392 67.6
Coronavirus infection
Yes 148 25.5
No/not sure 432 74.5
General health
Poor 15 2.6
Average 148 25.5
Good 387 66.7
Physical health
Poor 34 5.9
Average 159 27.4
Good 387 66.7
Mental health
Poor 94 16.2
Average 193 33.3
Good 293 50.5
Depression
Mild 0 0
Moderate 200 34.5
Severe 380 65.5
Anxiety
Mild 0 0
Moderate 53 9.1
Severe 527 90.9
Stress
Mild 20 3.4
Moderate 64 11
Severe 496

They were predominantly female (80.3%), aged between 21 and 30 (68.4), religious (63.3%), and from urban areas (85.9%). More than one-third of participants (37.1%) had few organized online classes during the pandemic, 32.4% had problems with e-learning platforms, and 25.5% of students were infected with SARS-CoV-2 by the time of the survey. Out of all examined students, 71.9%, 66.7% and 50.5% self-perceived their general, physical and mental health as good, respectively. Severe symptoms of depression were recognized by 65.5% of students, 90.9% of students suffered from severe anxiety, and 85.6% were under severe stress.

A total of 64.5%, 66.8% and 66.7% of students between the ages of 21 and 30 reported severe depressive symptoms, severe degree of anxiety, and a severe stress, respectively (Table 2).

Table 2. Distribution of self-assessed depression, anxiety and stress, as well as their differences in relation to students demographic variables, their medical studies and health status during the coronavirus epidemic.

Variables Depression Scale P-value* Anxiety Scale P-value* Stress Scale P-value*
Moderate (%) Severe (%) Moderate (%) Severe (%) Mild (%) Moderate (%) Severe (%)
Gender 0.417 0.043 <0.001
Male 21.5 18.7 30.2 18.6 45 32.8 16.9
Female 78.5 81.3 69.8 81.4 55 67.2 83.1
Age 0.003 0.020 0.009
≤20 21.5 34.5 13.2 31.7 5 21.9 32.1
21–30 76 64.5 84.9 66.8 95 73.4 66.7
31+ 2.5 1.1 1.9 1.5 0 4.7 1.2
Year of studies <0.001 0.012 0.016
First 11.5 21.6 3.8 19.5 0 7.8 20.2
Second 13 15.5 17 14.4 5 17.2 14.7
Third 14 17.1 22.6 15.4 30 17.2 15.3
Fourth 12.5 15.5 9.4 15 10 9.4 15.3
Fifth 19 10.8 24.5 12.5 30 15.6 12.7
Sixth 30 19.5 22.6 23.1 25 32.8 21.8
Marital status 0.490 0.640 0.199
Single 77 79.5 81.1 78.4 90 84.4 77.4
Married/Living with a partner 33 20.5 18.9 21.6 10 15.6 22.6
Religious 0.024 0.890 0.309
Yes 69.5 60 64.2 63.2 50 68.8 63.1
No 30.5 40 35.8 36.8 50 31.2 36.9
Settlement type 0.749 0.583 0.156
Urban 86.5 85.5 88.7 85.6 90 78.1 86.7
Rural 13.5 14.5 11.3 14.1 10 21.9 13.3
Cohabitation during the studies 0.311 0.122 0.002
Alone 22.5 18.9 28.3 19.4 35 34.4 17.7
With family/room mate 77.5 81.1 71.7 80.6 65 65.6 82.3
Location during the state of emergency 0.686 0.847 0.713
In Belgrade 42 40.3 39.6 41 35 37.5 41.5
Not in Belgrade/Serbia 58 59.7 60.4 59 65 62.5 58.5
Online classes 0.429 0.275 0.849
Few 38.5 36.3 43.4 36.4 30 39.1 37.1
Moderate 37 42.4 30.2 41.6 50 35.9 40.7
Plenty 24.5 21.3 26.4 22 20 25 22.2
Problems with online learning platform 0.006 0.057 0.251
Yes 25 36.3 20.8 33.6 30 23.4 33.7
No 75 63.7 79.2 66.4 70 76.6 66.3
Coronavirus infection 0.552 0.875 0.539
Yes 27 24.7 26.4 25.4 15 25 26
No/not sure 73 75.3 73.6 74.5 85 75 74
General health <0.001 0.015 0.002
Poor 0 3.9 0 2.8 0 0 3
Average 10 33.7 11.3 26.9 0 14.1 28
Good 90 62.4 88.7 70.2 100 85.9 69
Physical health <0.001 0.029 0.005
Poor 1.5 8.2 3.8 6.1 0 0 6.9
Average 14.5 34.2 13.2 28.8 5 21.9 29
Good 84 57.6 83 65.1 95 78.1 64.1
Mental health <0.001 <0.001 <0.001
Poor 0.5 24.5 0 17.8 0 0 19
Average 14.5 43.2 13.2 35.3 5 15.6 36.7
Good 85 32.4 86.8 46.9 95 84.4 44.4

*According to Chi-squаre test

The percentage of women who perceived their anxiety as severe was 81.4%, while the percentage of women who perceived their stress as severe was 83.1%. The most severe symptoms of depression, anxiety, and stress were among students in the first (21.6%; 19.5% and 20.2%, respectively) and sixth (19.5%, 23.1%, and 21.8%, respectively) year of study, while the least severe symptoms occur in fifth-year students (10.8%, 12.5%, and 12.7%, respectively). Also, 60% of students with severe depressive symptoms were religious and 36.3% of them did not have adequate online learning platforms. Among students who self-reported severe depressive symptoms, 32.4% rated their mental health as good, and of those with severe anxiety, 65.1% considered their physical health to be good. Of all the participants who rated their general health as good, 69% of the participants self-reported severe stress.

The results of the bivariate logistic regressions are shown in Table 3.

Table 3. Associations of scales of depression, anxiety and stress with students’ demographic variables, their medical studies and health status during the coronavirus pandemic–results of bivariate logistic regressions.

Variables Bivariate logistic regression (Severe versus moderate)
Depression Scale Anxiety Scale Stress Scale
OR (95%CI) P-value OR (95%CI) P-value OR (95%CI) P-value
Gender
Male 1 1 1
Female 1.19 (0.78–1.82) 0.418 1.89 (1.01–3.54) 0.046 2.39 (1.35–4.24) 0.003
Age
≤20 1 1 1
21–30 0.53 (0.35–0.79) 0.002 0.33 (0.15–0.74) 0.007 0.62 (0.33–1.16) 0.135
31+ 0.26 (0.07–1.02) 0.054 0.34 (0.04–3.06) 0.333 0.18 (0.04–0.78) 0.022
Year of studies
First 1 1 1
Second 0.64 (0.33–1.22) 0.175 0.16 (0.03–0.78) 0.023 0.33 (0.11–0.99) 0.049
Third 0.65 (0.34–1.23) 0.189 0.13 (0.03–0.60) 0.009 0.34 (0.12–1.04) 0.058
Fourth 0.66 (0.34–1.28) 0.219 0.30 (0.06–1.62) 0.164 0.63 (0.19–2.15) 0.464
Fifth 0.30 (0.16–0.57) <0.001 0.10 (0.02–0.45) 0.003 0.04 (0.10–0.96) 0.043
Sixth 0.35 (0.19–0.61) <0.001 0.20 (0.04–0.90) 0.036 0.01 (0.09–0.71) 0.009
Marital status
Single 1 1 1
Married/Living with a partner 0.86 (0.57–1.30) 0.490 1.19 (0.58–2.44) 0.640 1.58 (0.78–3.19) 0.208
Religious
Yes 1 1 1
No 1.52 (1.05–2.19) 0.024 1.04 (0.58–1.88) 0.890 1.29 (0.74–2.25) 0.378
Settlement type
Urban 1 1 1
Rural 1.08 (0.66–1.78) 0.749 1.32 (0.55–3.19) 0.538 0.55 (0.29–1.05) 0.069
Cohabitation during the studies
Alone 1 1 1
With family/room mate 1.24 (0.82–1.89) 0.311 1.64 (0.87–3.10) 0.125 2.43 (1.38–4.27) 0.002
Location during the state of emergency
In Belgrade 1 1 1
Not in Belgrade/Serbia 1.07 (0.75–1.52) 0.686 0.95 (0.53–1.68) 0.847 0.85 (0.49–1.45) 0.538
Online classes
Few 1 1 1
Moderate 1.24 (0.82–1.80) 0.332 1.64 (0.84–3.19) 0.146 1.19 (0.66–2.18) 0.564
Plenty 0.92 (0.59–1.45) 0.726 0.99 (0.49.2.00) 0.983 0.93 (0.48–1.83) 0.842
Problems with online learning platform
Yes 1 1 1
No 0.58 (0.40–0.86) 0.006 0.52 (0.26–1.03) 0.061 0.60 (0.33–1.11) 0.103
Coronavirus infection
Yes 1 1 1
No/not sure 1.12 (0.76–1.66) 0.552 1.05 (0.55–2.00) 0.875 0.95 (0.52–1.73) 0.862
General health
Poor 1 1 1
Average / 0.999 / 0.999 / 0.999
Good / 0.998 / 0.999 / 0.999
Physical health
Poor 1 1 1
Average 0.43 (0.12–1.52) 0.191 1.36 (0.27–6.84) 0.711 / 0.998
Good 0.13 (0.04–0.42) 0.001 0.49 (0.11–2.20) 0.335 / 0.998
Mental health
Poor 1 1 1
Average 0.06 (0.01–0.45) 0.006 / 0.997 / 0.996
Good 0.01 (0.01–0.06) <0.001 / 0.996 / 0.996

Students between the ages of 21 and 30, as well as fifth and sixth-year students, were less likely to rate their depression as severe compared to students under the age of 20, and first-year students, respectively. The same pattern was observed for the self-assessment of anxiety. On contrary, non-religious students were one and a half times more likely to experience a major depressive episode (OR = 1.52) compared to religious students. Students who did not have problems with online learning platforms were less likely to assess their depression as severe. Students who rated their mental health as average or good, as well as those who rated physical health as good, were less likely to experience a severe depressive reaction, compared to students who rated their physical and mental health as poor. Compared to men, women almost twice as often (OR = 1.89) and almost two and a half times more women (OR = 2.39) perceived their anxiety and stress as severe, respectively.

As indicated in Table 4, sixth-year (OR = 0.21) and fifth-year students (OR = 0.12) were less likely to perceive their depression as severe as first-year students. Students of the second (OR = 0.18), third (OR = 0.11), fifth, and sixth year (OR = 0.09) evaluated less frequently stressful reactions as severe, compared to students of the first year of medicine. Students who rated their mental health as good (OR = 0.01) or average (OR = 0.06) were also less likely to rate their depression as severe. Women more than twice (OR = 2.21) and more than three times (OR = 3.37) times more often assessed their anxiety or stress reactions as severe compared to men.

Table 4. Associations of scales of depression, anxiety and stress with students’ demographic variables, their medical studies and health status during the coronavirus pandemic–results of multivariate logistic regressions.

Variables Multivariate logistic regression (Severe versus moderate)
Depression Scale Anxiety Scale Stress Scale
OR (95%CI) P-value OR (95%CI) P-value OR (95%CI) P-value
Gender
Male 1 1 1
Female 1.56 (0.91–2.66) 0.107 2.21 (1.09–4.49) 0.027 3.37 (1.70–6.68) <0.001
Age
≤20 1 1 1
21–30 1.81 (0.61–5.44) 0.288 0.59 (0.14–2.47) 0.467 1.82 (0.42–7.90) 0.424
31+ 0.37 (0.04–3.20) 0.370 0.31 (0.02–5.10) 0.416 0.21 (0.02–2.20) 0.194
Year of studies
First 1 1 1
Second 0.53 (0.23–1.25) 0.150 0.20 (0.03–1.14) 0.069 0.18 (0.05–0.69) 0.012
Third 0.32 (0.09–1.19) 0.090 0.16 (0.02–1.40) 0.099 0.11 (0.02–0.71) 0.021
Fourth 0.26 (0.06–1.07) 0.061 0.42 (0.04–4.25) 0.461 0.18 (0.02–1.46) 0.109
Fifth 0.12 (0.03–0.49) 0.003 0.16 (0.02–1.49) 0.107 0.09 (0.01–0.71) 0.023
Sixth 0.21 (0.05–0.81) 0.023 0.36 (0.04–3.32) 0.366 0.09 (0.01–0.71) 0.022
Marital status
Single 1 1 1
Married/Living with a partner 1.05 (0.62–1.77) 0.868 1.34 (0.61–2.98) 0.466 2.01 (0.90–4.48) 0.088
Religious
Yes 1 1 1
No 1.50 (0.95–2.36) 0.083 1.10 (0.56–2.14) 0.786 1.36 (0.71–2.62) 0.359
Settlement type
Urban 1 1 1
Rural 1.33 (0.73–2.43) 0.358 1.40 (0.54–3.62) 0.494 0.57 (0.27–1.20) 0.140
Cohabitation during the studies
Alone 1 1 1
With family/room mate 1.18 (0.70–2.01) 0.531 1.53 (0.74–3.16) 0.253 2.57 (1.31–5.03) 0.006
Location during the state of emergency
In Belgrade 1 1 1
Not in Belgrade/Serbia 1.06 (0.68–1.66) 0.795 0.90 (0.46–1.75) 0.748 0.99 (0.52–1.89) 0.938
Online classes
Few 1 1 1
Moderate 0.96 (0.58–1.61) 0.892 1.64 (0.76–3.56) 0.206 1.03 (0.50–2.13) 0.938
Plenty 0.55 (0.28–1.07) 0.077 0.83 (0.33–2.06) 0.687 0.52 (0.21–1.29) 0.157
Problems with online learning platform
Yes 1 1 1
No 0.75 (0.47–1.22) 0.247 0.68 (0.32–1.48) 0.335 0.94 (0.46–1.90) 0.857
Coronavirus infection
Yes 1 1 1
No/not sure 0.88 (0.54–1.44) 0.617 0.99 (0.48–2.02) 0.974 0.80 (0.40–1.60) 0.530
General health
Poor 1 1 1
Average / 0.998 / 0.998 / 0.999
Good / 0.998 / 0.998 / 0.999
Physical health
Poor 1 1 1
Average 1.23 (0.26–5.92) 0.795 3.79 (0.52–27.49) 0.187 / 0.998
Good 0.71 (0.14–3.57) 0.683 2.80 (0.36–21.68) 0.324 / 0.998
Mental health
Poor 1 1 1
Average 0.06 (0.01–0.50) 0.009 / 0.996 / 0.996
Good 0.01 (0.01–0.07) <0.001 / 0.996 / 0.996

Discussion

The current study indicates that 65.5%, 85.6%, and 90.9% of students self-reported severe depressive, stress, and anxiety reactions, respectively. Our results are in line with the study from Russia where students showed higher levels of depression and higher levels of stress during the pandemic, but the opposite compared to students from Belarus, where social distance measures were not effective in the first months of the pandemic [18]. A study conducted on students in Switzerland showed that depressive symptoms were present among more than a quarter of the student population [19]. Similar results, but with lower levels of depression, anxiety, and stress (42%, 44.5%, and 66.0%, respectively) were obtained in another study conducted among the general population in Serbia [10]. A possible explanation for higher levels in our study may be attributed to the population that participated. Namely, medical students and medical personnel were more than the general population in contact with patients, moved to places where the virus transmission was higher, and generally knew more about the virus than other people, which could have further compromised their mental health [20].

The results of our study showed that only 32.4% of students with self-reported severe depressive reactions had good mental health. In a study with Switzerland’s students, depressive symptoms occurred more often in female students than in males, as well as in students who cared more about their health or already had some health problems [19]. In our study, no gender difference was found in terms of self-reported depressive reactions, although, a study conducted among Italian students [9] showed a significant difference between men and women, that is, women showed more depressive reactions.

Our study showed that first year students self-reported more severe depressive reactions than their older colleagues at the second, third, fifth, and sixth years of studies. Similar results were obtained in an extensive study conducted in nine countries by Ochnik et al. [21], which showed that students worldwide did not differ much in their reactions to the pandemic, but also that students in their younger years were more likely to self-report more depressive reactions. Students from our study who did not have problems with online learning platforms during the pandemic were 0.58 times less likely to self-report severe depressive reactions compared to students who had certain problems. For students who had problems with online learning platforms, professors from Belgrade Medical Faculty might organize additional consultations on weekly basis, so they can catch up on the material. Also, medical students who were non-religious self-reported severe depressive symptoms one and a half times more often (OR = 1.52) than religious students, which is in line with the findings of a study conducted with students in Malaysia [22] who generally turned to religion as a mechanism of coping stressful situations. Students from our study who aren’t religious can be referred to attend courses at the Department of Humanities that include topics in religion (like Health Psychology) and the content like this may help them find some answers on how to cope with stress during the days of the pandemic.

The results of this study showed that anxiety in our students was present in 90.9%, which indicates the high vulnerability of Serbian students to pandemic conditions. A study conducted among Chinese medical students [12] showed that 25% of students had problems with anxiety due to the virus pandemic and its consequences on everyday life and education. Anxiety was also a reaction of US students to the pandemic and its uncertainties, such as financial problems, unemployment, social isolation, concerns related to study conditions, and the organization of distance learning [23]. In our study, female students were more likely to self-report anxiety, that is, 2.21 times more often than male students, which is in line with data from a study conducted in New York [24]. Anxiety also occurred among adolescents and students during the pandemic in Pakistan [25], and the possible cause may be complete isolation, which was especially difficult for students who are by their nature very active, curious, and friendly. Medical students from Jordan [8], showed a higher degree of anxiety during the pandemic due to the way the studies were organized, that is, the difficulty of organizing primarily practical classes.

In our study, 17.8% of students stated that they have poor mental health, and self-perceived poor mental health was a predictor of higher levels on the anxiety scale. Research with students from Bangladesh showed that mental health problems can predict some psychopathological symptoms [26] and that there is a link between fear and anxiety about the virus and anxiety reactions. High anxiety levels, were also found in medical students from Mexico [27], and consequently, the students stated that anxiety and depressive reactions in that period were the main problems in normal everyday life. Health-related anxiety also occurred in students in Germany [28], where half of them reported increased concerns during the COVID-19 pandemic. Students from Serbia self-reported more intense and more often anxiety reactions at the beginning of their studies compared to those of older students and such findings are consistent with results in some other countries such as Slovenia, Germany, Turkey or Israel [21].

Our findings showed that 85.6% of medical students from Serbia self-reported severe stress due to the SARS-CoV-2 virus pandemic and 3.37 times more often female medical students compared to their male counterparts, which is in line with the student population in China [29]. At the beginning of their studies, students more often self-reported severe stress reactions compared to their older colleagues, which was also confirmed in a study by Ochnik et al. [21]. Our study did not confirm that social support in family life has a protective effect on mental health. Students who lived with their family were two and a half times (OR = 2.57) more likely to self-report severe stress in relation to their colleagues who lived alone and perceived their stress as moderate or mild. On the contrary, research conducted in Thailand [30] showed that stress reduction is more successful if students are provided with some form of social support and assistance. The transition of society, the lack of social support within some families, and the value system that has reigned in Serbia recently might be partly responsible for the ongoing situation, while in countries with a very expressed collectivist culture, such as Indochina, the value of social support has not declined.

During the pandemic, the University did not provide any organized activities of assistance to students. The students themselves organized support groups through social networks. The primary focus of the University was the organization of online classes while taking care of students’ mental health was of secondary importance.

In Belgrade, the students can get specialist consultative services (covered by health insurance) for the protection of their mental health at the Institute for students’ healthcare as primary health care institution. There is no program or center for psychological counseling at Belgrade University so the creation of a network of centers for counseling and psychological help for students as an integrated part of the health system is of crucial importance for the prevention and protection of mental health, but also for young people in general. The individual, group, and workshop activities for students could be provided in those centers by teachers, assistants, final year students, psychotherapists, and other psychologists, but also experts and researchers from numerous other institutions. Basic activities would be direct counseling, peer counseling, SOS telephone service, internet counseling (through an online Faculty platform), organization of forums, seminars, round tables, the realization of empirical research, training and education, etc. Also, if one student needs hospital treatment, professional help would be provided. The support program should be available to students throughout the year and could start at the beginning of the academic year. For those students with poor mental health it must take into consideration the specificities of the population to which it refers and all other contextual specificities [31]. During the orientation week or mental health gatekeeper training, younger students can learn from professors or senior colleagues how to recognize the first signs of mental problems, how to successfully deal with stress and use coping mechanisms, and where to find professional help [32, 33].

According to our best knowledge, this is the first study in Serbia that examines the effects of the COVID-19 pandemic on students’ mental health and the first study to observe the mental health of the medical student population. Also, the advantage of this study was the random sampling process, and consequently representative sample. However, there are several limitations that need to be stressed. The generalization of results cannot be applied to students of other faculties of the University of Belgrade or to students in the rest of Serbia. Due to the epidemiological situation, the study was conducted online, which could have led to uneven conditions for completing the questionnaire. This was partially avoided by detailed written instructions and those related to the conditions in which the completion of the questionnaire should be organized, but still, we assume that some of the participants may have ignored these instructions. Students could also be dishonest in their responses.

Conclusion

As a consequence of the SARS-CoV-2 virus pandemic, students attending undergraduate medical studies in Belgrade developed mental health problems. The majority of students assessed their anxiety and depressive reactions as moderate or severe, while stress reactions were sometimes assessed as mild, but more often as moderate or severe. The COVID-19 pandemic had a great impact on the overall mental health of medical students and therefore it is important to pay attention to preserving their mental health and to launch programs that would provide, primarily social support and assistance in the form of consultative work.

Supporting information

S1 Table

(PDF)

Data Availability

All relevant data are within the paper.

Funding Statement

This study was supported by the Ministry of Education, Science and Technological Development of the Republic of Serbia (Ministarstvo Prosvete, Nauke i Tehnološkog Razvoja RS, project No 200110). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A novel coronavirus from patients with pneumonia in China. N Engl J Med. 2020;382(8): 727–733. 10.1056/nejmoa2001017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Ihm L, Zhang H, Vijfeijken A, Waugh M. Impacts of the Covid-19 pandemic on the health of university students. Int J Health Plann Manage. 2021;36(3): 618–627. doi: 10.1002/hpm.3145 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Salvatore PP, Sula E, Coyle JP, Caruso E, Smith AR, Levine RS, et al. Recent increase in COVID-19 cases reported among adults aged 18–22 years–United States, May 31–September 5, 2020. MMWR Morb Mortal Wkly Rep. 2020;69(39):1419–1424. doi: 10.15585/mmwr.mm6939e4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Casagrande M, Favieri F, Tambelli R, Forte G. The enemy who sealed the world: Effects quarantine due to the COVID-19 on sleep quality, anxiety, and psychological distress in the Italian population. Sleep Med. 2020;75: 12–20. doi: 10.1016/j.sleep.2020.05.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Dubey S, Biswas P, Ghosh R, Chatterjee S, Dubey MJ, Chatterjee S, et al. Psychosocial impact of COVID-19. Diabetes Metab Syndr. 2020;14(5): 779–788. doi: 10.1016/j.dsx.2020.05.035 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Shah SMA, Mohammad D, Qureshi MFH, Abbas MZ, Aleem S. Prevalence, psychological responses and associated correlates of depression, anxiety and stress in a global population, during the coronavirus disease (COVID-19) pandemic. Community Ment Health J. 2021;57(1): 101–110. doi: 10.1007/s10597-020-00728-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Marazziti D. The COVID-19 outbreak: the latest challenge to psychological and psychiatric intervention. Clin Neuropsychiatry. 2020;17(2): 39–40. doi: 10.36131/clinicalnpsych20200201 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Seetan K, Al-Zubi M, Rubbai Y, Athamneh M, Khamees A, Radaideh T. Impact of COVID-19 on medical students’ mental wellbeing in Jordan. Plos One. 2021;16(6): e0253295. doi: 10.1371/journal.pone.0253295 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Di Consiglio M, Merola S, Pascucci T, Violani C, Couyoumdjian A. The Impact of COVID-19 Pandemic on Italian University Students’ Mental Health: Changes across the Waves. Int J Environ Res Public Health. 2021;18(18): 9897–9900. doi: 10.3390/ijerph18189897 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Vujčić I, Safiye T, Milikić B, Popović E, Dubljanin D, Dubljanin E, et al. Coronavirus Disease 2019 (COVID-19) Epidemic and Mental Health Status in the General Adult Population of Serbia: A Cross-Sectional Study. Int J Environ Res Public Health. 2021;18(4): 1957–1973. doi: 10.3390/ijerph18041957 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Gavurova B, Ivankova V, Rigelsky M. Relationships between perceived stress, depression and alcohol use disorders in university students during the COVID-19 pandemic: a socio-economic dimension. Int J Environ Res Public Health. 2020;17(23): 8853–8878. doi: 10.3390/ijerph17238853 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Cao W, Fang Z, Hou G, Han M, Xu X, Dong J, et al. The psychological impact of the COVID-19 epidemic on college students in China. Psychiatry Res, 2020;287: 112934. doi: 10.1016/j.psychres.2020.112934 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Lavergne JA, Kennedy ML. Telepsychiatry and Medical Students: a Promising Mental Health Treatment for Medical Student Use Both Personally and Professionally. Curr Psychiatry Rep. 2021;23(6): 31–6. doi: 10.1007/s11920-021-01248-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Kecojevic A, Basch CH, Sullivan M, Davi NK. The impact of the COVID-19 epidemic on mental health of undergraduate students in New Jersey, cross-sectional study. PloS One. 2020;15(9): e0239696. doi: 10.1371/journal.pone.0239696 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Jovanović V, Gavrilov-Jerković V, Žuljević D, Brdarić D. Psihometrijska evaluacija Skale depresivnosti, anksioznosti i stresa-21 (DASS-21) na uzorku studenata u Srbiji. Psihologija. 2014;47(1): 93–112. [Google Scholar]
  • 16.Henry J, Crawford J. The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. Br J Clin Psychol. 2005;44(2): 227–239. 10.1348/014466505x29657 [DOI] [PubMed] [Google Scholar]
  • 17.Lovibond PF, Lovibond SH. The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav Res Ther. 1995;33(3): 335–343. doi: 10.1016/0005-7967(94)00075-u [DOI] [PubMed] [Google Scholar]
  • 18.Gritsenko V, Skugarevsky O, Konstantinov V, Khamenka N, Marinova T, Reznik A, et al. COVID 19 fear, stress, anxiety, and substance use among Russian and Belarusian university students. Int J Ment Health Addict. 2021;19(6): 2362–2368. doi: 10.1007/s11469-020-00330-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Volken T, Zysset A, Amendola S, Klein-Swormink A, Huber M, Wyl A. Depressive symptoms in Swiss university students during the covid-19 pandemic and its correlates. Int J Environ Res Public Health. 2021;18(4): 1458–1462. doi: 10.3390/ijerph18041458 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Antonijevic J, Binic I, Zikic O, Manojlovic S, Tosic-Golubovic S, Popovic N. Mental health of medical personnel during the COVID-19 pandemic. Brain Behav. 2020;10(12): e01881. doi: 10.1002/brb3.1881 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Ochnik D, Rogowska AM, Kuśnierz C, Jakubiak M, Schütz A, Held MJ, et al. Mental health prevalence and predictors among university students in nine countries during the COVID-19 pandemic: A cross-national study. Sci Rep. 2021;11(1): 1–13. 10.1038/s41598-021-97697-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Al-Dubai SAR, Al-Naggar RA, Alshagga MA, Rampal KG. Stress and coping strategies of students in a medical faculty in Malaysia. Malays J Med Sci. 2011;18(3): 57–64. [PMC free article] [PubMed] [Google Scholar]
  • 23.Browning M, Larson L, Sharaievska I, Rigolon A, McAnirlin O, Mullenbach L, et al. Psychological impacts from COVID-19 among university students: Risk factors across seven states in the United States. PloS One. 2021;16(1): е0245327. doi: 10.1371/journal.pone.0245327 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Gupta P, Anupama BK, Ramakrishna K. Prevalence of Depression and Anxiety Among Medical Students and House Staff During the COVID-19 Health-Care Crisis. Acad Psychiatry. 2021;45(5): 575–580. doi: 10.1007/s40596-021-01454-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Imran N, Zeshan M, Pervaiz Z. Mental health considerations for children & adolescents in COVID-19 Pandemic. Pak J Med Sci. 2020;(COVID19-S4): S67–S72. 10.12669/pjms.36.covid19-s4.2759 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Magson NR, Freeman JY, Rapee RM, Richardson CE, Oar EL, Fardouly J. Risk and protective factors for prospective changes in adolescent mental health during the COVID-19 pandemic. J Youth Adolesc. 2021;50(1): 44–57. doi: 10.1007/s10964-020-01332-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.García-Espinosa P, Ortiz-Jiménez X, Botello-Hernández E, Aguayo-Samaniego R, Leija-Herrera J, Góngora-Rivera F. Psychosocial impact on health-related and non-health related university students during the COVID-19 pandemic. Results of an electronic survey. Rev Colomb Psiquiatr. 2021;50(3): 214–224. 10.1016/j.rcpeng.2021.04.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Jungmann S, Witthoft M. Health anxiety, cyberchondria, and coping in the current COVID-19 pandemic: Which factors are related to coronavirus anxiety? J Anxiety Disord. 2020;73: 102239. doi: 10.1016/j.janxdis.2020.102239 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Li X, Lv Q, Tang W, Deng W, Zhao L, Meng Y, et al. Psychological stresses among Chinese university students during the COVID-19 epidemic: The effect of early life adversity on emotional distress. J Affect Disord. 2021;282: 33–38. doi: 10.1016/j.jad.2020.12.126 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Puranachaikere T, Hataiyusuk S, Anupansupsai R, In-Iw S, Saisavoey N, Techapanuwat T, et al. Stress and associated factors with received and needed support in medical students during COVID-19 pandemic: a multicenter study. Korean J Med Educ. 2021;33(3): 203–213. doi: 10.3946/kjme.2021.200 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Singh S, Roy D, Sinha K, Parveen S, Sharma G, Joshi G. Impact of COVID-19 and lockdown on mental health of children and adolescents: A narrative review with recommendations. Psychiatry Res. 2020;293: 113429. doi: 10.1016/j.psychres.2020.113429 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Elhai JD, Schweinle W, Anderson SM. Reliability and validity of the attitudes toward seeking professional psychological help scale-short form. Psychiatry Res. 2008;159(3): 320–329. doi: 10.1016/j.psychres.2007.04.020 [DOI] [PubMed] [Google Scholar]
  • 33.Cvjetković SJ. Research on predictors of psychological distress and willingness to seek professional psychological help among Belgrade University students [In Serbian]. Doctoral Thesis, Faculty of Medicine University of Belgrade. 2020. Available from: https://nardus.mpn.gov.rs/handle/123456789/18503

Decision Letter 0

Aleksandra Barac

14 Jul 2022

PONE-D-22-11573The impact of the COVID-19 epidemic on students’ mental health: a cross-sectional studyPLOS ONE

Dear Dr. Janković,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Aug 28 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Dr Aleksandra Barac

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Reviewer one

The article of self-reported experiences of depression, stress and anxiety among medical students in the University of Belgrade, Serbia is well-written, but it is generally confusing and needs refining, if it is to be published in this journal. The issues I will raise are conceptual, methodological and analytical.

CONCEPTUAL AND METHODOLOGICAL

The authors say they applied stratified random sampling. It is rare indeed to have medical schools with more Female students. But if University of Belgrade, Serbia has more female students, one of the purposes of stratified random sampling would be to ‘balance-out’ this gender anomaly. Therefore, to have a sample – with approximately four times female students, makes it superfluous to consider gender as an analytical tool . To put it in another way, given this huge gender imbalance, authors could have just retained female students’ self-reported experiences through out the article.

ANALYTICAL

Only students in clinical years ( 4 , 5, 6 years) come in contact with patients. Therefore attributing the high figures of self-reported anxiety, stress and depression in medical students during covid-19 to interacting with patients is confusing. It is even more confusing that students in senior years (4, 5, 6 years), self-reported being in good mental health.

There is always a big difference between self-report and exact experience in clinical categories in mental health. The authors instead use the terms self-report and ‘experience’ inter-changeably. I think what was assessed is self-report of stress, anxiety and depression.

If indeed up to 32.4% experienced, severe depression reactions, authors need to state clearly how they collected data with students who had symptoms including suicidal thoughts, lack of focus, and losing interest in pleasurable activities such as responding to lengthy online questionnaire.

Were these students who ‘experienced’ severe depression, treat by technical people. Severe depression -as-a-clinical category may require medication and Not Counselling. If the client had a symptom like suicidal thoughts, that is an emergency, requiring admission and close monitoring – not counselling and guidance.

Some sentences are poorly written. For example, a sentence like this lacks clarity. 71.9%, 66.7%. and 50.5% of students perceived their general, physical and mental health are good respectively. And yet, also 64.%%, 60.7% and 66.7% of students of ages 20 to 30 experienced severe depression symptoms, severe anxiety and severe stress. Please clarify how this contradiction can exists.

And if there were co-morbidity of severe depression and severe anxiety; this amounts to an emergency in mental health. Did you attend to these students, by referring them to a clinician?

In mental health, one needs to distinguish between commonly used words like stress, anxiety and depression – and sometimes schizophrenia, yet they are at the same time clinical categories with specific symptoms- over-a-six months period . In our experience, students in pre-clinical years, (first through to third year students) – use these clinical terms casually. I say casually because they do not exactly understand what they mean,

It is not surprising that on page 32, for instance, first year students, or generally students in junior year of study report moderate to severe depression than older colleagues .

Reviewer #2: In the statistical analysis section the sentence , "All predictors were first included in the bi-variate regression analyses, and then, regardless of whether they were statistically significant or not, included in the multivariate regression analyses". why you entered all variables into the multi-variable regression analysis without filtering out from the bi-variate analysis?

Reviewer #3: The impact of the COVID-19 epidemic on students' mental health: a cross-sectional study

Thank you for allowing me to review this study. This interesting study targets the most important concern among students, particularly medical students: mental health status and the emotional reaction to the pandemic.

- The significance of the study was clearly described in general and within the context of medical students and the country.

- The introduction was informative regarding all supportive global, international, national, and local literature.

- The study's purpose reflected the significance and context of the study.

- Methods were explained with some details (sampling methods, instruments, ethical concerns, data collection procedure, and the types of analysis).

- The results are presented clearly in tables and text.

- The discussion discussed the results within the context of the literature, the current situation, and the context of education and medical students.

- The authors highlighted the possible limitations and proposed a solution.

Minor changes:

- Typo error line 206 (form should be from).

- In the discussion part, you need to mention if there are any programs at all levels already run in the universities in Belgrade and if there were any activities during the pandemic for students.

- The conclusion must mention the differences in mental health between students to be considered in any designed program.

- Study implications in clinical practice, policy, and research should be considered and added. What type of programs should be launched, when, and how.

- Authors can suggest some recommendations specifically for the current sample, taking the factors associated with their mental health such as religion, study level, gender, access to online platforms..etc). for example, you may have specific actions for younger students during orientation week, such so.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Grace Akello, PhD

Reviewer #2: Yes: Ayechew Ademas

Reviewer #3: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Sep 22;17(9):e0275167. doi: 10.1371/journal.pone.0275167.r002

Author response to Decision Letter 0


7 Sep 2022

PONE-D-22-11573

The impact of the COVID-19 epidemic on students’ mental health: a cross-sectional study

PLOS ONE

Response to the Reviewer’s Comments

Reviewer #1: The article of self-reported experiences of depression, stress and anxiety among medical students in the University of Belgrade, Serbia is well-written, but it is generally confusing and needs refining, if it is to be published in this journal. The issues I will raise are conceptual, methodological and analytical.

COMMENTS

CONCEPTUAL AND METHODOLOGICAL

1.- The authors say they applied stratified random sampling. It is rare indeed to have medical schools with more Female students. But if University of Belgrade, Serbia has more female students, one of the purposes of stratified random sampling would be to ‘balance-out’ this gender anomaly. Therefore, to have a sample – with approximately four times female students, makes it superfluous to consider gender as an analytical tool . To put it in another way, given this huge gender imbalance, authors could have just retained female students’ self-reported experiences through out the article.

RESPONSE:

We appreciate your comment. It is not rare in this case, that is, at Medical Faculty University of Belgrade to have more female students than male students. It is a common gender proportion for Belgrade Medical Faculty on an annual basis, for each enrolled generation of students. So, we don't think in our case that this is a gender anomaly and our sample is a representative sample of medical students in Belgrade. We were interested in mental health of the entire student population, not in a stratified sample by gender. The subjects were selected according to the principle of stratified cluster sample. The entire population of medical students was observed as one cluster, while students from each of the six years of study were observed as a separate group. The representativeness was determined on the basis of a sufficient number of observation units to assess the proportions, as well as random selection of observation units, which enabled the generalization of the obtained results.

ANALYTICAL

2.- Only students in clinical years (4, 5, 6 years) come in contact with patients. Therefore attributing the high figures of self-reported anxiety, stress and depression in medical students during covid-19 to interacting with patients is confusing. It is even more confusing that students in senior years (4, 5, 6 years), self-reported being in good mental health.

RESPONSE:

Our Medical Faculty University of Belgrade is obviously a different case and students from all study years come in contact with patients. According to the curriculum first year students have obligatory module: ”The basics of clinical practice I” and second year students have obligatory module: “The basics of clinical practice II” with Physician in the community part when they go to Hospitals and Primary Health Care Centers and talk with the patients. Third year students have obligatory module: ”Clinical Propedeutics”.

As you said in one of your comments (number 8) younger students use clinical terms like stress, anxiety and depression casually so based on our experience the finding that first year students had more severe depressive reactions than their older colleagues is not surprising or confusing at all.

Our findings of good mental health among older students are in line with data from other studies. For example, study conducted in nine countries showed that students in their younger years were more likely to experience more depressive reactions (Ochnik, D., Rogowska, A. M., Kuśnierz, C., et al. 2021. Mental health prevalence and predictors among university students in nine countries during the COVID-19 pandemic: A cross-national study. Scientific reports, 11 (1), pp. 1-13). Other study showed that students in their younger years were more likely to experience more anxiety reactions (Saeed, N. and Javed, N. 2021. Lessons from the COVID-19 pandemic: Perspectives of medical students. Pakistan Journal of Medical Sciences, 37 (5), pp. 1402-1407).

3.- There is always a big difference between self-report and exact experience in clinical categories in mental health. The authors instead use the terms self-report and ‘experience’ inter-changeably. I think what was assessed is self-report of stress, anxiety and depression.

RESPONSE:

We totally agree with your comment. In our study we used The Depression Anxiety Stress Scales (DASS-21) questionnaire to assess depression, anxiety and stress. We used only self-reported measures and accordingly word ‘experience’ is changed with the words ‘self-report’ or ‘self-perceive’ throughout the whole text.

4.- If indeed up to 32.4% experienced, severe depression reactions, authors need to state clearly how they collected data with students who had symptoms including suicidal thoughts, lack of focus, and losing interest in pleasurable activities such as responding to lengthy online questionnaire.

RESPONSE:

It is clearly described under the methodological section how was the level of depression, anxiety and stress measured. Also, students reported on their self-assessment of mental health. There is nowhere in the text that up to 32.4% experienced, severe depression reactions. The truth is that among students who self-reported severe depressive symptoms, 32.4% rated their mental health as good. Students didn’t report on their diagnoses or clinical conditions. They reported exclusively on their own reactions to the pandemic and on their subjective, intrapersonal perceptions of their own condition. We did not use questions regarding suicidal thoughts, lack of focus, and losing interest in pleasurable activities.

5.- Were these students who ‘experienced’ severe depression, treat by technical people. Severe depression -as-a-clinical category may require medication and Not Counseling. If the client had a symptom like suicidal thoughts, that is an emergency, requiring admission and close monitoring – not counselling and guidance.

RESPONSE:

Students who reported severe depression were not treated by technical people. The main reason is that students filled out questionnaires anonymously so we don't know who are these students. As we have already said in our research we did not use questions regarding suicidal thoughts.

We agree with you that severe depression as a clinical category may require medication and treatment by technical people, but in this research, the DASS-21 self-reported questionnaire was used as a quantitative measure of distress along the 3 axes of depression, anxiety and stress. It is not a categorical measure of clinical diagnoses and the term severe depression doesn’t refer to the clinical manifestation of depression as a disorder. It is clearly explained under the methodological section how we obtained variables with three categories: severe, moderate, and mild depression/anxiety/stress.

Counseling is the first step in the process of helping students who report mental health problems. If a student needs hospitalization and close monitoring he must be referred for medical treatment. Under the discussion section we proposed certain actions and according to reviewer#3 comments study implications in clinical practice, policy, and research were added.

6.- Some sentences are poorly written. For example, a sentence like this lacks clarity. 71.9%, 66.7%. and 50.5% of students perceived their general, physical and mental health are good respectively. And yet, also 64.%%, 60.7% and 66.7% of students of ages 20 to 30 experienced severe depression symptoms, severe anxiety and severe stress. Please clarify how this contradiction can exists.

RESPONSE:

The sentences were reworded in the text. In the first sentence, we presented the answers of all students who self-assessed their general, physical and mental health. This self-assessment questionnaire collected data on how respondents generally assess three mentioned components of their health. In the second sentence, we presented the answers of students from the only one age category (20-30 years). These data were collected using the DASS-21 questionnaire and show self-report of depressive, anxiety and stress reactions. Therefore, these two sentences show different aspects of students' self-report of health.

7.- And if there were co-morbidity of severe depression and severe anxiety; this amounts to an emergency in mental health. Did you attend to these students, by referring them to a clinician?

RESPONSE:

The answer on this question is similar as the answer on question number 5. In this research, the DASS-21 self-reported questionnaire was used and it is clearly explained under the methods section how three subscales were transformed to obtain variables with three categories: severe, moderate, and mild depression/anxiety/stress. The DASS-21 is a quantitative measure of distress along the 3 axes of depression, anxiety and stress. It is not a categorical measure of clinical diagnoses, so the term severe depression doesn’t refer to the clinical manifestation of depression as a disorder. We did not examine co-morbidity and students filled out questionnaires anonymously so we don't know specifically who reported severe depression or severe anxiety and therefore it was not possible to approach them.

8.- In mental health, one needs to distinguish between commonly used words like stress, anxiety and depression – and sometimes schizophrenia, yet they are at the same time clinical categories with specific symptoms- over-a-six months period. In our experience, students in pre-clinical years, (first through to third year students) – use these clinical terms casually. I say casually because they do not exactly understand what they mean. It is not surprising that on page 32, for instance, first year students, or generally students in junior year of study report moderate to severe depression than older colleagues .

RESPONSE:

That's right. We agree with you. Many terms are used incorrectly and to describe conditions that doesn’t indicate a diagnosis in everyday speech. For us it is also not surprising the finding that first year students had more severe depressive reactions than their older colleagues.

Reviewer #2:

1.- In the statistical analysis section the sentence, "All predictors were first included in the bi-variate regression analyses, and then, regardless of whether they were statistically significant or not, included in the multivariate regression analyses". why you entered all variables into the multi-variable regression analysis without filtering out from the bi-variate analysis?

RESPONSE:

Thank you for your comment. All variables were included in the multivariate regression analyses because of the possibility that might be a significant association between certain variables and because of their significance for the study topic according to the literature and authors' opinion. A part of the sentence was added in the method section of the manuscript, under statistical analysis subheading. Nevertheless, multivariate logistic regression, which was performed only with variables that were significant predictors in bivariate logistic regression, showed exactly the same results (significant predictors are the same variables) with our original analysis, that is, when all variables were included in the multivariate regression analyses despite their significance in the bivariate regression analyses. Please, see attached tables (we performed additional statistical analysis). When all variables were included in the analysis, the only difference is in more significant categories of the "years of study" variable.

Reviewer #3: Thank you for allowing me to review this study. This interesting study targets the most important concern among students, particularly medical students: mental health status and the emotional reaction to the pandemic.

- The significance of the study was clearly described in general and within the context of medical students and the country.

- The introduction was informative regarding all supportive global, international, national, and local literature.

- The study's purpose reflected the significance and context of the study.

- Methods were explained with some details (sampling methods, instruments, ethical concerns, data collection procedure, and the types of analysis).

- The results are presented clearly in tables and text.

- The discussion discussed the results within the context of the literature, the current situation, and the context of education and medical students.

- The authors highlighted the possible limitations and proposed a solution.

Minor changes:

1.- Typo error line 206 (form should be from).

RESPONSE:

The typo error is corrected.

2.- In the discussion part, you need to mention if there are any programs at all levels already run in the universities in Belgrade and if there were any activities during the pandemic for students.

RESPONSE:

Thank you for your comment. One paragraph was added in the discussion part about the existence of programs and activities for students.

During the pandemic, the University did not provide any organized activities of assistance to students. The students themselves organized support groups through social networks. The primary focus of the University was the organization of online classes while taking care of students' mental health was of secondary importance.

The students can get specialist consultative services (covered by health insurance) for the protection of their mental health at the Institute for students’ healthcare as primary health care institution in Belgrade. But, there is no program or center for psychological counseling at Belgrade University.

3.- The conclusion must mention the differences in mental health between students to be considered in any designed program.

RESPONSE:

Thank you for your comment. One sentence was added in the discussion part about the differences in mental health between students to be considered in any designed program.

Designed programs for providing support to students will take into account all the differences and specificities between students, primarily the level of depressive, anxiety and stress reactions.

4.- Study implications in clinical practice, policy, and research should be considered and added. What type of programs should be launched, when, and how.

RESPONSE:

Study implications were added in one paragraph under the discussion section.

Regarding the fact that there is no program or center for psychological counseling at Belgrade University, we think that the creation of a network of centers for counseling and psychological help for students as an integrated part of the health system is of crucial importance for the prevention and protection of mental health, but also for young people in general. The individual, group and workshop activities for students could be provided in those centers by teachers, assistants, final year students, psychotherapists and other psychologists, but also experts and researchers from numerous other institutions. Basic activities would be direct counseling, peer counseling, SOS telephone service, internet counseling (through an online Faculty platform), organization of forums, seminars, round tables, the realization of empirical research, training and education, etc. Also, if one student needs hospital treatment, professional help would be provided. The support program should be available to students throughout the year and could start at the beginning of the academic year.

5.- Authors can suggest some recommendations specifically for the current sample, taking the factors associated with their mental health such as religion, study level, gender, access to online platforms..etc). for example, you may have specific actions for younger students during orientation week, such so.

RESPONSE:

We agree with your comment and suggestion. We added specific recommendations in a few sentences under the discussion section.

Programs for providing assistance to students with poor mental health must really take into consideration the specificities of the population to which it refers and all other contextual specificities. (Singh, S., Roy, D., Sinha, K., Parveen, S., Sharma, G., et al. Joshi, G. 2020. Impact of COVID-19 and lockdown on mental health of children and adolescents: A narrative review with recommendations. Psychiatry research, 293, pp. 113429). During the orientation week or mental health gatekeeper training, younger students can learn from professors or older colleagues how to successfully deal with stress and use coping mechanisms. Also, senior colleagues can show them how to recognize the first signs of mental problems and where they can get professional help. (Cvjetković, SJ. 2020. Research on predictors of psychological distress and willingness to seek professional psychological help among Belgrade University students. Doctoral Dissertation (in Serbian). Faculty of Medicine University of Belgrade). For students who had problems with online learning platforms, professors might organize additional consultations on weekly basis, so they can catch up on the material. Students who aren’t religious can be referred to attend courses at the Department of Humanities that include topics in religion (like Health Psychology) and the content like this may help them find some answers on how to cope with stress during the days of the pandemic.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Aleksandra Barac

12 Sep 2022

The impact of the COVID-19 epidemic on students’ mental health: a cross-sectional study

PONE-D-22-11573R1

Dear Dr. Janković,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Aleksandra Barac

Academic Editor

PLOS ONE

Acceptance letter

Aleksandra Barac

14 Sep 2022

PONE-D-22-11573R1

The impact of the COVID-19 epidemic on students’ mental health: a cross-sectional study

Dear Dr. Janković:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Aleksandra Barac

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the paper.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES