Skip to main content
PLOS One logoLink to PLOS One
. 2023 Aug 11;18(8):e0288769. doi: 10.1371/journal.pone.0288769

Evaluation the validity and reliability of the perceived medical school stress scale in Turkish medical students

Esra Çınar Tanrıverdi 1,*, Sinan Yılmaz 2, Yasemin Çayır 3
Editor: Somayeh Delavari4
PMCID: PMC10420339  PMID: 37566581

Abstract

Medical education can be a challenging and stressful process. Additional stressors can make the medical education process even more complex and impair a student’s attention and concentration. To the authors’ knowledge, there is no valid and reliable scale to measure medical school stress in Turkish medical students. Therefore, this study aimed to determine the validity and reliability of the Perceived Medical School Stress (PMSS) Scale in Turkish medical students. The Perceived Medical School Stress Scale is a self-assessment tool developed to measure medical school-induced stress in medical students. It consists of 13 items divided into two subdimensions. Scale items are answered using a four-point (0–4) Likert system The total score that can be obtained from the PMSS ranges from 0 to 52, with higher scores indicating higher levels of perceived stress. First, the scale was applied as a pilot to 52 students by performing the scale’s back-and-forth translation into Turkish. Then, the scale was applied to 612 volunteer medical students to ensure validity. Convergent validity and confirmatory factor analysis are used to assess the construct validity of a scale. Test-retest, item correlations, and Cronbach’s alpha coefficients are used to evaluate the reliability of a scale. As a result of confirmatory factor analysis, the two-factor structure of the original scale was confirmed. The fit indices of the model obtained showed excellent fit. The Generalized Anxiety Disorder-7 (GAD-7) Scale was used for convergent validity. The GAD-7 is a self-assessment tool that measures the level of generalized anxiety. It is answered with a four-point Likert scale for the last two weeks. The score that can be obtained from the scale is between 0–21. A score of ten or more indicates possible anxiety disorder. The students’ mean perceived medical school stress score was 39.80±8.09, and their GAD-7 score was 11.0±5.5. A significant positive relationship was found between the total scores of the scales (r = .48, P < .001). The Cronbach’s alpha value of the scale was .81, and test-retest reliability was significant for all scale items (P < .001 for all). No item was deleted according to Cronbach’s alpha values and item-total correlations. There was no significant relationship between Turkish version of the PMSS and GAD-7 scores and age, sex, income status, tobacco use, or exercise (P>.05). The Turkish version of the Perceived Medical School Stress Scale is a valid and reliable scale that can be used to investigate the medical school-specific stress of students.

Introduction

Medical education is a lifelong and demanding process that begins with medical school admission. The stress that medical education creates on students is a well-recognized issue that has been studied extensively in many countries worldwide [13]. Awareness of stress in medical education is also increasing in Türkiye [4,5].

Academic life can create a lack of time for other activities by affecting the personal and social life of individuals. Not being able to save enough time for their families, friends, social life, and personal development increases students’ stress. University students can experience a range of stressors beyond the academic demands of their coursework, such as moving to another city for university, financial stress, and the need for shelter or a house [6].

Research has consistently shown that medical students experience higher stress, anxiety, depression, and burnout symptoms than students in other fields of study, peers, and the general population [1,3,79]. It is generally accepted that the high-stress levels experienced by medical students are due to a range of specific stressors unique to medical education [1,6,8]. Among these reasons are the intense curriculum and information overload, academic competition, high-performance expectations and grade anxiety [1], fear of inadequacy and making mistakes, and the faculty’s insensitivity to students’ needs [1,6,8,10,11]. In addition, attention is also drawn to emotional stressors, such as witnessing people’s illnesses, disabilities, suffering, and deaths [1,8].

Intense stress is one of the leading causes of cognitive dysfunction [12]. The stress experienced by medical students negatively impacts their school performance, leading to a decrease in academic achievement [1], dropping out of school, and even suicidal thoughts [13,14]. The stress experienced by medical students is also closely related to burnout [12,15]. A recent study in Turkey showed that the psychological health of medical students deteriorated within the first year of medical education [16].

Perceived stress affects students’ psychological health and attitudes toward patients. It has been reported that stress negatively affects medical students’ ethical and professional attitudes and causes empathy loss toward patients [13,15]. Perceived stress thus negatively affects the quality of patient care [17].

Studies report that even though medical students are aware of the stress they experience, they are reluctant to accept their psychological problems, seek professional help, and even show resistance in this regard [18,19]. Therefore, to develop preventive strategies, it is necessary to recognize medical students’ stress and identify the factors affecting it.

The Perceived Medical School Stress (PMSS) scale is an easy-to-answer and practical tool developed to measure medical school-specific stress perceived by medical students [6]. It has been adapted and widely used in various languages and cultures [1,8,10,20,21]. There is currently no version of the scale adapted to Turkish. In Türkiye, studies evaluating medical students’ perceived stress levels use scales such as the "Perceived Stress Scale" and "Depression Anxiety and Stress Scale," which were validated in Turkish [16,22]. Although these scales assess stress, they cannot distinguish medical school-specific stress from general stress.

This study aims to adapt the PMSS scale to Turkish, conduct validity and reliability studies, and provide a unique tool to be used in evaluating medical school-induced stress of medical students in Türkiye.

Materials and methods

Study design and participants

This study is a methodological, two-stage observational validity study. The research was carried out with Atatürk University Faculty of Medicine preclinical students between July and September 2022. Initially, Prof. Dr. Peter P. Vitaliano, who developed the original scale, was contacted via e-mail, and the necessary permission was obtained to adapt the scale into Turkish. Subsequently, the study was approved by the Atatürk University Faculty of Medicine Non-Invasive Studies Ethics Committee (Number: B.30.2.ATA.0.01.00/05, date: 24.06.2021). The study was carried out under the rules of the Helsinki Declaration. Informed consent from the participants was obtained.

Although 5–20 participants are recommended for each scale item in validity and reliability studies [23], all volunteering students’ inclusion was aimed at the investigation since a more extensive study sample was preferred. At the time of the study, there were 1080 preclinical students in the medical faculty. Of these students, 612 volunteers participated in the study. In addition, 14 days after the first application, the Turkish version of the PMSS (PMSS-TR) was readministered to 70 randomly selected students who agreed to participate for the second time to evaluate the test-retest reliability.

Data were collected through an online survey. Students were first informed about the purpose and scope of the study via e-mail and classroom WhatsApp groups. Then, the survey link was shared with the students. Information about the purpose and scope of the study was also included at the beginning of the questionnaire. The first question of the questionnaire was written as "I have been informed about the study, and I accept participation voluntarily." Participants could not answer other questions without giving this consent. In this way, online permission was obtained from the participants. Data were collected anonymously, and students were not asked for personal information. However, the students were asked to write a nickname to match with the retest. The questionnaire was available to access for three weeks. During this period, a weekly reminder message was sent to the students. At the end of the period, the survey was terminated. Answering the questionnaire takes approximately 15–20 minutes. Students with a diagnosed psychiatric illness, those using a medication, and those who did not volunteer were excluded. No incentives were paid to the students for participation.

Data collection tools

A three-part questionnaire was used as a data collection form in the study. The first part of the questionnaire contained questions about sociodemographic characteristics (age, sex, years of education, income status, tobacco use, and exercise), the second part had the PMSS scale, and the third part included the Generalized Anxiety Disorder-7 scale.

Perceived Medical School Stress Scale (PMSS)

The PMSS was developed by Vitaliano et al. to measure the stress of medical students from studying in medical school. The original language of the scale is English. There are two dimensions and 13 items on the scale. There are nine items in the "Psychological Stress and Environment" dimension (items 1, 4, 6, 7, 8, 9, 10, 11, and 12) and three in the "Resilience and Expectations" dimension (items 2, 3, and 5). The 13th item was added to the scale by the authors’ majority approval because it was a primary concern of students (finance). However, this item was not included in either of the two subdimensions. The scale consists of items such as "Medical education controls my life and leaves little time for other activities," "Medical school is cold, soulless, and unnecessarily bureaucratic," and "My financial situation is a concern for me," which questions various situations related to stress such as workload, financial concerns, competition, and threats [6].

The scale has a 5-point Likert scale. Scale items are answered and scored as "0 = strongly disagree" and 4 = strongly agree." The score obtained from each item is between 0–4. There is no reverse-scored item on the scale. The total score is obtained by summing the scores of each item. The total score that can be obtained from the scale varies between 0–52. High scores are associated with higher perceived stress [6,8]. The Cronbach’s alpha of the scale was .81 [6].

Scores between 1 and 5 were used in the scale’s European versions. The total score obtained in these versions is between 13–65 [7,10,20].

Generalized Anxiety Disorder Scale (GAD-7)

The GAD-7 is a tool developed by Spitzer et al. (2006) to measure anxiety levels. It inquires about symptoms in the past two weeks. Scale items are answered and scored according to a four-point Likert system (0 = almost never, …. 3 = almost every day). The score that can be obtained from the scale is between 0–21. The cutoff point of the scale was determined to be 10. A GAD-7 score of ≥10 indicates a high probability of generalized anxiety disorder. For total scores from the scale, ≥5–9, ≥10–14, and ≥15 are cutoff points for mild, moderate, and severe anxiety, respectively. The Cronbach’s alpha of the scale was .92 [24]. It was adapted into Turkish by Konkan et al., and Cronbach’s alpha level was calculated as .85 [25]. In our study, Cronbach’s alpha value on the scale was .90.

Procedures performed within the scope of adapting the scale to Turkish

Linguistic equivalence

The original questionnaire was translated by two native Turkish translators who can speak fluent English. As a result of the agreement between the translators, the first Turkish version of the PMSS (PMSS-TR) was obtained. Then, two native speakers with fluent Turkish skills were asked to translate the PMSS-TR back into English. The received English back translations were compared with the original scale by the authors, and inconsistencies in the first version of the PMSS-TR were corrected.

The obtained PMSS-TR was applied to 10 students as a pilot. Participants read the questions and verbally evaluated the intelligibility of the items. In line with the feedback received, no changes were required in the scale items. These students were not included in the study.

In terms of linguistic equivalence, the PMSS-English original scale (PMSS-EN) and PMSS-TR were applied crosswise to two groups (Group 1: PMSS-EN followed by PMSS-TR, Group 2: PMSS-TR followed by PMSS-EN) consisting of 35 medical students each (native speakers of Turkish and those studying in the English-instructed medical school program). The relationship between the total scores was examined. In addition, in both versions, free text comments were requested from the participants. In line with the students’ feedback, grammatical errors were also reviewed, and the PMSS-TR was given its final form. Afterwards, the PMSS-TR was presented to the expert committee consisting of a public health specialist, two medical education specialists and a psychiatrist. A standard evaluation form was used in the expert panel. In this form, there was an area where opinions were written for each item of the scale and a response section with three options: “appropriate”, “can be changed in line with suggestions”, and “must be revised”. The evaluations made by the experts independently from each other were reviewed, and the PMSS-TR was given its final form.

Statistical analyses

SPSS 22.0 (IBM, Armonk, NY, USA) and AMOS 24 (IBM) statistical package programs were used for the reliability and validity analyses of the scale. Descriptive statistics are presented as the mean ± standard deviation (SD) for ordinal data and as numbers and percentages for categorical data. Normality tests of ordinal variables and scale scores were performed using Z values calculated for graphing methods, Kolmogorov–Smirnov test, skewness, and kurtosis coefficients. The scores obtained from the PMSS-TR and GAD-7 scales are the mean ± SD. Confirmatory factor analysis (CFA) was used in the validity analysis. In addition, Cronbach’s alpha coefficient was calculated for reliability analysis, and intraclass correlation was checked in the test-retest. A P value of < .05 was considered significant.

Results

Characteristics of participants

A total of 612 volunteer preclinical medical students participated in the survey. The overall response rate was 56% (population = 1080). A total of 574 students’ data were analyzed, excluding 38 questionnaires that were not completed appropriately. The mean age of the participants was 20.9±2.2 years, and 292 were females (50.9%). The sociodemographic characteristics of the study group are presented in Table 1.

Table 1. Sociodemographic characteristics of the participants.

Study Year
Variables Term I Term II Term III
Age [Mean (±SD)] 21.0 (±2.3) 20.8 (±2.4) 21.0 (±1.8)
Sex [n (%)]
 Male 101 (51.3) 92 (47.9) 89 (48.1)
 Female 96 (48.7) 100 (52.1) 96 (51.9)
Income status [n (%)]
 Good 33 (16.8) 41 (21.4) 38 (20.5)
 Moderate 155 (78.7) 137 (71.4) 138 (74.6)
 Bad 9 (4.6) 14 (7.3) 9 (4.9)
Tobacco use [n (%)]
 Yes 27 (13.7) 33 (17.2) 22 (11.9)
 No 170 (86.3) 159 (82.8) 163 (88.1)
Exercise [n (%)]
 Yes 106 (53.8) 108 (56.3) 97 (52.4)
 No 91 (46.2) 84 (43.8) 88 (47.6)

The mean PMSS-TR score of the students was 39.80±8.09, and the GAD-7 score was 11.0±5.5. According to the GAD-7 scale, 28.2% of the students showed mild anxiety, 30.5% moderate, and 28.2% severe anxiety symptoms. There was no significant relationship between the PMSS-TR and GAD-7 scores of the participants and their age, sex, tobacco use, exercise, or income status (P>.05).

Linguistic equivalence

The original PMSS and PMSS-TR were applied crosswise and separately to two groups of 35 students who were fluent in both languages (trained in the English Medicine program). There was a highly significant correlation between total scores in the first group (PMSS-EN-PMSS-TR) and the second group (PMSS-TR-PMSS-EN) (r = .84, P < .001 and r = .81, P < .001, respectively).

Pilot application, ıtem fit ındices, and reliability

A pilot study was conducted with 52 students to determine the internal consistency coefficient, and item correlation fits. The Cronbach’s alpha for pilot data was .80. Although items 1, 2, and 11 appeared problematic according to item fit indices, they were not deleted because there was no significant change in Cronbach’s alpha value when removed.

The reliability analysis of the Turkish form was carried out on the data obtained from 574 students. Item total score correlations were between .31 and .56, and Cronbach’s alpha value was .81. A significant difference was found between the upper and lower 27% group scores for all scale items (P < .001). The fit indices of items 1, 2, and 11, which seemed problematic in the pilot administration, were also sufficient (Table 2).

Table 2. Item fit indices and cronbach alpha values calculated in the main administration.

Item number Item Total Correlation Cronbach’s Alpha if Item Deleted
1 .50 .80
2 .40 .81
3 .49 .80
4 .43 .81
5 .35 .81
6 .55 .80
7 .39 .81
8 .59 .80
9 .49 .80
10 .57 .80
11 .32 .82
12 .52 .80
13 .31 .82

A significant correlation was found between each item score and its dimension, as well as between dimensions and the total scale score (P < .001 for all). The results of the correlation analysis between the scale items’ subdimensions and the total score are given in Table 3.

Table 3. Correlation values between scale items, subdimensions, and the total score.

Psychological Stress and Environment Resilience and Expectations Total
Item 1 .60* .37* .59*
Item 2 .39* .79* .53*
Item 3 .47* .65* .56*
Item 4 .52* .34* .51*
Item 5 .30* .66* .44*
Item 6 .64* .44* .64*
Item 7 .54* .20* .49*
Item 8 .66* .39* .64*
Item 9 .59* .30* .56*
Item 10 .70* .34* .65*
Item 11 .42* .16* .38*
Item 12 .62* .31* .60*
Item 13 .34* .15* .46*
Psychological Stress and Environment .53* .95*
Resilience and Expectations .71*

* P<0.001.

The number of items, mean score and Cronbach’s alpha values for the subdimensions and the overall scale are given in Table 4.

Table 4. The number of items, mean scores, and Cronbach’s alpha values for subdimensions and overall PMSS-TR.

PMSS-TR Number of Items Mean±SD Cronbach’s Alfa
Psychological Stress and Environment 9 1.95±0.02 .78
Resilience and Expectations 3 2.46±0.16 .53
Overall 13 2.06±0.05 .81

Construct validity

Confirmatory factor analysis (CFA) was performed to confirm the original structure of the scale. Meanwhile, item 13 was excluded, as suggested by the developers of the scale, and confirmatory factor analysis was conducted based on the two-factor structure [6]. The fit indices of the model obtained were at an acceptable level after the modifications applied between error variances (CMIN/DF = 1.51. p < .001, RMSEA = .04, CFI = .97, GFI = .97). In confirmatory factor analysis, the two-factor structure of the original scale was confirmed (Fig 1). Acceptable values for model fit indices and values obtained from the model are shown in Table 5.

Fig 1. Confirmatory factor analysis path diagram.

Fig 1

Table 5. Acceptable limits of model fit indices and values obtained from the model.

Fit Index Good fit Acceptable fit PMSS-TR Assessment of fit
CMIN/DF 0 ≤ CMIN/DF ≤ 2 2 ≤ CMIN/DF ≤ 3 1.51 Good
AGFI .90 ≤ AGFI ≤ 1.00 .85 ≤ AGFI ≤ .90 .95 Good
GFI .95 ≤ GFI ≤ 1.00 .90 ≤ GFI ≤ .95 .97 Good
NFI .95 ≤ NFI ≤ 1.00 .90 ≤ NFI ≤ .95 .91 Acceptable
CFI .95 ≤ CFI ≤ 1.00 .90 ≤ CFI ≤ .95 .97 Good
IFI .95 ≤ IFI ≤ 1.00 .90 ≤ IFI ≤ .95 .97 Good
RMSEA .00 ≤ RMSEA ≤ .05 .05 ≤ RMSEA ≤ .08 .04 Good
SRMR .00 ≤ SRMR ≤ .05 .05 ≤ SRMR ≤ .10 .05 Acceptable

χ2(48) = 72.567, P = .013.

AGFI: Adjusted Goodness-of-Fit Index; CFI: Comparative Fit Index; CMIN/df: Chi-Square/Degree of Freedom; GFI: Goodness-of-Fit Index; IFI: Incremental Fit Index; NFI: Normed Fit Index; RMSEA: Root Mean Square Error of Approximation; SRMR: Standardized Root Mean Square Residual.

Convergent validity

The GAD-7 scale was used for convergent validity. Evidence for convergent validity was sought by evaluating the relationship between students’ scores on the PMSS-TR and GAD-7 scales and whether the scores differed significantly according to various sociodemographic characteristics (sex, tobacco use, income status, and exercise). There was a positive and significant relationship between the scales’ total scores (r = .48, P < .001). However, there was no significant relationship between PMSS-TR and GAD-7 scores and age, sex, income status, tobacco use, or exercise characteristics (P>.05).

The scale was administered to a separate group of 70 students 15 days later for test-retest reliability. Intraclass correlation coefficient (ICC) scores ranged from .68 to .88 (Table 6).

Table 6. Intraclass correlation coefficients, item and scale score descriptors in test-retest application.

Scale dimensions Items r (95% CI) Mean (±SD)
Test-Retest Reliability Test Retest
Psychological Stress and Environment 1 .80 (.68–.88) 2.0 (±1.2) 1.9 (±1.0)
4 .73 (.57–.83) 2.5 (±1.1) 2.3 (±1.0)
6 .68 (.48–.80) 2.1 (±1.2) 2.1 (±1.1)
7 .83 (.72–.89) 2.2 (±1.2) 2.0 (±1.1)
8 .80 (.65–.89) 2.3 (±1.0) 1.9 (±1.0)
9 .78 (.65–.86) 2.1 (±1.0) 2.1 (±1.0)
10 .86 (.78–.91) 1.6 (±1.1) 1.7 (±1.1)
11 .76 (.62–.85) 1.6 (±1.0) 1.8 (±1.0)
12 .79 (.65–.87) 1.0 (±1.0) 1.3 (±1.0)
Resilience and Expectations 2 .77 (.63–.86) 2.0 (±1.3) 2.1 (±1.2)
3 .78 (.65–.87) 2.2 (±1.2) 2.0 (±1.0)
5 .83 (.73–.90) 3.1 (±1.1) 2.9 (±1.1)
13 .88 (.80–.92) 1.7 (±1.4) 1.8 (±1.3)
Total .92 (.87–.95) 24.6 (±7.5) 24.2 (±7.2)

r: Intraclass correlation coefficient, CI: Confidence interval, SD: Standard deviation.

Discussion

Our study examined the Turkish validity and reliability of the PMSS Scale. This scale, developed by Vitaliano et al., is a scale for determining the stress specific to medical school and was defined by the authors as a valid and reliable tool. This study showed that the Turkish version of the PMMS scale is an accurate and reliable tool that can be applied to determine perceived medical school-specific stress in Turkish medical students. No original Turkish tool is used to assess medical students’ medical school-specific stress. To the best of our knowledge, this is the first study to evaluate medical school-specific stress perceived by medical students in Türkiye.

In the adaptation of the scale, the International Association for Pharmacoeconomics and Outcomes Research guidelines were followed, and the "Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measure" were applied [28]. In cultural adaptation, it is recommended to pay attention to semantic equivalence and cultural differences instead of the literal translation of scale items [18]. While translating the PMSS scale into Turkish, we considered these suggestions and attached importance to semantic equivalence. For example, since the word "medical school" in the original scale was used as "medical faculty" in Türkiye, its Turkish equivalent was written in this way. A similar approach was used in the German version of the scale [10]. In addition, while scale items were scored between 0–4 in the original scale, most European versions were scored 1–5 [7,10]. We also used the 1–5 scoring system to compare our study results with the European population.

Confirmatory factor analysis is used to determine the validity of measurement tools developed in other samples and cultures [26]. Confirmatory factor analysis was conducted to determine whether the Turkish representative confirmed the scale’s factor structure and construct validity. It was observed that each item of the scale contributed significantly to the formation of dimensions in the CFA model. In the current study, a correlation was established between the error variance values of the items in the CFA. For example, items 2 and 5 represent “working conditions and information overload”. The correlation of these items was found to be high, and corrections were made. Similarly, items 8 and 9, 9 and 10, and 11 and 12 generally represent the "attitude of the faculties"; the correlation between these items was also found to be high, and corrections were made. As a result, most of the items were combined under the same factors, similar to the original structure. The two-factor structure of the original scale was confirmed in the PMSS-TR, and it was decided to make the naming identical to the original scale. Nine items collected in the first dimension were associated with the "Psychological Stress and Environment" subdomain of the scale. In contrast, three under the second dimension were associated with the "Resilience and Expectations" dimension. Item 13 is finance-related and is not associated with either factor as in the original scale. Therefore, it is not included in one of the dimensions. However, as it was in the original scale, it was not removed from the scale because the students highly approved it.

A slightly modified version of the PMSS was used by Tyssen R et al. In this form of the scale, the original scale’s item about internships was changed, and an item about the accommodation was written instead. The internal consistency of the scale was .78 [7]. In the studies conducted in Norway, three dimensions were identified in the scale: 1) the medical school being cold and threatening, 2) concerns about work and competence, and 3) concerns about finance and housing [7,20]. Our study did not change the original scale’s items and obtained two dimensions as in the original scale. The difference in the studies mentioned above is the writing of an article about accommodation. In these studies, this item change may have affected the scale’s three-factor structure.

According to the results of the goodness-of-fit analysis of the first-level CFA model, the sample model is consistent and significant with the original structure of the scale (CMIN/DF = 1.51, RMSEA = .04, NFI = .91). In our study, the CFI value of the PMSS-TR was .97. The NFI showed an acceptable fit. In contrast, the CMIN-DF, GFI, CFI, and RMSEA showed excellent fits.

Item correlations and Cronbach’s alpha were evaluated for the internal consistency of the PMSS-TR. Item total score correlations were between .35 and .59, and Cronbach’s alpha value was .81. These results indicate a high level of reliability [27]. High reliability was also found in the adaptation studies of the scale to other languages [7,10].

In our study, Cronbach’s alpha values for the scale dimensions were .79 and .63 for the "Psychological stress and environment" and "Resilience and expectations" dimensions, respectively. There are three items in the "Resilience and expectations" dimension of the scale. This may have caused low Cronbach’s alpha values. In the current study, we found a significant correlation between each item and its dimension and between the dimensions and the scale’s total score. This finding supports that items and dimensions were marked consistently.

Test-retest reliability was significant for all scale items, and the temporal consistency of the scale was good. Since there was no significant change in Cronbach’s alpha value when the item was deleted, removing any item from the scale was unnecessary. In our study, item reliability was high for all scale items. There was a significant correlation between the score of each item and the dimension it is in, as well as the dimensions and the scale’s total score.

Our study found a significant positive relationship between the total scores of the PMSS-TR and GAD-7 scales. This finding indicated that both scales measure similar concepts. There was no significant relationship between the total scores of both scales and age, sex, tobacco use, exercise, or income status.

The average PMSS-TR score of the students participating in this study was 39.8±8.0, indicating a high perceived stress level. In a survey conducted by Afshar et al. [28] in Germany in which the German version of the PMSS was used, the stress scores of the students were 37.2±8.3 (18–65). This study reported that students had high-stress levels [28]. In a study conducted in Poland, the PMSS-PL score was 36.4±8.4 (13–65) [21]. In the study by Tyssen et al. in Norway, students’ stress scores were 30.7±7.6 [7]. Similarly, in a study conducted in Germany [10], students’ stress levels were higher than in Norwegian studies [7,29]. These results were attributed to the difference in working conditions and the fact that Norwegian doctors were more satisfied with their requirements. Our study’s scores were higher than the stress scores obtained in the German and European studies. We think that various factors, such as the education program’s structure, the curriculum’s density, measurement and evaluation systems, social opportunities, and physicians’ working conditions, may have contributed to our students’ higher perceived stress levels. Students’ financial situation and economic well-being may also have impacted the results. The factors that cause our students to perceive a high-stress level should be clarified with larger, multicenter, and prospective studies.

In the study of Tyssen et al., no difference was found between male and female students regarding general stress levels [7]. Likewise, our research showed no difference between the sexes regarding stress scores.

In this study, the validity and reliability of the Turkish version of the PMSS scale were assessed and found to be acceptable. The PMSS-TR is not a diagnostic tool but an easy-to-apply, practical screening tool that can be used to suspect students’ perceived medical school stress. In this respect, it is thought that it will contribute to researchers in Turkish-speaking countries.

Study limitations

Our study has several limitations. First, it is a methodologic study, and its sample consists of medical students studying at a State University in Türkiye. Therefore, the results cannot be generalized to medical students. Second, the data are based on students’ self-evaluations. Although the study population has similar demographic characteristics such as age and socioeconomic status, the 56% participation rate may have caused a selection bias. The strength of our study is that it provided a valid and reliable tool to investigate medical school-induced stress in medical students in Türkiye. It is the first study in Türkiye to evaluate medical students’ stress specific to medical school.

Conclusion

The PMSS-TR is a valid and reliable tool that can be used alone or in combination with other measurement tools to assess the medical school-related stress of medical students in Türkiye. The scale is a unique, easy-to-answer, practical tool to evaluate stress perceived by medical students in Turkish-speaking communities. It can be used to screen and monitor the stress situations of medical students in Türkiye and to evaluate preventive or mitigating interventions. Medical schools should be aware of the stress of their students caused by medical school. Including stress-reducing strategies in medical school curricula, receiving feedback from students, regular monitoring of students, and early detection of stress and its sources are important for preventive actions. Additionally, future studies should focus on prospective and large-scale research into developing preventive strategies and the effectiveness of interventions using the PMSS-TR.

Supporting information

S1 Dataset

(SAV)

S2 Dataset

(SAV)

Acknowledgments

We thank Professor Peter P. Vitaliano for his cooperation in validating the Perceived Medical School Stress Scale in Turkish medical students. We also thank the medical students who participated in the study.

Data Availability

All relevant data are within the paper and its Supporting information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.Dyrbye LN, Thomas MR, Shanafelt TD, editors. Medical student distress: causes, consequences, and proposed solutions. Mayo Clinic Proceedings; 2005: Elsevier. [DOI] [PubMed]
  • 2.Dyrbye LN, Thomas MR, Shanafelt TD. Systematic review of depression, anxiety, and other indicators of psychological distress among US and Canadian medical students. Academic medicine. 2006;81(4):354–73. [DOI] [PubMed] [Google Scholar]
  • 3.Hunt J, Eisenberg D. Mental health problems and help-seeking behavior among college students. Journal of Adolescent Health. 2010;46(1):3–10. doi: 10.1016/j.jadohealth.2009.08.008 [DOI] [PubMed] [Google Scholar]
  • 4.Cihan FG, Kutlu R, Medine MK. Occupational future concerns and stress management conditions of intern doctors. JAREM Journal of Academic Research in Medicine. 2017;7(3):122. [Google Scholar]
  • 5.Arslan MA, Dönmez L. Effect of Stress and Coping with Stress Capability on Burnout among Medical Students. Akdeniz Medical Journal. 2017; 3(3):149–57. [Google Scholar]
  • 6.Vitaliano PP, Russo J, Carr JE, Heerwagen JH. Medical school pressures and their relationship to anxiety. Journal of Nervous and Mental Disease. 1984. doi: 10.1097/00005053-198412000-00006 [DOI] [PubMed] [Google Scholar]
  • 7.Tyssen R, Vaglum P, Gronvold NT, Ekeberg O. Factors in medical school that predict postgraduate mental health problems in need of treatment. A nationwide and longitudinal study. Medical education. 2001;35(2):110–20. doi: 10.1046/j.1365-2923.2001.00770.x [DOI] [PubMed] [Google Scholar]
  • 8.Vitaliano PP, Maiuro RD, Mitchell E, Russo J. Perceived stress in medical school: resistors, persistors, adaptors and maladaptors. Social Science & Medicine. 1989;28(12):1321–9. doi: 10.1016/0277-9536(89)90351-1 [DOI] [PubMed] [Google Scholar]
  • 9.Rosal MC, Ockene IS, Ockene JK, Barrett SV, Ma Y, Hebert JR. A longitudinal study of students’ depression at one medical school. Academic Medicine: journal of the Association of American Medical Colleges. 1997;72(6):542–6. doi: 10.1097/00001888-199706000-00022 [DOI] [PubMed] [Google Scholar]
  • 10.Kötter T, Voltmer E. Measurement of specific medical school stress: translation of the “perceived medical school stress instrument” to the German language. GMS Zeitschrift für Medizinische Ausbildung. 2013;30(2). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Guthrie E, Black D, Shaw C, Hamilton J, Creed F, Tomenson B. Embarking upon a medical career: psychological morbidity in first year medical students. Medical education. 1995;29(5):337–41. doi: 10.1111/j.1365-2923.1995.tb00022.x [DOI] [PubMed] [Google Scholar]
  • 12.Mihailescu M, Neiterman E. A scoping review of the literature on the current mental health status of physicians and physicians-in-training in North America. BMC Public Health. 2019;19(1):1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Dyrbye LN, Harper W, Durning SJ, Moutier C, Thomas MR, Massie FS Jr, et al. Patterns of distress in US medical students. Medical Teacher. 2011;33(10):834–9. doi: 10.3109/0142159X.2010.531158 [DOI] [PubMed] [Google Scholar]
  • 14.Stewart SM, Lam T, Betson C, Wong C, Wong A. A prospective analysis of stress and academic performance in the first two years of medical school. Medical Education. 1999. doi: 10.1046/j.1365-2923.1999.00294.x [DOI] [PubMed] [Google Scholar]
  • 15.Thomas MR, Dyrbye LN, Huntington JL, Lawson KL, Novotny PJ, Sloan JA, et al. How do distress and well-being relate to medical student empathy? A multicenter study. Journal of General Internal Medicine. 2007;22(2):177–83. doi: 10.1007/s11606-006-0039-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Akdemir M, Aktekin MR, Şenol YY, Sönmez Y, Baysal ÖD, Mamakli S, et al. Depression and Psychological Distress in Medical Students, A Prospective Study. Archives of Neuropsychiatry. 2022;59(2):116. doi: 10.29399/npa.27799 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Wallace JE, Lemaire JB, Ghali WA. Physician wellness: a missing quality indicator. The lancet. 2009;374(9702):1714–21. doi: 10.1016/S0140-6736(09)61424-0 [DOI] [PubMed] [Google Scholar]
  • 18.McKenna SP, Doward LC. The translation and cultural adaptation of patient-reported outcome measures. Value in health: the journal of the International Society for Pharmacoeconomics and Outcomes Research. 2005;8(2):89–91. doi: 10.1111/j.1524-4733.2005.08203.x [DOI] [PubMed] [Google Scholar]
  • 19.Tjia J, Givens JL, Shea JA. Factors associated with undertreatment of medical student depression. Journal of American college health. 2005;53(5):219–24. doi: 10.3200/JACH.53.5.219-224 [DOI] [PubMed] [Google Scholar]
  • 20.Bramness J, Fixdal T, Vaglum P. Effect of medical school stress on the mental health of medical students in early and late clinical curriculum. Acta Psychiatrica Scandinavica. 1991;84(4):340–5. doi: 10.1111/j.1600-0447.1991.tb03157.x [DOI] [PubMed] [Google Scholar]
  • 21.Marchewka W, Loster Z, Marchewka J, Olszewska-Turek K, Kopec G. Stress associated with undergraduate medical courses: A translation and validation of the Perceived Medical School Stress Instrument into Polish and its adaptation to the Polish environment. Folia Medica Cracoviensia. 2020;60(2). [PubMed] [Google Scholar]
  • 22.Dagtekin G, Emrah A, Kılınç A, Eyüboğlu M, Eyüboğlu D, Ünsal A, et al. Cigarette Smooking, Perceived Stres and Quality of Life by Gender Among Medical Students. Osmangazi Medical Journal. 2020;42(4):350–6. (in Turkish). [Google Scholar]
  • 23.Tavsancıl E. Measuring attitudes and data analysis with SPSS. Nobel Publishing, Ankara. 2002. (in Turkish). [Google Scholar]
  • 24.Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Archives of internal medicine. 2006;166(10):1092–7. doi: 10.1001/archinte.166.10.1092 [DOI] [PubMed] [Google Scholar]
  • 25.Konkan R, Şenormanci Ö, Güçlü O, Aydin E, Sungur MZ. Validity and Reliability Study for the Turkish Adaptation of the Generalized Anxiety Disorder-7 (GAD-7)Scale. Archives of Neuropsychiatry. 2013;50(1). (in Turkish). [Google Scholar]
  • 26.Yaslıoglu M. Factor analysis and validity in social sciences: Application of exploratory and confirmatory factor analyses. Istanbul University Journal of the School of Business. 2017;46:74–85. [Google Scholar]
  • 27.Büyüköztürk Ş, Kılıç-Çakmak E, Akgün Ö, Karadeniz Ş, Demirel F. Scientific research methods. Pegem A Publishing, Ankara, 2008. (in Turkish). [Google Scholar]
  • 28.Afshar K, Wiese B, Stiel S, Schneider N, Engel B. Perceived stress and study-related behavior and experience patterns of medical students: a cross-sectional study. BMC Medical Education. 2022;22(1):1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Holm M, Tyssen R, Stordal KI, Haver B. Self-development groups reduce medical school stress: a controlled intervention study. BMC Medical Education. 2010;10(1):1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Somayeh Delavari

14 Feb 2023

PONE-D-22-28252Measurement of medical faculty-specific stress: Validity and Reliability of the Turkish Version of the Perceived Medical School Stress (PMSS) Scale ​PLOS ONE

Dear Dr. Çınar Tanrıverdi,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Mar 31 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Somayeh Delavari, Ph.D.,

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. 

Additional Editor Comments (if provided):

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dear Aouthers:

thank you for conducting this valuable study. This study is about the one of important problems in teaching and learning of medical students. However, after reviewing the manuscript, I believe there are important issues which need to be addressed before the manuscript is ready for publication in PLOS ONE. My comments (both editorial and substantive) are found below:

1- The main work in this study is evaluating validity and reliability of PMSS that I think the first sentence in the topic “Measurement of medical faculty-specific stress” can be deleted.

2- In the topic, Please mention that in whose population you want evaluate validity and reliability of PMSS.

3- One of the stages of evaluating validity and reliability of scales is Qualitative Content Validity. (Face validity for checking difficulty, relevance and ambiguity, Content validity for checking grammar, wording, Item location and scaling). I do not see this stage in your research.

4- Test-retest reliability was performed in the pilot stage?

5- What is the means of “Test-retest reliability was significant for all items”? In the Test-retest reliability we expect that the significant change wasn’t happened after 15 days period and the most important thigs is the correlation coefficient of scales in two period.

6- I suggest that use ICC (Intra Class Correlation) to evaluation of correlation coefficient In the Test-retest reliability.

7- Please report the Chi-Squared P-Value indices.

8- I think your means of "Criterion validity" in the assessment of Construct validity are "Convergent Validity". Because in the Convergent Validity we use another scales that validated before to confirm construct validity of new scale.

9- Why the researchers didn’t use “Perceived Stress Scale” for Convergent Validity?

Good Luck

Reviewer #2: The authors did not add item 13 to one of the scale dimensions as in the original article of the scale. In the method section, they should explain this situation with reference to the original article.

Can ICC (intraclass correlation coeffience) result be presented in test-retest comparison for scale sub-dimensions and total score?

Cronbach's alpha values for the sub-dimensions should be presented in a table in the findings section (presented in the discussion section). Having 3 items in a dimension may cause a low alpha value. This result can be explained in this way in the discussion section of the article.

The presentation of the results of the pilot study in Table 2 causes confusion. The results of the pilot study should be omitted from table 2 and mentioned in the text only.

In the CFA analysis, a connection was established between the error variance values of the items. If such a correction is to be made in the model, the reason for this should be briefly explained in the discussion section. for example, "items represent 'too much course load' for the connection between 2 and 5, so the correlation between them was found to be high and correction was made". Otherwise, it appears that extra effort is spent in statistical analysis for the model's good fit value.

Reviewer #3: The general research question is a valid and the authors answers to it appropriately. However, there are some comments for improving the manuscript.

- The participation rate in this study is reported to be 65%, which can be a type of selection bias. Were those who participated in the study different from those who did not participate in terms of important variables such as (demographics, socioeconomic status, etc.) to assess the validity and reliability of a questionnaire, the selection of participants should be random for generalizability.

Reviewer #4: Thank you for giving me this opportunity to review the paper. The study design and sample size are acceptable and the paper is well-written by and large. I have a few comments:

1. Maximum number of both scales should be added to the abstract.

2. 'Medical Faculty' is not an appropriate key-word.

3. What is 'XXX' in line 94?

4. A " is missed in line 135.

5. Psychometric properties of the original version should be added.

6. The manuscript needs exact proof reading for any typo like '(24]'.

7. What is definition of 'Income status'?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

Reviewer #4: Yes: Mohammadreza Shalbafan

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Aug 11;18(8):e0288769. doi: 10.1371/journal.pone.0288769.r002

Author response to Decision Letter 0


23 Feb 2023

Dear Reviewer,

We would like to thank you for your insightful comments and suggestions. We made all possible changes that were suggested and detailed the changes in the table below. Prior to responding to your comments, we want to inform you that all the revisions and improvements are highlighted red in the revised version of our manuscript. We sincerely appreciate your comments on our manuscript. We would like to thank you again for your valuable time and insight to strengthen our paper.

Yours truly,

Corresponding author on behalf of the authors.

Reviewer #1 Comment and Response Reviewer #1

1. The main work in this study is evaluating validity and reliability of PMSS that I think the first sentence in the topic “Measurement of medical faculty-specific stress” can be deleted.

We have removed “Measurement of medical faculty-specific stress” from the title.

2. In the topic, Please mention that in whose population you want evaluate validity and reliability of PMSS.

The title has been amended as follows: “Assessing the validity and reliability of the Perceived Medical School Stress Scale in Turkish medical students”.

3. One of the stages of evaluating validity and reliability of scales is Qualitative Content Validity. (Face validity for checking difficulty, relevance and ambiguity, Content validity for checking grammar, wording, Item location and scaling). I do not see this stage in your research.

Necessary explanations have been added to the Linguistic equivalence section.

(Afterwards, PMSS-TR was presented to the expert committee consisting of a public health specialist, two medical education specialists and a psychiatrist. A standard evaluation form was used in the expert panel. In this form, there was an area where opinions were written for each item of the scale and a response section with three options as “appropriate”, “can be changed in line with suggestions” and “must be revised”. The evaluations made by the experts independently from each other were reviewed and PMSS-TR was given its final form.)

4. Test-retest reliability was performed in the pilot stage?

Test-retest reliability was not performed in the pilot stage.

5. What is the means of “Test-retest reliability was significant for all items”? In the Test-retest reliability we expect that the significant change wasn’t happened after 15 days period and the most important thigs is the correlation coefficient of scales in two period.

An expression error has occurred in this field. What is meant to be expressed is that the relationships between consecutive applications are positive and significant for all items.

We have made the relevant corrections. This finding is presented in Table 2 by ICC analysis.

6. I suggest that use ICC (Intra Class Correlation) to evaluation of correlation coefficient In the Test-retest reliability.

ICC results were added to the study (Table 2).

7. Please report the Chi-Squared P Value indices.

We have added Chi-Squared and P Value. (Table 6)

8. I think your means of "Criterion validity" in the assessment of Construct validity are "Convergent Validity". Because in the Convergent Validity we use another scales that validated before to confirm construct validity of new scale.

Corrected as "Convergent Validity" throughout the article.

9.

Why the researchers didn’t use “Perceived Stress Scale” for Convergent Validity?

Although the “Perceived Stress Scale” measures perceived stress, it does not show stress specific to medical school.

Anxiety is identified as the main type of distress among medical students.

Developing the original scale, Vitalino et al., it has been reported in previous studies of medical school-induced stress that there is a significant correlation with anxiety. (Vitaliano PP, Russo J, Carr JE, Heerwagen JH. Medical school pressures and their relationship to anxiety. Journal of Nervous and Mental Disease. 1984- reference 6)

For convergent validity, we preferred to use the GAD-7, a widely used anxiety scale with proven validity and reliability in Turkey, in addition to the PMSS scale, since there is no instrument that measures stress specific to medical school and is adapted to Turkish.

GAD-7 scores showed significant correlation with PMSS scores.

However, we do not think that GAD-7 is the gold standard in ensuring convergent validity.

Reviewer #2 Comment and Response Reviewer #2

1. The authors did not add item 13 to one of the scale dimensions as in the original article of the scale. In the method section, they should explain this situation with reference to the original article.

In the method section, 132-134. specified in the line.

(The 13th item was added to the scale by the authors' majority approval because it was a primary concern of students (finance). However, this item was not included in either of the two subdimensions)

2. Can ICC (intraclass correlation coeffience) result be presented in test-retest comparison for scale sub-dimensions and total score?

The ICC (intraclass correlation coefficient) result in the test-retest comparison for the scale sub-dimensions and the total score is shown in Table 2.

3. Cronbach's alpha values for the sub-dimensions should be presented in a table in the findings section (presented in the discussion section).

Cronbach's alpha values for the sub-dimensions were presented in a Table in the findings section (Table 5 has been added).

4. Having 3 items in a dimension may cause a low alpha value. This result can be explained in this way in the discussion section of the article.

This result explained in this way in the discussion section of the article.

5. The presentation of the results of the pilot study in Table 2 causes confusion. The results of the pilot study should be omitted from table 2 and mentioned in the text only.

The results of the pilot study were deleted from Table 2 (named Table 3 after revision) and cited in the text only.

6. In the CFA analysis, a connection was established between the error variance values of the items.

If such a correction is to be made in the model, the reason for this should be briefly explained in the discussion section. for example, "items represent 'too much course load' for the connection between 2 and 5, so the correlation between them was found to be high and correction was made".

Otherwise, it appears that extra effort is spent in statistical analysis for the model's good fit value.

In the current study, a correlation was established between the error variance values of the items in the CFA analysis.

For example, 2 and 5 represent “working conditions and information overload”. The correlation of these items was found to be high and correction was made. Similarly, items 8 and 9, items 9 and 10, items 11 and 12 generally represent the "attitude of the faculties", the correlation between these items was also found to be high and correction was made.

Added to the discussion.

Reviewer #3 Comment and Response Reviewer #3

1.The participation rate in this study is reported to be 65%, which can be a type of selection bias.

Were those who participated in the study different from those who did not participate in terms of important variables such as (demographics, socioeconomic status, etc.) to assess the validity and reliability of a questionnaire, the selection of participants should be random for generalizability.

The study population has similar characteristics in terms of demographic characteristics such as age and socioeconomic status.

However, the 65% participation rate in the research may have caused a selection bias. The fact that the participants were not randomly selected in our study is one of the limitations of the study.

We have added this statement to the limitations.

Reviewer #4 Comment and Response Reviewer #4

1.Maximum number of both scales should be added to the abstract.

We have added more information about PMSS and GAD-7 to the abstract section.

2.'Medical Faculty' is not an appropriate key-word.

We have removed 'Medical Faculty' from keywords.

3.What is 'XXX' in line 94?

XXX was written for blinding. All changed to “Atatürk”.

4. A " is missed in line 135.

Corrected.

5. Psychometric properties of the original version should be added.

We have added psychometric properties and internal consistency of the original version.

6. The manuscript needs exact proof reading for any typo like '(24]'

The entire manuscript has been revised for mistypos, if any

7. What is definition of 'Income status'?

Students were asked about their own perceptions of their economic situation. They were asked to choose one of the definitions as good, medium or bad.

Attachment

Submitted filename: Reviewer # 4.docx

Decision Letter 1

Somayeh Delavari

30 Mar 2023

PONE-D-22-28252R1Assessing the validity and reliability of the Perceived Medical School Stress Scale in Turkish medical studentsPLOS ONE

Dear Dr. Çınar Tanrıverdi,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by May 14 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Somayeh Delavari, Ph.D.,

Academic Editor

PLOS ONE

Journal Requirements:

1. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

Reviewer #3: (No Response)

Reviewer #4: (No Response)

********** 

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: (No Response)

********** 

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: No

Reviewer #4: (No Response)

********** 

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: (No Response)

********** 

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: (No Response)

********** 

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Hello dear authors

Thank you for considering the comments in revised article.

Just for imprving manuscript I suggest that using "Evauation" instesd of "Assessing" in topic.

Table 2 are very confusing. unfortunatelly I couldnt understand what information have presented in this table (Test-re-test reliabilty or ICC).

If you didnt calculate Test-re-test reliabilty andICC for pilot Application, I suggest that seperate this section from pilot aplication section and present that after convergent validity. Absolutely we should analyse the reliability of quastionnaire after assuring of vlidity.

thank you

Reviewer #2: (No Response)

Reviewer #3: Dear authors

The most important point to evaluate the validity and reliability of the questionnaire is generalizability. Although the authors stated that the demographics and underlying information of the participants were similar, they had to show statistically that there was no difference between the respondents' responses and those who did not respond. This can reduce the selection bias to some extent.

My concern about the selection bias has not been addressed.

Reviewer #4: Thank you for revisions. My comments have been addressed appropriately. No further comment from my side.

********** 

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

Reviewer #4: Yes: Mohammadreza Shalbafan

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Aug 11;18(8):e0288769. doi: 10.1371/journal.pone.0288769.r004

Author response to Decision Letter 1


15 Jun 2023

Dear Reviewers,

We would like to thank you for your insightful comments and suggestions. We made all possible changes that were suggested and detailed the changes in the table below. Prior to response your comments, we want to inform you that all the revisions and improvements are highlighted red in the revised version of our manuscript. We sincerely appreciate your comments on our manuscript. We would like to thank you again for your valuable time and insight to strengthen our paper.

Yours truly,

Corresponding author on behalf of the authors.

Reviewer 1 Comment

1. I Thank you for considering the comments in revised article. Just for imprving manuscript I suggest that, using "Evauation" instesd of "Assessing" in topic.

We changed “assessing” as “evalaution” in the title as you recommend.

2. Table 2 are very confusing. unfortunatelly I couldnt understand what information have presented in this table (Test-re-test reliabilty or ICC).

Table 2 shows test-retest reliability.

We didn’t calculate test-retest reliability and ICC for pilot application.

For this reason, we seperated the ICC from pilot application section and it has been added to after convergent validity as you suggest.

Reviewer 3 Comment

1. The most important point to evaluate the validity and reliability of the questionnaire is generalizability. Although the authors stated that the demographics and underlying information of the participants were similar, they had to show statistically that there was no difference between the respondents' responses and those who did not respond. This can reduce the selection bias to some extent.

My concern about the selection bias has not been addressed.

Thank you for your feedback regarding my article and for highlighting your concern regarding the potential selection bias in evaluating the validity and reliability of the questionnaire. I apologize if my previous response did not adequately address your concern.

While I did mention that the demographics and underlying information of the participants were similar, I agree that it is important to statistically demonstrate that there were no significant differences between the respondents' responses and those who did not respond. Unfortunately, due to certain limitations, such as data availability, I was unable to perform a statistical comparison between respondents and non-respondents in this particular study. Furthermore we addressed this limitation in the article. Your critical input is invaluable in helping me recognize the gaps in my research and improve its quality. Thank you once again for your valuable feedback and for your interest in my research.

Attachment

Submitted filename: Respond to Reviewer 1.-revision 2 docx.docx

Decision Letter 2

Somayeh Delavari

4 Jul 2023

Evaluation the validity and reliability of the Perceived Medical School Stress Scale in Turkish medical students

PONE-D-22-28252R2

Dear Dr. Çınar Tanrıverdi,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Somayeh Delavari, Ph.D.,

Academic Editor

PLOS ONE

Acceptance letter

Somayeh Delavari

4 Aug 2023

PONE-D-22-28252R2

Evaluation the validity and reliability of the Perceived Medical School Stress Scale in Turkish medical students

Dear Dr. Çınar Tanrıverdi:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Somayeh Delavari

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Dataset

    (SAV)

    S2 Dataset

    (SAV)

    Attachment

    Submitted filename: Reviewer # 4.docx

    Attachment

    Submitted filename: Respond to Reviewer 1.-revision 2 docx.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES