Abstract
Background: Postpartum depression has a negative impact on quality of life. The aim of this study was to examine the factor structure and psychometric properties of the Slovak version of the Edinburgh Postnatal Depression Scale (EPDS). Methods: A paper and pencil version of the 10-item EPDS questionnaire was administered personally to 577 women at baseline during their stay in hospital on the second to fourth day postpartum (age, 30.6 ± 4.9 years; 73.5% vaginal births vs. 26.5% operative births; 59.4% primiparas). A total of 198 women participated in the online follow-up 6–8 weeks postpartum (questionnaire sent via e-mail). Results: The Slovak version of the EPDS had Cronbach’s coefficients of 0.84 and 0.88 at baseline (T1) and follow-up, respectively. The three-dimensional model of the scale offered good fit for both the baseline (χ2 (df = 28) = 1339.38, p < 0.001; CFI = 0.99, RMSEA = 0.02, and TLI = 0.99) and follow-up (χ2 (df = 45) = 908.06, p < 0.001, CFI = 0.93, RMSEA = 0.09, and TL = 0.90). A risk of major depression (EPDS score ≥ 13) was identified in 6.1% in T1 and 11.6% in the follow-up. Elevated levels of depression symptoms (EPDS score ≥ 10) were identified in 16.7% and 22.7% of the respondents at baseline and follow-up, respectively. Conclusions: The Slovak translation of the EPDS showed good consistency, convergent validity, and model characteristics. The routine use of EPDS can contribute to improving the quality of postnatal health care.
Keywords: Edinburgh Postnatal Depression Scale (EPDS), Slovakia, validity, postpartum depression
1. Introduction
Significant geographical and socio-demographical differences in the estimates of the prevalence of postpartum depression have been reported by several studies. In a systematic review by Shorey et al. [1], the average prevalence of depression was 17% among healthy mothers without a prior history of depression, with significant differences between geographical regions, with the Middle East having the highest prevalence (26%) and Europe having the lowest (8%). In a large-sample multinational study by Lupattelli et al. [2], significant differences in the prevalence of postpartum depression between European regions were found as well, with Eastern European countries having a significantly higher prevalence of postpartum depression. Similarly, differences in prevalence in high-income countries (9.5%) and low/middle-income countries (18.7%) were found in a systematic review by Woody et al. [3]; the overall pooled prevalence in this study was 11.9% among women during the perinatal period. The prevalence of depressive symptoms in a longitudinal ELSPAC study was 10–11% in a representative sample of postpartum women in the Czech Republic [4]. Only a few studies have estimated the postpartum depression occurrence in the Slovak Republic. A prevalence of 18% was reported in a small sample of Slovak postpartum women by Izakova [5]; similarly, 25% prevalence was reported by Banovcinova et al. [6].
In the etiopathogenesis of postnatal depression, genetic predisposition, together with anamnestic risk factors and the accumulation of psychosocial stressors, seems to play an important role. According to a systematic review by Hutchens and Kearney [7], the risk factors for postnatal depression are high life stress, lack of social support, current or past abuse, prenatal depression, marital or partner dissatisfaction, and prenatal depression. There is evidence that depressive symptoms that begin during the antenatal period tend to persist into the postnatal period. Up to one-third of women with postnatal depression have a diagnosis of depression or anxiety disorder in their medical history. Furthermore, as many as half of postpartum women with depression experienced depressive symptoms during pregnancy [8]. Depression or anxiety disorder in medical anamnesis prior to pregnancy is also a major risk factor for postpartum depression. However, a significant proportion of women experience depressive symptoms only during the postpartum period and have no increased risk of depression without a relationship to pregnancy or birth. A specific sensitivity of the mood-regulation system influencing pregnancy-related hormones might play a role in this case [9].
The association between the mode of delivery and postpartum depression remains unclear. Whereas some studies reported elevated levels of postpartum depressive symptoms amongst women who underwent operative birth or had perinatal factors such as significant blood loss or longer duration of stage II or III of labor [10]; other studies, including systematic reviews, found no significant association [11,12]. However, subjective perception of the birth experience and level of birth satisfaction might be more important risk factors of postpartum depression than the objective mode of delivery. Women’s negative perception of their birth experience, including factors such as lack of respect, privacy, support, inclusion in decision making, and feeling nurtured, may contribute to postnatal depression [12].
The Edinburgh Postnatal Depression Scale (EPDS) is a widely used measuring instrument for postpartum depression screening, providing a quick and simple administration and scoring system. The EPDS has been translated into over 60 languages and validated both as an antenatal and postpartum screen for minor or major depression in several countries [13]. High heterogeneity has been found regarding the sensitivity and specificity of the cut-off scores in different studies, possibly due to differences in study methodology, language, and diagnostic criteria used. Therefore, the validity of the EPDS as a screening instrument for postpartum depression may vary across different settings [14].
The EPDS was originally designed as a unidimensional measure. However, as shown in a comprehensive overview of the EPDS validation studies [15], most of the researchers confirmed the multidimensionality of the scale. In some studies, a two-factor structure has been found [16,17]; others have identified three factors of the EPDS: anxiety, anhedonia, and depression [18,19]. A theoretically driven four-factor model of the EPDS performed well in a Hungarian sample of postpartum women [20].
According to available information, the Slovak version of the EPDS has not yet been validated. The adaptation of the Slovak version of the Edinburgh Scale of Postnatal Depression and the examination of its psychometric properties and factor structure in a research sample of postpartum women in Slovakia were the main research aims in this study.
2. Materials and Methods
2.1. Data Collection and Sample
A longitudinal follow-up design was used in this study, with data collection at two time points: T1 (paper and pencil questionnaire completed 2–4 days after birth) and T2 (electronic data collection 6–8 weeks postpartum). A convenient sampling method was used in the process of the data collection.
T1 data, baseline: The inclusion criteria at T1 were 2–4 days postpartum and informed consent. The exclusion criteria in T1 point were actual perinatal loss or stillbirth (previous perinatal loss in the anamnesis was not an exclusion criterium) and a history of severe psychiatric disorder in the anamnesis (psychotic disorder). Data for the T1 point were collected in 2 hospital birth centers in Slovakia: Bratislava (located in the capital city) and Martin (located in the central part of the country). Both centers are large university hospital facilities providing complex perinatal care, including specialized perinatological care for high-risk pregnancies and pathological births. Each participant filled out a paper and pencil questionnaire during their second to fourth day postpartum hospital stay (4 days is the standard length of hospital stay after a physiological birth in Slovakia). Data were collected by midwives working in the birth center between September 2018 and April 2020. Each participant in T1 data collection was personally approached by a midwife and invited to participate in the research. A total of 577 postpartum women participated in T1 data collection; the response rate for T1 was 82.3%.
T2 data, follow-up: All women who participated in the T1 data collection received an e-mail 6–8 weeks postpartum with the invitation to participate in the follow-up and an electronic version of the questionnaire (the e-mail addresses were provided when signing the informed consent letter). Altogether, 198 women participated in the follow-up (response rate of 34.9%).
Most of the validation studies of the EPDS include women 6–8 weeks postpartum, or later. However, validation studies in Serbia, and Greece have also included women immediately after the birth [18,21]. Some of the authors [22,23,24] reported that the use of the EPDS in early postpartum is valid, and have argued that using the EPDS shortly after birth might have clinical value, especially in detecting the symptoms of anxiety or atypical depression, and in identifying women eligible for depression screening later during postpartum. Zanardo et al. [25] have found a strong association between high maternity blues scores and EPDS scores, and suggested that women who experienced strong symptoms of maternity blues may represent a distinct subgroup of postpartum women with a significantly increased risk of developing postpartum depression. Using the EPDS shortly after the birth also has significant practical advantages, as administering the questionnaire during the stay in the hospital allows approaching a larger proportion of postpartum women compared to online or telephone contact a few weeks of month postpartum.
Given the high attrition rate in T2 follow-up, differences between respondents and nonrespondents in the T2 follow-up were examined with chi-square statistics. The results of the nonresponse bias analysis showed significant differences regarding education (p ≤ 0.001) and type of birth (p ≤ 0.05). Among women who responded in the T2 follow-up, higher rates of participants with high education were found compared with the nonresponse group (68% vs. 53%). Women after physiological birth were also more likely to respond in T2 (79% in the response group compared with 72% in the nonresponse group). No significant differences between respondents and nonrespondents were found regarding age, parity, preterm birth, perinatal loss in anamnesis, complications in pregnancy, support person during birth, positive psychiatric anamnesis reported in T1, or positive depression symptoms (˂13 points in EPDS) in T1. Total EPDS scores in response and nonresponse groups were compared using Student independent samples t-test, and no significant differences were found (t = 1.90, p > 0.05).
2.2. Measuring Instruments
The Edinburgh Postnatal Depression Scale (EPDS) was used for both T1 and T2 of the data collection. The EPDS was developed by Cox et al. [26]. The EPDS is a 10-item self-rated questionnaire; each item asks about a common depressive symptom. Due to the specifics of the postpartum period, the EPDS does not contain items asking about somatic symptoms (as distinguishing somatic symptoms caused by physiological postpartum changes from those associated with depression is problematic). The scale also does not include items focused on assessing a mother–child relationship. Each EPDS item contains 4 response choices per statement (rated on a Likert scale). Items 3, 5, 6, 7, 8, 9, and 10 are reversely scored. The possible total score of the scale ranges from 0–30 points, with a higher score indicating a higher level of depression symptoms.
Different cut-off points of the EPDS have been used. According to the EPDS manual, second edition [15], a cut-off point of 10 or higher is recommended for research use, indicating elevated levels of depressive symptoms. For clinical use, a cut-off score of 12.5 has been shown to detect women at risk of major depression. As the EPDS is a screening measure, not a diagnostic tool, a woman who meets this threshold should be further assessed by a mental health professional for diagnosis.
Permission to use the EPDS for this study was obtained from the Royal College of Psychiatrists (U.K.). The back-translation process of the EPDS was performed with an additional assessment of the accuracy of the translation. Strong emphasis was placed on possible ambiguous questions and culturally sensitive items.
In a longitudinal follow-up (T2), the Zung self-rated depression scale was used along with the EPDS as a measure of the convergent validity of the EPDS. The Zung self-rated depression scale [27] is a self-reported 20-item scale measuring the symptoms of depression. The items’ responses are ranked from 1 to 4, with higher scores corresponding to elevated depressive symptoms. Ten positively worded items (2, 5, 11, 12, 14, 16, 17, 18, and 20) are scored reversely. The total score on the Zung depression scale indicates the level of depressive symptoms rather than a clinical diagnosis of major depression. The maximum total score is 80, and four categories can be identified based on the total score of the scale: 1, total score < 50 = no signs of depressive symptoms; 2, total score 50–60 = minimal signs of depression; 3, total score 60–69 = moderately to notably expressed signs of depression; and 4, total score > 70 = severe symptoms of depression. The Zung SDS is an established measure and in Slovakia, it is frequently used as a screening measure for depression. The Zung SDS has shown good psychometric properties and validity in the general population [28], in a population with depression [18], and in women of reproductive age [29].
At T1 baseline data collection, a sociodemographic and anamnestic questionnaire was used in the study together with the EPDS. The anamnestic questionnaire contained questions on basic sociodemographic variables (age and education) and perinatal data (type of birth, parity, support person during birth, preterm birth, perinatal loss in the anamnesis, and complications in pregnancy). Previous or actual onset of psychiatric disorders of the participants was measured by self-reported questions focused on a history of depression or other psychiatric illness before or during pregnancy.
2.3. Statistical Procedures
Statistical analysis was performed using IBM SPSS Statistics for Windows, version 25.0, and statistical software R, version 3.5.0 (2018). Student’s t-test for independent samples and ANOVA with Sheffe’s post hoc tests were used when testing differences in the mean EPDS sores in the different groups of respondents according to basic demographic and perinatal characteristics. For the analysis of the reliability of the EPDS, Cronbach’s α and the Spearman–Brown coefficient were employed. Chi-square tests were used for testing differences between respondents and nonrespondents in T2. The convergent validity of the EPDS was tested based on the correlation coefficients between the total EPDS score and the total Zung self-rated depression inventory score only in the T2 sample (6–8 weeks postpartum). Interclass correlation coefficients between the EPDS and Zung SDS were calculated as well; average measures value greater than 0.6 were considered acceptable.
Exploratory factor analysis (EFA) was employed to test the factor structure in both T1 and T2 samples. Multiple factor solutions (direct oblimin rotation) were run. Eigenvalues, scree plots, and the amount of variance explained were examined to determine the number of factors in each model. Factors with eigenvalues greater than one were retained, with a meaningful factor solution explaining at least 50% of the variance. An item loading significantly on a factor was determined by a loading of ≥0.3.
In the next step, confirmatory factor analysis (CFA) was performed in both the T1 and T2 samples with the goal of evaluating the EFA-based models’ fit to the data. The structural equation modeling (SEM) approach was employed to perform the CFA, using the statistical software R, version 3.5.0 [30], including the lavaan [31] and semPlot statistical packages [32]. A maximum likelihood (ML) approach to model estimation was adopted. Multiple goodness-of-fit tests were used to evaluate the models, including the chi-square statistic, comparative fit index (CFI), toot mean square error of approximation (RMSEA), and the Tucker–Lewis index (TLI). A CFI greater than 0.90 was employed as an indicator of an acceptable fit to the data, and a CFI equal to or greater than 0.95 indicated a good fit to the data. An RMSEA less than 0.08 was a threshold for an acceptable fit to the data; values of less than 0.05 indicated a good fit to the data. TLI values greater than 0.9 were considered the threshold for a good model fit [33,34].
2.4. Ethical Issues
All the participants were thoroughly informed about the project aims and ethical issues (anonymity, personal data protection, and voluntary participation). An informed consent letter was signed by each participant prior to their participation. Ethical approval was obtained from the Ethical committee of the Jessenius Faculty of Medicine in Martin, Slovakia, no. EK 36/2018.
3. Results
3.1. Distribution of the EPDS Scores
The basic demographic and anamnestic characteristics of the respondents who participated at both T1 and T2 are provided in Table 1, along with the mean EPDS scores in the different groups of participants. The T1 sample included 577 postpartum women with a mean age of 30.6 ± 4.9 years. Altogether, 375 (65%) participants were from Martin university hospital and 202 (35%) from Bratislava university hospital. Most of the respondents had higher education (57.9%), and 59.4% were primiparas. The majority of women in the research sample (73.5%) had a vaginal birth.
Table 1.
Variable | T1 Total Sample n = 584 | EPDS Score (SD) | p Value | T2 Total Sample n = 204 | EPDS Score (SD) | p-Value | |
---|---|---|---|---|---|---|---|
Age (years) | Mean (SD) Range | 30.6 (±4.9) 16–44 |
- | - | 30.9 (±4.8) 20–44 |
- | - |
Education | Primary Secondary Tertiary Missing |
13 (2.3%) 229 (39.7%) 334 (57.9%) 1 (0.2%) |
4.0 (±3.1) 5.1 (±4.2) 5.4 (±4.5) |
0.41 | 1 (0.5%) 62 (31.3%) 135 (68.2%) |
4.0 (-) 6.3 (±5.3) 6.2 (±4.8) |
0.90 |
Parity | Primipara Multipara Missing |
343 (59.4%) 229 (39.7%) 5 (0.9%) |
5.6 (±4.6) 4.7 (±3.8) |
0.05 | 115 (58.1%) 81 (40.9%) 2 (1%) |
6.4 (±4.9) 5.8 (±4.9) |
0.44 |
Preterm birth | Yes No Missing |
119 (20.6%) 457 (79.2%) 1 (0.2%) |
5.8 (±4.1) 5.1 (±4.4) |
0.14 | 40 (20.2%) 158 (79.8%) |
5.8 (±4.6) 6.3 (±5.0) |
0.50 |
Type of birth | Vaginal Operative |
424 (73.5%) 153 (26.5%) |
4.8 (±4.2) 6.5 (±4.4) |
0.001 | 157 (79.3%) 41 (20.7%) |
6.2 (±4.8) 6.5 (±4.5) |
0.68 |
Chronic health conditions in anamnesis | Yes No |
52 (9.0%) 522 (90.5%) 3 (0.5%) |
5.9 (±5.9) 5.2 (±4.2) |
0.27 | 19 (9.6%) 179 (90.4%) |
6.4 (±4.9) 6.2 (±5.0) |
0.88 |
Perinatal loss in anamnesis | Yes No Missing |
127 (22.0%) 448 (77.6%) 2 (0.3%) |
5.2 (±3.8) 5.3 (±4.5) |
0.85 | 41 (20.7%) 157 (79.3%) |
6.1 (±4.9) 6.2 (±4.7) |
0.90 |
Support person during labor |
Yes No Missing |
402 (69.7%) 174 (30.2%) 1 (0.2%) |
5.2 (±4.3) 5.3 (±4.6) |
0.86 | 145 (73.2%) 53 (26.8%) |
6.3 (±4.6) 6.0 (±5.8) |
0.77 |
History of psychiatric disorder | Yes No |
27 (4.7%) 550 (95.3%) |
8.8 (±6.1) 5.1 (±4.2) |
0.001 | 7 (3.5%) 191 (96.5%) |
11.3 (±4.6) 6.0 (±4.8) |
0.05 |
Risk of major depression | EPDS score ≥ 13 EPDS score ˂ 13 |
35 (6.1%) 542 (93.9%) |
- | - | 23 (11.6%) 175 (88.4%) |
- | - |
Elevated depressive symptoms | EPDS score ≥ 10 EPDS score ˂ 10 |
96 (16.7%) 481 (83.4%) |
- | - | 45 (22.7%) 153 (77.3%) |
- | - |
Zung self-rated depression scale | No signs of depression Minimal signs of depression Moderate signs of depression Severe signs of depression |
153 (77.3%) 35 (17.6% 10 (5.1%) - |
- | - |
There were 198 postpartum women participants at T2, with a mean age of 30.9 ± 4.8 years; most of them had higher education (68.2%). Altogether, 58.1% of women were primiparas, and 79% had a vaginal birth. More detailed information on the study participants at T1 and T2 is provided in Table 1. In the T1 sample, statistically significant differences in EPDS scores were found regarding parity (primiparas scored significantly higher in the EPDS than multiparas), type of birth (women after operative birth scored significantly higher in EPDS than women after spontaneous birth). In both T1 and T2 samples, significant differences regarding the history of psychiatric disorders were found: women with a history of psychiatric disorders scored significantly higher than those without a history of psychiatric illness).
The mean EPDS score T1 at (2–4 days postpartum) was 5.24 (SD = 4.35), and 6.21 (SD = 4.93) at T2 (6–8 weeks postpartum); the difference in the EPDS scores between samples was statistically significant (t = −2.61, p ≤ 0.009).
A risk of major depression (EPDS score ≥ 13) was identified in 6.1% of women at T1 and 11.6% women at T2. An elevated level of depression symptoms (EPDS score ≥ 10) was reported by 16.7% and 22.7% of the respondents at T1 and T2, respectively. According to the results of the Zung self-rated depression scale, 17.7% of women reported having mild signs of depression, and 5.1% as having moderate signs of depression (results only from T2 sample).
The mean EPDS score at T1 (2–4 days postpartum) was 5.24 (SD = 4.35), and 5.71 (SD = 4.42) at T2 (6–8 weeks postpartum); the difference in the EPDS scores between samples was not statistically significant (t = 1.288, p ≤ 0.19).
The risk of major depression (EPDS score ≥ 13) was identified in 6.1% of women at T1 and 8.4% women at T2. An elevated level of depression symptoms (EPDS score ≥ 10) was recorded in 16.7% and 19.5% of respondents at T1 and T2, respectively. According to the results of the Zung self-rated depression scale, 16.8% of women were identified as having mild signs of depression and 2.6%, as having moderate signs of depression (results only from the T2 sample).
3.2. Convergent Validity
The total score of the Slovak version of the EPDS was statistically significantly correlated with the Zung self-rated depression scale scores (Pearson’s r = 0.718, p ≤ 0.001) in the sample of 204 postpartum women (T2, 6–8 weeks postpartum). According to Cohen’s interpretation of Pearson correlation coefficients, this represents a strong correlation between variables. The interclass correlation coefficients calculation showed an average measure value of 0.798 (95% CI: 0.73, 0.85). These results showed that the construct validity of the Slovak version of the EPDS is satisfactory.
3.3. Reliability of the EPDS Scores
Table 2 shows the internal consistency of the individual as well as total EPDS scores. The EPDS showed good reliability (Cronbach’s α 0.84 at T1 and 0.88 at T2). The α coefficients for individual EPDS items were above 0.80, indicating good homogeneity. The Spearman–Brown coefficient was 0.80 at T1 and 0.87 at T2, indicating the good split-half reliability of the scale.
Table 2.
Item No. | EPDS Cronbach’s α without the Item at T1 | EPDS Cronbach’s α without the Item at T2 |
---|---|---|
1. I have been able to laugh and see the funny side of things | 0.83 | 0.87 |
2. I have looked forward with enjoyment to things | 0.83 | 0.87 |
3. I have blamed myself unnecessarily when things went wrong | 0.83 | 0.88 |
4. I have been anxious and worried for no good reason | 0.81 | 0.86 |
5. I have felt scared or panicky for no very good reason | 0.81 | 0.87 |
6. Things have been getting on top of me | 0.82 | 0.87 |
7. I have been so unhappy that I have had difficulty sleeping | 0.83 | 0.88 |
8. I have felt sad or miserable | 0.81 | 0.86 |
9. I have been so unhappy that I have been crying | 0.82 | 0.87 |
10. The thought of harming myself has occurred to me | 0.84 | 0.88 |
EPDS scale: Cronbach’s α | 0.84 | 0.88 |
EPDS scale: Spearman Brown coefficient | 0.80 | 0.87 |
3.4. Exploratory Factor Analysis (EFA) of the Data from the T1 Sample
The Kaiser–Meyer–Olkin measure of sampling adequacy for T1 data was 0.82, and the result of the Bartlett’s test of sphericity was significant (p-value < 0.001), which indicated that the collected data were suitable for factor analysis.
The results of the EFA revealed two components with eigenvalues greater than one: the first was 5.605, and represented a factor consisting of items 3–10; the second was 1.333 and contained items 1 and 2. However, there were items that loaded significantly on both factors: item 6 loaded almost similarly on factors 1 and 2, and item 8 loaded higher on factor 1 and lower but significantly on factor 2 (Table 3). The combination of the two factors explained 57.5% of the variance, and the correlation between factors was 0.43. the internal reliability of the first factor was 0.90, and 0.86 for the second factor.
Table 3.
Item No. | Two-Factor Solution | Three-Factor Solution | |||
---|---|---|---|---|---|
Factor 1 | Factor 2 | Factor 1 | Factor 2 | Factor 3 | |
Item 1 | 0.819 | 0.755 | |||
Item 2 | 0.974 | 0.923 | |||
Item 3 | 0.520 | 0.336 | |||
Item 4 | 0.333 | 0.570 | |||
Item 5 | 0.742 | 0.997 | |||
Item 6 | 0.420 | 0.420 | 0.341 | ||
Item 7 | 0.641 | 0.719 | |||
Item 8 | 0.616 | 0.363 | 0.840 | ||
Item 9 | 0.547 | 0.754 | |||
Item 10 | 0.975 | 0.574 | 0.473 |
The three-factor solution was suggested by parallel analysis. This solution contained a first factor (items 7–10); a second factor, which comprised items 1 and 2; and a third factor with items 3–5. Item 6 loaded significantly on both factors 1 and 2, with higher loading on factor 2. Item 10 loaded significantly on all three factors, with the highest loading on factor 1. The combination of the three factors explained 58.7% of the variance, and the correlation between factors varied from 0.30 to 0.64. the internal reliability of the first, second, and third factors was 0.87, 0.86, and 0.84, respectively.
3.5. EFA of the Data from the T2 Sample
The Kaiser–Meyer–Olkin measure of sampling adequacy for T2 was 0.82, and the p-value for Bartlett’s test of sphericity was less than 0.001.
The results of the EFA revealed only one component with an eigenvalue greater than one (eigenvalue = 6.52). The factor loadings for each item ranged from 0.66 to 0.88 (Table 4), and this single factor explained 61.6% of the variance. Cronbach’s α of the factor was 0.94.
Table 4.
Item No. | One-Factor Solution | Two-Factor Solution | Three-Factor Solution | |||
---|---|---|---|---|---|---|
Factor 1 | Factor 1 | Factor 2 | Factor 1 | Factor 2 | Factor 3 | |
Item 1 | 0.888 | 0.742 | 0.453 | 0.372 | ||
Item 2 | 0.826 | 0.732 | 0.901 | |||
Item 3 | 0.667 | 0.364 | 0.368 | 0.333 | ||
Item 4 | 0.832 | 0.720 | 0.634 | |||
Item 5 | 0.690 | 0.907 | 0.936 | |||
Item 6 | 0.793 | 0.439 | 0.431 | 0.584 | 0.369 | |
Item 7 | 0.662 | 0.626 | 0.801 | |||
Item 8 | 0.832 | 0.799 | 0.432 | 0.440 | ||
Item 9 | 0.826 | 1.017 | 0.827 | |||
Item 10 | 0.796 | 0.733 | 0.752 |
The two-factor solution was suggested by parallel analysis. This solution contained a first factor (items 1–2, 6, and 7–10) and a second factor that comprised items 3–5. Items 3 and 6 loaded significantly on both factors 1 and 2. The combination of the two factors explained 58.4% of the variance, and the correlation between factors was 0.76. The internal reliability of the first and second factors was 0.93 and 0.87, respectively.
The three-factor solution for the T2 data was examined as well. This solution contained a first factor (items 1 and 7–10); a second factor, which comprised items 2 and 6; and a third factor containing items 3–5. Item 1 loaded significantly on both factors 1 and 2, with a higher loading on factor 1, and item 6 loaded significantly on the second and third factors, with a higher loading on factor 2. Item 8 also loaded significantly on factors 1 and 2, with a slightly higher loading on factor 1 (Table 4). The combination of the three factors explained 56.1% of the variance, and the correlation between factors was 0.95–0.97. This three-factor model differs from the three-factor model identified by EFA using T1 data in one feature: in the T2 EFA model, item 1 loaded significantly on the first factor together with items 7–10; in the T1 EFA model, item 1 loaded on the second factor together with items 2 and 6.
3.6. Confirmatory Factor Analysis (CFA)
The first step in the CFA was the evaluation of the two multidimensional structural models (two-factor and three-factor solutions) as well as the unidimensional model on data from the T1 baseline sample. As shown in Figure 1, the structure of the three-factor model of the Slovak version of the EPDS was found to have a good fit with the baseline data (χ2(df = 32) = 159.84, p < 0.001; CFI = 0.94, RMSEA = 0.08, and TLI = 0.91). The two-factor solution was found to poorly fit the baseline data; the CFA and RMSEA values did not meet the threshold for an acceptable fit to the data (χ2(df = 45) = 1982.96, p < 0.001; CFI = 0.87, RMSEA = 0.114, TLI = 0.82). Similar results were found for the unidimensional model of the EPDS (χ2(df = 45) = 1982.78, p < 0.001; CFI = 0.80, RMSEA = 0.138, TLI = 0.74).
As the second step in CFA, both multidimensional structural models (two-factor and three-factor solutions) and the unidimensional model on data from the T2 sample were evaluated. A single-factor model of the Slovak version of the EPDS was found to poorly fit the data (χ2(df = 45) = 908.06, p < 0.001, CFI = 0.88, RMSEA = 0.12, TLI = 0.84). The two-factor model showed an acceptable fit to the T2 data (χ2(df = 45) = 908.06, p < 0.001, CFI = 0.93, RMSEA = 0.09 and TLI = 0.90), as did the three-factor EPDs model (χ2(df = 45) = 908.06, p < 0.001, CFI = 0.93, RMSEA = 0.09 and TLI = 0.90).
An additional confirmatory factor analysis of the T2 data was performed as well using the three-factor model identified on T1 data. This step of the CFA revealed similar results: an acceptable fit of this model to the T2 data (χ2(df = 45) = 908.05, p < 0.001, CFI = 0.94, RMSEA = 0.09, and TL =0.91) (Figure 2).
4. Discussion
To the best of our knowledge, this is the first study examining the factor structure and psychometric properties of the Edinburgh Postnatal Depression Scale in Slovakia. The Slovak translation of the EPDS showed good consistency, convergent validity, and acceptable model characteristics among postpartum women. The three-factor model best fit the Slovak data for both the baseline data (2–4 days postpartum) and the follow-up data (6 weeks postpartum). The three dimensions identified by factor analysis in our study might be seen as representing three factors: (1) depression (items 7–10 with/without item 1), (2) anxiety (items 3, 4, and 5), and (3) anhedonia (items 2 and 6, with/without item 1). Despite the authors of the EPDS presuming its single-dimensional character [26], many studies have reported the multidimensional nature of the EPDS, as shown in a study by Kozinszkyi et al. [20]. Our study findings agree with previous validation studies of the EPDS and confirm the multidimensionality of the scale. The three-factor model in the present study is similar to those found by Coates et al. [19] on a large representative U.K. sample and Odalovic et al. [18] on a smaller Serbian sample. The two-factor model was identified as an alternative model with an acceptable fit for the follow-up data (6 weeks postpartum) in our sample: (1) items 1, 2, and 7–10; (2) items 3, 4, and 5. This two-factor model is identical to the two-factor model proposed by Gollan et al. [17] in a study on a large representative USA sample. However, the two-factor model performed unsatisfactorily for our T1 data, which led us to the conclusion that the three-factor model best fit the Slovak data.
Both exploratory and confirmatory factor analysis revealed differences in the models for the T1 and T2 samples in our study. A possible explanation for these discrepancies might be the differences between the T1 and T2 samples in our study. The high attrition rate in the T2 sample, which resulted in a low number of participants at T2, might have contributed to the differences in the results of the EPDS factor analysis of the T1 and T2 samples. Another factor potentially influencing the different results of EFA and CFA in the T2 sample is the nonresponse bias according to lower education and operative birth in our sample. Moreover, the validity of using the EPDS shortly after birth might be problematic. Although the use of the EPDS early postpartum was found to be valid by some studies [24], a critical point against the EPDS validity 1–2 weeks postpartum was recently raised [35]. Petrozzi et al. [22] argued that symptoms measured by the EPDS in a short time postpartum are symptoms of anxiety rather than depressive symptoms, and they propose more focus on differentiating the EPDS anxiety and depression subscales. Dennis et al. [24] showed that the 1-week EPDS accurately classified approximately half of women at 16 weeks postpartum with elevated EPDS scores. Thus, it seems that using the EPDS shortly after the birth needs to reflect the heterogeneity in the EPDS results at different time points, and the relevance of using the EPDS in early postpartum needs to be examined closer.
In our sample, the risk of major depression (EPDS score higher than or equal to 13 points) was identified among 6.1% of women at T1 and 11.6% at the 6–8 weeks follow-up. When using the EPDS cut-off point of 10 points or higher, the prevalence of depressive symptoms was 16.7% at T1 and 22.7% at T2. Lupattelli et al. [2] reported a 30% prevalence of mild to moderate depressive symptoms (EPDS scores 10–16), and a 5–6% prevalence of moderate to severe symptoms (EPDS scores > 17) in Eastern European countries, which is higher than in our study. Similarly, higher prevalence compared with our study (24.8%) was found among Serbian postpartum women using the 13-point criterion [18]. One of the possible reasons for this might be that data were collected over a longer timespan after birth (1 year) in both of these studies. However, depressive syndrome prevalence in our study was similar to the findings of an ELSPAC study in a large representative sample of Czech women 6 weeks postpartum, where the prevalence of 21.9% was found (using the 10-point criterion), and 11.8% when the stricter cut-off point was used [4]. Similar to our study, 10,1% prevalence of 6–8 weeks postpartum was found in a study by Coates et al. [19] in a large UK sample; and 10.8% prevalence of 3–24 weeks postpartum was found by Nagy et al. [36] in Hungarian sample. In both studies, a 13-point cut-off of the EPDS criterion was used. In a review by Lyubenova et al. [37], the pooled prevalence of postpartum depression ranged from 27.8% when a cut-off of nine points was used to 9.0% when a 14-points cut-off was employed. Comparison of depressive symptoms prevalence across different studies is complicated using different cut-off points and data collection time spans; however, it seems that the prevalence of depressive symptoms found in our study is similar to that of other studies, and depressive symptoms occurrence might have an increasing tendency with time during the postpartum period. The prevalence of depressive symptoms among postpartum women across research studies highlights the importance of the detection of depression as a part of postpartum screening programs. According to Cox [38], in some countries, the EPDS is included in the national screening programs for perinatal women (for instance, in the USA, Sweden, and Australia), and in the U.K., its use is recommended).
Some of the methodological limitations of this study need to be mentioned. When comparing our sample with birthing women in Slovakia based on national statistical reports [39], some of the sociodemographic and perinatal characteristics in our sample differed significantly from the population of Slovak women giving birth. The respondents in our sample were more often highly educated (58.2%) compared with the population of birthing women in Slovakia (34.7%) and more often primiparas (59.9% vs. 45.9% in the whole population). The type of birth in our sample was vaginal in 73.8%, whereas it was 67.8% in the whole population of women giving birth in Slovakia. These differences influence the possibility of generalizing our results to the whole population of Slovak women. The second limitation of the study is the high attrition rate at T2, which may have occurred due to the differences in the data collection process: women were approached personally during baseline T1 data collection, which contributed to the higher response rate compared with online data collection via e-mail for the T2 follow-up. The analysis of response bias showed that women with lower education and after operative birth were less likely to respond at T2. As both these characteristics might be seen as risk factors for developing postpartum depression, these differences might have influenced the results of our analysis. Using the Zung depression scale in the process of validation is also a possible methodological limitation of our study, as well as convergent validity only being assessed for the T2 sample. Although the Zung SDS has been established as a widely used screening measure and has been validated in the general population [28], a population with depression [40], and women of reproductive age [29], the appropriateness of its use among perinatal women has not been sufficiently explored. No history of depression diagnosis (other than one self-report question) is also a methodological weakness in our research. Another limitation in our study is that we did not analyze the possible impact of ethnicity on our results. The largest ethnic minority in Slovakia, Roma, accounts for approximately 8–9% of the population. A significant proportion of this ethnic minority lives in socially excluded communities with severely disadvantaged socioeconomic conditions, which can significantly impact postpartum depression prevalence in this group. Finally, we have considered only cut-off values validated in different countries in our study, and we did not establish the exact cut-off values appropriate and sensitive for use in the Slovak population, as we did not consider a formal diagnosis of postnatal depression in our research. This issue needs to be addressed in future studies, which should focus on establishing the cut-off scores sensitive to the characteristics of the Slovak population of postpartum women, using, for instance, ROC curves.
5. Conclusions
The Slovak translation of the EPDS showed good consistency, convergent validity, and good model characteristics in a sample of postpartum Slovak women. Postpartum depression remains undiagnosed and untreated in a high percentage of cases in Slovakia. Multidisciplinary cooperation of experts, particularly in the fields of psychiatry, clinical psychology, gynecology, and midwifery, is required to improve postpartum depression screening and treatment. Routine screening for postpartum depression may significantly help to identify women with an increased risk of developing depression, thereby contributing to improving disease prevention and effective treatment. The administration and scoring of the Edinburgh Postnatal Depression Scale are quick and simple, and its use in routine screening programs in postpartum care may contribute to improved quality of health care with increased emphasis on mental health in Slovakia. Further studies should focus on establishing the sensitivity and specificity of the Slovak version of the EPDS on a larger and more representative sample using a psychiatric diagnostics interview as the acknowledged standard in the EPDS validation.
Author Contributions
Conceptualization, Z.Š., Ľ.B., E.U., and M.B.; methodology, Z.Š. and Ľ.B.; software, M.G.; validation, Z.Š.; formal analysis, M.G.; investigation, E.U.; resources, M.B.; data curation, Z.Š. and Ľ.B.; writing—original draft preparation, Z.Š.; writing—review and editing, Z.Š. and M.B.; visualization, M.G.; supervision, M.B.; project administration, Z.Š. and Ľ.B.; funding acquisition, Z.Š. All authors have read and agreed to the published version of the manuscript.
Funding
This work was financially supported by the VEGA (research grant agency of the Ministry of Education, Science, Research and Sport of the Slovak Republic) under contract no. VEGA-1/0211/19.
Institutional Review Board Statement
The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of Jessenius Faculty of Medicine in Martin, Slovakia, no. EK 36/2018.
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
The data presented in this study are available on request from the corresponding author. The data are not publicly available due to ethical and privacy restrictions.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Shorey S., Chee C.Y.I., Ng E.D., Chan Y.H., Tam W.W.S., Chong Y.S. Prevalence and incidence of postpartum depression among healthy mothers: A systematic review and meta-analysis. J. Psychiatr. Res. 2018;104:235–248. doi: 10.1016/j.jpsychires.2018.08.001. [DOI] [PubMed] [Google Scholar]
- 2.Lupattelli A., Twigg M.J., Zagorodnikova K., Moretti M.E., Drozd M., Panchaud A., Rieutord A., Juraski R.G., Odalovic M., Kennedy D., et al. Self-reported perinatal depressive symptoms and postnatal symptom severity after treatment with antidepressants in pregnancy: A cross-sectional study across 12 European countries using the Edinburgh Postnatal Depression Scale. Clin. Epidemiol. 2018;10:655–669. doi: 10.2147/CLEP.S156210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Woody C.A., Ferrari A.J., Siskind D.J., Whiteford H.A., Harris M.G. A systematic review and meta-regression of the prevalence and incidence of perinatal depression. J. Affect. Disord. 2017;219:86–92. doi: 10.1016/j.jad.2017.05.003. [DOI] [PubMed] [Google Scholar]
- 4.Fiala A., Švancara J., Klánová J., Kašpárek T. Sociodemographic and delivery risk factors for developing postpartum depression in a sample of 3233 mothers from the Czech ELSPAC study. BMC Psychiatry. 2017;17:104. doi: 10.1186/s12888-017-1261-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Izáková Ľ. Incidence of depressive symptoms in the postpartum period. Psychiatr. Praxi. 2013;14:26–29. [Google Scholar]
- 6.Banovcinova L., Skodova Z., Jakubcikova K. Predictors of increased depressive symptoms in the postpartum period. Kontakt. 2018;21:32–38. doi: 10.32725/kont.2018.003. [DOI] [Google Scholar]
- 7.Hutchens B.F., Kearney J.J. Risk Factors for Postpartum Depression: An Umbrella Review. J. Midwifery Womens Health. 2020;65:96–108. doi: 10.1111/jmwh.13067. [DOI] [PubMed] [Google Scholar]
- 8.Underwood L., Waldie K., D’Souza S., Peterson E.R., Morton S. A review of longitudinal studies on antenatal and postnatal depression. Arch. Women’s Ment. Health. 2016;19:711–720. doi: 10.1007/s00737-016-0629-1. [DOI] [PubMed] [Google Scholar]
- 9.Brummelte S., Galea L.A. Postpartum depression: Etiology, treatment and consequences for maternal care. Horm. Behav. 2016;77:153–166. doi: 10.1016/j.yhbeh.2015.08.008. [DOI] [PubMed] [Google Scholar]
- 10.Zaręba K., Banasiewicz J., Rozenek H., Wójtowicz S., Jakiel G. Peripartum Predictors of the Risk of Postpartum Depressive Disorder: Results of a Case-Control Study. Int. J. Environ. Res. Public Health. 2020;17:8726. doi: 10.3390/ijerph17238726. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Clout D., Brown R. Sociodemographic, pregnancy, obstetric, and postnatal predictors of postpartum stress, anxiety and depression in new mothers. J. Affect. Disord. 2015;188:60–67. doi: 10.1016/j.jad.2015.08.054. [DOI] [PubMed] [Google Scholar]
- 12.Bell A.F., Andersson E. The birth experience and women’s postnatal depression A systematic review. Midwifery. 2016;39:112–123. doi: 10.1016/j.midw.2016.04.014. [DOI] [PubMed] [Google Scholar]
- 13.Cox J. Use and misuse of the Edinburgh Postnatal Depression Scale (EPDS): A ten point ‘survival analysis’. Arch. Womens Ment. Health. 2017;20:789–790. doi: 10.1007/s00737-017-0789-7. [DOI] [PubMed] [Google Scholar]
- 14.Cox J.L., Holden J.M., Henshaw C. Perinatal Mental Health. The Edinburgh Postanatal Depression Scale (EPDS) Manual. 2nd ed. The Royal College of Psychiatrists; London, UK: 2014. [Google Scholar]
- 15.Gibson J., McKenzie-McHarg K., Shakespeare J., Price J., Gray R. A systematic review of studies validating the Edinburgh Postnatal Depression Scale in antepartum and postpartum women. Acta Psychiatr. Scandidavica. 2009;119:350–364. doi: 10.1111/j.1600-0447.2009.01363.x. [DOI] [PubMed] [Google Scholar]
- 16.Toreki A., Andó B., Dudas R.B., Dweik D., Janka Z., Kozinszky Z., Keresztúri A. Validation of the Edinburgh Postnatal Depression Scale as a screening tool for postpartum depression in a clinical sample in Hungary. Midwifery. 2014;30:911–918. doi: 10.1016/j.midw.2014.02.008. [DOI] [PubMed] [Google Scholar]
- 17.Gollan J.K., Wisniewski S.R., Luther J.F., Eng H.F., Dills J.L., Sit D., Ciolino J.D., Wisner K.L. Generating an efficient version of the Edinburgh Postnatal Depression Scale in an urban obstetrical population. J. Affect. Disord. 2017;15:615–620. doi: 10.1016/j.jad.2016.10.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Odalovic M., Tadic I., Lakic D., Nordeng H., Lupattelli A., Tasic L. Translation and factor analysis of structural models of Edinburgh Postnatal Depression Scale in Serbian pregnant and postpartum women—Web-based study. Women Birth. 2016;28:31–35. doi: 10.1016/j.wombi.2015.01.014. [DOI] [PubMed] [Google Scholar]
- 19.Coates R., Ayers S., de Visser R.O. Factor structure of the Edinburgh Postnatal Depression Scale in a population-based sample. Psychol. Assess. 2017;29:1016–1027. doi: 10.1037/pas0000397. [DOI] [PubMed] [Google Scholar]
- 20.Kozinszky Z., Töreki A., Hompoth E.A., Dudas R., Németh G. A more rational, theory-driven approach to analysing the factor structure of the Edinburgh Postnatal Depression Scale. Psychiatry Res. 2017;250:234–243. doi: 10.1016/j.psychres.2017.01.059. [DOI] [PubMed] [Google Scholar]
- 21.Vivilaki V.G., Dafermos V., Kogevinas M., Bitsios P., Lionis C. The Edinburgh Postnatal Depression Scale: Translation and validation for a Greek sample. BMC Public Health. 2009;9:329. doi: 10.1186/1471-2458-9-329. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Petrozzi A., Gagliardi L. Anxious and depressive components of Edinburgh Postnatal Depression Scale in maternal postpartum psychological problems. J. Perinat. Med. 2013;41:343–348. doi: 10.1515/jpm-2012-0258. [DOI] [PubMed] [Google Scholar]
- 23.Jardri R., Pelta J., Maron M., Thomas P., Delion P., Codaccioni X., Goudemand M. Predictive validation study of the Edinburgh Postnatal Depression Scale in the first week after delivery and risk analysis for postnatal depression. J. Affect. Disord. 2006;93:169–176. doi: 10.1016/j.jad.2006.03.009. [DOI] [PubMed] [Google Scholar]
- 24.Dennis C.L., Merry L., Stewart D., Gagnon A.J. Prevalence, continuation, and identification of postpartum depressive symptomatology among refugee, asylum-seeking, non-refugee immigrant, and Canadian-born women: Results from a prospective cohort study. Arch. Womens Ment. Health. 2016;19:959–967. doi: 10.1007/s00737-016-0633-5. [DOI] [PubMed] [Google Scholar]
- 25.Zanardo V., Volpe F., de Luca F., Giliberti L., Giustardi A., Parotto M., Straface G., Soldera G. Maternity blues: A risk factor for anhedonia, anxiety, and depression components of Edinburgh Postnatal Depression Scale. J. Matern.-Fetal Neonatal Med. 2019;33:3962–3968. doi: 10.1080/14767058.2019.1593363. [DOI] [PubMed] [Google Scholar]
- 26.Cox J.L., Holden J.M., Sagovsky R. Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. Br. J. Psychiatry. 1987;150:782–786. doi: 10.1192/bjp.150.6.782. [DOI] [PubMed] [Google Scholar]
- 27.Zung W., Durham N.C. A Self-Rating Depression Scale. Arch. Gen. Psychiatry. 1965;12:63–70. doi: 10.1001/archpsyc.1965.01720310065008. [DOI] [PubMed] [Google Scholar]
- 28.Ruiz-Grosso P., de Mola C.L., Vega-Dienstmaier J.M., Arevalo J.M., Chavez K., Vilela A., Lazo M., Huapaya J. Validation of the Spanish Center for Epidemiological StudiesDepression and Zung Self-Rating Depression Scales: A Comparative Validation Study. PLoS ONE. 2012;7:e45413. doi: 10.1371/journal.pone.0045413. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Sedighi S., Najarzadegan M., Ghasemzadeh H., Khodabandeh M., Khazaei M., Mirzadeh M., Babakhanian M., Rokni A., Ghazanfarpour M. Factor Structure and Psychometric Properties of Zung Self-Rating Depression Scale in Women with a Sick Child. Int. J. Pediatrics. 2020;8:11581–11586. [Google Scholar]
- 30.R Core Team . A Language and Environment for Statistical Computing. R Foundation for Statistical Computing; Vienna, Austria: 2018. [(accessed on 18 October 2020)]. Available online: https://www.R-project.org/ [Google Scholar]
- 31.Rosseel Y. Lavaan: An R Package for Structural Equation Modeling. J. Stat. Softw. 2012;48:1–36. doi: 10.18637/jss.v048.i02. [DOI] [Google Scholar]
- 32.Epskamp S., Stuber S. SemPlot: Path Diagrams and Visual Analysis of Various SEM Packages’ Output. R Package Version 1.1. [(accessed on 25 October 2020)];2017 Available online: https://CRAN.R-project.org/package=semPlot.
- 33.Kline R.B. Principles and Practice of Structural Equation Modeling. 3rd ed. Guilford Press; London, UK: 2011. [Google Scholar]
- 34.Brown T. Confirmatory Factor Analysis for Applied Research. 2nd ed. Guilford Press; New York, NY, USA: 2015. [Google Scholar]
- 35.Matthey S. Does an early postpartum Edinburgh Postnatal Depression Scale (EPDS) really detect the majority of women with elevated EPDS scores at 16-weeks postpartum? Arch. Womens Ment. Health. 2017;20:811–812. doi: 10.1007/s00737-017-0763-4. [DOI] [PubMed] [Google Scholar]
- 36.Nagy E., Molnar P., Pal A., Orvos H. Prevalence rates and socioeconomic characteristics of post-partum depression in Hungary. Psychiatry Res. 2011;185:113–120. doi: 10.1016/j.psychres.2010.05.005. [DOI] [PubMed] [Google Scholar]
- 37.Lyubenova A., Neupane D., Levis B., Wu Y., Sun Y., He C., Krishnan A., Bhandari P.M., Negeri Z., Imran M., et al. Depression prevalence based on the Edinburgh Postnatal Depression Scale compared to Structured Clinical Interview for DSM DIsorders classification: Systematic review and individual participant data meta-analysis. Int. J. Methods Psychiatry Res. 2020;30:e1860. doi: 10.1002/mpr.1860. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Cox J. Thirty years with the Edinburgh Postnatal Depression Scale: Voices from the past and recommendations for the future. Br. J. Psychiatry. 2019;214:127–129. doi: 10.1192/bjp.2018.245. [DOI] [PubMed] [Google Scholar]
- 39.NHIC-National Health Information Center Starostlivosť o Rodičku a Novorodenca v Slovenskej Republike 2018 (Mother-Infant Healthcare in Slovak Republic 2018) [(accessed on 10 November 2020)]; Available online: http://www.nczisk.sk/Statisticke_vystupy/Tematicke_statisticke_vystupy/Gynekologia_Porodnictvo_Potraty/Porodnictvo/Pages/default.aspx.
- 40.Romera I., Delgado-Cohen H., Perez T., Caballero L., Gilaberte I. Factor analysis of the Zung self-rating depression scale in a large sample of patients with major depressive disorder in primary care. BMC Psychiatry. 2008;8:4. doi: 10.1186/1471-244X-8-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data presented in this study are available on request from the corresponding author. The data are not publicly available due to ethical and privacy restrictions.