Abstract
Depressive symptoms and suicidal ideation are common internalizing problems during adolescence. Numerous studies have explored the role of certain demographic, social, and economic factors in their development in referred or non-referred adolescents, but not simultaneously in both groups. In this study, we examined the association between age, gender, parents’ educational level, and socioeconomic status (SES) and depressive symptoms and suicidal ideation in a referred group (n = 211) and a non-referred (n = 1401) group of adolescents. We also examined the moderating role that these factors play in the relationships between both internalizing problems. The results showed: higher levels of depressive symptoms and suicidal ideation in the referred group; an increase in both problems during early-to-middle adolescence in the non-referred group; an association between low SES and suicidal ideation in both groups; an association between low father’s education level and depressive symptoms in the non-referred group; and no gender differences in either of these two internalizing problems. The moderation analyses showed that age, in referred adolescents, and SES, in non-referred adolescents, moderated the relationship between depressive symptoms and suicidal ideation. This study contributes to the identification of groups of vulnerable adolescents that could constitute the target populations of preventive programs.
Keywords: demographic factors, social factors, economic factors, internalizing problems, depressive symptoms, suicidal ideation, adolescence
1. Introduction
Mental disorders constitute one of the greatest public health problems of our time. Several studies have shown that one out of four people in the world develop mental health problems at some point in their life [1]. Adolescence is a key period during which the incidence of externalizing and internalizing problems increases significantly [2,3,4].
The internalizing problems that most commonly occur during this developmental stage are depressive symptoms and suicidal ideation. Research has found a rapid increase in depressive symptoms and suicidal ideation from early to late adolescence [5,6], with their being occurrence greater in girls than boys [7,8,9]. In addition, depressive symptoms and suicidal ideation have been postulated to be the main predictors of adolescent suicide [10,11,12]. Thus, to identify the causes of these internalizing problems has become an international priority for suicide prevention among youths.
With the focus on the prevention and understanding of these problems, in this study, we explored the association between certain demographic, social, and economic factors and the manifestation of depressive symptoms and suicidal ideation in two populations: referred adolescents, namely outpatients using mental health facilities, and non-referred adolescents, namely community adolescents. Furthermore, we aimed to clarify the moderating role that certain demographic, social, and economic factors may play in the relationship between depressive symptoms and suicidal ideation.
1.1. Depressive Symptoms and Suicidal Ideation during Adolescence: Age and Gender Differences
Adolescence is a developmental stage during which individuals are particularly vulnerable to the development of mental health problems [13,14], particularly internalizing problems [15]. Most studies report that the levels of some internalizing problems, such as depressive symptoms and suicidal ideation, increase from early to late adolescence [5,6]. However, other studies have found that the levels of these problems remain stable during this period [16,17]. In early adulthood, the levels of these problems begin to decline for some individuals, while they become chronic for others.
Regarding gender differences, the available evidence also contains discrepancies. Many studies suggest that adolescent girls from referred and non-referred samples experience higher levels of depressive symptoms [18,19,20,21] and suicidal ideation [17,22] than boys. However, there are also studies that have not found gender differences in non-referred samples [23,24,25]. Likewise, other studies conducted simultaneously in referred and non-referred samples have found that levels of depressive symptoms were significantly higher in girls than in boys from the referred group, but that there were no gender differences in the non-referred group [26]. Although these results highlight the need to conduct studies that clarify gender differences based on the type of analyzed sample, few studies to date have simultaneously explored the existence of gender differences in samples of referred and non-referred adolescents.
The comorbidity and stability of depressive symptoms and suicidal ideation have also been studied along with gender differences. In recent decades, ample research with the adolescent population has documented a strong and stable correlation between depressive symptoms and suicidal ideation [27,28]. In addition, both of these internalizing problems can persist over time, affecting mental health during adulthood [1,29,30,31,32]. In fact, both depressive symptoms and suicidal ideation are well-established risk factors of suicide [10,11,12], which constitutes the second most frequent cause of death worldwide in individuals between 10 and 24 years old [33]. The high stability of these manifestations and their association with future health problems could explain the current interest of the scientific community in identifying the factors involved in their development during adolescence [34].
1.2. Social and Economic Factors of Depressive Symptoms and Suicidal Ideation
It has been shown that depressive symptoms and suicidal ideation are not determined by a single cause. These complex phenomena have multiple determinants [35,36] and are caused by a conjunction of biological, psychological, social, economic, and cultural factors [37,38].
Regarding social factors, research has focused on the contribution of socioeconomic status and parents’ educational level to depressive symptoms and suicidal ideation in adolescents. These studies indicate that adolescents who come from families with a low socioeconomic status are at a greater risk of developing depressive symptoms and suicidal ideation [39,40,41], both in girls and in boys [42]. Few studies, however, have analyzed the contribution of parents’ educational level as a factor distinct from socioeconomic status. This research, although limited, has found a negative association between parents’ educational level and the development of depressive symptoms [39] and suicidal ideation [36].
Therefore, despite the clear relationship between socioeconomic status and parents’ educational level, the available literature highlights the importance of independently studying the influence of parents’ educational level on the development of depressive symptoms and suicidal ideation in adolescents, in order to fill a gap in our knowledge that currently exists. Furthermore, most studies have focused on either a referred sample or a non-referred sample. Studies that use a combined design, in which both types of samples are integrated simultaneously, remain scarce. Thus, it seems necessary to know whether their contribution is similar or different in clinical and community adolescents. In addition, research should go one step further and analyze whether certain social and economic factors can modify the relationships that the scientific literature has shown to exist between depressive symptoms and suicidal ideation. To date, however, few studies have investigated the moderating role that such variables as adolescents’ age and gender, parents’ educational level, and family socioeconomic status play in the relationship between the two internalizing problems. These data may help us to identify vulnerable populations in order to develop intervention policies and programs for preventing or decreasing the manifestation of these two internalizing problems.
1.3. The Present Study
Considering the above-described background, the first objective of this study was to analyze the association between certain demographic (i.e., age and gender) and social and economic factors (i.e., mother’s education level, father’s education level, and family socioeconomic status) and depressive symptoms and suicidal ideation, in a mixed sample of referred and non-referred adolescents. Based on the existing literature, we expected to find higher levels of depressive symptoms and suicidal ideation in the group of referred adolescents, during middle and late adolescence, and among those adolescents—referred or non-referred—from families with a lower socioeconomic status and parental educational level. Regarding gender differences, we expected girls in the referred sample to exhibit higher levels of depressive symptoms and suicidal ideation than boys and that these differences, although smaller, would also be found in non-referred adolescents.
The second objective was to explore the moderating role that these demographic, social, and economic factors play in the relationship between depressive symptoms and suicidal ideation in both samples. Due to the lack of available evidence, no expectations were set for this second objective.
2. Materials and Methods
2.1. Participants and Procedure
This study used two groups of participants: a group of referred adolescents (n = 211) and a group of non-referred adolescents (n = 1401). The main demographic characteristics of the participants are summarized in Table 1.
Table 1.
Variables | Referred (n = 211) |
Non-Referred (n = 1401) |
---|---|---|
Gender, n (%) | ||
Female | 120 (56.9%) | 744 (53.1%) |
Male | 91 (43.1%) | 657 (46.9%) |
Age, mean (SD) | 14.44 (1.64) | 14.79 (1.54) |
Education Level, n (%) | ||
Compulsory Secondary Education | 171 (81%) | 1062 (75.8%) |
Post-Compulsory Education | 20 (9.5%) | 288 (20.6%) |
Vocational Training | 20 (9.5%) | 51 (3.6%) |
Family Structure, n (%) | ||
Two-parent families | 148 (70.1%) | 1156 (82.3%) |
Single-parent families | 36 (17.1%) | 134 (9.6%) |
Reconstituted families | 21 (10%) | 88 (6.3%) |
Lived with other relatives | 6 (2.8%) | 19 (1.4%) |
Institutionalized homes | - | 4 (0.4%) |
Referred adolescents were recruited from 12 Child and Adolescent Mental Health facilities of the public health system in the southern region of Spain according to a quota sampling procedure. The procedure had two stages. First, a total of 522 potential participants satisfying the selection criteria (aged between 12 and 17 years old, living with his/her family instead of residing in an institution, not enduring a psychotic episode or outbreak, and not being intellectually disabled) were identified. To represent the diverse range of youths who use mental health facilities, we divided the potential participants into 24 mutually exclusive subgroups based on their gender (boy or girl), age (12–14 or 15–17 years old), primary referral problem (externalizing, internalizing, or other problem), and parental educational attainment (basic education (primary school, secondary school and medium vocational training) or higher education (high-school degree, high vocational training, and university)). Each of the 24 subgroups (2 × gender, 2 × age, 3 × primary referral problem, and 2 × parental educational attainment) was assigned the same number of participants (n = 10). Second, researchers contacted 287 randomly chosen parents to obtain consent to the participation of youths in the study. Of the 24 subgroups, 7 had less than 10 eligible participants. The acceptance rate was high (75.96%).
Non-referred adolescents were recruited from 12 high schools located in the same areas as the Mental Health facilities. High schools were selected according to the size of the municipality (<30,000 or ≥30,000 inhabitants for small and larger municipalities, respectively), the annual average per capita income of the school area (<21,966 € for low-income areas and ≥21,966 € for higher-income areas), and the type of school (public or private).
Informed consent was obtained from adolescents and parents. Data on the referred sample were collected at the clinical facilities. Data on the non-referred sample were collected in the school setting during school hours. Participation was anonymous and voluntary. Trained researchers distributed the questionnaires and assisted the participants during data collection. This study was approved by the Biomedical Research Ethics Review Board of Andalusia (Spain).
2.2. Measures
2.2.1. Demographic, Social, and Economic Factors
An ad hoc questionnaire was used to record information about the main demographic and social characteristics of the participants, including age (12–13, 14–15, or 16–17), gender (boy or girl), and parents’ education level (no education, primary education, secondary education, or higher education).
To evaluate participants’ socioeconomic status (SES), we used the Family Affluence Scale II (FAS II) [43]. This is a brief measure of family wealth that includes four items regarding family holidays in the last 12 months, car ownership, bedroom occupancy, and home computers. The FAS II score, which ranged from 0 to 9, was computed by summing the responses to these four items. Following Currie et al. [44], this score was recoded into a three-point score for low (0–3), middle (4–6), and high (7–9) SES groups.
2.2.2. Depressive Symptoms
The anxious/depressed scale of the youth self-report (YSR) [45] was used to evaluate depressive symptoms. The YSR comprises 112 items that assess a range of adolescents’ emotional and behavioral problems. The scale applied in this study includes 13 items (e.g., “I feel worthless or inferior”) answered on a Likert scale ranging from 0 (not true) to 2 (very true or often true). Cronbach’s alpha was 0.86 for the referred sample and 0.78 for the non-referred sample.
2.2.3. Suicidal Ideation
Suicidal ideation was evaluated using the negative subscale of the positive and negative suicide ideation inventory (PANSI) [46,47]. This questionnaire is based on the assumption that certain factors increase the risk of suicidal behavior (e.g., negative thoughts), whereas other factors modulate or buffer against this behavior (e.g., positive thoughts). It is comprised of 14 items grouped into two subscales that evaluate the presence of protective factors and risk factors associated with suicidal thoughts during the past two weeks. Items were answered on a Likert scale ranging from 1 (none of the time) to 5 (most of the time). For the purpose of this study, we only considered the negative subscale of risk factors (8 items; e.g., “During the past two weeks, including today, how often have you thought that your problems were so overwhelming that suicide was seen as the only option for you?”). Cronbach’s alpha was 0.95 and 0.94 for the referred sample and the non-referred sample, respectively.
2.3. Data Analysis
Data analyses were performed using IBM SPSS Statistics (IBM Corp., Armonk, NY, USA) for MacOS, version 26. Little’s [48] missing completely at random (MCAR) test was not significant in both samples (χ²/df = 0.27, p > 0.05, for the referred sample; χ²/df = 2.67, p > 0.05, for the non-referred sample), suggesting that missing data were completely at random.
Most analyses were conducted separately for the referred and non-referred groups, since both samples were obtained through a quota sampling procedure that controlled for age, gender, parents’ educational level, and socioeconomic status to facilitate subgroups comparisons within each sample and to systematize the variations produced by the demographic, social, and economic factors of interest [49].
As preliminary analyses, we calculated correlations between the demographic, social, and economic factors and depressive symptoms and suicidal ideation.
Next, we carried out a multivariate analysis of variance (MANOVA) to determine the existence of differences in depressive symptoms and suicidal ideation between referred and non-referred samples. This analysis included mental health status (referred or non-referred) as a fixed factor and internalizing problems (i.e., depressive symptoms and suicidal ideation) as dependent variables.
Then, we conducted two factorial MANOVAs—one per mental health status group—in order to examine the effects of demographic, social, and economic factors on internalizing problems in both samples, including age range (12–13, 14–15, or 16–17), gender (boy or girl), mother’s education level (no education, primary education, secondary education, or higher education), father’s education level (no education, primary education, secondary education, or higher education), and socioeconomic status (low, medium, or high) as independent variables, and depressive symptoms and suicidal ideation as dependent variables. Complementary Bonferroni tests were carried out to evaluate multiple comparisons.
Finally, we conducted moderation analyses using the macro PROCESS 3.4 for SPSS Statistics. Five moderation models per sample were performed using depressive symptoms as an independent variable (X), suicidal ideation as a dependent variable (Y), and each demographic, social, or economic factor (i.e., age, gender, mother’s education level, father’s education level, and socioeconomic status) as a possible model moderator (W). Categorical moderators with more than two levels (i.e., age and SES) were coded as dummy variables ( and , respectively). All applications were based on 5000 bootstrap samples with a 95% confidence interval.
3. Results
3.1. Preliminary Analyses
Bivariate correlations for the study variables are displayed in Table 2. In both samples, mother’s education level, father’s education level, and socioeconomic status were significantly and positively correlated to each other, and socioeconomic status was negatively corelated to depressive symptoms and suicidal ideation. The correlation between depressive symptoms and suicidal ideation was strong and positive. In the referred sample, age correlated positively to depressive symptoms and suicidal ideation, and mother’s education level was negatively associated with suicidal ideation. In the non-referred sample, age and father’s education level were negatively related to suicidal ideation.
Table 2.
AGE | MEL | FEL | SES | DS | SI | |
---|---|---|---|---|---|---|
Referred sample (n = 211) | ||||||
Age | - | - | - | - | - | - |
Mother’s Education Level (MEL) | −0.10 | - | - | - | - | - |
Father’s Education Level (FEL) | −0.10 | 0.45 *** | - | - | - | - |
Socioeconomic Status (SES) | −0.07 | 0.21 ** | 0.23 ** | - | - | - |
Depressive Symptoms (DS) | 0.15 * | −0.10 | 0.02 | −0.17 * | - | - |
Suicidal Ideation (SI) | 0.15 * | −0.17 * | −0.14 | −0.17 * | 0.70 *** | - |
Non-referred sample (n = 1401) | ||||||
Age | - | - | - | - | - | - |
Mother’s Education Level (MEL) | −0.03 | - | - | - | - | - |
Father’s Education Level (FEL) | −0.04 | 0.58 *** | - | - | - | - |
Socioeconomic Status (SES) | −0.01 | 0.30 *** | 0.31 *** | - | - | - |
Depressive Symptoms (DS) | 0.02 | −0.01 | −0.03 | −0.08 ** | - | - |
Suicidal Ideation (SI) | −0.08 ** | −0.04 | −0.08 ** | −0.10 *** | 0.53 ** | - |
Note: * p < 0.05; ** p < 0.01; *** p < 0.001.
3.2. The Effect of Demographic, Social, and Economic Factors on Depressive Symptoms and Suicidal Ideation
Before we performed the main analysis, we conducted a MANOVA to examine differences in depressive symptoms and suicidal ideation between samples. A significant main effect was found for mental health status (Wilks’ Lambda = 0.07, F(2, 1556) = 55.45, p < 0.001, η2 = 0.07). As expected, referred adolescents scored significantly higher in depressive symptoms (F(1, 1557) = 95.11, p < 0.001, η2 = 0.06 (M = 0.74, SD = 0.47 for referred adolescents; M = 0.49, SD = 0.33, for non-referred adolescents)) and suicidal ideation (F(1, 1557) = 78.67, p < 0.001, η2 = 0.05 (M = 1.78, SD = 1.15, for referred adolescents; M = 1.29, SD = 0.66, for non-referred adolescents)) than non-referred adolescents.
Then, we carried out MANOVAs in both samples to examine the effect of demographic, social, and economic factors on depressive symptoms and suicidal ideation. For the referred group, no significant multivariate effects were obtained (see Table 3). The univariate analysis only showed significant differences in terms of socioeconomic status for suicidal ideation scores (F(2, 28) = 4.09, p = 0.02, η2 = 0.09). Bonferroni tests showed that adolescents from families with a low socioeconomic status scored higher in suicidal ideation than those from families with a medium or high socioeconomic status. No interaction effects were found among demographic, social, and economic factors.
Table 3.
Demographic, Social, and Economic Factors | Depressive Symptoms | Suicidal Ideation | ||
---|---|---|---|---|
M (SD) | F/η2 | M (SD) | F/η2 | |
Age | 0.64/0.02 | 1.83/0.05 | ||
12–13 | 0.66 (0.45) | 1.53 (0.88) | ||
14–15 | 0.75 (0.47) | 1.88 (1.27) | ||
16–17 | 0.83 (0.47) | 1.96 (1.24) | ||
Gender | 1.28/0.02 | 1.08/0.01 | ||
Boy | 0.63 (0.45) | 1.50 (0.93) | ||
Girl | 0.83 (0.47) | 2.00 (1.26) | ||
Mother’s education level | 0.72/0.03 | 1.17/0.04 | ||
No education | 1.05 (0.45) | 2.53 (1.35) | ||
Primary education | 0.75 (0.51) | 1.93 (1.23) | ||
Secondary education | 0.66 (0.43) | 1.47 (0.98) | ||
Higher education | 0.76 (0.44) | 1.79 (1.10) | ||
Father’s education level | 1.42/0.05 | 0.89/0.03 | ||
No education | 0.75 (0.51) | 2.07 (1.26) | ||
Primary education | 0.74 (0.47) | 1.86 (1.19) | ||
Secondary education | 0.76 (0.48) | 1.73 (1.15) | ||
Higher education | 0.75 (0.47) | 1.47 (0.97) | ||
Socioeconomic status (SES) | 1.74/0.04 | 4.08 */0.10 | ||
Low | 0.89 (0.49) | 2.05 (1.28) | ||
Medium | 0.72 (0.48) | 1.63 (1.19) | ||
High | 0.65 (0.40) | 1.48 (0.87) |
Note: * p < 0.05.
Table 4 displays the MANOVA results for the non-referred group. Significant multivariate effects were obtained for age (Wilks’ Lambda = 0.01, F(4, 2240) = 3.17, p = 0.01, η2 = 0.01) and socioeconomic status (Wilks’ Lambda = 0.01, F(4, 2240) = 2.54, p = 0.04, η2 = 0.005). Regarding depressive symptoms, the univariate analyses showed differences in terms of age (F(2, 1120) = 3.67, p = 0.02, η2 = 0.01) and father’s education level (F(3, 1120) = 3.26, p = 0.02, η2 = 0.01). A post hoc analysis indicated that adolescents in the 14–15 age group showed a higher level of depressive symptoms than adolescents in the other age groups (i.e., 12–13 and 16–17). Likewise, the group of adolescents with fathers with no education scored higher in depressive symptoms than all other participants (i.e., fathers with a completed primary, secondary, or higher education). No interaction effects were observed among demographic, social, and economic factors.
Table 4.
Demographic, Social, and Economic Factors | Depressive Symptoms | Suicidal Ideation | ||
---|---|---|---|---|
M (SD) | F/η2 | M (SD) | F/η2 | |
Age | 3.67 */0.01 | 5.50 */0.01 | ||
12–13 | 0.45 (0.33) | 1.32 (0.71) | ||
14–15 | 0.52 (0.34) | 1.35 (0.74) | ||
16–17 | 0.48 (0.31) | 1.21 (0.52) | ||
Gender | 1.24/0.001 | 0.37/0.001 | ||
Boy | 0.41 (0.30) | 1.24 (0.57) | ||
Girl | 0.55 (0.33) | 1.33 (0.72) | ||
Mother’s education level | 0.69/0.002 | 1.29/0.003 | ||
No education | 0.44 (0.28) | 1.29 (0.66) | ||
Primary education | 0.51 (0.34) | 1.32 (0.72) | ||
Secondary education | 0.49 (0.33) | 1.27 (0.63) | ||
Higher education | 0.47 (0.31) | 1.27 (0.61) | ||
Father’s education level | 3.26 */0.01 | 1.28/0.003 | ||
No education | 0.56 (0.33) | 1.47 (0.84) | ||
Primary education | 0.48 (0.32) | 1.31 (0.71) | ||
Secondary education | 0.47 (0.32) | 1.22 (0.53) | ||
Higher education | 0.48 (0.32) | 1.26 (0.62) | ||
Socioeconomic status (SES) | 1.51/0.003 | 4.78 **/0.01 | ||
Low | 0.55 (0.35) | 1.53 (0.87) | ||
Medium | 0.50 (0.32) | 1.27 (0.65) | ||
High | 0.46 (0.32) | 1.25 (0.60) |
Note: * p < 0.05; ** p < 0.01.
Regarding suicidal ideation, the univariate analyses showed differences in terms of age (F(2, 1120) = 5.50, p = 0.004, η2 = 0.01) and socioeconomic status (F(2, 1120) = 4.78, p = 0.009, η2 = 0.01). Bonferroni tests showed that youths in the 14–15 year-old age group displayed higher levels of suicidal ideation than youths in the other age groups (12–13 or 16–17 years old). Also, adolescents in the low socioeconomic status group showed a higher level of suicidal ideation than adolescents in the medium and high socioeconomic status groups. We observed interaction effects between age and father’s education level (F(6, 1120) = 3.73, p < 0.001, η2 = 0.02); gender, mother’s level education, and socioeconomic status (F(5, 1120) = 2.52, p = 0.03, η2 = 0.01); and age, gender, father’s level education, and socioeconomic status (F(9, 1120) = 2.06, p = 0.03, η2 = 0.02). Taken together, these results indicate a higher level of suicidal ideation among girls in the 14–15 year-old age group with parents with no education and whose family has a low socioeconomic status.
3.3. The Moderating Role That Demographic, Social, and Economic Factors Play in the Depressive Symptoms-Suicidal Ideation Relationship
Moderation analyses were conducted separately for referred and non-referred adolescents to determine the individual moderation role that each demographic, social, or economic factor (W) played in the relationship between depressive symptoms (X) and suicidal ideation (Y). In the referred sample, the results only showed moderation effects in the model that included age as a moderator (F(2, 197) = 8.08, p < 0.001, ∆R2 = 0.03). As expected, depressive symptoms were significantly related to suicidal ideation ( = 1.07, p < 0.001, 95% CI [0.68, 1.45]). However, although age was not associated with suicidal ideation ( = 0.25, p = 0.08, 95% CI [−0.03, 0.53]; = 0.16, p = 0.23, 95% CI [−0.10, 0.42]), the interaction effect of depressive symptoms and age on suicidal ideation was statistically significant ( = 0.81, p = 0.006, 95% CI [0.23, 1.40]; = 1.04, p < 0.001, 95% CI [0.51, 1.57]). This indicates that the relationship between depressive symptoms and suicidal ideation was dissimilar among the three age groups. The plotted interaction effects (Figure 1a) indicate that the relationship between depressive symptoms and suicidal ideation was stronger in the 14–15 (B = 1.88, p < 0.001) and 16–17 (B = 2.11, p < 0.001) age groups than in the 12–13 age group (B = 1.07, p < 0.001).
In the non-referred sample, only socioeconomic status was found to moderate the relationship between depressive symptoms and suicidal ideation (F(2, 1350) = 3.06, p = 0.04, ∆R2 = 0.01). The results showed a significant simple effect of depressive symptoms ( = 1.53, p < 0.001, 95% CI [1.09, 1.97]) and socioeconomic status ( = −0.17, p = 0.002, 95% CI [−0.28, −0.06]; = −0.16, p = 0.004, 95% CI [−0.27, −0.05]) on suicidal ideation. Likewise, we found a significant interaction effect of depressive symptoms and socioeconomic status on suicidal ideation ( = −0.43, p = 0.09, 95% CI [−0.94, 0.07]; = −0.61, p < 0.01, 95% CI [−1.10, −0.12]). As shown in Figure 1b, this interaction effect suggests that the relationship between depressive symptoms and suicidal ideation was stronger in those adolescents whose socioeconomic status was low (B = 1.53, p < 0.001). In comparison, in adolescents with a medium (B = 1.10, p < 0.001) or high socioeconomic status (B = 0.92, p < 0.001), the strength of this association was similar.
4. Discussion
This study had two main objectives. The first objective was to examine the association between certain demographic, social, and economic factors and depressive symptoms and suicidal ideation in referred and non-referred adolescents. The second objective was to explore the moderating effect of these factors on the relationship between depressive symptoms and suicidal ideation in both groups.
As expected, referred adolescents showed higher levels of depressive symptoms and suicidal ideation than non-referred adolescents. In addition, regarding age, we expected to find higher levels of internalizing problems in middle and late adolescence in both groups. As highlighted in the introduction, most studies found an increase in the levels of depressive symptoms and suicidal ideation throughout adolescence [5,6], although some studies have reported stability in these levels [16,17]. Our findings in referred adolescents showed stable levels of depressive symptoms and suicidal ideation during adolescence. In comparison, in non-referred adolescents, our data indicate an increase in the levels of depressive symptoms and suicidal ideation between 12–13 and 14–15 years old, and stability from 14–15 to 16–17 years old. These results suggest different developmental trends of internalizing problems among referred and non-referred adolescents. However, the cross-sectional nature of our data precludes the establishment of causality. Further longitudinal studies are required to clarify these trends.
Another interesting finding is that when both socioeconomic status and parents’ educational level were considered in the same analysis, suicidal ideation was significantly associated with socioeconomic status, but not with parents’ educational level. As predicted, and consistent with available evidence [40,41], we found higher levels of suicidal ideation among referred and non-referred adolescents from families with a low socioeconomic status. In contrast, the relationship between socioeconomic status and depressive symptoms was not significant when parents’ educational level was partialled out. In line with previous research [39], our results also evidenced a significant and negative relationship between father’s educational level and the development of depressive symptoms.
The above findings support the convenience of analyzing the effect of socioeconomic status and parents’ educational level based on differentiated variables. In addition, we must emphasize that our data indicate that socioeconomic status is related to suicidal ideation, in both referred and non-referred adolescents, but not to depressive symptoms. A possible explanation for this finding could be related to the factors that are involved in the increase of both problems during adolescence. While the development of depressive symptoms could be associated with the physical and psychological changes that come along with puberty [50], an increase in suicidal ideation may be linked to the occurrence of other mental health problems [34,51]. In view of this, socioeconomic status could be relevant to suicidal ideation only, and not to depressive symptoms, because suicidal ideation is more strongly associated with access to mental health services than depressive symptoms. Thus, belonging to a family with a low socioeconomic status, which limits access to resources for mental health promotion [40], may result in additional psychological problems and, consequently, increase the risk of developing higher levels of suicidal ideation. As opposed to our expectations, a low socioeconomic status does not seem to be a determining factor for depressive symptoms, perhaps because these symptoms are related to normative changes in adolescence [32] that do not always require specialized mental health care.
The role that parents’ educational level plays in depressive symptoms may be explained by previous studies showing that fathers with a higher educational level tend to be warmer and more communicative with their children and to possess better emotional skills [52,53]. These aspects may be, in turn, associated with lower levels of depressive symptoms. In fact, warmth and supportive parenting have been postulated to be protective factors against the development of depressive symptoms during adolescence [54,55].
Finally, regarding the first objective, we found no gender differences in the levels of depressive symptoms and suicidal ideation among referred and non-referred adolescents. Although the absence of gender differences in a non-referred sample has been observed in prior studies [23,24,25], most studies with referred samples have found higher levels of depressive symptoms and suicidal ideation among girls belonging to this group [21,22]. A possible explanation for our findings could be the reduction of differences in sex-type roles adopted by adolescent boys and girls [56]. Although our study did not confirm a direct effect of gender on the levels of depressive symptoms and suicidal ideation in referred and non-referred adolescents, we did find an interaction effect between the gender and age of adolescents, parents’ educational level, and family socioeconomic status in the non-referred sample. In this adolescent group, girls who were 14–15 years old, had parents with no education, and belonged to families with a low socioeconomic status reported higher levels of suicidal ideation. These results suggest that, in addition to analyzing gender and age in the development of depressive symptoms and suicidal ideation, it is necessary to consider the effect of certain social and economic factors that may contribute to the identification of vulnerable groups that could be target populations of preventive programs.
Regarding the second objective, we found a positive and strong association between depressive symptoms and suicidal ideation in both groups. This relationship, which was consistent with previous studies [28], was also found to be moderated by different factors.
In the referred sample, this link was influenced by adolescents’ age. Specifically, our results showed that the relationship between depressive symptoms and suicidal ideation was stronger in the 14–15 and 16–17 year-old age groups, and weaker in early adolescence (the 12–13 year-old age group). These results suggest that this relationship becomes stronger as adolescence progresses. A possible explanation could be related to the stages of cognitive development during adolescence and the acquisition of formal operational in middle adolescence, that is at 14–15 years old [57]. Boys and girls in mid–late adolescence have greater cognitive abilities and exhibit more complex thinking [58]. This may allow them to reflect and consider suicide to be an easy way out of a depressive situation, which in the referred sample sharpens significantly with age. Although adolescents in the 12–13 year-old age group do experience depressive symptoms, they may not have reached a sufficient level of cognitive maturation for the elaboration of a hypothetical plan to commit suicide or to think of suicide as a possible solution to their problems.
In the non-referred sample, our results indicated that it was not age, but family socioeconomic status that moderated the relationship between depressive symptoms and suicidal ideation. Our results showed that the association between depressive symptoms and suicidal ideation was stronger in adolescents with a low socioeconomic status. These findings, in line with previous research [39,40,41], indicate that a low family socioeconomic status may be a risk factor for the emergence and maintenance of some internalizing problems. These results may help us to identify vulnerable populations and evidence the convenience of developing primary prevention programs designed to target non-referred adolescents who come from economically disadvantaged family contexts. In this context, it may be beneficial to implement in school programs that promote mental health. These programs could promote the competences and well-being that prevent the occurrence of internalizing problems in adolescents [59].
Although the present study yielded some interesting findings, these should be considered in light of the study’s limitations. Firstly, this study had a cross-sectional design which allows us to examine the association between variables, but not to make inferences about causality. Further longitudinal studies are required to shed light on the directionality of relationships and to analyze the developmental trajectory of depressive symptoms and suicidal ideation in referred and non-referred adolescents. Second, assessments of depressive symptoms and suicidal ideation, as well as of social and economic factors, were based on adolescents’ self-reports, which may have artificially inflated the strength of the observed associations through shared method variance. However, some authors, such as Andrew et al. [60], have found that adolescents report more realistically about their internal states than their parents or other external informants. Third, we developed this study by considering two samples that were obtained by a quota sampling procedure that controls for the variables age, gender, parents’ educational level, and socioeconomic status. This type of sampling procedure was chosen to facilitate comparisons between subgroups and the systematization of the variations produced by the sociodemographic factors in each sample [49]. Nevertheless, this sampling procedure prevented us from offering prevalence rates and comparing samples in terms of some social and economic factors because their presence was controlled based on the established quotas. Finally, it is important that future research examines other social and economic factors intimately related to depressive symptoms and suicidal ideation, such as access to mental health services. The study of a more diverse variety of demographic, social, and economic factors could provide a more complete picture of the factors involved in the development of internalizing problems during adolescence.
5. Conclusions
The findings of this study emphasize the importance of examining the role that certain demographic, social, and economic factors play in the development of depressive symptoms and suicidal ideation during adolescence. This study also highlights the utility of employing a combined design in which referred and non-referred adolescents are assessed simultaneously. Our results suggest that it is possible that there is no single unique developmental trajectory for these internalizing problems, but a differentiated trend that is based on the individual’s mental health status. Moreover, we did not find gender differences in depressive symptoms and suicidal ideation in referred and non-referred adolescents. However, the interaction effect demonstrated that, in non-referred adolescents, suicidal ideation levels were higher in girls who were 14–15 years old, with parents without studies, and belonging to families with a low socioeconomic status. These results emphasized the importance of analyzing, together with gender and age, other social and economic factors associated with the development of depressive symptoms and suicidal ideation.
In addition, our findings evidence the convenience of considering socioeconomic status and parents’ educational level as differentiated variables. When both variables were studied together, it was found that socioeconomic status was related to suicidal ideation and that parental educational level was associated with depressive symptoms.
Finally, our data show that demographic, social, and economic factors moderate the relationship between depressive symptoms and suicidal ideation. In the referred sample, our results show that the relationship between depressive symptoms and suicidal ideation was moderated by age and becomes stronger as adolescence progresses. In the non-referred sample, it was observed that family socioeconomic status moderated this relationship, finding that this relationship was stronger in those adolescents whose family socioeconomic status was low. As such, it is important to consider the moderating effect of these factors on the relationship between depressive symptoms and suicidal ideation with the objective of developing specific prevention strategies for each adolescent group.
Acknowledgments
The authors acknowledge the support from the Plan Propio de Investigación y Transferencia of the Universidad de Sevilla.
Author Contributions
Conceptualization, L.A.-S., F.J.N.-C., A.R.-M., and A.O.; Data curation, L.A.-S.; Formal analysis, F.J.N.-C.; Funding acquisition, F.J.N.-C.; Investigation, L.A.-S., F.J.N.-C., and A.R.-M.; Methodology, L.A.-S. and A.R.-M.; Supervision, A.R.-M. and A.O.; Writing—Original draft, F.J.N.-C.; Writing—review & editing, L.A.-S. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by a research grant awarded to Francisco J. Nieto-Casado by the Plan Propio de Investigación y Transferencia of the Universidad de Sevilla.
Conflicts of Interest
The authors declare no conflict of interest.
References
- 1.Alonso J., Angermeyer M.C., Bernert S., Bruffaerts R., Brugha T.S., Bryson H., de Girolamo G., de Graaf R., Demyttenaere K., Gasquet I., et al. Prevalence of mental disorders in Europe: Results from the European Study of the Epidemiology of Mental Disorders (ESEMeD) project. Acta Psychiatr. Scand. 2004;109:21–27. doi: 10.1111/j.1600-0047.2004.00325.x. [DOI] [PubMed] [Google Scholar]
- 2.Bornstein M.H., Hahn C.S., Suwalsky J.T.D. Language and internalizing and externalizing behavioral adjustment: Developmental pathways from childhood to adolescence. Dev. Psychopathol. 2013;25:857–878. doi: 10.1017/S0954579413000217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Bornstein M.H., Hahn C.S., Suwalsky J.T.D. Developmental pathways among adaptive functioning and externalizing and internalizing behavioral problems: Cascades from childhood into adolescence. Appl. Dev. Sci. 2013;17:76–87. doi: 10.1080/10888691.2013.774875. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Lansford J.E., Godwin J., Bornstein M.H., Chang L., Deater-Deckard K., Di Giunta L., Dodge K.A., Malone P.S., Oburu P., Pastorelli C., et al. Parenting, culture, and the development of externalizing behaviors from age seven to 14 in nine countries. Dev. Psychopathol. 2018;30:1937–1958. doi: 10.1017/S0954579418000925. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Allison S., Roeger L., Martin G., Keeves J. Gender Differences in the Relationship Between Depression and Suicidal Ideation in Young Adolescents. Aust. N. Z. J. Psychiatry. 2001;35:498–503. doi: 10.1046/j.1440-1614.2001.00927.x. [DOI] [PubMed] [Google Scholar]
- 6.King C.A., Kerr D.C., Passarelli M.N., Foster C.E., Merchant C.R. One-year follow-up of suicidal adolescents: Parental history of mental health problems and time to post-hospitalization attempt. J. Youth Adolesc. 2010;163:219–232. doi: 10.1007/s10964-009-9480-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Carli V., Hoven C.W., Wasserman C., Chiesa F., Guffanti G., Sarchiapone M., Apter A., Balazs J., Brunner R., Corcoran P., et al. A newly identified group of adolescents at “invisible” risk for psychopathology and suicidal behavior: Findings from the SEYLE study. World Psychiatry. 2014;13:78–86. doi: 10.1002/wps.20088. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Faravelli C., Alessandra M., Castellini G., Lo Sauro C. Gender differences in depression and anxiety: The role of age. Psychiatry Res. 2013;210:1301–1303. doi: 10.1016/j.psychres.2013.09.027. [DOI] [PubMed] [Google Scholar]
- 9.Salk R.H., Hyde J.S., Abramson L.Y. Gender differences in depression in representative national samples: Meta-analyses of diagnoses and symptoms. Psychol. Bull. 2017;143:783–822. doi: 10.1037/bul0000102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Miranda-Mendizabal A., Castellví P., Parés-Badell O., Alayo I., Almenara J., Alonso I., Blasco M.J., Cebrià A., Gabilondo A., Gili M., et al. Gender differences in suicidal behavior in adolescents and young adults: Systematic review and meta-analysis of longitudinal studies. Int. J. Public Health. 2019;64:265–283. doi: 10.1007/s00038-018-1196-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Scott E.M., Hermens D.F., Naismith S.L., White D., Whitwell B., Guastella A.J., Glozier N., Hickie I.B. Thoughts of death or suicidal ideation are common in young people aged 12 to 30 years presenting for mental health care. BMC Psychiatry. 2012;12:234. doi: 10.1186/1471-244X-12-234. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Weinberger A.H., Gbedemah M., Martinez A.M., Nash D., Galea S., Goodwin R.D. Trends in depression prevalence in the USA from 2005 to 2015: Widening disparities in vulnerable groups. Psychol. Med. 2018;48:1308–1315. doi: 10.1017/S0033291717002781. [DOI] [PubMed] [Google Scholar]
- 13.Andersen S.L. Trajectories of brain development: Point of vulnerability or window of opportunity? Neurosci. Biobehav. Rev. 2003;27:3–18. doi: 10.1016/S0149-7634(03)00005-8. [DOI] [PubMed] [Google Scholar]
- 14.Nightingale E.O., Fischhoff B. Adolescent risk and vulnerability: Overview. J. Adolesc. Health. 2002;31:3–9. doi: 10.1016/S1054-139X(02)00413-5. [DOI] [PubMed] [Google Scholar]
- 15.Sihvola E., Keski-Rahkonen A., Dick D.M., Pulkkinen L., Rose R.J., Marttunen M., Kaprio J. Minor depression in adolescence: Phenomenology and clinical correlates. J. Affect. Disord. 2007;97:211–218. doi: 10.1016/j.jad.2006.06.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Wiens K., Williams J.V., Lavorato D.H., Duffy A., Pringsheim T.M., Sajobi T.T., Patten S.B. Is the prevalence of major depression increasing in the Canadian adolescent population? Assessing trends from 2000 to 2014. J. Affect. Disord. 2017;210:22–26. doi: 10.1016/j.jad.2016.11.018. [DOI] [PubMed] [Google Scholar]
- 17.Kim K.M. What makes adolescents psychologically distressed? Life events as risk factors for depression and suicide. Eur. Child Adolesc. Psychiatry. 2020 doi: 10.1007/s00787-020-01520-9. [DOI] [PubMed] [Google Scholar]
- 18.Dekker M.C., Ferdinand R.F., van Lang N.D.J., Bongers I.L., van der Ende J., Verhulst F.C. Developmental trajectories of depressive symptoms from early childhood to late adolescence: Gender differences and adult outcome. J. Child Psychol. Psychiatry. 2007;48:657–666. doi: 10.1111/j.1469-7610.2007.01742.x. [DOI] [PubMed] [Google Scholar]
- 19.Pace U., Zappulla C. Relations Between Suicidal Ideation, Depression, and Emotional Autonomy from Parents in Adolescence. J. Child Fam. Stud. 2010;19:747–756. doi: 10.1007/s10826-010-9364-9. [DOI] [Google Scholar]
- 20.Galambos N.L. Gender and gender role development in adolescence. In: Lerner R.M., Steinberg L., editors. Handbook of Adolescent Psychology. 2nd ed. John Wiley & Sons; Hoboken, NJ, USA: 2004. pp. 233–262. [Google Scholar]
- 21.Bennett D.S., Ambrosini P.J., Kudes D., Metz C., Rabinovich H. Gender differences in adolescent depression: Do symptoms differ for boys and girls? J. Affect. Disord. 2005;89:35–44. doi: 10.1016/j.jad.2005.05.020. [DOI] [PubMed] [Google Scholar]
- 22.Borges G., Benjet C., Medina-Mora M.E., Orozco R., Nock M. Suicide ideation, plan, and attempt in the Mexican adolescent mental health survey. J. Am. Acad. Child Adolesc. Psychiatry. 2008;47:41–52. doi: 10.1097/chi.0b013e31815896ad. [DOI] [PubMed] [Google Scholar]
- 23.Ceballos-Ospino G.A., Suarez-Colorado Y., Suescún-Arregocés J., Gamarra-Vega L.M., González K.E., Sotelo-Manjarres A.P. Ideación suicida, depresión y autoestima en adolescentes escolares de Santa Marta. Duazary. 2015;12:15–22. doi: 10.21676/2389783X.1394. [DOI] [Google Scholar]
- 24.Kirchner T., Ferrer L., Forns M., Zanini D. Conducta autolesiva e ideación suicida en estudiantes de Enseñanza Secundaria Obligatoria. Diferencias de género y relación con estrategias de afrontamiento. Actas Esp. Psiquiatr. 2011;39:226–235. [PubMed] [Google Scholar]
- 25.Martyn D., Andrews L., Byrne M. Prevalence rates and risk factors for mental health difficulties in adolescents aged 16 and 17 years living in rural Ireland. Ir. J. Psychol. Med. 2014;31:111–123. doi: 10.1017/ipm.2014.20. [DOI] [PubMed] [Google Scholar]
- 26.Compas B.E., Oppedisano G., Connor J.K., Gerhardt C.A., Hinden B.R., Achenbach T.M., Hammen C. Gender differences in depressive symptoms in adolescence: Comparison of national samples of clinically referred and nonreferred youths. J. Consult. Clin. Psychol. 1997;65:617–626. doi: 10.1037/0022-006X.65.4.617. [DOI] [PubMed] [Google Scholar]
- 27.Montemarano V., Troister T., Lambert C.E., Holden R.R. A four-year longitudinal study examining psychache and suicide ideation in elevated-risk undergraduates: A test of Shneidman’s model of suicidal behavior. J. Clin. Psychol. 2018;74:1820–1832. doi: 10.1002/jclp.22639. [DOI] [PubMed] [Google Scholar]
- 28.Ribeiro J.D., Huang X., Fox K.R., Franklin J.C. Depression and hopelessness as risk factors for suicide ideation, attempts and death: Meta-analysis of longitudinal studies. Br. J. Psychiatry. 2018;212:279–286. doi: 10.1192/bjp.2018.27. [DOI] [PubMed] [Google Scholar]
- 29.Kim-Cohen J., Caspi A., Moffitt T.E., Harrington H., Milne B.J., Poulton R. Prior juvenile diagnoses in adults with mental disorder: Developmental follow-back of a prospective-longitudinal cohort. Arch. Gen. Psychiatry. 2003;60:709–717. doi: 10.1001/archpsyc.60.7.709. [DOI] [PubMed] [Google Scholar]
- 30.Johnson D., Dupuis G., Piche J., Clayborne Z., Colman I. Adult mental health outcomes of adolescent depression: A systematic review. Depress. Anxiety. 2018;35:700–716. doi: 10.1002/da.22777. [DOI] [PubMed] [Google Scholar]
- 31.Reinherz H.Z., Tanner J.L., Berger S.R., Beardslee W.R., Fitz-Maurice G.M. Adolescent suicidal ideation as predictive of psychopathology, suicidal behavior, and compromised functioning at age 30. Am. J. Psychiatry. 2006;163:1226–1232. doi: 10.1176/ajp.2006.163.7.1226. [DOI] [PubMed] [Google Scholar]
- 32.Thapar A., Collishaw S., Pine D.S., Thapar A.K. Depression in adolescence. Lancet. 2012;379:1056–1067. doi: 10.1016/S0140-6736(11)60871-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.World Health Congress . National Suicide Prevention Strategies: Progress, Examples and Indicators. World Health Organization; Geneva, Switzerland: 2018. [Google Scholar]
- 34.Adewuya A.O., Oladipo E.O. Prevalence and associated factors for suicidal behaviours (ideation, planning, and attempt) among high school adolescents in Lagos, Nigeria. Eur. Child Adolesc. Psychiatry. 2019 doi: 10.1007/s00787-019-01462-x. [DOI] [PubMed] [Google Scholar]
- 35.Erausquin J.T., McCoy T.P., Bartlett R., Park E. Trajectories of suicide ideation and attempts from early adolescence to mid-adulthood: Associations with race/ethnicity. J. Youth Adolesc. 2019;48:1796–1805. doi: 10.1007/s10964-019-01074-3. [DOI] [PubMed] [Google Scholar]
- 36.Fergusson D.M., Woodward L.J., Horwood L.J. Risk factors and life processes associated with the onset of suicidal behaviour during adolescence and early adulthood. Psychol. Med. 2000;30:23–39. doi: 10.1017/S003329179900135X. [DOI] [PubMed] [Google Scholar]
- 37.Nolen-Hoeksema S., Hilt L.M. Handbook of Depression in Adolescents. Routledge; New York, NY, USA: 2009. [Google Scholar]
- 38.Windfuhr K., Steeg S., Hunt I.M., Kapur N. International perspectives on the epidemiology and etiology of suicide and self-harm. In: O’Connor R.C., Pirkis J., editors. The International Handbook of Suicide Prevention. 2nd ed. John Wiley & Sons; Oxford, UK: 2016. pp. 36–60. [Google Scholar]
- 39.Goodman E., Slap G.B., Huang B. The Public Health Impact of Socioeconomic Status on Adolescent Depression and Obesity. Am. J. Public Health. 2003;93:1844–1850. doi: 10.2105/AJPH.93.11.1844. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Kim J., Yoon S.Y. Association between socioeconomic attainments and suicidal ideation by age groups in Korea. Int. J. Soc. Psychiatry. 2018;64:628–636. doi: 10.1177/0020764018792592. [DOI] [PubMed] [Google Scholar]
- 41.Moeini B., Bashirian S., Soltanian A.R., Ghaleiha A., Taheri M. Prevalence of depression and its associated sociodemographic factors among Iranian female adolescents in secondary schools. BMC Psychol. 2019;7:7. doi: 10.1186/s40359-019-0298-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Van de Velde S., Bracke P., Levecque K. Gender differences in depression in 23 European countries. Cross-national variation in the gender gap in depression. Soc. Sci. Med. 2010;71:305–313. doi: 10.1016/j.socscimed.2010.03.035. [DOI] [PubMed] [Google Scholar]
- 43.Boyce W., Torsheim T., Currie C., Zambon A. The family affluence scale as a measure of national wealth: Validation of an adolescent self-reported measure. Soc. Indic. Res. 2006;78:473–487. doi: 10.1007/s11205-005-1607-6. [DOI] [Google Scholar]
- 44.Currie C., Molcho M., Boyce W., Holstein B.E., Torsheim T., Richter M. Researching health inequalities in adolescents: The development of the Health Behaviour in School-aged Children (HBSC) family affluence scale. Soc. Sci. Med. 2008;66:1429–1436. doi: 10.1016/j.socscimed.2007.11.024. [DOI] [PubMed] [Google Scholar]
- 45.Achenbach T.M., Rescorla L.A. Manual for the ASEBA School-Age Forms & Profiles. University of Vermont, Research Center for Children, Youth, & Families; Burlington, VT, USA: 2001. [Google Scholar]
- 46.Osman A., Gutierrez P.M., Kopper B.A., Barrios F.X., Chiros C.E. The Positive and negative suicide ideation inventory: Development and validation. Psychol. Rep. 1998;82:783–793. doi: 10.2466/pr0.1998.82.3.783. [DOI] [PubMed] [Google Scholar]
- 47.Villalobos-Galvis F.H. Validez y fiabilidad del inventario de ideación suicida positiva y—PANSI, en estudiantes colombianos. Univ. Psychol. 2009;9:509–520. doi: 10.11144/Javeriana.upsy9-2.vfii. [DOI] [Google Scholar]
- 48.Little R.J.A. A Test of missing completely at random for multivariate data with missing values. J. Am. Stat. Assoc. 1988;83:1198–1202. doi: 10.1080/01621459.1988.10478722. [DOI] [Google Scholar]
- 49.Bornstein M.H., Jager J., Putnick D.L. Sampling in developmental science: Situations, shortcomings, solutions, and standards. Dev. Rev. 2013;33:357–370. doi: 10.1016/j.dr.2013.08.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Nolen-Hoeksema S., Girgus J.S. The emergence of gender differences in depression during adolescence. Psychol. Bull. 1994;115:424–443. doi: 10.1037/0033-2909.115.3.424. [DOI] [PubMed] [Google Scholar]
- 51.Lanzillo E.C., Horowitz L.M., Pao M. Suicide in Children. In: Falcone T., Timmons-Mitchell J., editors. Suicide Prevention. A Practical Guide for the Practitioner. Springer; Cham, Switzerland: 2018. pp. 73–108. [Google Scholar]
- 52.Dornbusch S.M., Ritter P.L., Leiderman P.H., Roberts D.F., Fraleigh M.J. The relation of parenting style to adolescent school performance. Child Dev. 1987;58:1244–1257. doi: 10.2307/1130618. [DOI] [PubMed] [Google Scholar]
- 53.Ruvalcaba N., Gallegos J., Robles F., Morales A., González N. Inteligencia emocional en la mejora de los estilos educativos de padres con hijos en edad escolar. Salud Soc. 2012;3:283–291. doi: 10.22199/S07187475.2012.0003.00004. [DOI] [Google Scholar]
- 54.Johnson L.E., Greenberg M.T. Parenting and Early Adolescent Internalizing: The Importance of Teasing Apart Anxiety and Depressive Symptoms. J. Early Adolesc. 2013;33:201–226. doi: 10.1177/0272431611435261. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Zahn-Waxler C., Klimes-Dougan B., Slattery M.J. Internalizing problems of childhood and adolescence: Prospects, pitfalls, and progress in understanding the development of anxiety and depression. Dev. Psychopathol. 2000;12:443–466. doi: 10.1017/S0954579400003102. [DOI] [PubMed] [Google Scholar]
- 56.Priess H.A., Lindberg S.M., Hyde J.S. Adolescent gender-role identity and mental health: Gender intensification revisited. Child Dev. 2009;80:1531–1544. doi: 10.1111/j.1467-8624.2009.01349.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Kuhn D. Adolescent thinking. In: Lerner R.M., Steinberg L., editors. Handbook of Adolescent Psychology: Individual Bases of Adolescent Development. John Wiley & Sons; Hoboken, NJ, USA: 2009. pp. 152–186. [DOI] [Google Scholar]
- 58.Carretero M., León J.A. Del pensamiento formal al cambio conceptual en la adolescencia. In: Palacios J., Marchesi A., Coll C., editors. Desarrollo Psicológico y Educación. 1. Psicología Evolutiva. 2nd ed. Alianza Editorial; Madrid, Spain: 2014. pp. 453–470. [Google Scholar]
- 59.Shek D.T.L., Sun R.C.F. Implementation of a positive youth development program in a Chinese context: A case study based on project P.A.T.H.S. Int. J. Child Adolesc. Health. 2009;2:431–446. [Google Scholar]
- 60.Andrews V.C., Garrison C.Z., Jackson K.L., Addy C.L., McKeown R.E. Mother-adolescent agreement on the symptoms and diagnoses of adolescent depression and conduct disorders. J. Am. Acad. Child Adolesc. Psychiatry. 1993;34:731–738. doi: 10.1097/00004583-199307000-00005. [DOI] [PubMed] [Google Scholar]