Abstract
The popularity of social media use among adolescents has raised concerns about the potentially harmful effects of social media use on adolescents’ sleep. Since longitudinal research considering this relationship is scarce, the present two-wave longitudinal study of 2021 secondary school students (Mage = 13.86, SD = 1.25) examined whether frequency of social media use and problematic social media use predicted adolescents’ bedtime and quality of sleep. Moreover, the protective role of parental rules regarding Internet and smartphone use one hour before sleep was examined. The findings indicated that strict parental rules about Internet and smartphone use before sleep might prevent negative consequences of social media use on bedtime and sleep quality, but only among less engaged social media users. Once adolescents are highly engaged social media users, strict parental rules do not seem to prevent negative media influences on sleep. This implies that limiting Internet accessibility before bedtime can help prevent adolescents’ sleep problems, but that regulation is less effective for adolescents who are already highly involved in social media use.
Keywords: social media use, social media addiction, sleep, parental rules, parenting, adolescents
1. Introduction
Using social media—such as Facebook, Instagram, Snapchat, and WhatsApp—has become one of the most popular leisure-time activities among adolescents. In 2017, 98% of Dutch adolescents aged 12–15 years owned a smartphone, and about 31% agreed they are using social media on their smartphone throughout the whole day [1]. The increasing amount of time adolescents spend using social media has raised concerns about its potential negative influence on adolescents’ health and well-being, including sleep [2,3]. Sleep is vital for adolescents’ learning capacity, memory processes, emotional regulation, and related behaviors [4,5]. Insufficient or disturbed sleep is related to attention problems [6], poor school performance [7], daytime tiredness [8], depression [9], and obesity [10]. Unfortunately, sleep problems among adolescents are rather common, with 10% of Dutch adolescents aged 14–17 years sleeping less than 6.5 h, 16.3% experiencing difficulties in falling asleep, 24.1% experiencing sleep interruptions, and 44.3% reporting feeling not rested upon waking up [11]. Increasing the knowledge about predictors of sleep problems among adolescents is, therefore, warranted.
Numerous studies have linked sleep problems with screen-based activities in general (for review, see [12]). However, longitudinal research on sleep and social media use among adolescents is limited. Since social media channels have become a fundamental part of adolescents’ daily lives, it is vital to investigate whether their use affects adolescents’ sleep. Therefore, the current longitudinal study examined the effects of social media use on adolescents’ actual bedtime and their perceived quality of sleep. Furthermore, we tested whether parental rules regarding Internet use in the hour before going to sleep and parental rules about taking the smartphone to the bedroom when going to sleep moderate these effects. Moreover, several scholars have emphasized that frequency of social media use and problematic social media use should be regarded as related but different dimensions [13,14,15]. Problematic social media use can be defined as a loss of control over one’s social media use, accompanied by significant impairments in daily-life functioning [13,14]. International research data show that 4% to 18% of 15 year olds from 42 countries and regions reported high levels of problematic social media use in 2017–2018 [16]. It is important to distinguish between frequency of use and problematic use because frequent users may be well able to regulate their social media use, whereas problematic users may not show intensive patterns of use, for instance, due to a mismatch between their desired and actual online social network [13,14].
1.1. Frequency of Social Media Use and Sleep
Previous cross-sectional studies have consistently shown that the frequency of social media use is associated with several sleep problems among adolescents. Adolescents who frequently use social media during the day report less total sleep time [17] and poorer sleep quality [18]. The frequency of social media use, particularly in the evenings, is related to a delay in bedtime [19], more difficulties falling asleep [20,21], a shorter sleep duration [20,22], and a poorer sleep quality [18,23]. Several mechanisms may play a role in these relationships. First, phone, tablet, or laptop screens emit blue light, which may suppress the production of the sleep-promoting hormone melatonin (e.g., [24,25]). Second, online activities (e.g., chatting) just before bedtime may cause emotional, mental, and/or physiological arousal [26], which may, in turn, lead to more difficulty falling asleep and poorer sleep quality [27]. Third, because social media use does not include a defined endpoint, adolescents may find it difficult to stop. Social media use in the evenings may postpone going to sleep and instigate irregular bedtimes, which may affect sleep duration and sleep quality [3]. Finally, social media might cause sleep interruptions when adolescents keep their smartphones in their bedroom at night, as social media may generate incoming messages accompanied by visual and sound alerts [18]. Yet, because of the cross-sectional nature of the mentioned studies, it is impossible to establish the direction of these relationships or their underlying mechanisms.
Van der Schuur, Baumgartner, and Sumter [28] conducted cross-sectional and longitudinal analyses regarding the link between the frequency of social media use and sleep-related variables, i.e., daytime tiredness and sleep latency. Their cross-sectional analysis showed that daytime tiredness was more prevalent in those with higher scores on social media use, in line with the previously mentioned findings. Additionally, more social media use was associated with longer sleep latency, i.e., the time between going to bed and falling asleep. However, longitudinal evidence for prospective relations between the frequency of social media use and daytime tiredness, as well as sleep latency, was not found [28]. As far as we know, this is the only available longitudinal study on the link between the frequency of social media use and adolescents’ sleep problems. Hence, longitudinal research on the effect of the frequency of social media use on other relevant sleep variables, such as time of going to sleep and perceived quality of sleep, is completely missing. The current longitudinal study addressed this gap. Based on the previous cross-sectional findings, we expected that more frequent use of social media would predict a later bedtime and a poorer sleep quality among adolescents.
1.2. Problematic Social Media Use and Sleep
Research on the relationship between problematic social media use (PSMU) and sleep outcomes is also rather scarce. A cross-sectional study among Australian adolescents aged 12–18 years found that problematic social networking was related to more sleep disturbances and poorer sleep quality [29]. Similarly, two cross-sectional studies of students with a mean age of 20 years demonstrated that Facebook dependence and social media addiction were associated with a poorer sleep quality [30,31]. Other cross-sectional research has addressed the link between more general forms of Internet addiction and sleep problems, indicating that Internet addiction among adolescents is related to longer sleep latency, increased use of sleep medication, lower sleep efficiency, more sleep interruptions [32], less total sleep time [33,34], poorer sleep quality [32,35], and more daytime tiredness [32,36]. Furthermore, a longitudinal study among children and adolescents aged 8–16 found that Internet addiction predicted a disturbed sleep–wake rhythm [37]. Based on these findings, we hypothesized that problematic social media use among adolescents would predict a later bedtime and poorer sleep quality.
1.3. The Role of Parental Rules Regarding Internet and Smartphone Use before Going to Sleep
It has been argued that the timing rather than the duration of social media use may affect adolescents’ sleep [15], as social media use at bedtime is a strong predictor of poorer sleep outcomes [38]. Thus, social media use during the evening hours and before going to sleep may be particularly associated with sleep problems. Therefore, it can be expected that the rules that parents set regarding Internet and smartphone use before sleep will buffer the assumed negative effect of social media use on sleep. For instance, it can be anticipated that adolescents who are allowed to bring their smartphone or tablet to their bedroom when they go to sleep will experience more sleep problems than adolescents who have to leave their smartphone or tablet behind.
The literature on the effects of parental rules about the Internet, social media, and smartphone use before bedtime has been limited. Moreover, studies on the effects of general Internet-specific rules on the intensity of adolescents’ Internet use and problematic use are rather inconsistent. On the one hand, several cross-sectional studies have found negative relationships of Internet-specific rules with time spent online [39,40] and problematic Internet use [41,42,43], suggesting that setting strict rules is effective in shaping adolescents’ online behavior. On the other hand, some cross-sectional studies did not reveal a relationship between Internet-specific rules and problematic Internet use [40] or time spent online [44], and one study even found a positive relationship, suggesting that strict parental rules may promote the development of problematic Internet use [45]. Concerning social media use, a longitudinal study showed that Internet-specific rules predicted fewer symptoms of problematic use among girls but not among boys [46].
As far as we know, two cross-sectional studies addressed parental rules regarding screen use in the evening hours. The study of Buxton et al. [47] among youth aged 6–17 years concluded that children whose parents enforce strict rules regarding the amount of time their child is allowed to use a smartphone, tablet, or computer in the evening slept longer compared to children whose parents impose such rules only sometimes or never. In addition, a cross-sectional study among Belgium adolescents aged 13–20 years showed that the presence of rules regarding media use in combination with the presence of rules regarding bedtime moderated the positive relationship between some types of media use (computer use, mp3-player use, and television viewing) in the evening and actual bedtimes [48]. Based on these studies, we expected that rules about Internet and smartphone use before bedtime would moderate the relationship between social media use and adolescents’ sleep. More specifically, we hypothesized that the assumed effect of social media use on sleep would be weaker when parents set strict rules about Internet and smartphone use before going to sleep.
1.4. Present Study
This two-wave longitudinal study aimed to contribute to our understanding of the effects of social media use on adolescents’ sleep and extend our knowledge of the preventive role that parents can play to protect adolescents from sleep-disturbing social media use. First, we examined the effects of both the frequency of social media use and problematic social media use on adolescents’ bedtime and adolescents’ perceived quality of sleep. Next, we tested whether parental rules about using the Internet in the hour before going to sleep and taking the smartphone to the bedroom moderated these effects. These relationships were tested in two separate models, one with the intensity of social media use and one with problematic social media use as the main predictors, and a combined model including both predictors simultaneously. Based on the previous empirical findings, we hypothesized that (1) both the frequency of social media use and problematic social media use will predict a delay in bedtime and poorer perceived quality of sleep and that (2) these effects will be mitigated when parents set strict rules regarding Internet and smartphone use before bedtime.
2. Methods
2.1. Sample
The data for this study were derived from the Digital Youth Project, a longitudinal research project on adolescents’ online behavior. Specifically, we used data from two measurement waves conducted in February 2017 and 2018 (T3 and T4 in the original project, in this study, referred to as T1 and T2), as some variables of interest were not included in the questionnaire in the first two waves of the original study. Adolescents from six different secondary schools completed a computer-based questionnaire during school hours. Research assistants were present to supervise the data collection, answer student questions, and ensure maximum privacy.
Of the 2708 participants included at T1, 678 dropped out of the study due to withdrawal of one of the six schools. Of the remaining 2030 participants, 1422 (70%) also participated at T2. Further dropout of participants was mainly due to dropout of complete classes (particularly last classes of lower-level secondary education) because schools did not provide permission for these specific classes, or, to a lesser extent, absence of individual students during the measurement days. Nine adolescents were excluded because of unreliable data, resulting in a final sample of 2021 participants eligible for analysis. More than half of the final sample was male (54.6%), and the age ranged from 11 to 17 years (Mage = 13.86, SD = 1.25) at T1. Students were in lower-level vocational education (42.2%), moderate level secondary education (11.8%), or high school/pre-university education (46.1%). Most students (95.4%) had a Dutch background.
Participants who dropped out of the study were more likely to be older (t(2696) = −15.98, p = < 0.001), to be male (χ2 (1) = 6.36, p = 0.01), to follow a lower level of education (χ2 (1) = 340.88, p < 0.001), and to have parents who do not impose strict rules regarding using the Internet in the hour before going to sleep (χ2 (1) = 15.69, p < 0.001) or taking the smartphone to the bedroom when going to sleep (χ2 (1) = 37.90, p < 0.001) compared to participants who participated in both waves. Additionally, participants who dropped out were more likely to report more frequent social media use (t(2704) = 5.40, p < 0.001), more problematic social media use (t(2630) = −2.63, p = 0.008), later times of going to sleep (t(2500) = −9.69, p < 0.001), and poorer quality of sleep (t(2598) = 2.09, p = 0.04). These differences may to some extent be explained by the fact that several whole school classes from the last year of lower-level secondary education dropped out.
2.2. Measures
The frequency of social media use was measured using six items. A definition of social media was given preceding the questions [13]. Four items measured the use of social network sites (e.g., “How many times a week do you post a message, picture, or video on your social network sites?”), and two items measured instant messaging through smartphones (e.g., “How many times a day do you send a message, picture, or video with your smartphone?”) on a 7-point response scale ranging from 1 (less than once a day/week) to 7 (more than 40 times a day/week). A sum score was calculated, where a higher score reflects a more frequent use of social media. Cronbach’s α values were 0.84 (T1) and 0.82 (T2).
Problematic social media use was measured using the Social Media Disorder (SMD) scale containing 9 items [49] corresponding to the nine diagnostic criteria for Internet Gaming Disorder (IGD) according to the Appendix of the DSM-5. These criteria entail preoccupation, tolerance, withdrawal, persistence, escape, conflict, problems on important life domains, displacement, and deception. Because both IGD and SMD are not officially recognized as mental disorders by the DSM-5, and because there is an ongoing scholarly discussion on how to conceptualize behavioural addictions [50], we prefer to use the term problematic use over disordered use. Adolescents were asked the following question: “During the past year, have you (…)”, followed by, for example, “regularly had no interest in hobbies or other activities because you would rather use social media?”, which refers to the criterion “displacement”. Respondents replied on a dichotomous scale (1 = no and 2 = yes). The nine items were summed, with a higher score indicating more social media disorder symptoms. Given the items’ dichotomous nature, internal consistency was calculated using the ordinal alpha based on the tetrachoric correlation matrix [51]. Ordinal alpha values were 0.90 (T1) and 0.89 (T2).
Perceived quality of sleep was measured using the 5-item Groningen Sleep Quality Scale (GSKS; [52]) and one item from the Depressive Mood List: “I have trouble going or staying asleep” [53]. Response categories ranged from 1 (never) to 5 (always). Most items were recoded so that a higher mean score reflected the higher quality of sleep. Cronbach’s α values were 0.83 (T1 and T2).
Bedtime was measured with one item, “On schooldays, at what time do you go to sleep?” Response categories ranged from 1 (before 20.00) to 10 (after 00.00), with higher scores indicating later bedtime.
Two parental rules regarding Internet and smartphone use before bedtime were included as moderators. Adolescents indicated the extent to which they are allowed to (1) use the Internet or play games in the hour before they go to sleep and (2) bring their smartphone/tablet to their bedroom at bedtime on regular school days. Response categories ranged from 1 (never) to 5 (very often). These variables were recoded into dichotomous variables, with 0 = no strict rules (“sometimes” to “very often”) and 1 = strict rules (“never” or “rarely”), since the parental rules variables were not normally distributed.
2.3. Data Analyses
Descriptive statistics and correlations between all study variables were computed using IBM SPSS Statistics 24. Next, structural equation modeling was conducted using Mplus 8.1 [54] to examine the effects of social media use on adolescents’ sleep. The effects of frequency of social media use and problematic social media use at T1 were tested in two separate multivariate models, which included each predictor separately, and a comprehensive multivariate model that included both predictors simultaneously. In these models, we also controlled for gender, age, educational level, and the outcome variables at T1. To test the moderating role of parental rules about using the Internet in the hour before going to sleep and of parental rules about taking the smartphone to the bedroom when going to sleep, interaction terms between the predictor variables and these two parental rules were included in four separate models. The predictive value of these interaction terms was tested while controlling for the main effects of these moderators. Maximum Likelihood estimation was used to handle missing data. Bootstrapping (500) was applied because the predictor “problematic social media use” was not normally distributed. The Comparative Fit Index (CFI) and the Root Mean Square Error of Approximation (RMSEA) were used to evaluate model fit. According to standard criteria, CFI values equal to 0.90 or higher and RMSEA values below 0.08 indicate an acceptable model fit [55].
3. Results
3.1. Descriptive Statistics
Descriptive statistics are presented in Table 1. The mean level of the frequency of social media use at T1 was 23.01 (SD = 8.10), and on average, adolescents reported one symptom of problematic social media use at T1. At T1, more than half of the participants (65.8%) reported going to sleep at 10.00 p.m. or later. At T2, this percentage increased to 81.8%. The average score of perceived quality of sleep was 3.32 (SD = 0.92) at T1 and 3.35 (SD = 0.89) at T2. At T1, about half of the adolescents indicated being rarely or never allowed to use the Internet or play games in the hour before going to sleep (53.3%) or take the smartphone/tablet to the bedroom when going to sleep (46.2%).
Table 1.
Total N = 2021 | n (%) | M (SD) | Min | Max |
---|---|---|---|---|
Gender (girls) | 917 (45.4%) | |||
Educational level (higher) | 1169 (57.8%) | |||
Age T1 | 13.86 (1.25) | 11 | 17 | |
Frequency social media use T1 | 23.01 (8.10) | 4 | 42 | |
Problematic social media T1 | 10.25 (1.54) | 9 | 18 | |
Bedtime T1 | 6.49 (2.09) | 1 | 10 | |
Bedtime T2 | 7.17 (1.89) | 1 | 10 | |
Quality of sleep T1 | 3.32 (0.92) | 1 | 5 | |
Quality of sleep T2 | 3.35 (0.89) | 1 | 5 | |
Parental rules Internet T1 (strict) | 1078 (53.3%) | |||
Parental rules smartphone T1 (strict) | 934 (46.2%) | |||
Non-responders at T2 | 608 (30%) |
3.2. Correlations
Correlations between all variables of interest can be found in Table S1. Both the frequency of social media use and problematic social media use were correlated significantly and positively with bedtime and negatively with perceived quality of sleep. This indicates that more frequent use of social media and more problematic social media use indicated later bedtime and a poorer quality of sleep. In addition, strict parental rules about using the Internet in the hour before going to sleep and taking the smartphone to the bedroom when going to sleep were significantly related to less frequent social media use, fewer symptoms of problematic use, earlier bedtime, and better quality of sleep. Finally, boys reported higher sleep quality and a later bedtime compared to girls, and older adolescents reported a lower sleep quality (at T2 only) and a later bedtime compared to younger adolescents.
3.3. Social Media Use, Problematic Social Media Use, and Sleep
The model testing the effects of the frequency of social media use on sleep outcomes showed an acceptable fit to the data (CFI = 0.998, RMSEA = 0.03). The frequency of social media use at T1 had a significant effect on bedtime at T2 (Table 2), indicating that more frequent use of social media predicts later bedtime one year later (β = 0.14, p < 0.001). The frequency of social media use did not significantly predict the perceived quality of sleep.
Table 2.
Bedtime T2 | Quality of Sleep T2 | |||
---|---|---|---|---|
Frequency of Social Media Use | β | SE | β | SE |
Gender (ref = girls) | 0.09 ** | 0.02 | 0.04 | 0.02 |
Age | 0.15 ** | 0.03 | −0.08 * | 0.03 |
Educational level (ref = higher) | −0.02 | 0.03 | 0.01 | 0.02 |
Bedtime T1 | 0.49 ** | 0.03 | - | - |
Quality of sleep T1 | - | - | 0.58 ** | 0.02 |
Frequency social media use T1 | 0.14 ** | 0.03 | −0.04 | 0.02 |
Problematic Social Media Use | β | SE | β | SE |
Gender (ref = girls) | 0.07 ** | 0.02 | 0.04 | 0.02 |
Age | 0.15 ** | 0.03 | −0.08 * | 0.03 |
Educational level (ref = higher) | −0.01 | 0.03 | 0.01 | 0.02 |
Bedtime T1 | 0.52 ** | 0.03 | - | - |
Quality of sleep T1 | - | - | 0.58 ** | 0.02 |
Problematic social media use T1 | 0.07 * | 0.02 | −0.03 | 0.02 |
Frequency of Social Media Use and Problematic Social Media Use | β | SE | β | SE |
Gender (ref = girls) | 0.09 ** | 0.02 | 0.04 | 0.02 |
Age | 0.15 ** | 0.03 | −0.08 * | 0.03 |
Educational level (ref = higher) | −0.02 | 0.03 | 0.01 | 0.02 |
Bedtime T1 | 0.49 ** | 0.03 | - | - |
Quality of sleep T1 | - | - | 0.58 ** | 0.02 |
Frequency social media use T1 | 0.13 ** | 0.03 | −0.03 | 0.02 |
Problematic social media use T1 | 0.04 | 0.03 | −0.03 | 0.03 |
Note. β = standardized coefficient; SE = standard error. * p < 0.01. ** p < 0.001.
The model testing the effects of problematic social media use also showed an acceptable fit to the data (CFI = 0.997, RMSEA = 0.03). The effect of problematic social media use at T1 on bedtime at T2 (Table 2) was significant, implying that more problematic social media use predicted later bedtime one year later (β = 0.07, p < 0.01). The effect of problematic social media use on the perceived quality of sleep was non-significant.
When we tested the effects of the frequency of social media use and problematic social media use simultaneously (the combined model; Table 2), the model fit was also acceptable (CFI = 0.998, RMSEA = 0.03), but only the effect of the frequency of social media use on bedtime one year later was significant (β = 0.13, p < 0.01). The previously found effect of problematic use on later bedtimes was not significant (β = 0.04, n.s.).
3.4. The Moderating Role of Parental Rules
Four out of eight interaction effects between social media use and parental rules about access to the Internet/smartphone before bedtime on adolescents’ sleep were (at least marginally) significant. First, parental rules about using the Internet in the hour before going to sleep at T1 moderated the effect of the frequency of social media use at T1 (β = −0.17, p < 0.01) as well as the effect of problematic social media use at T1 (β = −0.24, p = 0.10) on the perceived quality of sleep at T2 (Figure 1A,B). In addition, parental rules about using the Internet in the hour before going to sleep at T1 moderated the effect of the frequency of social media use on bedtime at T2 (β = 0.12, p < 0.05; Figure 2A). Finally, parental rules about taking the smartphone to the bedroom when going to sleep at T1 moderated the effect of problematic social media use at T1 on the time adolescents go to sleep at T2 (β = 0.30, p < 0.05; Figure 2B). These findings indicated that strict parental rules seem to prevent subsequent sleep problems, i.e., low quality of sleep and delayed bedtime, particularly among adolescents who reported low levels of (problematic) social media use. Among adolescents who reported high levels of (problematic) social media use, strict parenting did not affect sleep quality or bedtime.
In the combined model that tested the effects of the frequency of social media use and problematic social media use simultaneously, three of the four previously found interactions were still (marginally) significant. We still found the moderating effect of rules about using the Internet in the hour before going to sleep at T1 on the relationship between frequency of social media use at T1 and quality of sleep (β = −0.13, p = 0.06) as well as on the relationship between problematic social media use at T1 and quality of sleep (β = −0.28, p = 0.06). Moreover, parental rules about taking the smartphone to the bedroom when going to sleep at T1 moderated the effect of problematic social media use at T1 on bedtime at T2 (β = 0.32, p < 0.05). The moderating effect of rules regarding Internet use in the hour before going to sleep on the relationship between social media use frequency and bedtime was no longer significant.
4. Discussion
The present study aimed to provide insight into the longitudinal relationship between social media use and adolescents’ sleep and clarify the parental role in protecting them against possible negative media influences. The longitudinal findings imply that more frequent use of social media and more problematic social media use predicted a later bedtime among adolescents one year later. However, the effects of frequency of social media use and problematic social media use on bedtime depended on the rules that parents set, i.e., strict parental rules on the Internet and smartphone use before going to sleep predicted an earlier bedtime, but only among adolescents who scored below average on the frequency of social media use and/or problematic social media use. In a similar vein, strict parental rules regarding Internet use in the hour before sleep predicted a better quality of sleep, but only among adolescents who scored below average on the frequency of social media use and/or problematic social media use. Among adolescents who used social media more frequently or reported more problematic social media use, strict parental rules did not predict a better quality of sleep and, therefore, did not prevent negative media influences on sleep.
Consistent with a cross-sectional study by Pieters et al. [48], the present longitudinal study suggests that restricting access to the Internet and smartphones before bedtime may be an effective parenting tool to improve adolescents’ bedtime habits as well as their sleep quality. In addition, the present study suggests that parental rules are only effective for adolescents who are less engaged with social media. Once adolescents become highly engaged social media users, restrictive parental rules no longer seem to have a protective effect on adolescents’ bedtime and sleep quality. A possible explanation for this finding may be that highly engaged social media users, including users who report problematic social media use, experience more stress and fear of missing out (FOMO [56]) when they are not allowed to check their social media late in the evening, for instance, because they experience a stronger urge to keep themselves updated all the time. In this regard, Cheever, Rosen, Carrier, and Chaves [57] showed that heavy daily users of mobile devices experienced more anxiety due to the fear of missing out when their access to these devices was denied compared to low and moderate daily users. Experiencing FOMO could prevent adolescents from falling asleep and/or lead to more restless sleep [58]. A second explanation relates to perceived social norms and expectations, as adolescents may not stop their social media use as they may experience fear of social disapproval when violating norms on steady online availability and prompt responding [59]. A third explanation may be that restrictive parental rules may provoke more conflicts with parents when adolescents are highly engaged in social media use and/or display signs of social media addiction. Mesch [60] showed that adolescents who use the Internet more frequently have more conflicts with their parents about such use. These parent–child conflicts (late in the evening) may evoke emotional insecurity [61] and physical and cognitive arousal, which may interfere with adolescents’ healthy sleep patterns. Therefore, more frequent and more problematic social media use seems to be associated with later bedtime and lower sleep quality. Moreover, strict rules about access to the Internet in the evening can protect against these negative influences, but only when adolescents have not yet developed a strong attachment to social media.
Both frequency of social media use and problematic social media use predicted a later bedtime. The relationship between frequency of use and bedtime remained significant after controlling for problematic social media use, indicating that this relationship is robust and does not result from the conceptual overlap between social media use intensity and problematic use. On the contrary, the relationship between problematic social media use and bedtime was non-significant when we controlled for the frequency of social media use. Nevertheless, we believe that this later finding is meaningful, as frequent use of social media can be regarded as a central characteristic of problematic use of social media, whereas intensive use of social media can easily exist without any signs of problematic use. Therefore, not finding a significant effect of problematic use on sleep after controlling for the frequency of use seems logical.
Finally, parental rules regarding social media use in the hour before going to sleep generated more convincing results than parental rules regarding taking a smartphone or tablet to the bedroom; therefore, they may be more effective in preventing sleep problems. These two parenting rules overlap, as preventing social media use in the hour before going to sleep also precludes using a smartphone or tablet inside the bedroom. Therefore, this parental rule may be more effective in improving bedtime and sleep quality in adolescents.
Strengths and Limitations
This study’s strengths include a longitudinal design with a one-year follow-up measurement and strict statistical tests in which we controlled for previous levels of the outcome variables and demographic factors. However, some limitations should be noted. First, data were based on adolescents’ self-reports. It would be valuable for future studies to use objective measures of social media use and sleep habits. Second, there are significant differences between participants who dropped out and who remained in this longitudinal study. Although these differences can be understood in light of the fact that more classes in the last year of lower-level secondary education dropped out, these differences still limit the unbiasedness of the sample and the generalizability of results. Third, some interaction effects were borderline significant. Yet, given the values of the standardized coefficients, the rigorous statistical tests, and the long-time-interval, we believe that these interaction effects should be considered meaningful, warranting further study. Finally, we did not assess factors such as (mental) health problems and caffeine and nicotine consumption, which are known to affect adolescents’ sleep [62,63,64]. Therefore, future research should also include these factors.
5. Conclusions
As far as we know, this is the first study to test the longitudinal effects of (problematic) social media use on adolescents’ sleep and to model the potential buffering role of parental rules about Internet/smartphone use before going to sleep. The findings suggest that the intensity of social media use and the degree of problematic social media use play a critical role in adolescents’ tendency to delay their bedtime. Restricting access to the Internet and smartphones before going to sleep seems to be an effective way to optimize adolescents’ sleep time. This, however, is only the case if adolescents are not too engaged with social media. Once adolescents have developed these risky social media use patterns, strict parental rules regarding Internet and smartphone use before going to sleep no longer seem to influence bedtime and sleep quality. The current study extends our understanding of differential susceptibility to media effects [65] by indicating that the effect of social media use on sleep differs from adolescent to adolescent, and that these effects are not only dependent upon individual characteristics, but also on contextual factors such as parenting behaviors. More practically, based on these findings, parents should be advised to prohibit their children from using the Internet and smartphones in the evenings before they become highly involved in social media use or display symptoms of problematic social media use. Whether these parental rules will help prevent children from becoming highly involved social media users is not completely clear yet [46,47] and is an important question that should be addressed in future research.
Supplementary Materials
The following are available online at https://www.mdpi.com/1660-4601/18/3/1346/s1, Table S1: Correlations between all Study Variables.
Author Contributions
Conceptualization, R.J.J.M.v.d.E.; methodology, R.J.J.M.v.d.E. and V.G.v.d.R.; formal analysis, I.M.K.; investigation, R.J.J.M.v.d.E.; data curation, V.G.v.d.R.; writing—original draft preparation, R.J.J.M.v.d.E. and S.M.G.; writing—review and editing, I.M.K., T.F.M.t.B., V.G.v.d.R. and R.J.J.M.v.d.E.; visualization, I.M.K.; supervision, R.J.J.M.v.d.E.; project administration, R.J.J.M.v.d.E.; funding acquisition, R.J.J.M.v.d.E. All authors have read and agreed to the published version of the manuscript.
Funding
This work received financial support from the Dutch ”Christine Bader Foundation Irene KinderZiekenhuis”. This funding source was not involved in the study design; in the collection, analysis and interpretation of data; in the writing of the report, or in the decision to submit the article for publication.
Institutional Review Board Statement
The study was approved by the Ethics Committee of Social and Behaviroal Sciences of Utrecht University (FETC16-076).
Informed Consent Statement
Participation was voluntary and anonymous, and informed consent was obtained from adolescents, parents, and schools.
Data Availability Statement
The data presented in this study are available on request from the corresponding author. The data are not publicly available yet because, at the time if proofreading, we were stil in the process of making the data publicly available in an accessible repository.
Conflicts of Interest
The authors report no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Boer M., Van den Eijnden R.J.J.M. Hoofdstuk 8: Sociale media en Gamen [Chapter 8: Social media and gaming] In: Stevens G.W.J.M., van Dorsselaer S.A.F.M., Boer M., de Roos S.A., Duinhof E.L., Bogt T.F.M.T., van den Eijnden R.J.J.M., Kuyper L., Visser D., Vollebergh W.A.M., et al., editors. HBSC 2017: Gezondheid, Welzijn en de Sociale Context van Jongeren in Nederland [HBSC 2017: Health, Well-Being and the Social Context of Dutch Youth] University of Utrecht; Utrecht, The Netherlands: 2018. [DOI] [Google Scholar]
- 2.The Atlantic Have Smartphones Destroyed a Generation? [(accessed on 22 September 2020)]; Available online: https://www.theatlantic.com/magazine/archive/2017/09/has-the-smartphone-destroyed-a-generation/534198/
- 3.Zimmerman F.J. Children’s Media Use and Sleep Problems: Issues and Unanswered Questions. Research Brief. The Henry J. Kaiser Family Foundation; Menlo Park, CA, USA: 2008. [Google Scholar]
- 4.Curcio G., Ferrara M., de Gennaro L. Sleep loss, learning capacity and academic performance. Sleep Med. Rev. 2006;10:323–337. doi: 10.1016/j.smrv.2005.11.001. [DOI] [PubMed] [Google Scholar]
- 5.Fallone G., Owens J.A., Deane J. Sleepiness in children and adolescents: Clinical implications. Sleep Med. Rev. 2002;6:287–306. doi: 10.1053/smrv.2001.0192. [DOI] [PubMed] [Google Scholar]
- 6.Fallone G., Acebo C., Arnedt J.T., Seifer R., Carskadon M.A. Effects of acute sleep restriction on behavior, sustained attention, and response inhibition in children. Percept. Mot. Ski. 2001;93:213–229. doi: 10.2466/pms.2001.93.1.213. [DOI] [PubMed] [Google Scholar]
- 7.Dewald J.F., Meijer A.M., Oort F.J., Kerkof G.A., Bögels S.M. The influence of sleep quality, sleep duration and sleepiness on school performance in children and adolescents: A meta-analytic review. Sleep Med. Rev. 2010;14:179–189. doi: 10.1016/j.smrv.2009.10.004. [DOI] [PubMed] [Google Scholar]
- 8.Wolfson A.R., Carskadon M.A. Sleep schedules and daytime functioning in adolescents. Child Dev. 1998;69:875–887. doi: 10.1111/j.1467-8624.1998.tb06149.x. [DOI] [PubMed] [Google Scholar]
- 9.Lovato N., Gradisar M. A meta-analysis and model of the relationship between sleep and depression in adolescents: Recommendations for future research and clinical practice. Sleep Med. Rev. 2014;18:521–529. doi: 10.1016/j.smrv.2014.03.006. [DOI] [PubMed] [Google Scholar]
- 10.Chen X., Beydoun M.A., Wang Y. Is sleep duration associated with childhood obesity? A systematic review and meta-analysis. Obesity. 2008;16:265–274. doi: 10.1038/oby.2007.63. [DOI] [PubMed] [Google Scholar]
- 11.Hersenstichting. [(accessed on 9 December 2020)]; Available online: https://www.hersenstichting.nl/app/uploads/2020/03/Def-Factsheet-Slaaponderzoek-Volwassenen1c21.pdf.
- 12.Cain N., Gradisar M. Electronic media use and sleep in school-aged children and adolescents: A review. Sleep Med. 2010;11:735–742. doi: 10.1016/j.sleep.2010.02.006. [DOI] [PubMed] [Google Scholar]
- 13.Van Den Eijnden R.J.J.M., Koning I.M., Doornwaard S., Van Gurp F., Ter Bogt T. The impact of heavy and disordered use of games and social media on adolescents’ psychological, social, and school functioning. J. Behav. Addict. 2018;7:697–706. doi: 10.1556/2006.7.2018.65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Boer M., Stevens G., Finkenauer C., Van den Eijnden R. ADHD-symptoms, social media use intensity, and social media use problems in adolescents: Investigating directionality. Child Dev. 2019;91:e853–e865. doi: 10.1111/cdev.13334. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Scott H., Woods H.C. Understanding links between social media use, sleep and mental health: Recent progress and current challenges. Curr. Sleep Med. Rep. 2019;5:141–149. doi: 10.1007/s40675-019-00148-9. [DOI] [Google Scholar]
- 16.Boer M., Stevens G., Finkenauer C., Koning I., Van den Eijnden R. Validation of the Social Media Disorder Scale in Adolescents: Findings from a Large-Scale Nationally Representative Sample. OSF Prepr. 2021 doi: 10.31219/osf.io/2fphx. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Pea R.D., Nass C., Meheula L., Rance M., Kumar A., Bamford H., Nass M., Simha A., Stillerman B., Yang S., et al. Media use, face-to-face communication, media multitasking, and social well-being among 8-to 12-year-old girls. Dev. Psychol. 2012;48:327–336. doi: 10.1037/a0027030. [DOI] [PubMed] [Google Scholar]
- 18.Woods H.C., Scott H. #Sleepyteens: Social media use in adolescence is associated with poor sleep quality, anxiety, depression and low self-esteem. J. Adolesc. 2016;51:41–49. doi: 10.1016/j.adolescence.2016.05.008. [DOI] [PubMed] [Google Scholar]
- 19.Scott H., Woods H.C. Fear of missing out and sleep: Cognitive behavioural factors in adolescents’ night-time social media use. J. Adolesc. 2018;68:61–65. doi: 10.1016/j.adolescence.2018.07.009. [DOI] [PubMed] [Google Scholar]
- 20.Arora T., Broglia E., Thomas G.N., Taheri S. Associations between specific technologies and adolescent sleep quantity, sleep quality, and parasomnias. Sleep Med. 2014;15:240–247. doi: 10.1016/j.sleep.2013.08.799. [DOI] [PubMed] [Google Scholar]
- 21.Fobian A.D., Avis K., Schwebel D.C. The Impact of media use on adolescent sleep efficiency. J. Dev. Behav. Pediatr. JDBP. 2016;37:9–14. doi: 10.1097/DBP.0000000000000239. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Reynolds A.C., Meltzer L.J., Dorrian J., Centofanti S.A., Biggs S.N. Impact of high-frequency email and instant messaging (E/IM) interactions during the hour before bed on self-reported sleep duration and sufficiency in female Australian children and adolescents. Sleep Health. 2019;5:64–67. doi: 10.1016/j.sleh.2018.10.008. [DOI] [PubMed] [Google Scholar]
- 23.Akçay D., Akçay B.D. The influence of media on the sleep quality in adolescents. Turk. J. Pediatr. 2018;60:255–263. doi: 10.24953/turkjped.2018.03.004. [DOI] [PubMed] [Google Scholar]
- 24.Cajochen C., Frey S., Anders D., Späti J., Bues M., Pross A., Mager R., Wirz-Justice A., Stefani O. Evening exposure to a light-emitting diodes (LED)-backlit computer screen affects circadian physiology and cognitive performance. J. Appl. Physiol. 2011;110:1432–1438. doi: 10.1152/japplphysiol.00165.2011. [DOI] [PubMed] [Google Scholar]
- 25.Wright H.R., Lack L.C. Effect of light wavelength on suppression and phase delay of the melatonin rhythm. Chronobiol. Int. 2001;18:801–808. doi: 10.1081/CBI-100107515. [DOI] [PubMed] [Google Scholar]
- 26.Munezawa T., Kaneita Y., Osaki Y., Kanda H., Minowa M., Suzuki K., Higuchi S., Mori J., Yamamoto R., Ohida T. The association between use of mobile phones after lights out and sleep disturbances among Japanese adolescents: A nationwide cross-sectional survey. Sleep. 2001;34:1013–1020. doi: 10.5665/SLEEP.1152. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Gregory A.M., Willis T.A., Wiggs L., Harvey A.G., STEPS team Presleep arousal and sleep disturbances in children. Sleep. 2008;31:1745–1747. doi: 10.1093/sleep/31.12.1745. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Van der Schuur W.A., Baumgartner S.E., Sumter S.R. Social Media Use, Social Media Stress, and Sleep: Examining Cross-Sectional and Longitudinal Relationships in Adolescents. Health Commun. 2018;34:552–559. doi: 10.1080/10410236.2017.1422101. [DOI] [PubMed] [Google Scholar]
- 29.Vernon L., Barber B.L., Modecki K.L. Adolescent problematic social networking and school experiences: The mediating effects of sleep disruptions and sleep quality. Cyberpsychol. Behav. Soc. Netw. 2015;18:386–392. doi: 10.1089/cyber.2015.0107. [DOI] [PubMed] [Google Scholar]
- 30.Wolniczak I., Cáceres-DelAguila J.A., Palma-Ardiles G., Arroyo K.J., Solís-Visscher R., Paredes-Yauri S., Mego-Aquije K., Bernabe-Ortiz A. Association between Facebook dependence and poor sleep quality: A study in a sample of undergraduate students in Peru. PLoS ONE. 2013;8:e59087. doi: 10.1371/journal.pone.0059087. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Wong H.Y., Mo H.Y., Potenza M.N., Chan M.N.M., Lau W.M., Chui T.K., Pakpour A.H., Lin C.Y. Relationships between Severity of Internet Gaming Disorder, Severity of Problematic Social Media Use, Sleep Quality and Psychological Distress. Int. J. Environ. Res. Public Health. 2020;17:1879. doi: 10.3390/ijerph17061879. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Cheung L.M., Wong W.S. The effects of insomnia and Internet addiction on depression in Hong Kong Chinese adolescents: An exploratory cross-sectional analysis. J. Sleep Res. 2011;20:311–317. doi: 10.1111/j.1365-2869.2010.00883.x. [DOI] [PubMed] [Google Scholar]
- 33.Canan F., Yildirim O., Sinani G., Ozturk O., Unstunel T.Y., Ataoglu A. Internet addiction and sleep disturbance symptoms among Turkish high school students. Sleep Biol. Rhythm. 2013;11:210–213. doi: 10.1111/sbr.12022. [DOI] [Google Scholar]
- 34.Yen C.F., Ko C.H., Yen J.Y., Cheng C.P. The multidimensional correlates associated with short nocturnal sleep duration and subjective insomnia among Taiwanese adolescents. Sleep. 2008;31:1515–1525. doi: 10.1093/sleep/31.11.1515. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.An J., Sun Y., Wan Y., Chen J., Wang X., Tao F. Associations between Problematic Internet Use and Adolescents’ Physical and Psychological Symptoms: Possible Role of Sleep Quality. J. Addict. Med. 2014;8:282–287. doi: 10.1097/ADM.0000000000000026. [DOI] [PubMed] [Google Scholar]
- 36.Choi K., Son H., Park M., Han J., Kim K., Lee B., Gwak H. Internet overuse and excessive daytime sleepiness in adolescents. Psychiatry Clin. Neurosci. 2009;63:455–462. doi: 10.1111/j.1440-1819.2009.01925.x. [DOI] [PubMed] [Google Scholar]
- 37.Chen Y.L., Gau S.S.F. Sleep problems and Internet addiction among children and adolescents: A longitudinal study. J. Sleep Res. 2016;25:458–465. doi: 10.1111/jsr.12388. [DOI] [PubMed] [Google Scholar]
- 38.Nowell S.B., Thompson K. Relationship between Social Media Use and Sleep Quality of Undergraduate Nursing Students at a Southeastern University. [(accessed on 9 December 2020)]; Chancellor’s Honors Program Projects. Available online: https://trace.tennessee.edu/utk_chanhonoproj/2347.
- 39.Lee S.J. Parental restrictive mediation of children’s Internet use: Effective for what and for whom? New Media Soc. 2013;15:466–481. doi: 10.1177/1461444812452412. [DOI] [Google Scholar]
- 40.IVO. [(accessed on 9 December 2020)]; Available online: https://ivo.nl/wp-content/uploads/2018/09/Van-Rooij-Van-den-Eijnden-2007-Monitor-Internet-en-Jongeren-2006-en-2007.-Ontwikkelingen-in-internetgebruik-en-de-rol-van-opvoeding.pdf.
- 41.Kalmus V., Blinka L., Olafsson K. Does it matter what mama says: Evaluating the role of parental mediation in European adolescents’ excessive Internet use. Child. Soc. 2015;29:122–133. doi: 10.1111/chso.12020. [DOI] [Google Scholar]
- 42.Li X., Li D., Newman J. Parental behavioral and psychological control and problematic Internet use among Chinese adolescents: The mediating role of self-control. Cyberpsychol. Behav. Soc. Netw. 2013;16:442–447. doi: 10.1089/cyber.2012.0293. [DOI] [PubMed] [Google Scholar]
- 43.Chang F.C., Chiu C.H., Miao N.F., Chen P.H., Lee C.M., Chiang J.T., Pan Y.C. The relationship between parental mediation and Internet addiction among adolescents, and the association with cyberbullying and depression. Compr. Psychiatry. 2015;57:21–28. doi: 10.1016/j.comppsych.2014.11.013. [DOI] [PubMed] [Google Scholar]
- 44.Lee S.J., Chae Y.G. Children’s Internet use in a family context: Influence on family relationships and parental mediation. Cyberpsychol. Behav. 2007;10:640–644. doi: 10.1089/cpb.2007.9975. [DOI] [PubMed] [Google Scholar]
- 45.Van den Eijnden R.J.J.M., Spijkerman R., Vermulst A.A., van Rooij T.J., Engels R.C. Compulsive Internet use among adolescents: Bidirectional parent–child relationships. J. Abnorm. Child Psychol. 2010;38:77–89. doi: 10.1007/s10802-009-9347-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Koning I.M., Peeters M., Finkenauer C., van den Eijnden R.J.J.M. Bidirectional effects of Internet-specific parenting practices and compulsive social media and Internet game use. J. Behav. Addict. 2018;7:624–632. doi: 10.1556/2006.7.2018.68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Buxton O.M., Chang A.M., Spilsbury J.C., Bos T., Emsellem H., Knutson K.L. Sleep in the modern family: Protective family routines for child and adolescent sleep. Sleep Health. 2015;1:15–27. doi: 10.1016/j.sleh.2014.12.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Pieters D., De Valck E., Vandekerckhove M., Pirrera S., Wuyts J., Exadaktylos V., Haex B., Michiels N., Verbraecken, Cluydts R. Effects of pre-sleep media use on sleep/wake patterns and daytime functioning among adolescents: The moderating role of parental control. Behav. Sleep Med. 2014;12:427–443. doi: 10.1080/15402002.2012.694381. [DOI] [PubMed] [Google Scholar]
- 49.Van den Eijnden R.J.J.M., Lemmens J.S., Valkenburg P.M. The social media disorder scale. Comput. Hum. Behav. 2016;61:478–487. doi: 10.1016/j.chb.2016.03.038. [DOI] [Google Scholar]
- 50.Billieux J., Van Rooij A.J., Heeren A., Schimmenti A., Maurage P., Edman J., Blaszczynski A., Khazaal Y., Kardefelt-Winther D. Behavioural Addiction Open Definition 2.0—using the Open Science Framework for collaborative and transparent theoretical development. Addiction. 2017;112:1723–1724. doi: 10.1111/add.13938. [DOI] [PubMed] [Google Scholar]
- 51.Gadermann A., Guhn M., Zumbo B. Estimating Ordinal Reliability for Likert-Type and Ordinal Item Response Data: A Conceptual, Empirical, and Practical Guide. Pract. Assess. Res. Eval. 2012;17:1–13. doi: 10.7275/n560-j767. [DOI] [Google Scholar]
- 52.Meijman T.F., De Vries-Griever A.H.G., De Vries G., Kampman R. The Evaluation of the Groningen Sleep Quality Scale. Heijmans Bulletins; Groningen, The Netherlands: 1988. HB 88-13-EX. [Google Scholar]
- 53.Kandel D.B., Davies M. Epidemiology of depressive mood in adolescents: An empirical study. Arch. Gen. Psychiatry. 1982;39:1205–1212. doi: 10.1001/archpsyc.1982.04290100065011. [DOI] [PubMed] [Google Scholar]
- 54.Muthén L.K., Muthén B.O. Mplus User’s Guide. Muthén & Muthén; Los Angeles, CA, USA: 1998–2017. [Google Scholar]
- 55.Geiser C. Data Analysis with Mplus. Guilford; New York, NY, USA: 2013. [Google Scholar]
- 56.Scott H., Biello S.M., Woods H.C. Identifying drivers for bedtime social media use despite sleep costs: The adolescent perspective. Sleep Health. 2019;5:539–545. doi: 10.1016/j.sleh.2019.07.006. [DOI] [PubMed] [Google Scholar]
- 57.Cheever N.A., Rosen L.D., Carrier L.M., Chavez A. Out of sight is not out of mind: The impact of restricting wireless mobile device use on anxiety levels among low, moderate and high users. Comput. Hum. Behav. 2014;37:290–297. doi: 10.1016/j.chb.2014.05.002. [DOI] [Google Scholar]
- 58.Dahl R.E., Lewin D.S. Pathways to adolescent health sleep regulation and behavior. J. Adolesc. Health. 2002;31:175–184. doi: 10.1016/S1054-139X(02)00506-2. [DOI] [PubMed] [Google Scholar]
- 59.Scott H., Biello S., Woods H. Social media use and adolescent sleep patterns: Cross-sectional findings from the UK Millennium Cohort Study. BMJ Open. 2019;9:e031161. doi: 10.1136/bmjopen-2019-031161. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Mesch G.S. Family characteristics and intergenerational conflicts over the Internet. Inf. Commun. Soc. 2006;9:473–495. doi: 10.1080/13691180600858705. [DOI] [Google Scholar]
- 61.El-Sheikh M., Kelly R.J., Bagley E.J., Wetter E.K. Parental depressive symptoms and children’s sleep: The role of family conflict. J. Child Psychol. Psychiatry. 2012;53:806–814. doi: 10.1111/j.1469-7610.2012.02530.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Levenson J.C., Shensa A., Sidani J.E., Colditz J.B., Primack B.A. Social media use before bed and sleep disturbance among young adults in the United States: A nationally representative study. Sleep. 2017;40 doi: 10.1093/sleep/zsx113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Marmorstein N. Associations among Caffeine Use, Sleep, and Alcohol Use among Early Adolescents. J. Am. Acad. Child Adolesc. Psychiatry. 2017;56:S304. doi: 10.1016/j.jaac.2017.07.586. [DOI] [Google Scholar]
- 64.Patten C.A., Choi W.S., Gillin J.C., Pierce J.P. Depressive symptoms and cigarette smoking predict development and persistence of sleep problems in US adolescents. Pediatrics. 2000;106:e23. doi: 10.1542/peds.106.2.e23. [DOI] [PubMed] [Google Scholar]
- 65.Valkenburg P.M., Peter J. The differential susceptibility to media effects model. J. Commun. 2013;63:221–243. doi: 10.1111/jcom.12024. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The data presented in this study are available on request from the corresponding author. The data are not publicly available yet because, at the time if proofreading, we were stil in the process of making the data publicly available in an accessible repository.