Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2017 Nov 1.
Published in final edited form as: Addict Behav. 2016 Jun 14;62:65–72. doi: 10.1016/j.addbeh.2016.06.019

Longitudinal Psychosocial Factors Related to Symptoms of Internet Addiction among Adults in Early Midlife

Chenshu Zhang 1, Judith S Brook 1, Carl G Leukefeld 2, David W Brook 1
PMCID: PMC4955795  NIHMSID: NIHMS797537  PMID: 27341513

Abstract

In this longitudinal study, we applied structural equation modeling (SEM) to examine the psychosocial factors from adolescence to adulthood as related to symptoms of Internet addiction (IA) during early midlife. We gathered longitudinal data on a prospective cohort of community-dwelling men and women (N=548) followed from adolescence to early midlife (mean age=43; SD=2.8). The findings supported a meditational model: adolescent (mean age = 16) conflictual parent-child relationship was associated with internalizing problem behaviors at mean age 21 in emerging adulthood (b=.13, p<.01), which, in turn, were associated with both alcohol/drug use problems at mean age 27-32 (b=.24, p<.001) and affective disorders at mean age 37 (b=.29, p<.001), which, ultimately, were associated with symptoms of IA in early midlife (b=.23, p<.01; b=.21, p<.05, respectively). In addition, alcohol/drug use problems were associated with affective disorders (b=.22, p<0.05). Among the constructs, alcohol/drug use problems had the greatest total effects on symptoms of IA in early midlife (b=.28, p<.001). Findings suggest that family therapy focused on an increase in the affectionate relationship between the adolescent and his/her parents, cognitive-behavioral treatment of internalizing problem behaviors, and effective treatment of individuals who have alcohol/drug use problems may reduce the likelihood of having symptoms of IA in early midlife.

Keywords: symptoms of Internet addiction, midlife, affective disorders, alcohol and substance use problems, internalizing behaviors, conflictual parent-child relationship

Introduction

The Internet has dramatically changed the way people obtain information and communicate with others. Internet addiction (IA) (Young, 1998a), also known as problematic Internet use (Spada, 2014) or excessive Internet use (Hardie & Tee, 2007; Morrison & Gore, 2010), appears to be an expanding mental health problem worldwide (Cash, Rae, Steel, & Winkler, 2012; Griffiths, Kuss, Billieux, & Pontes, 2016; Kuss, Griffiths, Karila, & Billieux, 2014; Kuss, Van Rooij, Shorter, Griffiths, & van de Mheen, 2013; Müller, Glaesmer, Brähler, Woelfling, & Beutel, 2014; Young, 2015). The consequences of Internet addiction include physical illness, psychological distress, family/social problems, and low well-being (Cheung & Wong, 2011; Muusses, Finkenauer, Kerkhof, & Billedo, 2014; Weinstein et al., 2015; Wu et al., 2014; Yuan et al., 2011). In addition, high comorbidity of IA with affective disorders, substance use disorders, attention deficit hyperactivity disorder, and compulsive buying have also been documented (Bozkurt, Coskun, Ayaydin, Adak, & Zoroglu, 2013; Ko, Yen, Yen, Chen, & Chen, 2012; Lee, Han, Kim, & Renshaw, 2013; Muller et al., 2011; Yen, Ko, Yen, Wu, & Yang, 2007; Weinstein et al., 2015).

Young (1998a) developed the first IA screening measure, the Internet Addiction Diagnostic Questionnaire (IADQ), which consisted of 8 items and was adapted from the DSM-IV criteria for pathological gambling. These 8 items included preoccupation, tolerance, withdrawal, loss of control, longer than intended use, functional impairment, denial, and escapism. Young (1998b) also developed the Internet Addiction Test (IAT), which consisted of 20 items that measured mild, moderate, and severe levels of IA. Both IADQ and IAT are reliable and have criterion-related validity (Lai et al., 2013; Jelenchick, Becker, & Moreno, 2012; Pawlikowski, Altstötter-Gleich, & Brand, 2013; Widyanto & McMurren, 2004; Young, 2015). Young (1998a) found parallels between compulsive gambling and IA.

Since the pioneer work by Young (1998a; 1998b), IA has been widely documented for adolescents and young adults in both Western and Eastern societies (Young, 2015). However, the reported prevalence rates of IA in these studies varied considerably (Shaw & Black, 2008). Using IADQ, Bakken, Wenzel, Götestam, Johansson, and Øren (2009) reported a 1.0% IA rate in a sample of Norwegian adults. In a sample of 1,856 Iranian Internet users, 22.8% were found to be addicted to the Internet (Kheirkhah & Gouran, 2010). As of today, the appropriate classification of IA continues to be debated (Kuss et al., 2014). Many researchers consider IA as a behavioral addiction (Kuss et al., 2014; Robbins & Clark, 2015; Villella et al, 2011), because, in many respects, IA shares some features with other behavioral addictions, including pathological gambling (PG) and compulsive buying. Behavioral addictions also share some features with substance use disorders (Robbins & Clark, 2015). The acceptance of IA is evidenced by the recent inclusion of Internet Use Gaming Disorder in Section 1.3 of the DSM-V (American Psychiatric Association, 2013; Block, 2008; Robbins & Clark, 2015; Young, 2015).

Early midlife is a unique developmental period when the consequences of many physical/mental health problems become more manifest (e.g., Bromberger, Schott, Kravitz, & Joffe, 2015; Case & Deaton, 2015). However, little is known about the etiology of IA among adults in early midlife. Furthermore, to our knowledge, no study has examined the psychosocial pathways from adolescence to early midlife as they relate to IA in early midlife. This study addresses this issue and fills an important research gap in the literature. Our study will aid in the identification of the longitudinal psychosocial factors for symptoms of IA in early midlife. Family Interaction Theory (FIT) was used as the theoretical framework for our study (Brook, Brook, Gordon, Whiteman, & Cohen, 1990). FIT is a multidimensional conceptual model, explaining the development of substance use and addiction over time by postulating a developmental sequence of influences from multiple domains on the individual's behavior. Our model hypothesizes domains and pathways consistent with FIT's premise of a developmental sequence of multi-factorial influences of which the family is paramount. Consistent with FIT and relevant findings in the literature (see below), we hypothesized that the following constructs predict one's symptoms of IA in early midlife: (1) a conflictual parent-child relationship in adolescence; (2) internalizing behaviors in emerging adulthood (i.e., depressive mood, anxiety, and interpersonal difficulty); (3) alcohol and/or substance use problems at mean age 27-32, and (4) affective disorders at mean age 37 (i.e., Major Depressive Episode and General Anxiety Disorder). The hypothesized pathways linking these domains are presented in Figure 1.

Figure 1. Standardized Pathways (z-statistic) to Symptoms of Internet Addiction in Early Midlife (Mean age=43; N=548).

Figure 1

Note: 1. *p<.05; **p<.01;***p<.001; 2. RMSEA=.03, CFI=.99; 3. Age and gender were statistically controlled.

A conflictual parent-child relationship in adolescence may, in part, explain why individuals turn to virtual relationships as a substitute in later life for the poor parental bonding (Kalaitzaki & Birtchnell, 2014; Hardie & Tee 2007). The association between the adolescents' conflictual relationship with their parents and later IA may be mediated by other important psychosocial factors (Kalaitzaki & Birtchnell, 2014). According to FIT, children with a conflictual relationship with their parents are less likely to identify with and model parental pro-social behaviors and, therefore, may be at risk for internalizing problem behaviors (Brook et al., 1990). Often beginning in adolescence and extending to adulthood, internalizing problem behaviors are found to be associated with later substance use/problems (Khantzian & Albanese, 2008) and more severe mental health problems (e.g., affective disorders), which, in turn, may be associated with a higher likelihood of IA in early midlife (Ko et al., 2012; Young & Rogers, 1998).

Several studies have reported the positive association between substance use/problems and IA (Fisoun, Floros, Siomos, Geroukalis, & Navridis, 2012; Lee, et al., 2013; Ko, Yen, Yen, Chen, Weng, & Chen, 2008). However, it is still unclear whether substance use/problems are triggers for IA or vice versa, or whether there is a reciprocal association between IA and substance use/problems. IA and substance use may also serve as an expression of other underlying factors or disorders.

Affective disorders, such as depression and anxiety, were noted to be the psychiatric disorders most possibly associated with IA (Ko et al., 2012; Yen et al., 2007). One possible explanation is that dysfunctional coping with problematic or stressful life events contributes to the development of IA (Brand, Laier, & Young, 2014). Another possible explanation of the associations is the self-medication hypothesis (Young & Rogers, 1998), which suggests that IA may act as a form of self-medication among individuals who are depressed or anxious. In addition, the association between substance use/problems and IA (see above) may also, in part, occur via affective disorders. Research has shown that substance use/problems are associated with later depression and anxiety (Volkow, Baler, Compton, & Weiss, 2014). Substance use may influence mood regulation by altering neurotransmitters, such as dopamine, in the regulatory systems, thus resulting in long-term changes in the reward circuitry in the brain and an elevated risk for depression and anxiety. Individuals with elevated depression and anxiety may, in turn, rely on Internet use to at least temporarily gain relief from depression and/or anxiety.

Hypotheses

Based on the theoretical framework (i.e. FIT) and the empirical evidence, we hypothesized that: 1) conflictual parent-child relationships in adolescence (mean age=16) are associated with internalizing problem behaviors at mean age 21 in emerging adulthood; 2) internalizing problem behaviors are associated with both alcohol/drug use problems at mean age 27-32 and affective disorders at mean age 37, which, ultimately, are associated with symptoms of IA in early midlife (mean age=43); 3) the association between alcohol/drug use problems at mean age 27-32 and symptoms of IA in early midlife, in part, is mediated by affective disorders at mean age 37; and 4) there is a direct association between internalizing problem behaviors and symptoms of IA.

In sum, operating within a life-span developmental perspective, we applied a prospective longitudinal design and followed youngsters in a community sample from adolescence into early midlife. Born in 1970 on average, this cohort of participants had no prior history of Internet use in their childhood and adolescence, because the Internet did not exist at that time. Thus, this cohort of participants provide us with a unique opportunity to study how earlier psychosocial factors are associated with initiating and developing symptoms of a new psychiatric disorder (i.e., IA) at a later developmental period.

Methods

Participants and Procedure

The participants were members of a community sample residing in one of two upstate New York counties (Albany and Saratoga) when the sample was selected in 1975, Time 1 (T1). At that time, their mothers were interviewed. At the time the data were collected, the sampled families were generally representative of the population of families in the two upstate New York counties. There was a close match of the participants on family income, maternal education, and family structure with the 1980 Census. With regard to ethnicity, the sample was 90% white. Forty nine percent of the participants were females.

Interviews of both the mothers and participants were conducted in 1983, called Time 2 (T2, N = 756), 1985–1986, Time 3 (T3, N = 739), and in 1992, Time 4 (T4, N = 750). Four more interviews of only the participants were conducted in 1997, Time 5 (T5, N = 749), in 2002, Time 6 (T6, N = 673), in 2005–2006, Time 7 (T7, N = 607), and in 2012-2013, Time 8 (T8, N=548). Some of the participants who were not interviewed at some of the earlier time waves were interviewed at later waves. The present analysis (N=548) is based on data from T8 of the longitudinal study. Table 1 presents the detailed history of this longitudinal study.

Table 1. History of Data Collection.

Time Wave Year of Data Collection Sample Size Mean Age (Standard Deviation) Male Percentage
Time 1 (T1) 1975 (Childhood) 973 5.0 (2.8) 51.1%
Time 2 (T2) 1983 (Adolescence) 756 14.1 (2.8) 49.6%
Time 3 (T3) 1985-1986 (Late adolescence) 739 16.3 (2.8) 50%
Time 4 (T4) 1992 (Emerging adulthood) 750 22.3 (2.8) 49.6%
Time 5 (T5) 1997 (Late 20s) 749 27.0 (2.8) 50.1%
Time 6 (T6) 2002 (Early 30s) 673 31.9 (2.8) 47.4%
Time 7 (T7) 2005-2006 (Late 30s) 607 36.6 (2.8) 45.6%
Time 8 (T8) 2012-2013 (Early midlife) 548 43.0 (2.8) 45%

At T1-T7, extensively trained and supervised lay interviewers administered interviews in private. The T8 data collection involved an Internet-based self-administered questionnaire. Written informed consent was obtained from participants and their mothers in 1983, 1985-1986, and 1992, and from participants only in 1997, 2002, 2005-2006, and 2012-2013. The Institutional Review Board of the New York University School of Medicine authorized the use of human subjects in this research study. Earlier waves of the study were approved by the Institutional Review Boards of the Mount Sinai School of Medicine and New York Medical College. Additional information regarding the study methodology is available in prior publications (Cohen & Cohen, 1996).

Measures

Symptoms of Internet Addiction (IA) (Mean age=43)

We applied Young's IADQ (1998) to assess symptoms of IA at T8. The participants responded to 8 questions scored on a two-point scale [no (0) and yes (1); Cronbach's α = .91; Young, 1998a). Among these 8 items, 5 items relate to the tendency to use the Internet: (1) “Do you feel preoccupied with the Internet?” (2) “Do you feel the need to use the Internet with increasing amount of time in order to achieve satisfaction?” (3) “Have you repeatedly made unsuccessful efforts to control, cut back, or stop the use of the Internet?” (4) “Do you feel restless, moody, depressed, or irritable when attempting to cut down or stop Internet use?” and (5) “Do you stay online longer than you originally intended?” There are 3 items that relate to the impairment in the individual's daily functioning due to excessive Internet use: (1) “Have you jeopardized or risked the loss of a significant relationship, job, educational or career opportunity because of your use of the Internet?” (2) “Have you lied to family members, a therapist, or others to conceal the extent of your involvement in the Internet?” and (3) “Do you use the Internet as a way of escaping from problems or of relieving a dysphoric mood (e.g., feelings of helplessness, guilt, anxiety, depression)?”

Affective disorders (Mean age=37)

The latent construct of affective disorders in the late 30s consisted of Major Depressive Episode (MDE) and Generalized Anxiety Disorder (GAD), which were assessed at T7 using adaptations of the respective measures of the University of Michigan Composite International Diagnostic Interview (UM-CIDI) (Kessler et al., 1994). The measures have good predictive validity and test-retest reliability (Wittchen & Kessler, 1994). We adapted these measures to make them consistent with the diagnoses presented in the Diagnostic and Statistical Manual of Mental Disorders, 4th ed. (DSM-IV) (American Psychiatric Association, 1994; see Table 2 for the diagnosis criteria for each disorder).

Table 2. Complete Items for Selected Scales (or Diagnoses).

Child resistance to maternal control (Adolescence; Mean age=16) (Schaefer & Finkelstein, 1975) 2
  1. Does your child do what (he/she) wants to instead of what you tell (him/her)?

  2. Does your child often break your rules?

  3. Does your child try to see what (he/she) can get away with?

  4. Does your child seldom follow your orders unless you insist?

  5. Does your child seldom obey you unless you keep after (him/her)?

Alcohol and substance use problems (Mean age=27)1
  1. How often had you had trouble at school or on the job/work because of your use of alcohol or drugs?

  2. How often had you drove unsafely because of your use of alcohol or drugs?

  3. How often had you had arguments/fights with family/friends because of your use of alcohol or drugs?

  4. How often had you had trouble with the police because of your use of alcohol or drugs?

  5. How often had you become depressed or lost interest in things because of your use of alcohol or drugs?

  6. How often had you had health problems because of your use of alcohol or drugs?

  7. How often had you got less work done than usual at school or on the job because of your use of alcohol or drugs?

Major Depressive Episode (Mean age=37)(American Psychiatric Association, 1994; Kessler et al., 1994)
Diagnosis: At least 5 of the following symptoms, including 1 and/or 2, must have been present during a period in the past 5 years.
  1. Consistently depressed or down most of the day, nearly every day.

  2. Markedly diminished interest or pleasure in all, or almost all, activities.

  3. Significant weight loss when not dieting or weight gain.

  4. Hypersomnia or insomnia nearly every day.

  5. Psychomotor agitation or retardation.

  6. Feeling tired nearly every day.

  7. Feeling worthlessness or inappropriate guilt.

  8. Problems concentrating.

  9. Recurrent thoughts about death.

Generalized Anxiety Disorder (Mean age=37)(American Psychiatric Association, 1994; Kessler et al., 1994)
Diagnosis: Criterion A and At least 5 of the following symptoms, including 1 and 2, must have been present during a 6-month period in the past 5 years.
  1. Within the last 5 years, have you ever had a period lasting 6 months or more when you would worry excessively or were anxious about several things?

  1. During this period of 6 months or more, were these worries present most days?

  2. Was it difficult to control the worries or the worries interfered with your ability to focus on what you were doing?

  3. During this period of 6 months or more in which you were anxious, did you most of the time…
    1. Feel restless.
    2. Feel tired or weak.
    3. Feel tense.
    4. Feel irritable.
    5. Have sleep problems.
    6. Difficulty concentrating.

Note:

1

The same items were also assessed for alcohol and substance use problems (Mean age=32);

2

The same items were also assessed for child resistance to paternal control (Adolescence; Mean age=16).

Other latent constructs

We also hypothesized the following latent constructs: (1) Conflictual parent–child relationship in adolescence (mean age=16; two manifest variables reported by the participants' mothers, i.e., T3 child resistance to maternal control and T3 child resistance to paternal control [Schaefer & Finkelstein, 1975]; see Table 2 for the items in each scale); (2) Internalizing behaviors in emerging adulthood (mean age=21; three manifest variables, i.e., T4 depressive mood, T4 anxiety, and T4 interpersonal difficulties [Derogatis, 1994]); (3) Alcohol and substance use problems at mean age 27-32 (two manifest variables, i.e., T5 alcohol and substance use problems and T6 alcohol and substance use problems [Original]; see Table 2 for the complete set of items). Table 3 presents the sample questions, number of items, and the Cronbach's alpha for each manifest variable cited above.

Table 3. Psychosocial Scales, Number of Items, Sample Items, and Cronbach's Alpha.

Scale Number of Items Sample Item Cronbach's Alpha

Dependent variable
Symptoms of Internet Addiction (Mean age=43) 8 Do you feel preoccupied with the Internet? .70
Independent latent constructs and manifest variables
Conflictual parent-child relationship (Mean age=16)
 Child resistance to maternal control 5 Does your child do what (he/she) wants to instead of what you tell (him/her)? .90
 Child resistance to paternal control 5 Does your child do what (he/she) wants to instead of what his/her father tell (him/her)? .88
Internalizing behaviors (Mean age=21)
 Depressive mood 5 Over the last few years, how much were you bothered by feeling low in energy or slowed down? .78
 Anxiety 4 Over the last few years, how much were you bothered by feeling fearful? .68
 Interpersonal difficulty 6 Over the last few years, how much were you bothered by feeling easily annoyed or irritated with other people? .79
Alcohol and substance use problems (Mean age=27 - 32)
 Alcohol and substance use problems (Mean age=27) 7 How often have you had trouble with the police because of your use of alcohol or drugs? .79
 Alcohol and substance use problems (Mean age=32) 7 How often have you had trouble with the police because of your use of alcohol or drugs? .85
Affective disorders (Mean age=37)
 Major Depressive Episode (MDE) 9 During the past five years, has there been a time during which you have been consistently depressed or down most of the day, nearly every day, for at least two weeks in a row? N.A.
 Generalized Anxiety Disorder (GAD) 8 During the past five years, have you ever had a period lasting six months or more when you worried excessively or were anxious about several things most of the days? N.A.

Data Analysis

There were no statistically significant differences between participants included in the analyses (N=548) and those who did not participate (N=208) with respect to T2 age and family socioeconomic status (SES, e.g. parental educational level and income of the family of origin). However, there was a greater percentage of female participants (55.1% vs. 39.9%; χ2(1) = 14.72, p-value < .001) among participants who were included in the analyses, as compared to those who did not participate.

A latent variable structural equation model (SEM) was used. To have more statistical power, we used the mean of the 8 items for symptoms of IA as the dependent variable in the present SEM analysis. To account for the influences of the participant's gender and age at T8, we used a partial correlation matrix as the input matrix (see Table 4 for the partial correlation matrix). This was created by statistically partialing out (removing the effect of) the baseline measure of the variables cited above on each of the original manifest variables in the present analyses. Our proposed model was estimated using Mplus (Muthén & Muthén, 2010). The Mplus (Muthén & Muthén, 2010) default option was used (i.e., full information maximum likelihood approach; FIML) to treat missing data. The advantage of FIML is that the results are less likely to be biased even if the data are not missing completely at random (Muthén, Kaplan, & Hollis, 1987). To account for the non-normal distribution of the model variables, we used the Mplus maximum likelihood with robust standard errors (MLR) as the estimator. We chose two fit indices to assess the fit of the models: (1) the root mean square error of approximation (RMSEA) and (2) Bentler's comparative fit index (CFI) (Bentler, 1990). Values between .90 and 1.0 on Bentler's CFI and values below .10 on the RMSEA indicate that the model provides a good fit to the data (Kelloway, 1998). We also calculated the standardized total effects, which equal the sum of the direct and the indirect effects of each latent or manifest variable estimated in the analysis on the dependent variable.

Table 4. Partial Pearson's Correlation Matrix.

Var1 Var2 Var3 Var4 Var5 Var6 Var7 Var8 Var9 Var10
Var1 1.0
Var2 .12** 1.0
Var3 .19*** .37*** 1.0
Var4 .18*** .08 .18*** 1.0
Var5 .26*** .06 .17*** .60*** 1.0
Var6 .17*** .17*** .18*** .14*** .13*** 1.0
Var7 .11* .13** .21*** .17*** .13** .71*** 1.0
Var8 .15*** .20*** .18*** .19*** .19*** .76*** .74*** 1.0
Var9 .08 .07 .08 .02 .11* .10* .03 .12** 1.0
Var10 .12** .05 .06 .01 .09* .12** .04 .10* .73*** 1.0

Note:

1. Var1 = Symptoms of Internet addiction (Mean age=43); Var2 = Major depressive episode (Mean age=37); Var3 = Generalized anxiety disorder (Mean age=37); Var4 = Alcohol and substance use problems (Mean age=27); Var5 = Alcohol and substance use problems (Mean age=32); Var6 = Depressive mood (Mean age=21); Var7 = Anxiety (Mean age=21); Var8 = Interpersonal difficulty (Mean age=21); Var9 = Child resistance to maternal control (Mean age=16); Var10 = Child resistance to paternal control (Mean age=21);

2.

*

p<.05;

**

p<.01;

***

p<.001.

In addition, for comparison, we also used the indicator variable for IA as the dependent variable in the SEM analyses. While there is continued discussion of the appropriate cutoff score (e.g., 3 criteria or 5 criteria) in diagnosing IA (Dowling & Quirk, 2009; Young, 2015), as suggested by Dowling and Quirk (2009), the cutoff criterion score of 3 was used in diagnosing IA.

Results

Descriptive Statistics

Table 6 presents the response ranges, means, and standard deviations of the dependent, independent, and control variables used in the SEM analyses. In the sample, 5.9% (n=32) reported having 3 or more of the 8 IA symptoms; 1.8% (n=10) reported having 5 or more symptoms.

Table 6. Descriptive Statistics of the Dependent, Independent, and Control Variables (N=548).

Variables Coding Mean (SD) or %
Symptoms of Internet Addiction (Mean age=43) No (0) – Yes (1) .08 (.13)
Affective disorders (Mean age=37)
 Major Depressive Episode (MDE) No (0) – Yes (1) 13%
 Generalized Anxiety Disorder (GAD) No (0) – Yes (1) 12%
Alcohol and substance use problems (Mean age=27 – 32)
 Alcohol and substance use problems (Mean age=27) Once or never (1) – Five times or more (4) 1.31 (.49)
 Alcohol and substance use problems (Mean age=32) Once or never (1) – Five times or more (4) 1.25 (.46)
Internalizing Behaviors (Mean age=21)
 Depressive mood Not at all (1) – Extremely (5) 2.12 (.70)
 Anxiety Not at all (1) – Extremely (5) 2.14 (.71)
 Interpersonal difficulty Not at all (1) – Extremely (5) 2.08 (.66)
Conflictual parent-child relationship (Mean age=16)
 Resistance to maternal control Not at all like my child (1) – Very much like my child (4) 1.77 (.7)
 Resistance to paternal control Not at all like my child (1) – Very much like my child (4) 1.64 (.66)
Control variables
Age Years 43 (2.8)
Gender Female (0) – Male (1) 45% (Male)

The SEM results using the indicator variable for IA (3 symptoms or more) were not appreciably different from using the mean score of IA. We present the results from using the mean score.

Path Analyses

For the measurement model, all factor loadings were significant (p<.001), showing that the indicator variables were satisfactory measures of the latent constructs (see Table 5 for the factor loadings). The RMSEA and the Bentler's CFI were .03 and .99, respectively, reflecting a satisfactory model fit. The obtained path diagram along with the standardized regression coefficients are depicted in Figure 1.

Table 5. SEM Model: Standardized Factor Loadings.

Factor1 Factor2 Factor3 Factor4 Factor5
Var1 1.0
Var2 .51***
Var3 .71***
Var4 .72***
Var5 .84***
Var6 .85***
Var7 .83***
Var8 .90***
Var9 .85***
Var10 .86***

Note:

1. Var1 = Symptoms of Internet addiction (Mean age=43); Var2 = Major depressive episode (Mean age=37); Var3 = Generalized anxiety disorder (Mean age=37); Var4 = Alcohol and substance use problems (Mean age=27); Var5 = Alcohol and substance use problems (Mean age=32); Var6 = Depressive mood (Mean age=21); Var7 = Anxiety (Mean age=21); Var8 = Interpersonal difficulty (Mean age=21); Var9 = Child resistance to maternal control (Mean age=16); Var10 = Child resistance to paternal control (Mean age=21);

2. Factor1 = Symptoms of Internet addiction (Mean age=43); Factor2 = Affective disorders (Mean age=37); Factor3 = Alcohol and substance use problems (Mean age=27-32); Factor4 = Internalizing behaviors (Mean age=21); Factor 5 = Conflictual parent-child relationships (Mean age=16);

3.

***

p<.001.

The results partially supported our major hypotheses. Specifically, adolescent (mean age=16) conflictual parent-child relationship was associated with internalizing problem behaviors at mean age 21 in emerging adulthood (b=.13, p<.01). This, in turn, was associated with both alcohol/drug use problems at mean age 27-32 (b=.24, p<.001) and affective disorders at mean age 37 (b=.29, p<.001). Alcohol and substance use problems were associated with symptoms of IA in early midlife (b=.23, p<.01) and affective disorders was associated with symptoms of IA (b=.21, p<.05). In addition, alcohol/drug use problems were associated with affective disorders (b=.22, p<.05). The direct association between internalizing problem behaviors in emerging adulthood and symptoms of IA in early midlife was not statistically significant (b=0.05, p=0.95; data not shown in the figure).

Standardized Total Effects and Indirect (Mediation) Effects

Table 7 presents the results of the total effects analyses. As shown in Table 7, each of the latent constructs had significant total effects (p<.05) on symptoms of IA in early midlife. Among the constructs, alcohol/drug use problems had the greatest total effects on symptoms of IA in early midlife (b=.28, p<.001). There was a significant mediational effect from internalizing behaviors in emerging adulthood on symptoms of IA via later alcohol/drug use problems and affective disorders (b=.13, p<.001).

Table 7. Standardized Total Effects (z-statistic) and Indirect Effects (z-statistic) of Independent Latent Constructs on Symptoms of Internet Addiction in Early Midlife (Mean age=43; N=548).

Independent Constructs Standardized Total Effects (z-statistic) Standardized Indirect Effects (z-statistic)

Conflictual parent-child relationship (Mean age=16) .02 (2.08)* .02 (2.08)*
Internalizing behaviors (Mean age=21) .13 (3.78)*** .13 (3.78)***
Alcohol and substance use problems (Mean age=27-32) .28 (3.87)*** .05 (1.72)
Affective disorders (Mean age=37) .21 (2.54)* Not Applicable

Note: 1.

*

p<.05;

**

p<.01,

***

p<.001;

2. Age and gender were statistically controlled.

Discussion

To our knowledge, this is the first longitudinal study to examine the psychosocial factors from adolescence to adulthood as related to symptoms of IA in early midlife. In contrast to prior mostly cross-sectional studies, this study included prospective data spanning six time points collected over the course of nearly 30 years. In accord with the results of studies on risk and resilience factors for IA (Kuss, Griffiths, Karila, & Billieux, 2014; Young, 2015), our research emphasized the roles played by social factors and psychological factors. More specifically, our investigation mapped a longitudinal sequence from early parent-child relationships to later internalizing behaviors, substance use problems, and affective disorders, which, ultimately, are associated with symptoms of IA in early midlife.

Consistent with FIT, a conflictual parent-child relationship in adolescence has a significant total effect on an individual's symptoms of IA in early midlife, such that individuals who had a greater conflictual parent-child relationship in adolescence may have more symptoms of IA in early midlife. In accord with FIT, the findings illuminate some of the mechanisms (i.e., later internalizing behaviors, substance use problems, and affective disorders) by which the earlier family relationship is related to symptoms of IA in early midlife. Internalizing behavior was an important mediator along this developmental pathway. It not only predicted more substance use problems, but also, a higher likelihood of affective disorders in adulthood, which in turn, are related to symptoms of IA in early midlife. These findings are consistent with the results of Kalaitzaki and Birtchnell (2014), who found that early parental bonding had an indirect impact on adult IA, through mediators such as sadness in later life.

In accord with Lee et al. (2013), we found that among the latent constructs, substance use problems had the greatest total effects on symptoms of IA in early midlife. The evidence from studies of neurobiology suggests that IA is similar in its neurocircuitry to other addictions such as substance use disorders. Hong et al. (2013) found that male adolescents with IA have significantly decreased cortical thickness in the right lateral orbitofrontal cortex (OFC). OFC is also considered as the most implicated frontal cortical areas in drug addiction (Volkow & Fowler, 2000). Kim, Baik, Park et al. (2011) found that individuals with IA showed reduced levels of dopamine D2 receptor availability in subdivisions of the striatum. Similarly, reductions in dopamine D2 receptors have been observed in individuals addicted to cocaine, marijuana, or alcohol (Volkow, Fowler, Wang, Baler, & Telang, 2009). The development of an addictive syndrome, therefore, may place people with the syndrome at increased risk for their continuing addictive behaviors and for developing new addictive behaviors (Shaffer et al., 2004). Therefore, it is possible that both drug use and IA activate similar reward mechanisms, which involve immediate relief of stress, anxiety, and depression. Despite these possibilities, at present, the etiology of IA is not known, although as with other complex behavioral disturbances, it may have contributions from developmental, neurobiological, and cultural factors.

The association between earlier substance use problems and later symptoms of IA was partially mediated via its association with a higher likelihood of affective disorders. In this study, the latter served as the most proximal factors to symptoms of IA. The comorbidity between IA and a variety of psychiatric disorders, including depression and social anxiety has been widely documented (Bozkurt et al., 2013; Ko et al., 2012; Morrison & Gore, 2010; Weinstein, et al., 2015; Young & Rogers, 1998). For example, Bozkurt et al. (2013) found high rates of psychiatric comorbidity, particularly behavioral, anxiety and mood disorders, in young people with IA. It is possible that affective disorders, such as depression, provoke a spontaneous action and pushes an individual to reduce tension. Relief from this tension thus becomes a primary motivation for symptoms of IA.

Limitations

Some limitations should be noted. First, the present study relies on self-reported measures, which may be problematic in terms of their reliability and validity. However, many of the measures are reliable and have predictive validity. Second, earlier measures of symptoms of IA were not available. Third, this study is limited because the sample was comprised of predominantly white participants. Therefore, the findings may not be generalizable to racial/ethnic minority groups or individuals living in other parts of the country. Future research should examine the pathways in more diverse populations. Fourth, the construct of symptoms of IA consisted of one manifest variable. The study would benefit from multiple manifest variables. In addition, we only have information on generalized symptoms of IA, which cover a broad range of Internet-related activities. According to Montag et al. (2015), there exist distinct forms of specific IA, such as online gaming and pornography viewing. Future research should examine the potentially different pathways to generalized IA vs. specific IA. Fifth, some participants were lost due to attrition. Had these nonparticipants been included in the analyses, it might have resulted in greater variability, which may have strengthened the results. Sixth, IA is a relatively new phenomenon. Particularly, the pathway from earlier alcohol/substance use problems to later symptoms of IA might be an artifact due to the historical development of the Internet. If the availability of the Internet in the adolescent participants (born in 1970s) had been as it is today, it might well be that some individuals would have used the Internet excessively instead of (or before) using alcohol or drugs.

Conclusions

Despite these limitations, the results of this research emphasize the significance of taking a lifespan perspective when identifying the predictors of symptoms of IA. Our results are consistent with FIT which emphasizes the mediators between conflictual parent-child relationships and symptoms of IA. The mediators in this study include internalizing problem behaviors, alcohol/drug use problems, and affective disorders.

From an intervention perspective, family therapy focused on an increase in the affectionate relationship between the adolescent and his/her parents, cognitive-behavioral treatment of internalizing problem behaviors, and the effective treatment of individuals who have alcohol/drug use problems may reduce their likelihood of having symptoms of IA in early midlife.

Research Highlights.

  • A conflictual parent-child relationship predicted later symptoms of IA

  • Alcohol/substance use problems had the greatest total effects on symptoms of IA

  • Affective disorders mediated between psychosocial factors and symptoms of IA

Acknowledgments

The authors wish to thank Dr. Stephen J. Finch for his critical review of this manuscript. This research was supported by NIH grants DA003188 and DA032603 from the National Institute on Drug Abuse awarded to Dr. Judith S. Brook.

Footnotes

Conflict of Interest: The authors have no conflicts of interest to report.

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

References

  1. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 4th. Washington, DC: American Psychiatric Association; 1994. [Google Scholar]
  2. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th. Arlington, VA: American Psychiatric Publishing; 2013. [Google Scholar]
  3. Bakken IJ, Wenzel HG, Götestam KG, Johansson A, Øren A. Internet addiction among Norwegian adults: A stratified probability sample study. Scandinavian Journal of Psychology. 2009;50(2):121–127. doi: 10.1111/j.1467-9450.2008.00685.x. [DOI] [PubMed] [Google Scholar]
  4. Bentler PM. Comparative fit indexes in structural models. Psychological Bulletin. 1990;107(2):238–246. doi: 10.1037/0033-2909.107.2.238. [DOI] [PubMed] [Google Scholar]
  5. Block JJ. Issues for DSM-V: Internet Addiction. American Journal of Psychiatry. 2008;165(3):306–307. doi: 10.1176/appi.ajp.2007.07101556. [DOI] [PubMed] [Google Scholar]
  6. Bozkurt H, Coskun M, Ayaydin H, Adak I, Zoroglu SS. Prevalence and patterns of psychiatric disorders in referred adolescents with internet addiction. Psychiatry and Clinical Neurosciences. 2013;67(5):352–359. doi: 10.1111/pcn.12065. [DOI] [PubMed] [Google Scholar]
  7. Brand M, Laier C, Young KS. Internet addiction: coping styles, expectancies, and treatment implications. Frontiers in psychology. 2014;5(1256):1–14. doi: 10.3389/fpsyg.2014.01256. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Bromberger JT, Schott L, Kravitz HM, Joffe H. Risk factors for major depression during midlife among a community sample of women with and without prior major depression: are they the same or different? Psychological medicine. 2015;45(08):1653–1664. doi: 10.1017/S0033291714002773. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Brook JS, Brook DW, Gordon AS, Whiteman M, Cohen P. The psychological etiology of adolescent drug use: A family interactional approach. Genetic, Social, and General Psychology Monographs. 1990;116(2):111–267. [PubMed] [Google Scholar]
  10. Case A, Deaton A. Rising morbidity and mortality in midlife among white non-Hispanic Americans in the 21st century. Proceedings of the National Academy of Sciences. 2015;112(49):15078–15083. doi: 10.1073/pnas.1518393112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Cash H, Rae CD, Steel AH, Winkler A. Internet addiction: A brief summary of research and practice. Current Psychiatry Reviews. 2012;8(4):292–298. doi: 10.2174/157340012803520513. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Cheung LM, Wong WS. The effects of insomnia and Internet addiction on depression in Hong Kong Chinese adolescents: An exploratory cross - sectional analysis. Journal of Sleep Research. 2011;20(2):311–317. doi: 10.1111/j.1365-2869.2010.00883.x. [DOI] [PubMed] [Google Scholar]
  13. Cohen P, Cohen J. Life Values and Adolescent Mental Health. Mahwah, NJ: Lawrence Erlbaum Associates; 1996. [Google Scholar]
  14. Derogatis LR. Symptoms checklist 90-R: Administration scoring and procedures manual. 3rd. Minneapolis, MN: National Computer Systems; 1994. [Google Scholar]
  15. Dowling NA, Quirk KL. Screening for Internet dependence: Do the proposed diagnostic criteria differentiate normal from dependent Internet use? Cyberpsychology & Behavior. 2009;12(1):21–27. doi: 10.1089/cpb.2008.0162. [DOI] [PubMed] [Google Scholar]
  16. Fisoun V, Floros G, Siomos K, Geroukalis D, Navridis K. Internet addiction as an important predictor in early detection of adolescent drug use experience—implications for research and practice. Journal of Addiction Medicine. 2012;6(1):77–84. doi: 10.1097/ADM.0b013e318233d637. [DOI] [PubMed] [Google Scholar]
  17. Griffiths MD, Kuss DJ, Billieux J, Pontes HM. The evolution of Internet addiction: A global perspective. Addictive Behaviors. 2016;53:193–195. doi: 10.1016/j.addbeh.2015.11.001. [DOI] [PubMed] [Google Scholar]
  18. Hardie E, Tee MY. Excessive internet use: The role of personality, loneliness and social support networks in internet addiction. Australian Journal of Emerging Technologies and Society. 2007;5(1):34–47. [Google Scholar]
  19. Hong SB, Kim JW, Choi EJ, Kim HH, Suh JE, Kim CD, et al. Yi SH. Reduced orbitofrontal cortical thickness in male adolescents with internet addiction. Behavioral and Brain Functions. 2013;9(11):9081–9089. doi: 10.1186/1744-9081-9-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Jelenchick LA, Becker T, Moreno MA. Assessing the psychometric properties of the Internet Addiction Test (IAT) in US college students. Psychiatry Research. 2012;196(2):296–301. doi: 10.1016/j.psychres.2011.09.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Kalaitzaki AE, Birtchnell J. The impact of early parenting bonding on young adults' Internet addiction, through the mediation effects of negative relating to others and sadness. Addictive Behaviors. 2014;39(3):733–736. doi: 10.1016/j.addbeh.2013.12.002. [DOI] [PubMed] [Google Scholar]
  22. Kelloway EK. Using LISREL for structural equation modeling: A researcher's guide. 1st. Thousand Oaks, CA: Sage Publications, Inc; 1998. [Google Scholar]
  23. Kessler RC, McGonagle KA, Zhao S, Nelson CB, Hughes M, Eshleman S, et al. Kendler KS. Lifetime and 12-month prevalence of DSM-III-R psychiatric disorders in the United States: Results from the National Comorbidity Survey. Archives of General Psychiatry. 1994;51(1):8–19. doi: 10.1001/archpsyc.1994.03950010008002. [DOI] [PubMed] [Google Scholar]
  24. Khantzian EJ, Albanese MJ. Understanding addiction as self medication: Finding hope behind the pain. New York: Rowman & Littlefield Publishers; 2008. [Google Scholar]
  25. Kheirkhah F, Gouran A. Internet addiction, prevalence and epidemiological features in Mazandaran Province, Northern Iran. Iranian Red Crescent Medical Journal. 2010;2010(2):133–137. [Google Scholar]
  26. Kim SH, Baik SH, Park CS, Kim SJ, Choi SW, Kim SE. Reduced striatal dopamine D2 receptors in people with internet addiction. Neuroreport. 2011;22(8):407–411. doi: 10.1097/WNR.0b013e328346e16e. [DOI] [PubMed] [Google Scholar]
  27. Ko CH, Yen JY, Yen CF, Chen CS, Chen CC. The association between internet addiction and psychiatric disorder: A review of the literature. European Psychiatry. 2012;27(1):1–8. doi: 10.1016/j.eurpsy.2010.04.011. [DOI] [PubMed] [Google Scholar]
  28. Ko CH, Yen JY, Yen CF, Chen CS, Weng CC, Chen CC. The association between internet addiction and problematic alcohol use in adolescents: The problem behavior model. Cyberpsychology & Behavior. 2008;11(5):571–576. doi: 10.1089/cpb.2007.0199. [DOI] [PubMed] [Google Scholar]
  29. Kuss DJ, Van Rooij AJ, Shorter GW, Griffiths MD, van de Mheen D. Internet addiction in adolescents: Prevalence and risk factors. Computers in Human Behavior. 2013;29(5):1987–1996. [Google Scholar]
  30. Kuss DJ, Griffiths MD, Karila L, Billieux J. Internet addiction: A systematic review of epidemiological research for the last decade. Current Pharmaceutical Design. 2014;20(25):4026–4052. doi: 10.2174/13816128113199990617. [DOI] [PubMed] [Google Scholar]
  31. Lai CM, Mak KK, Watanabe H, Ang RP, Pang JS, Ho RC. Psychometric properties of the internet addiction test in Chinese adolescents. Journal of Pediatric Psychology. 2013;38(7):794–807. doi: 10.1093/jpepsy/jst022. [DOI] [PubMed] [Google Scholar]
  32. Lee YS, Han DH, Kim SM, Renshaw PF. Substance abuse precedes internet addiction. Addictive behaviors. 2013;38(4):2022–2025. doi: 10.1016/j.addbeh.2012.12.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Montag C, Bey K, Sha P, Li M, Chen YF, Liu WY, et al. Reuter M. Is it meaningful to distinguish between generalized and specific Internet addiction? Evidence from a cross - cultural study from Germany, Sweden, Taiwan and China. Asia - Pacific Psychiatry. 2015;7(1):20–26. doi: 10.1111/appy.12122. [DOI] [PubMed] [Google Scholar]
  34. Morrison CM, Gore H. The relationship between excessive internet use and depression: A questionnaire-based study of 1,319 young people and adults. Psychopathology. 2010;43(2):121–126. doi: 10.1159/000277001. [DOI] [PubMed] [Google Scholar]
  35. Müller KW, Glaesmer H, Brähler E, Woelfling K, Beutel ME. Prevalence of internet addiction in the general population: Results from a German population-based survey. Behaviour & Information Technology. 2014;33(7):757–766. [Google Scholar]
  36. Müller A, Mitchell JE, Peterson LA, Faber RJ, Steffen KJ, Crosby RD, Claes L. Depression, materialism, and excessive internet use in relation to compulsive buying. Comprehensive Psychiatry. 2011;52(4):420–424. doi: 10.1016/j.comppsych.2010.09.001. [DOI] [PubMed] [Google Scholar]
  37. Muthén LK, Muthén BO. Mplus User's Guide. 6th. Los Angeles, CA: Muthén & Muthén; 2010. [Google Scholar]
  38. Muthén BO, Kaplan D, Hollis M. On structural equation modeling with data that are not missing completely at random. Psychometrika. 1987;52(3):431–462. [Google Scholar]
  39. Muusses LD, Finkenauer C, Kerkhof P, Billedo CJ. A longitudinal study of the association between compulsive internet use and wellbeing. Computers in Human Behavior. 2014;36:21–28. [Google Scholar]
  40. Pawlikowski M, Altstötter-Gleich C, Brand M. Validation and psychometric properties of a short version of Young's Internet Addiction Test. Computers in Human Behavior. 2013;29(3):1212–1223. [Google Scholar]
  41. Robbins TW, Clark L. Behavioral addictions. Current opinion in neurobiology. 2015;30:66–72. doi: 10.1016/j.conb.2014.09.005. [DOI] [PubMed] [Google Scholar]
  42. Schaefer ES, Finkelstein NW. Paper presented at the annual meeting of American Psychological Association. Chicago, IL: 1975. Child behavior toward parents: An inventory and factor analysis. [Google Scholar]
  43. Shaffer H, LaPlante D, LaBrie R, Kidman R, Donato A, Stanton M. Toward a syndrome model of addiction: Multiple expressions, common etiology. Harvard Review of Psychiatry. 2004;12(6):367–74. doi: 10.1080/10673220490905705. [DOI] [PubMed] [Google Scholar]
  44. Shaw M, Black DW. Internet addiction. CNS drugs. 2008;22(5):353–365. doi: 10.2165/00023210-200822050-00001. [DOI] [PubMed] [Google Scholar]
  45. Spada MM. An overview of problematic internet use. Addictive behaviors. 2014;39(1):3–6. doi: 10.1016/j.addbeh.2013.09.007. [DOI] [PubMed] [Google Scholar]
  46. Villella C, Martinotti G, Di Nicola M, Cassano M, La Torre G, Gliubizzi MD, et al. Conte G. Behavioural addictions in adolescents and young adults: Results from a prevalence study. Journal of Gambling Studies. 2011;27(2):203–214. doi: 10.1007/s10899-010-9206-0. [DOI] [PubMed] [Google Scholar]
  47. Volkow ND, Fowler JS. Addiction, a disease of compulsion and drive: Involvement of the orbitofrontal cortex. Cerebral Cortex. 2000;10(3):318–325. doi: 10.1093/cercor/10.3.318. [DOI] [PubMed] [Google Scholar]
  48. Volkow ND, Fowler JS, Wang GJ, Baler R, Telang F. Imaging dopamine's role in drug abuse and addiction. Neuropharmacology. 2009;56(Suppl 1):3–8. doi: 10.1016/j.neuropharm.2008.05.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Volkow ND, Baler RD, Compton WM, Weiss SR. Adverse health effects of marijuana use. New England Journal of Medicine. 2014;370(23):2219–2227. doi: 10.1056/NEJMra1402309. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Weinstein A, Dorani D, Elhadif R, Bukovza Y, Yarmulnik A, Dannon P. Internet addiction is associated with social anxiety in young adults. Annals of Clinical Psychiatry. 2015;27(1):3. [PubMed] [Google Scholar]
  51. Widyanto L, McMurren M. The psychometric properties of the internet addiction test. Cyberpsychology & Behavior. 2004;7(4):445–453. doi: 10.1089/cpb.2004.7.443. [DOI] [PubMed] [Google Scholar]
  52. Wittchen HU, Kessler RC. Modifications of the CIDI in the National Comorbidity Survey: The development of the UM-CIDI. [Accessed March 14, 2016];1994 Available at http://www.hcp.med.harvard.edu/ncs/ftpdir/um-cidi.pdf.
  53. Wu K, Politis M, O'Sullivan SS, Lawrence AD, Warsi S, Lees A, Piccini P. Problematic Internet use in Parkinson's disease. Parkinsonism & Related Disorders. 2014;20(5):482–487. doi: 10.1016/j.parkreldis.2014.01.019. [DOI] [PubMed] [Google Scholar]
  54. Yen JY, Ko CH, Yen CF, Wu HY, Yang MJ. The comorbid psychiatric symptoms of internet addiction: Attention deficit and hyperactivity disorder (ADHD), depression, social phobia, and hostility. Journal of Adolescent Health. 2007;41(1):93–98. doi: 10.1016/j.jadohealth.2007.02.002. [DOI] [PubMed] [Google Scholar]
  55. Young KS. Internet addiction: The emergence of a new clinical disorder. Cyberpsychology & Behavior. 1998a;1(3):237–244. [Google Scholar]
  56. Young KS. Caught in the Net. New York: John Wiley & Sons; 1998b. [Google Scholar]
  57. Young KS. The evolution of internet addiction disorder. In: Montag C, Reuter M, editors. Internet Addiction. Switzerland: Springer International Publishing; 2015. pp. 3–17. [Google Scholar]
  58. Young KS, Rogers RC. The relationship between depression and internet addiction. Cyberpsychology & Behavior. 1998;1(1):25–28. [Google Scholar]
  59. Yuan K, Qin W, Wang G, Zeng F, Zhao L, Yang X, et al. Tian J. Microstructure abnormalities in adolescents with internet addiction disorder. PloS one. 2011;6(6):e20708. doi: 10.1371/journal.pone.0020708. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES