Skip to main content
PMC home page
UKPMC Funders Author Manuscripts logoLink to UKPMC Funders Author Manuscripts
. Author manuscript; available in PMC: 2018 Jun 1.
Published in final edited form as: Addict Behav. 2018 Feb 12;81:157–166. doi: 10.1016/j.addbeh.2018.02.017

Problematic internet use as an age-related multifaceted problem: evidence from a two-site survey

Konstantinos Ioannidis a,b, Matthias S Treder c, Samuel R Chamberlain a,b, Franz Kiraly d, Sarah A Redden e, Dan J Stein f, Christine Lochner g, Jon E Grant e
PMCID: PMC5849299  EMSID: EMS76237  PMID: 29459201

Abstract

Background and aims

Problematic internet use (PIU; otherwise known as Internet Addiction) is a growing problem in modern societies. There is scarce knowledge of the demographic variables and specific internet activities associated with PIU and a limited understanding of how PIU should be conceptualized. Our aim was to identify specific internet activities associated with PIU and explore the moderating role of age and gender in those associations.

Methods

We recruited 1749 participants aged 18 and above via media advertisements in an Internet-based survey at two sites, one in the US, and one in South Africa; we utilized Lasso regression for the analysis.

Results

Specific internet activities were associated with higher problematic internet use scores, including general surfing (lasso β:2.1), internet gaming (β:0.6), online shopping (β:1.4), use of online auction websites (β:0.027), social networking (β:0.46) and use of online pornography (β:1.0). Age moderated the relationship between PIU and role-playing-games (β:0.33), online gambling (β:0.15), use of auction websites (β:0.35) and streaming media (β:0.35), with older age associated with higher levels of PIU. There was inconclusive evidence for gender and gender × internet activities being associated with problematic internet use scores. Attention-deficit hyperactivity disorder (ADHD) and social anxiety disorder were associated with high PIU scores in young participants (age ≤ 25, β:0.35 and 0.65 respectively), whereas generalized anxiety disorder (GAD) and obsessive-compulsive disorder (OCD) were associated with high PIU scores in the older participants (age > 55, β:6.4 and 4.3 respectively).

Conclusions

Many types of online behavior (e.g. shopping, pornography, general surfing) bear a stronger relationship with maladaptive use of the internet than gaming supporting the diagnostic classification of problematic internet use as a multifaceted disorder. Furthermore, internet activities and psychiatric diagnoses associated with problematic internet use vary with age, with public health implications.

Keywords: internet addiction, behavioral addiction, internet gaming disorder, problematic internet use, lasso, machine learning

Introduction

Problematic internet use (PIU; otherwise known as Internet Addiction), is a public health concern in modern societies across the globe. The epidemiology of PIU is still unclear (Ho et al., 2014; C.-H. Ko, Yen, Yen, Chen, & Chen, 2012) with a wide range of reported point prevalence estimates (1% to 36.7%), likely reflecting not only population differences but also the diversity of assessment tools and different operational definitions of PIU behaviors. DSM-5 has highlighted Internet gaming disorder as a condition for further study (American Psychiatric Association, 2013), specifically excluding other internet based activities like gambling and use of social media, despite the accumulating evidence that problematic internet use is a multifaceted problem that goes beyond online gaming (Király et al., 2014; Kuss & Lopez-Fernandez, 2016; Lopez-Fernandez, 2015). Many different online behaviors have been described as being capable of impairing normal functioning when undertaken to excess, including online gaming and massively-multiplayer online role-playing-games (Achab et al., 2011; Cole & Hooley, 2013; Chih-Hung Ko, Yen, Yen, Lin, & Yang, 2007; Lecardeur, 2013; Lopez-Fernandez, 2015; Masten & Tellegen, 2012), online gambling (Griffiths, 2003; King & Barak, 1999), online shopping (Claes, Müller, & Luyckx, 2016; Rose & Dhandayudham, 2014; Trotzke, Starcke, Müller, & Brand, 2015), viewing pornography (Brand et al., 2011; King, 1999; Laier, Pawlikowski, Pekal, Schulte, & Brand, 2013), frequent email checking, instant messaging (Igarashi, Motoyoshi, Takai, & Yoshida, 2008; Rutland, Sheets, & Young, 2007; Yuen, Lavin, Weinman, & Kozak, 2004) and overuse of social media (Kuss & Griffiths, 2011; Kuss, Griffiths, & Binder, 2013). Online behaviors can also cause concern for individuals’ physical health (Király, Griffiths, & Demetrovics, 2015; Tam & Walter, 2013) or lay the ground for criminal acts (Recupero, 2008). Impulsive and compulsive characteristics may underpin problematic internet behaviors (Block, 2008; Cao, Su, Liu, & Gao, 2007; Claes et al., 2016; Ioannidis et al., 2016; Trotzke et al., 2015), while specific internet activities have been linked with psychiatric disorders; for example, online shopping has been linked with depression and hoarding (Claes et al., 2016).

Young people and students are considered to be most vulnerable for PIU (Bakken, Wenzel, Götestam, Johansson, & Oren, 2009; Janower, 2006; Kuss et al., 2013; Kuss & Lopez-Fernandez, 2016; Wallace, 2014), but middle-aged and older populations have not been comprehensively investigated. Young age has been associated with problematic online shopping (Mueller et al., 2010; Trotzke et al., 2015). However, there have been a number of studies identifying problematic internet activities, including excessive internet based shopping, in adult populations (Rose & Dhandayudham, 2014). Overall, the natural history of problematic internet use is still unknown and there may be age related differences in PIU overall, or in different problematic online behaviors.

PIU has been considered to have a male preponderance (Shaw & Black, 2008; Tsai et al., 2009) and is likely more prevalent among Asian male youth, but females can also be vulnerable (Ha & Hwang, 2014; Xin et al., 2018). On a clinical level, the majority of PIU studies included male participants only (Kuss & Lopez-Fernandez, 2016) and it is unclear whether female clinical populations may have been understudied. There is some evidence from observational studies that males and females differ in the way they operate in the online environment in terms of activities they choose and their negative consequences (Ha & Hwang, 2014; Liang, Zhou, Yuan, Shao, & Bian, 2016). Excessive use of chatting and social media has been associated with female gender in young students (Andreassen, Torsheim, Brunborg, & Pallesen, 2012; Fernández-Villa et al., 2015; Kittinger, Correia, & Irons, 2012; Kuss & Griffiths, 2011; S Laconi, Andréoletti, Chauchard, Rodgers, & Chabrol, 2016). Female gender has also been identified as a predictor of problematic online shopping (Rose & Dhandayudham, 2014), but the opposite has also been reported (Fernández-Villa et al., 2015; S Laconi et al., 2016). Online gaming has been associated with male gender (Fernández-Villa et al., 2015), but massively multiplayer online role-play gaming has been reported in both genders (Achab et al., 2011). Online pornography as well as online gambling have been reported to be more frequent among adult males (S Laconi et al., 2016), however, it has been argued that the role of reward reinforcement, cue reactivity and craving of online sex are similar for both genders (Laier et al., 2013). Particular platforms of social media with addictive potential, such as networking sites like Facebook, are used by both genders and it has been argued that females might be particularly at risk (Kuss et al., 2013). Overall, there might be gender-specific differences for aspects of PIU; alternatively, it may be that once clinical and behavioural characteristics/confounds are taken into account, both genders are similarly affected (Ioannidis et al., 2016; Király et al., 2014; Kuss et al., 2013).

Overall, problematic internet use including the wide variety of problematic internet behaviors require more rigorous investigations that would shed light onto which specific activities should be regarded as problematic or dysfunctional or in general contributing to the phenomenon described as PIU. The way in which age and gender moderate the relationship between particular internet activities and PIU has been understudied, warranting more attention.

Our objective was to identify specific internet-related activities statistically associated with PIU and whether there are interactions with age or gender that moderate those relationships.

Material and methods

Setting and measures

More details about the setting and measures of this study have also been described in our previous publication on PIU (Ioannidis et al., 2016). Reporting of methods for this study follows the STROBE guideline (von Elm et al., 2008). The current study was conducted from January 2014 – February 2015. Individuals aged 18 years and above were recruited at two sites: Chicago (USA) and Stellenbosch (South Africa) using internet advertisements (mean age 29 [18-77]; 1119 males [64%]; 1285 Caucasian [73%]). The advertisements asked individuals to take part in an online survey about internet use. Participants completed the survey anonymously using Survey Monkey software. The survey was sent through Craigslist so only participants from the specific locales were targeted. The study was approved by the institutional review boards at each research site. Participants received no compensation for taking part but were enrolled in a random lottery whereby five prizes were available with each prize valued between $50 and $200 in USA and three prizes between ZAR250 and ZAR750 in South Africa.

The online survey contained questions about each individual’s age, gender, race, relationship status, sexual orientation and education background, along with various measures of specific internet activities. We measured a number of different internet activities including 1) general surfing 2) internet gaming total 3) Online role playing games (RPG) 4) Time wasters/skill games (i.e. Apps on iPod/iPad/cell phone, Tetris, Jewels) 5) Online action multiplayer (i.e. Call of Duty, Gears of War) 6) Online shopping 7) Auction websites (i.e. Ebay) 8) Online gambling 9) Social networking 10) Online sports (i.e. Fantasy sports, ESPN) 11) Pornography/Sex on internet 12) Messaging/Blogging (i.e. AIM, Skype) and 13) Streaming videos/media (i.e. YouTube, Hulu). The survey also included clinical measures: the Internet Addiction Test (IAT) (Young 1998) to provide a measure of maladaptive internet use; select Mini International Neuropsychiatric Interview (MINI) modules (Sheehan et al., 1998) to identify probable social anxiety disorder (SAD), generalized anxiety disorder (GAD) and obsessive-compulsive disorder (OCD); the Adult ADHD Self-Report Scale Symptom Checklist (ASRS-v1.1) (Ronald C Kessler et al., 2005) to identify attention-deficit hyperactivity disorder (ADHD) symptoms; the Padua Inventory (PI) (Burns, Keortge, Formea, & Sternberger, 1996) to identify obsessive-compulsive tendencies; and the Barratt Impulsiveness Scale (BIS-11) to quantify impulsive personality (Patton, Stanford, & Barratt, 1995). Descriptive statistics for all variables are summarized and stratified by age in supplementary table S1a.

The IAT comprises 20 questions examining facets of PIU. Scores on the IAT range from 20-100 with 20-49 reflecting mild Internet use, 50-79 moderate Internet use, and 80-100 reflecting severe Internet use. The PI consists of 39 items assessing common obsessional and compulsive behavior. The BIS-11 is a self-report questionnaire used to determine levels of impulsiveness.

We performed a Principal Components Analysis (PCA) to identify whether a few components of internet activities would be able to account for a significant portion of the variance. However, this analysis showed that we required more than 11 out of 13 components to achieve >90% of variance indicating that a significant portion of the variables of internet activities contribute uniquely to the variance. We therefore decided to use each variable separately in our analysis.

Only data from participants who completed the entirety of the online survey, including the internet activity measures, were included in the analyses. The original sample included 2551 individuals. 63 individuals were excluded for lacking IAT scores. A further 18 individuals were excluded for reporting transgender gender and 459 for missing important predictor variables e.g. PI or BIS questionnaire scores. Five individuals were excluded for reporting age less than 18 years old. A further 257 individuals were excluded due to missing measures of internet activity. The final full set included 1749 individuals with complete scores on all variables. This last step of exclusion process accounts for the sample difference between the present study and Ioannidis et al. 2016. This final full set included 1063 individuals from the Stellenbosch site and 686 individuals from the Chicago site. The estimated point prevalence of PIU was ~8.5% using an IAT cut-off of 50 or above. Comparing the two study site populations, the Stellenbosch site had younger participants [mean(range) 24.3(18-76) vs 36.3(18-77), ANOVA F<0.05, η2: 0.20], a lower proportion of male gender [58% vs 73%, χ2 <0.05, φ:0.15], higher proportion of heterosexual sexual orientation [91% vs 84%, χ2 <0.05, φ:0.10], higher rates of ADHD [50% vs 41% χ2 <0.05, φ:0.9], lower rates of online shopping [mean(range) 0.48(0-5) vs 1.27(0-5), ANOVA F<0.05, η2: 0.18] and slightly lower IAT scores [mean(range) 30.3(20-94) vs 35.9(20-85), ANOVA F<0.05, η2: 0.06]. A more detailed comparison is presented in the supplemental Table S1b. Recruitment and exclusion process are graphically presented in Figure 1. All continuous variables (i.e. BIS score) were standardized to increase the interpretability of the model coefficients. The prediction methods used the IAT score as a numeric variable (Range 20-94, Mean 32.48). All analyses were undertaken in R Studio version 3.1.2. Lasso Generalized Linear Models were performed using the “glmnet” package (Package glmnet version 2.0-5 (Friedman, Hastie, & Tibshirani, 2010)). More details about the analysis process can be found in the supplement (methodology appendix).

Figure 1. Recruitment flow diagram.

Figure 1

Open in a new tab

Flow diagram describing recruitment and exclusion from main and subgroup analyses. ; IAT: Internet Addiction test; PI: Padua Inventory-Revised; BIS - Barratt Impulsiveness Scale 11; CHI – Chicago; SA – South Africa (Stellenbosch) (color print, 1.5 column fitting image)

Exploration of correlations

We explored correlations between the variables in our data (see Figure 2). All different internet activities had weak positive correlations with the IAT score (Pearson correlation coefficient range 0.23-0.48). Some moderate positive correlations between internet activity variables were identified i.e. total internet gaming and RPG (r=0.57), total internet gaming and action multiplayer games (r=0.55), online shopping and use of auction websites (r=0.55), general surfing and shopping (r=0.44), general surfing and social networking (r=0.44), general surfing and streaming media (r=0.44). There were weak positive correlations between sports and pornography (r=0.38), male gender and sports (r=0.30) or pornography (r=0.39) or action multiplayer gaming (r=0.27). There were weak correlations between online gambling and action multiplayer (r=0.41), RGP (r=0.32), auction websites (r=0.38), sports (r=0.38) or pornography (r=0.39). Impulsivity was weakly positively correlated with general surfing, online shopping, use of auction websites, social networking, streaming media and pornography (0.2 ≤ r ≤ 0.3). There was also a weak correlation between older age and shopping activities (r=0.33) or use of auction websites (r=0.22), and between non-heterosexual sexual orientation and pornography (r=0.22). All other correlations between internet activities and age, gender, relationship status, sexual orientation, level of education, race and levels of impulsivity and compulsivity were very weak (-0.2 < r < 0.2).

Figure 2. Exploratory correlation matrix of variables.

Figure 2

Open in a new tab

Pearson correlations between all variables. Positive correlations are indicated in green gradient colour, negative correlations are in red gradient. IAT.Total - Internet Addiction Score; PADUA - PADUA Inventory score; BIS - Barratt Impulsiveness Scale score; RPG - Online Role Playing games. (color print, two-column fitting image)

Dealing with over-fitting

For our statistical methods we used models that included demographic variables (age, race, education level, gender, relationship status, sexual orientation), clinical characteristics (diagnoses of ADHD, GAD, Social Anxiety and OCD), behavioral dimensions known to be associated with PIU (impulsivity and compulsivity), internet activities and interaction terms between Internet activities × Age or Gender; the latter was decided to test the hypothesis that age or gender moderate the relationship between internet activities and problematic internet use scores. We included a total of 51 predictor variables. By including a plethora of variables we aimed for a model that is more accurate and at the same time captures complex interactions between demographic and internet activity variables. However, the downside of having many predictor variables is that this typically leads to over-fitting accompanied by large coefficients. Furthermore, in-sample linear regression also tends to over-fit, especially in complex models, and is fundamentally flawed in making predictions on new data. There is extensive evidence of the downsides of over-fitting models (Huys, Maia, & Frank, 2016). To deal with over-fitting, we have discussed using out-of-sample statistical methods (cross-validation) to get an estimate of the generalization and prediction error of the model (Ioannidis et al., 2016). We explored this approach in our current data when we used an out-of-sample cross-validated estimation of the root-mean-squared-error in conjunction with backward selection of variables to test whether models improve by adding a high number of variables in the subsets of possible combinations of predictors, and we saw that sparse models (i.e. with about between 13 and 16 variables) were non-inferior in terms of cross-validated RMSE compared to more complex models (including more than 16 variables). This is shown in exploratory Figure 3 (top left).

Figure 3. Explanatory plots for cross-validated errors and Lasso coefficients.

Figure 3

Open in a new tab

Explanatory plots for cross-validated errors and Lasso coefficients (all participants n=1749). The first plot (top left) demonstrates the cross-validated root mean squared error (rmse.cv) as a function of number of variables included in the linear regression model. The plot demonstrates that adding more than ~16 variables in the model does not necessarily improve the model in terms of RMSE reduction. The second plot (top right) demonstrates the 10-fold cross-validated mean squared error as a function of (log) lambda (λ) for the lasso regularized model using the full data with interaction terms. The top numbering of the plot indicates the number of predictors (variables) the model is using, going from all predictors (top left corner) to more sparse models (top right corner). This function helps the optimization of Lasso in terms of choosing the best λ. The third plot (bottom left) shows the predictors coefficients scores as a function of log(λ) indicating the shrinkage of coefficients for larger numbers of log(λ). The top numbering of the plot indicates the number of predictors (variables) the model is using, going from all predictors (top left corner) to more sparse models (top right corner). The last plot (bottom right) shows the fraction of deviance explained by the models in relation to the number of predictors used and their coefficients. Each coloured line described a single predictor and its coefficient score. The plot shows that close to the maximum fraction of deviance explained larger coefficients occur indicating likely over-fitting of the model. (color print, two-column fitting image)

Regularised regression with sparsity constraints

For the reasons mentioned in the previous paragraph, we wanted to use a method of prediction that would not over-fit as much, while being comparable to standard statistical methods in terms of predicting PIU scores. It would also be valuable if our method could also do variable selection (i.e. by reducing the number of predictors with non-zero coefficients), in order to help with the interpretability of the model. Regularization, initially designed by Tikhonov to solve integral equations (Tikhonov, 1963) and later introduced in statistical science by Tibshirani (Tibshirani, 1996) has some of the desired aforementioned properties of shifting model construction towards sparsity and reducing over-fitting (Huys et al., 2016). Lasso (generalized linear model with penalized maximum likelihood, known as regression using Least Absolute Shrinkage and Selection Operator (Lasso or LASSO (Tibshirani, 1996))) is a regularization and regression analysis method now often used in medical sciences (Bujak, Daghir-Wojtkowiak, Kaliszan, & Markuszewski, 2016; Kim, Kang, Biswas, Liu, & Gao, 2016) and has potential for use in clinical prediction modelling in psychiatry (R C Kessler et al., 2016). Ridge regression is another form of regularized linear regression that shrinks coefficients by introducing a coefficient penalty (Hoerl & Kennard, 1970). The elastic-net is an intermediate model between ridge and lasso and its penalty is controlled by α, which bridges the gap between Lasso (α=1) and ridge (α=0). The tuning parameter λ controls the overall strength of the penalty. Lasso uses the L1 penalty and ridge uses the L2 penalty. In contrast to ridge regression, the effect of the Lasso L1 penalty is that most coefficients are driven to zero, leading to a regularized solution that is sparse at the same time. By this mechanism, the lasso performs variable selection which can greatly simplify interpretation especially if many predictors are involved in the model. Another non-standard method known for high accuracy and ability to avoid over fitting is random forests (Breiman, 2001). Random forests is a machine learning method that performs well against non-linear dependencies and therefore, exploring the performance of this model could give us insight into, possibly ‘hidden’, complex associations.

Prediction methods

To choose the appropriate model in our analysis, we compared linear regression, ridge regression, elastic-net, Lasso and random forest models with one another and against a naïve baseline, using a cross-validated out-of-sample estimate of RMSE. Our cross validation included randomly splitting the data in a training and testing set, tuning the model parameters in the training set and making predictions for IAT scores in the testing set. Due to the random nature of splitting the data into folds, we repeated this process 50 times to get a stable and replicable estimate. We then compared the final vectors of RMSE scores using Exact Wilcoxon-Pratt signed rank tests. All models were significantly superior to the naïve baseline (p corrected <.001, Cohen’s d = -0.87) (see supplemental table S2). Summary statistics of RMSE scores are presented in supplementary Table S3. Lasso and elastic net were superior to ridge regression (p-corrected < 0.01, d=0.51, d=0.49) and linear regression (p corrected <.001, d = 0.76) and not statistically different between each other (p corrected >.05, d = -0.08). Random forest was non-superior to either lasso (p=0.12) or elastic net (p corrected >.05). Therefore, in our analysis, we used Lasso, because, further to good out-of-sample prediction performance, Lasso was able to perform variable selection by shrinking coefficients to zero and therefore increasing interpretability. Although the elastic net can also perform variable selection, it tends to select more variables, and despite being a more complex and more powerful model, it did not give significantly better performance than lasso. In our final analysis full data and subgroup analyses, we used 10-fold cross-validation to produce the optimal lambda for each lasso model and report coefficients produced by those models. Explanatory plots deriving from the full data analysis are presented in Figure 3.

Results

Lasso regression results are summarized in the whole sample and stratified by age in Table 1 and Table 2. Full tables of results for subgroup analyses, including stratified by age and by study site are presented in the online Supplement tables (Tables S4-S10). Exploratory plots of the data are presented in supplementary figures (Figure S1-S3). Results from the more standard statistical approach of linear regression are also presented in Supplement Tables S4-S10 and any differences in structural inference compared to the main results presented below are conditional upon the choice of another model.

Table 1.

Lasso coefficients for internet activities stratified by age

Internet activity All (n= 1749) 18 ≤ Age ≤ 25
(n = 1042)		 26 ≤ Age ≤ 55
(n = 592)		 Age > 55
(n= 115)
General Surfing 2.100 2.400 1.500 0.590
Internet gaming 0.600 0.450 0.110 0.000
RPG 0.000 0.000 0.710 0.000
Time Wasters 0.000 0.000 0.000 0.450
Action Multiplayer 0.000 0.000 0.000 0.000
Shopping 1.400 0.840 1.500 0.000
Auction Websites 0.027 0.000 0.990 0.230
Gambling 0.000 0.000 0.780 0.000
Social networking 0.460 0.000 1.300 0.000
Sports 0.000 0.000 0.000 0.000
Pornography 1.000 1.400 0.210 0.000
Messaging 0.000 0.000 0.110 0.000
Streaming media 0.000 0.000 0.000 1.200
PADUA 0.074 0.085 0.029 0.065
BIS 0.066 0.048 0.072 0.086
ADHD Diagnosis 1.700 0.350 3.100 0.000
GAD Diagnosis 0.230 0.000 0.000 6.400
Social Anxiety Diagnosis 0.000 0.560 0.000 0.000
OCD Diagnosis 0.270 0.000 0.000 4.300
Open in a new tab

Lasso - least absolute shrinkage and selection operator; RPG - Role Playing games; PADUA: Padua Inventory-Revised Checking; BIS - Barratt Impulsiveness Scale 11; ADHD - Attention Deficit Hyperactivity Disorder; GAD – Generalized Anxiety disorder; OCD – Obsessive-Compulsive disorder

Table 2.

Lasso coefficients for demographics and interaction terms

Internet activity All
(n= 1749)		 18 ≤ Age ≤ 25
(n = 1042)		 26 ≤ Age ≤ 55
(n = 592)		 Age > 55
(n= 115)
Demographic variables 0.000 0.000 0.000 0.000
Gender x any Internet Activity 0.000 0.000 0.000 0.000
Age x General Surfing 0.000 - - -
Age x Internet Gaming 0.000 - - -
Age x RPG 0.330 - - -
Age x Time Wasters 0.000 - - -
Age x Action Multiplayer 0.000 - - -
Age x Shopping 0.000 - - -
Age x Gambling 0.150 - - -
Age x Auction Websites 0.350 - - -
Age x Social Networking 0.000 - - -
Age x Sports 0.000 - - -
Age x Pornography 0.000 - - -
Age x Messaging 0.000 - - -
Age x Streaming media 0.350 - - -
Open in a new tab

Lasso - least absolute shrinkage and selection operator; RPG - Role Playing games; Demographic variables are: Age, Gender, Race, Education, Relationship status and Sexual Orientation

Demographics

In lasso regression no variable including age, gender, race, education level, relationship status or sexual orientation was associated with PIU in any age subgroup or in the full data.

Internet Activities

In the full data Lasso regression, a number of internet activities were associated with high PIU scores including general surfing (β: 2.1), internet gaming (β: 0.6), online shopping (β: 1.4), use of auction websites (β: 0.027), social networking (β: 0.46) and use of online pornography (β: 1.0). The relationships between PIU and role-playing-games (RPGs), online gambling, use of auction websites and using streaming media were moderated by age (β: 0.33, 0.15, 0.35 and 0.35 respectively), with older age associated with higher PIU scores. In age-subgroup analysis (young participants age ≤ 25, middle age participants 25 < age ≤ 55; older participants age > 55), general surfing was associated with PIU in all age groups, but more strongly in the young (β: 2.4), less in the middle aged (β: 1.5), and even less in the older participants (β: 0.59). A similar trend was seen in internet gaming (β: 0.45, 0.11 and 0.0 for the three age groups respectively) and use of online pornography (β: 1.4, 0.21 and 0.0). Some internet activities such as use of online RPGs were more strongly associated with PIU in middle aged participants compared to other age groups (β: 0.71). The same was true for online gambling (β: 0.78), instant messaging (β: 0.11) and online social networking (β: 1.3). Use of auction websites was also more strongly associated with PIU in middle aged participants (β: 0.99), but also predictive in the older participants (β: 0.23). Streaming online media and use of time wasters were associated with PIU in the older participants (β: 1.2, 0.45 respectively), but not in any other age group.

Clinical and behavioral characteristics

Symptoms of attention-deficit hyperactivity disorder (ADHD) (β: 1.7), generalized anxiety disorder (GAD) (β: 0.23) and obsessive-compulsive disorder (OCD) (β: 0.27) were associated with higher PIU scores. In age-subgroup analysis, ADHD and SAD were associated with higher PIU scores in younger participants (β: 0.35 and 0.56 respectively), while ADHD remained significant in the middle-aged subgroup (β: 3.1). GAD and OCD were associated with higher PIU scores in the older participants subgroup (β: 6.4 and 4.3 respectively), but not in the other age groups. BIS scores (impulsive personality) and PADUA scores (obsessive-compulsive tendencies) were associated with higher PIU scores in the full data (β.: 0.066 and 0.074 respectively) and in all age subgroups analyses.

Discussion

This paper is the first attempt to comprehensively explore the different types of internet activities associated with maladaptive use of the internet, i.e. with problematic internet use. Previous work has generally tackled the issue of specific internet activities leading to problematic use by focusing on isolated internet activities (Achab et al., 2011; Claes et al., 2016; Griffiths, 2003; Chih-Hung Ko et al., 2007; Kuss & Griffiths, 2011). We have shown here that a range of internet activities, including general surfing, internet gaming, online shopping, use of auction websites, online gambling, social networking and use of online pornography contribute separately and uniquely to PIU, providing evidence that PIU is a complex phenomenon comprising a variety of problematic behaviors. Further to that, we have shown that those behaviors retain their statistically significant associations with PIU, even when psychiatric symptoms known to be associated with PIU (i.e. symptoms of ADHD, GAD and OCD) (Carli et al., 2013; Ho et al., 2014) and dimensions of behavior known to be predictive of PIU (i.e. personality measures of impulsivity and compulsivity)(Cao et al., 2007; Claes et al., 2016; Ioannidis et al., 2016; Trotzke et al., 2015) are taken into account. We have further demonstrated that specific internet activities like RPG, online gambling, use of auction websites and streaming media are associated with higher PIU scores and that this relationship is influenced by age. Finally, our data show that other types of online behavior (e.g. shopping, pornography, general surfing) bear a stronger relationship with maladaptive use of the internet than gaming and it is possible that this relates to the fact that previous studies have not included such a wide array of internet-related activities. These results have significant implications for the conceptualization of PIU as a clinically meaningful disorder, as they draw the attention away from the unidimensional and relatively narrow construct of ‘Internet gaming disorder’, towards a multidimensional entity of problematic internet use or internet addiction comprising multiple facets of human online behavior.

Moreover, using out-of-sample cross validation we have shown that the ‘non-standard’ approach of using Lasso regression is more accurate in predicting PIU scores as compared to the ‘more standard’ linear regression. Using out-of-sample estimation of the predictive value of a model often helps with tackling the phenomenon by which significances decay in replication studies. However, the choice of Lasso regression comes with the caveat that variables which are not selected by the model (with zero coefficients) can still be predictive, especially when there are high correlations between selected and non-selected variables. In our data set, we did not have any highly correlated variables, nevertheless, this limitation means that we should treat any negative results conservatively. For example, the lack of association between gender and PIU as well as the lack of association between gender × Internet activities with PIU arguably supports the hypothesis that if a wider range of PIU behaviors and potential confounders are taken into account, both genders are equally vulnerable to developing facets of PIU (Ioannidis et al., 2016; Király et al., 2014). However, due to the limitations of our analysis, we cannot exclude the possibility that other associations between PIU and gender exist. For example, it has been suggested that gender moderates the relationship between online shopping and PIU and that females may be more at risk (Rose & Dhandayudham, 2014). Of relevance may be that compulsive buying disorder, a disorder that is prominent in middle aged groups has a female predominance by 5:1 ratio (Black, 2007), and may be driving such findings. We did not have any data on this disorder to test this hypothesis. It is also important to note, that the IAT instrument used here has received critique on its lack of robustness concerning factor structure, differences from current DSM-5 operationalization (gaming disorder) and lagging behind the technological advances of internet applications (Khazaal et al., 2015; Stéphanie Laconi, Rodgers, & Chabrol, 2014). Future PIU research would be well served by methodologically robust, validated instruments, which would also be able to capture the quickly evolving nature of PIU from a technological and behavioral perspective.

Our age-subgroup analysis provided insight into the age related associations between PIU and various internet activities. The common conception that PIU is a disorder of youth is not necessarily correct and may be based on the lack of appropriately designed studies that capture online behaviors across all age groups. Insufficient knowledge for the natural history of PIU across the lifespan does not allow a comprehensive exploration of vulnerabilities in the older populations in terms of risk to develop PIU. However, our results indicate that those vulnerabilities do exist and further research is warranted to map out the characteristics of the populations at risk. For example, having ADHD or social anxiety symptoms may be a predictor for PIU in young populations, whereas having OCD or GAD symptoms may be a predictor for PIU in older populations. The fact that OCD was not found to be associated with PIU in a recent meta-analysis (Ho et al., 2014) may be an indicator that older populations have been understudied. The fact that ADHD was strongly associated with high PIU scores is not surprising, as other studies have reported a very high prevalence of ADHD (up to 100%) in PIU populations (Carli et al., 2013). At the same time, specific middle aged populations (between 26 and 55) may be more at risk of PIU, if they also suffer from compulsive buying disorder or gambling disorder, given the natural history of those disorders, which peak in middle age (Cunningham-Williams et al., 2005).

Furthermore, the findings that a particular online activity was associated with PIU only in specific age groups, imply that particular age groups may be at risk of developing aspects of PIU. While young people might be more at risk of developing PIU with a propensity for viewing pornography, a vulnerability that may be less strong in middle age and wane later on in life, older people might be more prone to develop PIU characterized by problematic use of time wasters and streaming media (see exploratory Figure 4). Finally, general surfing might be an underestimated facet of PIU, which seems to be more strongly associated with higher PIU scores in young people, but important across all age groups; this finding may be related to the fact that early adult life can be less goal directed and the young people are spending more time during unstructured activities in online environments compared to other older age groups.

Figure 4. Example exploratory figure of the association between Problematic internet use and streaming media, by age group.

Figure 4

Open in a new tab

This is an example figure showing the relationship between Problematic internet use (PIU) and streaming media grouped by age. The regression lines are linear models with confidence intervals (grey areas). Interestingly, streaming media appears to be less associated with PIU in the young age ≤ 25 as compared to older people > 55 (also shown in Lasso analysis in the main paper; Lasso coef Streaming media β: 0.0 for young and β: 1.2 for old, Age × Streaming Media interaction Lasso coef β: 0.35). (color print, single-column fitting image)

Our results also have public health implications in relation to the regulation of online content, and targeting interventions. If particular activities are more strongly linked with the development of problematic use than others, then the question arises as to whether public health policies should be targeting groups of vulnerable individuals to improve their resilience towards risk of PIU, or whether more universal interventions targeting specific facets of internet behaviors, should be considered to make the online environments less addictive. For example, online platforms may in some cases be using specific architectures that take advantage of users’ vulnerabilities (i.e. impulsive or compulsive traits) and that aim to maximize users’ length of stay within the online environment. While this makes sense from a marketing perspective, it does raise concern of whether these environments should also issue a health warning to the user.

Limitations

This was a cross-sectional online survey, therefore no causal relationships can be drawn. Moreover, because of the recruitment methodology, and possible propensity for people with PIU to be more likely to complete an online survey, the current findings may not generalize to PIU in the general background population at large. Another limitation of our study is the lack of clinical data for some diagnostic entities associated with PIU, for example depression or substance misuse. Therefore, it is possible that depression or substance misuse could account for some of the associations observed in our study. Future studies should include a wider range of clinical parameters to explore whether those account for associations observed between PIU and internet activities. There are further limitations in regards to our clinical data deriving from using the MINI; this is validated to be delivered from a trained person in a face-to-face interview whereas in our study it was delivered via an online tool. However, our clinical data are in agreement with previous studies in PIU. Furthermore, another downside to our data collection, was that we assessed internet activity using time spent on the activity as proxy measure for PIU of that activity. While this can capture excessive, and therefore problematic use, it can also possibly capture essential use. While the activities assessed in this study were often by default non-essential due to their nature (e.g. time wasters), or when they are performed in severe excess (e.g. more than 8h/day of shopping, gambling or pornography), future studies could include measures that can differentiate essential from non-essential internet use for each internet activity, to allow for such analyses. Another limitation of our study is the lack of data for children and adolescent populations. Children and adolescent populations may interact with the internet in a different way, but also are exposed to online use during a different neurodevelopmental window. Therefore, such differences may imply different vulnerabilities or resilience in terms of risk to develop PIU. For example, early, low level exposure to the online environment may have a ‘stress inoculation’ effect (Rutter, 1993) that steels individuals from future development of PIU. If such the case, this can further explain why older populations that only got their first exposure of online environments in adulthood may be more vulnerable. Future studies could include those child and adolescent age groups and examine prospectively whether specific internet activities are predictive of PIU. Unfortunately, the number of participants reporting transgender gender was small (n=18), which did not allow for a meaningful analysis of the effect of transgender gender. A final limitation of our study is that our study population consists of healthy adults who only in <1% suffer from significant PIU behaviors (IAT>80). Future studies would benefit from having a specific focus on the higher end of the PIU spectrum to be able to compare those severe PIU populations with a control group of low to moderate or non-PIU individuals. While the estimated point prevalence of PIU in our sample was ~8.5% (using IAT≥50 cut-off), the thresholds for clinical caseness for PIU remain contentious and future research would benefit from a universally accepted measure and definition of PIU.

Conclusion

To summarize, DSM-5 highlights internet gaming disorder as a candidate disorder, but other types of online behavior (e.g. shopping, pornography, general surfing) bear a stronger relationship with maladaptive use of the internet than gaming. Psychiatric diagnoses and internet activities associated with Problematic internet use vary with age, a finding that has public health implications. These results contribute to the limited knowledge about internet activities associated with problematic internet use and may contribute to the diagnostic classification of problematic internet use as a multifaceted disorder.

Supplementary Material

Supplementary data

References

  1. Achab S, Nicolier M, Mauny F, Monnin J, Trojak B, Vandel P, et al. Haffen E. Massively multiplayer online role-playing games: comparing characteristics of addict vs non-addict online recruited gamers in a French adult population. BMC Psychiatry. 2011;11:144. doi: 10.1186/1471-244X-11-144. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-5. Washington, D.C.: American Psychiatric Association; 2013. [Google Scholar]
  3. Andreassen CS, Torsheim T, Brunborg GS, Pallesen S. Development of a Facebook Addiction Scale. Psychological Reports. 2012;110(2):501–517. doi: 10.2466/02.09.18.PR0.110.2.501-517. [DOI] [PubMed] [Google Scholar]
  4. Bakken IJ, Wenzel HG, Götestam KG, Johansson A, Oren A. Internet addiction among Norwegian adults: a stratified probability sample study. Scandinavian Journal of Psychology. 2009;50(2):121–7. doi: 10.1111/j.1467-9450.2008.00685.x. [DOI] [PubMed] [Google Scholar]
  5. Black DW. A review of compulsive buying disorder. World Psychiatry : Official Journal of the World Psychiatric Association (WPA) 2007;6(1):14–8. [PMC free article] [PubMed] [Google Scholar]
  6. Block JJ. Issues for DSM-V: Internet addiction. American Journal of Psychiatry. 2008;165(3):306–307. doi: 10.1176/appi.ajp.2007.07101556. [DOI] [PubMed] [Google Scholar]
  7. Brand M, Laier C, Pawlikowski M, Schächtle U, Schöler T, Altstötter-Gleich C. Watching pornographic pictures on the Internet: role of sexual arousal ratings and psychological-psychiatric symptoms for using Internet sex sites excessively. Cyberpsychology, Behavior and Social Networking. 2011;14(6):371–7. doi: 10.1089/cyber.2010.0222. [DOI] [PubMed] [Google Scholar]
  8. Breiman L. Statistical Modeling: The Two Cultures. Statistical Science. 2001;16(3):199–215. doi: 10.2307/2676681. [DOI] [Google Scholar]
  9. Bujak R, Daghir-Wojtkowiak E, Kaliszan R, Markuszewski MJ. PLS-Based and Regularization-Based Methods for the Selection of Relevant Variables in Non-targeted Metabolomics Data. Frontiers in Molecular Biosciences. 2016 Jul;3:1–10. doi: 10.3389/fmolb.2016.00035. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Burns GL, Keortge SG, Formea GM, Sternberger LG. Revision of the Padua Inventory of obsessive compulsive disorder symptoms: distinctions between worry, obsessions, and compulsions. Behaviour Research and Therapy. 1996;34(2):163–73. doi: 10.1016/0005-7967(95)00035-6. [DOI] [PubMed] [Google Scholar]
  11. Cao F, Su L, Liu T, Gao X. The relationship between impulsivity and Internet addiction in a sample of Chinese adolescents. European Psychiatry. 2007;22(7):466–471. doi: 10.1016/j.eurpsy.2007.05.004. [DOI] [PubMed] [Google Scholar]
  12. Carli V, Durkee T, Wasserman D, Hadlaczky G, Despalins R, Kramarz E, et al. Kaess M. The Association between Pathological Internet Use and Comorbid Psychopathology: A Systematic Review. Psychopathology. 2013;46(1):1–13. doi: 10.1159/000337971. [DOI] [PubMed] [Google Scholar]
  13. Claes L, Müller A, Luyckx K. Compulsive buying and hoarding as identity substitutes: The role of materialistic value endorsement and depression. Comprehensive Psychiatry. 2016;68:65–71. doi: 10.1159.1016/j.comppsych.2016.04.005. [DOI] [PubMed] [Google Scholar]
  14. Cole SH, Hooley JM. Clinical and Personality Correlates of MMO Gaming: Anxiety and Absorption in Problematic Internet Use. Social Science Computer Review. 2013;31(4):424–436. doi: 10.1177/0894439312475280. [DOI] [Google Scholar]
  15. Cunningham-Williams RM, Grucza RA, Cottler LB, Womack SB, Books SJ, Przybeck TR, et al. Cloninger CR. Prevalence and predictors of pathological gambling: results from the St. Louis personality, health and lifestyle (SLPHL) study. Journal of Psychiatric Research. 2005;39(4):377–90. doi: 10.1016/j.jpsychires.2004.09.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Fernández-Villa T, Alguacil Ojeda J, Almaraz Gómez A, Cancela Carral JM, Delgado-Rodríguez M, García-Martín M, et al. Martín V. Problematic Internet Use in University Students: associated factors and differences of gender. Adicciones. 2015;27(4):265–75. [PubMed] [Google Scholar]
  17. Friedman J, Hastie T, Tibshirani R. Regularization Paths for Generalized Linear Models via Coordinate Descent. Journal of Statistical Software. 2010;33(1):1–22. [PMC free article] [PubMed] [Google Scholar]
  18. Griffiths M. Internet gambling: issues, concerns, and recommendations. Cyberpsychology Behavior : The Impact of the Internet, Multimedia and Virtual Reality on Behavior and Society. 2003;6(6):557–68. doi: 10.1089/109493103322725333. [DOI] [PubMed] [Google Scholar]
  19. Ha Y-M, Hwang WJ. Gender Differences in Internet Addiction Associated with Psychological Health Indicators Among Adolescents Using a National Web-based Survey. International Journal of Mental Health and Addiction. 2014;12(5):660–669. doi: 10.1007/s11469-014-9500-7. [DOI] [Google Scholar]
  20. Ho RC, Zhang MWB, Tsang TY, Toh AH, Pan F, Lu Y, et al. Mak K-K. The association between internet addiction and psychiatric co-morbidity: a meta-analysis. BMC Psychiatry. 2014;14:183. doi: 10.1186/1471-244X-14-183. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Hoerl AE, Kennard RW. Ridge Regression: Biased Estimation for Nonorthogonal Problems. Technometrics. 1970;12(1):55–67. doi: 10.1080/00401706.1970.10488634. [DOI] [Google Scholar]
  22. Huys QJM, Maia TV, Frank MJ. Computational psychiatry as a bridge from neuroscience to clinical applications. Nature Neuroscience. 2016;19(3):404–13. doi: 10.1038/nn.4238. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Igarashi T, Motoyoshi T, Takai J, Yoshida T. No mobile, no life: Self-perception and text-message dependency among Japanese high school students. 2008 doi: 10.1016/j.chb.2007.12.001. [DOI] [Google Scholar]
  24. Ioannidis K, Chamberlain SR, Treder MS, Kiraly F, Leppink E, Redden S, et al. Grant JE. Problematic internet use (PIU): Associations with the impulsive-compulsive spectrum. An application of machine learning in psychiatry. Journal of Psych. 2016 doi: 10.1016/j.jpsychires.2016.08.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Janower CR. Gambling on the Internet. Journal of Computer-Mediated Communication. 2006;2(2):0–0. doi: 10.1111/j.1083-6101.1996.tb00054.x. [DOI] [Google Scholar]
  26. Kessler RC, Adler L, Ames M, Demler O, Faraone S, Hiripi E, et al. Walters EE. The World Health Organization Adult ADHD Self-Report Scale (ASRS): a short screening scale for use in the general population. Psychological Medicine. 2005;35(2):245–56. doi: 10.1017/s0033291704002892. [DOI] [PubMed] [Google Scholar]
  27. Kessler RC, van Loo HM, Wardenaar KJ, Bossarte RM, Brenner LA, Cai T, et al. Zaslavsky AM. Testing a machine-learning algorithm to predict the persistence and severity of major depressive disorder from baseline self-reports. Molecular Psychiatry. 2016;21(10):1366–1371. doi: 10.1038/mp.2015.198. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Khazaal Y, Achab S, Billieux J, Thorens G, Zullino D, Dufour M, Rothen S. Factor Structure of the Internet Addiction Test in Online Gamers and Poker Players. JMIR Mental Health. 2015;2(2):e12. doi: 10.2196/mental.3805. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Kim D, Kang M, Biswas A, Liu C, Gao J. Integrative approach for inference of gene regulatory networks using lasso-based random featuring and application to psychiatric disorders. BMC Medical Genomics. 2016;9(Suppl 2):50. doi: 10.1186/s12920-016-0202-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. King SA. Internet Gambling and Pornography: Illustrative Examples of the Psychological Consequences of Communication Anarchy. CyberPsychology & Behavior. 1999;2(3):175–193. doi: 10.1089/cpb.1999.2.175. [DOI] [PubMed] [Google Scholar]
  31. King SA, Barak A. Compulsive Internet Gambling. Cyberpsychology & Behavior. 1999;2(5):441–456. doi: 10.1089/cpb.1999.2.441. [DOI] [PubMed] [Google Scholar]
  32. Király O, Griffiths MD, Demetrovics Z. Internet Gaming Disorder and the DSM-5: Conceptualization, Debates, and Controversies. Current Addiction Reports. 2015;2(3):254–262. doi: 10.1007/s40429-015-0066-7. [DOI] [Google Scholar]
  33. Király O, Griffiths MD, Urbán R, Farkas J, Kökönyei G, Elekes Z, et al. Demetrovics Z. Problematic internet use and problematic online gaming are not the same: findings from a large nationally representative adolescent sample. Cyberpsychology, Behavior and Social Networking. 2014;17(12):749–54. doi: 10.1089/cyber.2014.0475. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Kittinger R, Correia CJ, Irons JG. Relationship Between Facebook Use and Problematic Internet Use Among College Students. Cyberpsychology, Behavior, and Social Networking. 2012;15(6):324–327. doi: 10.1089/cyber.2010.0410. [DOI] [PubMed] [Google Scholar]
  35. Ko C-H, Yen J-Y, Yen C-F, Chen C-S, Chen C-C. The association between Internet addiction and psychiatric disorder: A review of the literature. European Psychiatry. 2012;27(1):1–8. doi: 10.1016/j.eurpsy.2010.04.011. [DOI] [PubMed] [Google Scholar]
  36. Ko C-H, Yen J-Y, Yen C-F, Lin H-C, Yang M-J. Factors predictive for incidence and remission of internet addiction in young adolescents: a prospective study. Cyberpsychology & Behavior : The Impact of the Internet, Multimedia and Virtual Reality on Behavior and Society. 2007;10(4):545–51. doi: 10.1089/cpb.2007.9992. [DOI] [PubMed] [Google Scholar]
  37. Kuss DJ, Griffiths MD. Online Social Networking and Addiction—A Review of the Psychological Literature. International Journal of Environmental Research and Public Health. 2011;8(12):3528–3552. doi: 10.3390/ijerph8093528. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Kuss DJ, Griffiths MD, Binder JF. Internet addiction in students: Prevalence and risk factors. Computers in Human Behavior. 2013;29(3):959–966. doi: 10.1016/j.chb.2012.12.024. [DOI] [Google Scholar]
  39. Kuss DJ, Lopez-Fernandez O. Internet addiction and problematic Internet use: A systematic review of clinical research. World Journal of Psychiatry. 2016;6(1):143–76. doi: 10.5498/wjp.v6.i1.143. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Laconi S, Andréoletti A, Chauchard E, Rodgers RF, Chabrol H. [Problematic Internet use, time spent online and personality traits] L’Encéphale. 2016;42(3):214–8. doi: 10.1016/j.encep.2015.12.017. [DOI] [PubMed] [Google Scholar]
  41. Laconi S, Rodgers RF, Chabrol H. The measurement of Internet addiction: A critical review of existing scales and their psychometric properties. Computers in Human Behavior. 2014;41:190–202. doi: 10.1016/J.CHB.2014.09.026. [DOI] [Google Scholar]
  42. Laier C, Pawlikowski M, Pekal J, Schulte FP, Brand M. Cybersex addiction: Experienced sexual arousal when watching pornography and not real-life sexual contacts makes the difference. Journal of Behavioral Addictions. 2013;2(2):100–7. doi: 10.1556/JBA.2.2013.002. [DOI] [PubMed] [Google Scholar]
  43. Lecardeur L. Psychopathologie du jeu multi-joueurs en ligne. Annales M?dico-Psychologiques, Revue Psychiatrique. 2013;171(8):579–586. doi: 10.1016/j.amp.2013.06.011. [DOI] [Google Scholar]
  44. Liang L, Zhou D, Yuan C, Shao A, Bian Y. Gender differences in the relationship between internet addiction and depression: A cross-lagged study in Chinese adolescents. Computers in Human Behavior. 2016;63:463–470. doi: 10.1016/J.CHB.2016.04.043. [DOI] [Google Scholar]
  45. Lopez-Fernandez O. How Has Internet Addiction Research Evolved Since the Advent of Internet Gaming Disorder? An Overview of Cyberaddictions from a Psychological Perspective. Current Addiction Reports. 2015;2(3):263–271. doi: 10.1007/s40429-015-0067-6. [DOI] [Google Scholar]
  46. Masten AS, Tellegen A. Resilience in developmental psychopathology: Contributions of the Project Competence Longitudinal Study. Development and Psychopathology. 2012;24(2):345–361. doi: 10.1017/S095457941200003X. [DOI] [PubMed] [Google Scholar]
  47. Mueller A, Mitchell JE, Crosby RD, Gefeller O, Faber RJ, Martin A, et al. de Zwaan M. Estimated prevalence of compulsive buying in Germany and its association with sociodemographic characteristics and depressive symptoms. Psychiatry Research. 2010;180(2–3):137–42. doi: 10.1016/j.psychres.2009.12.001. [DOI] [PubMed] [Google Scholar]
  48. Patton JH, Stanford MS, Barratt ES. Factor structure of the Barratt impulsiveness scale. Journal of Clinical Psychology. 1995;51(6):768–74. doi: 10.1002/1097-4679(199511)51:6<768::aid-jclp2270510607>3.0.co;2-1. [DOI] [PubMed] [Google Scholar]
  49. Recupero PR. Forensic evaluation of problematic Internet use. The Journal of the American Academy of Psychiatry and the Law. 2008;36(4):505–14. [PubMed] [Google Scholar]
  50. Rose S, Dhandayudham A. Towards an understanding of Internet-based problem shopping behaviour: The concept of online shopping addiction and its proposed predictors. Journal of Behavioral Addictions. 2014;3(2):83–9. doi: 10.1556/JBA.3.2014.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Rutland JB, Sheets T, Young T. Development of a Scale to Measure Problem Use of Short Message Service: The SMS Problem Use Diagnostic Questionnaire. CyberPsychology & Behavior. 2007;10(6):841–844. doi: 10.1089/cpb.2007.9943. [DOI] [PubMed] [Google Scholar]
  52. Rutter M. Resilience: some conceptual considerations. The Journal of Adolescent Health : Official Publication of the Society for Adolescent Medicine. 1993;14(8):626–31. doi: 10.1016/1054-139x(93)90196-v. 690–6. [DOI] [PubMed] [Google Scholar]
  53. Shaw M, Black DW. Internet addiction: definition, assessment, epidemiology and clinical management. CNS Drugs. 2008;22(5):353–65. doi: 10.2165/00023210-200822050-00001. [DOI] [PubMed] [Google Scholar]
  54. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. Dunbar GC. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. The Journal of Clinical Psychiatry. 1998;59(Suppl 20) 22-33-57. [PubMed] [Google Scholar]
  55. Tam P, Walter G. Problematic internet use in childhood and youth: evolution of a 21st century affliction. Australasian Psychiatry. 2013 doi: 10.1177/1039856213509911. [DOI] [PubMed] [Google Scholar]
  56. Tibshirani R. Regression Shrinkage and Selection Via the Lasso. Journal of the Royal Statistical Society, Series B. 1996;(58):267–288. [Google Scholar]
  57. Tikhonov AN. Solution of incorrectly formulated problems and the regularization method. Soviet Math Dokl. 1963;5:1035–1038. Retrieved from http://aitopics.org/publication/solution-incorrectly-formulated-problems-and-regularization-method. [Google Scholar]
  58. Trotzke P, Starcke K, Müller A, Brand M. Pathological Buying Online as a Specific Form of Internet Addiction: A Model-Based Experimental Investigation. PloS One. 2015;10(10):e0140296. doi: 10.1371/journal.pone.0140296. [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Tsai HF, Cheng SH, Yeh TL, Shih C-C, Chen KC, Yang YC, Yang YK. The risk factors of Internet addiction?A survey of university freshmen. Psychiatry Research. 2009;167(3):294–299. doi: 10.1016/j.psychres.2008.01.015. [DOI] [PubMed] [Google Scholar]
  60. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, Initiative S. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Journal of Clinical Epidemiology. 2008;61(4):344–349. doi: 10.1016/j.jclinepi.2007.11.008. [DOI] [PubMed] [Google Scholar]
  61. Wallace P. Internet addiction disorder and youth: There are growing concerns about compulsive online activity and that this could impede students’ performance and social lives. EMBO Reports. 2014;15(1):12–6. doi: 10.1002/embr.201338222. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Xin M, Xing J, Pengfei W, Houru L, Mengcheng W, Hong Z. Online activities, prevalence of Internet addiction and risk factors related to family and school among adolescents in China. Addictive Behaviors Reports. 2018;7:14–18. doi: 10.1016/j.abrep.2017.10.003. (October 2017) [DOI] [PMC free article] [PubMed] [Google Scholar]
  63. Yuen CN, Lavin MJ, Weinman M, Kozak K. Internet Dependence in the Collegiate Population: The Role of Shyness. CyberPsychology & Behavior. 2004;7(4):379–383. doi: 10.1089/cpb.2004.7.379. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data
NIHMS76237-supplement-Supplementary_data.docx (20.5MB, docx)

RESOURCES