Skip to main content
Journal of Behavioral Addictions logoLink to Journal of Behavioral Addictions
. 2017 Nov 10;6(4):516–524. doi: 10.1556/2006.6.2017.074

Established risk factors for addiction fail to discriminate between healthy gamers and gamers endorsing DSM-5 Internet gaming disorder

Jory Deleuze 1,*, Filip Nuyens 1,2, Lucien Rochat 3, Stéphane Rothen 4, Pierre Maurage 1, Joël Billieux 1,4,5,6,*
PMCID: PMC6034950  PMID: 29130328

Abstract

Background and aims

The DSM-5 includes criteria for diagnosing Internet gaming disorder (IGD) that are adapted from substance abuse and widely used in research and clinical contexts, although evidence supporting their validity remains scarce. This study compared online gamers who do or do not endorse IGD criteria regarding self-control-related abilities (impulsivity, inhibitory control, and decision-making), considered the hallmarks of addictive behaviors.

Method

A double approach was adopted to distinguish pathological from recreational gamers: The first is the classic DSM-5 approach (≥5 criteria required to endorse the IGD diagnosis), and the second consists in using latent class analysis (LCA) for IGD criteria to distinguish gamers’ subgroups. We computed comparisons separately for each approach. Ninety-seven volunteer gamers from the community were recruited. Self-reported questionnaires were used to measure demographic- and game-related characteristics, problematic online gaming (with the Problematic Online Gaming Questionnaire), impulsivity (with the UPPS-P Impulsive Behavior Scale), and depression (with the Beck Depression Inventory-II). Experimental tasks were used to measure inhibitory control (Hybrid-Stop Task) and decision-making abilities (Game of Dice Task).

Results

Thirty-two participants met IGD criteria (33% of the sample), whereas LCA identified two groups of gamers [pathological (35%) and recreational]. Comparisons that used both approaches (DSM-5 and LCA) failed to identify significant differences regarding all constructs except for variables related to actual or problematic gaming behaviors.

Discussion

The validity of IGD criteria is questioned, mostly with respect to their relevance in distinguishing high engagement from pathological involvement in video games.

Keywords: Internet gaming disorder, inhibitory control, impulsivity, decision-making, DSM-5

Introduction

The study of video game-related disorders took a step forward with the inclusion of Internet gaming disorder (IGD), as proposed in Section 3 of the fifth edition of the Diagnostic and Statistical Manual for Mental Disorders (DSM-5; American Psychiatric Association [APA], 2013; Petry & O’Brien, 2013; Table 1), encouraging further research on this condition. Directly transposed from established substance abuse diagnostic criteria and including dimensions such as tolerance or withdrawal, the proposed IGD criteria have already generated much debate and controversy (Griffiths et al., 2016; Kardefelt-Winther, 2015; Petry et al., 2016). Although evidence regarding their validity is still limited (e.g., Király, Sleczka, et al., 2017; Ko et al., 2014), some studies have nevertheless used these criteria to determine the prevalence of IGD in population-based samples, mainly young adults, reporting rates of between 0.3% and 1.3% (e.g., Przybylski, Weinstein, & Murayama, 2017; Rehbein, Kliem, Baier, Mößle, & Petry, 2015). As caution is required before using a newly established diagnostic criteria in population-based epidemiological studies (van Rooij & Kardefelt-Winther, 2017; van Rooij, Van Looy, & Billieux, 2017), we aimed in the current report to test whether established risk factors for addictive behaviors successfully discriminate gamers who endorse DSM-5 IGD criteria from healthy gamers, and thus to gather new evidence regarding the construct validity of IGD criteria. In this study, we focused on three constructs that are widely identified as being crucial in gaming disorder and constituting hallmarks of addictive disorders: inhibitory control, decision-making, and impulsivity traits (Bechara, 2005; Goldstein & Volkow, 2011; Volkow, Wang, Fowler, & Tomasi, 2012).

Table 1.

Internet gaming disorder criteria and percentages of gamers per criteria

IGD criteria (DSM-5) Percentage of “yes” (N = 97)
Preoccupation with Internet games 77.3
Withdrawal symptoms when games are taken away 14.4
Tolerance (need for increasing the amount of time spent playing) 35.1
Unsuccessful attempts to control participation in games 48.5
Loss of interest in other activities 21.6
Continued use despite problem awareness 59.8
Deceiving relatives 30.9
Use for mood regulation 39.2
Jeopardize relationship or job 15.5
Proportion of participants endorsing IGD criteria (5+ criteria) 33

Note. IGD: Internet gaming disorder.

In the last two decades, a growing corpus of data has emphasized the role of inhibitory and decision-making deficits, along with heightened impulsivity traits, in the etiology of excessive video game use (Gentile et al., 2011; Littel et al., 2012; Pawlikowski & Brand, 2011; Yao et al., 2015), in line with what had long been identified in substance-related addictive states (Biernacki, McLennan, Terrett, Labuschagne, & Rendell, 2016; Coskunpinar, Dir, & Cyders, 2013; Smith, Mattick, Jamadar, & Iredale, 2014). These self-control-related constructs are incorporated in the most recent models of IGD (Brand, Young, Laier, Wölfling, & Potenza, 2016) and constitute important factors in the influential “dual-process” models of addictive disorders (Bechara, 2005; D’Hondt, Billieux, & Maurage, 2015).

Since the release of the DSM-5, a growing number of studies have explored impulsivity traits and impairments in executive function in individuals with IGD, producing mixed findings (e.g., Argyriou, Davison, & Lee, 2017; Brand et al., 2016). Some studies have, e.g., shown that individuals with IGD are characterized by reduced response inhibition and mental flexibility (Choi et al., 2014; Yao et al., 2015; Zhou, Yuan, & Yao, 2012), whereas another study failed to identify inhibitory control impairment in IGD with a Go/No-Go (GNG) task (Ding et al., 2014). Other studies have shown IGD to be related to proneness to make disadvantageous decisions in various laboratory tasks, supposedly because of more impulsive reward seeking (Wang, Wu, Lin, et al., 2016; Wang, Wu, Wang, et al., 2016). Furthermore, on the basis of both self-reported and neuroimaging measures, IGD also appears to rely on heightened impulsivity (Choi et al., 2014; Ding et al., 2014; Ko et al., 2015; Yen et al., 2017).

Following the ongoing debates on IGD conceptualization and diagnosis (Griffiths et al., 2016; Kuss, Griffiths, & Pontes, 2016), we intended this study to fill an important gap by comparing gamers who endorse the tentative criteria for IGD in the DSM-5 with gamers who do not for the aforementioned self-control-related constructs, namely inhibitory control, decision-making abilities, and impulsivity traits. Indeed, if the DSM-5 criteria successfully allowed diagnosis of IGD as an addictive behavior, then established risk factors for addiction such as those mentioned above should differ between groups, as has been shown in gambling disorder (Billieux, Lagrange, et al., 2012; Brevers, Bechara, Cleeremans, & Noël, 2013; Devos, Clark, Maurage, Kazimierczuk, & Billieux, 2015; van Holst, van den Brink, Veltman, & Goudriaan, 2010). A double approach was adopted because of the still preliminary nature of IGD criteria. First, the polythetic approach proposed in the DSM-5 was used, i.e., considering gamers who endorse five or more criteria to be presenting IGD. Second, a data-driven approach that consisted of applying latent class analysis (LCA) to the same diagnostic criteria was conducted to potentially identify a group of problematic gamers. Construct validity of IGD criteria was addressed through the use of a problematic gaming questionnaire, and depressive symptoms were controlled for as potential confounding variables (Bargeron & Hormes, 2017; Gentile et al., 2011).

Methods

Participants

Ninety-seven gamers (87% males) were recruited through Facebook, word of mouth, and announcements in the Université catholique de Louvain (Louvain-la-Neuve, Belgium). Inclusion criteria were being above 18 years of age, a fluent French speaker, and playing online video games weekly. The age of the participants ranged from 18 to 39 years (M = 22.21, SD = 3.73). Regarding education, 71% had a secondary school diploma, 25% a university diploma, and 4% a non-university higher education degree.

Measures

IGD criteria

IGD was assessed using the questionnaire elaborated by Petry et al. (2014). In their article, they proposed the questionnaire in several other languages, including French. Gamers answer “yes” or “no” to at least five of the nine criteria occurring over the past 12 months in order to endorse IGD. The nine dichotomous items measure IGD criteria: preoccupation, withdrawal, tolerance, unsuccessful attempts to stop or reduce the time spent playing, loss of interest in other hobbies or activities, excessive gaming despite problems, deception, escape or relief from a negative mood, and jeopardizing a relationship or job.

Problematic Online Gaming Questionnaire (POGQ)

The POGQ was developed by Demetrovics et al. (2012) to measure six facets of problematic online gaming. It is composed of 18 items measuring preoccupation (i.e., obsessive thinking about the game or daydreaming; Cronbach’s α = .75), overuse (i.e., not controlling the time spent playing; Cronbach’s α = .79), immersion (i.e., losing track of time when playing; Cronbach’s α = .67), interpersonal conflicts (i.e., conflicts with relatives due to video games; Cronbach’s α = .70), social isolation (i.e., neglecting “real” social interactions for the benefits of online gaming; Cronbach’s α = .60), and withdrawal (i.e., being irritated when not being able to play; Cronbach’s α = .74). For this study, a total score was calculated (Cronbach’s α = .84), the minimum score being 18 and the maximum 90. A French translation has been conducted with a translation–back translation method.

Short UPPS Impulsive Behavior Scale (s-UPPS-P)

The s-UPPS-P (Billieux, Rochat, et al., 2012) is a 20-item questionnaire assessing the different impulsivity components. Each item is scored on a 4-point Likert Scale. Five impulsivity facets are measured: negative and positive urgency (i.e., acting under the influence of emotions; with Cronbach’s αs of .82 and .76, respectively), lack of premeditation (i.e., difficulties considering the consequences of an action; Cronbach’s α = .87), lack of perseverance (i.e., difficulties remaining focused on a difficult or boring task; Cronbach’s α = .92), and sensation seeking (i.e., searching for new and thrilling experiences; Cronbach’s α = .82). On the basis of recent research (Berg, Latzman, Bliwise, & Lilienfeld, 2015), positive and negative urgency facets were merged into an “urgency” construct (i.e., the tendency to act rashly in intense emotional contexts) because of their high correlation (r = .56, p < .001).

Beck Depression Inventory-II (BDI-II)

The French version of the BDI-II (Beck, Steer, & Brown, 1998) was used to measure depressive symptoms. With 21 items on a 4-point Likert scale, depression scores may vary between 0 and 63, with 0–13 for absence of depression, 14–19 for light depression, 20–28 for moderate depression, and 28 or more for severe depression. The global internal consistency is high (Cronbach’s α = .79).

The Hybrid-Stop Task (HST)

The HST was developed by Schachar, Forget-Dubois, Dionne, Boivin, and Robaey (2011) and designed with E-Prime 2.0.8. The originality of this task is that it measures two different inhibition processes: cancellation (i.e., the capacity to interrupt an ongoing automatic action) and restraint of a prepotent motor response (i.e., the capacity to prevent an action from occurring when required).

Three different trials are measured: Go trials (for the reaction time), No-Go trials (for the restraint process), and stop-signal trials (SST) (for the cancellation process). During the training block composed of 16 trials, the intention is to automatize the association between the stimuli that appear and the response keys. Following this step, the task begins with a total of 320 trials divided into five blocks. The 160 Go trials require the participant to answer as quickly as possible by pressing on the keyboard to indicate in which direction a black arrow appearing in the middle of the screen is pointing (left or right). In GNG trials (80 trials), the blue arrow appears immediately, requiring the participant to restrain his/her answer. In SST (80 trials), the arrow turns blue after a short delay, requiring the participant to cancel the ongoing prepotent response. The first stop-signal delay is based on the mean reaction time measured during the training session, after which a dynamic algorithm modifies the duration of the delay: 50 ms slower if the participant did not succeed in inhibiting the answer (making the next SST easier to inhibit), and 50 ms faster after successful inhibition (making the next SST harder to inhibit).

Crucially, the instruction given to the participant stresses giving an answer as quickly as possible, without anticipating the possible occurrence of the SST. The average time required to successfully inhibit a motor answer is calculated with the stop-signal reaction time (Logan, 1994) estimated via the integration method (Logan & Cowan, 1984). For GNG, the percentage of errors (i.e., when responding to blue arrows) was calculated. For each participant, all errors made in Go trials were removed prior to the calculation of mean reaction time. Late responses were suppressed by removing every reaction time in Go trials that was longer than the mean for Go trials plus 2.5 standard deviations on a subject-by-subject basis.

The Game of Dice Task (GDT)

Decision-making abilities were measured with the GDT (Brand et al., 2005) in which participants have to maximize their virtual money capital in risky situations, i.e., where the individual is aware of the task contingencies. A short clip on the left of the screen shows dice being shaken in a cup. On the center and top right, the participant sees his/her current capital and the feedback boxes where losses and gains are displayed in both figures and columns. In the center of the screen, different clickable bets show the amounts of winnable money, which vary depending on the probability of winning. The throws are pseudorandomized in order for all six values to be displayed three times.

Choices in the GDT are either advantageous or disadvantageous. Choices with one or two values are considered disadvantageous, with elevated probabilities of winning or losing high amounts of money more frequently, whereas choices with three or four values are advantageous, with probabilities of winning or losing smaller amounts being over 50%.

Following the guidelines provided by the task’s creators (Brand et al., 2005), a net score consisting in the subtraction of disadvantageous choices from advantageous choices is calculated as an indicator of overall task performance. Higher net scores are indicators of advantageous decision strategies.

Procedure

Participants were first selected through an online survey (Qualtrics, Provo, UT) to ensure that they met the inclusion criteria. They were then individually contacted by e-mail to arrange an appointment to complete the experiment in a quiet laboratory. They signed an informed consent form prior to starting the experiment and were debriefed regarding the objectives at the end. The study started with a questionnaire that assessed demographic variables (age, gender, educational level, and current job or study) and game-related factors (gaming frequency and preferences). Participants then participated in two laboratory tasks that assessed inhibitory control with the HST (Schachar et al., 2011) and decision-making with the GDT (Brand et al., 2005). They also completed questionnaires that assessed DSM-5 IGD criteria (Petry et al., 2014), impulsivity traits with the s-UPPS-P (Billieux, Rochat, et al., 2012), symptoms of problematic video game use with the POGQ (Demetrovics et al., 2012), and symptoms of depression with the BDI-II (Beck et al., 1998). Participants received an incentive of 10 euros for their participation. Some results from the current data set, unrelated to the objective of this study, have been published elsewhere (Deleuze, Christiaens, Nuyens, & Billieux, 2017).

Statistical analysis

T-tests were used to compare participants endorsing or not DSM-5 IGD criteria on study variables. LCAs were performed using R software (R Development Core Team, 2008) with the poLCA package (Linzer & Lewis, 2011). LCA is a multivariate method that identifies discrete multivariate variables called latent classes on the basis of multivariate categorical data. Its advantage over other analyses such as cluster analysis is that it allows the use of binary variables. In this study, LCA was performed on each criterion’s endorsement (1 = endorsement and 0 = non-endorsement) to, first, identify different profiles of online gamers and, second, to determine the probabilities for members from each class to endorse all IGD criteria. The maximum posterior probability served as the assignment of each participant in classes.

Different models ranging from 1 to 10 classes were tested in an exploratory way. The Akaike information criterion (AIC) and the Bayesian information criterion (BIC) were both calculated, penalizing the number of estimated parameters for parsimoniousness and the quality of the model. An additional index of entropy was calculated for the model accuracy, with values close to 1 meaning better homogeneity of the classes. The final decision for the model retained depends on these indices and on closeness to reality. Table 2 shows the AIC and BIC indices of fitting and the entropy measure for the 10 tested models. The BIC and AIC indicated a two-class model. For entropy, caution must be taken, as it progressively increased, whereas the opposite is sought, given the higher risks of assignment errors (Collins & Lanza, 2013). An increase in the entropy score between the two- and three-class solutions speaks in favor of a three-class model. The final choice for the two-class model was motivated by the principle of parsimony and based on the need for IGD criteria to distinguish problematic gamers from regular gamers.

Table 2.

Fit indices for latent class analyses

Number of latent classes AIC BIC Entropy
1 1,027.49 1,050.66 1
2 1,001.72 1,050.65 0.69
3 1,006.16 1,080.83 0.82
4 1,006.30 1,106.71 0.77
5 1,013.09 1,139.26 0.91
6 1,016.08 1,167.99 0.93
7 1,030.17 1,207.82 0.92
8 1,037.24 1,240.64 0.89
9 1,050.50 1,279.65 0.91
10 1,055.43 1,310.32 0.94

Note. AIC: Akaike information criterion; BIC: Bayesian information criterion.

Ethics

The ethical committee of the Psychological Science Research Institute of the Université catholique de Louvain (Belgium) approved the study protocol. All subjects were informed about the anonymity of the study and provided their informed consent.

Results

Endorsement of DSM-5 IGD criteria and group comparisons

Table 1 shows endorsement proportions for each IGD criterion. Of the 97 gamers involved in the study, 32 endorsed five or more IGD criteria. Consequently, we compared individuals who endorsed five or more criteria with those who endorsed fewer than five criteria.

Table 3 shows a series of t-tests conducted between participants identified as endorsing or not endorsing IGD regarding the study variables. No significant difference appeared between groups for demographics, impulsivity traits (s-UPPS-P), inhibitory control (HST), decision-making abilities (GDT), and depressive symptoms (BDI-II). The only differences were that gamers endorsing IGD criteria reported higher POGQ scores and more hours spent playing per week.

Table 3.

Multiple comparisons between gamers endorsing IGD criteria and control gamers and between LCA classes 1 and 2

DSM-5 approach LCA approach t Cohen’s d
IGD (n = 32) Control (n = 65) Class 1 (n = 63) Class 2 (n = 34) DSM LCA DSM LCA
Demographic measures Age 21.84 (3.21) 22.38 (3.97) 22.48 (3.99) 21.71 (3.17) 0.669 0.970 0.015 0.021
Hours/week 19.15 (9.61) 13.90 (8.90) 13.78 (9.01) 19.06 (9.34) −2.663* −2.715* 0.56 0.57
Self-reported questionnaires POGQ – total 50.78 (7.77) 40.98 (7.47) 40.92 (7.53) 50.32 (7.86) −5.990** −5.779** 1.28 1.22
s-UPPS-P – urgency 21.12 (4.18) 19.24 (4.63) 19.27 (4.60) 20.97 (4.32) −1.936 −1.773 0.42 0.38
s-UPPS-P – lack of premeditation 7.38 (2.64) 7.28 (2.25) 7.32 (2.27) 7.29 (2.58) −0.190 0.046 0.04 0.01
s-UPPS-P – lack of perseverance 7.88 (3.05) 7.46 (2.70) 7.43 (2.74) 7.91 (2.97) −0.678 −0.805 0.14 0.16
s-UPPS-P – sensation seeking 11.84 (2.69) 11.08 (2.65) 11 (2.62) 11.94 (2.70) −1.332 −1.668 0.28 0.35
BDI-II 9.41 (3.76) 7.46 (5.98) 7.59 (6.03) 9.06 (3.91) −1.951b −1.282 0.39 0.28
Hybrid-Stop Task Go RTa 480.08 (212.90) 485.56 (221.11) 487.88 (224.25) 476.10 (206.98) −0.116 0.253 0.02 0.05
SSRTa 266.31 (65.41) 255.42 (51.59) 256.05 (52.14) 264.51 (64.05) 0.893 −0.703 0.18 0.14
GNG errors, % (restraint process) 3.87 (7.97) 2.19 (2.92) 2.24 (2.95) 3.67 (7.77) 1.150b −1.305b 0.28 0.24
SST errors, % (cancellation process) 63.79 (17.06) 60.96 (15.02) 61.23 (15.18) 63.12 (16.76) 0.833 −0.565 0.17 0.12
Game of Dice Task Net score 8.62 (9.62) 10.33 (9.27) 10.22 (9.36) 8.94 (9.46) 0.953 0.640 0.18 0.13

Note. IGD: Internet gaming disorder; LCA: latent class analysis; POGQ: Problematic Online Gaming Questionnaire; s-UPPS-P: short UPPS-P Impulsive Behavior Scale; BDI-II: Beck Depression Inventory-II; Go RT: mean reaction time to go trials; SSRT: stop-signal reaction time; GNG errors: percentage of errors in Go/No-Go trials; SST errors: percentage of errors in stop-signal trials; net score: number of disadvantageous choices subtracted from number of advantageous choices.

aGo RT and SSRT are expressed in milliseconds. bCorrection for variance inequality was applied.

*p < .05. **p < .005.

LCA and comparisons between classes

An LCA was computed to identify latent subgroups, with a two-class model emerging. Class 1 is composed of 63 gamers (65% of the sample). All endorsement probabilities were below 50% except for preoccupation at 65.1%. Class 2 is composed of 34 gamers (35%) who had a higher probability of reporting loss of control and overuse, all of whom endorsed the preoccupation criterion. This second class comprises all participants who endorsed the IGD condition (five criteria or more). Table 3 reports comparisons between healthy and pathological gamers based on the DSM-5 and the LCA approaches.

Discussion

This study used a double approach to explore the validity of IGD criteria proposed in the DSM-5 among gamers from the community. First, individuals who endorsed five or more IGD criteria were compared with recreational gamers (i.e., those who endorsed four or fewer criteria). Second, an LCA was computed from the criteria endorsement, which identified two distinct classes. In both cases, the identified groups were compared for self-control-related constructs (impulsivity traits, inhibitory control, and decision-making), which are considered hallmarks of addictive behaviors. Contrary to our expectations, the results largely failed to highlight expected group differences, as gamers who endorsed criteria defining pathological online video game use and recreational gamers did not present significantly different performances.

The most striking finding of this study is that established risk factors for addictive behaviors failed to distinguish between gamers presenting or not presenting pathological use of video games as defined by DSM-5 IGD criteria. Indeed, as reported in Table 3, the only differences shown were related to (i) self-reported time spent playing and (ii) symptoms of disordered gaming (assessed with a self-reported continuous scale of disordered use of video games). This finding does not support the validity of the DSM-5 criteria, which were developed from the conceptualization of IGD as an addictive disorder. Indeed, the self-control-related constructs measured in this study have repeatedly been found to be impaired in individuals who present behavioral or substance-related addictive disorders (Biernacki et al., 2016; Coskunpinar et al., 2013; Smith et al., 2014) and are markers of gambling disorder (Billieux, Lagrange, et al., 2012; Brevers et al., 2013; Devos et al., 2015; van Holst et al., 2010), which is to date the only behavioral disorder considered to be a genuine addictive state (APA, 2013). Our results thus question the relevance of recycling substance abuse criteria to those for IGD and more largely the trend that consists in applying these criteria to a wide range of daily life behaviors and/or leisure activities (Aarseth et al., 2017; Billieux, Schimmenti, Khazaal, Maurage, & Heeren, 2015; Kardefelt-Winther et al., 2017). This does not mean that IGD is not a genuine disorder, as it is known that excessive involvement in video games is associated with functional impairment and psychological distress (Billieux et al., 2017); rather, the current DSM-5 proposal to measure IGD is not necessarily valid or pertinent, which is concerning, given its widespread use for epidemiological purposes in recent years. This view is in line with recent claims that symptoms such as tolerance or withdrawal in relation to IGD are not supported by enough evidence to be retained as diagnostic criteria (King & Delfabbro, 2016; Starcevic, 2016), or that it is misleading to consider preoccupation in online video games (or another leisure activity) as an index of pathological behavior (Kardefelt-Winther et al., 2017). As illustrated in Table 1, the preoccupation criterion was endorsed by 77.3% of our community sample of regular gamers, further supporting the idea that preoccupation for leisure activities is, in contrast to preoccupation for consumption of a psychoactive substance, not necessarily a sign of deviant or pathological behavior.

One potential explanation for the absence of differences between groups in this study is that DSM-5 IGD criteria are probably not able to distinguish a high but healthy involvement from an excessive and pathological involvement in video games, which could translate into false positives and pathologization of normal behavior. Indeed, Charlton and Danforth (2007) have shown in an influential video game study that classic addiction criteria must be distinguished in relation to their “core” or “peripheral” nature. According to their study, core criteria (i.e., behavioral salience, withdrawal, conflicts, relapse, and reinstatement) are associated with pathological behavior, whereas peripheral criteria (i.e., cognitive salience or preoccupation, tolerance, and euphoria) instead reflect high engagement (or passion) in video games, which is in most cases healthy. Since Charlton and Danforth’s seminal study, accumulating data suggest that intense video gaming is not essentially problematic or associated with negative consequences or functional impairment (e.g., Billieux et al., 2013; Király, Tóth, Urbán, Demetrovics, & Maraz, 2017). Accordingly, it is likely that some criteria incorporated in the IGD proposal (e.g., preoccupation and tolerance) constitute peripheral criteria that should not be used to define a pathological condition. In contrast, the LCA allowed us to identify potentially core criteria that could constitute valid predictors of pathological use (Figure 1), such as loss of control, continuous involvement despite negative consequences, or gaming for mood regulation. Relying on two different data-analytic approaches, this study suggests that the polythetic diagnostic approach proposed in the DSM-5 is susceptible to mixing of core and peripheral symptoms, hindering the distinction between highly involved versus pathological cases. This is probably why more than a third of our sample endorsed the pathological threshold.

Figure 1.

Figure 1.

Latent classes based on endorsement of IGD criteria. The number of latent classes is based on the Akaike and Bayesian information criteria

A specific limitation of the study that is worth mentioning pertains to the study sample. Although the primary objective was to compare pathological versus healthy gamers, it would have been of interest to include a clinical group of treatment-seeking gamers. Indeed, we cannot exclude the possibility that group differences would have emerged if a treatment-seeking group had been included, especially if IGD criteria fail to distinguish between highly involved versus pathological gamers.

In this study, we questioned the validity of the DSM-5 IGD criteria using an original double categorization approach. At a broader level, this study calls for further elaboration and refinement of the diagnostic criteria used to define IGD. In particular, we believe that the establishment of a list of specific IGD diagnostic criteria also requires a focus on the unique psychological and behavioral features associated with this condition (James & Tunney, 2016; Kardefelt-Winther et al., 2017), rather than capitalizing only on similarities to addictive disorders. Moreover, such diagnostic criteria should allow the dissociation of healthy elevated involvement from pathological involvement in order to limit the risk of pathologization of normal behavior. Regarding the latter issue, the recent guidelines provided by the World Health Organization (2017) in a beta draft version of the 11th revision of the International Classification of Diseases appear to be an improvement, as it does not include peripheral criteria and explicitly considers functional impairment as a mandatory criterion for diagnosis (Billieux et al., 2017; Király & Demetrovics, 2017).

Funding Statement

Funding sources: JD is funded by a Special Research Fund (FSR) from the Université catholique de Louvain (Belgium). The work of PM (Research Associate) is funded by the Belgian Fund for Scientific Research (F.R.S. -FNRS, Belgium).

Authors’ contribution

JD and JB designed the study. LR and FN created the Hybrid-Stop Task. JD and FN acquired the data. JD and SR ran the statistical analyses. JD and JB interpreted the results. JD and SR also wrote the initial draft of the article. FN, LR, SR, and PM reviewed the initial draft and participated in the writing of the final draft. All authors approved the final version of the manuscript.

Conflict of interest

The authors declare no conflict of interest.

References

  1. Aarseth E., Bean A. M., Boonen H., Colder Carras M., Coulson M., Das D., Deleuze J., Dunkels E., Edman J., Ferguson C. J., Haagsma M. C., Helmersson Bergmark K., Hussain Z., Jansz J., Kardefelt-Winther D., Kutner L., Markey P., Nielsen R. K., Prause N., Przybylski A., Quandt T., Schimmenti A., Starcevic V., Stutman G., Van Looy J., Van Rooij A. J. (2017). Scholars’ open debate paper on the World Health Organization ICD-11 Gaming Disorder proposal. Journal of Behavioral Addictions, 6(3), 267–270. doi:10.1556/2006.5.2016.088 [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. American Psychiatric Association [APA]. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: American Psychiatric Association. [Google Scholar]
  3. Argyriou E., Davison C. B., Lee T. T. C. (2017). Response inhibition and Internet gaming disorder: A meta-analysis. Addictive Behaviors, 71, 54–60. doi:10.1016/j.addbeh.2017.02.026 [DOI] [PubMed] [Google Scholar]
  4. Bargeron A. H., Hormes J. M. (2017). Psychosocial correlates of Internet gaming disorder: Psychopathology, life satisfaction, and impulsivity. Computers in Human Behavior, 68, 388–394. doi:10.1016/j.chb.2016.11.029 [Google Scholar]
  5. Bechara A. (2005). Decision making, impulse control and loss of willpower to resist drugs: A neurocognitive perspective. Nature Neuroscience, 8(11), 1458–1463. doi:10.1038/nn1584 [DOI] [PubMed] [Google Scholar]
  6. Beck A. T., Steer R. A., Brown G. K. (1998). Inventaire de Dépression de Beck – 2ème édition (IDB-II) [Beck Depression Inventory – 2nd edition (BDI-II)] (2nd ed.). Paris, France: Éditions du Centre de Psychologie Appliquée. [Google Scholar]
  7. Berg J. M., Latzman R. D., Bliwise N. G., Lilienfeld S. O. (2015). Parsing the heterogeneity of impulsivity: A meta-analytic review of the behavioral implications of the UPPS for psychopathology. Psychological Assessment, 27(4), 1129–1146. doi:10.1037/pas0000111 [DOI] [PubMed] [Google Scholar]
  8. Biernacki K., McLennan S. N., Terrett G., Labuschagne I., Rendell P. G. (2016). Decision-making ability in current and past users of opiates: A meta-analysis. Neuroscience and Biobehavioral Reviews, 71, 342–351. doi:10.1016/j.neubiorev.2016.09.011 [DOI] [PubMed] [Google Scholar]
  9. Billieux J., King D. L., Higuchi S., Achab S., Bowden-Jones H., Hao W., Long J., Lee H. K., Potenza M. N., Saunders J. B., Poznyak V. (2017). Functional impairment matters in the screening and diagnosis of gaming disorder. Journal of Behavioral Addictions, 6(3), 285–289. doi:10.1556/2006.6.2017.036 [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Billieux J., Lagrange G., Van der Linden M., Lançon C., Adida M., Jeanningros R. (2012). Investigation of impulsivity in a sample of treatment-seeking pathological gamblers: A multidimensional perspective. Psychiatry Research, 198(2), 291–296. doi:10.1016/j.psychres.2012.01.001 [DOI] [PubMed] [Google Scholar]
  11. Billieux J., Rochat L., Grazia C., Carré A., Offerlin-Meyer I., Defeldre A. C., Khazaal Y., Besche-Richard C., Van der Linden M. (2012). Validation of a short French version of the UPPS-P Impulsive Behavior Scale. Comprehensive Psychiatry, 53(5), 609–615. doi:10.1016/j.comppsych.2011.09.001 [DOI] [PubMed] [Google Scholar]
  12. Billieux J., Schimmenti A., Khazaal Y., Maurage P., Heeren A. (2015). Are we overpathologizing everyday life? A tenable blueprint for behavioral addiction research. Journal of Behavioral Addictions, 4(3), 119–123. doi:10.1556/2006.4.2015.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Billieux J., Van der Linden M., Achab S., Khazaal Y., Paraskevopoulos L., Zullino D., Thorens G. (2013). Why do you play World of Warcraft? An in-depth exploration of self-reported motivations to play online and in-game behaviours in the virtual world of Azeroth. Computers in Human Behavior, 29(1), 103–109. doi:10.1016/j.chb.2012.07.021 [Google Scholar]
  14. Brand M., Fujiwara E., Borsutzky S., Kalbe E., Kessler J., Markowitsch H. J. (2005). Decision-making deficits of Korsakoff patients in a new gambling task with explicit rules: Associations with executive functions. Neuropsychology, 19(3), 267–277. doi:10.1037/0894-4105.19.3.267 [DOI] [PubMed] [Google Scholar]
  15. Brand M., Young K. S., Laier C., Wölfling K., Potenza M. N. (2016). Integrating psychological and neurobiological considerations regarding the development and maintenance of specific Internet-use disorders: An Interaction of Person-Affect-Cognition-Execution (I-PACE) model. Neuroscience and Biobehavioral Reviews, 71, 252–266. doi:10.1016/j.neubiorev.2016.08.033 [DOI] [PubMed] [Google Scholar]
  16. Brevers D., Bechara A., Cleeremans A., Noël X. (2013). Iowa Gambling Task (IGT): Twenty years after – Gambling disorder and IGT. Frontiers in Psychology, 4, 665. doi:10.3389/fpsyg.2013.00665 [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Charlton J. P., Danforth I. D. W. (2007). Distinguishing addiction and high engagement in the context of online game playing. Computers in Human Behavior, 23(3), 1531–1548. doi:10.1016/j.chb.2005.07.002 [Google Scholar]
  18. Choi S.-W., Kim H., Kim G.-Y., Jeon Y., Park S., Lee J.-Y., Jung H. Y., Sohn B. K., Choi J. S., Kim D.-J. (2014). Similarities and differences among Internet gaming disorder, gambling disorder and alcohol use disorder: A focus on impulsivity and compulsivity. Journal of Behavioral Addictions, 3(4), 246–253. doi:10.1556/JBA.3.2014.4.6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Collins L. M., Lanza S. T. (2013). Latent class and latent transition analysis: With applications in the social, behavioral, and health sciences. New York, NY: Wiley. [Google Scholar]
  20. Coskunpinar A., Dir A. L., Cyders M. A. (2013). Multidimensionality in impulsivity and alcohol use: A meta-analysis using the UPPS model of impulsivity. Alcoholism: Clinical and Experimental Research, 37(9), 1441–1450. doi:10.1111/acer.12131 [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Deleuze J., Christiaens M., Nuyens F., Billieux J. (2017). Shoot at first sight! First person shooter players display reduced reaction time and compromised inhibitory control in comparison to other video game players. Computers in Human Behavior, 72, 570–576. doi:10.1016/j.chb.2017.02.027 [Google Scholar]
  22. Demetrovics Z., Urbán R., Nagygyörgy K., Farkas J., Griffiths M. D., Pápay O., Kökönyei G., Felvinczi K., Oláh A. (2012). The development of the problematic online gaming questionnaire (POGQ). PLoS One, 7(5), e36417. doi:10.1371/journal.pone.0036417 [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Devos G., Clark L., Maurage P., Kazimierczuk M., Billieux J. (2015). Reduced inhibitory control predicts persistence in laboratory slot machine gambling. International Gambling Studies, 15(3), 408–421. doi:10.1080/14459795.2015.1068351 [Google Scholar]
  24. D’Hondt F., Billieux J., Maurage P. (2015). Electrophysiological correlates of problematic Internet use: Critical review and perspectives for future research. Neuroscience and Biobehavioral Reviews, 59, 64–82. doi:10.1016/j.neubiorev.2015.10.005 [DOI] [PubMed] [Google Scholar]
  25. Ding W., Sun J., Sun Y., Chen X., Zhou Y., Zhuang Z., Li L., Zhang Y., Xu J. R., Du Y. (2014). Trait impulsivity and impaired prefrontal impulse inhibition function in adolescents with Internet gaming addiction revealed by a Go/No-Go fMRI study. Behavioral and Brain Functions, 10(1), 20. doi:10.1186/1744-9081-10-20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Gentile D. A., Choo H., Liau A., Sim T., Li D., Fung D., Khoo A. (2011). Pathological video game use among youths: A two-year longitudinal study. Pediatrics, 127(2), e319–e329. doi:10.1542/peds.2010-1353 [DOI] [PubMed] [Google Scholar]
  27. Goldstein R. Z., Volkow N. D. (2011). Dysfunction of the prefrontal cortex in addiction: Neuroimaging findings and clinical implications. Nature Reviews Neuroscience, 12(11), 652–669. doi:10.1038/nrn3119 [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Griffiths M. D., van Rooij T., Kardefelt-Winther D., Starcevic V., Király O., Pallesen S., Müller K., Dreier M., Carras M., Prause N., King D. L., Aboujaoude E., Kuss D. J., Pontes H. M., Lopez Fernandez O., Nagygyorgy K., Achab S., Billieux J., Quandt T., Carbonell X., Ferguson C. J., Hoff R. A., Derevensky J., Haagsma M. C., Delfabbro P., Coulson M., Hussain Z., Demetrovics Z. (2016). Working towards an international consensus on criteria for assessing Internet gaming disorder: A critical commentary on Petry et al. (2014). Addiction, 111, 167–178. doi:10.1111/add.13057 [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. James R. J. E., Tunney R. J. (2016). The need for a behavioural analysis of behavioural addictions. Clinical Psychology Review, 52, 69–76. doi:10.1016/j.cpr.2016.11.010 [DOI] [PubMed] [Google Scholar]
  30. Kardefelt-Winther D. (2015). A critical account of DSM-5 criteria for Internet gaming disorder. Addiction Research & Theory, 23(2), 93–98. doi:10.3109/16066359.2014.935350 [Google Scholar]
  31. Kardefelt-Winther D., Heeren A., Schimmenti A., van Rooij A., Maurage P., Carras M., Edman J., Blaszczynski A., Khazaal Y., Billieux J. (2017). How can we conceptualize behavioural addiction without pathologizing common behaviours? Addiction, 112(10), 1709–1715. doi:10.1111/add.13763 [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. King D. L., Delfabbro P. H. (2016). Defining tolerance in Internet gaming disorder: Isn’t it time? Addiction, 111(11), 2064–2065. doi:10.1111/add.13448 [DOI] [PubMed] [Google Scholar]
  33. Király O., Demetrovics Z. (2017). Inclusion of gaming disorder in ICD has more advantages than disadvantages. Commentary on: Scholars’ open debate paper on the World Health Organization ICD-11 gaming disorder proposal (Aarseth et al.). Journal of Behavioral Addictions, 6(3), 280–284. doi:10.1556/2006.6.2017.046 [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Király O., Sleczka P., Pontes H. M., Urbán R., Griffiths M. D., Demetrovics Z. (2017). Validation of the Ten-Item Internet Gaming Disorder Test (IGDT-10) and evaluation of the nine DSM-5 Internet gaming disorder criteria. Addictive Behaviors, 64, 253–260. doi:10.1016/j.addbeh.2015.11.005 [DOI] [PubMed] [Google Scholar]
  35. Király O., Tóth D., Urbán R., Demetrovics Z., Maraz A. (2017). Intense video gaming is not essentially problematic. Psychology of Addictive Behaviors. Advance online publication. doi:10.1037/adb0000316 [DOI] [PubMed] [Google Scholar]
  36. Ko C.-H., Hsieh T.-J., Wang P.-W., Lin W.-C., Yen C.-F., Chen C.-S., Yen J.-Y. (2015). Altered gray matter density and disrupted functional connectivity of the amygdala in adults with Internet gaming disorder. Progress in Neuro-Psychopharmacology & Biological Psychiatry, 57, 185–192. doi:10.1016/j.pnpbp.2014.11.003 [DOI] [PubMed] [Google Scholar]
  37. Ko C.-H., Yen J.-Y., Chen S.-H., Wang P.-W., Chen C.-S., Yen C.-F. (2014). Evaluation of the diagnostic criteria of Internet gaming disorder in the DSM-5 among young adults in Taiwan. Journal of Psychiatric Research, 53, 103–110. doi:10.1016/j.jpsychires.2014.02.008 [DOI] [PubMed] [Google Scholar]
  38. Kuss D. J., Griffiths M. D., Pontes H. M. (2016). Chaos and confusion in DSM-5 diagnosis of Internet gaming disorder: Issues, concerns, and recommendations for clarity in the field. Journal of Behavioral Addictions, 6(2), 103–109. doi:10.1556/2006.5.2016.062 [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Linzer D. A., Lewis J. B. (2011). poLCA: An R package for polytomous variable latent class analysis. Journal of Statistical Software, 42(10), 1–29. doi:10.18637/jss.v042.i10 [Google Scholar]
  40. Littel M., van den Berg I., Luijten M., van Rooij A. J., Keemink L., Franken I. H. A. (2012). Error processing and response inhibition in excessive computer game players: An event-related potential study. Addiction Biology, 17(5), 934–947. doi:10.1111/j.1369-1600.2012.00467.x [DOI] [PubMed] [Google Scholar]
  41. Logan G. D. (1994). On the ability to inhibit thought and action: A users’ guide to the stop signal paradigm. In Dagenbach D., Carr T. H. (Eds.), Inhibitory processes in attention, memory, and language (pp. 189–239). San Diego, CA: Academic Press. [Google Scholar]
  42. Logan G. D., Cowan W. B. (1984). On the ability to inhibit thought and action: A theory of an act of control. Psychological Review, 91(3), 295–327. doi:10.1037/0033-295X.91.3.295 [DOI] [PubMed] [Google Scholar]
  43. Pawlikowski M., Brand M. (2011). Excessive Internet gaming and decision making: Do excessive World of Warcraft players have problems in decision making under risky conditions? Psychiatry Research, 188(3), 428–433. doi:10.1016/j.psychres.2011.05.017 [DOI] [PubMed] [Google Scholar]
  44. Petry N. M., O’Brien C. P. (2013). Internet gaming disorder and the DSM-5. Addiction, 108(7), 1186–1187. doi:10.1111/add.12162 [DOI] [PubMed] [Google Scholar]
  45. Petry N. M., Rehbein F., Gentile D. A., Lemmens J. S., Rumpf H.-J., Mößle T., Bischof G., Tao R., Fung D. S., Borges G., Auriacombe M., González Ibáñez A., Tam P., O’Brien C. P. (2014). An international consensus for assessing Internet gaming disorder using the new DSM-5 approach. Addiction, 109(9), 1399–1406. doi:10.1111/add.12457 [DOI] [PubMed] [Google Scholar]
  46. Petry N. M., Rehbein F., Gentile D. A., Lemmens J. S., Rumpf H.-J., Mößle T., Bischof G., Tao R., Fung D. S., Borges G., Auriacombe M., González-Ibáñez A., Tam P., O’Brien C. P. (2016). Griffiths et al.’s comments on the international consensus statement of Internet gaming disorder: Furthering consensus or hindering progress? Addiction, 111(1), 175–178. doi:10.1111/add.13189 [DOI] [PubMed] [Google Scholar]
  47. Przybylski A. K., Weinstein N., Murayama K. (2017). Internet gaming disorder: Investigating the clinical relevance of a new phenomenon. American Journal of Psychiatry, 174(3), 230–236. doi:10.1176/appi.ajp.2016.16020224 [DOI] [PubMed] [Google Scholar]
  48. R Development Core Team. (2008). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. [Google Scholar]
  49. Rehbein F., Kliem S., Baier D., Mößle T., Petry N. M. (2015). Prevalence of Internet gaming disorder in German adolescents: Diagnostic contribution of the nine DSM-5 criteria in a state-wide representative sample. Addiction, 110(5), 842–851. doi:10.1111/add.12849 [DOI] [PubMed] [Google Scholar]
  50. Schachar R. J., Forget-Dubois N., Dionne G., Boivin M., Robaey P. (2011). Heritability of response inhibition in children. Journal of the International Neuropsychological Society, 17(2), 238–247. doi:10.1017/S1355617710001463 [DOI] [PubMed] [Google Scholar]
  51. Smith J. L., Mattick R. P., Jamadar S. D., Iredale J. M. (2014). Deficits in behavioural inhibition in substance abuse and addiction: A meta-analysis. Drug and Alcohol Dependence, 145, 1–33. doi:10.1016/j.drugalcdep.2014.08.009 [DOI] [PubMed] [Google Scholar]
  52. Starcevic V. (2016). Tolerance and withdrawal symptoms may not be helpful to enhance understanding of behavioural addictions. Addiction, 111(7), 1307–1308. doi:10.1111/add.13381 [DOI] [PubMed] [Google Scholar]
  53. van Holst R. J., van den Brink W., Veltman D. J., Goudriaan A. E. (2010). Why gamblers fail to win: A review of cognitive and neuroimaging findings in pathological gambling. Neuroscience and Biobehavioral Reviews, 34(1), 87–107. doi:10.1016/j.neubiorev.2009.07.007 [DOI] [PubMed] [Google Scholar]
  54. van Rooij A. J., Kardefelt-Winther D. (2017). Lost in the chaos: Flawed literature should not generate new disorders. Commentary on: Chaos and confusion in DSM-5 diagnosis of Internet gaming disorder: Issues, concerns, and recommendations for clarity in the field (Kuss et al.). Journal of Behavioral Addictions, 6(2), 128–132. doi:10.1556/2006.6.2017.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. van Rooij A. J., Van Looy J., Billieux J. (2017). Internet gaming disorder as a formative construct: Implications for conceptualization and measurement. Psychiatry and Clinical Neurosciences, 71(7), 445–458. doi:10.1111/pcn.12404 [DOI] [PubMed] [Google Scholar]
  56. Volkow N. D., Wang G.-J., Fowler J. S., Tomasi D. (2012). Addiction circuitry in the human brain. Annual Review of Pharmacology and Toxicology, 52, 321–336. doi:10.1146/annurev-pharmtox-010611-134625 [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Wang L., Wu L., Lin X., Zhang Y., Zhou H., Du X., Dong G. (2016). Dysfunctional default mode network and executive control network in people with Internet gaming disorder: Independent component analysis under a probability discounting task. European Psychiatry, 34, 36–42. doi:10.1016/j.eurpsy.2016.01.2424 [DOI] [PubMed] [Google Scholar]
  58. Wang Y., Wu L., Wang L., Zhang Y., Du X., Dong G. (2016). Impaired decision-making and impulse control in Internet gaming addicts: Evidence from the comparison with recreational Internet game users: Recreational game users. Addiction Biology, 22(6), 1610–1621. doi:10.1111/adb.12458 [DOI] [PubMed] [Google Scholar]
  59. World Health Organization. (2017). ICD-11 beta draft. Mental, behavioural or neurodevelopmental disorders Retrieved July 14, 2017, from https://icd.who.int/dev11/l-m/en#/http%3a%2f%2fid.who.int%2ficd%2fentity%2f338347362
  60. Yao Y.-W., Wang L.-J., Yip S. W., Chen P.-R., Li S., Xu J., Zhang J. T., Deng L. Y., Liu Q.X., Fang X.-Y. (2015). Impaired decision-making under risk is associated with gaming-specific inhibition deficits among college students with Internet gaming disorder. Psychiatry Research, 229(1–2), 302–309. doi:10.1016/j.psychres.2015.07.004 [DOI] [PubMed] [Google Scholar]
  61. Yen J.-Y., Liu T.-L., Wang P.-W., Chen C.-S., Yen C.-F., Ko C.-H. (2017). Association between Internet gaming disorder and adult attention deficit and hyperactivity disorder and their correlates: Impulsivity and hostility. Addictive Behaviors, 64, 308–313. doi:10.1016/j.addbeh.2016.04.024 [DOI] [PubMed] [Google Scholar]
  62. Zhou Z., Yuan G., Yao J. (2012). Cognitive biases toward Internet game-related pictures and executive deficits in individuals with an Internet game addiction. PLoS One, 7(11), e48961. doi:10.1371/journal.pone.0048961 [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of Behavioral Addictions are provided here courtesy of Akadémiai Kiadó

RESOURCES