Skip to main content
Journal of Medical Internet Research logoLink to Journal of Medical Internet Research
. 2014 Apr 17;16(4):e102. doi: 10.2196/jmir.2923

Executive Functioning in Alcoholics Following an mHealth Cognitive Stimulation Program: Randomized Controlled Trial

Pedro Gamito 1,2,, Jorge Oliveira 1,2, Paulo Lopes 1,2, Rodrigo Brito 1,2, Diogo Morais 1,2, Diana Silva 1, Ana Silva 1, Sara Rebelo 1, Marta Bastos 1, Alberto Deus 3
Editor: Abdulfattah Mashat
Reviewed by: Sergio Pérez
PMCID: PMC4019779  PMID: 24742381

Abstract

Background

The consequences of alcohol dependence are severe and may range from physical disease to neuropsychological deficits in several cognitive domains. Alcohol abuse has also been related to brain dysfunction specifically in the prefrontal cortex. Conventional neuropsychological interventions (paper-and-pencil cognitive stimulation training) have a positive effect but are time-consuming, costly, and not motivating for patients.

Objective

Our goal was to test the cognitive effects of a novel approach to neuropsychological intervention, using mobile technology and serious games, on patients with alcohol dependence.

Methods

The trial design consisted of a two-arm study assessing the cognitive outcomes of neuropsychological intervention with mobile serious games (mHealth) versus control (treatment-as-usual with no neuropsychological intervention) in patients undergoing treatment for alcohol dependence syndrome. Sixty-eight patients were recruited from an alcohol-rehab clinic and randomly assigned to the mHealth (n=33) or control condition (n=35). The intervention on the experimental group consisted of a therapist-assisted cognitive stimulation therapy for 4 weeks on a 2-3 days/week basis.

Results

Fourteen patients dropped out of the study. The results of the neuropsychological assessments with the remaining 54 patients showed an overall increase (P<.05) of general cognitive abilities, mental flexibility, psychomotor processing speed, and attentional ability in both experimental (n=26) and control groups (n=28). However, there was a more pronounced improvement (P=.01) specifically in frontal lobe functions from baseline (mean 13.89, SE 0.58) to follow-up (mean 15.50, SE 0.46) in the experimental group but not in the control group.

Conclusions

The overall increase in general cognitive function for both experimental and control groups supports the beneficial role of existing alcohol treatment protocols aimed at minimizing withdrawal symptoms, but the differential improvements observed in frontal lobe functioning supports the use of mobile serious games for neuropsychological stimulation to overcome executive dysfunction in patients with alcohol dependence. This trial was negative on two neuropsychological/cognitive tests, and positive on one.

Trial Registration

ClinicalTrials.gov NCT01942954; http://www.clinicaltrials.gov/ct2/show/NCT01942954 (Archived by WebCite at http://www.webcitation.org/6OYDqHLwB).

Keywords: alcohol, addiction, cognitive stimulation, executive function, mobile health, serious games

Introduction

Alcohol abuse is a global health problem and cause of excess mortality and morbidity, as well as a source of personal disruption for both abusers and their families. A representative survey-based study of the US population found that excessive consumption of alcohol increased risk of mortality over a 14-year period [1]. A study in Northern Germany concluded that alcohol dependency (as assessed by the Diagnostic and Statistical Manual of Mental Disorders, 4th edition [DSM-IV]) increased the mortality rate almost two-fold for men and more than four-fold for women [2].

Apart from excess mortality, the negative effects of alcohol on the brain can also be severe. Alcohol dependence syndrome has been related to brain dysfunction specifically in the prefrontal cortex, which is associated with cognitive functioning [3]. In fact, the available evidence suggests that alcohol abuse produces a decrease in specific cognitive abilities, particularly those associated with executive functions [4]. Many studies have found a positive correlation between the integrity of white matter and cognitive performance in teenagers and a negative effect of prolonged alcohol dependence on the integrity of white matter in adults (eg, [5]). This suggests that alcohol use is related to the reduction of the integrity of grey matter, as the integrity of grey matter depends on functional white matter, in particular, the superior longitudinal fasciculus. Also, several studies with general population samples indicate that the prefrontal cortex is particularly vulnerable to the neurotoxic effects of alcohol [6]. A recent review of 62 papers assessing cognitive dysfunction in alcoholics concluded that (1) several cognitive functions become significantly compromised, and remain so, even during abstinence, with stable effects for 1 year of abstinence, (2) without intervention, these effects start reversing after 1 year of abstinence, (3) they appear to support the diffuse cerebral hypothesis, but (4) it is still unclear which cognitive functions are more susceptible to be compromised, as well as what the necessary timeframe is for cognitive recovery [7]. What is known is that there is a relation between the excessive consumption of alcohol and the compromising of cognitive functions in a variety of domains, namely, attention, working memory, processing speed, visual-spatial capacities, impulsivity, learning, memory, verbal fluency, decision making, and executive functions [8-14]. One study showed that, even when sober, binge drinking (BDs) university students performed significantly worse on planning tasks (they took significantly longer to plan an action) and on attention/working memory tasks (they got fewer correct answers on the Paced Auditory Serial Addition Task [PASAT]) than university students who did not binge drink (non-BDs) [15]. Another study found that BDs showed a lower capacity to retain and manipulate information in the verbal working memory (Digit Span Backward, Wechsler Memory Scale [WMS-III]), as well as a greater number of persevering responses (although only on the speed of processing test [SOPT], and not on the Wisconsin Card Sorting Test [WCST]) than non-BDs [16], indicating a lower capacity on executive tasks, which depend on the functional integrity of the prefrontal cortex. Another study also found that BD university students had worse results on perseverative and intrusion errors and more false positives (Complutense Verbal Learning Test [TAVEC]), as well as greater interference (Stroop tests) and worse performance in the Digit Span (WMS-III), Corsi Block Test, and the Series Recall Test [17].

In sum, patients with alcohol dependence are clearly an important target population for neuropsychological rehabilitation programs in general and cognitive rehabilitation programs in particular. However, the literature on the effectiveness of neuropsychological rehabilitation in alcohol addicts is still scarce. A few years ago, a review of cognitive rehabilitation programs with alcoholics noted that although patients’ responses to cognitive rehabilitation techniques were generally satisfactory, those techniques had not been used in traditional treatment programs [18]. Subsequent studies have shown that training and stimulating cognitive functions that have been compromised by the effects of drugs have some positive effects. For example, a study of 120 drug addicts in treatment found that patients benefiting from cognitive rehabilitation remained in treatment for significantly longer periods, and 38% of this group ended treatment successfully, compared to only 18% of other groups [19]. Another study with 60 drug addicts in in-residence treatment found that patients undergoing cognitive rehabilitation treatment became significantly more committed to the treatment, assimilated therapeutic content better, remained in abstinence for longer periods after ending the treatment, and had better scores on social and family behavioral normalization, as well as greater reduction of legal problems, than those who did not undergo treatment [20]. In addition, a study with 40 alcoholics found that a group subjected to cognitive rehabilitation significantly improved their level of information processing, visual-constructive abilities, and decision-making process compared to a group that did not undergo cognitive rehabilitation [21]. A recent review of all available studies on cognitive rehabilitation (CR) related to addiction concluded that there is a clear tendency for improvement of success rates in the treatment of patients that are targeted by specifically cognitive rehabilitation programs [22].

Despite the apparent added value of CR, the large majority of programs are still based on pencil-and-paper tasks with questionable ecological validity for functionality in daily life. Serious games (SG), that is, games designed for other purposes than gaming, seem to be a sound way to overcome this flaw by simulating real life activities or by simply challenging patients’ cognitive functions through an interactive and appealing interface. Several have already been designed and applied to stroke and traumatic brain injury rehabilitation (eg, [23,24]). SGs are usually platforms that encompass training environments where repetition and visual and auditory feedback can be systematically manipulated according to individual specificities. And because these are games, patients are usually motivated to execute the proposed exercises. Thus, SGs combine three important aspects that may contribute to the effectiveness of this approach: repetition, feedback, and motivation. Repetition refers to an intrinsic characteristic of games, which is the possibility of repeating over and over the same action in a pleasing way. Feedback refers to the fact that, while carrying out exercises, the patient’s senses are provided with feedback on the accomplishments achieved during each task. Finally, motivation is probably enhanced in SG because they are usually presented on a multimodal platform with different immersive cues, such as images and sounds, where patients may be more willing to engage and pursue an exercise.

The increasing development of both hardware and software has allowed the use of mobile devices in cognitive rehabilitation programs [23]. It is now possible to design, develop, and apply training and treatment programs over mobile health (mHealth) applications. Mobile device-based interventions are already used, for example, to enhance emotional awareness [25] or to treat emotional disorders such as depression [26] or anxiety [27], as self-help programs to reduce cocaine consumption [28], or to support patients with mild acquired cognitive impairments [29]. There are also some studies on alcohol abusers that reflect this shift of attention. For example, Hester et al developed a Web-based application so that alcoholics could overcome their drinking problems [30]. They found that patients using their program significantly decreased their average number of drinks per drinking day and alcohol-related problems, and also increased their average number of abstinence days. The application, however, did not produce better results than the traditional approach.

Another study compared the outcomes of two types of Web-based interventions on 170 problem drinkers. In one of the interventions, Check Your Drinking (CYD) [31], screened participants were invited to answer questions about the quantity and frequency of their drinking and with the severity of their drinking problems. In the other, the Alcohol Help Center (AHC) [32], participants had to undergo several exercises based on cognitive and behavioral principles, designed to increase motivation levels and prevent relapse. A significant additional reduction in drinking for participants in the AHC group was found when compared with the CYD group [33].

However, for addiction-related cognitive impairments, research assessing the effect of cognitive stimulation using mHealth SG programs for the improvement of cognitive functioning is still in its infancy. The objective of the current study was to assess the outcome of cognitive stimulation exercises over a Web platform developed to tackle cognitive impairments of individuals with Alcohol Dependence Syndrome (ADS) [34]. The potential impact of using such an approach relies on the possibility of democratizing the access and the usage of cognitive stimulation programs throughout the health care system (ie, both through caregivers and directly to patients), thus also reducing the societal burden associated with the costs of cognitive impairments and treatments.

Methods

Trial Design

The study design consisted of a two-arm randomized controlled trial (RCT) developed to assess the neuropsychological effects of mHealth applications in alcoholics. (The trial was registered retrospectively because our funding agency, the Portuguese National Science Foundation [FCT] does not require registration for psychological tests nor does our home country have a registration system.) Our sample size was estimated based on a priori power analysis according to commonly accepted standards in the field (see Statistical Procedures) and agreed to in advance with the clinical institution where the trial took place.

The method of patient assignment was based on simple randomization with a random number generator. The patients were randomly assigned to experimental and control groups in a specialized institution for treatment of alcohol dependence (see Multimedia Appendix 1 for the CONSORT eHealth Checklist). The trial was approved by the Ethics Committee of the research center where the authors were affiliated at the time (Centre for the Study of Cognitive and Learning Psychology [CEPCA]) and adhered to the principles of the World Medical Association’s Declaration of Helsinki.

Participants

Sixty-eight patients diagnosed with ADS according to DSM-IV criteria were recruited from a specialized institution for treatment of alcohol dependence, the Novo Rumo Clinic, São João de Deus Institute in the Lisbon region, Portugal, and were asked to participate in a study on the effects of their treatment on cognitive abilities. In the experimental condition, they were told that their treatment would include cognitive exercises. Due to a dropout rate of 20.6% (14/68 patients), the final sample consisted of 54 patients.

Inclusion Criteria

Only patients that scored higher than the cut-off values for their age (see Outcomes) on the Mini Mental State Examination (MMSE) [35] and with no clinical scores on the Symptoms Checklist Revised (SCL-90-R) [36] were included in the study.

Patients continued during the entire study their regular medication regimen consisting of anxiolytics, mostly Diazepam and Tiapride, which help minimize withdrawal symptoms, and vitamins. Each patient’s assistant psychiatrist guaranteed the stability of the medication regimens throughout the program.

Exclusion Criteria

Patients with dependency on substances other than alcohol or with a history of previous neurological disorders were excluded from the study. Patients were also screened for minimal computer literacy, but no patient was excluded due to this criterion (ie, all patients demonstrated the minimum literacy required).

Study Procedure

After initial recruitment and screening, participants were randomly assigned to either the experimental group with mHealth SG-based cognitive stimulation plus treatment-as-usual (n=33) or to the control group (n=35), which received solely treatment-as-usual. The treatment-as-usual consisted of an alcohol-abstinence program adapted from the Minnesota Model (see [37] for a detailed description of this program) and lasted for an average period of 1 month.

Figure 1 illustrates the flow of participants in the experimental group throughout the protocol. Participants failing to complete training sessions within the assigned time-frame were considered to have dropped out and their data were not analyzed.

Figure 1.

Figure 1

Flow chart describing the flow of the participants in the treatment group throughout the protocol.

The trial took place over a period of 6 months, and no changes to the stimulus program were made during this period. Both the treatment and the assessments took place on location at the clinic where participants were recruited.

Each participant underwent two complete neuropsychological assessments, once after they had undergone screening and given their written informed consent to treatment and assessment, and again after at least 30 days. In the case of the treatment group, this was done after completing the intervention.

The intervention consisted of ten 60-minute sessions of cognitive stimulation with mobile technology using SG (2-3 sessions per week over the usual 4-6 week period of treatment). No institutional affiliations were presented in the eHealth media. The executive training exercises performed by participants in the experimental group were selected in order to develop cognitive abilities related to executive functioning. Each session started with a brief training period, when participants were able to (re)acquire interaction skills with the touchscreen devices. Participants accessed the exercises freely over the Internet, and their responses were registered using the input from the device’s touchscreen.

Therapists from the research and intervention team were involved in both the recruitment and the cognitive stimulation. These therapists were introduced to patients by in-house therapists and asked patients to participate in the study, explaining its benefits, duration, and demands on patients’ time and commitment. During the assessments, other therapists provided, explained, and collected the assessment forms. In the cognitive simulation sessions, the first group of therapists provided the mobile devices, launched the exercises, and explained how they worked to participants.

The mobile cognitive stimulation program consisted of several mobile applications developed to run on Android OS, which were adapted from the traditional paper-and-pencil exercise conceived for cognitive stimulation on patients with cognitive impairments, independently of the cause, but selected for their relevance to address the most common cognitive impairments in addicts. Cognitive stimulation in each session comprised attention, working memory, and logical reasoning exercises (see Textbox 1 for a more detailed description; these exercises (Figure 2) are available online [34]). The level of difficulty of each task increased progressively throughout the cognitive stimulation rationale. In the last session, the same neuropsychological tests used in the first assessment were again applied.

Cognitive stimulation program—sessions and mHealth applications. a: Perception; b: Processing speed; c: Reasoning; d: Attention; e: Memory; f: Decision making; g: Planning; h: Spatial vision.

Session 1. Slotd/Memorye/Parking Zoneg/Under pressureh/Snowflakesb

Session 2. Slotd/Memorye/Under pressureh/Snowflakesb/Right orderc

Session 3. Slotd/Memorye/Hanoi Towerf/Snowflakesb/Right orderc

Session 4. Slotd/Memorye/Odd-evenc/Parking Zoneg/Snowflakesb

Session 5. Basketc/Odd-evenc/Hand tricksh/Bricka/Memorye

Session 6. Hanoi Towerf/Parking Zoneg/Under pressureh/Memorye/Snowflakesb

Session 7. Parking Zoneg/Under pressureh/Selective transferd/Memorye/Snowflakesb

Session 8. Selective transferd/Bricka/Hand tricksh/Memorye

Session 9. Parking Zoneg/Bricka/Hand tricksh/Memorye

Session 10. Slotd/Memorye/Parking Zoneg/Under pressureh/Snowflakesb

Figure 2.

Figure 2

Slot machine (top-left) for attention; visual memory task (bottom-left and bottom-right with increased difficulty) for working memory; and word-object correspondence (top-right) for logical reasoning.

The hardware used to perform the exercises consisted of Samsung Galaxy 10.1ʺ tablets. The applications were developed using Unity 2.5, and their alpha and beta versions had been previously tested by a group of students.

Outcomes

All neuropsychological assessments were carried out with the pencil-and-paper forms of well-established cognitive tests. Global cognitive abilities were assessed with the MMSE [35], a brief screening test that has been validated for the Portuguese population [38]. The MMSE assesses diverse aspects of cognitive mental function, allowing an overall assessment of cognitive performance based on 30 items grouped into 6 categories: Orientation, Retention, Attention and Calculation, Language, and Visual-spatial abilities. The maximum score is 30 points and the current cut-off values for the Portuguese population were estimated according to age and education, specifically for people aged over 40 years: (1) 0-2 years of schooling—22, (2) 3-6 years of schooling—24, and (3) more than 7 years of schooling—27. MMSE was dictated on the basis of education.

Frontal brain functioning was evaluated with the Frontal Assessment Battery (FAB) [39]. The FAB assesses conceptualization, mental flexibility, motor programming, sensitivity to interference, inhibitory control, and environmental autonomy. The total score of the FAB (maximum 18 points) is estimated through the sum of each of the subtest scores. The FAB assesses 6 domains of frontal functioning through the ability to generate similarities (conceptualization), verbal fluency (mental flexibility), Luria’s motor series (motor programming), conflicting instructions (sensitivity to interference), go-no go paradigm (inhibitory control), and prehension behavior assessments (environmental autonomy).

Cognitive flexibility was measured with the WCST [40], which evaluates cognitive functions in several executive domains, namely the ability to develop and maintain appropriate strategies for problem solving and planning, and the ability to use environmental feedback to modify a cognitive response. The WCST assesses cognitive abilities such as abstraction, mental flexibility, and sustained attention. We focused on the overall index of performance through correct responses, categories, and perseverative errors. In the current study, we used the short version of the test (WCST-64).

Psychomotor processing speed and attentional abilities were estimated through the Color Trail Test (CTT) [41]. The CTT assesses focused and divided attention, sequencing, mental flexibility, visual search, and motor functions. The CTT consists of an A4 sheet containing circles with numbers printed in yellow and pink. Participants are asked to link the numbered circles in the right order, as fast as possible, and without lifting the pen. The CTT consists of two different forms (CTT1 and CTT2), which differ in difficulty. Two measures of performance were analyzed: errors and execution time.

Statistical Analysis

The variables evaluated during the neuropsychological assessments were submitted to parametric statistical analyses. The dependent variables were based on the neuropsychological outcomes from the MMSE, FAB, WCST, and the CTT. Scores reported refer to before intervention (baseline) and after intervention (follow-up).

Sample and baseline characteristics were compared between the experimental and control groups with Student’s t test for independent samples for interval dependent variables and chi-square test for categorical dependent variables.

The statistical analyses of evaluation outcomes were based on generalized linear model procedures using type III Sum of Squares. A full factorial model (within-between interaction) was tested using repeated measures analysis of variance (ANOVA). The factorial design consisted of one within-subjects factor with 2 levels (baseline vs follow-up) and one between-subjects factor with 2 levels (experimental vs control group). Missing data imputation was completed using linear interpolation method. A significance level of .05 was adopted for all statistical procedures. Post-hoc effect sizes are eta-square in the ANOVA procedure, and within-between interactions were tested using simple effects.

Inferential statistics were carried out using IBM SPSS v.20. A priori power analysis was estimated with G*Power v.3.1 with Cohen’s f effect size for F tests [42].

Sample Size

The expected effect size for calculating the required sample size was 0.35 (medium effect) based on a power of 0.80 for a significance level of .05. According to these criteria, a total sample size of 68 patients would be required for this trial. This was the initial size of the sample recruited for this study.

Results

Sample Characteristics

Due to a dropout rate of 20.6% (14/68 patients), the final sample consisted of 54 patients diagnosed with alcohol dependence syndrome: 45 males and 9 females, mean age 45.37 years (SD 10.12) with an average of 10 years of formal education (SD 4.62). Of these, 26 patients had been assigned to the mobile health cognitive stimulation condition: 19 males and 7 females, mean age 45.50 years (SD 10.18) with an average of 10 years of education (SD 4.39). Twenty-eight patients were assigned to the control condition consisting of treatment-as-usual: 26 males and 2 females, mean age 45.25 years (SD 10.26) with an average of 10 years of formal education (SD 4.95). No statistically significant differences at the conventional P<.05 level were observed between groups for the demographic characteristics of gender (Table 1), age, and education (Table 2).

Table 1.

Baseline demographics for categorical data.

Characteristics mHealth,
n (%)
Treatment-as-usual,
n (%)
χ2 P value
Gender 3.798 .051

Male 19 (35.2) 26 (48.1)


Female 7 (13.0) 2 (3.7)

Table 2.

Baseline demographics for interval data.

Characteristics mHealth,
mean (SD)
Treatment-as-usual,
mean (SD)
t P value
Age, yrs 45.50 (10.18) 45.25 (10.26) 0.090 .929
Education, yrs 10.18 (4.93) 10.25 (4.95) –0.052 .958

Baseline Characteristics

The statistical analyses for the neuropsychological data at baseline were focused on comparisons between groups for the overall score of the MMSE and the FAB, the correct responses, categories and perseverative errors in the WCST, and the mean errors and execution times in the CTT. The results revealed no statistically significant differences between the experimental and control group for neuropsychological outcomes at baseline (all Ps>.41) (Table 3).

Table 3.

Baseline characteristics for both mHealth and control.

Characteristics mHealth,
mean (SD)
Treatment-as-usual,
mean (SD)
t P value
MMSE

Total score 26.46 (2.97) 26.38 (2.67) 0.098 .922
FAB

Total score 13.89 (2.86) 14.14 (3.05) –0.320 .750
WCST

Correct responses 52.85 (20.05) 52.48 (17.01) 0.068 .946

Categories 54.86 (35.60) 50.00 (35.27) 0.485 .630

Perseverative errors 24.78 (15.30) 25.57 (13.56) –0.193 .848
CTT1

Errors 0.23 (0.58) 0.26 (0.08) –0.146 .409

Execution time (seconds) 86.65 (42.45) 114.02 (162.60) –0.832 .885
CTT2

Errors 0.81 (1.09) 0.85 (1.29) –0.134 .894

Execution time (seconds) 173.42 (82.06) 169.71 (93.44) 0.154 .878

Evaluation Outcomes

Global cognitive function was estimated at baseline and follow-up assessment with the MMSE. The ANOVA on the overall score of the MMSE revealed a main effect of assessment (F 1,52=20.68, eta-square=0.41, P<.001), indicating an improvement of cognitive ability from baseline (mean 26.42, SE 0.38) to follow-up (mean 27.70, SE 0.26). No statistically significant main effect of group or interaction effect between factors (Fs<1) was found (Figure 3).

Figure 3.

Figure 3

MMSE total scores for the experimental and control conditions at baseline and follow-up.

Frontal lobe functions were also evaluated under the same factorial design. The data from the FAB showed a significant interaction effect between factors (F 1,52=8.00, eta-square=0.16, P=.01). Simple effects analysis was performed to test differences between assessments on each group (experimental and control). These data indicated a significant increase in the FAB score from baseline (mean 13.89, SE 0.58) to follow-up (mean 15.50, SE 0.46) only in the experimental group, but not in the control group (mean 14.14, SE 0.56) and (mean 14.14, SE 0.45), respectively for baseline and follow-up (Figure 4).

Figure 4.

Figure 4

FAB total scores for the experimental and control conditions at baseline and follow-up.

Cognitive flexibility was measured on three different dimensions of the WCST: the correct responses, the number of categories, and the number of perseverative errors during the task. The ANOVA showed a main effect of assessment on the number of correct responses (F 1,52=15.10, eta-square=0.29, P<.001) and on the number of completed categories (F 1,52=4.94, eta-square=0.09, P=.03), indicating an improvement in performance of the WCST from baseline to follow-up assessment, but there was no interaction effect with the treatment factor (F<1). No significant effects (F<1) were reported for perseverative errors (Figure 5).

Figure 5.

Figure 5

WCST correct responses (left) perseverative errors (middle) and completed categories (right) for the experimental and control conditions at baseline and follow-up.

Speed of processing and attentional functioning were assessed respectively with execution time and error rate of the two forms of the CTT. We found a main effect of assessment for both error rate and execution time in the CTT1 and in the CTT2. A significant decrease in error rate (F 1,52=5.20, eta-square=0.10, P=.03) and execution time (F 1,52=4.26, eta-square=0.08, P=.04) was found in the CTT1 (Figure 6). The same pattern, but with a stronger effect, was found for the results of the CTT2, with a decrease in error rate (F 1,52=13.23, eta-square=0.25; P<.001) as well as execution time (F 1,52=14.41, eta-square=0.28, P<.001) (Figure 7). In both the CTT1 and the CTT2, there was no significant interaction (F<1) with the treatment factor.

Figure 6.

Figure 6

CTT1 execution time in seconds (left) and mean errors (right) for the experimental and control conditions at baseline and follow-up.

Figure 7.

Figure 7

CTT2 execution time in seconds (left) and mean errors (right) for the experimental and control conditions at baseline and follow-up.

Discussion

Principal Findings

The current experiment was designed to study the effectiveness of a cognitive stimulation program in alcohol abusers’ executive functioning with mobile SG applications. According to previous studies, alcohol dependence may impair information processing in the prefrontal areas, such as the dorsolateral prefrontal cortex and the anterior cingulate cortex, which are thought to be related to executive functioning in cognitive domains ranging from attention and working memory to higher-order functions of reasoning and decision making. In this study, our aim was to evaluate the effect of cognitive stimulation with mobile technology and serious games on the general cognitive ability of patients diagnosed with ADS.

To do this, we carried out an RCT on patients undergoing an alcohol rehabilitation treatment at a specialized institution for treatment of alcohol dependence. The overall MMSE scores at baseline suggest deficits in general cognitive ability of ADS patients, which concurs with previous studies highlighting the relationship between the alcohol abuse and cognitive impairments [4]. There were no differences at baseline between control and treatment groups, which indicates a successful random distribution of patients.

Our results indicate a general improvement of cognitive abilities in both patient groups, which reflects an effect of the withdrawal of the direct impact of alcohol on the brain. In support of the specific effectiveness of the cognitive stimulation, this effect was qualified with an interaction with the treatment factor in the FAB test, indicating a more pronounced increase of frontal cognitive abilities in patients subjected to mHealth SG approach, with improvements in frontal lobe function and executive functioning. However, there were no significant effects of the treatment on the MMSE and WCST, which measure more specific, not general, domains of frontal lobe functioning. These results are in agreement with those of other cognitive rehabilitation trials with addict populations, suggesting that the positive effects of neuropsychological rehabilitation in addicted populations are restricted to cognitive abilities related to frontal lobes [21].

The explanation for this is that both traditional exercises and SG applications focused mainly on cognitive abilities related to frontal lobe functioning, such as attention, working memory, decision making, and planning. The systematic and repeated stimulation of these functions may have had a more pronounced effect on those domains, but not on the others. Our results suggest that the neuropsychological benefits of our mHealth SG cognitive stimulation program in alcoholics may be limited to frontal lobe general functioning and that may arise from the response demands of the game tasks. That is, the processes required to meet the games’ tasks are most closely related to the processes that are captured by the FAB.

In addition, the overall feedback from the participants was positive. Qualitative comments were mainly related to the technological and innovative features of this approach and intrinsic aspects such as a positive motivation to pursue a goal in the tasks.

Limitations

This study was not designed to test the relative effectiveness of mobile intervention with online stimulation and serious games against traditional pencil-and-paper cognitive stimulation exercises. It was simply to test if this mHealth solution could add effectiveness in cognitive rehabilitation to treatment-as-usual procedures. Further studies testing the relative effectiveness of SG vs traditional approaches are needed. Due to the characteristics of SG and of the clinical context, it would not have been possible to conduct a double blind study. However, the therapists conducting the assessment were not aware of which group (experimental vs control) the patients were enrolled in.

Conclusions

The increase in general cognitive function for both experimental and controls supports the beneficial role of existing alcohol treatment protocols, which are based on medication to help minimize withdrawal symptoms along with behavioral therapy mainly to help patients manage their stress levels during abstinence, and indicates that the neuropsychological effects of alcohol abuse on brain structure are reversible through rehabilitation. The effect of the trial is encouraging, suggesting an improvement specifically in frontal cognitive general functioning in alcoholics following an mHealth approach with SG in line with previous studies using cognitive stimulation with addicts in rehab.

Acknowledgments

Hardware and software acquisition was funded by Centre for the Studies on Cognitive and Learning Psychology (where the first five authors were researchers until its merger into a larger center, COPELABS of Universidade Lusófona de Humanidades e Tecnologias, where they are currently researchers) via the Foundation for Science and Technology (FCT) of Portugal (PEst-OE/PSI/UI0700/2011).

Abbreviations

ADS

Alcohol Dependence Syndrome

AHC

AlcoholHelpCenter.net

ANOVA

analysis of variance

BD

binge drinking

CR

cognitive rehabilitation

CTT

Color Trail Test

CYD

Check Your Drinking

DSM-IV

Diagnostic and Statistical Manual of Mental Disorders, 4th edition

FAB

Frontal Assessment Battery

mHealth

mobile health

MMSE

Mini Mental State Examination

PASAT

Paced Auditory Serial Addition Task

RCT

randomized controlled trial

SCL-90-R

Symptoms Checklist Revised

SG

serious games

SOPT

Speed of Processing Test

SPSS

Statistical Package for Social Sciences

TAVEC

Verbal Learning Test of the Complutense University

WCST

Wisconsin Card Sorting Test

WMS

Wechsler Memory Scale

Multimedia Appendix 1

CONSORT-EHEALTH checklist V1.6.2 [43].

jmir_v16i4e102_app1.pdf (980.6KB, pdf)

Footnotes

Authors' Contributions: All authors contributed to the design and analysis of the study and have approved the final manuscript, but specific authors had a major role in the following aspects of the study: Pedro Gamito: concept, intervention design, and original draft; Jorge Oliveira: statistical analyses; Paulo Lopes: evaluation protocol and supervision of the intervention; Rodrigo Brito: additional literature review and critical revision; Diogo Morais: original literature review; Diana Silva and Ana Silva: neuropsychological assessment; Alberto Deus: supervision of the assessment; Sara Rebelo and Marta Bastos: intervention.

Conflicts of Interest: The authors have developed and own the majority of the applications, but these are freely available online and no commercial profit is intended from them.

References

  • 1.John U, Rumpf HJ, Bischof G, Hapke U, Hanke M, Meyer C. Excess mortality of alcohol-dependent individuals after 14 years and mortality predictors based on treatment participation and severity of alcohol dependence. Alcohol Clin Exp Res. 2013 Jan;37(1):156–63. doi: 10.1111/j.1530-0277.2012.01863.x. [DOI] [PubMed] [Google Scholar]
  • 2.Breslow RA, Graubard BI. Prospective study of alcohol consumption in the United States: quantity, frequency, and cause-specific mortality. Alcohol Clin Exp Res. 2008 Mar;32(3):513–21. doi: 10.1111/j.1530-0277.2007.00595.x. [DOI] [PubMed] [Google Scholar]
  • 3.Chan RC, Shum D, Toulopoulou T, Chen EY. Assessment of executive functions: review of instruments and identification of critical issues. Arch Clin Neuropsychol. 2008 Mar;23(2):201–16. doi: 10.1016/j.acn.2007.08.010. [DOI] [PubMed] [Google Scholar]
  • 4.Moselhy HF, Georgiou G, Kahn A. Frontal lobe changes in alcoholism: a review of the literature. Alcohol Alcohol. 2001;36(5):357–68. doi: 10.1093/alcalc/36.5.357. http://alcalc.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=11524299. [DOI] [PubMed] [Google Scholar]
  • 5.Elofson J, Gongvatana W, Carey KB. Alcohol use and cerebral white matter compromise in adolescence. Addict Behav. 2013 Jul;38(7):2295–305. doi: 10.1016/j.addbeh.2013.03.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Oscar-Berman M, Marinković K. Alcohol: effects on neurobehavioral functions and the brain. Neuropsychol Rev. 2007 Sep;17(3):239–57. doi: 10.1007/s11065-007-9038-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Stavro K, Pelletier J, Potvin S. Widespread and sustained cognitive deficits in alcoholism: a meta-analysis. Addict Biol. 2013 Mar;18(2):203–13. doi: 10.1111/j.1369-1600.2011.00418.x. [DOI] [PubMed] [Google Scholar]
  • 8.Beatty WW, Tivis R, Stott HD, Nixon SJ, Parsons OA. Neuropsychological deficits in sober alcoholics: influences of chronicity and recent alcohol consumption. Alcohol Clin Exp Res. 2000 Feb;24(2):149–54. [PubMed] [Google Scholar]
  • 9.Cantrell H, Finn PR, Rickert ME, Lucas J. Decision making in alcohol dependence: insensitivity to future consequences and comorbid disinhibitory psychopathology. Alcohol Clin Exp Res. 2008 Aug;32(8):1398–407. doi: 10.1111/j.1530-0277.2008.00714.x. http://europepmc.org/abstract/MED/18565158. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Davies SJ, Pandit SA, Feeney A, Stevenson BJ, Kerwin RW, Nutt DJ, Marshall EJ, Boddington S, Lingford-Hughes A. Is there cognitive impairment in clinically 'healthy' abstinent alcohol dependence? Alcohol Alcohol. 2005;40(6):498–503. doi: 10.1093/alcalc/agh203. http://alcalc.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=16186142. [DOI] [PubMed] [Google Scholar]
  • 11.Goudriaan AE, Grekin ER, Sher KJ. Decision making and response inhibition as predictors of heavy alcohol use: a prospective study. Alcohol Clin Exp Res. 2011 Jun;35(6):1050–7. doi: 10.1111/j.1530-0277.2011.01437.x. http://europepmc.org/abstract/MED/21332527. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Le Berre AP, Vabret F, Cauvin C, Pinon K, Allain P, Pitel AL, Eustache F, Beaunieux H. Cognitive barriers to readiness to change in alcohol-dependent patients. Alcohol Clin Exp Res. 2012 Sep;36(9):1542–9. doi: 10.1111/j.1530-0277.2012.01760.x. [DOI] [PubMed] [Google Scholar]
  • 13.Noël X, Bechara A, Dan B, Hanak C, Verbanck P. Response inhibition deficit is involved in poor decision making under risk in nonamnesic individuals with alcoholism. Neuropsychol. 2007;21:778–786. doi: 10.1037/0894-4105.21.6.778. [DOI] [PubMed] [Google Scholar]
  • 14.Pitel AL, Rivier J, Beaunieux H, Vabret F, Desgranges B, Eustache F. Changes in the episodic memory and executive functions of abstinent and relapsed alcoholics over a 6-month period. Alcohol Clin Exp Res. 2009 Mar;33(3):490–8. doi: 10.1111/j.1530-0277.2008.00859.x. [DOI] [PubMed] [Google Scholar]
  • 15.Hartley DE, Elsabagh S, File SE. Binge drinking and sex: effects on mood and cognitive function in healthy young volunteers. Pharmacol Biochem Behav. 2004 Jul;78(3):611–9. doi: 10.1016/j.pbb.2004.04.027. [DOI] [PubMed] [Google Scholar]
  • 16.Parada M, Corral M, Mota N, Crego A, Rodríguez Holguín S, Cadaveira F. Executive functioning and alcohol binge drinking in university students. Addict Behav. 2012 Feb;37(2):167–72. doi: 10.1016/j.addbeh.2011.09.015. [DOI] [PubMed] [Google Scholar]
  • 17.García-Moreno L, Expósito J, Sanhueza C, Angulo M. Actividad prefrontal y alcoholismo de fin de semana en jóvenes. Prefrontal activity and weekend alcoholism in young people Adicciones. 2008;20:271–279. [PubMed] [Google Scholar]
  • 18.Allen DN, Goldstein G, Seaton BE. Cognitive rehabilitation of chronic alcohol abusers. Neuropsychol Rev. 1997 Mar;7(1):21–39. doi: 10.1007/BF02876971. [DOI] [PubMed] [Google Scholar]
  • 19.Grohman K, Fals-Stewart W. Computer-assisted cognitive rehabilitation with substance-abusing patients: Effects on treatment response. J Cogn Rehab. 2003;21(4):10–17. [Google Scholar]
  • 20.Fals-Stewart W, Lam WK. Computer-assisted cognitive rehabilitation for the treatment of patients with substance use disorders: a randomized clinical trial. Exp Clin Psychopharmacol. 2010 Feb;18(1):87–98. doi: 10.1037/a0018058. [DOI] [PubMed] [Google Scholar]
  • 21.Goldstein G, Haas GL, Shemansky WJ, Barnett B, Salmon-Cox S. Rehabilitation during alcohol detoxication in comorbid neuropsychiatric patients. J Rehabil Res Dev. 2005;42(2):225–34. doi: 10.1682/jrrd.2004.03.0040. http://www.rehab.research.va.gov/jour/05/42/2/pdf/Goldstein.pdf. [DOI] [PubMed] [Google Scholar]
  • 22.Ruiz-Sánchez de León JM, Pedrero-Pérez EJ, Rojo-Mota G, Llanero-Luque M, Puerta-García C. [A proposal for a protocol of neuropsychological assessment for use in addictions] Rev Neurol. 2011 Oct 16;53(8):483–93. http://www.revneurol.com/LinkOut/formMedLine.asp?Refer=2010809&Revista=RevNeurol. [PubMed] [Google Scholar]
  • 23.Gamito P, Oliveira J, Lopes P, Morais D, Brito R, Saraiva T, Bastos M, Cristóvão S, Caçôete C, Picareli F. Assessment of frontal brain functions in alcoholics following a health mobile cognitive stimulation approach. Stud Health Technol Inform. 2013;191:110–4. [PubMed] [Google Scholar]
  • 24.Gamito P, Oliveira J, Pacheco J, Morais D, Saraiva T, Lacerda R, Baptista A, Santos N, Soares F, Gamito L Rosa P. Traumatic Brain Injury memory training: a Virtual Reality online solution. International Journal on Disability and Human Development. 2011;10(4):309–312. doi: 10.1515/IJDHD.2011.049. [DOI] [Google Scholar]
  • 25.Morris ME, Kathawala Q, Leen TK, Gorenstein EE, Guilak F, Labhard M, Deleeuw W. Mobile therapy: case study evaluations of a cell phone application for emotional self-awareness. J Med Internet Res. 2010;12(2):e10. doi: 10.2196/jmir.1371. http://www.jmir.org/2010/2/e10/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.van Bastelaar KM, Pouwer F, Cuijpers P, Riper H, Twisk JW, Snoek FJ. Is a severe clinical profile an effect modifier in a Web-based depression treatment for adults with type 1 or type 2 diabetes? Secondary analyses from a randomized controlled trial. J Med Internet Res. 2012;14(1):e2. doi: 10.2196/jmir.1657. http://www.jmir.org/2012/1/e2/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Klein B, Meyer D, Austin DW, Kyrios M. Anxiety online: a virtual clinic: preliminary outcomes following completion of five fully automated treatment programs for anxiety disorders and symptoms. J Med Internet Res. 2011;13(4):e89. doi: 10.2196/jmir.1918. http://www.jmir.org/2011/4/e89/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Schaub M, Sullivan R, Haug S, Stark L. Web-based cognitive behavioral self-help intervention to reduce cocaine consumption in problematic cocaine users: randomized controlled trial. J Med Internet Res. 2012;14(6):e166. doi: 10.2196/jmir.2244. http://www.jmir.org/2012/6/e166/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Eghdam A, Scholl J, Bartfai A, Koch S. Information and communication technology to support self-management of patients with mild acquired cognitive impairments: systematic review. J Med Internet Res. 2012;14(6):e159. doi: 10.2196/jmir.2275. http://www.jmir.org/2012/6/e159/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Hester RK, Lenberg KL, Campbell W, Delaney HD. Overcoming Addictions, a Web-based application, and SMART Recovery, an online and in-person mutual help group for problem drinkers, part 1: three-month outcomes of a randomized controlled trial. J Med Internet Res. 2013;15(7):e134. doi: 10.2196/jmir.2565. http://www.jmir.org/2013/7/e134/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Check Your Drinking. 2013. [2013-11-03]. http://www.checkyourdrinking.net/CYD/CYDScreenerP1_0.aspx.
  • 32.Alcohol Help Center. 2013. [2013-11-03]. http://www.alcoholhelpcenter.net/
  • 33.Cunningham JA. Comparison of two Internet-based interventions for problem drinkers: randomized controlled trial. J Med Internet Res. 2012;14(4):e107. doi: 10.2196/jmir.2090. http://www.jmir.org/2012/4/e107/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Gamito. 2013. [2013-08-29]. http://labpsicom.ulusofona.pt/
  • 35.Folstein MF, Folstein SE, McHugh PR. "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975 Nov;12(3):189–98. doi: 10.1016/0022-3956(75)90026-6. [DOI] [PubMed] [Google Scholar]
  • 36.Derogatis LR. SCL-90-R: administration, scoring and procedures manual II. Towsen, MD: Clinical Psychometric Research; 1992. [Google Scholar]
  • 37.Morgenstern J, Bux D, Labouvie E, Blanchard KA, Morgan TI. Examining mechanisms of action in 12-step treatment: the role of 12-step cognitions. J Stud Alcohol. 2002 Nov;63(6):665–72. doi: 10.15288/jsa.2002.63.665. [DOI] [PubMed] [Google Scholar]
  • 38.Guerreiro M, Silva AP, Botelho MA, Leitão A, Castro-Caldas A Garcia C. Adaptação à população portuguesa da tradução do Mini-Mental State Examination (MMSE) Revista Portuguesa de Neurologia. 1994;3(1):9–10. [Google Scholar]
  • 39.Dubois B, Slachevsky A, Litvan I, Pillon B. The FAB: a Frontal Assessment Battery at bedside. Neurology. 2000 Dec 12;55(11):1621–6. doi: 10.1212/wnl.55.11.1621. [DOI] [PubMed] [Google Scholar]
  • 40.Heaton RK, Chelune GJ, Talley JL, Kay GG, Curtiss G. Wisconsin card sorting test (WCST) — manual revised and expanded. Odessa, FL: Psychological Assessment Resources; 1993. [Google Scholar]
  • 41.D'Elia L, Satz P, Uchiyama C, White T. Color trails test professional manual. Odessa, FL: Psychological Assessment Resources; 1999. [Google Scholar]
  • 42.Cohen J. Statistical power analysis for the behavioral sciences. Hillsdale, NJ: L. Erlbaum Associates; 1988. [Google Scholar]
  • 43.Eysenbach G, CONSORT-EHEALTH Group CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res. 2011;13(4):e126. doi: 10.2196/jmir.1923. http://www.jmir.org/2011/4/e126/ [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of Medical Internet Research are provided here courtesy of JMIR Publications Inc.

RESOURCES