Efficacy of a short cognitive training program in patients with multiple sclerosis

Abstract

Background

Cognitive impairment is a common feature in multiple sclerosis (MS) and may have a substantial impact on quality of life. Evidence about the effectiveness of neuropsychological rehabilitation is still limited, but current data suggest that computer-assisted cognitive training improves cognitive performance.

Objective

The objective of this study was to evaluate the efficacy of combined computer-assisted training supported by home-based neuropsychological training to improve attention, processing speed, memory and executive functions during 3 consecutive months.

Methods

In this randomized controlled study blinded for the evaluators, 62 MS patients with clinically stable disease and mild-to-moderate levels of cognitive impairment were randomized to receive a computer-assisted neuropsychological training program (n=30) or no intervention (control group [CG]; n=32). The cognitive assessment included the Brief Repeatable Battery of Neuropsychological Test. Other secondary measures included subjective cognitive impairment, anxiety and depression, fatigue and quality of life measures.

Results

The treatment group (TG) showed significant improvements in measures of verbal memory, working memory and phonetic fluency after intervention, and repeated measures analysis of covariance revealed a positive effect in most of the functions. The control group (CG) did not show changes. The TG showed a significant reduction in anxiety symptoms and significant improvement in quality of life. There were no improvements in fatigue levels and depressive symptoms.

Conclusion

Cognitive intervention with a computer-assisted training supported by home training between face-to-face sessions is a useful tool to treat patients with MS and improve functions such as verbal memory, working memory and phonetic fluency.

Video abstract

Download video file ^{(134.1MB, avi)}

Introduction

Multiple sclerosis (MS) is an inflammatory degenerative disease of the central nervous system (CNS), which is thought to be largely caused by autoimmune processes that produce loss of myelin in the white matter of the cerebral hemispheres, brainstem, cerebellum, spinal cord and optic nerves. Because of the widespread nature of the MS lesions within the CNS, the illness presents a broad range of symptoms, which include loss of vision, tremor, ataxia, sphincter dysfunction, neuropsychiatric symptoms and cognitive impairment, among others.

Recent studies show that cognitive decline in MS can be attributed not only to the involvement of the white matter but also to the pathology of the gray matter.^1–3

Cognitive impairment is a frequent feature of MS affecting up to 65% of patients,⁴ at both the earlier and later stages of the disease,⁵ and it tends to worsen over time.⁶

MS negatively affects several aspects of cognitive functions, including attention, information processing,⁷ learning and memory, executive function and visuospatial abilities,⁸ causing an important impact on quality of life,^9–11 employment status,¹² daily functioning, independence¹³ and participation in social activities.¹⁴ For this reason, the alleviation of deficits in cognitive functioning should be the main goal in MS research.

Systematic reviews on cognitive rehabilitation in MS have not found evidence to support its effectiveness. Hence, a recent review of the Cochrane Database found low-level evidence for positive effects of neuropsychological rehabilitation in MS, probably due to the fact that interventions and outcome measures included were heterogeneous, which limited the comparability of the studies.¹³ However, some studies show that neuropsychological rehabilitation may have favorable effects on patients’ cognitive performance. Specifically, there is some evidence that individual computer-assisted cognitive rehabilitation improves performance in neuropsychological tests.

Some of the studies have focused on specific attention training^15–17 or memory,^18,19 while others have shown a positive effect on multiple skills.^20–24 Table 1 lists some of the major studies on the topic.

Table 1.

Cognitive intervention studies

Studies	Participants	Cognitive domains	Duration, frequency	Techniques	Results
Brissart et al21	TG: 10 CG: 10	Multiple skills	6 months, 2/month	Computer-assisted program	TG showed improvements in verbal memory, visual memory, working memory, verbal fluency and language
Mattioli et al49	TG: 10 CG: 10	Attention executive functions	12 weeks, 3/week	Computer-assisted program	TG showed improvements in attention, information processing, executive functions and depressive scores
Shatil et al20	TG: 24 CG: 22	Multiple skills	12 weeks, 3/week	Computer-assisted program	TG improved memory-based cognitive abilities, speed of information recall, focused attention and visuomotor vigilance
Plohmann et al15	TG: 22	Attention	2×3 weeks	Computer-assisted retraining	The group showed significant improvement in cognitive performance and daily functioning
De Giglio et al23	TG: 18 CG: 17	Multiple skills	8 weeks	Home-based cognitive rehabilitation program based on the video game Dr Kawashima’s Brain Training	TG improved cognitive functions, some aspects of QoL and cognitive fatigue
Amato et al16	TG: 55 CG: 33	Attention	12 weeks, 2/week	Computer-assisted program: specific vs nonspecific training	Improvements in the PASAT (working memory) with specific training
Chiaravalloti et al18	TG: 41 CG: 41	Memory and learning	10 sessions	mSMT	Significant improved learning, everyday memory, general contentment and family report of apathy and executive functions
Rosti-Otajärvi et al22	TG: 50 CG: 28	Multiple skills	13 weeks, 1/week	Computer-assisted program: strategy-oriented neuropsychological rehabilitation	Positive effects on perceived cognitive deficits maintained after 9 months
Stuifbergen et al19	TG: 34 CG: 27	Memory, attention and problem solving	8 weeks, 3/week	Computer-assisted program combined with eight group meetings	Effects on verbal memory and compensatory strategies
Mäntynen et al24	TG: 58 CG: 40	Multiple skills	13 weeks, 1/week	Computer-assisted program: strategy-oriented neuropsychological rehabilitation	TG did not improve cognitive performance but had a positive effect on perceived cognitive deficits
Cerasa et al17	TG: 12 CG: 11	Attention	6 weeks, 2/week	Computer-assisted program	Improvement in attention abilities

Abbreviations: TG, treatment group; CG, control group; mSMT, modified Story Memory Technique; PASAT, Paced Auditory Serial Addition Test; QoL, quality of life.

We have developed a multi-domain computer-assisted cognitive rehabilitation program supported by independent home-based work intended to generalize the strategies. The main objective was to assess the effectiveness of the rehabilitation program in patients with mild/moderate cognitive impairment. Additionally, we studied the effects of the program on emotional variables, perception of fatigue and cognitive impairment, and we analyzed the impact on quality of life.

Methods

The study was conducted in accordance with the principles of the Declaration of Helsinki²⁵ and good clinical practice standards and was approved by the ethics committee for clinical research of the University Hospital of the Canary Islands. All participants provided written informed consent to participate.

Patients and design

A randomized, controlled, 3-month study blinded for the evaluators was conducted in the Service of Neurology of the Complejo Hospitalario Universitario de Canarias (Tenerife) and in the Service of Neurology of the Doctor José Molina Orosa Hospital (Lanzarote). The study was conducted between October 2013 and June 2015.

An incidental sample obtained from the population of patients with MS treated at the Service of Neurology of two tertiary hospitals was recruited.

Inclusion was based on the following criteria:

1. MS diagnosis according to the revised McDonald criteria;²⁶

2. being older than 18 years;

3. having an Expanded Disability Status Scale (EDSS)²⁷ score ≤7.0 to prevent the inclusion of patients who may have difficulty traveling to the center in the rehabilitation phase;

4. subjective complaints about cognitive problems; this information was taken into account to promote adherence to the training program and

5. objective cognitive impairment defined as a performance of 1.5 standard deviation lower than the mean in a control group (CG) in at least two cognitive tests (determined by the neuropsychological assessment).

Participants were excluded if:

1. they had a diagnosis of current or past severe psychiatric disorder;

2. they had a relapse or had taken steroids within the 3 months prior to inclusion based on their clinical history;

3. they had previously participated in any cognitive rehabilitation program and

4. they met the criteria for the diagnosis of dementia.²⁸

Measurements and variables

The Brief Repeatable Battery of Neuropsychological Test (BRB-N)²⁹ was used to assess abilities in various cognitive domains. The battery consists of five tests: Selective Reminding Test (SRT)³⁰ as a measure of verbal learning and delayed recall, which included long-term storage (SRT-LTS), consistent long-term retrieval (SRT-CLTR) and delayed recall (SRT-DR); the 10/36 Spatial Recall Test,³¹ an extended version of the original form and the 7/24 Spatial Recall Test that assesses visuospatial learning and delayed recall (SPART-T and SPART-DR); the Symbol Digit Modalities Test (SDMT)³² as a measure of complex attention and processing speed; the Paced Auditory Serial Addition Test (PASAT)³³ that assesses sustained attention and working memory and the Controlled Oral Word Association Test (COWAT)³⁴ that assesses verbal fluency. Normative values were adopted in accordance with Sepulcre et al³⁵ and Troyer.³⁶

Other instruments were used to measure the possible influence of the training on different aspects of MS: the Multiple Sclerosis Neuropsychological Questionnaire (MSNQ),³⁷ the Fatigue Severity Scale (FSS),³⁸ the Hospital Anxiety and Depression Scale (HADS)³⁹ and the Multiple Sclerosis Quality of Life-54 (MSQoL-54).⁴⁰

The neuropsychological battery and the questionnaires were administrated by a neuropsychologist familiar with the administration of all the tests. Alternative forms of the neuropsychological battery were used at baseline and after intervention program, in order to control test–retest effects and learning effects. The neuropsychologist who performed the posttreatment cognitive assessment was blinded to the group allocation of the patients.

Intervention procedure

The 62 participants included in the study were randomly assigned to either the intervention group or the CG.

The wait-list CG received no treatment. This group received information about their cognitive status and received a booklet containing a set of guidelines and general advice on the influence of habits and lifestyles on cognitive functions. The CG was contacted once a week.

The treatment group (TG) received cognitive training for a total of 12 weekly consecutive sessions, each lasting 60–75 minutes.

The rehabilitation program was focused on attention, processing speed, memory and executive functions through computerized and paper and pencil tasks designed by the members of the research team (all tasks were different to evaluation procedures to prevent the effect of practice). In order to ensure homogeneity, all sessions were standardized for all patients.

The sessions included 10 minutes to evaluate the generalization of prior training to activities of daily life and control and/or correction of assignment notebooks delivered in the previous session and 50 minutes of working with the patients. The last 10–15 minutes consisted of feedback on the performance and relevance of the work and a review of work done at home during the week. Table 2 lists the distribution of cognitive functions trained in each session. Figure 1 shows two examples of attention and memory tasks.

Table 2.

Functions trained in each session

Session	Cognitive functions
1	Attention, processing speed and inhibition
2	Attention, processing speed, inhibition and visual memory
3	Attention and verbal memory
4	Memory of names and organization
5	Attention, processing speed and learning
6	Visuospatial memory and calculation
7	Working memory and concentration
8	Working memory and organization
9	Sustained attention and visual memory
10	Processing speed and planning
11	Verbal and working memory
12	Contextual memory and application of techniques to activities of daily living

Figure 1.

Examples of computerized tasks.

After each session, patients were handed a booklet with tasks to perform at home during the week. These booklets were composed of a minimum of 10 and a maximum of 30 exercises designed to reinforce the material covered in the previous session and prevent cognitive inactivity until the next session. These booklets included cancellation tasks to work attentional functions, memorization of stimuli tasks (words, numbers and images), task planning and organizing and other tasks. Figure 2 shows examples of the tasks.

Figure 2.

Examples of paper and pencil tasks.

The review on the degree of compliance with home training and patient feedback on their performance was one of the most important points in these booklets (only patients with a degree of compliance ≥80% were included in the analyses).

The last booklet contained a set of guidelines and general advice on the influence of habits and lifestyles on cognitive functions, practical exercises for working memory and the ability to concentrate as well as suggestions on planning and physical activity.

Statistical analysis

Categorical variables were expressed as frequencies and percentages. Continuous variables were expressed as mean, standard deviation, median and range (min–max). Normality was tested with the Kolmogorov–Smirnov test.

The comparison between groups for continuous variables was performed using the Student’s t-test, and the Mann–Whitney U test was used for the comparison of categorical variables.

A repeated measures analysis of covariance (ANCOVA) with baseline and 3 months scores as dependent measures, time as a fixed factor, TG as an independent variable and age and schooling as covariates was used to test the effect of the intervention on cognitive performance.

A repeated measures analysis of variance was used to test for changes in secondary variables (subjective perception of cognitive disability, level of fatigue, anxiety and depression and quality of life).

The Pearson coefficient was used to calculate the correlation between effect sizes of change in cognitive measures and anxiety and depressive symptoms.

Statistical analysis was performed with SPSS v. 17.0 (SPSS Inc., Chicago, IL, USA). The P-values <0.05 were considered statistically significant.

Results

A total of 62 patients were included in the statistical analysis. Table 3 lists their clinical and demographic characteristics. No differences were found between groups in terms of sex, age, level of schooling, MS course, disease duration or EDSS scores.

Table 3.

Clinical and demographic characteristics of patients

Characteristics	TG (n=30)	CG (n=32)	P-value
Sex (female), n (%)	18 (56.3)	14 (76.7)	0.09
Age (years)	44.93±9.89	40.88±8.50	0.08
Schooling (years)	10.21±2.64	11.59±3.03	0.06
MS course, n (%)
RR	27 (90.0)	30 (93.7)
SP	2 (6.7)	0 (0)	0.63
PP	1 (3.3)	2 (6.3)
Disease duration (years)	11.50±8.05	9.59±7.40	0.34
EDSS	2.78±1.98	2.11±1.36	0.12

Abbreviations: CG, control group; EDSS, Expanded Disability Status Scale; MS, multiple sclerosis; PP, primary progressive; RR, relapsing remitting; SP, secondary progressive; TG, treatment group.

Both the TG and the CG were cognitively equivalent before intervention (there were no significant differences in any cognitive variable; Table 4).

Table 4.

Results of cognitive assessment

Measures	TG (n=30)	CG (n=32)	t/F	df	P-value
SRT
LTS
Baseline	26.37±15.56	28.91±13.27	1.93	1.60	0.49
3 months	41.40±14.91*	34.00±16.26	8.52	1.57	<0.05
CLTR
Baseline	17.57±13.94	22.03±13.89	0.00	1.60	0.21
3 months	32.03±18.26#	24.53±16.28	14.8	1.57	<0.001
SRT-DR
Baseline	5.87±2.56	6.03±2.87	0.76	1.60	0.81
3 months	8.03±2.79‡	6.22±2.86	20.48	1.57	<0.001
10/36 SPART
SPART – total
Baseline	20.70±4.81	20.47±4.50	0.19	1.60	0.85
3 months	22.77±5.56	21.38±4.14	1.34	1.57	0.25
SPART-DR
Baseline	6.50±2.11	7.59±1.76	−1.82	1.60	0.06
3 months	7.87±2.21	7.63±1.81	5.24	1.57	<0.05
SDMT
Baseline	42.00±12.72	47.53±11.09	−1.76	1.60	0.07
3 months	46.47±13.30	47.93±10.34	8.13	1.57	<0.05
PASAT
PASAT-3″ correct
Baseline	24.50±14.56	31.18±14.41	−1.77	1.60	0.07
3 months	29.70±15.48¶	30.44±16.08	22.02	1.57	<0.001
COWAT
FAS
Baseline	28.37±10.13	31.88±9.69	−1.07	1.60	0.29
3 months	32.23±9.67*	33.13±11.21	4.55	1.57	<0.05
Animals
Baseline	17.70±5.05	19.00±4.48	−1.39	1.60	0.17
3 months	19.23±4.45	19.63±5.51	1.02	1.57	0.32

Notes: All values are raw scores. Comparing baseline with 3 months:

^*P<0.05,

^#P<0.001,

^‡P<0.001, and

^¶P≤0.05.

Abbreviations: CG, control group; CLTR, consistent long-term retrieval; COWAT, Controlled Oral Word Association Test; df, degree of freedom; DR, delayed recall; FAS, Phonetic fluency; LTS, long-term storage; PASAT, Paced Auditory Serial Addition Test; SDMT, Symbol Digit Modalities Test; SPART, Spatial Recall Test; SRT, Selective Reminding Test; TG, treatment group.

ANCOVA showed the intervention effect on cognitive performance in all verbal memory measures (LTS [P<0.05], CLTR [P<0.001], SRT-DR [P≤0.001]), visu-ospatial delayed recall (SPART [P<0.05]), working memory (PASAT [P<0.001]), processing speed (SDMT [P<0.05]) and phonetic fluency (COWAT [P≤0.05]).

The CG showed no differences in cognitive performance between baseline condition and condition after 3 months, but the TG showed improvements in verbal memory, working memory and phonetic fluency.

Regarding secondary variables (Table 5), both the TG and the CG were equivalent in subjective perception of cognitive performance (MSNQ), level of fatigue (FSS) and anxiety (HADS); however, the TG showed higher scores in depression (HADS) at the beginning of the treatment. The CG had higher quality of life (physical and mental).

Table 5.

Questionnaire results at baseline and at 3 months

Measures	TG (n=30)	CG (n=32)	t/F	df	P-value
MSNQ
Baseline	29.83±11.99	24.28±11.57	2.41	1.60	0.07
3 months	23.87±11.83*	25.63±11.83	16.55	1.60	<0.001
FSS
Baseline	34.73±21.97	28.89±21.79	1.05	1.60	0.29
3 months	30.51±20.22	29.21±21.94	1.44	1.60	0.24
HADS
Anxiety
Baseline	8.10±4.18	6.50±3.39	1.66	1.60	0.10
3 months	5.97±3.15#	7.41±3.44#	17.52	1.60	<0.001
Depression
Baseline	7.47±3.29	5.75±3.63	2.11	1.60	0.05
3 months	5.57±3.93	6.13±3.49	12.31	1.60	<0.001
MSQoL-54
Physical
Baseline	46.43±17.83	63.75±17.27	−3.88	1.60	<0.001
3 months	52.99±19.20¶	63.24±16.98	4.57	1.60	<0.05
Mental
Baseline	47.88±20.19	62.16±16.27	−3.07	1.60	0.03
3 months	56.39±18.70‡	67.32±17.06	1.18	1.60	0.28

Notes: All values are raw scores. Comparing baseline with 3 months:

^*P<0.001,

^#P<0.05,

^‡P<0.05 and

^¶P<0.05.

Abbreviations: CG, control group; df, degree of freedom; FSS, Fatigue Severity Scale; HADS, Hospital Anxiety and Depression Scale; MSNQ, Multiple Sclerosis Neuropsychological Questionnaire; MSQoL-54, Multiple Sclerosis Quality of Life-54; TG, treatment group.

After intervention, the TG had a significant decrease in anxiety symptoms, a significantly lower score in MSNQ and higher quality of life, both physical and mental. ANCOVA showed a positive effect of the treatment on MSNQ (P<0.001), anxiety (P<0.001), depression (P<0.001) and physical quality of life (P<0.001).

Regarding effect size in cognitive measures, anxiety showed a negative correlation with CLTR (F=−0.436, P=0.26) and the same trend in the remaining variables but without statistical significance.

Discussion

Neurodegenerative conditions such as dementia, Parkinson’s disease and MS are often characterized by a significant neuropsychological deficit worsening the quality of life of patients and reducing their occupational profile and social participation.^41–43 Cognitive rehabilitation could be a useful tool in reducing the impairment and/or maintaining the cognitive status, although the results of research conducted on this are inconclusive.

We have developed a multi-domain computer-assisted cognitive program supported by home-based work for 3 months to train cognitive functions in patients with MS.

The main result of the present study is that this type of intervention can be effective to improve some of major cognitive functions, which are affected in patients with MS: verbal memory, working memory, processing speed and phonetic fluency. The exercises induced significantly better results on both the objective and subjective perception of cognitive impairment compared with a non-cognitive-specific intervention receiving information about cognitive functions and status and some advice about them.

The benefits of rehabilitation in cognition have been documented in several studies, and our data are consistent with the literature. The results obtained in the present study are similar to those found by Brissart et al,²¹ who used a nonspecific training in which multiple cognitive domains are worked. In this case, the TG showed an increase in several cognitive measures. For their part, Shatil et al²⁰ obtained similar results with a more intensive computer-aided intervention program with three training sessions per week. Other studies have also shown the positive effects of computerized training of different cognitive domains, even in the perception of improvement in cognitive deficits.²²

Unlike most of the abovementioned studies, the present study applies a combination of computer-assisted work (weekly training has been focused on teaching of memorization techniques, organization of information or planning and direct training on attention functions, working memory and processing speed) and self-training at home to reinforce the cognitive strategies, putting these strategies into practice and avoiding inactivity between sessions. The training program had positive results, both in cognitive variables and in the subjective perception of cognitive status. Finally, the program was less intensive and shorter in time. The authors believe that the combination of the two types of training allows the same positive results to be obtained as longer workouts that only include one treatment modality.

As regards working memory, this impairment is well known in patients with MS, but not many studies have demonstrated improvement resulting from intervention.^21,44

These results suggest that our intervention protocol is at least partially effective in improving cognitive functions, although other possible explanations should be considered.

First, the results may be related to the effect of practice, although the CG did not show better performance in any of the variables analyzed and this effect was controlled by using alternative versions of the same battery. However, with the aim of avoiding the regression to the mean, both the experimental group and the CG were equivalent on all clinical (EDSS score, MS course, disease duration), demographic (sex, age, schooling) and neuropsychological variables. In addition, the possible effect of baseline performance on the 3-month performance was controlled by including a repeated measures model in the analyses.

Second, patients were not blinded to the intervention group, and it is also possible that the results were influenced by this, which could contribute to and increase the placebo effect of the patients included in the TG and a tendency to not perceive cognitive changes in patients of the waiting group.

It is noteworthy that, in the present study, the patients who received cognitive training also showed a significant decrease in the anxiety score but not in the depression score. The high prevalence of psychiatric concerns, such as depression and anxiety, has been well documented in patients with MS.⁴⁵ It seems that depression symptoms and anxiety symptoms may involve different processes within MS.⁴⁶ We believe that anxiety could be related to the feeling of lack of control over various aspects of the disease and with the anticipation of negative consequences. Both the CG and TG were informed about the implications of cognitive deterioration and received advice about them. The TG showed a significant lower score on anxiety measures. As regards depression, the pattern of change is equivalent but the scores are not significantly lower. It is possible, with a slightly larger sample, that the decline in depression would be significant as well. The improvement in emotional symptoms after periods of cognitive treatment has already been described by other authors.^47,48

Since there were already differences in quality of life between the two groups before the intervention (the CG had a higher baseline MSQoL in both physical and mental domains and lower depressive scores, this might reflect a better neuropsychiatric/quality of life status in this group). Thus, the more likely explanation for these differences is an effect of regression to the mean, and therefore, improving this could not be associated with the treatment carried out.

This study indicates the usefulness of combining computer-aided training and self-training at home for treating memory deficits present in patients with MS, and the improvement found has encouraged us to continue studying strategies to counteract cognitive damage arising from MS and to develop studies with a longer follow-up period to verify the persistence of the positive effect.

The main limitation of this study is the absence of a placebo group. The CG did not have any comparable interaction with the caregiver; they were contacted once a week, but did not have the 12 sessions of physician contact compared to the real-TG. The “medical care itself” (seeing the physician, filling in the questionnaires, hospital setting, follow-ups) can contribute to the patients’ well-being and might have contributed to the positive results seen in the real TG.

Conclusion

Cognitive intervention with a computer-assisted training supported by home training between face sessions is a useful tool to treat patients with MS and improve functions such as verbal memory, working memory and phonetic fluency through learning and subsequent consolidation of strategies and techniques of organization of the information.