Abstract
Cognitive training offers the potential for individualised learning, prevention of cognitive decline, and rehabilitation. However, key research challenges include ecological validity (training design), transfer of learning and long-term effects. Given that cognitive training and neuromodulation affect neuroplasticity, their combination could promote greater, synergistic effects. We investigated whether combining transcranial direct current stimulation (tDCS) with cognitive training could further enhance cognitive performance compared to training alone, and promote transfer within a short period of time. Healthy adults received real or sham tDCS over their dorsolateral prefrontal cortices during two 30-minute mathematics training sessions involving body movements. To examine the role of training, an active control group received tDCS during a non-mathematical task. Those who received real tDCS performed significantly better in the game than the sham group, and showed transfer effects to working memory, a related but non-numerical cognitive domain. This transfer effect was absent in active and sham control groups. Furthermore, training gains were more pronounced amongst those with lower baseline cognitive abilities, suggesting the potential for reducing cognitive inequalities. All effects associated with real tDCS remained 2 months post-training. Our study demonstrates the potential benefit of this approach for long-term enhancement of human learning and cognition.
Cognitive training offers the potential for individualised learning, prevention of cognitive decline, and rehabilitation1. Key aspects that could maximize its potential application beyond the lab include its ecological validity (training design), transfer, and long-term effects. Given that current evidence is mixed, there is an ongoing debate about the transfer and longevity of learning gains from training1,2. Typical studies involve weeks of repeated training on simple tasks, resulting in restricted ecological validity, i.e., reduced likeliness of repeated training on the same simple task (e.g., non-adaptive, without feedback) as an approach to learning in real-life. Meanwhile, non-invasive brain stimulation (NIBS) has been shown to improve training performance within 5–6 days3,4, with transfer effects to domains similar to those engaged during training. However, there have been mixed findings on its long-term effects. For example, while some found long-term effects for both trained and non-trained domains4, others observed long-term effects only for trained3. Given that both cognitive training and neuromodulation could affect neuroplasticity, we hypothesized that their combination would promote greater transfer and long-term effects.
In addition, individual differences have been shown to modulate the effects of cognitive training and NIBS. Although one aim of learning is to reduce cognitive inequalities, cognitive training alone might benefit those with higher cognitive abilities5,6. Promisingly, NIBS tends to mostly benefit those with lower baseline abilities7,8,9, although further research is needed to examine the influence of ceiling effects8,9 and possible impairment amongst those with higher baseline abilities7. However, current studies have adopted the extreme groups approach whereby participants were classified into groups (e.g., high vs. low) based on a specific cognitive ability, which could affect the reliability and generalisability of the results10 (but see11). Currently, it is unclear how the parametric effect of individual differences would affect the outcome of a combined approach of cognitive training and NIBS.
In the current study, we combined transcranial direct current stimulation (tDCS), a form of NIBS, and cognitive training (a mathematical video game) to investigate whether their synergistic effects on transfer and long-term change would be greater than training alone. Given our training context and the link between mathematics and working memory12, we expected to see transfer effects to this domain. We also examined whether cognitive benefit from this combined approach is influenced by individual baseline cognitive performance. We explored the effects of an hour of combined tDCS and cognitive training, as a previous study showed structural changes after 2 hours of training13. We wondered if a shorter training compared to previous studies3,4 would still show long-lasting effects.
Twenty healthy adults were randomised to receive either 1 mA real or sham tDCS over their bilateral dlPFCs (left: cathodal; right: anodal) during 2 days of 30-minute cognitive training (Fig. 1). Participants trained on an adaptive game featuring fractions and number line estimation, real-life mathematical concepts that are strong predictors of mathematical achievement14,15. Participants mapped fractions on a virtual number line by moving their body from side-to-side (Fig. 1). Such integration of embodiment within numerical training has been associated with more pronounced training benefits16. Moreover, compared to previous studies, the relatively more engaging design (i.e., immediate feedback, adaptive to player performance, training on a more complex task featuring fractions) could increase the attractiveness and likelihood of real-world adoption for learning.
Participants’ performance on the video game was measured by their response times (RT) and accuracy. Note that the duration of our game per day was 30 minutes to coincide with the length of stimulation (30 minutes).
To assess the training effects of our video game independent of tDCS, an active control group was further recruited; they received identical tDCS to the real group while performing non-mathematical visuospatial tasks. To assess long-term effects, a follow-up session was conducted 2 months later, where participants performed their previously assigned tasks (mathematics video game or visuospatial tasks) without tDCS. To examine training effects, transfer effects (working memory) and longevity of all effects, we assessed participants before, immediately after, and 2 months after training.
We examined whether: 1) the real tDCS group would perform better in the video game than the sham tDCS group, with long-lasting improvements; 2) there would be a transfer effect to working memory only in the real tDCS group who trained on the mathematical game; and 3) the effect(s) of tDCS would differ depending on baseline mathematical achievement.
Methods
Participants
Thirty healthy right-handed participants (20 females, mean = 24.2 ± SD = 2.1 years) with no history of neurological or psychiatric disorders gave their informed consent to participate in this study. They were assigned to three groups: 1) real tDCS during mathematics video game training (n = 10, 4 males; mean age = 24.6 ± SD = 3.8 years); 2) sham tDCS during mathematics video game training (n = 10, 2 males; mean age = 23.9 ± SD = 2.5 years); and 3) active control group that received real tDCS during non-mathematical visuospatial tasks (n = 10, 4 males; mean age = 24.1 ± SD = 2.0 years). The groups did not differ in terms of gender χ2(2) = 1.2, p = 0.55. Participants were matched across groups on their performance on a standardized mathematics test (Wechsler Individual Achievement Test, Second UK Edition, WIAT-II UK). Unfortunately, we did not assess participants’ previous experience of video gaming at the individual level to examine if this might have incidentally led to a difference between the groups. This study was given ethical approval by the Berkshire Research Committee and the methods were carried out in accordance with approved guidelines.
Video game
Based on our previous research that showed more effective training outcomes for training that involves body movements16, we designed an adaptive video game that requires participants to indicate the position of fractions on a visually presented number line by moving their body side-to-side. Participants’ movements were captured by a motion-detecting device, KINECTTM (Fig. 1c). Participants performed four practice trials before their first training session. RTs and accuracy (difference between correct and estimated positions on number line) of responses were recorded.
Analyses were performed on data up to level 3 because four participants did not perform beyond this level on the first day (2 tDCS; 2 sham). These levels were categorized based on their level of difficulty: Easy, Medium, and Hard and were selected through a pilot study prior to the current experiment (Fig. 1b) (For full stimulus list of our game, see Supplementary Table S1). Each fraction level was allocated 4 levels of ‘precision’, which specify the amount of deviation from the target allowed for a correct response. The lowest precision corresponds to ±7% allowed deviation based on the number line range, with two intermediate levels defined in steps of ±1%. We chose these specific levels of precision as pilot data indicated that they are appropriate for our targeted population; the easiest level (7%) was the least demanding but it was not too easy, while the most difficult level (4%) was challenging but not unattainable. The levels in between (5%, 6%) provided gradually more challenging trials to stretch the capacity of our participants. Taken together, the level of difficulty was defined by the fraction category and level of precision within that category. The fraction category was defined by the size of the fractions (Fig. 1b), which increase gradually from Easy to Hard and therefore require more precise mapping on the number line. The more difficult fractions do not share the lowest common multiple with the easier fractions (see Supplementary Table S1 for full stimulus list).
The precision requirement was calculated based on the deviation from the target within each category of fractions (Easy, Medium, Hard). In the easiest precision level (7%), a correct answer is accepted as long as it falls within ±7% of the target fraction. In the most demanding precision level (4%), participants were required to map within ±4% of the target to have their trial considered correct. For example, in the Easy level, the fraction 3/5 (0.6) is presented. A response that is considered correct within the 7% level would be 0.558–0.642, and 0.576–0.624 for 4% level. Each trial consisted of a presentation of a fraction challenge, a response window, and an immediate assessment of a response with feedback (Fig. 1a). Participants started the game by mapping positions of Easy fractions with the lowest precision, ±7% from target. After 3 consecutive correct answers, they were promoted to the next level requiring a higher precision of response, i.e., ±6%, followed by ±5% and ±4%. After 3 consecutive incorrect answers, participants were demoted by a category or precision level. For example, participants would be demoted to a lower precision level of 7% if they produced 3 incorrect responses at 6% precision, or to Easy fractions at precision level of 4% if they produced 3 incorrect responses at the Medium level at the precision level of 7%. This game was adaptive in order to challenge participants close to their maximal capacity. Note that to account for all levels of the game achieved by our participants, we conducted an analysis of inter-individual variability in performance based the overall levels achieved by our participants (not restricted to level 3).
Transcranial direct current stimulation
During real stimulation, 1 mA tDCS was delivered to the bilateral dlPFC (right, F4: anode, left, F3: cathode) for 30 minutes on 2 separate days (within 3 days) during mathematics video game training. The dlPFCs were chosen as stimulation sites, as these are key areas involved in learning17 including mathematical learning4,18 and are hubs for a range of domain-general, executive functions17. Therefore, we inferred that these would be ideal stimulation sites to maximise the potential of transfer effects.
We chose to apply a right-anodal, left-cathodal montage for several reasons: 1. Anodal tDCS to the left dlPFC with a reference electrode on the contralateral supraorbital region improved performance on digit span, but only in the forward order19. Instead, when repetitive transcranial magnetic stimulation (rTMS) at 1 Hz was applied over the right dlPFC to transiently disrupt its function, performance on both forward and backward digit span were impaired20 (note that in contrast to rTMS at 1 Hz, which has an interference effect, the anodal electrode in our study, which is assumed to influence cortical excitability was placed above the right dlPFC); 2. We chose to adopt a bilateral instead of unilateral tDCS montage (stimulating the contralateral dlPFC instead of using a reference electrode) because other studies have shown stronger and more specific effects of the anodal tDCS in bilateral compared to unilateral tDCS21,22,23, and a previous study showed that such montage is more effective in producing localised current flows24; and 3. We chose the current montage rather than the opposite montage (right-cathodal, left-anodal) as the latter was shown to impair learning in another training paradigm25. Stimulation was delivered via a wireless tDCS cap with two 25 cm2 circular sponge electrodes (Neuroelectrics, Barcelona). The current densities were not localised to one hemisphere (Fig. 1d).
The sham group received identical training as the tDCS group, but stimulation was only applied for 30 seconds (15 seconds ramp-up, 15 seconds ramp-down at the beginning and at the end of the training). This brief stimulation is assumed to produce negligible effects on neuronal populations beneath stimulation electrodes, but induces scalp sensations that are indistinguishable from real tDCS26,27. The active control group was stimulated with the same protocol as the real tDCS group, but during non-mathematical visuospatial tasks (from the Wechsler Abbreviated Scale of Intelligence, WASI-II test).
Active Control Training
Participants in the active control group were given 15 minutes to perform in each Block Design and Matrix Reasoning subtest of WASI-II (total duration of up to 30 minutes).
In the Block Design task, participants were asked to arrange a few blocks into 10 specified designs or items shown in the Stimulus Book. Each side of the blocks could be purely red, purely white or divided into 2 equal triangles (half red, half white). Participants were given 4 blocks for the first 5 items, and 9 blocks for the following 4 items. They had two practice trials using items 1 and 2 to ensure that they understand the task. They were then required to solve the first 5 items within 60 seconds for each item, and the following 4 items within 120 seconds for each item. They were allowed two trials for the first 2 items, and were given a score of 2 for a correct response on the first trial, a score of 1 for a correct response on the second trial, and a score of 0 for incorrect response on both trials. For the remaining items, they were scored based on the time taken to solve each trial. For items 3–9, they were given a score of 4 for correctly assembled designs within 21–60 seconds, a score of 5 within 16–20 seconds, a score of 6 within 11–15 seconds and a score of 7 within 1–10 seconds. For item 10, they were given a score of 4 for recreating the designs correctly within 66–120 seconds, a score of 5 within 46–65 seconds, a score of 6 within 31–45 seconds and a score of 7 within 1–30 seconds. For each items 11–13, they were given a score of 4 for recreating the designs correctly within 76–120 seconds, a score of 5 within 56–75 seconds, a score of 6 within 41–55 seconds and a score of 7 within 1–40 seconds. The maximum raw score is 71. In the event that the participant had completed his/her blocks in less than 15 minutes, they were required to wear the tDCS cap for the remaining duration while they prepared for the second task, Matrix Reasoning (e.g., filling in their personal details).
In the Matrix Reasoning task, participants were given 30 incomplete matrices or series from the Stimulus Book and were required to select the response option that completes each matrix or series. A correct response was given a score of 1, and an incorrect response was given a score of 0. The maximum raw score is 35. In the event that the participant completed the task in less than 15 minutes, they were required to wear the tDCS cap for the remaining duration.
Please note that, in line with the WASI-II administration guidelines, the active control group did not receive any feedback on their performance and participants’ training was characterized by repeating the task on the next day. The two tasks were not presented in alternated order across or within participants over the three testing days. Overall, each participant completed 10 Blocks Design items and 30 Matrix Reasoning items on each day.
Cognitive assessments
Cognitive assessments were conducted before, immediately after, and 2 months after training in order to assess the generalizability of training (transfer) and longevity of effects. Participants were tested on their mathematical achievement and working memory capacity (verbal and visuospatial). Mathematical achievement was tested using the Wechsler Individual Achievement Test 2nd UK Edition (WIAT-II, UK). This included tests on numerical operations and mathematical reasoning. The composite scores were used to control for any differences in mathematical achievement during group allocation and to assess the effect of individual differences on training outcomes for real and sham tDCS. Verbal and visuospatial working memory capacities were assessed using Digit Span and Corsi blocks respectively (both forward and backward for each test).
Statistical Analyses
Response times and accuracy (absolute deviation of answer from target) up to level 3 and within ±3 standard deviations (SD) of the mean were analysed by 4-way mixed analyses of variance (ANOVAs). Time (day 1, day 2) x category (Easy, Medium, Hard fraction problems) x precision (±7%, ±6%, ±5%, ±4% from the exact answer based on the number line range) were the within-subject factors, and group (tDCS, sham) was the between-subject factor. Two months later, data were analysed using a 3-way ANCOVA with category, precision and group. We included day 1 RTs as a covariate to control for baseline performance as it correlated with performance 2 months later (n = 20, Pearson r = 0.72, p < 0.01; Spearman r = 0.84, p < 0.01). Note that on Day 1, one participant from the tDCS group did not perform up to Level 3, and was therefore excluded from the RT and accuracy analyses and data provided in Table 1.
Table 1. Game RT and accuracy with improvements within- and between groups.
RT (Raw values) | |||
---|---|---|---|
Day 1 | Day 2 | 2 months later | |
tDCS | 11.81 (4.27) | 10.79 (3.43) | 9.63 (2.91) |
Sham | 12.99 (3.45) | 11.82 (4.85) | 12.07 (4.02) |
Improvement within groups (%) | |||
Time | Day 2 vs. Day 1 | 2 months later vs. Day 2 | 2 months later vs. Day 1 |
tDCS | 8.6 | 10.8 | 18.5 |
sham | 9 | −2.1 | 7 |
Difference between groups (tDCS-sham, %) | |||
Time | Day 1 | Day 2 | 2 months later |
1.7 | 8.7 | 20.3 | |
Accuracy (Raw Values) | |||
Day 1 | Day 2 | 2 months later | |
tDCS | 0.0327 (0.0071) | 0.0287 (0.0072) | 0.0271 (0.0081) |
Sham | 0.0343 (0.0093) | 0.0287 (0.0054) | 0.03000 (0.0059) |
Improvement within groups (%) | |||
Time | Day 2 vs. Day 1 | 2 months later vs. Day 2 | 2 months later vs. Day 1 |
tDCS | 12.2 | 5.6 | 17.1 |
sham | 16.3 | 4.5 | 12.5 |
Difference between groups (tDCS-sham, %) | |||
Time | Day 1 | Day 2 | 2 months later |
0.5 | 0 | 0.1 |
Improvements within and between groups (tDCS vs. sham) are shown as % changes. Data are depicted as mean ± SD.
Overall performance on the game was taken into account when we analysed the relationship between the overall levels (sum of all precision levels in all categories achieved) and participants’ baseline mathematics abilities using both Pearson and Spearman correlation analyses. Note that one participant was excluded for being an outlier (>6 SD from the mean) and when we assessed the gain from the training at the end of the game, performance on day 1 was controlled for as baseline performance, as it was correlated with performance on day 2. We controlled for day 1 instead of subtracting it as it is recommended as the best method suited to our design28,29.
Results
We began this experiment with 2 groups, tDCS and sham. To further assess the role of our video game, we conducted an additional experiment (active control group). We report the results from this control experiment at the end of the results section, as participants were not randomly assigned to this group unlike the real and sham tDCS groups. Participants’ game performance was expressed as response time (RT) and accuracy. Working memory was assessed using Digit Span and Corsi Blocks.
Short-term effects
Response times
ANOVA revealed that the more difficult the fractions participants had to map, the longer the RT [F(2,34) = 32.23, p < 0.001, η2p = 0.66]. There was an interaction between time, precision of fractions mapping, and group [F(3,51) = 4.02, p < 0.03, η2p = 0.45]. Further analysis revealed that this interaction was due to a significant simple interaction between precision and group on the first day of training [F(3, 51) = 5.23, p = 0.003, η2p = 0.24]. Post-hoc independent t-tests showed that the precision of the game affected the RT of the sham group on the first day; there was a higher RT in the most difficult precision (4%) compared to other precision levels (5%, 6%, 7%; all p < 0.04). In contrast, precision requirements did not affect RT in the real tDCS group [F(3,27) = 1.66, p = 0.2, η2p = 0.16; difference in the mean RT between the two groups: p > 0.2]. The fact that those in the sham group took longer to map fractions within 4% deviation from targets suggests that participants found it difficult to map at this level of precision on day 1. Note that on average, participants first attempted 4% precision (in this case, at Level 1) after 9.8 minutes (SD = 3.3) and performance at precision 4% was averaged across the levels of training (up to Level 3). Therefore, the effect for the most difficult condition occurred at a time point where tDCS is expected to affect neural functions26,30 and cognitive performance31. TDCS did not affect RTs on day 2 (p > 0.4) (See Fig. 2).
Accuracy
The main effect of time indicated more accurate performance on day 2 [F(1,17) = 12.54, p < 0.003, η2p = 0.43]. This was dependent on the precision required [time x precision interaction: F(3,51) = 5.48, p < 0.002, η2p = 0.24]. Notably, there was an interaction between precision and group [F(3,51) = 3.77, p < 0.02, η2p = 0.18]. While there were no significant differences between tDCS and sham for each precision level (p > 0.19), the simple main effect of precision for the sham group was significant [F(1,9) = 17, p = 0.003, η2p = 0.65]. Linear trend analysis revealed that 70% of the variance in this interaction was attributed to decreased deviation from the correct location in the sham group with increasing precision demands (linear trend analysis: p < 0.001) (Supplementary Figure S1). In contrast, precision demands had no effect on the accuracy of the tDCS group [F(1,8) = 0.001, p > 0.98, η2p = 0.001, linear trend analysis: p > 0.58] (See Supplementary Figure 1). Noticeably, the tDCS group showed a trend toward shorter RTs at the most demanding precision level (4%), but with lower accuracy. Further analysis indicated that this was not due to a speed-accuracy trade-off (r = 0.02, p > 0.91).
Number of trials
Participants attempted the following number of trials on Day 1: 102 (SD = 26), Day 2: 101 (SD = 28) and 2 months later: 104 (SD = 23). A 4-way ANOVA with day (1,2) x level (3) x precision (4) x condition (real, sham) was conducted on the number of trials up to level 3, as 4 participants did not perform beyond level 3. All interactions with condition were not significant, all p > 0.8. The main effect of day and precision was significant [F(1,17) = 6.49, p = 0.021, n2p = 0.28 and F(3,51) = 13, p < 001, n2p = 0.43 respectively].
The influence of individual differences
As predicted, individual baseline ability modulated the effects of training (Fig. 3a). In the sham group, those with higher mathematics achievement achieved more levels during training (r = 0.77, p < 0.01). This is consistent with the typical observation that ‘those who start ahead, stay ahead’5, or the so-called “Matthew effect”32, and with previous studies investigating cognitive training6,16,33. Notably, the tDCS group showed an opposite pattern; those with lower baseline mathematics achievement progressed through more levels during training (r = −0.76, p < 0.01). These correlations differed between groups (Steiger’s Z-test, Z = 3.62, p = 0.002)34. Similar results were achieved with Spearman correlations [sham: r = 0.57, p < 0.08; tDCS: r = −0.72, p < 0.02] (Fig. 3b). These observations cannot be explained by ‘ceiling effects’ as both sham and tDCS groups achieved on average similar levels at the end of training (p > 0.32). An explanation based on regression to the mean is also unsatisfactory, as it cannot explain the differences in the slopes between both groups35.
Working memory
Working memory (WM) performance pre- and post-training were analysed by a 4-way ANOVA with task (verbal WM, visuospatial WM) x order of retrieval (forward, backward) x time (pre-training, post-training) as within-subject factors, with group (tDCS, sham) as a between-subject factor.
There was an interaction between the type of working memory (WM) task (verbal, visuospatial), time, and group [F(1,18) = 22.4, p < 0.0001, η2p = 0.56]. Note that order of retrieval (forward vs. backward) did not contribute to this 3-way interaction (p > 0.38). Therefore, it is suggested that, in these cases, the analysis should not decompose the interaction into backward and forward to avoid type I error. Nevertheless, for visual illustration, we present the interaction of time x group for verbal WM separately for backward and forward spans in Supplementary Figure S2, which shows a similar pattern.
The 3-way interaction between task, time and group was decomposed for verbal and visuospatial WM.
Verbal WM
There was an interaction between time and group [F(1,18) = 10.62, p < 0.004, η2p = 0.37] (Fig. 4a). TDCS and sham groups did not differ in capacity at pre-test [t(18) = 0.37, p > 0.72], but at post-test, the tDCS group showed an improved verbal WM capacity compared to the sham group [t(18) = 3.46, p > 0.002, Cohen’s d = 0.63]. Post-hoc analyses revealed that only the tDCS group improved in verbal WM capacity [tDCS: t(9) = 3.09, p < 0.01, Cohen’s d = 0.72], while sham group performance did not change (note that the decline observed in the sham group was not significant: t(9) = 0.8, p > 0.44).
Visuospatial WM
The simple main effects, as well as the interaction between time and group were not significant [F < 2.42, p > 0.14] (Fig. 4c).
Long-term effects (2 months post-training)
Response times
At follow-up, the tDCS group was 2.4 seconds (20%) faster than the sham group in the game [group: F(1,17) = 4.84, p < 0.04, η2p = 0.22] (Table 1). This was based on a 3-way Analysis of Covariance (ANCOVA) with level, precision and group on RT two months post-training.
There was a significant linear trend in the RT observed across time (day 1, day 2, 2 months later), [F(1,18) = 10.29, p < 0.005, n2p = 0.36], although the interaction with group showed only a trend, [F(1,18) = 3.12, p < 0.094 n2p = 0.15]. Further analyses on separate groups indicated that there was a significant linear trend in the tDCS group, [F(1,9) = 8.74, p < 0.032, n2p = 0.49, corrected for multiple comparisons, due to the non-significant interaction] but not in the sham group [F(1,18) = 1.78, p > 0.43 n2p = 0.17].
Accuracy
A significant interaction between precision and group [F(3,48) = 6.28, p < 0.001, η2p = 0.28, controlling for accuracy on day 1 was due to more precise mapping fractions in the tDCS group compared to the sham group in the easiest precision level [t(18) = 2.71, p < 0.01, Cohen’s d = 0.54] (For accuracy values, see Table 1).
Number of trials
When the follow-up data was included, the interaction between precision and condition was significant, F(3,51) = 17.21, p = 0.035, n2p = 0.15. However, when decomposed, we did not find any significant differences between the groups at any precision level, all p > 0.15.
Working memory
The tDCS group showed a sustained effect in verbal WM capacity after two months [t(18) = 3.45, p < 0.002, Cohen’s d = 0.63] (Fig. 4b), but no effect in visuospatial WM capacity [t(18) = 0.13, p = 0.89] (Fig. 4d). Results replicated those immediately after training, indicating that the type of WM enhancement depended on the group [F(1,18) = 6.13, p < 0.02, η2p = 0.44] (For WM scores, see Supplementary Table S2).
The role of training in tDCS effect
In order to assess whether the coupling of tDCS and the mathematical game was critical to these effects on working memory and not a result of stimulating the dlPFC per se, we conducted a separate experiment. We recruited an active control group (n = 10; matched across age and baseline mathematics achievement) who trained on Matrix Reasoning and Block Design (See Methods) while receiving real tDCS. Both Matrix Reasoning and Blocks Design tasks engage visuospatial skills but non-mathematical skills. However, due to the nature of these two tasks, their difficulty levels cannot be directly and accurately compared. We measured performance on both tasks using raw and scale scores (Supplementary Table S3). Performance was timed and the overall time taken was about 30 minutes. These tasks served as ”placebo training” (not the main training, but included visuospatial processing similar to our game). This allowed us to 1) assess the specific training effects of our mathematical video game, and 2) control to some extent, the cognitive processes engaged during the stimulation period36,37. Note that the primary role of the active control group was to enable the comparison of verbal and visuospatial WM changes with those observed in the real and sham tDCS groups. The active control group did not receive any training on the maths video game and therefore, we did not have any accuracy or RTs for this group (for further analyses, see Supplementary Results). When we added the results from this group to the ANOVA: time (day1, day 2) x group (real tDCS, sham tDCS, active control), the reported interaction between the types of WM task, time and group remained significant [F(1,28) = 15.41, p = 0.012, n2p = 0.21] (Fig. 4). We therefore decompose the interaction to the different WM tasks.
Verbal WM
The interaction between time and group was significant [F(2, 28) = 7.89, p = 0.009, n2p = 0.22]. The tDCS and control groups (both sham and the active control groups) differed in verbal WM at post-testing [t(28) = 3.07, p = 0.005]. Only the tDCS group showed improved WM capacity at post-testing [tDCS: t(9) = −3.1, p < 0.01; control groups: t(19) = 1.02, p = 0.32].
Visuospatial WM
There was no interaction between time and group (p > 0.59, n2p = 0.01).
Discussion
In the current study, we examined whether 60 minutes of combined brain stimulation and mathematical video gaming could 1) improve training performance with long-term effects; 2) induce transfer to working memory and 3) modulate training outcomes based on initial mathematical abilities. The key findings and their implications are reviewed below.
As predicted, brain stimulation further improved training performance, with immediate and long-term gains. This improved performance is especially apparent between the two groups with increasing difficulty levels; the sham group showed an expected decline in performance, while those who received tDCS did not. This supports the finding that tDCS is more effective when participants are engaged in a difficult task38. Only after two days of 30-minute training, those who received tDCS were on average 9% quicker in mapping fractions, and continued to improve by another 11% when tested 2 months later without further practice and use of tDCS (linear trend analysis: tDCS, p < 0.02; sham, p > 0.2, see also Results and Table 1). This delayed benefit post-anodal tDCS expands on that reported by Floel and colleagues who found behavioural improvements in memory only after 1 week post-training39. The further improvement in performance by 8% at follow up is also consistent with the findings of Reis and colleagues who showed that anodal tDCS during training induced positive offline gains compared to sham40. Such gains were thought to be due to enhanced protein synthesis following anodal tDCS during training, or the result of interaction between the excitability effects during and after training, and downstream of learning- related protein synthesis40. Indeed, when assessed 2 months later without any brain stimulation, the tDCS group showed about 18% faster responses than their initial performance, while the sham tDCS group showed only 7% improvement (Table 1). Together, these findings suggest that 2 days of 30-minute training with 1 mA tDCS could have long-lasting impact on neuroplasticity. Further studies could collect physiological data to investigate the exact mechanisms of the effects observed in this study.
On the subject of transfer, we found improvements in working memory capacity, a domain not directly trained. Participants in the tDCS group retained at least one item more than those in the control groups immediately after training, and retained this benefit over a period of 2 months without further training and tDCS. This is a novel finding with potential practical implications, given the brevity of training and its transfer impact at the capacity level. Studies that have shown similar improvements took up to 100 hours of training41. It is important to point out that this transfer effect is exclusive to the combination of tDCS and our mathematical video game training. No transfer effect was found in the active control group that trained on visuospatial tasks or the sham tDCS group (see Supplementary Results for further analyses). Therefore, our results suggest that the mechanisms behind these observations are not due to tDCS per se, but an outcome of the synergy between tDCS and our training game. Notably, the transfer effect to verbal working memory suggests the predominant use of verbal components as a strategy during our game. Indeed, participants had to retain symbolic fractions in mind in order to map them as precisely as possible on the number line. Moreover, fractions problem solving and mathematical computation are linked to verbal working memory42,43. Another possible explanation is that, as digit span forward and backward engage an overlapping functional neural system linked with working memory, specifically the right dlPFC44, anodal tDCS over the right dlPFC during our video game might have reinforced synaptic efficiency between dlPFC and overlapping networks, as suggested in previous brain stimulation and neuroimaging work40,45,46. Further studies could investigate whether this effect is due to enhanced protein synthesis during training, which has been proposed to trigger downstream interactions of learning-related protein in motor learning46. As for the lack of improvement of the active control group, it is difficult to explain why a null result was obtained. The inclusion of an active control group in our study was to assess whether the effect we observed on working memory was due to tDCS per se, and therefore it included similar cognitive processing, without numerical information. The null results could be attributed to the specific nature of training, stimulation of this montage, or other factors. However, the lack of WM improvement in the active control group does not impact on the potential connection between working memory and fluid intelligence47, which is beyond the scope of the current study’s aims and design.
Finally, as predicted, cognitive gains from training and brain stimulation were influenced by individual baseline mathematical achievement. There was an opposite pattern in the correlation between game performance and baseline achievement between the sham and tDCS groups. In the sham group, those with higher baseline achievement progressed through more levels in the game. This pattern mirrors performance in a typical classroom5,32 and findings of previous cognitive training studies6. On the contrary, those with lower baseline achievement achieved more levels in the game in the tDCS group. These findings corroborate and build on previous findings that tDCS efficacy is influenced by baseline performance in a categorical fashion (low vs. high mathematics anxiety7; low vs. high visual short-term memory8; trained vs. untrained musicians9). The observed relationship is in line with the prediction that greater cognitive gains for those with lower baseline abilities will be achieved via modulation of cortical excitation and inhibition using methods like tDCS48. One possible explanation is that the effects of tDCS are more salient for difficult trials since that performance on easy trials are likely to be close to optimal response, and tDCS is less likely to produce further, significant behavioural improvements49. It might be that, compared to participants with higher achievement, those with lower achievement were more likely to have found our task more difficult, and hence benefited more from tDCS. The lack of effects among individuals with higher achievement might also be capped by individual limits of cortical excitability7,8 (see also48 for a brief review). Given that the physiological effects of tDCS on human cognition are likely to be complex, further research using multi-modal approaches (e.g., neuroimaging and computational simulations) is needed to understand the mechanisms underlying these observations49.
Taken together, these findings present two new contributions to current literature. Firstly, when assessing the efficacy of NIBS, inter-subject variation in baseline cognitive achievement should be taken into account. This might be especially relevant for stimulation over areas that are more strongly modulated by genetic factors such as the dlPFC50,51. By modelling the interactions between NIBS and individual brain characteristics, we could refine our understanding of the mechanisms of NIBS. Secondly, by finding that tDCS could reduce rather than increase existing disparities in performance, our study addresses concerns about the potential risk of NIBS for increasing cognitive inequality in healthy individuals52,53. Further research should determine how individual differences and tDCS would interact in other cognitive domains and populations.
One limitation of the current study is its relatively modest sample size. This sample size is comparable however, to other cognitive studies using tDCS54. In spite of this, we had sufficient power to detect group differences and interactions55, and the effect sizes that we found are similar to that reported in the literature on the use of tDCS in cognitive studies56. The current findings could motivate future studies to test larger samples and examine the underlying changes at the neural level. Another open question is whether the improvement we observed on the game was due to arithmetic or visuospatial accuracy. Due to the nature of our task, it is difficult to disentangle these two cognitive components, which are interlinked and involved in numerical mapping. Another control task that could tease apart the contribution of each component is needed.
In sum, we show that short- and long-term enhancement of human cognitive functions is achievable within the timescale of an hour. Conceptually, we demonstrated that by combining brain stimulation and training with good ecological validity, we could achieve synergistic effects that are greater than those achieved separately. In practical terms, these findings highlight the possibility of achieving long-term cognitive enhancement with reduced time investment using combined non-pharmacological methods. Identifying inter-individual variations in response to such interventions could contribute towards understanding the mechanisms underlying such interactions, efficacy of such methods on different individuals, and eventually, the design of individualised stimulation. Overall, this study offers new directions for research on the mechanisms of neuroplasticity, learning, and the influence of individual differences on cognitive enhancement.
Additional Information
How to cite this article: Looi, C. Y. et al. Combining brain stimulation and video game to promote long-term transfer of learning and cognitive enhancement. Sci. Rep. 6, 22003; doi: 10.1038/srep22003 (2016).
Supplementary Material
Acknowledgments
This work was supported by the Wellcome Trust (WT88378) and the James S. McDonnell Foundation 21st Century Science Initiative in Understanding Human Cognition – Scholar Award. We thank Michael Clayton for his comments and Giulio Ruffini from Neuroelectrics for the computational simulation of current field intensity map presented in Figure 1d.
Footnotes
Prof. Cohen Kadosh serves on the scientific advisory boards of Neuroelectrics Inc and The Cognition Matters Foundation (non-profit organisation). His research on brain stimulation was funded by the Wellcome Trust, the British Academy/Leverhulme Trust Small Research Grant, and the James S. McDonnell Foundation. He filed a patent entitled “Apparatus for improving and/or maintaining numerical ability’ (International Application PCT/GB2011/050211), but as the patent was not granted this is unlikely to serve as a conflict of interest. The other authors declare no conflict of interest.
Author Contributions C.Y.L., M.D., S.F., H.-C.N. and R.C.K. were involved in designing the experiment; C.Y.L. ran the experiment, C.Y.L. and R.C.K. analysed the data; C.Y.L. and R.C.K. wrote the manuscript; M.D., S.F., H.-C.N. and A.-K.B. commented on the manuscript.
References
- Au J. et al. Improving fluid intelligence with training on working memory: a meta-analysis. Psychonom Bull Rev 22, 366–377, doi: 10.3758/s13423-014-0699-x (2014). [DOI] [PubMed] [Google Scholar]
- Jaeggi S. M., Buschkuehl M., Shah P. & Jonides J. The role of individual differences in cognitive training and transfer. Mem & cogn 42, 464–480, doi: 10.3758/s13421-013-0364-z (2014). [DOI] [PubMed] [Google Scholar]
- Cappelletti M. et al. Transfer of cognitive training across magnitude dimensions achieved with concurrent brain stimulation of the parietal lobe. J Neurosci 33, 14899–14907, doi: 10.1523/JNEUROSCI.1692-13.2013 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Snowball A. et al. Long-Term Enhancement of Brain Function and Cognition Using Cognitive Training and Brain Stimulation. Curr Biol 23, 987–992, doi: 10.1016/j.cub.2013.04.045 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Duncan G. J. et al. School readiness and later achievement. Dev Psychol 43, 1428, doi: 10.1037/0012-1649.43.6.1428 (2007). [DOI] [PubMed] [Google Scholar]
- Lövdén M., Brehmer Y., Li S. C. & Lindenberger U. Training-induced compensation versus magnification of individual differences in memory performance. Front human neurosci 6, 141, doi: 10.3389/fnhum.2012.00141 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sarkar A., Dowker A. & Cohen Kadosh R. Cognitive Enhancement or Cognitive Cost: Trait-specific Outcomes of Brain Stimulation in the Case of Mathematics Anxiety. J Neurosci 34, 16605–16610, doi: 10.1523/JNEUROSCI.3129-14.2014 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tseng P. et al. Unleashing potential: transcranial direct current stimulation over the right posterior parietal cortex improves change detection in low-performing individuals. J Neurosci 32, 10554–10561, doi: 10.1523/JNEUROSCI.0362-12.2012 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Furuya S., Klaus M., Nitsche M. A., Paulus W. & Altenmüller E. Ceiling Effects Prevent Further Improvement of Transcranial Stimulation in Skilled Musicians. J. Neurosci 34, 13834–13839, doi: 10.1523/JNEUROSCI.1170-14.2014 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Preacher K. J., Rucker D. D., MacCallum R. C. & Nicewander W. A. Use of the extreme groups approach: A critical reexamination and new recommendations. Psychological Methods 10, 178–192, doi: 10.1037/1082-989X.10.2.178 (2005). [DOI] [PubMed] [Google Scholar]
- Santarnecchi E. et al. Individual differences and specificity of prefrontal gamma frequency-tACS on fluid intelligence capabilities. Cortex 75, 33–43 (2016). [DOI] [PubMed] [Google Scholar]
- Ginsburg V., van Dijck J. P., Previtali P., Fias W. & Gevers W. The impact of verbal working memory on number–space associations. Journal of Experimental Psychology: Learning, Memory and Cognition 40, 976, doi: 10.1037/a0036378 (2014). [DOI] [PubMed] [Google Scholar]
- Sagi Y. et al. Learning in the fast lane: new insights into neuroplasticity. Neuron 73, 1195–1203, doi: 10.1016/j.neuron.2012.01.025 (2012). [DOI] [PubMed] [Google Scholar]
- Bailey D. H., Hoard M. K., Nugent L. & Geary D. C. Competence with fractions predicts gains in mathematics achievement. J Exp Child Psychol 113, 447–455, doi: 10.1016/j.jecp.2012.06.004 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Siegler R. S. & Booth J. L. Development of numerical estimation in young children. Child Dev 75, 428–444, doi: 10.1111/j.1467-8624.2004.00684.x (2004). [DOI] [PubMed] [Google Scholar]
- Link T., Moeller K., Huber S., Fischer U. & Nuerk H. C. Walk the number line–An embodied training of numerical concepts. Trends in Neurosci and Edu 2, 74–84, doi: 10.1016/j.tine.2013.06.005 (2013). [DOI] [Google Scholar]
- Chein J. M. & Schneider W. The Brain’s Learning and Control Architecture. Current Directions in Psychological Science 78–84, doi: 10.1177/0963721411434977 (2012). [DOI] [Google Scholar]
- Zamarian L., Ischebeck A. & Delazer M. Neuroscience of learning arithmetic—Evidence from brain imaging studies. Neurosci Biobehav Rev 33, 909–925, doi: 10.1016/j.neubiorev.2009.03.005 (2009). [DOI] [PubMed] [Google Scholar]
- Andrews S. C., Hoy K. E., Enticott P. G., Daskalakis Z. J. & Fitzgerald P. B. Improving working memory: the effect of combining cognitive activity and anodal transcranial direct current stimulation to the left dorsolateral prefrontal cortex. Brain stimulation 4, 84–89, doi: 10.1016/j.brs.2010.06.004 (2011). [DOI] [PubMed] [Google Scholar]
- Aleman A. & van’t Wout M. Repetitive transcranial magnetic stimulation over the right dorsolateral prefrontal cortex disrupts digit span task performance. Neuropsychobiology 57, 44–44, doi: 10.1159/000129666 (2007). [DOI] [PubMed] [Google Scholar]
- Sehm B., Kipping J., Schäfer A., Villringer A. & Ragert P. A comparison between uni-and bilateral tDCS effects on functional connectivity of the human motor cortex. Frontiers in human neuroscience 7, 1–7, doi: 10.3389/fnhum.2013.00183 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vines B. W., Cerruti C. & Schlaug G. Dual-hemisphere tDCS facilitates greater improvements for healthy subjects’ non-dominant hand compared to uni-hemisphere stimulation. BMC neuroscience 9, 1–7, doi: 10.1186/1471-2202-9-103 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mordillo-Mateos L. et al. Effects of simultaneous bilateral tDCS of the human motor cortex. Brain stimulation 5, 214–222, doi: 10.1016/j.brs.2011.05.001 (2012). [DOI] [PubMed] [Google Scholar]
- Nathan S. S., Sinha S. R., Gordon B., Lesser R. P. & Thakor N. V. Determination of current density distributions generated by electrical stimulation of the human cerebral cortex. Electroencephalography and clinical neurophysiology 86, 183–192, doi: 10.1016/0013-4694(93)90006-H (1993). [DOI] [PubMed] [Google Scholar]
- Iuculano T. & Cohen Kadosh R. The mental cost of cognitive enhancement. J Neurosci 33, 4482–4486, doi: 10.1523/jneurosci.4927-12.2013 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fritsch B., Reis J., Martinowich K., Schambra H. M., Ji Y. & Cohen L. G. Direct current stimulation promotes BDNF-dependent synaptic plasticity: potential implications for motor learning. Neuron 66, 198–204, doi: 10.1016/j.neuron.2010.03.035 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gandiga P. C., Hummel F. C. & Cohen L. G. Transcranial DC stimulation (tDCS): a tool for double-blind sham-controlled clinical studies in brain stimulation. Clin Neurophysiol, 845–850, doi: 10.1016/j.clinph.2005.12.003 (2006). [DOI] [PubMed] [Google Scholar]
- Van Breukelen G. J. ANCOVA versus change from baseline had more power in randomized studies and more bias in nonrandomized studies. Journal of clinical epidemiology 59, 920–925, doi: 10.1016/j.jclinepi.2006.02.007 (2006). [DOI] [PubMed] [Google Scholar]
- Edwards J. R. Ten Difference Score Myths. Organizational Research Methods 4, 265–287, doi: 10.1177/109442810143005 (2001). [DOI] [Google Scholar]
- Nitsche M. A. & Paulus W. Sustained excitability elevations induced by transcranial DC motor cortex stimulation in humans. Neurology 57, 1899–1901 (2001). [DOI] [PubMed] [Google Scholar]
- Nelson J. T., McKinley R. A., Golob E. J., Warm J. S. & Parasuraman R. Enhancing vigilance in operators with prefrontal cortex transcranial direct current stimulation (tDCS). Neuroimage 85, 911–919 (2014). [DOI] [PubMed] [Google Scholar]
- Stanovich K. E. Matthew effects in reading: Some consequences of individual differences in the acquisition of literacy. Reading Research Quarterly, 360–407 (1986). [Google Scholar]
- Bissig D. & Lustig C. Who benefits from memory training? Psychol Sci 18, 720–726, doi: 10.1111/j.1467-9280.2007.01966.x (2007). [DOI] [PubMed] [Google Scholar]
- Cohen J., Cohen P., West S. G. & Aiken L. S. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences. (2003).
- Barnett A. G., van der Pols J. C. & Dobson A. J. Regression to the mean: what it is and how to deal with it. Int J Epidemiol 34, 215–220, doi: 10.1093/ije/dyh299 (2005). [DOI] [PubMed] [Google Scholar]
- Jolles D. D. & Crone E. A. Training the developing brain: a neurocognitive perspective. Front. Hum. Neurosci. 6, 1–13, doi: 10.3389/fnhum.2012.00076 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gruberger M., Ben-Simon E., Levkovitz Y., Zangen A. & Hendler T. Towards a neuroscience of mind-wandering. Front hum neurosci 5, 1–11, doi: 10.3389/fnhum.2011.00056 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pope P. A. & Miall R. C. Task-specific facilitation of cognition by cathodal transcranial direct current stimulation of the cerebellum. Brain Stimulation 5, 84–94, doi: 10.1016/j.brs.2012.03.006 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Floel A. et al. Non-invasive brain stimulation improves object-location learning in the elderly. Neurobiol. Aging. 33, 1682–1689, doi: 10.1016/j.neurobiolaging.2011.05.007 (2012). [DOI] [PubMed] [Google Scholar]
- Reis J. et al. Noninvasive cortical stimulation enhances motor skill acquisition over multiple days through an effect on consolidation. Proc. Natl. Acad. Sci. USA 106, 1590–1595, doi: 10.1073/pnas.0805413106 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schmiedek F., Lövdén M. & Lindenberger U. Hundred days of cognitive training enhance broad cognitive abilities in adulthood: findings from the COGITO study. Front aging neurosci 2, doi: 10.3389/fnagi.2010.00027 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fuchs L. S. et al. Does working memory moderate the effects of fraction intervention? An aptitude–treatment interaction. J Educat Psychol 106, 499, doi: 10.1037/a0034341 (2014). [DOI] [Google Scholar]
- Wilson K. M. & Swanson H. L. Are mathematics disabilities due to a domain-general or a domain-specific working memory deficit? J Learn Disabil 34, 237–248, doi: 10.1177/002221940103400304 (2001). [DOI] [PubMed] [Google Scholar]
- Gerton B. K. et al. Shared and distinct neurophysiological components of the digits forward and backward tasks as revealed by functional neuroimaging. Neuropsychologia 42, 1781–1787, doi: 10.1016/j.neuropsychologia.2004.04.023 (2004). [DOI] [PubMed] [Google Scholar]
- Dahlin E., Neely A. S., Larsson A., Bäckman L. & Nyberg L. Transfer of learning after updating training mediated by the striatum. Science 320, 1510–1512, doi: 10.1126/science.1155466 (2008). [DOI] [PubMed] [Google Scholar]
- Reis J., Prichard G. & Fritsch B. In The Stimulated Brain (ed. Cohen Kadosh R.) Ch. 8, 207–236 (Elsevier, 2014). [Google Scholar]
- Jaeggi S. M., Buschkuehl M., Jonides J. & Perrig W. J. Improving fluid intelligence with training on working memory. PNAS 105, 6829–6833 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Krause B., Márquez-Ruiz J. & Cohen Kadosh R. The effect of transcranial direct current stimulation: a role for cortical excitation/inhibition balance? Front Hum Neurosci 7, 602, doi: 10.3389/fnhum.2013.00602 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bonaiuto J. J. & Bestmann S. Understanding the nonlinear physiological and behavioral effects of tDCS through computational neurostimulation. Progress in Brain Research, 1–29, doi: 10.1016/bs.pbr.2015.06.013 (2015). [DOI] [PubMed] [Google Scholar]
- Kanai R. & Rees G. The structural basis of inter-individual differences in human behaviour and cognition. Nat Rev Neurosci 12, 231–242, doi: 10.1038/nrn3000 (2011). [DOI] [PubMed] [Google Scholar]
- Thompson P. M. et al. Genetic influences on brain structure. Nat. Neurosci. 4, 1253–1258, doi: 10.1038/nn758 (2001). [DOI] [PubMed] [Google Scholar]
- Cohen Kadosh R., Levy N., O’Shea J., Shea N. & Savulescu J. The neuroethics of non-invasive brain stimulation. Curr. Biol. 22, R108–R111, doi: 10.1016/j.cub.2012.01.013 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Riggall K. et al. Researchers’ perspectives on scientific and ethical issues with transcranial direct current stimulation: An international survey. Scientific Reports 5, 1–10, doi: 10.1038/srep10618 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Krause B. & Cohen Kadosh R. Can transcranial electrical stimulation improve learning difficulties in atypical brain development? A future possibility for cognitive training. Dev Cog Neurosci 6, 176–194, doi: 10.1016/j.dcn.2013.04.001 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friston K. Ten ironic rules for non-statistical reviewers. NeuroImage 61, 1300–1310, doi: 10.1016/j.neuroimage.2012.04.018 (2012). [DOI] [PubMed] [Google Scholar]
- Jacobson L., Koslowsky M. & Lavidor M. tDCS polarity effects in motor and cognitive domains: a meta-analytical review. Experimental Brain Research 216, 1–10, doi: 10.1007/s00221-011-2891-9 (2012). [DOI] [PubMed] [Google Scholar]
- Feenstra L., Aleven V., Rummel N. & Taatgen N. in Intelligent Tutoring Systems Vol. 6095 (eds v. Aleven J. Kay, & Mostow J.) 221–223 (Springer 2010). [Google Scholar]
- Miranda P. C., Lomarev M. & Hallett M. Modeling the current distribution during transcranial direct current stimulation. Clin Neurophysiol 117, 1623–1629, doi: 10.1016/j.clinph.2006.04.009 (2006). [DOI] [PubMed] [Google Scholar]
- Miranda P. C., Mekonnen A., Salvador R. & Ruffini G. The electric field in the cortex during transcranial current stimulation. Neuroimage 70, 48–58, doi: 10.1016/j.neuroimage.2012.12.034 (2013). [DOI] [PubMed] [Google Scholar]
- Ruffini G., Fox M. D., Ripolles O., Miranda P. C. & Pascual-Leone A. Optimization of multifocal transcranial current stimulation for weighted cortical pattern targeting from realistic modeling of electric fields. Neuroimage 89, 216–225, doi: 10.1016/j.neuroimage.2013.12.002 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.