Abstract
Altering cortical activity using transcranial direct current stimulation (tDCS) has been shown to improve working memory (WM) performance. Due to large inter-experimental variability in the tDCS montage configuration and strength of induced electric fields, results have been mixed. Here, we present a novel meta-analytic method relating behavioral effect sizes to electric field strength to identify brain regions underlying largest tDCS-induced WM improvement. Simulations on 69 studies targeting left prefrontal cortex showed that tDCS electric field strength in lower dorsolateral prefrontal cortex (Brodmann area 45/47) relates most strongly to improved WM performance. This region explained 7.8% of variance, equaling a medium effect. A similar region was identified when correlating WM performance and electric field strength of right prefrontal tDCS studies (n = 18). Maximum electric field strength of five previously used tDCS configurations were outside of this location. We thus propose a new tDCS montage which maximizes the tDCS electric field strength in that brain region. Our findings can benefit future tDCS studies that aim to affect WM function.
Keywords: Working memory, Transcranial direct current stimulation, Electric field modeling, Prefrontal cortex, Neuromodulation
1. Introduction
Over the last two decades neuromodulation using transcranial direct current stimulation (tDCS) has been shown to alter cortical activity and consequently human behavior (Polania et al., 2018). When using tDCS, a weak electric current is applied to the scalp, resulting in a low amplitude electric field being induced in the brain non-invasively. By targeting brain regions corresponding to specific cognitive functions, tDCS has the potential to alter behavioral performance (Kuo et al., 2014). Importantly, modeling studies that have simulated the tDCS electric field distribution highlighted the influence of electrode montage and brain anatomy on the affected brain regions (Miranda et al., 2013; Opitz et al., 2015). Thus, for tDCS to alter performance, a montage needs to be used that adequately targets cortical regions underlying specific behavior.
One cognitive domain that has been studied extensively is the effect of tDCS on working memory (WM). Working memory is crucially involved in various cognitive functions, including language comprehension, decision making, learning, and reasoning (Baddeley, 1992). Also, WM deficits are observed in neuropsychiatric disorders, including major depressive disorder, schizophrenia, and obsessive-compulsive disorder (Gold et al., 2019; Heinzel et al., 2018; Marraziti et al., 2010). The effect of tDCS on WM performance has been investigated in a large number of studies. Initial meta-analyses have suggested a potential increase of WM performance after anodal tDCS over prefrontal cortex (PFC) (Brunoni & Vanderhasselt, 2014; Hill et al., 2016; Manusco et al., 2016). However, variability across studies was considerable and overall effect size was small. Consequently, different analyses where results are divided into more detailed categories may render meta-analytic findings non-significant (Horvath et al., 2015).
Inter-experimental variability stems from the choice of different tDCS parameters, such as electrode location, targeted area, current intensity, electrode material, electrode orientation, and conductive agent (Polania et al., 2018). Since the classical meta-analysis method generalizes over different features, it is not well-suited to investigate the broad variety in tDCS approaches related to altering WM performance. Moreover, since the publication of previous meta-analytic results on tDCS-related WM effects, numerous new studies have been published exploring a variety of new electrode montages to optimize the effect of tDCS (Hill et al., 2018; Hussey et al., 2015; 2020; Nikolin et al., 2019; Splittberger et al., 2020). For instance, recent years have seen a rise in the use of high-definition montages, in which a small stimulation electrode is surrounded by multiple return electrodes to produce a higher focality compared to standard two-electrode montages (Datta et al., 2009; Hill et al., 2018; Nikolin et al., 2019; Villamar et al, 2013).
With experimental variability in tDCS montages, induced electric fields vary considerably between studies (Opitz et al., 2018). This issue is further complicated when specific targeted regions differ across studies. For example, to improve WM performance, several studies opted to place the anode over F3 (according to the 10–10 system), in order to target the dorsolateral PFC (DLPFC) (e.g., Fregni et al., 2005; Hoy et al., 2013; Jongkees et al., 2019). However, other studies have used slightly different targets, such as F5 or F7 to stimulate more ventro-lateral portions of the PFC, corresponding to the inferior frontal cortex (IFC) (e.g., Di Rosa et al, 2019, Weintraub-Brevda & Chua, 2019). In addition to the variability in location, stimulation intensity strongly differs across studies. Indeed, no normative value for tDCS intensity exists and current intensities typically vary between 0.5 mA and 2 mA across studies. As such, even if differences in WM tasks and outcome measures are set aside, variability in tDCS parameters alone is likely to be a major contributing factor for heterogeneity in results.
Simulation of tDCS-induced electric fields by computational modeling helps to identify variability in targeted cortical regions of different tDCS montages. Thereby, a montage can be determined that optimally targets a region or brain network of interest (Evans et al., 2020; Soleimani et al., 2021). This is crucial since induced electric fields can be significantly affected by minor changes to electrode location (De Witte et al., 2018; Opitz et al., 2018) orientation (Foerster et al., 2019) or size (Sharma & Chowdhury, 2019). Furthermore, electric field modeling may aid in overcoming individual variability in brain morphology, by individual modeling and optimizing montage configuration per participant (Evans et al., 2020; Laakso et al., 2015; 2016). Analogously, group-level variability can be investigated by examining electric field distributions of different experiments (Soleimani et al., 2021).
To tackle inter-experimental variability and understand tDCS-induced effects on WM, we introduce a novel meta-analytic method to systematically analyze electric field distributions in relation to behavioral performance. With this method, simulated tDCS-induced electric field strength is locally associated with changes in WM performance, providing an estimate for tDCS efficacy at a particular brain region. In other words, our computational meta-analytic method exploits variability in tDCS montage and intensity to form a map of brain regions for which tDCS most strongly correlates to beneficial effects on WM. In order to perform our analysis, a classical meta-analysis was first performed to summarize effect sizes of different studies. This gave an indication if anodal tDCS over left and right PFC generally alters WM performance, regardless of montage. Second, electric field simulations of 69 experiments over left PFC and 18 over right PFC were run to map the different affected cortical areas. Subsequently, electric fields and effect sizes on WM performance were locally correlated and compared to a null-hypothesis model to map out regions that are most susceptible to tDCS-induced WM improvement. Finally, we provide an optimized tDCS montage which maximizes the electric field strength in the region that our meta-analysis identified.
2. Methods
The guidelines of the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) was used to structure the present meta-analysis (Moher et al., 2009).
2.1. Eligibility criteria and search strategy
We included studies in the present meta-analytic computational study if they adhered to the following criteria: 1) Published in a peer-reviewed journal in the English language, with full-text availability. 2) Experimental design included a randomized placebo- (sham) controlled or baseline-controlled design, 3) effect size data was reported or could be calculated from mean and standard deviation or standard error of mean (SEM), presented in the results section, figures, tables, or supplementary material. 4) Reported data was collected from healthy adult participants. 5) Effects of single session tDCS were reported. From multi-session tDCS studies, only first session results were included (Lally et al., 2013; Looi et al., 2016; Ke et al., 2019; Martin et al., 2013; Richmond et al., 2014; Wang et al., 2019).
We conducted a literature search within databases PubMed and Web of Science in a period between January 2000 and October 2020. The search terms ‘tDCS’ + ‘working memory’ and ‘transcranial direct current stimulation’ + ‘working memory’ were used and the reference sections of research and review articles were examined for additional articles. After removing duplicates, 281 articles were inspected for eligibility, finally yielding 68 selected articles (Supplementary Figure 1A). From these we extracted 69 effect sizes related to left PFC anodal tDCS and 18 effect sizes related to right PFC anodal tDCS (Table 1 and 2). In our initial search we identified 11 studies using left prefrontal cathodal tDCS and 1 study using right prefrontal cathodal tDCS. Since these sample sizes are too small for a correlation analysis, as was performed here, we focused on anodal tDCS only.
Table 1.
Study overview left PFC anodal tDCS
| Study | year | anode | Size (cm) | cathode | Size (cm) | material | mA | g | |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Fregni et al. | 2005 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | sponges | 1 | 0.438 |
| 2 | Ohn et al. | 2008 | F3 | ▯ 5×5 | Fp2 | ▯ 5×5 | Sponges | 1 | 0.573 |
| 3 | Andrews et al. | 2011 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 2 | 0.355 |
| 4 | Keeser et al. | 2011 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 1 | 0.079 |
| 5 | Mulquiney et al. | 2011 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 1 | 0.111 |
| 6 | Teo et al. | 2011 | F3 | ▯ 5×7 | f p2 | ▯ 5×7 | Sponges | 1 | 0.094 |
| 7 | 2 | 0.127 | |||||||
| 8 | Zaehle et al. | 2011 | F3 | ▯ 5×7 | Left mastoid | ▯ 5×7 | Sponges | 1 | −0.004 |
| 9 | Berryhill & Jones | 2012 | F3 | ▯ 5×7 | Right cheek | ▯ 5×7 | Sponges | 1.5 | 0.108 |
| 10 | Gladwin et al. | 2012 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 1 | 0.201 |
| 11 | Jeon & Han | 2012 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 1 | 0.098 |
| 12 | Mylius et al. | 2012 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 2 | 0.344 |
| 13 | Hoy et al. | 2013 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 1 | 0.182 |
| 14 | 2 | 0.169 | |||||||
| 15 | Lally al. | 2013 | F3 | ▯ 5×7 | Right cheek | ▯ 5×7 | Sponges | 1 | 0.271 |
| 16 | Martin et al. | 2013 | F3 | ▯ 5×7 | Right deltoid | ▯ 10×10 | Sponges | 2 | 0.188 |
| 17 | Meiron & Lavidor | 2013 | F3-AF3 | ▯ 4×4 | Cz | ▯ 5×7 | Sponges | 2 | 0.887 |
| 18 | Richmond et al. | 2014 | F3 | ▯ 5×7 | F4 | ▯ 5×7 | Sponges | 1.5 | 0.287 |
| 19 | Carvalho et al. | 2015 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 1 | 0.714 |
| 20 | Gill et al. | 2015 | F3 | ▯ 5×5 | Fp2 | ▯ 5×5 | Sponges | 2 | 0.222 |
| 21 | Hussey et al. | 2015 | F3 | Ø 1,3 | O1 | Ø 1,3 | ag/agcl + gel | 2 | 0.088 |
| 22 | Jones et al. Exp1 | 2015 | F3-F7 | ▯ 5×7 | Right cheek | ▯ 5×7 | Sponges | 1.5 | 0.240 |
| 23 | Jones et al. Exp2 | 2015 | F3-F7 | ▯ 5×7 | Right cheek | ▯ 5×7 | Sponges | 1.5 | 0.220 |
| 24 | Moreno et al. | 2015 | F3 | ▯ 5×5 | F4 | ▯ 5×5 | Sponges | 2 | 0.271 |
| 25 | Nikolin et al. | 2015 | F3 | Ø 2 | AF3, F5, F1, FC3 | Ø 2 each | ag/agcl + gel | 2 | 0.135 |
| 26 | Nilsson et al. | 2015 | F3 | ▯ 5×7 | Fp2 | ▯ 10×10 | Sponges | 1 | 0.097 |
| 27 | 2 | −0.003 | |||||||
| 28 | Pope et al. | 2015 | F3 | ▯ 5×5 | Right deltoid | ▯ 5×5 | Spo iges | 2 | 0.548 |
| 29 | Faehling & Plewnia | 2016 | F3 | ▯ 5×7 | Right deltoid | ▯ 5×7 | Rubber + paste | 0.5 | −0.325 |
| 30 | 1 | −0.079 | |||||||
| 31 | 1.5 | −0.287 | |||||||
| 32 | Trumbo et al. | 2016 | F3 | ▯ 5×5 | Right deltoid | ▯ 5×5 | Sponges | 2 | 0.147 |
| 33 | Cespon et al. | 2017 | F3 | ▯ 4×4 | Right deltoid | ▯ 5×10 | Rubber + paste | 1.5 | 0.029 |
| 34 | Hill et al. | 2017 | F3 | Ø 4 | Fp2 | Ø 4 | Rubber + paste | 1 | 0.026 |
| 35 | F3 | Ø 2 | Fp1, Fz, C3, F7 | Ø 2 each | ag/agcl + gel | 1 | −0.063 | ||
| 36 | Nikolin et al. | 2017 | F3 | ▯ 4×4 | F4 | ▯ 4×4 | Sponges | 2 | −0.608 |
| 37 | Talsma et al. | 2017 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 1 | 0.533 |
| 38 | Deldar et al. | 2018 | F3 | ▯ 5×7 | Right deltoid | ▯ 5×7 | Sponges | 2 | 0.178 |
| 39 | Dumont et al. | 2018 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 1.5 | −0.097 |
| 40 | Hill et al. | 2018 | F3 | Ø 2 | Fp1, Fz, C3, F7 | Ø 2 each | ag/agcl + gel | 1.5 | 0.046 |
| 41 | F3, P3 | Ø 2 each | Fp1, Fz, C3, F7, P7, Pz | Ø 2 each | ag/agcl + gel | 1.5 | 0.176 | ||
| 42 | Lukasik et al. | 2018 | F7 | ▯ 5×5 (6×8) | Fp2 | ▯ 5×5 (6×5) | Sponges | 1.5 | 0.019 |
| 43 | Naka et al. | 2018 | F3 | Ø 2,25 | Fp1, Fz, C3, F7 | Ø 2,25 each | ag/agcl + gel | 1.5 | 0.423 |
| 44 | Nikolin et al. | 2018 | F3 | ▯ 4×4 | F4 | ▯ 4×4 | Sponges | 1 | 0.184 |
| 45 | 2 | −0.167 | |||||||
| 46 | Rabipour et al. | 2018 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 2 | 0.225 |
| 47 | Rohner et al. | 2018 | F3 | ▯ 5×7 | Left deltoid | ▯ 5×7 | Sponges | 1 | 0.080 |
| 48 | Talsma et al. | 2018 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 1 | −0.471 |
| 49 | Baumert et al. | 2019 | F3 | ▯ 5×7 | Left trapezius | ▯ 5×7 | Sponges | 1 | 0.540 |
| 50 | Deldar et al. | 2019 | F3 | ▯ 5×7 | Right deltoid | ▯ 5×7 | Sponges | 2 | 0.505 |
| 51 | Di Rosa et al. | 2019 | F3-F7 | ▯ 5×7 | Right deltoid | ▯ 5×7 | Rubber + paste | 1.5 | 0.104 |
| 52 | Friehs & Frings | 2019 | F3 | ▯ 3×3 | Left deltoid | ▯ 5×7 | ? | 0.5 | 0.152 |
| 53 | Hill et al. | 2019 | F3 | Ø 2 | Fp1, Fz, C3, F7 | Ø 2 each | ag/agcl + gel | 1.5 | 0.129 |
| 54 | Jongkees et al | 2019 | F3 | ▯ 5×7 | F4 | ▯ 5×7 | Rubber + paste | 1 | −0.065 |
| 55 | Ke et al. | 2019 | F3 | Ø 2,5 | Fp1, Fz, C3, F7 | Ø 2,5 | Sponges | 1.5 | −0.069 |
| 56 | Luque-Casado et al. | 2019 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 1.5 | 0.125 |
| 57 | Nikolin et al. | 2019 | F3 | Ø 2 | AF3, F5, F1, FC3 | Ø 2 each | ag/agcl + gel | 2 | 0.178 |
| 58 | Wang et al. | 2019 | F3 | Ø 2 | Fp1, Fz, C3, F7 | Ø 2 each | Sponges | 2 | 0.367 |
| 59 | Weintraub-Brevda & Chua, | 2019 | F7 | Ø 2 | F9, F5, FT7, Fc5 | Ø 2 each | ag/agcl + gel | 2 | 0.822 |
| 60 | Abellaned a-Perez et al. | 2020 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Rubber + paste | 2 | 0.161 |
| 61 | Byrne et al. | 2020 | F3 | ▯ 5×5 | Fp2 | ▯ 5×5 | Sponges | 1 | 0.154 |
| 62 | Hussey et al. | 2020 | F3 | 5*Ø 1.6 | Right biceps | 5*Ø 1.6 | ag/agcl + gel | 2 | 0.300 |
| 63 | Koshy et al. | 2020 | F3 | Ø 1.2 | AF3, F5, F1, FC3 | Ø 1.2 each | ag/agcl + gel | 2 | 0.008 |
| 64 | Murphy et al. | 2020 | F3 | ▯ 5×7 | AF8 | ▯ 5×7 | Rubber + paste | 1 | −0.242 |
| 65 | Papazova et al. | 2020 | F3 | ▯ 5×7 | Right deltoid | ▯ 5×7 | Sponges | 1 | −0.040 |
| 66 | 2 | 0.027 | |||||||
| 67 | Ramaraju et al. | 2020 | F3 | ▯ 5×7 | Fp2 | ▯ 5×7 | Sponges | 1.5 | 0.440 |
| 68 | Splittgerber et al. | 2020 | F3 | Ø 5,64 | Fp2 | Ø 5,64 | Sponges | 1 | 0.027 |
| 69 | 2020 | AF3, AF7, F3 | Ø 2 each | Fp2, T7 | Ø 2 each | ag/agcl + gel | 2 | 0.010 | |
▯ Square electrode, Ø circular electrode. In the case that sponge size was larger than electrode size, sponge size is reported in parentheses. Size of circular electrodes refers to the radius.
Table 2.
Study overview right PFC anodal tDCS
| Study | year | anode | size | cathode | size | material | mA | g | |
|---|---|---|---|---|---|---|---|---|---|
| 70 | Berryhill & Jones | 2012 | F4 | ▯ 5×7 | Left cheek | ▯ 5×7 | Sponges | 1.5 | −0.123 |
| 71 | Jeon & Han | 2012 | F4 | ▯ 5×7 | Fp1 | ▯ 5×7 | Sponges | 1 | −0.208 |
| 72 | Mylius et al. | 2012 | F4 | ▯ 5×7 | Fp1 | ▯ 5×7 | Sponges | 2 | 0.020 |
| 73 | Meiron & Lavidor | 2013 | F4-AF4 | ▯ 4×4 | Cz | ▯ 5×7 | Sponges | 2 | 1.111 |
| 74 | Wu et al. | 2014 | F4 | ▯ 4×4 (5×5) | Left cheek | ▯ 4×4 (5×5) | Sponges | 1.5 | 0.179 |
| 75 | Bogdanov & Schwabe | 2016 | F4 | ▯ 5×5 | Cz | ▯ 10×10 | Sponges | 1.075 | 0.488 |
| 76 | Looi et al. | 2016 | F4 | Ø 5,64 | F3 | Ø 5,64 | Sponges | 1 | 0.151 |
| 77 | Trumbo et al. | 2016 | F4 | ▯ 5×5 | Left deltoid | ▯ 5×5 | Sponges | 2 | 0.378 |
| 78 | Robison et al. | 2017 | F4 | ▯ 4×4 | Left cheek | ▯ 4×4 | Sponges | 1.5 | 0.164 |
| 79 | Arcieniega et al. | 2018 | F6 | ▯ 5×7 | P6 | ▯ 5×7 | Sponges | 2 | 0.115 |
| 80 | F6 | ▯ 5×7 | F5 | ▯ 5×7 | Sponges | 2 | −0.024 | ||
| 81 | Wang et al | 2018 | F4 | ▯ 5×5 | Fp1 | ▯ 5×5 | Sponges | 1.5 | 0.006 |
| 82 | Jongkees et al | 2019 | F4 | ▯ 5×7 | F3 | ▯ 5×7 | Rubber + paste | 1 | 0.016 |
| 83 | Nissim et al. | 2019 | F4 | ▯ 5×7 | F3 | ▯ 5×7 | Rubber + paste | 2 | 0.017 |
| 84 | Weintraub-Brevda & Chua, | 2019 | F8 | Ø 2 | F10,F6,FT8,Fc6 | Ø 2 each | ag/agcl + gel | 2 | 0.722 |
| 85 | Ankri et al. | 2020 | F4-AF4 | ▯ 5×5 | Cz | ▯ 5×5 | Sponges | 2 | −0.043 |
| 86 | Koshy et al. | 2020 | F4 | Ø 1,2 | AF4, F2, F6, FC4 | Ø 2 each | ag/agcl + gel | 2 | −0.034 |
| 87 | Shires et al. | 2020 | F4 | ▯ 5×7 | Left cheek | ▯ 5×7 | Sponges | 1.5 | 0.079 |
▯ Square electrode, Ø circular electrode. In the case that sponge size was larger than electrode size, sponge size is reported in parentheses. Size of circular electrodes refers to the radius.
2.2. Outcome variables for effect size calculation
In the present analysis WM was treated as a single cognitive construct and thus we included data from different WM tasks. The studies we investigated used one or more of the following tasks: N-back task, Sternberg task, Corsi block tapping task, paced auditory serial addition and/or subtraction task, digit span, change detection task, internal shift task, delayed WM task, and other custom WM tasks. Different cognitive modalities, such as spatial, visual, auditory, and verbal WM task were included. Also, tasks of various difficulty were included, such as 2-back as well as 4-back tasks (Supplementary Table 1 and 2). However, note that specifically for the n-back task, 0-back and 1-back trials were excluded from analysis here as they are typically employed as a control task and task performance is at ceiling level (Gill et al., 2015). Furthermore, WM tasks with experimental manipulations such as inducing stress (Ankri et al., 2020; Bogdanov & Schwabe, 2016), emotional load (Faehling & Plewnia, 2016; Weintraub-Brevda & Chua, 2019; Wolkenstein et al., 2014), or interference (Gladwin et al., 2012) were included if WM remained the primary tested construct of interest. Outcome measures included: 1) accuracy; 2) reaction time; 3) maximum achieved n, which is the highest n in an n-back task, where participant still score above chance; 4) forward span; 5) backward span; 6) sensitivity, which reflects the amount of correct responses controlled for false alarm rate; 7) discriminability, which is the ratio of correctly identified targets versus non-targets; 8 NIH-examiner WM score.
Combining various WM tasks and outcome measures lowers specificity in detecting tDCS-related effects on specific features (e.g. spatial vs verbal WM, or n-back vs Sternberg performance, or accuracy vs reaction time). However, comparison of different WM aspects lowers the amount of observations per category and consequently strongly reduces statistical power. Therefore, we want to emphasize that investigation of tDCS parameters is the goal of the present study and analysis of WM sub-components is beyond the scope of the present study.
2.3. Effect size extraction and statistical analysis
We used anodal tDCS-induced WM task performance change compared to a control condition for effect size calculation. Comparison to a control condition was defined as I) the difference between anodal and sham tDCS; or II) if a baseline measurement was present, the difference between baseline corrected anodal (posttest – pretest) tDCS and baseline corrected sham (posttest-pretest) tDCS. Hedges’ g was used as the effect size measure, which is based on Cohen’s d with an adjustment to account for inflation due to small sample sizes (Hedges & Olkin, 1985). We gathered data for effect size calculation from results sections and tables or estimated them from figures and appendices using WebPlotDigitizer 4.3. software (https://github.com/ankitrohatgi/WebPlotDigitizer). Hedges’ g for all outcome measurements (accuracy, reaction time, digit span, etc.) was derived from reported Cohen’s d values or calculated using means and pooled standard error of mean. Subsequently, for each study we pooled effect sizes from different outcome measures, such that a single Hedges’ g value was associated with each tDCS montage and intensity configuration. That is, studies using a single tDCS setup are reflected by a single Hedges’ g value and studies using multiple tDCS configurations are associated with as many effect size values (e.g. Faehling & Plewnia, 2016; Hill et al., 2017; Hoy et al., 2013). A positive Hedges’ g reflects a tDCS-induced increase WM performance, whereas negative g indicates a tDCS-induced decrease of WM performance compared to (baseline-corrected) sham values.
We performed classical meta-analyses using MetaWin 2.1. (Rosenberg et al., 2000) and JASP 0.14. For Hedges’ g from left PFC tDCS (n = 69) and right PFC tDCS (n = 18) a random effects model resulted in the cumulative effect size () and 95% confidence intervals. From this we calculated the corresponding Z-statistic and p-value to investigate whether differed significantly from zero. For comparison, effect sizes were calculated for five tDCS montage categories targeting the left hemisphere: PFC-supraorbital region (SOR) (n = 28), PFC-Cheek (n = 4), PFC-Shoulder (n = 12), PFC high-definition (HD) (n = 11) and PFC bifrontal (n = 6). Due to limited sample size this analysis was not performed for experiments on right PFC.
Total heterogeneity (Qt) of effect size distribution was tested (Hedges, 1981) and checked for normality using a Kolmogorov–Smirnov test. Furthermore, the Rosenthal method (α < 0.05) was used to calculate a fail-safe number, which reflects the number of null findings that are necessary to render non-significant (Rosenthal, 1979). Symmetry between sample size and mean effect size, that is a funnel plot, was used to assess publication bias (Sterne et al., 2011). Additionally, sample size bias and recency bias were explored by correlating number of participants, publication year, and effect size using a non-parametric Spearman rank-order test (ρ)(Begg & Mazumdar, 1994; Schäfer & Schwarz, 2019).
2.4. Risk of bias assessment
We performed an assessment of bias risk on the included studies employing the Cochrane Collaboration’s tool for risk of bias in randomized trials (Higgins et al., 2011). The risk of selection bias, performance bias, detection bias, attrition bias, reporting bias, and other biases was judged for each study and classified as high, low, or uncertain. Results are presented in Supplementary Figure 1B.
2.5. FEM Modeling
All FEM simulations were run using SimNIBS version 3.2. (Thielscher et al., 2015). We simulated the tDCS electric field distribution for each included study (left PFC n = 69, right PFC n = 18; Supplementary Figure 2). Specific tDCS montage (electrode location, size, shape and orientation), intensity, electrode material (sponge, rubber, Ag/AgCl), as described in each study, was used for simulations. Simulations were performed on an individual head model of a healthy adult male provided by SimNIBS (“Ernie”). Previously established realistic conductivity values of different tissue types were used: σskin = 0.465 S/m, σbone = 0.01 S/m, σcerebrospinal fluid = 1.654 S/m, σgray matter = 0.275 S/m, and σwhite matter = 0.126 S/m (Windhoff et al., 2013). Gray matter volume was extracted for calculation of electric field strength (total volume 1332 cm3). To confirm our results, all analyses were repeated on a second head model, which was extracted from the WU-Minn Human Connectome Project data set (Van Essen et al., 2013). This head model was of a female, age range 31–35, with a total brain volume of 1245 cm3. Analyses on the second model are shown in Supplementary figure 4 and 5.
Besides simulations for each study, we created an averaged electric field distribution for five tDCS montage categories commonly used by previous studies (PFC-SOR, PFC-Cheek, PFC-Shoulder, PFC HD, PFC bifrontal), as well as for the entire dataset. The robust maximum of electric field strength (EMAX) was quantified as the 99.9th percentile of electric field strength and corresponding MNI coordinates were determined. Affected volume was quantified as the volume (in cm3 and percentage of total brain volume) corresponding to half of the maximum electric field (Foc50). E95, E75, E50, and Foc75 are reported in Supplementary Table 2. EMAX and Foc50 were compared between montage categories using repeated-measures ANOVAs, followed by Bonferroni-corrected post-hoc t-tests.
2.6. Meta-analytic covariance between electric-field distribution and behavioral performance
We introduce a novel method that allows for associating meta-analytic behavioral effect size and tDCS-induced electric field distributions (Figure 1). To this end we locally correlated electric field strength and Hedges g values across all studies at each gray matter tetrahedron (left PFC, n = 69 and right PFC, n = 18). This correlation will be referred to as the performance – electric field correlation (PEC). PEC values above zero reflect a positive association between electric field and hedges g. This indicates the tDCS-induced electric field strength in a particular brain region relates to increased WM performance. A PEC below zero reflects a negative association between electric field and hedges g. This means that a higher tDCS electric field in a particular brain region relates to decreased WM performance. PEC values were calculated for all tetrahedra resulting in a map displaying the relationship between tDCS-induced electric fields and behavioral change.
Figure 1.

Analysis pipeline for relating electric field distributions to WM performance. First electric fields were simulated for all studies (left PFC n = 69; right PFC n = 18). Subsequently, for each tetrahedron (individual volumetric element in gray matter, m = ~9.8 × 105) the correlation between electric field strength (V/m) and WM effects size (Hedges’ g) is calculated. This correlation is referred to as the performance – electric field correlation (PEC). To test for significance, a permutation test is performed in which PEC values are compared to a null-hypothesis model. The null-hypothesis model is generated at each tetrahedron by performing 5000 randomized correlations between the shuffled Hedges’ g value and electric field strength. The actual obtained PEC values are compared to the distribution of the null-hypothesis model yielding a (one-sided) t-statistic and corresponding probability (p) value, such the 95th percentile of the distribution corresponds to p = 0.05. Finally, all PEC and inverted log10-transformed p-values are displayed on the gray matter volume in Figure 5 (left PFC) and Figure 7 (right PFC).
After PEC calculation we used a permutation test to statistically analyze PEC values and determine significance compared to a null-hypothesis model (Figure 1). First, the null-hypothesis model was formed by performing 5000 permutations of randomized PEC values at each tetrahedron resulting in an approximate Gaussian distribution. Subsequently, we compared actual obtained PEC values to the null-hypothesis model for each brain region yielding a t-statistic and a corresponding p-value. Since previous meta-analysis suggested beneficial effects of tDCS, a one-sided distribution was used for our main analysis, such that the 95% of the Gaussian distribution equals a p-value of 0.05. Two-sided statistics are reported in the supplementary data. For presentation purposes, we displayed inverted log10 transformed p-values to emphasize low p-values (Figures 5B and Figures 7B).
Figure 5.

A) PEC values of left PFC tDCS studies representing the relationship between electric field strength and behavioral effect size. That is, higher PEC values indicate that higher electric field strength in a particular brain location relates to higher increased WM performance. B) Inverted Log10 p-values associated with the PEC values. Inverted Log-p of 1.31 and 2 correspond to p = 0.05 and p = 0.01 respectively.
Figure 7.

PEC values of right PFC tDCS studies representing the relationship between electric field strength and behavioral effect size. That is, higher PEC values indicate that a higher electric field in a particular location relate to higher increased WM performance. B) Inverted Log10 p-values associated with the PEC values. Inverted Log-p of 1.31 and 2 correspond to p = 0.05 and p = 0.01 respectively.
To get an indication of the efficacy of most commonly used tDCS montages, the electric field strength was calculated averaged for all tetrahedra in the region where PEC values are significant (PECSIG). Additionally, the PEC value was determined for each montage category at the location of their respective EMAX. Each PEC value was compared to the robust maximum (PECMAX), which was quantified as the 99.9th percentile of significant PEC values.
2.7. tDCS montage optimization
Using the SimNIBS optimization routine (Saturnino et al., 2020), we determined a tDCS montage which maximizes the electric field strength in the left PFC robust maximum PEC (PECMAX) location. The optimization algorithm is performed on the same standard head model (“Ernie”) and 74 possible electrode positions according to the 10–10 EEG system included with SimNIBS. All brain locations in a radius of 10 mm around the PECMAX location were used as target, with no restraints on electric field direction. The number of stimulation electrodes was set to 5 or fewer, with a maximum intensity of 1 mA per electrode and 2 mA total current. The perpendicular component of the induced electric field was separated at the brain surface level to display inward and outward currents of the optimized tDCS montage.
3. Results
3.1. Classical meta-analysis for left prefrontal tDCS
We performed a meta-analysis on the effect of left prefrontal tDCS on WM performance to get an indication of general tDCS efficacy irrespective of montage and intensity. A total of 69 effect size values (hedges g) of left PFC anodal tDCS studies were collected. Overall, we observed a significant cumulative effect size of , Z = 3.595, p < 0.001, indicating that tDCS has a small beneficial effect on WM performance compared to a control condition (Figure 2A). Total heterogeneity of effect sizes was not significant (QT = 40.48, p = 0.997) and Kolmogorov–Smirnov test indicated no deviation from normality (D = 0.134, p = 0.156). The fail-safe number indicated that 306 null results would be necessary to render the cumulative effect size non-significant. Effect sizes for tDCS montage categories separately varied between to (Table 3). Given the smaller sample sizes the compared effectiveness of each montage category is less conclusive, and no montage category appears superior.
Figure 2.

A) Forest plot showing effect sizes (Hedges’ g) and 95% confidence interval of left PFC anodal tDCS on working memory (n = 69). Positive values represent tDCS-related improved WM, whereas negative values represent decreased WM performance. Number labels on the right represent experiment numbers corresponding to Table 1. B) Scatterplots representing the relationship between publication year and effect size; C) between publication year and sample size; and D) between sample size and effect size.
Table 3.
Classical meta-analysis results
| Montage | N | 95% CI | Z | p-value | Fail-safe number | Qt | p-value | ||
|---|---|---|---|---|---|---|---|---|---|
| Left PFC | Overall | 69 | 0.147 | 0.067 – 0.228 | 3.595 | < 0.001 | 306.5 | 40.48 | 0.997 |
| PFC-SOR | 28 | 0.141 | 0.010 – 0.273 | 2.101 | 0.036 | 30.4 | 13.23 | 0.988 | |
| PFC-cheek | 4 | 0.208 | −0.454 – 0.869 | 0.615 | 0.539 | 0 | 0.09 | 0.993 | |
| PFC-shoulder | 12 | 0.084 | −0.127 – 0.294 | 0.780 | 0.435 | 0 | 7.58 | 0.670 | |
| PFC HD | 11 | 0.195 | −0.028 – 0.418 | 1.717 | 0.086 | 0 | 6.35 | 0.785 | |
| PFC bifrontal | 6 | 0.018 | −0.355 – 0.392 | 0.095 | 0.924 | 0 | 3.66 | 0.599 | |
| PFC other | 8 | 0.241 | −0.001 – 0.483 | 1.958 | 0.050 | 0 | 7.21 | 0.514 | |
| Right PFC | Overall | 18 | 0.115 | −0.056 – 0.286 | 1.32 | 0.187 | 0 | 6.95 | 0.984 |
The relationship between sample size, publication year and effect size were investigated to assess risk of publication bias. Publication year and effect size were not significantly correlated (ρ = −0.218, p = 0.072; Figure 2B). However, a slight negative trend was observed, which may be explained by the observation of a significant positive correlation between publication year and sample size (ρ = 0.482, p < 0.001; Figure 2C), as well as a significant negative correlation between sample size and effect size (ρ = −0.280, p = 0.020; Figure 2D). This suggests that more recent studies recruited more participants and studies with larger sample sizes tend to find smaller effect sizes. However, a funnel shape distribution and absence of asymmetry around the mean effect size suggest there is no clear evidence for publication bias (Figure 2D).
3.2. Classical meta-analysis for right prefrontal tDCS
Similar to the previous analysis, we performed a meta-analysis on the effect of right prefrontal tDCS on WM performance to get an indication of general tDCS efficacy irrespective of montage and intensity. For right PFC tDCS studies on WM performance 18 effect sizes were collected. Overall cumulative effect size did not reach significance (, 95% CI = −0.056 – 0.286, Z = 1.32, p = 0.187; Figure 3A). Total heterogeneity of effect sizes was not significant (QT = 6.95, p = 0.984) and Kolmogorov–Smirnov test indicated no deviation from normality (D = 0.204, p = 0.388). That is, without taking montage and intensity into account, right prefrontal tDCS is not effective in changing WM performance.
Figure 3.

Forest plot showing effect sizes (Hedges’ g) and 95% confidence interval of right PFC anodal tDCS on working memory (n = 18). Positive values represent tDCS-related improved WM, whereas negative values represent decreased WM performance. Number labels on the right represent experiment numbers corresponding to Table 2. B) Scatterplots representing the relationship between publication year and effect size; C) between publication year and sample size; and D) between sample size and effect size.
No significant relationship between publication year and effect size was observed (ρ = −0.082, p = 0.745; Figure 3B). More recent publications were associated with larger sample sizes (ρ = 0.506, p = 0.032; Figure 3C), but no significant correlation between sample size and effect size was observed (ρ = 0.243, p = 0.331; Figure 3D). Furthermore, equal distribution around the mean suggests no publication bias (Figure 3D).
3.3. Left prefrontal relationship between electric field distribution and behavioral performance
Next, we performed our novel meta-analytic method on the correlation between electric field strength and behavioral performance. Initially, electric field distributions were simulated for all left prefrontal tDCS (n = 69) studies. The electric field averaged over all data suggested that a large portion of the PFC was targeted across studies and no clear preference for a specific region was observed (Figure 4A). The average Foc50 value of the 69 montages was 83.14 ± 5.56 cm3 and focality varied between 6.15 cm3 and 178.91 cm3, which corresponds to between 0.46% and 13.43% of total gray matter volume. This suggests that the extent of electric fields varied considerably across montages (Figure 4B–F, Supplementary Table 3). A significant difference between montage categories was observed (F(4,56) = 238.83, p < .001). Post-hoc analysis showed significant differences between all montages (p < .005), except between PFC-cheek and PFC bifrontal (p = .366). Unsurprisingly, average Foc50 was lowest for PFC HD (23.58 ± 3.83 cm3) and highest for PFC-shoulder (159.09 ± 4.46 cm3; Supplementary Table 2). EMAX average was 0.307 ± 0.014 V/m and ranged between 0.113 V/m and 0.747 V/m and differed significantly between montage categories (F(4,56) = 3.23, p = 0.019). The only significant difference was between PFC-shoulder and PFC HD (p = 0.032). Electric field distributions for the second head model were comparable to these results (Supplementary Figure 4).
Figure 4.

Averaged electric field distributions of left PFC tDCS. A) electric field strength averaged over all studies (n = 69). B) electric field strength averaged for PFC-SOR montages (n = 28); C) PFC-Cheek montages (n = 4); PFC-Shoulder montages (n = 12); PFC HD montages (n = 11); PFC bifrontal montages (n = 6).
Next, the relationship between electric field strength and behavioral effect size was investigated at each brain location. This relationship is represented by the PEC value, which is the correlation between electric field strength and Hedges’ g. We found a significant volume at the border of the lower left DLPFC and left IFC between Brodmann area 45 and 47 (Figure 5A). PECMAX was .279 (one-sided p = 0.010; for two-sided results see Supplementary Figure 3) at MNI coordinates [−51, 39, 4]. The PECMAX corresponds to 7.8% explained variance, which amounts to a medium-sized effect (Cohen, 1977). A total volume of 1.16 cm3 had a PEC value that reached significance (PEC > 0.199, p < 0.05; Figure 5B). Averaged PECSIG was 0.241 (p = 0.023; Figure 6A). PEC results for the second head model are shown in Supplementary Figure 5A and B.
Figure 6.

A) Scatterplot of the correlation between the electric field strength for each study averaged over the PECSIG area and effect size values. Various symbols are related to different montages. B) Individual and mean electric field strengths for each montage category averaged of the PECSIG area. C) PEC values at the EMAX location of each montage category compared to PECMAX (dashed line).
We explored how well each of the five montage categories targets the PECSIG region. Electric field strength of each tDCS montage, averaged for all tetrahedra within the PECSIG volume, differed considerably compared to their EMAX (Figure 6B). This suggest that the PECSIG area was not primarily targeted by these montages. Furthermore, at the location that each montage targets the relationship to WM improvement is non-significant. Specifically, the PEC values corresponding to EMAX location of each montage were not significantly larger than zero (Figure 6C): PFC-SOR [1, 62, 11], PEC = 0.002 (p = 0.990), PFC-Cheek [−32, 29, −15], PEC = 0.052 (p = 0.336), PFC-Shoulder [−30, −1, −24], PEC = 0.027 (p = 0.159), PFC HD [−39, 47, 23], PEC = 0.069 (p = 0.159), PFC Bifrontal [−23, 50, 15], PEC = −0.011 (p = 0.159).
3.4. Right prefrontal relationship between electric field distribution and behavioral performance
The average Foc50 values of the 18 montages was 91.17 ± 10.52 cm3 and focality varied between 5.37 cm3 and 168.95 cm3, which corresponds to between 0.40% and 12.69% of the total gray matter volume. EMAX average was 0.337 ± 0.027 V/m and ranged between 0.104 V/m and 0.509 V/m (Supplementary Table 3).
In agreement with the left PFC results, largest PEC values for tDCS over the right PFC were found in the lower part of the DLPFC (Figure 7A). Maximum PEC was 0.503 (one-sided p = 0.017; for two-sided results see supplementary figure 3), which corresponded to MNI coordinates [52, 36, 7]. A total volume of PECSIG was 1.29 cm3 (PEC > 0.401, p < 0.05; Figure 7B). PEC results for the second head model are shown in Supplementary Figure 5C and D.
3.5. Optimized tDCS montage
In order to induce electric fields with maximum strength in the PECSIG region, we propose a montage targeting the lower DLPFC/upper IFC. For this we used the electrode location optimization routine provided by SimNIBS. The routine resulted in a four-electrode montage with two circular (3.14 cm2) anodes over F7 and AF7, with an intensity of 1 mA each. Furthermore, two circular cathodes at an intensity of −1 mA over Fc1 and Fcz were suggested (Figure 8A). This montage yields an electric field over the PEGSIG volume with EMAX = 0.58 V/m and Foc50 = 37.93 cm3 (Figure 8B and C). Additionally, we repeated the optimization routine with a limit of two square electrode (5×5 cm). A montage was found with the anode over F7 (2 mA) and cathode over Fc1 (−2 mA), resulting in an EMAX = 0.48 V/m and Foc50 = 47.95 cm3 (Supplementary Figure 6).
Figure 8.

A) Montage resulting from the SimNIBS optimization routine to target an area with a radius of 10 mm around PECMAX in left PFC, using circular electrodes with 1 cm diameter. Stimulation intensity for anodal electrodes at AF7 and F7 was 1 mA and for cathodal electrodes at Fc1 and Fcz was −1 mA. B) Induced electric field by the optimized montage. C) Inward (red) and outward (blue) currents induced by the optimized stimulation montage.
Discussion
Here, we presented a novel meta-analytic approach, using computational electric field simulations to study the relationship between tDCS parameters and WM performance. Large variety in tDCS set ups yields large inter-experimental variability in electric field distribution and strength (Opitz et al., 2018; Polania et al., 2018). As a result, classical meta-analyses are not well-suited to capture differences between studies using different tDCS montages. Instead, our method exploited the observed variability in tDCS electric fields to predict brain regions where tDCS is related to changes in WM performance. Analysis related to 69 effect sizes of anodal tDCS over left PFC showed that tDCS electric fields in the lower left DLPFC/upper left IFC (Brodmann area 45 and 47) are most strongly related to increased general WM performance. Differences in electric field strength in this region accounts for 7.8% of variance for WM improvements, which amounts to a medium-sized effect (Cohen, 1977). Interestingly, a similar region for tDCS-induced WM performance improvements was observed for right PFC tDCS studies (n = 18). Electric fields of five tDCS montages categories commonly used in WM-related research did not reach maximum strength in the lower DLPFC/upper IFC. Therefore, we presented a tDCS montage to better target this region. Hence, future studies could investigate the potential performance benefits on WM performance of this tDCS montage.
4.1. Electric field modeling on meta-analytic datasets
In the present study we introduced a novel way of systematically investigating tDCS parameters across multiple studies. Recently, studies used individualized electric field simulations and compared these to changes in behavior (Albizu et al., 2020; Caulfield et al., 2020; Evans et al., 2020; Kim et al., 2014). Thereby, these studies were able to control for inter-individual electric field variability when interpreting tDCS-related effects. Analogously, here inter-experiment electric field variability was exploited to explain differences between studies in tDCS-induced WM performance change. Effects of non-invasive brain stimulation are prone to numerous sources of intra-individual, inter-individual, and inter-experimental variability (Lopez-Alonso et al., 2014; Polania et al., 2018; Ridding & Ziemann, 2010). Although variability should be reduced, it cannot be completely eliminated. With our new approach, we were able to overcome shortcomings of classical meta-analyses, which are unable to tackle variability across studies with respect to differences to tDCS stimulation parameters. As such, we calculated a brain region specific estimate of tDCS-related WM improvements. Indeed, whereas previous meta-analyses either found small or null effects of tDCS on WM (Brunoni & Vanderhasselt, 2014; Hill et al., 2016; Horvath et al., 2015; Manusco et al., 2016), our method revealed that a medium effect (7.8% explained variance), specifically for the lower DLPFC/upper IFC region. In sum, converging evidence of 87 effect sizes, reported in 68 peer-reviewed articles, suggested that anodal tDCS can improve WM performance and that targeting the lower DLPFC may be the best way to achieve this.
4.2. Differences in PFC tDCS target region
Investigation of electric field distributions related to different tDCS montages showed considerable variation in targeted volume. Orbital-referenced and bifrontal montages primarily target anterior portions of the PFC, corresponding to Brodmann area 10. In contrast, cheek- and shoulder-referenced montages target more posterior and inferior regions, such as triangular and opercular part of the IFC, corresponding to Brodmann areas 44 and 45. High-definition montage electric field distribution is more restricted to location of the anodal montages. Since most studies used F3 of the 10–20 system for electrode positioning, the induced electric field is largest in the superior part of the DLPFC (Brodmann area 46). The present meta-analytic results suggested that the inferior part of the DLPFC and superior orbital part of the IFC were most strongly related to increased WM performance. Electric fields induced by five common montages were not maximal at this region, providing a potential explanation for overall small effect sizes on WM performance.
Indeed, the majority of tDCS studies intended to target the upper DLPFC by placing the anodal electrode over F3. However, a few studies attempted to target lower DLPFC/IFC by placing the target electrode at F5/F6 or F7/F8 (Arciniega et al., 2019; Di Rosa et al., 2019; Jones et al., 2015; Lukasik et al., 2018; Weintraub-Brevda & Chua, 2019). For example, Weintraub-Brevda and Chua (2019) found that anodal tDCS over left and right IFC (referred to as ventrolateral PFC) increased both emotional and neutral WM. Similarly, Jones et al. (2015) found WM improvements of lower PFC anodal tDCS, but these results were limited to participants with high baseline WM capacity. Furthermore, tDCS-effects were amplified with the presentation of extrinsic motivation by offering a reward. These results were partially confirmed by Di Rosa et al. (2019), who showed lower PFC anodal tDCS-related improved reaction time during and after a reward-driven WM task. However, in contrast to Jones et al., Di Rosa and colleagues found that the effect was stronger for participants with lower baseline WM capacity. Furthermore, in agreement with our findings, the beneficial tDCS-induced effects on WM were associated with increased hemodynamic activity in the IFC. Contrary to these findings, Lukasik et al. (2018) reported no tDCS-related effects on WM when the anodal electrode was placed over IFC. Yet, whereas the montages used by Jones et al. (2015), Di Rosa et al. (2019), and Weintraub-Brevda & Chua (2019) electric field distribution significantly overlapped with the IFC (Supplementary Figure 2, study nr. 22, 51, and 59), Lukasik et al. (2018) targeted more anterior parts of the PFC (Supplementary Figure 2, study nr. 47). This further demonstrates the benefits of electric field modeling when determining affected cortical volumes.
Although the mid-to-upper DLPFC has received much attention and was targeted by most tDCS studies on WM performance, considerable evidence supports a crucial role for the lower DLPFC/upper IFC (Grossberg, 2018; Petrides et al., 2002). Various non-mutually exclusive hypotheses have been proposed that point towards different functional properties of upper and lower PFC, including manipulation and maintenance of information (Petrides et al., 2002; Stern et al., 2000; Veltman et al., 2003), distinct processing of neutral and emotional stimuli (Dolcos et al., 2013), and a spatial versus verbal distinction (Grossberg, 2018; Owen et al., 1999). Furthermore, within PFC areas, different neuronal activity patterns have been observed. Whereas some neurons display elevated activity during a delay period, others show an ‘activity-silent’ pattern where neurons maintain information by a change in synaptic weights (Spaak et al., 2017; Stokes, 2015). Future research may investigate whether tDCS-induced cortical activation might preferentially target specific functional processes and neuronal encoding patterns and how this relates to different PFC subdivisions.
4.3. Potential biases in WM-related tDCS studies
Our risk of bias assessment suggested no strong biases within studies. Blinding of experimenters was not guaranteed in one third of studies, which poses a small potential of performance bias. However, report of successful blinding of participants, as well as their sensations during active tDCS and sham is frequently lacking and should be adopted in the future. Overall, we found no strong indication for publication bias (Sterne et al., 2011). Yet, it should be noted that more recent studies tended to recruit a larger sample size, which is associated with smaller effect sizes. Indeed, larger sample sizes are associated with smaller variance and are thus less likely to include extremely large (or small) effects. In accordance, although not statistically significant, we found a downward trend in effect sizes correlated to publication year. This observation may be related to a recent increase in openness to publish null findings (Schäfer & Schwarz, 2019).
4.4. Limitations and perspectives
One limitation of our study relates to the variability in tasks and outcome measurements between studies. We opted to include several WM tasks (N-back, Sternberg task, digit span, etc.), as well as outcome measurements (accuracy, RT, achieved N, etc.), in order to present results of tDCS effects that can be extrapolated over all WM-related tasks. Different tasks that focus on different cognitive modalities, such as verbal versus visuo-spatial WM is likely to rely on distinct cortical networks (Nee et al., 2013). However, although specific networks are different, there seems to be considerable overlap (Lycke et al., 2008). In an imaging study, Lycke and colleagues (2008) found bilateral IFC activation for both spatial and verbal WM tasks. This is in line with the WM model of Baddeley and Hitch (1974), which suggests that different cognitive modalities, such as verbal and visuo-spatial processing, is governed by a central executive system. Here, we opted to generalize over cognitive modalities. It is possible, that the region identified in our results mainly relates to this central executive, rather than modality-specific functions. However, this needs to be addressed by future studies. By investigating specific aspects of WM we may have reduced inter-experimental variability, but this would have been at the cost of generalizability. Furthermore, selecting specific parameters of a task would have reduced sample size, which would have drastically reduced statistical power.
Furthermore, it should be noted that although the present study accounts for inter-experimental variability, inter-individual variability is an additional determinant for tDCS efficacy (Evans et al., 2020). Here, we used a typically healthy male brain for electric field modeling. However, head shape, brain size, skull-to-cortex distance, gyrification and conductivity differs between individuals (Antonenko et al., 2021; Opitz et al., 2015). To give an indication whether our results hold for other brain morphologies, we attempted to replicate our results in another head model of a typical female (WU-Minn HCP data set, Van Essen et al., 2013). The results of the second model were similar, with the PECMAX being situated at an almost identical location. Nevertheless, the present results are generalizable to a group-level, however precise location related to optimal tDCS-effects on WM can differ per individual. Therefore, adjusting tDCS montage based on individual imaging data is desirable (Evans et al., 2020). This issue is further amplified when considering patient population with brain atrophy or brain damage (Lu et al., 2019). Whether present results translate to abnormal brain physiology needs to be established in future studies.
Although electric field distribution varied considerably between studies, systematic experimental investigation of montage configuration, as well as target location may be a subject for future studies. Comparison of tDCS that primarily targets IFC, lower DLPFC, upper DLPFC and anterior PFC offers the opportunity to experimentally verify current meta-analytic findings. Furthermore, the efficacy of our tDCS montage suggestion, which followed from the optimization routine, should be empirically substantiated.
Besides tDCS, applying oscillatory currents using transcranial alternating current stimulation (tACS) has been proposed as a method of changing neural activity and behavioral performance (Johnson et al., 2020; Neuling et al., 2013; Reato et al., 2013; Schutter & Wischnewski, 2016; Wischnewski et al., 2019a; 2019b). Recent studies have suggested that tACS can improve WM performance when targeting theta oscillations (Abellaneda-Perez et al., 2020, Jausovec & Jausovec, 2014; Jausovec et al., 2014; Röhner et al., 2018), gamma oscillations (Hoy et al., 2015), or a combination of both (Alekseichuk et al., 2016). Interestingly, Abellaneda-Perez and colleagues (2020) suggested differing neural network activation related to tDCS- and tACS-related effects on WM performance. Indeed, neural mechanisms of tACS may differ from tDCS, where neurons are entrained without an increase in spiking rate (Johnson et al., 2020). As such, the differing neurophysiological properties that tDCS and tACS may target mean that the translation of our findings to tACS applications needs to be established.
WM deficits have been observed in a variety of disorders, including attention-deficit hyperactivity disorder (ADHD) (Salehinejad et al., 2020; Valera et al., 2005), post-traumatic stress disorder (PTSD) (Flanagan et al., 2018), obsessive-compulsive disorder (OCD) (Nakao et al., 2009), and major depressive disorder (MDD) (Joormann & Gotlib, 2008; Marquand et al., 2008). Findings of our meta-analysis may provide insights for clinical studies that employ tDCS to treat individuals suffering from these and other disorders. Indeed, tDCS has been shown to improve WM performance in children with ADHD, however, the effect was small and large variability was observed (Salehinejad et al., 2019). Similarly, several studies provided evidence for tDCS-related WM benefits in patients with MDD (Moreno et al., 2015; Oliveira et al., 2013), which has been associated with relief of depressive symptoms (Salehinejad et al., 2015). Therefore, attempting to maximize tDCS-related effects to WM by performing meta-analytic electric field modeling studies, as we propose here, may be beneficial to the therapeutic use of tDCS in the treatment of psychiatric disease.
Supplementary Material
Highlights.
We summarize the effect of 87 tDCS studies on working memory performance
We introduce a new meta-analytic method correlating tDCS electric fields and performance
tDCS-induced electric fields in lower DLPFC correlate significantly with improved working memory
The lower DLPFC was not maximally targeted by most tDCS montages and we provide an optimized montage
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
References
- Abellaneda-Perez K, Vaque-Alcazar L, Perellon-Alfonso R, Bargallo N, Kuo MF, Pascual-Leone A, et al. , 2020. Differential tDCS and tACS effects on working memory-related neural activity and resting-state connectivity. Front. Neurosci 13, 1440. 10.3389/fnins.2019.01440 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Albizu A, Fang R, Indahlastari A, O’Shea A, Stolte SE, See KB, 2020. Machine learning and individual variability in electric field characteristics predict tDCS treatment response. Brain Stimul. 13(6), 1753–1764. 10.1016/j.brs.2020.10.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Alekseichuk I, Turi Z, Amador de Lara G, Antal A, Paulus W, 2016. Spatial working memory in humans depends on theta and high gamma synchronization in the prefrontal cortex. Curr. Biol 26(12), 1513–1521. 10.1016/j.cub.2016.04.035 [DOI] [PubMed] [Google Scholar]
- Andrews SC, Hoy KE, Enticott PG, Daskalakis ZJ, Fitzgerald PB, 2011. Improving working memory: The effect of combining cognitive activity and anodal transcranial direct current stimulation to the left dorsolateral prefrontal cortex. Brain Stimul. 4(2), 84–89. 10.1016/j.brs.2010.06.004 [DOI] [PubMed] [Google Scholar]
- Ankri YLE, Braw Y, Luboshits G, Meiron O, 2020. The effects of stress and transcranial direct current stimulation (tDCS) on working memory: A randomized controlled trial. Cogn. Affect. Behav. Neurosci 20(1), 103–114. 10.3758/s13415-019-00755-7 [DOI] [PubMed] [Google Scholar]
- Antonenko D, Grittner U, Saturnino G, Nierhaus T, Thielscher A, Floël A, 2021. Inter-individual and age-dependent variability in simulated electric fields induced by conventional transcranial electrical stimulation. NeuroImage 224, 117413. 10.1016/j.neuroimage.2020.117413 [DOI] [PubMed] [Google Scholar]
- Arciniega H, Gözenman F, Jones KT, Stephens JA, Berryhill ME, 2018. Frontoparietal tDCS benefits visual working memory in older adults with low working memory capacity. Front. Aging Neurosci 10, 57. 10.3389/fnagi.2018.00057 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baddeley A, 1992. Working memory. Science 255(5044), 556–559. 10.1126/science.1736359 [DOI] [PubMed] [Google Scholar]
- Baddeley AD, Hitch G, 1974. Working memory. In: Bower GH (Eds.), Psychology of learning and motivation. Academic Press, Cambridge, MA, USA, pp. 47–89. 10.1016/S0079-7421(08)60452-1 [DOI] [Google Scholar]
- Baumert A, Buchholz N, Zinkemagel A, Clarke P, MacLeod C, Osinsky R, Schmitt M, 2019. Causal underpinnings of working memory and Stroop interference control: Testing the effects of anodal and cathodal tDCS over left DLPFC. Cogn. Affect. Behav. Neurosci, 20(1), 34–48. 10.3758/s13415-019-00726-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Begg CB, Mazumdar M, 1994. Operating characteristics of a rank correlation test for publication bias. Biometrics. 50(4), 1088–1101. 10.2307/2533446 [DOI] [PubMed] [Google Scholar]
- Berryhill ME, Jones KT, 2012. tDCS selectivity improves working memory in older adults with more education. Neurosci. Lett 521, 148–151. 10.1016/j.neulet.2012.05.074 [DOI] [PubMed] [Google Scholar]
- Bogaard AR, Lajoie G, Boyd H, Morse A, Zanos S, Fetz EE, 2019. Cortical network mechanisms of anodal and cathodal transcranial direct current stimulation in awake primates. [Google Scholar]
- Bogdanov M, Schwabe L, 2016. Transcranial stimulation of the dorsolateral prefrontal cortex prevents stress-induced working memory deficits. J. Neurosci 36(4), 1429–1437. 10.1523/JNEUROSCI.3687-15.2016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brunoni AR, Vanderhasselt MA, 2014. Working memory improvement with non-invasive brain stimulation of the dorsolateral prefrontal cortex: A systematic review and meta-analysis. Brain Cogn. 86, 1–9. 10.1016/j.bandc.2014.01.008 [DOI] [PubMed] [Google Scholar]
- Byrne EM, Ewbank MP, Gathercole SE, Holmes J, 2020. The effects of transcranial direct current stimulation on within- and cross-paradigm transfer following multi-session backward recall training. Brain Cogn. 141, 105552. 10.1016/j.bandc.2020.105552 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carvalho S, Boggio PS, Goncalves OF, Vigario AR, Faria M, Silva S, et al. , 2015. Transcranial direct current stimulation based metaplasticity protocols in working memory. Brain Stimul. 8(2), 289–294. 10.1016/j.brs.2014.11.011 [DOI] [PubMed] [Google Scholar]
- Caulfield KA, Badran BW, DeVries WH, Summers PM, Kofmehl E, Li X, et al. , 2020. Transcranial electrical stimulation motor threshold can estimate individualized tDCS dosage from reverse-calculation electric-field modeling. Brain Stimul. 13(4), 961–969. 10.1016/j.brs.2020.04.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cespon J, Rodella C, Rossini PM, Miniussi C, Pellicciari MC, 2017. Anodal transcranial direct current stimulation promotes frontal compensatory mechanisms in healthy elderly subjects. Front. Aging Neurosci 9, 420. 10.3389/fnagi.2017.00420 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cohen J, 1977. Statistical power analysis for the behavioral sciences. Academic Press, New York, NY, USA. [Google Scholar]
- Datta A, Bansal V, Diaz J, Patel J, Reato D, Bikson M, 2009. Gyri-precise head model of transcranial direct current stimulation: Improved spatial focality using a ring electrode versus conventional rectangular pad. Brain Stim. 2(4), 201–207. 10.1016/j.brs.2009.03.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- De Witte S, Klooster D, Dedoncker J, Duprat R, Remue J, Baeken C, 2018. Left prefrontal neuronavigated electrode localization in tDCS: 10–20 EEG system versus MRI-guided neuronavigation. Psychiatry Res. Neuroimaging 274, 1–6. 10.1016/j.pscychresns.2018.02.001 [DOI] [PubMed] [Google Scholar]
- Deldar Z, Rustamov N, Bois S, Blanchette I, Piché M, 2018. Enhancement of pain inhibition by working memory with anodal transcranial direct current stimulation of the left dorsolateral prefrontal cortex. J. Physiol. Sci 68, 825–836. 10.1007/s12576-018-0598-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Deldar Z, Rustamov N, Blanchette I, Piché M, 2019. Improving working memory and pain inhibition in older persons using transcranial direct current stimulation. Neurosci. Res 148, 19–27. 10.1016/j.neures.2018.12.007 [DOI] [PubMed] [Google Scholar]
- Di Rosa E, Brigadoi S, Cutini S, Tarantino V, Dell’Acqua R, Mapelli D, et al. , 2019. Reward motivation and neurostimulation interact to improve working memory performance in healthy older adults: A simultaneous tDCS-fNIRS study. Neuroimage, 202, 116062. 10.1016/j.neuroimage.2019.116062 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dolcos F, Iordan AD, Kragel J, Stokes J, Campbell R, McCarthy G, Cabeza R, 2013. Neural correlates of opposing effects of emotional distraction of working memory and episodic memory: an event-related fMRI investigation. Front. Psychol 4, 293. 10.3389/fpsyg.2013.00293 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dumont L, El Mouderrib S, Theoret H, 2018. Randomized, crossover, sham-controlled, double-blind study of transcranial direct current stimulation of left DLPFC on executive functions. Rest. Neurol. Neurosci 36(6), 755–766. 10.3233/RNN-180872 [DOI] [PubMed] [Google Scholar]
- Evans C, Bachmann C, Lee JSA, Gregoriou E, Ward N, Bestmann S, 2020. Dose-controlled tDCS reduces electric field intensity variability at a cortical target size. Brain Stimul. 13(1), 125–136. 10.1016/j.brs.2019.10.004 [DOI] [PubMed] [Google Scholar]
- Faehling F, Plewnia C, 2016. Controlling the emotional bias: Performance, late positive potentials, and the effect of anodal transcranial direct current stimulation (tDCS). Front. Cell. Neurosci 10, 159. 10.3389/fncel.2016.00159 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Flanagan JC, Hand A, Jarnecke AM, Moran-Santa Maria MM, Brady KT, Joseph JE, 2018. Effects of oxytocin on working memory and executive control system connectivity in posttraumatic stress disorder. Exp. Clin. Psychopharmacol 26(4), 391–402. 10.1037/pha0000197 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Foerster A, Yavari F, Farnad L, Jamil A, Paulus W, Nitsche MA, Kuo MF, 2019. Effects of electrode angle-orientation on the impact of transcranial direct current stimulation on motor cortex excitability. Brain Stimul. 12(2), 263–266. 10.1016/j.brs.2018.10.014 [DOI] [PubMed] [Google Scholar]
- Fregni F, Boggio PS, Nitsche M, Bermpohl F, Antal A, Feredoes E et al. , 2005. Anodal transcranial direct current stimulation of prefrontal cortex enhances working memory. Exp. Brain Res, 166, 23–30. 10.1007/s00221-005-2334-6 [DOI] [PubMed] [Google Scholar]
- Friehs MA, Frings C, 2019. Offline beats online: Transcranial direct current stimulation timing influences on working memory. Neuroreport, 30, 795–799. 10.1097/WNR.0000000000001272 [DOI] [PubMed] [Google Scholar]
- Gill J, Shah-Basak PP, Hamilton R, 2015. It’s the thought that counts: Examining the task-dependent effects of transcranial direct current stimulation on executive function. Brain Stimul. 8(2), 253–259. 10.1016/j.brs.2014.10.018 [DOI] [PubMed] [Google Scholar]
- Gladwin TE, den Uyl TE, Fregni FF, Wiers RW, 2012. Enhancement of selective attention by tDCS: Interaction with interference in a Sternberg task. Neurosci. Lett 512, 33–37. 10.1016/j.neulet.2012.01.056 [DOI] [PubMed] [Google Scholar]
- Gold JM, Barch DM, Feuerstahler LM, Carter CS, MacDonald AW, Ragland JD, et al. , 2019. Working memory impairment across psychotic disorders. Schizophr. Bull 45(4), 804–812. 10.1093/schbul/sby134 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grossberg S, 2018. Desirability, availability, credit assignment, category learning, and attention: Cognitive-emotional and working memory dynamics of orbitofrontal, ventrolateral, and dorsolateral prefrontal cortices. Brain Neurosci. Adv 2, 2398212818772179. 10.1177/2398212818772179 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hedges LV, 1981. Distribution theory for Glass’s estimator of effect size and related estimators. J Educ Stat. 6, 107–128. 10.2307/1164588 [DOI] [Google Scholar]
- Hedges LH, Olkin I, 1985. Statistical Methods for Meta Analysis. Orlando, FL: Academic Press. 10.1016/C2009-0-03396-0 [DOI] [Google Scholar]
- Heinzel S, Kaufmann C, Grützmann R, Hummel R, Klawohn J, Riesel A, et al. , 2018. Neuroimage Clin. 17, 426–434. 10.1016/j.nicl.2017.10.039 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. , 2011. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 343, d5928. 10.1136/bmj.d5928 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hill AT, Fitzgerald PB, Hoy KE, 2016. Effects of anodal transcranial direct current stimulation on working memory: A systematic review and meta-analysis of findings from healthy and neuropsychiatric populations. Brain Stim. 9(2), 197–208. 10.1016/j.brs.2015.10.006 [DOI] [PubMed] [Google Scholar]
- Hill AT, Rogasch NC, Fitzgerald PB Hoy KE, 2017. Effects of prefrontal bipolar and high-definition transcranial direct current stimulation on cortical reactivity and working memory in healthy adults. Neuroimage 152, 142–157. 10.1016/j.neuroimage.2017.03.001 [DOI] [PubMed] [Google Scholar]
- Hill AT, Rogasch NC, Fitzgerald PB, Hoy KE, 2018. Effects of single versus dual-site high-definition transcranial direct current stimulation (HD-tDCS) on cortical reactivity and working memory performance in healthy subjects. Brain Stimul. 11(5), 1033–1043. 10.1016/j.brs.2018.06.005 [DOI] [PubMed] [Google Scholar]
- Hill AT, Rogasch NC, Fitzgerald PB, Hoy KE, 2019. Impact of concurrent task performance on transcranial direct current stimulation (tDCS)-induced changes in cortical physiology and working memory. Cortex, 113, 37–57. 10.1016/j.cortex.2018.11.022 [DOI] [PubMed] [Google Scholar]
- Horvath JC, Forte JD, Carter O, 2015. Quantitative review finds no evidence of cognitive effects in healthy populations from single-session transcranial direct current stimulation (tDCS). Brain Stimul. 8(3), 535–550. 10.1016/j.brs.2015.01.400 [DOI] [PubMed] [Google Scholar]
- Hoy KE, Bailey N, Arnold S, Windsor K, John J, Daskalakis ZJ, Fitzgerald PB, 2015. The effect of γ-tACS on working memory performance in healthy controls. Brain Cogn. 101, 51–56. 10.1016/j.bandc.2015.11.002 [DOI] [PubMed] [Google Scholar]
- Hoy KE, Emonson MRL, Arnold SL, Thomson RH, Daskalakis ZJ, Fitzgerald PB, 2013. Testing the limits: Investigating the effects of tDCS dose on working memory enhancement in healthy controls. Neuropsychologia 51, 1777–1784. 10.1016/j.neuropsychologia.2013.05.018 [DOI] [PubMed] [Google Scholar]
- Hussey EK, Fontes EB, Ward N, Westfall DR, Kao SC, Kramer AF, Hillman CH, 2020. Combined and isolated effects of acute exercise and brain stimulation on executive function in healthy young adults. J. Clin. Med 9(5), 1410. 10.3390/jcm9051410 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hussey EK, Ward N, Christianson K, Kramer AF, 2015. Language and memory improvements following tDCS of left lateral prefrontal cortex. PLoS ONE 10(11), e0141417. 10.1371/journal.pone.0141417 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jausovec N, Jausovec K, 2014. Increasing working memory capacity with theta transcranial alternating current stimulation (tACS). Biol. Psychol 96, 42–47. 10.1016/j.biopsycho.2013.11.006 [DOI] [PubMed] [Google Scholar]
- Jausovec N, Jausovec K, Pahor A, 2014. The influence of theta transcranial alternating current stimulation (tACS) on working memory storage and processing functions. Acta Psychhol. 146, 1–6. 10.1016/j.actpsy.2013.11.011 [DOI] [PubMed] [Google Scholar]
- Jeon SY, Han SJ, 2012. Improvement of the working memory and naming by transcranial direct current stimulation. Ann. Rehabil. Med 36(5), 585–595. 10.5535/arm.2012.36.5.585 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johnson L, Alekseichuk I, Krieg J, Doyle A, Yu Y, Vitek J, et al. , 2020. Dose-dependent effects of transcranial alternating current stimulation on spike timing in awake nonhuman primates. Sci Adv. 6(36), eaaz2747. 10.1126/sciadv.aaz2747 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jones KT, Gözenman F, Berryhill ME, 2015. The strategy and motivational influences on the beneficial effect of neurostimulation: A tDCS and fNIRS study. Neuroimage 105, 238–247. 10.1016/j.neuroimage.2014.11.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jongkees BJ, Loseva AA, Yavari FB, Nitsche MA, Colzato LS, 2019. The COMT Val158Met polymorphism does not modulate the after-effect of tDCS on working memory. Eur. J. Neurosci 49(2), 263–274. 10.1111/ejn.14261 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Joormann J, Gotlib IH, 2008. Updating the contents of working memory in depression: Interference from irrelevant negative material. J. Abnorm. Psychol 117(1), 182–192. 10.1037/0021-843X.117.1.182 [DOI] [PubMed] [Google Scholar]
- Ke Y, Wang N, Du J, Kong L, Liu S, Xu M, et al. , 2019. The effects of transcranial direct current stimulation (tDCS) on working memory training in healthy young adults. Front. Hum. Neurosci 13, 19. 10.3389/fnhum.2019.00019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Keeser D, Padberg F, Reisinger E, Pogarell O, Kirsch V, Palm U, et al. , 2011. Prefrontal direct current stimulation modulates resting EEG and event-related potentials in healthy subjects: A standardized low resolution tomography (sLORETA) study. Neuroimage, 55, 644–657. 10.1016/j.neuroimage.2010.12.004 [DOI] [PubMed] [Google Scholar]
- Kim JH, Kim DW, Chang WH, Kim YH, Kim K, Im CH, 2014. Inconsistent outcomes of transcranial direct current stimulation may originate from anatomical differences among individuals: Electric field simulation using individual MRI data. Neurosci. Lett 564, 6–10. 10.1016/j.neulet.2014.01.054 [DOI] [PubMed] [Google Scholar]
- Koshy SM, Wiesman AI, Spooner RK, Embury C, Rezich MT, Heinrichs-Graham E, Wilson TW, 2020. Multielectrode transcranial electrical stimulation of the left and right prefrontal cortices differentially impacts verbal working memory neural circuitry. Cereb. Cort 30(4), 2389–2400. 10.1093/cercor/bhz246 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kuo MF, Paulus W, Nitsche MA, 2014. Therapeutic effects of non-invasive brain stimulation with direct currents (tDCS) in neuropsychiatric diseases. NeuroImage, 85, 948–960. 10.1016/j.neuroimage.2013.05.117 [DOI] [PubMed] [Google Scholar]
- Laakso I, Tanaka S, Koyama S, De Santis V, Hirata A, 2015. Inter-subject variability in electric fields of motor cortical tDCS. Brain Stimul. 8(5), 906–913. 10.1016/j.brs.2015.05.002 [DOI] [PubMed] [Google Scholar]
- Laakso I, Tanaka S, Mikkonen M, Koyama S, Sadato N, Hirata A, 2016. Electric fields of motor and frontal tDCS in a standard brain space: A computer simulation study. NeuroImage 137, 140–151. 10.1016/j.neuroimage.2016.05.032 [DOI] [PubMed] [Google Scholar]
- Lally N, Nord CL, Walsh V, Roiser JP, 2013. Does excitatory fronto-extracerebral tDCS lead to improved working memory performance? F1000Research 2, 219. 10.12688/f1000research.2-219.v2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Looi CY, Duta M, Brem AK, Huber S, Nuerk HC, Kadosh RC, 2016. Combining brain stimulation and video game to promote long-term transfer of learning and cognitive enhancement. Sci. Rep 6, 22003. 10.1038/srep22003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lopez-Alonso V, Cheeran B, Rio-Rodriguez D, Fernandez-del-Olmo M, 2014. Inter-individual variability in response to non-invasive brain stimulation paradigms. Brain Stimul, 7(3), 372–380. 10.1016/j.brs.2014.02.004 [DOI] [PubMed] [Google Scholar]
- Lu H, Lam LCW, Ning Y, 2019. Scalp- to- cortex distance of left primary motor cortex and its computational head model: Implications for personalized neuromodulation. CNS Neurosci. Ther 25(11), 1270–1276. 10.1111/cns.13204 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lukasik KM, Lehtonen M, Salmi J, Meinzer M, Joutsa J, Laine M, 2018. No effects of stimulating the left ventrolateral prefrontal cortex with tDCS on verbal working memory updating. Front. Neurosci 11, 738. 10.3389/fnins.2017.00738 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Luque-Casado A, Fogelson N, Iglesias-Soler E, Fernandez-del-Olmo M, 2019. Exploring the effects of transcranial direct current stimulation over the prefrontal cortex on working memory: A cluster analysis approach. Behav. Brain Res 375, 112144. 10.1016/j.bbr.2019.112144 [DOI] [PubMed] [Google Scholar]
- Lycke C, Specht K, Ersland L, Hugdahl K, 2008. An fMRI study of phonological and spatial working memory using identical stimuli. Scand. J. Psychol 49(5), 393–401. 10.1111/j.1467-9450.2008.00672.x [DOI] [PubMed] [Google Scholar]
- Mancuso LE, Ilieva IP, Hamilton RH, Farah MJ, 2016. Does transcranial direct current stimulation improve healthy working memory?: A meta-analytic review. J. Cogn. Neurosci 28(8), 1063–1089. 10.1162/jocn_a_00956 [DOI] [PubMed] [Google Scholar]
- Marazziti D, Consoli G, Picchetti M, Carlini M, Faravelli L, 2010. Cognitive impairment in major depression. Eur. J. Pharmacol 626(1), 83–86. 10.1016/j.ejphar.2009.08.046 [DOI] [PubMed] [Google Scholar]
- Martin DM, Liu R, Alonzo A, Green M, Player MJ, Sachdev P, Loo CK, 2013. Can transcranial direct current stimulation enhance outcomes from cognitive training? A randomized controlled trial in healthy participants. Int. J. Neuropsychopharmacol 16, 1927–1936. 10.1017/S1461145713000539 [DOI] [PubMed] [Google Scholar]
- Marquand AF, Mourao-Miranda J, Brammer MJ, Cleare AJ, Fu CHY, 2008. Neuroanatomy of verbal working memory as a diagnostic biomarker for depression. Neuroreport 19(15), 1507–1511. 10.1097/WNR.0b013e328310425e [DOI] [PubMed] [Google Scholar]
- Meiron O, Lavidor M, 2013. Unilateral prefrontal direct current stimulation effects are modulated by working memory load and gender. Brain Stimul. 6(3), 440–447. 10.1016/j.brs.2012.05.014 [DOI] [PubMed] [Google Scholar]
- Miranda PC, Mekonnen A, Salvador R, Ruffini G, 2013. The electric field in the cortex during transcranial current stimulation. NeuroImage, 70, 48–58. 10.1016/j.neuroimage.2012.12.034 [DOI] [PubMed] [Google Scholar]
- Moher D, Liberati A, Tetzlaff J, Altman DG, 2009. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. BMJ. 339, b2535. 10.1136/bmj.b2535 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moreno ML, Vanderhasselt MA, Carvalho AF, Moffa AH, Lotufo PA, Bensenor IM, Brunoni AR, 2015. Effects of acute transcranial direct current stimulation in hot and cold working memory tasks in healthy and depressed subjects. Neurosci. Lett 591, 126–131. 10.1016/j.neulet.2015.02.036 [DOI] [PubMed] [Google Scholar]
- Mulquiney PG, Hoy KE, Daskalakis ZJ, Fitzgerald PB, 2011. Improving working memory: Exploring the effect of transcranial random noise stimulation and transcranial direct current stimulation on dorsolateral prefrontal cortex. Clin Neurophysiol. 122, 2384–2389. 10.1016/j.clinph.2011.05.009 [DOI] [PubMed] [Google Scholar]
- Murphy OW, Hoy KE, Wong D, Bailey NW, Fitzgerald PB, Segrave RA, 2020. Transcranial random noise stimulation is more effective than transcranial direct current stimulation for enhancing working memory in healthy individuals: Behavioral and electrophysiological evidence. Brain Stimul. 13(5), 1370–1380. 10.1016/j.brs.2020.07.001 [DOI] [PubMed] [Google Scholar]
- Mylius V, Jung M, Menzler K, Haag A, Khader PH, Oertel WH, et al. , 2012. Effects of transcranial direct current stimulation on pain perception and working memory. Eur. J. Pain 16, 974–982. 10.1002/j.1532-2149.2011.00105.x [DOI] [PubMed] [Google Scholar]
- Naka M, Matsuzawa D, Ishii D, Hamada H, Uchida T, Sugita K, et al. , 2018. Differential effects of high-definition transcranial direct current stimulation on verbal working memory performance according to sensory modality. Neurosci. Lett 687, 131–136. 10.1016/j.neulet.2018.09.047 [DOI] [PubMed] [Google Scholar]
- Nakao T, Nakagawa A, Nakatani E, Nabeyama M, Sanematsu H, Yoshiura T, et al. , 2009. Working memory dysfunction in obsessive–compulsive disorder: A neuropsychological and functional MRI study. J. Psychiatric Res 43(8), 784–791. 10.1016/j.jpsychires.2008.10.013 [DOI] [PubMed] [Google Scholar]
- Nee DE, Brown JW, Askren MK, Berman MG, Demiralp E, Krawitz A, Jonides J, 2013. A meta-analysis of executive components of working memory. Cereb. Cort 23(2), 264–282. 10.1093/cercor/bhs007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Neuling T, Rach S, Herrmann CS, 2013. Orchestrating neuronal networks: sustained after-effects of transcranial alternating current stimulation depend upon brain states. Front. Hum. Neurosci 7, 161. 10.3389/fnhum.2013.00161 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nikolin S, Loo CK, Bai S, Dokos S, Martin DM, 2015. Focalised stimulation using high definition transcranial direct current stimulation (HD-tDCS) to investigate declarative verbal learning and memory functioning. Neuroimage 117, 11–19. 10.1016/j.neuroimage.2015.05.019 [DOI] [PubMed] [Google Scholar]
- Nikolin S, Boonstra TW, Loo CK, Martin D, 2017. Combined effects of prefrontal transcranial direct current stimulation and a working memory task on heart rate variability. PLoS ONE 12(8), e0181833. 10.1371/journal.pone.0181833 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nikolin S, Martin D, Loo CK, Boonstra TW, 2018. Effects of TDCS dosage on working memory in healthy participants. Brain Stimul. 11(3), 518–527. 10.1016/j.brs.2018.01.003 [DOI] [PubMed] [Google Scholar]
- Nikolin S, Lauf S, Loo CK, Martin D, 2019. Effects of high-definition transcranial direct current stimulation (HD-tDCS) of the intraparietal sulcus and dorsolateral prefrontal cortex on working memory and divided attention. Front. Integr. Neurosci 12, 64. 10.3389/fnint.2018.00064 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nilsson J, Lebedev AV, Lövden M, 2015. No significant effect of prefrontal tDCS on working memory performance in older adults. Front. Aging Neurosci 7, 230. 10.3389/fnagi.2015.00230 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nissim NR, O’Shea A, Indahlastari A, Telles R, Richards L, Porges E, Cohen R, Woods AJ, 2019. Effects of in-scanner bilateral frontal tDCS on functional connectivity of the working memory network in older adults. Front. Aging Neurosci 11, 51, 10.3389/fnagi.2019.00051 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ohn SH, Park CI, Yoo WK, Ko MH, Choi KP, Kim GM, et al. , 2008. Time-dependent effect of transcranial direct current stimulation on the enhancement of working memory. Neuroreport 19(1), 43–47. 10.1097/WNR.0b013e3282f2adfd [DOI] [PubMed] [Google Scholar]
- Oliveira JF, Zanao TA, Valiengo L, Lotufo PA, Bensenor IM, Fregni F, Brunoni A, 2013. Acute working memory improvement after tDCS in antidepressant-free patients with major depressive disorder. Neurosci. Lett 537, 60–64. 10.1016/j.neulet.2013.01.023 [DOI] [PubMed] [Google Scholar]
- Opitz A, Paulus W, Will S, Antunes A, Thielscher A, 2015. Determinants of the electric field during transcranial direct current stimulation. Neuroimage, 109, 140–150. 10.1016/j.neuroimage.2015.01.033 [DOI] [PubMed] [Google Scholar]
- Opitz A, Yeagle E, Thielscher A, Schroeder C, Mehta AD, Milham MP, 2018. On the importance of precise electrode placement for targeted transcranial electric stimulation. Neuroimage 181, 560–567. 10.1016/j.neuroimage.2018.07.027 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Owen AM, Herrod NJ, Menon DK, Clark JC, Downey SPMJ, Carpenter TA, et al. , 1999. Redefining the functional organization of working memory processes within human lateral prefrontal cortex. Eur. J. Neurosci 11(2), 567–574. 10.1046/j.1460-9568.1999.00449.x [DOI] [PubMed] [Google Scholar]
- Papazova I, Strube W, Wienert A, Henning B, Schwippel T, Fallgatter AJ, et al. , 2020. Effects of 1 mA and 2 mA transcranial direct current stimulation on working memory performance in healthy participants. Conscious. Cogn 83, 102959. 10.1016/j.concog.2020.102959 [DOI] [PubMed] [Google Scholar]
- Petrides M, Alivisatos B, Frey S, 2002. Differential activation of the human orbital, mid-ventrolateral, and mid-dorsolateral prefrontal cortex during the processing of visual stimuli. Proc. Nat. Acad. Sci 99(8), 5649–5654. 10.1073/pnas.072092299 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Polania R, Nitsche MA, Ruff CC, 2018. Studying and modifying brain function with noninvasive brain stimulation. Nat. Neurosci 21, 174–187. 10.1038/s41593-017-0054-4 [DOI] [PubMed] [Google Scholar]
- Pope PA, Brenton JW, Miall RC, 2015. Task-specific facilitation of cognition by anodal transcranial direct current stimulation of the prefrontal cortex. Cereb. Cort 25(11), 4551–4558. 10.1093/cercor/bhv094 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rabipour S, Wu AD, Davidson PSR, Iacoboni M, 2018. Expectations may influence the effects of transcranial direct current stimulation. Neuropyschologia 119, 524–534. 10.1016/j.neuropsychologia.2018.09.005 [DOI] [PubMed] [Google Scholar]
- Ramaraju S, Roula MA, McCarthy PW, 2020. Transcranial direct current stimulation and working memory: Comparison of effect on learning shapes and English letters. PLoS ONE 15(7), e0222688. 10.1371/journal.pone.0222688 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reato D, Rahman A, Bikson M, Parra LC, 2013. Effects of weak transcranial alternating current stimulation on brain activity—a review of known mechanisms from animal studies. Front. Hum. Neurosci 7, 687. 10.3389/fnhum.2013.00687 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Richmond LL, Wolk D, Chein J, Olson IR, 2014. Transcranial direct current stimulation enhances verbal working memory training performance over time and near transfer outcomes. J. Cogn. Neurosci 26(11), 2443–2454. 10.1162/jocn_a_00657 [DOI] [PubMed] [Google Scholar]
- Ridding MC, Ziemann U, 2010. Determinants of the induction of cortical plasticity by non-invasive brain stimulation in healthy subjects. J. Physiol 588(13), 2291–2304. 10.1113/jphysiol.2010.190314 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Robison MK, McGuirk WP, Unsworth N, 2017. No evidence for enhancements to visual working memory with transcranial direct current stimulation to prefrontal or posterior parietal cortices. Behav. Neurosci, 131(4), 277–288. 10.1037/bne0000202 [DOI] [PubMed] [Google Scholar]
- Röhner F, Breitling C, Rufener KS, Heinze HJ, Hinrichs H, Krauel K, Sweeney-Reed CM, 2018. Modulation of working memory using transcranial electrical stimulation: A direct comparison between TACS and TDCS. Front. Neurosci 12, 761. 10.3389/fnins.2018.00761 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rosenberg MS, Adams DC, Gurevitch J, 2000. MetaWin: statistical software for meta-analysis version 2.0 Sunderland, Massachusetts: Sinauer Associates. [Google Scholar]
- Rosenthal R, 1979. The file drawer problem and tolerance for null results. Psychol. Bull 86(3), 638–641. 10.1037/0033-2909.86.3.638 [DOI] [Google Scholar]
- Salehinejad MA, Nejati V, Mosayebi-Samani M, Mohammadi A, Wischnewski M, Kuo MF, et al. , 2020. Transcranial direct current stimulation in ADHD: a systematic review of efficacy, safety, and protocol-induced electrical field modeling results. Neurosci. Bull 36, 1191–1212. 10.1007/s12264-020-00501-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Salehinejad MA, Rostami R, Ghanavati E, 2015. Transcranial direct current stimulation of dorsolateral prefrontal cortex in major depression: Improving visual working memory, reducing depressive symptoms. Neuroregulation 2(1), 37–49. 10.15540/nr.2.1.37 [DOI] [Google Scholar]
- Salehinejad MA, Wischnewski M, Nejati V, Vicario CM, Nitsche MA, 2019. Transcranial direct current stimulation in attention-deficit hyperactivity disorder: a meta-analysis of neuropsychological deficits. PLoS ONE 14(4), e0215095. 10.1371/journal.pone.0215095 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Saturnino GB, Madsen KH, Thielscher A, 2020. Optimizing the Electric Field Strength in Multiple Targets for Multichannel Transcranial Electric Stimulation. J. Neural Engineer, accepted article. 10.1088/1741-2552/abca15 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Saturnino GB, Siebner HR, Thielscher A, & Madsen KH, 2019. Accessibility of cortical regions to focal TES: Dependence on spatial position, safety, and practical constraints. NeuroImage, 203, 116183. 10.1016/j.neuroimage.2019.116183 [DOI] [PubMed] [Google Scholar]
- Schäfer T, Schwarz MA, 2019. The meaningfulness of effect sizes in psychological research: Differences between sub-disciplines and the impact of potential biases. Front. Psychol 10, 813. 10.3389/fpsyg.2019.00813 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schutter DJLG, Wischnewski M, 2016. A meta-analytic study of exogenous oscillatory electric potentials in neuroenhancement. Neuropsychologia 86, 110–118. 10.1016/j.neuropsychologia.2016.04.011 [DOI] [PubMed] [Google Scholar]
- Sharma G, Chowdhury SR, 2019. Enhancement in focality of non-invasive brain stimulation through high definition (hd) anodal transcranial direct current stimulation (tdcs) techniques. IEEE Internet Computing 2019, 1–5. 10.1109/CIBCB.2019.8791447 [DOI] [Google Scholar]
- Shires J, Carrasco C, Berryhill ME, 2020. No tDCS augmented working memory training benefit in undergraduates rewarded with course credit. Brain Stimul. 13(6), 1524–1526. 10.1016/j.brs.2020.08.015 [DOI] [PubMed] [Google Scholar]
- Soleimani G, Saviz M, Bikson M, Towhidkhah F, Kuplicki R, Paulus MP, Ekhtiari H, 2021. Group and individual level variations between symmetric and asymmetric DLPFC montages for tDCS over large scale brain network nodes. Sci. Rep 11, 1271. 10.1038/s41598-020-80279-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spaak E, Watanabe K, Funahashi S, Stokes MG, 2017. Stable and dynamic coding for working memory primate prefrontal cortex. J. Neurosci, 37(27), 6503–6516. 10.1523/JNEUROSCI.3364-16.2017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Splittgerber M, Salvador R, Brauer H, Breitling-Ziegler C, Prehn-Kristensen A, Krauel K, et al. , 2020. Individual baseline performance and electrode montage impact on the effects of anodal tDCS over the left dorsolateral prefrontal cortex. Front. Hum. Neurosci 14, 349. 10.3389/fnhum.2020.00349 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stern CE, Owen AM, Tracey I, Look RB, Rosen BR, Petrides M, 2000. Activity in ventrolateral and mid-dorsolateral prefrontal cortex during nonspatial visual working memory processing: Evidence from functional magnetic resonance imaging. Neuroimage, 11(5), 392–399. 10.1006/nimg.2000.0569 [DOI] [PubMed] [Google Scholar]
- Sterne JAC, Sutton AJ, Ioannidis JPA, Terrin N, Jones DR, Lau J, et al. , 2011. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 343, d4002. 10.1136/bmj.d4002 [DOI] [PubMed] [Google Scholar]
- Stokes MG, 2015. ‘Activity-silent’ working memory in prefrontal cortex: a dynamic coding framework. Trends Cogn. Sci 19(7), 394–405. 10.1016/j.tics.2015.05.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Talsma LJ, Kroese HA, Slagter HA, 2017. Boosting cognition: Effects of multiple-session transcranial direct current stimulation on working memory. J. Cogn. Neurosci 29(4), 755–768. 10.1162/jocn_a_01077 [DOI] [PubMed] [Google Scholar]
- Talsma LJ, Broekhuizen JA, Huisman J, Slagter HA, 2018. No evidence that baseline prefrontal cortical excitability (3T-MRS) predicts the effects of prefrontal tDCS on WM performance. Front. Neurosci 12, 481. 10.3389/fnins.2018.00481 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Teo F, Daskalakis ZJ, Fitzgerald PB, 2011. Investigating the role of current strength in tDCS modulation of working memory performance in healthy control. Front. Psychiatry 2, 45. 10.3389/fpsyt.2011.00045 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thielscher A, Antunes A and Saturnino GB, 2015. Field modeling for transcranial magnetic stimulation: a useful tool to understand the physiological effects of TMS? IEEE EMBS 2015, Milano, Italy. 10.1109/EMBC.2015.7318340 [DOI] [PubMed] [Google Scholar]
- Trumbo MC, Matzen LE, Coffman BA, Hunter MA, Jones AP, Robinson CSH, Clark VP, 2016. Enhanced working memory performance via transcranial direct current stimulation: The possibility of near and far transfer. Neuropsychologia 93, 85–96. 10.1016/j.neuropsychologia.2016.10.011 [DOI] [PubMed] [Google Scholar]
- Valera EM, Faraone SV, Biederman J, Poldrack RA, Seidman LJ, 2005. Functional neuroanatomy of working memory in adults with attention-deficit/hyperactivity disorder. Biol. Psychiatry 57(5), 439–447. 10.1016/j.biopsych.2004.11.034 [DOI] [PubMed] [Google Scholar]
- Van Essen DC, Smith SM, Barch DM, Behrens TEJ, Yacoub E, Ugurbil K, and for the WU-minn HCP Consortium, 2013. The WU-Minn Human Connectome Project: An overview. NeuroImage 80, 62–79. 10.1016/j.neuroimage.2013.05.041 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Veltman DJ, Rombouts SARB, Dolan RJ, 2003. Maintenance versus manipulation in verbal working memory revisited: an fMRI study. Neuroimage 18(2), 247–256. 10.1016/S1053-8119(02)00049-6 [DOI] [PubMed] [Google Scholar]
- Villamar MF, Volz MS, Bikson M, Datta A, DaSilva AF, Fregni F, 2013. Technique and Considerations in the Use of 4×1 Ring High-definition Transcranial Direct Current Stimulation (HD-tDCS). J. Vis. Exp 77, 50309. 10.3791/50309 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang J, Tian J, Hao R, Tian L, Liu Q, 2018. Transcranial direct current stimulation over the right DLPFC selectively modulates subprocesses in working memory. PeerJ, 6, e4906. 10.7717/peerj.4906 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang N, Ke Y, Du J, Liu W, Kong L, Zhao X, et al. , 2019. High-definition transcranial direct current stimulation (HD-tDCS) enhances working memory training. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc 2019. 329–332. 10.1109/EMBC.2019.8856976 [DOI] [PubMed] [Google Scholar]
- Weintraub-Brevda RR, Chua EF, 2019. Transcranial direct current stimulation over the right and left VLPFC leads to differential effects on working and episodic memory. Brain Cogn. 132, 98–107. 10.1016/j.bandc.2019.03.005 [DOI] [PubMed] [Google Scholar]
- Windhoff M, Opitz A, Thielscher A, 2013. Electric field calculations in brain stimulation based on finite elements: An optimized processing pipeline for the generation and usage of accurate individual head models. Hum. Brain Map 34(4), 923–935. 10.1002/hbm.21479 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wischnewski M, Engelhardt M, Salehinejad MA, Schutter DJLG, Kuo MF, Nitsche MA (2019a). NMDA receptor-mediated motor cortex plasticity after 20 Hz transcranial alternating current stimulation. Cereb. Cort 29(7), 2924–2931. 10.1093/cercor/bhy160 [DOI] [PubMed] [Google Scholar]
- Wischnewski M, Schutter DJLG, Nitsche MA, 2019b. Effects of beta-tACS on corticospinal excitability: A meta-analysis. Brain Stim. 12(6), 1381–1389. 10.1016/j.brs.2019.07.023 [DOI] [PubMed] [Google Scholar]
- Wu YJ, Tseng P, Chang CF, Pai MC, Hsu KS, Lin CC, Juan CH, 2014. Modulation the interference effect on spatial working memory by applying transcranial direct current stimulation over the right dorsolateral prefrontal cortex. Brain Cogn. 91, 87–94. 10.1016/j.bandc.2014.09.002 [DOI] [PubMed] [Google Scholar]
- Zaehle T, Sandmann P, Thorne JD, Jäncke L, Herrmann CS, 2011. Transcranial direct current stimulation of the prefrontal cortex modulates working memory performance: Combined behavioral and electrophysiological evidence. BMC Neurosci. 12, 2. 10.1186/1471-2202-12-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
