Abstract
Transcranial direct current stimulation (tDCS) of the left dorsolateral prefrontal cortex (DLPFC) has been shown to promote working memory (WM), however, its efficacy against time-on-task-related performance decline and associated cognitive fatigue remains uncertain. This study examined the impact of anodal tDCS of the left DLPFC on performance during a fatiguing visuospatial WM test. We adopted a repeated measures design, where 32 healthy adults (16 female), underwent anodal, control and sham tDCS on separate days. They completed an hour long two-back test, with stimulation intensity, onset, and duration set at 1 mA, at the 20th minute for 10 minutes respectively. Task performance, subjective responses, and heart rate variability (HRV) were captured during the experiment. Anodal tDCS substantially improved WM relative to sham tDCS and control in both sexes. These benefits lasted beyond the stimulation interval, and were unique across performance measures. However, no perceptual changes in subjective effort or fatigue levels were noted between conditions, although participants reported greater discomfort during stimulation. While mood and sleepiness changed with time-on-task, reflecting fatigue, these were largely similar across conditions. HRV increased under anodal tDCS and control, and plateaued under sham tDCS. We found that short duration anodal tDCS at 1 mA was an effective countermeasure to time-on-task deficits during a visuospatial two-back task, with enhancement and preservation of WM capacity. However, these improvements were not available at a perceptual level. Therefore, wider investigations are necessary to determine “how” such solutions will be operationalized in the field, especially within human-centered systems.
Subject terms: Neuroscience, Psychology
Introduction
Fatigue in the emergency response (ER) domain has been typified as an accepted hazard of the job, with extended work hours, cognitive and physical demands, and sleep deprivation1. However, its impact on worker health and safety demands wider attention on contributory neurophysiological mechanisms and countermeasures. Performance decrements due to fatigue endanger not only the personnel involved, but also the public they serve2. Firefighters and emergency medical technicians, individuals in occupations with high fatigue-risk, are required to multitask using information from concurrent visual and auditory sources, where their working memory (WM) is frequently a key determinant of task success3. This ability can be significantly undermined in the field, for example, wild-land firefighters report sleep deficits exceeding hours each week, which severely degrades their situational awareness and decision-making4. Schmiechel et al. found that the mere perception of fatigue can impede executive function5. Therefore, multimodal solutions to augment or otherwise preserve WM, beyond the subjective experience of fatigue, would bring great value to the operations of all first responders.
Neuroimaging studies have shown that Brodmann areas 46 and 9, i.e. primarily the left dorsolateral prefrontal cortex (DLPFC)6, are most associated with WM and related executive function, and therefore, this region has been a focal point for targeted neuromodulation7. Transcranial direct current stimulation (tDCS), a non-invasive brain stimulation technique, was shown to improve cortical excitability in those regions and in turn promote WM in healthy adults6. Studies mainly report a polarity-dependent effect of tDCS on WM, where anodal tDCS of the left DLPFC with intensity mA enabled performance enhancements across multiple WM tests8–11. However, recent meta-analyses identified inconsistencies in the effectiveness of tDCS12–14 owing to small effect sizes, heterogeneous stimulation parameters (e.g., timing, intensity, or duration) and study designs (e.g. repeated vs. between subjects design) resulting in variability of the observed impacts on accuracy, response time and other WM performance measures. Some evidence also questions the efficacy of sham tDCS as a control paradigm due to its effect on behavioral and physiological responses15. These discrepancies demand wider investigations into the effectiveness of tDCS with equity in participants and their experiences.
Of particular interest to us is the intersection of WM, cognitive fatigue, and neurostimulation. In examining the efficacy of tDCS as a fatigue countermeasure, McIntire et al.16 demonstrated that anodal tDCS for 30 min at 2 mA resulted in improvements on attentional accuracy during vigilance tasks beyond the effects of sleep deprivation. However, they found no direct effect of stimulation on WM during those experiments. Similarly, Borragan et al. report that tDCS at 1.5 mA for 25 min did not counteract the behavioral influence of cognitive fatigue during a sustained WM paradigm17. Therefore, while the benefits of stimulation toward vigilance or attention capacity during fatiguing tasks have been reported16, evidence for the same effect on WM remains lacking. Hence, research that evaluates the effectiveness of dosage, timing, and duration in task contexts beyond those previously tested is needed, as these factors drive subsequent use and acceptance in time-sensitive field applications such as ER.
In our previous investigation, we explored the role of tDCS on sustained attention during a prolonged (60 minute) psychomotor vigilance test (PVT)18, where we relied on the PVT to serve both as a fatigue induction paradigm and as a measure of attention capacity—informed by related efforts that consider the influence of time-on-task and its impact on sustained attention19. The time-on-task effect is analogous to fatiguing protocols in the literature20,21, where sustained cognitive demand at fixed or varying workload levels is shown to elicit increases in subjective and objective fatigue indices. We found that anodal tDCS at 1 mA for 10 minutes enhanced vigilance capacity on the PVT beyond this time-on-task effect, while response time and accuracy were both seen to decrease otherwise. These findings were encouraging as they addressed the immediacy demands that are characteristic of the ER domain by showing the potential benefits of online tDCS on attention networks notwithstanding task demands that were present and continuing leading into the stimulation interval. Furthermore, the efficacy of a relatively short stimulation interval (10 min) at low current intensity (1 mA) is particularly relevant toward fieldability requirements in emergency response, where work conditions demand unobtrusive and expeditious modes of intervention. In the current study, we build on this investigation to consider the role of stimulation on time-on-task related deficits during a WM exercise. Under sustained periods of cognitive workload, human WM is compromised by time-on-task related fatigue22. This fatigue can manifest as an increase in response time, a decrease in accuracy, an increase in self-reported fatigue scores or a decrease in motivation to continue task performance22,23. Previous investigations have successfully validated the use of a two-back protocol as a fatigue induction paradigm, specifically the work by Shigihara and Tanaka et al.24,25 employed a two-back test for 30 minutes to induce fatigue in its participant pool before relying on a trail-making task to discern the effects of fatigue on cognition. The choice of a two-back task also affords the right balance between task workload and fatigability unlike the one-back or three-back protocols that are either too easy or challenging to the point of rapid saturation, an observation from our pilot efforts. Therefore, we co-opt this tested two-back protocol in our present investigation, but consider a singular task for 60 minutes to both induce fatigue and to evaluate WM across stimulation conditions.
We also espouse the vision of building a closed-loop solution for non-invasive neuromodulation in ER applications18. Current efforts with the use of electroencephalography show promise toward prescient state recognition26,27, however they remain impractical for field-use. Through this work we investigate the utility of heart rate variability (HRV) as an indicator of WM states across stimulation conditions. Prior studies have successfully demonstrated performance prediction when relying on HRV28, however the impact of tDCS and the robustness of these prediction paradigms remain unclear29. The neurovisceral integration model (NVIM) explores functional associations between cardiac vagal activity, and activation in the prefrontal cortex30, and could expand how we utilize HRV as a neurocognitive indicator. Therefore, the present study is focused on understanding the influence of anodal tDCS on WM performance during the fatiguing visuospatial two-back task. We consider a repeated measures, balanced experiment design with three conditions—anodal tDCS, sham tDCS, and control towards this goal. We hypothesize that anodal tDCS over the left DLPFC will prove an effective countermeasure to fatigue-related declines in WM capacity. Presently, we operationalize fatigue as a trait driven by the time-on-task effect and we characterize it by relying on a combination subjective self-reports and WM performance. Further, we look toward HRV as a means to understand changes in cognitive task performance using the NVIM.
Methods
Experiment design and methodology
This study employed a repeated-measures, counterbalanced Latin square design31, with participants returning on separate days to complete a working memory exercise under three distinct conditions—control, anodal or sham tDCS. Participants were cast into three sex-balanced cohorts and the order in which each cohort was exposed to the treatment condition was based on the Latin square. Each session began with informed consent followed by subjective questionnaires on their mood (Profile of Mood States; POMS32) and sleepiness (Karolinska Sleepiness Scale; KSS33) levels (see Fig. 1a); before their first sessions participants also responded to a background questionnaire. The sessions lasted minutes each, and were divided into 12 blocks during which time participants completed a WM task. During anodal and sham tDCS conditions a researcher administered interventions at the start of the fifth block, i.e. approximately 20 minutes from the start of the session, while remaining outside the participant’s field of view. Prior investigations on performance deficits due to the time-on-task effect consider 20–30 min as the ideal window for fatigue onset19,25, and it is our goal to explore potential opportunities for intervention around this interval. Furthermore, participants were blinded to the stimulation condition (sham or anodal), but were aware of control sessions due to the absence of stimulation peripherals. Between each block, participants responded to a subjective questionnaire related to their levels of fatigue, effort and perceived discomfort, they were instructed to complete this as quickly as possible. The average block transition time was s. In addition, to reduce any anticipatory bias, participants were not informed of the precise duration of each block or experiment session.
Participants
Fifty four participants were recruited for this study, only 32 (16 female) among them completed all three experiment sessions due to the constraints of the pandemic, i.e. 96 sessions across all treatment variables. The median age was years. All participants were neurotypical and reported no adverse reaction history to tDCS, or treatments for neuropsychiatric and brain-related disorders. 29 out of the 32 participants in this study reported getting at least 6 hours of sleep in the days preceding each experiment session, with a median sleep quality rating of 7 on a ten point scale, where 0 indicated a state of “severe exhaustion” due to lack of sleep, and 10 indicated a state of being “extremely well rested”. Roughly (N = 19) of our participants reported a daily activity level of steps, with 3 reporting activity levels in excess of 10000 steps and the remaining below 4000. Participants reported a median score of 7 on a 10 point scale, with regards to their level of motivation to participate in the study, where 0 indicated “absolutely no motivation” to proceed, and 10 being “extremely motivated”. In addition, during recruitment, participants were subject to a list of exclusion criteria34 that included past neurological disorders, use of over the counter medication and caffeine habits. All experimental procedures were approved by Texas A&M University’s Institutional Review Board (IRB2019-1591DCR), and proceeded in accordance with a strict infection control plan and the Ethics Code of the American Psychological Association. Participants provided written informed consent before the start of each experiment and were reimbursed for their time.
Working memory task
Participants were subject to an hour long visuospatial two-back WM test, while seated in front of a personal computer and provided a keyboard to record their responses. On the task, they tracked the position of a circle within a grid, if the position of the circle matched the one from two steps prior, they responded by pushing the space-bar (see Fig. 1b). The inter-stimulus-interval was 1 s with a persistence time of 900 ms. The two-back match probability () was 0.6; the interface served a fixed number (N = 94) of randomly timed match events within each 5 minute block. Before starting their first session, participants were introduced to the task and allowed to practice for a minimum of 5 minutes under a training mode to ensure that they understood task instructions. In this mode, the interface provided textual feedback on their response time and correctness (RED = incorrect, GREEN = correct). During the actual experiments this feedback was withheld; participants began each session on self-indicating their willingness to proceed after the practice period. The interface recorded every key-press and stimulus match event presented to the participant along with a time-stamp, response correctness tag (hit, miss, or false alarm), and response time (in ms).
Transcranial direct current stimulation
A tDCS device (Soterix Medical, NY, USA) was used in this study. The primary region of interest for WM was the left DLPFC, i.e. anode over F3 according to the 10-10 EEG system, with the right supra-orbital (r-SO) region or FP2 used as the reference location (see Fig. 1c)35. Participants were instrumented with stimulation peripherals during anodal and sham tDCS conditions only. Before each session participants were acquainted to the sensation of the stimulus. The current intensity was set to 1 mA, and the current density was . Under anodal tDCS, the stimulation duration was 10 min at set point (1 mA); under sham tDCS, there was a ramp to the set point followed by a ramp to zero, lasting a total duration of s. The stimulation onset time was the same for both conditions—at the start of the fifth block, minutes from the start of each session. Stimulation onset time and condition were withheld from participants.
Metrics
Working memory performance
Three performance measures, namely accuracy, specificity, and sensitivity, were used to assess task performance on the WM test employed in this study. Table 1 presents a description of each measure. For analysis, the data was grouped into five phases I (baseline), II, III (stimulation), IV and V (terminal), such that phase I to IV consisted of two blocks each, and V was made of three blocks, with each block lasting 5 minutes. This phase resolution was adopted—(1) to ensure that the two-block stimulation phase (i.e. blocks 5, 6 in phase III) was preserved uniquely in our comparisons, while ensuring block integrity across all phases; and (2) since block 12 was excluded from our analyses due to a self-reported anticipation-bias, where participants realized that the experiment was near its end (e.g. by counting the number of blocks) and returned to a state of alertness.
Table 1.
Performance measure | Description |
---|---|
Accuracy | |
Sensitivity | (TP)/(P) |
Specificity | (TN)/(N) |
Response delay (ms) | Time between stimulus and key-press |
TP = True Positives; P = all Positive or response selection events.
TN = True Negatives; N = all Negative or response inhibition events.
Heart rate variability
Cardiac electrical activity was obtained from a chest-based electrocardiogram (ECG) probe and amplifier interface at 128 Hz (Actiheart 4, CamNTech, Inc., UK). The electrodes were positioned at the base of the sternum and over the left pectoralis minor muscle. The raw ECG signal was filtered for motion artifacts36, and corrected for ectopics with polynomial interpolation37. Subsequently, a peak detection algorithm was used to isolate the R peaks of the ECG signal38. The time between successive R–R peaks, i.e. the inter-beat-interval (IBI), was then derived from the processed peak signals. For subsequent analyses, we derived two representative statistics for every 5 min window in the raw IBI data, one in the time domain (RMSSD) and another in the frequency domain (LF-power; see Table 2). The measures were normalized across all three sessions, for each individual, before statistical analyses.
Table 2.
HRV measure | Description |
---|---|
RMSSD | Root Mean Square of the Sum of Successive inter-beat interval (IBI) Differences |
LF | Power density of the Low Frequency (0.04–0.15 Hz) component in the IBI spectrum |
Subjective responses
Participants were subject to three one-point subjective questionnaires related to their levels of fatigue, expended effort and perceived discomfort during the brief transition interval ( s) between each 5 minute experiment block. Participants rated each subjective attribute on a 10-point scale, where a score of 1 was “low or minimal”, and a score of 10 was rated “extreme or unbearable.” Besides the block transition questionnaires, participants were also subject to the POMS and KSS surveys before (PRE) and after (POST) each experiment session. We used an abridged version of the POMS survey with 39 questions across six emotive categories—tension-anxiety, depression-rejection, anger-hostility, vigor-activity, fatigue-inertia, and confusion-bewilderment32. Participants qualified each emotion on a 5-pt scale with 0 being “not at all”, and 4 being “extremely.” The score across all descriptors in a category was summed to generate a factor score; and this factor score was used to generate a composite mood disturbance score. The KSS reflected participant sleepiness levels ranging from 1 meaning “Extremely Alert” to 10 meaning “Extremely sleepy, can’t keep awake”.
Statistical analysis
The primary goal of the statistical analysis in this investigation was to explore the influence of experiment condition on performance, physiological and subjective responses at different time points (phase), and across both sexes during the WM exercise. Independent analysis techniques were applied for each dependent measure due to constraints in the data, but a common time scale was used across performance, HRV, and inter-block subjective responses, where the data was grouped into five phases. For the POMS and KSS, statistical comparisons were drawn between the PRE- and POST-experiment reports across each condition. Bonferroni corrections were applied where relevant to set the significance level at an appropriate threshold for multiple comparisons. For purposes of clarity, data in the figures are illustrated using the mean value and the standard error of the mean (S.E.M.); all graphs were created using Matplotlib 3.4.239.
WM performance measures were not normally distributed, we relied on the non-parametric Friedman’s test to assess the effects of condition and sex (male, female) in each phase. Values that were more than three standard deviations from the mean were labeled outliers and excluded prior to analysis. Kendall’s W was used to determine the effect size. Significant outcomes on the Friedman’s test were then evaluated with pairwise Wilcoxon signed-rank tests. The HRV metrics introduced in Table 2 agreed with normality and sphericity constraints of the repeated measures ANOVA. Therefore, we performed a three-way repeated measures ANOVA to test the main and interaction effects of condition, phase, and sex on each metric. All two way interactions were analyzed to assess simple main effects and simple pairwise comparisons through t-tests. In addition, we compared the baseline-subtracted median accuracy scores between cohorts using a Kruskal-Wallis one-way analysis of variance test, and found no significant difference between them in any phase or condition (H-statistic ; all p values), suggesting a balanced distribution of WM capacities across cohorts. Subjective inter-block responses were not normally distributed, and therefore analyzed using a similar approach to that on performance data. Analyses on the PRE- and POST-experiment mood and sleepiness surveys relied on simple paired t-tests. Where relevant, normality was assessed using the Shapiro-Wilk’s test, sphericity using Mauchly’s test for sphericity, and the homogeneity of variance among participants using the Levene test. All statistical analyses were performed in R using the rstatix and tidyverse packages.
Results
Working memory performance
During baseline, i.e. phase I and through phase II, there was no effect of condition on any of the performance measures (all p values ). During stimulation and beyond, i.e. phase III to V, a significant effect of condition was observed on all three metrics (all ). Post-hoc analyses revealed that during phases III, IV and V, all measures of performance were significantly better under anodal tDCS relative to sham tDCS or control (all ). A main effect of time was observed across all conditions for the sensitivity and accuracy measures. For specificity, this was true only under control and sham tDCS (all ). Overall, we note a decreasing trend in accuracy under sham tDCS and control. This decrease began from phase II, followed by a marginal improvement from phase III to IV, before declining further in phase V (all ). Under anodal tDCS, we note an improvement in accuracy from phase II to III, and a gradual decrease across phases III and V (all ). Sensitivity under anodal tDCS exhibits a trend similar to accuracy across phase II and V (all ). Under sham tDCS and control, sensitivity remained unaltered between phase I and III and phase I to IV respectively (all ). However, in both conditions, we observed a decrease in the terminal phase (all ). Specificity under sham tDCS and control was seen to improve in baseline and decrease from phase II to III, followed by contrasting trends across phase III and V (all ; see Fig. 2). No effect of sex was found on any condition or time variable (all ).
Heart rate variability measures
No effect of sex was found on any HRV measure considered (all ). We found a significant main effect of time on the RMSSD values across all conditions (all . Post-hoc comparisons revealed an increase in RMSSD across phase I and II under each condition (all ). Under anodal tDCS, this increase in RMSSD was seen to persist until phase IV, followed by a plateau in phase V (all ). Under sham tDCS, we observed that RMSSD remained relatively unchanged beyond phase II (all ). Under control, we note an increasing trend in RMSSD, with statistically significant differences between phase III and IV, and phase IV and V (all ). A main effect of condition was observed (), where in phases III and IV, we found that RMSSD under the anodal condition was significantly higher than that under control or sham tDCS (). For the LF-power measure, a significant main effect of time was apparent in all three conditions (all ). Post-hoc comparisons revealed an increase in LF power from phase I to II in all conditions (all ). This increasing trend persisted under control and anodal tDCS until phase IV (all ). Beyond phase IV, LF power under anodal tDCS was found to decrease in the terminal phase (), while remaining unchanged under the control condition (). Under sham tDCS LF-power was found to remain unchanged from phase II to IV (all ), however in the terminal phase LF-power was elevated (); see Fig. 3.
Subjective responses
No effect of condition was found across the subjective dimensions of effort, and fatigue (all ). A marginal effect of condition was evident for the discomfort measure where participants reported higher discomfort under sham, and anodal tDCS conditions relative to control during the stimulation interval, i.e. phase III (; see Fig. 4). A significant effect of time was observed across all three conditions for the discomfort and fatigue measures (all ), with participants reporting increased perceptions of fatigue and discomfort over time (all ). On the effort scores, a significant effect of time was reported only under the anodal tDCS condition (p= ). Post-hoc analyses revealed a marginal decrease of effort scores in phase III relative to phase I under this condition (). No effect of sex was found across the subjective responses (all ). Furthermore, a significant difference was found in the PRE- and POST- mood disturbance and sleepiness scores across all conditions (all ), with a mood disturbance decrement of points and sleepiness increment of points after the completion of each session. No effect of sex or condition was evident for either measure (all ; see Fig. 5a, b).
Power analysis
Thirty two participants completed this study (16 female), i.e. 96 sessions across all treatment variables. We employed a repeated measures design where participants were cast into three sex-balanced cohorts (10, 10, and 12) with the order in which they were exposed to each treatment condition (anodal, control or sham) counterbalanced through a Latin square. A power analysis was conducted to verify if our experiment had sufficient power to detect the effect sizes found significant in prior literature when employing a similar WM test, experiment design and stimulation protocol ()40. Sample size estimation for a repeated measures ANOVA at a power level of 0.8, an error probability of 0.05 and partial eta-squared () of 0.3 using the G*Power software41 suite revealed that a total sample size of 15 was required to test our hypothesis for the desired effect size. Given that we rely on non-parametric tests for significance in a subset of our variables, a rule of thumb42 increases the required sample size to 18 for the desired significance; 32 participants completed our experiments.
Discussion
The present study explores the role of anodal tDCS as a countermeasure to the time-on-task (TOT) effect during a fatiguing visuospatial WM exercise. The TOT effect, we hypothesized, would result in decreasing WM capacity and an increase in the perceptions of fatigue when individuals are engaged in tasks with sustained cognitive demand for extended periods of time. For example, in the work by Mockel et al.20, on a 3 hour long Simon task43, perceptions of fatigue, and performance levels were shown to progressively deteriorate within the first hour of task and further so with time. Therefore, in some ways, the TOT effect is analogous to the human fatigue response, although the timescales for typical fatigue experiments are longer. Previous efforts have established the role of stimulation as a fatigue countermeasure for attention and response inhibition when relying on tasks relevant to those constructs, e.g. Go/No-Go tests, the Mackworth clock test, etc.16,44, indeed, investigations have also shown the efficacy of tDCS in improving WM in other conditions45,46. However, evidence that supports the use of tDCS as a countermeasure for TOT effects on WM remains unclear, in fact, antecedent results show a lack of improvement in WM capacity under fatiguing conditions with intervention at different current intensities and duration16,17. While the modes of fatigue onset remain disparate across these results, informed by prior work related to TOT-fatigue24,25, we employed a visuospatial two-back task to serve as both a fatigue induction mechanism and as a tool to evaluate WM. We compared performance, subjective and physiological responses, the influence of sex as a factor, and the effects of stimulation through a single-blind, repeated measures experiment, counterbalanced for learning across the three treatment conditions.
In both sexes, we found that anodal tDCS improved WM performance, beyond TOT-driven deficits that were otherwise evident across all performance measures (see Fig. 2). These improvements were found to last beyond the stimulation interval and enabled distinct changes that were unique to each performance measure for e.g., sensitivity improved under stimulation while specificity was maintained. However, no significant perceptual differences in self-reported effort or fatigue scores were noted between conditions. In general, participants indicated a marginal decrease in effort-scores under anodal tDCS and greater levels of discomfort during stimulation, as expected. Fatigue and discomfort reports were found to increase in a condition-agnostic manner over the time-course of the experiment, consistent with our expectations of the TOT effect, however, perceived effort remained similar throughout the hour long experiment, indicating participant motivation to stay on task. While mood and sleepiness changed with time, they were not significantly influenced by the condition variable.
The visuospatial two-back test, in its protracted format, demands both WM and sustained attention47. The central executive48 is responsible for encoding and updating an internal WM buffer, recognizing match events, and priming task-relevant actions. The brain regions essential to this activity include the prefrontal, motor, and visual cortices49. These areas enable substantial behavioral adaptation, attention or response inhibition, and learning during WM exercises50,51. However, with time-on-task, individuals invariably feel fatigued or otherwise depleted19. The onset of TOT-fatigue is marked by a decrease in neural activity across regions responsible for maintaining task-related behaviors, that are preempted by an increase in activation in regions peripheral to those networks52. These neurocognitive changes are supported by subjective fatigue scores, typically self-reported, or indirectly referenced from performance decrements53; in our protocol we rely on both modalities to operationalize TOT-fatigue. As reported, we found that subjective fatigue scores increased with time while PRE-POST surveys showed worsening mood after the completion of the experiment (see Fig. 5a, b). Specifically, a substantial and statistically significant increase was found in the fatigue-inertia emotive category (see Fig. 5c). According to the work by Schwartz et al.54, the minimally important clinically-relevant difference (MICD) indicating fatigue on the POMS survey was 5.6 points, roughly 1.1 points for each category, and the MICD on a 1-pt fatigue questionnaire, similar to the one used in this investigation, was 2.4. In our observations, changes in the POMS mood disturbance scores, the POMS fatigue-inertia scores and the inter-block 1-pt fatigue responses exceeded these thresholds with a mean decrement of points, and increments of and points respectively, signaling the negative influence of sustained task performance on fatigue perception and reaffirming our TOT-fatigue hypothesis. Furthermore, this change was also reflected in performance behaviors as participants displayed a reduction in accuracy, sensitivity and specificity during both control and sham tDCS conditions beyond phase II, i.e. roughly 20 min into the experiment (see Fig. 2). Therefore, we reason that the observed changes in participant behaviors are driven by TOT-fatigue.
In light of the above evidence, the key finding in our work was affirmation that anodal tDCS at 1 mA for 10 min improved WM beyond TOT deficits. This improvement was seen both as the enhancement of WM capacity relative to baseline (accuracy, sensitivity), and as the preservation of performance levels over time (specificity; see Fig. 2). In addition, the effects were both concurrent and beyond transient, lasting for up to 20 min after the stimulation interval. Furthermore, we observed these changes in an experiment protocol, where intervention was provided after 20 min of sustained cognitive demand, which is noteworthy given mixed evidence thus far from studies that considered the online effects of tDCS on WM and contradictory observations of its effect on fatigue13,14. Furthermore, earlier investigations with offline or online stimulation for longer durations and at current intensities greater than 1 mA reported no positive effect on WM under fatiguing or fatigued conditions16,17. Additionally, we found no improvements in mood and sleepiness due to stimulation, contrary to some prior observations. Besides differences in the format of the WM task or stimulation parameters, we believe differences in the fatigue induction paradigm could be responsible for some of these divergent observations. For e.g., McIntire et al.16 explored fatigue driven by extended wakefulness, while our protocol demanded sustained attention for min. Therefore, the nature of fatigue on the task is a factor to consider in future investigations.
Curiously, we note that although performance levels improved under anodal tDCS, changes in the level of perceived effort and fatigue remained similar across conditions (see Fig. 4). A recurrent hypothesis in this domain attributes cognitive enhancements enabled by tDCS to changes in neural efficiency55, however subjective reports indicate that these “benefits” are mostly imperceptible, which demands consideration on how these intervention modes will be operationalized within human-centered systems. In addition, the self-reported fatigue scores appeared in contrast to those seen in the motor domain, where tDCS was shown to alleviate levels of perceived fatigue56,57. The reasons for this disparity are perhaps related to the fundamentally distinct neurocognitive footprint of muscular and cognitive fatigue58, regardless, larger studies with concurrent neuroimaging are necessary to unpack the neural mechanisms that underlie these distinctions, which remains the focus of our future efforts.
On performance improvements under anodal tDCS, we found that stimulation did not produce the same effect on sensitivity and specificity measures. During sham tDCS and control we discovered that sensitivity remained unchanged until the terminal phase, while specificity decreased beginning from phase III. Secondly, under anodal tDCS, sensitivity increased concomitant with stimulation, while specificity was maintained throughout the 60 min task. It is likely that these distinctions are due to the fundamental differences in the behaviors these measures capture. Sensitivity identifies response selection, in this context, it characterizes event recognition and the commission of a prepotent motor response, while specificity identifies response inhibition and reflects the ability to withhold motor impulses59. Bender et al. demonstrated that these are fundamentally distinct cognitive operations governed by functionally and structurally independent brain regions60, which may explain some of the observed differences. Studies also identify distinct cortical networks that underlie these processes, e.g. Rowe et al. showed the central role of frontoparietal networks, including the DLPFC, in response selection both when associated with WM and other tasks of willed action61; while others recognize the inferior frontal gyri (IFG), parieto-temporal junction, and supplementary motor areas as those essential toward inhibitory behaviors62. Filmer et al.63, when using similar stimulation parameters, reported augmentation in response selection during anodal tDCS of the left lateral prefrontal cortex, while other efforts point to the role of the right IFG in enhancing task-relevant response inhibition under tDCS64. Therefore, we reason that the non-focal nature of tDCS driven by the electrode size, current intensity and current density may be contributing to the differential impacts on response selection or inhibition behaviors observed in our investigation. Future investigations into the role of fatigue or time-on-task on these specific cognitive processes are necessary to shed light on the precise nature of their response and receptivity to stimulation.
HRV indexes the interaction between the central autonomic network and cardiac activity. The neurovisceral integration model posits that the main role of the prefrontal cortex during a WM task is toward attentional inhibition30. Empirical evidence points to a functional link between attentional inhibition mediated by the prefrontal cortex and vagal activity65. In our WM task, we expected that this would manifest as an increase in HRV during the early periods followed by a decrease due to TOT fatigue. However, HRV as indexed by RMSSD and LF-power increased under anodal tDCS until it plateaued in the terminal phase, while it appeared to increase throughout the experiment under control. In contrast, under sham tDCS, we found that the HRV indices increased through baseline before plateauing during the remainder of the experiment. Contextualized by performance data and subjective responses, we reason that HRV trends under sham or anodal tDCS agree with the expectations of the NVIM, however the control outcomes deviate from the model. It is possible that this deviation can be interpreted as the cumulative effect of fatigue and sustained WM demand on participants, with prior research indicating the linearly additive effects on HRV and similarly confounding observations29. Future investigations should consider HRV as an independent variable in investigating the influence of stimulation, which along with behavioral state dynamics and task state dynamics will serve as a crucial element in the development of fieldable closed-loop solutions for neuromodulation66.
Limitations
We reported an anticipation bias in some participants during the terminal block, which required that we exclude it from our analyses, while this did not impact the trends observed in performance or subjective response, it remains a factor to consider in future study designs to avoid unanticipated influences on participant motivation while on task. Second, we do not adapt workload on the task to individual WM capacity, this appears as common practice in some earlier investigations on tDCS67, however, we reasoned that a prolonged task format would elicit a consistent TOT-fatigue response in our participants which was determined to be the case. Third, our participant blinding strategy was potentially inadequate—during the experiments, participants were blinded to sham or anodal tDCS, based on existing best practices68. The consistent discomfort scores between the two conditions indicates that our blinding between stimulation sessions was likely satisfactory, however, the absence of stimulation peripherals during control may have skewed participant experience during that condition. Fourth, we do not capture motivation or engagement levels during active task performance. We made this decision to avoid disruptions to the participant’s experience while on task, however, these measures could have improved how we understand the impact of tDCS on WM under fatigue69. Overall, our findings support the need for future investigations into the neural underpinnings that drive WM improvements, above and beyond the deficits induced by TOT-fatigue.
Conclusions
Cognitive fatigue can have serious consequences in safety-critical domains such as ER. Our research showed that, under controlled conditions, WM can be enhanced beyond the influence of TOT-fatigue with the help of anodal tDCS. Further investigation is necessary to provide clarity on the specific neural origins of these changes and their perceptual relevance to the human in the loop. Moreover, future explorations must consider how WM enhancements under abstract conditions in the laboratory translate to real-world ER WM demands. Additionally, although our work points to the positive influence of stimulation on task output, subjective feelings of effort, fatigue, and discomfort were not seen to benefit from neuromodulation, which demands consideration on “how” these technologies will be operationalized within human-centered, high-risk socio-technical systems.
Author contributions
R.K. and R.K.M. designed the research. R.K and M.R.S. collected all the data. R.K. analyzed the data; R.K.M. provided guidance and resources. R.K and M.R.S. wrote the manuscript and created all figures. All authors reviewed and revised the manuscript.
Data availability
All experimental procedures were approved by Texas A&M University’s Institutional Review Board (IRB2019-1591DCR), and proceeded in accordance with the Ethics Code of the American Psychological Association. Data will be made available upon reasonable request to the authors.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Naushad VA, et al. A systematic review of the impact of disaster on the mental health of medical responders. Prehosp. Disaster Med. 2019;34:632–643. doi: 10.1017/S1049023X19004874. [DOI] [PubMed] [Google Scholar]
- 2.Yung M, Du B, Gruber J, Yazdani A. Developing a Canadian fatigue risk management standard for first responders: Defining the scope. Saf. Sci. 2021;134:105044. doi: 10.1016/j.ssci.2020.105044. [DOI] [Google Scholar]
- 3.Westbrook JI, Raban MZ, Walter SR, Douglas H. Task errors by emergency physicians are associated with interruptions, multitasking, fatigue and working memory capacity: A prospective, direct observation study. BMJ Qual. Saf. 2018;27:655–663. doi: 10.1136/bmjqs-2017-007333. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Vincent GE, et al. Sleep in wildland firefighters: What do we know and why does it matter? Int. J. Wildland Fire. 2018;27:73–84. doi: 10.1071/WF17109. [DOI] [Google Scholar]
- 5.Schmeichel BJ. Attention control, memory updating, and emotion regulation temporarily reduce the capacity for executive control. J. Exp. Psychol. Gen. 2007;136:241. doi: 10.1037/0096-3445.136.2.241. [DOI] [PubMed] [Google Scholar]
- 6.Wager TD, Smith EE. Neuroimaging studies of working memory. Cogn. Affect. Behav. Neurosci. 2003;3:255–274. doi: 10.3758/CABN.3.4.255. [DOI] [PubMed] [Google Scholar]
- 7.Jones KT, Peterson DJ, Blacker KJ, Berryhill ME. Frontoparietal neurostimulation modulates working memory training benefits and oscillatory synchronization. Brain Res. 2017;1667:28–40. doi: 10.1016/j.brainres.2017.05.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Keshvari F, Pouretemad H-R, Ekhtiari H. The polarity-dependent effects of the bilateral brain stimulation on working memory. Basic Clin. Neurosci. 2013;4:224. [PMC free article] [PubMed] [Google Scholar]
- 9.Hoy KE, et al. Testing the limits: Investigating the effect of tDCS dose on working memory enhancement in healthy controls. Neuropsychologia. 2013;51:1777–1784. doi: 10.1016/j.neuropsychologia.2013.05.018. [DOI] [PubMed] [Google Scholar]
- 10.Gill, J., Shah-Basak, P. P. & Hamilton, R. It’s the thought that counts: Examining the task-dependent effects of transcranial direct current stimulation on executive function. Brain Stimul.8, 253–259 (2015). [DOI] [PubMed]
- 11.Giglia G, et al. Anodal transcranial direct current stimulation of the right dorsolateral prefrontal cortex enhances memory-guided responses in a visuospatial working memory task. Funct. Neurol. 2014;29:189. [PMC free article] [PubMed] [Google Scholar]
- 12.Dedoncker J, Brunoni AR, Baeken C, Vanderhasselt M-A. A systematic review and meta-analysis of the effects of transcranial direct current stimulation (tDCS) over the dorsolateral prefrontal cortex in healthy and neuropsychiatric samples: Influence of stimulation parameters. Brain Stimul. 2016;9:501–517. doi: 10.1016/j.brs.2016.04.006. [DOI] [PubMed] [Google Scholar]
- 13.Mancuso LE, Ilieva IP, Hamilton RH, Farah MJ. Does transcranial direct current stimulation improve healthy working memory?: A meta-analytic review. J. Cogn. Neurosci. 2016;28:1063–1089. doi: 10.1162/jocn_a_00956. [DOI] [PubMed] [Google Scholar]
- 14.Hill AT, Fitzgerald PB, Hoy KE. Effects of anodal transcranial direct current stimulation on working memory: A systematic review and meta-analysis of findings from healthy and neuropsychiatric populations. Brain Stimul. 2016;9:197–208. doi: 10.1016/j.brs.2015.10.006. [DOI] [PubMed] [Google Scholar]
- 15.Fonteneau C, et al. Sham tDCS: A hidden source of variability? Reflections for further blinded, controlled trials. Brain Stimul. 2019;12:668–673. doi: 10.1016/j.brs.2018.12.977. [DOI] [PubMed] [Google Scholar]
- 16.McIntire LK, McKinley RA, Nelson JM, Goodyear C. Transcranial direct current stimulation versus caffeine as a fatigue countermeasure. Brain Stimul. 2017;10:1070–1078. doi: 10.1016/j.brs.2017.08.005. [DOI] [PubMed] [Google Scholar]
- 17.Borragán G, et al. Transcranial direct current stimulation does not counteract cognitive fatigue, but induces sleepiness and an inter-hemispheric shift in brain oxygenation. Front. Psychol. 2018;9:2351. doi: 10.3389/fpsyg.2018.02351. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Karthikeyan, R. & Mehta, R. K. Towards a closed-loop neurostimulation platform for augmenting operator vigilance. In 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC) 3976–3983 (IEEE, 2020).
- 19.Lim J, et al. Imaging brain fatigue from sustained mental workload: An ASL perfusion study of the time-on-task effect. Neuroimage. 2010;49:3426–3435. doi: 10.1016/j.neuroimage.2009.11.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Möckel T, Beste C, Wascher E. The effects of time on task in response selection—An ERP study of mental fatigue. Sci. Rep. 2015;5:1–9. doi: 10.1038/srep10113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Ackerman PL, Kanfer R, Shapiro SW, Newton S, Beier ME. Cognitive fatigue during testing: An examination of trait, time-on-task, and strategy influences. Hum. Perform. 2010;23:381–402. doi: 10.1080/08959285.2010.517720. [DOI] [Google Scholar]
- 22.Krimsky M, Forster DE, Llabre MM, Jha AP. The influence of time on task on mind wandering and visual working memory. Cognition. 2017;169:84–90. doi: 10.1016/j.cognition.2017.08.006. [DOI] [PubMed] [Google Scholar]
- 23.Hopstaken JF, Van Der Linden D, Bakker AB, Kompier MA. A multifaceted investigation of the link between mental fatigue and task disengagement. Psychophysiology. 2015;52:305–315. doi: 10.1111/psyp.12339. [DOI] [PubMed] [Google Scholar]
- 24.Shigihara Y, et al. Two different types of mental fatigue produce different styles of task performance. Neurol. Psychiatry Brain Res. 2013;19:5–11. doi: 10.1016/j.npbr.2012.07.002. [DOI] [Google Scholar]
- 25.Tanaka M, Mizuno K, Tajima S, Sasabe T, Watanabe Y. Central nervous system fatigue alters autonomic nerve activity. Life Sci. 2009;84:235–239. doi: 10.1016/j.lfs.2008.12.004. [DOI] [PubMed] [Google Scholar]
- 26.Johannesen JK, Bi J, Jiang R, Kenney JG, Chen C-MA. Machine learning identification of EEG features predicting working memory performance in schizophrenia and healthy adults. Neuropsychiatric Electrophysiol. 2016;2:1–21. doi: 10.1186/s40810-016-0017-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Wascher, E. et al. Neuroergonomics on the Go: An Evaluation of the Potential of Mobile EEG for Workplace Assessment and Design. Hum. Fact.10.1177/00187208211007707 (2021). [DOI] [PMC free article] [PubMed]
- 28.Tsunoda K, Chiba A, Yoshida K, Watanabe T, Mizuno O. Predicting changes in cognitive performance using heart rate variability. IEICE Trans. Inf. Syst. 2017;100:2411–2419. doi: 10.1587/transinf.2016OFP0002. [DOI] [Google Scholar]
- 29.Nikolin S, Boonstra TW, Loo CK, Martin D. Combined effect of prefrontal transcranial direct current stimulation and a working memory task on heart rate variability. PLoS One. 2017;12:e0181833. doi: 10.1371/journal.pone.0181833. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Thayer JF, Hansen AL, Saus-Rose E, Johnsen BH. Heart rate variability, prefrontal neural function, and cognitive performance: The neurovisceral integration perspective on self-regulation, adaptation, and health. Ann. Behav. Med. 2009;37:141–153. doi: 10.1007/s12160-009-9101-z. [DOI] [PubMed] [Google Scholar]
- 31.Bradley JV. Complete counterbalancing of immediate sequential effects in a Latin square design. J. Am. Stat. Assoc. 1958;53:525–528. doi: 10.1080/01621459.1958.10501456. [DOI] [Google Scholar]
- 32.Shacham, S. A Shortened Version of the Profile of Mood States. J. Pers. Assess.47(3), 305-306 (1983). [DOI] [PubMed]
- 33.Kaida K, et al. Validation of the Karolinska sleepiness scale against performance and EEG variables. Clin. Neurophysiol. 2006;117:1574–1581. doi: 10.1016/j.clinph.2006.03.011. [DOI] [PubMed] [Google Scholar]
- 34.Brunoni AR, et al. Clinical research with transcranial direct current stimulation (tDCS): Challenges and future directions. Brain Stimul. 2012;5:175–195. doi: 10.1016/j.brs.2011.03.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Nitsche MA, et al. Transcranial direct current stimulation: State of the art 2008. Brain Stimul. 2008;1:206–223. doi: 10.1016/j.brs.2008.06.004. [DOI] [PubMed] [Google Scholar]
- 36.Strasser, F., Muma, M. & Zoubir, A. M. Motion artifact removal in ECG signals using multi-resolution thresholding. In 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO) 899–903 (IEEE, 2012).
- 37.Kamath, M. V. Correction of the heart rate variability signal for ectopic and missing beats. Heart rate variability. 75–85 (1995).
- 38.Li C, Zheng C, Tai C. Detection of ECG characteristic points using wavelet transforms. IEEE Trans. Biomed. Eng. 1995;42:21–28. doi: 10.1109/10.362922. [DOI] [PubMed] [Google Scholar]
- 39.Hunter JD. Matplotlib: A 2D graphics environment. Comput. Sci. Eng. 2007;9:90–95. doi: 10.1109/MCSE.2007.55. [DOI] [Google Scholar]
- 40.Teo F, Hoy KE, Daskalakis ZJ, Fitzgerald PB. Investigating the role of current strength in tDCS modulation of working memory performance in healthy controls. Front. Psychiatry. 2011;2:45. doi: 10.3389/fpsyt.2011.00045. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Faul F, Erdfelder E, Lang A-G, Buchner A. G* power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods. 2007;39:175–191. doi: 10.3758/BF03193146. [DOI] [PubMed] [Google Scholar]
- 42.Lehmann, E. L. & D’Abrera, H. J. Nonparametrics: Statistical Methods based on Ranks (Holden-Day, 1975).
- 43.Simon, J. R. The effects of an irrelevant directional cue on human information processing. In Advances in psychology, Vol. 65, 31–86 (North-Holland, 1990).
- 44.McIntire LK, McKinley RA, Goodyear C, Nelson J. A comparison of the effects of transcranial direct current stimulation and caffeine on vigilance and cognitive performance during extended wakefulness. Brain Stimul. 2014;7:499–507. doi: 10.1016/j.brs.2014.04.008. [DOI] [PubMed] [Google Scholar]
- 45.Fregni F, et al. Anodal transcranial direct current stimulation of prefrontal cortex enhances working memory. Exp. Brain Res. 2005;166:23–30. doi: 10.1007/s00221-005-2334-6. [DOI] [PubMed] [Google Scholar]
- 46.Arciniega H, Gözenman F, Jones KT, Stephens JA, Berryhill ME. Frontoparietal tDCS benefits visual working memory in older adults with low working memory capacity. Front. Aging Neurosci. 2018;10:57. doi: 10.3389/fnagi.2018.00057. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Helton WS, Russell PN. Visuospatial and verbal working memory load: Effects on visuospatial vigilance. Exp. Brain Res. 2013;224:429–436. doi: 10.1007/s00221-012-3322-2. [DOI] [PubMed] [Google Scholar]
- 48.D’esposito, M. et al. The neural basis of the central executive system of working memory. Nature378, 279–281 (1995). [DOI] [PubMed]
- 49.d’Esposito, M. et al. Functional MRI studies of spatial and nonspatial working memory. Cogn. Brain Res.7, 1–13 (1998). [DOI] [PubMed]
- 50.Kim, C., Johnson, N. F. & Gold, B. T. Conflict adaptation in prefrontal cortex: Now you see it, now you don’t. Cortex50, 76–85 (2014). [DOI] [PMC free article] [PubMed]
- 51.Tiego J, Testa R, Bellgrove MA, Pantelis C, Whittle S. A hierarchical model of inhibitory control. Front. Psychol. 2018;9:1339. doi: 10.3389/fpsyg.2018.01339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Causse M, Dehais F, Pastor J. Executive functions and pilot characteristics predict flight simulator performance in general aviation pilots. Int. J. Aviat. Psychol. 2011;21:217–234. doi: 10.1080/10508414.2011.582441. [DOI] [Google Scholar]
- 53.Paul RH, Beatty WW, Schneider R, Blanco CR, Hames KA. Cognitive and physical fatigue in multiple sclerosis: Relations between self-report and objective performance. Appl. Neuropsychol. 1998;5:143–148. doi: 10.1207/s15324826an0503_5. [DOI] [PubMed] [Google Scholar]
- 54.Schwartz AL, et al. Measurement of fatigue: Determining minimally important clinical differences. J. Clin. Epidemiol. 2002;55:239–244. doi: 10.1016/S0895-4356(01)00469-3. [DOI] [PubMed] [Google Scholar]
- 55.McKendrick R, Falcone B, Scheldrup M, Ayaz H. Effects of transcranial direct current stimulation on baseline and slope of prefrontal cortex hemodynamics during a spatial working memory task. Front. Hum. Neurosci. 2020;14:64. doi: 10.3389/fnhum.2020.00064. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Williams PS, Hoffman RL, Clark BC. Preliminary evidence that anodal transcranial direct current stimulation enhances time to task failure of a sustained submaximal contraction. PLoS One. 2013;8:e81418. doi: 10.1371/journal.pone.0081418. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Angius L, Santarnecchi E, Pascual-Leone A, Marcora SM. Transcranial direct current stimulation over the left dorsolateral prefrontal cortex improves inhibitory control and endurance performance in healthy individuals. Neuroscience. 2019;419:34–45. doi: 10.1016/j.neuroscience.2019.08.052. [DOI] [PubMed] [Google Scholar]
- 58.Christodoulou, C. The Assessment and Measurement of Fatigue. In Fatigue as a window to the brain, (ed. DeLuca, J.) 19–35 (MIT Press, 2005).
- 59.Goghari VM, MacDonald AW., III The neural basis of cognitive control: Response selection and inhibition. Brain Cogn. 2009;71:72–83. doi: 10.1016/j.bandc.2009.04.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Bender AD, Filmer HL, Garner K, Naughtin CK, Dux PE. On the relationship between response selection and response inhibition: An individual differences approach. Atten. Percept. Psychophys. 2016;78:2420–2432. doi: 10.3758/s13414-016-1158-8. [DOI] [PubMed] [Google Scholar]
- 61.Rowe JB, Toni I, Josephs O, Frackowiak RS, Passingham RE. The prefrontal cortex: Response selection or maintenance within working memory? Science. 2000;288:1656–1660. doi: 10.1126/science.288.5471.1656. [DOI] [PubMed] [Google Scholar]
- 62.Ko L-W, Shih Y-C, Chikara RK, Chuang Y-T, Chang EC. Neural mechanisms of inhibitory response in a battlefield scenario: A simultaneous FMRI-EEG study. Front. Hum. Neurosci. 2016;10:185. doi: 10.3389/fnhum.2016.00185. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Filmer HL, Mattingley JB, Dux PE. Improved multitasking following prefrontal tDCS. Cortex. 2013;49:2845–2852. doi: 10.1016/j.cortex.2013.08.015. [DOI] [PubMed] [Google Scholar]
- 64.Leite J, et al. The differential effects of unihemispheric and bihemispheric tDCS over the inferior frontal gyrus on proactive control. Neurosci. Res. 2018;130:39–46. doi: 10.1016/j.neures.2017.08.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Park G, Thayer JF. From the heart to the mind: Cardiac vagal tone modulates top–down and bottom–up visual perception and attention to emotional stimuli. Front. Psychol. 2014;5:278. doi: 10.3389/fpsyg.2014.00278. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Zrenner C, Belardinelli P, Müller-Dahlhaus F, Ziemann U. Closed-loop neuroscience and non-invasive brain stimulation: A tale of two loops. Front. Cell. Neurosci. 2016;10:92. doi: 10.3389/fncel.2016.00092. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Ruf SP, Fallgatter AJ, Plewnia C. Augmentation of working memory training by transcranial direct current stimulation (tDCS) Sci. Rep. 2017;7:1–11. doi: 10.1038/s41598-017-01055-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Dinn W, et al. Effectiveness of tDCS blinding protocol in a sham-controlled study. Brain Stimul. Basic Transl. Clin. Res. Neuromodul. 2017;10:401. [Google Scholar]
- 69.Jones KT, Gözenman F, Berryhill ME. The strategy and motivational influences on the beneficial effect of neurostimulation: A tDCS and fNIRS study. Neuroimage. 2015;105:238–247. doi: 10.1016/j.neuroimage.2014.11.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All experimental procedures were approved by Texas A&M University’s Institutional Review Board (IRB2019-1591DCR), and proceeded in accordance with the Ethics Code of the American Psychological Association. Data will be made available upon reasonable request to the authors.