Abstract
This paper provides the framework and supporting evidence for a highly efficient closed-loop paradigm that modifies a classic learning scenario using real-time brain activity in order to improve learning performance in a perceptual-cognitive training paradigm known as 3-dimensional multiple object tracking, or 3D-MOT. Results demonstrate that, over 10 sessions, when manipulating this novel task by using real-time brain signals, speed and degree of learning can be substantially improved compared with a classic learning system or an active sham-control group. Superior performance persists even once the feedback signal is removed, which suggests that the effects of enhanced training are consolidated and do not rely on continued feedback. This type of learning paradigm could contribute to overcoming one of the fundamental limitations of neurofeedback and other cognitive enhancement techniques, a lack of observable transfer effects, by utilizing a method that can be directly integrated into the context in which improved performance is sought.
Subject terms: Neuroscience, Psychology
Introduction
Of the numerous domains in which neuroscience is being widely applied, learning and cognitive enhancement figure prominently in both scientific research and popular culture. While there is a burgeoning interest in these techniques and technologies, one major issue is still to be addressed. Evidence for transfer, the replication or application of an enhanced ability in a context other than that of the training paradigm, is largely lacking1.
Cognitive enhancement paradigms typically target given function or set of cognitive abilities, train them in a given paradigm, and then use standardized tests and outcome measures to demonstrate cognitive enhancement and transfer. While cognitive enhancement appears attainable in a number of domains, evidence of transfer remains severely limited1. This novel research proposes integrating EEG-neurofeedback directly into an existing learning paradigm in order to demonstrate that it is possible to overcome the weak transfer effects observed in existing cognitive enhancement and neurofeedback literature2 by applying enhancement directly into the target context.
Banich and Compton define skill learning as “the acquisition—usually gradually and incrementally through repetition—of motor, perceptual, or cognitive operations or procedures that aid performance.”3 Here, we are especially interested in the perceptual and cognitive operations. Since all learning is the result of neuroplasticity, an updated brain-based approach to learning, using all of the technological advancements of the past decades, is fundamentally needed.
In developed parts of the world, a large part of skill learning comes from academic education. The developed world acknowledges some shortfalls of these systems, however, still tout them as the best4. Yet, from preschools to the most sophisticated institutions of higher learning, we are still essentially using trial and error learning5. The base formula for this system is: spend time and energy trying to learn something, and then apply a post-hoc test to see if learning has occurred; thus providing feedback. If learning has occurred, move on to the next subject. If it does not, repeat (hopefully with a variation based on experience from the failed trial) and test again. This traditional type of learning paradigm is presented in Fig. 1a. The so-called ‘solution’ of simple repetition, though, appears to fall short in academic contexts6.
While we continue to proceed with trial and error learning, the manner in which we teach has at least somewhat evolved over time, in large part due to the great work of Jean Piaget, Leonard Vygotsky, Jerome Bruner and many others. Their work led to the fundamental tenant that drives our current learning systems: the zone of proximal development7. This involves maintaining the difficulty of a task within a certain degree of difficulty, or simply put: in order to maximize learning, a task should never be too hard or too easy7.
Clow8 articulates a framework for successful learning cycle: “successful learning analytics work as four linked steps: learners (1) generating data (2) that is used to produce metrics, analytics or visualisations (3). The key step is ‘closing the loop’ by feeding back this product to learners through one or more interventions (4).” The same author proposes improving learning by “speeding up or shortening the cycle so feedback happens more quickly” 8.
A brain-based approach aims to optimize a learning paradigm based on the leaner’s real-time ability to learn by providing feedback based on the moment-to-moment changes in the brain. A real-time indicator of performance is provided, allowing consistent real-time feedback instead of waiting for a post-hoc test. What we are referring to is a closed-loop learning paradigm. In other words, take the information that a person is perceiving, processing, understanding and encoding into their brain in a given environment at a given moment in time, and feed it to the brain optimally, using the brain’s own performance to adjust the flow of information and the task as appropriate. Figure 1b provides a graphic representation of this paradigm.
To further illustrate this concept, let’s take an example in which learning can occur and simplify it. A significant amount of learning can involve reading, so let’s start there. First, you’d have to measure the neural activity in the part of the brain (Wernicke’s area) responsible for the reading task9, and provide the learning stimulus (the next word or sentence) to a person only when this area of the brain is functioning optimally and thus receptive to the information.
While this is great in theory, it is an oversimplified idea that rests on a number of assumptions. First, we are assuming that Wernicke’s area is solely responsible for reading comprehension, which is not the case10. It also assumes that we can define and measure what the optimal functioning of this part of the brain is, and although this is theoretically possible, it is quite complex11. Finally, it assumes that the suggested manipulation is going to maintain the task within the zone of proximal development, and thus facilitate a task that is otherwise too difficult, and load a task that is otherwise too easy.
With all of these assumptions, one would think that a rather complex framework for a closed-loop paradigm is needed, but thanks to technological advancements and mounting evidence from various domains of neuroscience, this type of paradigm is possible today.
Dating back to the 1970s, brain-computer interfaces have been used to measure real-time brain activity and feed the signal back to the person12 in order to modify brain function13 and structure14. Called neurofeedback (NFB), this technique has been employed in order to diminish symptoms of various cognitive difficulties and disorders (ADHD12, epilepsy15, depression and anxiety16 and others17), and enhance cognitive abilities (attention18, working memory17, music performance19 and others20) in cognitively healthy individuals. It is typically applied as a conditioning procedure involving the modulation of visual (animations) and auditory stimuli (music) 16.
One type of brain activity often targeted by neurofeedback protocols, alpha, is typically defined as neural oscillations at a speed between 8 and 12 or 13 Hz21. Peak Alpha Frequency, or PAF, “corresponds to the discrete frequency with the highest magnitude within the alpha range” 22. Although EEG measures cortical activity, in the case of the upper-band alpha activity examined here, the source of this activity is primarily believed to be the thalamus and thalamo-cortical loops23.
The thalamus is often referred to as a high-order relay station; an important router tasked with dispatching incoming information and coordinating relevant parts of the brain for more complex work24. Succinctly, the thalamus sends the relevant information to the cortex, the executor of the task. The cortex then responds to the thalamus indicating whether or not it has achieved the work it was asked to do, giving feedback on its performance. This back-and-forth circuitry between the thalamus and the cortex is referred to as a thalamo-cortical loop25. In adults, the speed of these thalamo-cortical loops is approximately 10 Hz and varies faster and slower based on cognitive performance; hence the measure of the PAF26. A significant correlation between the speed of these oscillations and task performance has been shown: a faster PAF means better performance on a wide variety of tasks27.
This leads to the idea that while the thalamus can be interpreted as the “router” of cortical activity, the PAF is then the speed at which the “router” is able to dispatch relevant signals throughout the brain and receive a response back. By this understanding, a faster PAF means that the thalamus (router) is dispatching information to the cortex (effector), and providing a return signal (feedback), more efficiently. One could even choose to think of it as another case of trial and error; the thalamus sends a task to the cortex (trial) and the cortex communicates back the result (success or error). PAF then, in this paradigm, serves to indicate an indirect measure of learning success or failure by signalling proper workload (success; faster PAF) or inefficient functioning (error; slower PAF). Essentially then, the result is a measure of trial-and-error learning in near real-time based on an objective, quantifiable brain measure.
Subset of neurofeedback protocols have specifically targeted the higher frequencies of the alpha band or set out to increase the dominant or peak alpha frequency. Notably used to enhance processing speed and executive function in healthy elderly populations28, memory in aging populations with mild cognitive impairment29, recovery from spatial neglect in stroke patients30, but also in healthy individuals for the enhancement of cognitive performance31, this type of neurofeedback has also been demonstrated to augment abilities in a mental rotation task20, short term memory32, and working memory33.
In these “classic” paradigms, the target parameters provide feedback by modulating a neutral, salient stimulus, and conditioning is driven by the basic principles of reward/punishnment2. This is a major difference with the approach described herein. Here, we propose the use of neurofeedback within a specific, applied learning paradigm to create a closed-loop learning system that uses the brain’s real-time activity to manipulate a specific task in order to enhance and optimize learning.
Other types of neurofeedback paradigms have been proposed, often by simultaneously combining classic neurofeedback with a cognitive task (for example, see Hosseini and colleagues34) while others have proposed creating neurofeedback-driven video-games to make training more enjoyable35. One very limited pilot study integrated a neurofeedback-modulated variable into a “shooter” style video game, and demonstrated changes in the peak alpha frequency in the three subjects trained36. While this latter work is closest to the proposed paradigm, a distinct difference in this work is that neurofeedback was integrated into a pre-existing learning paradigm (3D-MOT; see “Method” section below) that has been applied in various contexts, with measurable transfer effects. In the famework of the learning model set out by Clow8, this significant difference makes the currently proposed paradigm distinct, in that it is an entirely closed-loop learning system.
There are a few steps required to set up a closed-loop system. Specifically, one must (1) identify the task, (2) identify the relevant brain regions and networks involved, (3) define what the optimal functioning of these regions and network is and (4) define and validate the manipulation of the task that will enhance learning.
That is exactly what we have set out to do: demonstrate that in the case of a novel learning paradigm, by targeting brain functioning even with relatively low specificity, a closed-loop system enhances learning when compared with a traditional paradigm, an active-sham control group and a non-active control group.
Method
The task
For the purposes of this investigation, in order to respect a typical learning paradigm, a trial-and-error task was chosen. The task used here is a perceptual cognitive paradigm known as 3-dimensional multiple object tracking, or 3D-MOT37–40. The 3D-MOT task involves tracking multiple target spheres amongst distractor spheres through 3-dimensional cube. Four targets are used as research has shown that most people, notably healthy adults, can generally track four elements in such a context37.
Parsons and colleagues40 provide the following breakdown of a 3D-MOT trial: “During the first phase of each trial, all 8 spheres appear in yellow and are stationary. Next, the 4 target spheres that the trainee must track appear in red for 2 s, before switching back to yellow. The spheres begin movement and tracking then occurs over a period of 8 s. All 8 spheres move along a linear path through the cube; should any sphere encounter an obstacle (either a wall or another sphere) it bounces off that obstacle and continues along its new linear trajectory. At the end of this phase, each sphere is identified with a number and the trainee is asked to verbally state their responses” 40.
The 3D-MOT task lends itself well to this research, as it follows the same standard “trial and error” approach as traditional learning paradigms. If all 4 targets are correctly identified the speed of the subsequent trial (the task difficulty) increases. If an incorrect response is given, the speed of the subsequent trial decreases, decreasing task difficulty. The speed changes are based on an adaptive staircase with wider initial variances followed by progressively smaller changes. This ensures that the learner quickly enters their zone of proximal development. At the end of a series of 20 trials, a final speed threshold score is given which reflects the maximum speed at which a subject’s performance is adequate (identification of all 4 correct targets). A subject’s session score comprises the average threshold score of 3 series of 20 trials.
3D-MOT training has been demonstrated to enhance attention, working memory and visual information processing speed in healthy participants40, attention in those with neurodevelopmental deficits41, on-field performance in athletes42, and memory43 and biological motion processing in healthy aging participants44.
Neural correlates
Being a visuospatial attentive tracking task, the neural network colloquially known as the where stream of visual processing is heavily involved45. The dorsal (where) stream is a complex visual network involved in locating and tracking objects through space, as opposed to the ventral (what) stream responsible for object identification46. A number of cerebral regions are involved in the where stream, most of them located around the dorsal posterior cortex47. A critical point, the precuneus (which corresponds to 10–20 location Pz)47, is easily measured using electroencephalographic (EEG) sensors placed on the scalp. EEG sensors passively measure the brain’s electric activity27. Due to its non-invasiveness, ease of use, low cost and temporal specificity, EEG was selected for the purposes of this study.
Optimal functioning
Thus far, progress into designing a closed-loop paradigm has been relatively simple. When it comes to defining the optimal functioning of the brain during the 3D-MOT task, or more specifically of the critical parts of the brain involved in the task (referenced by the electrode site Pz above), the precuneus and medial parietal cortex, there are a considerable number of variables to consider. These include the specifics of the task, the neural networks involved, and the individual performing the task.
Optimal functioning within a learning paradigm requires a targeted workload that falls within or slightly above the domain of current competence7; thus defining and measuring workload is essential. Workload can be defined as “the amount of mental resources that are used to execute a specific task, also known as working memory load.”48 This model of workload, developed and utilized by Gerjets et al. 49, among others, has been applied in a multitude of learning tasks with and without a brain-computer interface (BCI) 50.
Many EEG markers for workload have been proposed, from the relatively simple (for example: frequency band amplitude measures51 and ERPs52) to the complex (for example: adaptive deep-learning models53). For the purposes of this study, a specific element of EEG activity, a relatively general measure of cognitive performance known as Peak Alpha Frequency (PAF) was selected as the target variable. The relationship between PAF and cognitive performance extends back to the late 1930s and early 1940s, when Knott54 and Hadley55 reported changes in the dominant alpha rhythm using only visual (“eyeball”) inspection. More advanced technologies as early as the 1980s allowed for more precise power spectral analyses to be performed by others, confirming the relevance of PAF to workload and performance56.
The manipulation
The final step is determining the way in which the learning task will be manipulated. In the case of 3D-MOT, since the goal is to track the 4 targets amidst the 4 distractors, the manipulation was designed to recall the identity of the targets. During the movement phase of the trial, target recall occurred: a subtle red hue (gradual change over 0.5 s to a maximum of 25% saturation) was applied to the four target spheres if non-optimal brain functioning (a slow PAF) over the precuneus was observed.
Subjects
The research project was approved by the Université de Montréal ethics committee for health research (Comité d’éthique de la recherche en santé; CERES). All recommended ethics procedures and guidelines were followed, and informed consent obtained from all study participants. Four groups (n = 40) took part in this study. All groups were matched for age (mean = 22.89 years, SD = 2.95; range = 19–29 years) and total years of post-secondary education (mean = 2.38 years, SD = 1.01, range = 1 to 5 years). Specific demographic information for each group is detailed in Table 1. All participants were free of any diagnosed cognitive or emotional deficits and psychoactive medication. The first two groups are presented in Parsons et al40 as a part of a study investigating the improvements in cognitive function of standard 3D-MOT training. They are the NT group (n = 10) that underwent standard 3D-MOT training, and the CON group (n = 10) that was a non-active control. In addition to those groups, this study added a NT-NFB group (active neurofeedback group; n = 10) and a NT-NFBs group (sham neurofeedback group; n = 10). All subjects were randomly assigned to groups following a block randomization procedure, and all subjects were trained over the same general timeframe (approximately 6 months).
Table 1.
Group | Description | n | Age (years) | SD | YPSE | SD |
---|---|---|---|---|---|---|
NT | Standard learning experimental | 10 | 23.54 | 2.56 | 2.5 | 0.97 |
NT-NFB | NFB-assisted learning experimental | 10 | 21.90 | 2.99 | 2.2 | 1.03 |
NT-NFBs | Sham-assisted learning control | 10 | 23.10 | 3.48 | 2.4 | 1.17 |
CON | Non-active control | 10 | 23.02 | 2.78 | 2.4 | 0.84 |
Group composition and demographic information.
YPSE: years of post-secondary education.
The NT, NT-NFB and NT-NFBs groups all performed 10 training sessions of 3D-MOT, with 2 training sessions a week over a period of 5 weeks. Each session lasted approximately 45 min. The CON group was a non-active control and thus underwent no training. All groups also conducted an initial testing session and a final testing session of the standard, un-manipulated 3D-MOT task.
The 3D-MOT task took place in a virtual 3D cube with each side measuring 1.5 m and projected onto a square screen with sides measuring 2.4 m. Target and distractor spheres each measured 10 cm in diameter. The speed is measured in meters per second (m/s); each trial began with an initial start speed of 0.3 m/s. Figure 2 presents a breakdown of a 3D-MOT trial.
Participants in the NT-NFB group underwent 3D-MOT training with a manipulation of the task based on real-time EEG-based brain activity. As discussed above, the sole information provided to the subject via neurofeedback-based modulation was the target recall. Specifically, the PAF measured over the midline parietal cortex (10–20 electrode site Pz47) was used to modulate the targets, making them slightly heterogenous. Pz was chosen as the site for training as it is heavily involved in visuotpatial tasks46, as well as proposed as a part of the neurofeedback “control network”, potentially in part responsible for the acquisition of neural autoregulation57. Fz was passively recorded for further offline analysis.
Prior to each series of trials, a 1-min baseline was taken, and a PAF threshold was then set as 95% of the baseline level (for example if PAF = 10 Hz, PAF threshold = 9.5 Hz). This measure ensured consideration of the individual and contextual variability inherent in EEG measures. Target recall was based on real-time EEG activity and would occur whenever the PAF dropped below threshold, between seconds 2 and 6 of the movement phase of a trial (see Fig. 2, image C). Target recall was a subtle red hue (gradual change over 0.5 s to a maximum of 25% saturation) applied to the four target spheres. No target recall occurred during the first two and final two seconds of each trial. Further, target recall was discontinued immediately once the PAF returned above threshold, or after a maximum of 0.5 s. Finally, every instance of target recall was followed by 1.5 s of ‘dead time’ during which no additional feedback could be given. Thus, a maximum of 1 total second of feedback time could be given per trial, accounting for 12.5% of the 8-s trial.
The NT-NFBs group was an active control group. The NT-NFBs group underwent the same training as the NT-NFB group, however target recall was not dependent on their brain activity. Instead, while each subject in the NT-NFBs group were told they were receiving feedback based on their brain activity, in reality each subject was paired with a participant in the NT-NFB group, and the color-change they observed was based on the pre-recorded EEG of their pair. The study respected a single-blind design; the experimenters were aware of who received real and sham recall but the participants themselves were not. As such, the task, including amount and timing of target recall was identical for both NT-NFB and NT-NFBs groups, with the only differing variable being that the NT-NFB group received brain-based target recall, while the NT-NFBs group received non-contingent or sham target recall.
All subjects were given identical instructions for the task itself incling a brief demonstration of 3D-MOT trial in order to educate them on how to perform this task. NT-NFB and NT-NFBs groups were also told that the target spheres would turn slightly red when an inefficient brain activity was detected.
Materials
A ProComp Infiniti encoder manufactured by Thought Technology Limited58 was used to acquire 2-channel EEG data from active sites Pz & Fz47, referenced to linked ears, with the ground at Cz. Application of electrodes was done by first lightly abrading the skin using NuPrep gel, then affixing the electrode to the ear or scalp using Ten20 conductive paste. Impedance for all electrodes was held below 5 kOhm, and within 1 kOhm of one another.
Thought Technology Limited’s BioGraph Infiniti software version 6.058 was used, with a customized interface allowing for communication with the 3D-MOT software program. The EEG signal was sampled at 256 Hz, with a high-pass (0.5 Hz) and low-pass filter (50 Hz). PAF was calculated by isolating the discrete frequency producing dominant power with a 1-s sliding-window FFT of EEG activity between 8 and 13 Hz. Real-time PAF was thus consistently a discrete frequency; either 8, 9, 10, 11, 12 or 13. The running average of PAF over a given trial, series or session could be any decimal value between 8 and 13 Hz.
The 3D-MOT task was custom-coded for the purposes of this project, built from a lab version of the commercially available NeuroTracker (CogniSens Inc.)59. The 3D-MOT sessions were performed in the C.A.V.E. (Cave Automatic Virtual Environment)60. The C.A.V.E is a 10 foot by 10 foot by 10 foot enclosure onto which is projected the 3D-MOT task. The MOT environment consists of a large cube measuring approximately 1.5 m in length, width, and height, while targets measure 10 cm diameter. The participant is seated at a distance of 1.5 m from the screen and is given a fixation point located in the center of the cube. The 3D-MOT task thus utilises a visual field of approximately 45 degrees. The use of a cube as the environment allows for horizontal and vertical movement of both targets and distractors to remain roughly equivalent. The 3-D aspect of the MOT task is achieved using stereoscopic projection and active shutter lenses synchronized to 120 Hz.
Results
The session scores and logarithmic learning curves of each group are presented below in Fig. 3. In the figure, the graph above shows the raw scores while the graph below shows scores based on a normalized baseline (session score—baseline score). A repeated-measures ANOVA of initial and final session scores demonstrated an effect of group (F = 20.317, p = < 0.001, partial Eta squared = 0.629). As can be easily observed, the NT-NFB group performed better than the NT-NFBs and NT groups, whose results are similar. Finally, as expected, the non-active CON group demonstrated the least amount of learning. In terms of the learning curves, as can clearly be seen in Fig. 3, the NT-NFB group demonstrates a steeper slope and this better learning than all other groups, and this effect is even more evident when observing the normalized learning curves.
In Table 2, the results of a univariate ANOVA on final test scores demonstrate that at final testing, the NT-NFB group significantly outperformed all other groups, while the NT and NT-NFBs groups performed significantly better than the CON group. Table 2 also gives us an idea of the power of the various learning paradigms; the NT-NFB paradigm significantly outperformed all others with effect sizes in the medium to large range. Meanwhile, no significant difference was observed between the classic paradigm (NT) and the sham paradigm (NT-NFBs). Both of these latter paradigms outperformed the non-active control group, with the classic paradigm and sham paradigms presenting a large and medium effect size, respectively. Between-group comparisons of the NT and NT-NFBs are non-significant, and future research could examine this possibility in a larger study.
Table 2.
Group | Comparator | Significance (p) | Effect size Cohen’s d (r) |
---|---|---|---|
NT-NFB | Versus NT | .044 | 0.9484 (.4284) |
Versus NT-NFBs | .004 | 1.2742 (.5373) | |
Versus CON | < .001 | 2.3015 (.7548) | |
NT | Versus NT-NFBs | NS | – |
Versus CON | .003 | 1.2583 (.5325) | |
NT-NFBs | Versus CON | .032 | 0.7317 (.3435) |
Y values represent mean speed of the final testing session in metres per second.
Cohen's d = (M2 − M1)/SDpooled (M = mean, SD = standard deviation).
Discussion
As can be seen from the results section above, the NT-NFB group out-performed all other groups and demonstrated a significantly better learning curve. This could be because the closed-loop learning paradigm provides assistance (target recall) when the learner needs it most, thus keeping the person within the optimal zone of development on a more consistent basis than when using a standard trial-and-error approach (in this case, an adaptive staircase) alone.
This is supported by observations of the NT group: while adaptive staircases based on behavioural performance work and significant learning is observed, a system that integrates real-time cognitive performance into the learning paradigm yields superior results. If the task is simply made easier, such as was the case for the NT-NFBs group who received help at the task (target recall) at times when it wasn’t needed, the learner does not perform any better than with the standard task. It may even be possible that the differences in effect sizes between NT and NT-NFBs groups, which are larger for the former, indicate that non-contingent feedback—irrelevant help—is disruptive to the learning process.
Further, even once target recall was removed from the task at the time of final testing, the NT-NFB group continues to perform at levels well above the other groups. The results of the NT-NFB group did not decrease even though they went back to the classic task and were no longer receiving target recall. This should be interpreted as a confirmation that there is a true acquisition of what was learned. This is an important point: if there were no transfer to classic applications, a closed-loop learning system would be of limited value because a person would always have to find themselves within a closed-loop context to perform at their full potential. This is not the case, as the NT-NFB group demonstrates that their learned abilities transfer back out into a traditional context.
This addresses a significant weakness in existing cognitive enhancement literature1 as well as in some classic neurofeedback applications2. By integrating a brain-based cognitive enhancement technique into a given learning paradigm, the highly-efficient closed-loop learning paradigm described by Clow8 can be achieved, side-stepping the need to achieve more distant transfer.
If we extrapolate, instead of applying neurofeedback in an experimental setting and attempting to achieve transfer, we can imagine designing specific in-classroom neurofeedback protocols for the “live” enhancement of cognitive functions effected by neurodevelopmental disorders such as ADHD13, learning disorders61, autism spectrum disorders62, as well as personal/professional protocols for emotional regulation16 and for peak performance18–20,28–33. Married with today’s technology, one can even begin to imagine the various forms in which this could take shape: an adaptive augmented reality classroom, the teacher able to modify their lesson based on the real-time brain-states of their student; a book that adapts how it presents information to its reader based on their real-time information processing, comprehension, memory encoding and reasoning; and a virtual reality environment that pushes behavioural and emotional regulation capacities to the maximum, without the risk of ever pushing beyond a tolerable level. Indeed, some of these biofeedback devices exist, most notably capitalizing on heart rate signals in order to manage stress63 and for personal emergency response systems worn during exercise64.
Conclusion
This study demonstrates that a closed-loop learning paradigm that incorporates cerebral performance (PAF) as well as cognitive performance (workload) optimizes a person’s ability to learn within the framework of a novel task (3D-MOT). There is still much work to be done before this type of learning system can be implemented on a broader scale.
First and foremost, the results of this study need to be replicated on a larger scale within the context of the 3D-MOT paradigm. Ideally, a larger number of subjects should be trained in order to validate and enhance statistical measures. Moreover, transfer measures such as structural and/or functional brain scans; cognitive performance tests and outcome measures should be utilized to examine the potential for cognitive enhancement beyond the task at hand.
Next, a closed-loop learning paradigm should be tested within the context of other tasks. Other measures of workload could be used, various electrode sites targeted for their involvement in a given task, and the same type of paradigm could theoretically be done using more precise brain-imaging techniques such as real-time functional magnetic resonance imaging (rt-fMRI), yielding deeper insights into task-related brain functioning65.
This study should be considered a proof of concept; a demonstration that it is possible to use brain activity to improve how the brain learns, by consistently presenting it with information within the zone of proximal development. While the immediate impact of this one study may be limited, there are far reaching implications: the possible real-world applications of a closed-loop learning paradigm are considerable, research supports PAF as a task-independent measure appropriate to multiple paradigms52, and the potential gains in learning outcomes across a wide variety of domains and applications are immense.
Acknowledgements
This research study was made possible by an NSERC Discovery operating grant.
Author contributions
B.P. was responsible for the design of the project, performed all testing and analysis, and oversaw training sessions. B.P. also wrote the manuscript text and prepared all figures and tables. J.F. provided supervision of the project design and reviewed the manuscript. Both authors reviewed and approved the final manuscript.
Data availability
The datasets generated and analysed during the current study are available from the corresponding author on reasonable request.
Competing interests
BP is a Scientific Advisor of CogniSens Athletics Inc. who produce the commercial version of the 3D-MOT program (NeuroTracker) used in this study. In this capacity, he holds shares in the company. JF is director of the Faubert Lab at the University of Montreal and he is a cofounder of CogniSens Athletics Inc. who produce the commercial version of the 3D-MOT program (NeuroTracker) used in this study. In this capacity, he holds shares in the company.
Footnotes
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Dresler M, Sandberg A, Ohla K, Bublitz C, Trenado C, Mroczko-Wąsowicz A, Kühn H, Repantis D. Non-pharmacological cognitive enhancement. Neuropharmacology. 2013;64:529–543. doi: 10.1016/j.neuropharm.2012.07.002. [DOI] [PubMed] [Google Scholar]
- 2.Gruzelier JH. EEG-neurofeedback for optimising performance. III: a review of methodological and theoretical considerations. Neurosci. Biobehav. Rev. 2014;44:159–182. doi: 10.1016/j.neubiorev.2014.03.015. [DOI] [PubMed] [Google Scholar]
- 3.Banich, M. T., & Compton, R. Cognitive Neuroscience. (3rd Edition, ed. Banish, M.T. & Compton, R.) 273 (Nelson Education, 2010).
- 4.Popova, A. What really works to improve learning in developing countries? An analysis of divergent findings in systematic reviews. The World Bank. 7203 (2015).
- 5.Brown AL. The advancement of learning. Educ. Res. 1994;23(8):4–12. doi: 10.3102/0013189X023008004. [DOI] [Google Scholar]
- 6.Bowman LJ. Grade retention: is it a help or hindrance to student academic success? Prevent. School Failure Altern. Educ. Child. Youth. 2005;49(3):42–46. doi: 10.3200/PSFL.49.3.42-46. [DOI] [Google Scholar]
- 7.Chaiklin, S. The zone of proximal development in Vygotsky’s analysis of learning and instruction. In Vygotsky’s Educational Theory in Cultural Context (1st edition, ed. Kozulun. A.) 39–64 (2003).
- 8.Clow, D. The learning analytics cycle: closing the loop effectively. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge. 134–138 (2012, April).
- 9.Dehaene S. Reading in the Brain: The New Science of How We Read. City of Westminster: Penguin; 2009. p. 64. [Google Scholar]
- 10.Jones, Ō. P., et al. Where, when and why brain activation differs for bilinguals and monolinguals during picture naming and reading aloud. Cerebral Cortex. 161 (2011). [DOI] [PMC free article] [PubMed]
- 11.Galin D, et al. EEG spectra in dyslexic and normal readers during oral and silent reading. Electroencephalogr. Clin. Neurophysiol. 1992;82(2):87–101. doi: 10.1016/0013-4694(92)90151-7. [DOI] [PubMed] [Google Scholar]
- 12.Wolpaw JR, et al. Brain-computer interface technology: a review of the first international meeting. IEEE Trans. Rehabil. Eng. 2000;8(2):164–173. doi: 10.1109/TRE.2000.847807. [DOI] [PubMed] [Google Scholar]
- 13.Arns M, Heinrich H, Strehl U. Evaluation of neurofeedback in ADHD: the long and winding road. Biol. Psychol. 2014;95:108–115. doi: 10.1016/j.biopsycho.2013.11.013. [DOI] [PubMed] [Google Scholar]
- 14.Ghaziri J, et al. Neurofeedback training induces changes in white and gray matter. Clin. EEG Neurosci. 2013;44(4):265–272. doi: 10.1177/1550059413476031. [DOI] [PubMed] [Google Scholar]
- 15.Tan G, et al. Meta-analysis of EEG biofeedback in treating epilepsy. Clin. EEG Neurosci. 2009;40(3):173–179. doi: 10.1177/155005940904000310. [DOI] [PubMed] [Google Scholar]
- 16.Hammond DC. Neurofeedback treatment of depression and anxiety. J. Adult Dev. 2005;12(2-3):131–137. doi: 10.1007/s10804-005-7029-5. [DOI] [Google Scholar]
- 17.Hammond DC. What is neurofeedback: an update. J. Neurother. 2011;15(4):305–336. doi: 10.1080/10874208.2011.623090. [DOI] [Google Scholar]
- 18.Wang JR, Hsieh S. Neurofeedback training improves attention and working memory performance. Clin. Neurophysiol. 2013;124(12):2406–2420. doi: 10.1016/j.clinph.2013.05.020. [DOI] [PubMed] [Google Scholar]
- 19.Egner T, Gruzelier JH. Ecological validity of neurofeedback: modulation of slow wave EEG enhances musical performance. NeuroReport. 2003;14(9):1221–1224. doi: 10.1097/00001756-200307010-00006. [DOI] [PubMed] [Google Scholar]
- 20.Zoefel B, Huster RJ, Herrmann CS. Neurofeedback training of the upper alpha frequency band in EEG improves cognitive performance. Neuroimage. 2011;54(2):1427–1431. doi: 10.1016/j.neuroimage.2010.08.078. [DOI] [PubMed] [Google Scholar]
- 21.Roy RN, Charbonnier S, Campagne A, Bonnet S. Efficient mental workload estimation using task-independent EEG features. J. Neural Eng. 2016;13(2):026019. doi: 10.1088/1741-2560/13/2/026019. [DOI] [PubMed] [Google Scholar]
- 22.Yin Z, Zhang J. Cross-session classification of mental workload levels using EEG and an adaptive deep learning model. Biomed. Signal Process. Control. 2017;33:30–47. doi: 10.1016/j.bspc.2016.11.013. [DOI] [Google Scholar]
- 23.Knott JR. Brain potentials during silent and oral reading. J. Gen. Psychol. 1938;18(1):57–62. doi: 10.1080/00221309.1938.9709890. [DOI] [Google Scholar]
- 24.Hadley JM. Some relationships between electrical signs of central and peripheral activity: II. During 'mental work. J. Exp. Psychol. 1941;28(1):53. doi: 10.1037/h0062239. [DOI] [Google Scholar]
- 25.Haxby JV, et al. Dissociation of object and spatial visual processing pathways in human extrastriate cortex. Proc. Natl. Acad. Sci. 1991;88(5):1621–1625. doi: 10.1073/pnas.88.5.1621. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Klimesch W. EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res. Rev. 1999;29(2):169–195. doi: 10.1016/S0165-0173(98)00056-3. [DOI] [PubMed] [Google Scholar]
- 27.Speckmann EJ, Elger CE. Introduction to the Neurophysiological Basis of the EEG and DC Potentials. In: Niedermeyer E, da Silva FL, editors. Electroencephalography: basic principles, clinical applications, and related fields. Philadelphia: Lippincott Williams & Wilkins; 2005. pp. 17–30. [Google Scholar]
- 28.Angelakis E, Stathopoulou S, Frymiare JL, Green DL, Lubar JF, Kounios J. EEG neurofeedback: a brief overview and an example of peak alpha frequency training for cognitive enhancement in the elderly. Clin. Neuropsychologist. 2007;21(1):110–129. doi: 10.1080/13854040600744839. [DOI] [PubMed] [Google Scholar]
- 29.Lavy Y, Dwolatzky T, Kaplan Z, Guez J, Todder D. Neurofeedback improves memory and peak alpha frequency in individuals with mild cognitive impairment. Appl. Psychophysiol. Biofeedback. 2019;44(1):41–49. doi: 10.1007/s10484-018-9418-0. [DOI] [PubMed] [Google Scholar]
- 30.Ros, T., Michela, A., Bellman, A., Vuadens, P., Saj, A. & Vuilleumier, P. Increased alpha-rhythm dynamic range promotes recovery from visuospatial neglect: a neurofeedback study. Neural plasticity, 2017 (2017). [DOI] [PMC free article] [PubMed]
- 31.Vernon D, Dempster T, Bazanova O, Rutterford N, Pasqualini M, Andersen S. Alpha neurofeedback training for performance enhancement: reviewing the methodology. J. Neurotherapy. 2009;13(4):214–227. doi: 10.1080/10874200903334397. [DOI] [Google Scholar]
- 32.Nan W, Rodrigues JP, Ma J, Qu X, Wan F, Mak PI, Mak PU, Vai MI, Rosa A. Individual alpha neurofeedback training effect on short term memory. Int. J. Psychophysiol. 2012;86(1):83–87. doi: 10.1016/j.ijpsycho.2012.07.182. [DOI] [PubMed] [Google Scholar]
- 33.Escolano, C., Aguilar, M. & Minguez, J. EEG-based upper alpha neurofeedback training improves working memory performance. In 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society 2327–2330. IEEE. (2011, August). [DOI] [PubMed]
- 34.Hosseini SH, Pritchard-Berman M, Sosa N, Ceja A, Kesler SR. Task-based neurofeedback training: a novel approach toward training executive functions. Neuroimage. 2016;134:153–159. doi: 10.1016/j.neuroimage.2016.03.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.AbuRas, R., Turcu, G., Kosunen, I. & Mihaescu, M. C. Peak alpha based neurofeedback training within survival shooter game. In International Conference on Intelligent Data Engineering and Automated Learning 821–828. Springer, Cham. (2018, November)
- 36.Liu, Y., Sourina, O. & Hou, X. Neurofeedback games to improve cognitive abilities. In 2014 International Conference on Cyberworlds 161–168. IEEE (2014, October).
- 37.Cavanagh P, Alvarez GA. Tracking multiple targets with multifocal attention. Trends Cognit. Sci. 2005;9(7):349–354. doi: 10.1016/j.tics.2005.05.009. [DOI] [PubMed] [Google Scholar]
- 38.Faubert J, Sidebottom L. Perceptual-cognitive training of athletes. J. Clin. Sport Psychol. 2012;6(1):85–102. doi: 10.1123/jcsp.6.1.85. [DOI] [Google Scholar]
- 39.Faubert J. Professional athletes have extraordinary skills for rapidly learning complex and neutral dynamic visual scenes. Sci. Rep. 2013;3:1154. doi: 10.1038/srep01154. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Parsons B, et al. Enhancing cognitive function using perceptual-cognitive training. Clin. EEG Neurosci. 2016;47(1):37–47. doi: 10.1177/1550059414563746. [DOI] [PubMed] [Google Scholar]
- 41.Tullo D, Guy J, Faubert J, Bertone A. Training with a three-dimensional multiple object-tracking (3D-MOT) paradigm improves attention in students with a neurodevelopmental condition: a randomized controlled trial. Dev. Sci. 2018;21(6):e12670. doi: 10.1111/desc.12670. [DOI] [PubMed] [Google Scholar]
- 42.Romeas T, Guldner A, Faubert J. 3D-Multiple Object Tracking training task improves passing decision-making accuracy in soccer players. Psychol. Sport Exerc. 2016;22:1–9. doi: 10.1016/j.psychsport.2015.06.002. [DOI] [Google Scholar]
- 43.Assed MM, Carvalho MKHVD, Rocca CCDA, Serafim ADP. Memory training and benefits for quality of life in the elderly: a case report. Dementia Neuropsychol. 2016;10(2):152–155. doi: 10.1590/S1980-5764-2016DN1002012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Legault I, Faubert J. Perceptual-cognitive training improves biological motion perception: evidence for transferability of training in healthy aging. NeuroReport. 2012;23(8):469–473. doi: 10.1097/WNR.0b013e328353e48a. [DOI] [PubMed] [Google Scholar]
- 45.Culham JC, et al. Cortical fMRI activation produced by attentive tracking of moving targets. J. Neurophysiol. 1998;80(5):2657–2670. doi: 10.1152/jn.1998.80.5.2657. [DOI] [PubMed] [Google Scholar]
- 46.Milner AD, Goodale MA. The visual brain in action. Oxford: Oxford University Press; 2006. [Google Scholar]
- 47.Klem GH, Lüders HO, Jasper HH, Elger C. The ten-twenty electrode system of the international federation. Electroencephalogr. Clin. Neurophysiol. 1999;52(3):3–6. [PubMed] [Google Scholar]
- 48.Walter, C. B. EEG workload prediction in a closed-loop learning environment. Doctoral dissertation, Universität Tübingen. (2015).
- 49.Gerjets P, Walter C, Rosenstiel W, Bogdan M, Zander TO. Cognitive state monitoring and the design of adaptive instruction in digital environments: lessons learned from cognitive workload assessment using a passive brain-computer interface approach. Front. Neurosci. 2014;8:385. doi: 10.3389/fnins.2014.00385. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Van Merriënboer JJ, Kirschner PA. Ten Steps to Complex Learning: A Systematic Approach to Four-Component Instructional Design. Abingdon: Routledge; 2017. [Google Scholar]
- 51.Sammer G, Blecker C, Gebhardt H, Bischoff M, Stark R, Morgen K, Vaitl D. Relationship between regional hemodynamic activity and simultaneously recorded EEG-theta associated with mental arithmetic-induced workload. Hum. Brain Mapp. 2007;28(8):793–803. doi: 10.1002/hbm.20309. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Osaka M. Peak alpha frequency of EEG during a mental task: task difficulty and hemispheric differences. Psychophysiology. 1984;21(1):101–105. doi: 10.1111/j.1469-8986.1984.tb02325.x. [DOI] [PubMed] [Google Scholar]
- 53.Ray WJ, Cole HW. EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes. Science. 1985;228(4700):750–752. doi: 10.1126/science.3992243. [DOI] [PubMed] [Google Scholar]
- 54.Angelakis E, et al. EEG neurofeedback: a brief overview and an example of peak alpha frequency training for cognitive enhancement in the elderly. Clin. Neuropsychologist. 2007;21(1):110–129. doi: 10.1080/13854040600744839. [DOI] [PubMed] [Google Scholar]
- 55.Hughes SW, Crunelli V. Thalamic mechanisms of EEG alpha rhythms and their pathological implications. Neuroscientist. 2005;11(4):357–372. doi: 10.1177/1073858405277450. [DOI] [PubMed] [Google Scholar]
- 56.Sherman SM. Drivers and modulators. In: Sherman SM, Guillery RW, editors. Exploring the Thalamus and Its Role in Cortical Function. Berlin: Springer; 2006. pp. 253–286. [Google Scholar]
- 57.Sitaram R, Ros T, Stoeckel L, Haller S, Scharnowski F, Lewis-Peacock J, Weiskopf N, Blefari ML, Rana M, Oblak E, Birbaumer N, Sulzer J. Closed-loop brain training: the science of neurofeedback. Nat. Rev. Neurosci. 2017;18(2):86–100. doi: 10.1038/nrn.2016.164. [DOI] [PubMed] [Google Scholar]
- 58.http://thoughttechnology.com/
- 59.https://neurotracker.net/
- 60.Cruz-Neira C, Sandin DJ, DeFanti TA, Kenyon RV, Hart JC. The CAVE: audio visual experience automatic virtual environment. Commun. ACM. 1992;35(6):64–72. doi: 10.1145/129888.129892. [DOI] [Google Scholar]
- 61.Fernandez T, Herrera W, Harmony TA, Diaz-Comas L, Santiago E, Sanchez L, Bosch J, Fernández-Bouzas A, Otero G, Ricardo-Garcell J, Barraza C, Valdés P. EEG and behavioral changes following neurofeedback treatment in learning disabled children. Clin. Electroencephalogr. 2003;34(3):145–152. doi: 10.1177/155005940303400308. [DOI] [PubMed] [Google Scholar]
- 62.Holtmann M, Steiner S, Hohmann S, Poustka L, Banaschewski T, Bölte S. Neurofeedback in autism spectrum disorders. Dev. Med. Child Neurol. 2011;53(11):986–993. doi: 10.1111/j.1469-8749.2011.04043.x. [DOI] [PubMed] [Google Scholar]
- 63.Wu W, Zhang H, Pirbhulal S, Mukhopadhyay SC, Zhang YT. Assessment of biofeedback training for emotion management through wearable textile physiological monitoring system. IEEE Sens. J. 2015;15(12):7087–7095. doi: 10.1109/JSEN.2015.2470638. [DOI] [Google Scholar]
- 64.Shen, T. W., Hsiao, T., Liu, Y. T. & He, T. Y. An ear-lead ECG based smart sensor system with voice biofeedback for daily activity monitoring. In Tencon 2008–2008 IEEE Region 10 Conference 1–6. IEEE. (2008, November).
- 65.Cox RW, Jesmanowicz A, Hyde JS. Real-time functional magnetic resonance imaging. Magn. Reson. Med. 1995;33(2):230–236. doi: 10.1002/mrm.1910330213. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The datasets generated and analysed during the current study are available from the corresponding author on reasonable request.