Abstract
Local field potentials (LFPs) are fluctuations of extracellular voltage that may reflect the physiological phenomena occurring within a volume of neural tissue. It is known that the allocation of spatial attention modulates the amplitude of LFPs in visual areas of primates. An issue that remains poorly investigated is whether and how attention modulates LFPs in executive brain areas, such as the lateral prefrontal cortex (LPFC), thought to be involved in the origins of attention. We addressed this issue by recording LFPs from multielectrode arrays implanted in the LPFC of two macaques. We found that the allocation of attention can be reliably decoded on a single-trial basis from ensembles of LFPs with frequencies >60 Hz. Using LFP frequencies <60 Hz, we could not decode the allocation of attention, but we could decode the location of a visual stimulus as well as the endpoint of saccades toward that stimulus. The information contained in the high-frequency LFPs was fully redundant with the information contained in the spiking activity of single neurons recorded from the same electrodes. Moreover, the decoding of attention using γ frequency LFPs was less accurate than using spikes, but it was twice more stable across time. Finally, decorrelating the LFP signals from the different electrodes increased decoding performance in the high frequencies by up to ∼14%. Our findings suggest that LFPs recorded from chronically implanted multielectrode arrays in the LPFC contain information about sensory, cognitive, and motor components of a task in a frequency-dependent manner.
Keywords: attention, decoding, local field potentials, multielectrode array, prefrontal cortex, primate
Introduction
Local field potentials (LFPs) are slow-voltage fluctuations in the extracellular space of neural tissue that are thought to mostly represent the aggregate of postsynaptic potentials averaged over a few hundred micrometers volume around a recording electrode (Buzsáki et al., 2012; Einevoll et al., 2013). Certain cognitive operations are known to modulate LFP oscillations. For example, allocating visual attention into the receptive field of neurons in the vicinity of a recording electrode has been associated with increases in local γ power, γ spike-field synchronization, and between-area field-field synchrony in the β and γ bands (Fries et al., 2001, 2008; Womelsdorf et al., 2006; Buschman and Miller, 2007; Gregoriou et al., 2009, 2012; Khayat et al., 2010; Bosman et al., 2012; Vinck et al., 2013). One issue that remains unclear is how much information LFP signals can provide regarding the allocation of visual attention and how this information compares with the one provided by the spiking activity of neurons in a certain brain region.
We have recently reported that the spiking activity of neuronal ensembles in lateral prefrontal cortex (LPFC) area 8A contains sufficient information to predict the allocation of covert attention on a single-trial basis (Tremblay et al., 2015). Supporting this finding, several studies have demonstrated that the LPFC is involved in target selection and attention (Petrides and Pandya, 1999; Everling et al., 2002; Lebedev et al., 2004; Petrides, 2005; Lennert and Martinez-Trujillo, 2011, 2013). Thus, we proposed that area 8A contains a neuronal map of the behavioral relevance of stimuli, and that this map can provide top-down signals to modulate the activity of visual neurons in upstream areas during the allocation of attention.
We further speculated that the neuronal ensemble spiking activity recorded from chronic multielectrode arrays (MEAs) could be instrumental in the implementation of cognitive neural prosthetics able to decode the behavioral relevance of objects across the visual field (Andersen et al., 2010). However, one potential problem with the use of spike signals recorded from chronic MEAs is that the isolation of single neurons deteriorates over short time periods (Dickey et al., 2009; Chestek et al., 2011; Perge et al., 2013), leaving LFPs as the only detectable signal. Thus, it is important to determine whether LFP signals can convey similar information as the spikes, and whether this information is sufficient for decoding cognitive signals within a behaviorally relevant timeframe.
We investigated this issue by recording LFPs from area 8A of two monkeys using chronically implanted MEAs while the animals performed a visual attention task. We examined LFP decoding accuracy across multiple frequency bands. We found that the allocation of attention could be decoded from LFPs in the 60–250 Hz range, but not from frequencies <60 Hz. High-frequency LFPs and spikes contained redundant information, similar attentional codes, and reacted similarly to distractors. Finally, decoding was lower using LFPs compared with spikes but was twice as stable over a 30 d time period and substantially improved when decorrelating the simultaneously recorded signals.
Materials and Methods
Two male macaque monkeys (Macaca fascicularis) were trained to perform a visual attention task (Fig. 1). The animals were instructed to covertly attend to one of four identical Gabor stimuli, to detect a subtle change in its orientation, and to saccade to it within 400 ms of the change to obtain a juice reward (Fig. 1A). The target Gabor appeared 363 ms earlier (cue period) than the other three distractors. After a variable delay period, orientation changes could happen in either the target (“Target” trials) or in the opposite distractor (“Distractor” trials). In the latter case, the monkey had to ignore the changing distractor and maintain fixation on the center dot until the end of the trial. In a third trial type, orientation changes occurred simultaneously in the target and in the opposite distractor (“Target + Distractor” trials), and the monkey had to saccade to the target change and ignore the distractor change. Within a given session, all three trial types were randomly interleaved, so that it was impossible for the animals to: (1) predict the location of the target, (2) know whether or not a saccade would be required, and (3) know whether the change would happen in the target, in a distractor stimulus, or in both.
Both monkeys performed above chance in all trial types: “Target,” “Target + Distractor” (both ∼80% hit rate, including fixation breaks), and “Distractor” (∼60%; Fig. 1B). The performance decrease in the “Distractor” condition is explained by the animals failing to inhibit their saccade and responding to the distractor change in a number of trials. Importantly, this was not due to the animals ignoring the cue and saccading to a change in any stimulus. If this were the case, the performance in the “Target + Distractor” trials would have been close to 50% and the performance in the “Distractor” trials would have been close to 0%.
We recorded neural activity during the different trials using a 96-channel MEA (Blackrock Microsystems) chronically implanted in area 8A of the left prefrontal cortex (Fig. 1C,D). Area 8A is a cytoarchitectonic subdivision of the LPFC located rostral to the frontal eye fields (FEFs) on the prearcuate convexity (Petrides and Pandya, 1999; Petrides, 2005). Spikes were extracted using standard thresholding and spike sorting techniques. LFPs were obtained by low-pass filtering the broadband signal at 250 Hz sampled at 1 kHz. Instantaneous power in 400 ms windows was obtained using complex wavelet convolution for each center frequency (Liebe et al., 2012). Frequency bands were defined as follows: δ (0–4 Hz), θ (4–8 Hz), α (8–12 Hz), low-β (βL: 12–20 Hz), high-β (βH: 20–30 Hz), low-γ (γL: 30–60 Hz), mid-γ (γM: 60–120 Hz), and high-γ (γH: 120–250 Hz).
The instantaneous power of each frequency band was decoded using a support-vector machine (Chang and Lin, 2011), which has been shown to reliably decode attentional signals from prefrontal cortex neurons (Astrand et al., 2014; Tremblay et al., 2015). The decoder was trained to decode both the spike and LFP signals at various epochs over the course of each trial. Depending on the epoch, the decoded information can be related to: (1) the cue position (cue epoch), (2) the attended location (attention epoch), or (3) the saccade direction (saccade epoch). The decoder was trained iteratively on four-fifths of available trials with the true label information provided. Next, the decoder's single-trial predictions were tested on an independent testing set (i.e., the remaining one-fifth of the trials) for which the true label information was not provided. This cross-validation procedure was repeated 5 times so that every trial was part of the testing set once (K-fold = 5). The chance performance of the decoder was determined by shuffling the trial labels of the training set before the cross-validation procedure.
Results
Decoding visual, attentional, and saccadic information from LFP
To decode trial information, we separated the LFP signal in different frequency bands. Figure 2 shows the decoding accuracy as a function of task epoch and frequency band. In the high-γ band (γH: 120–250 Hz), decoding accuracy reached 65% for the cue epoch (cue onset to 400 ms after cue onset), 58% for the attentional epoch (800–1200 ms after cue onset), and 75% for the saccade epoch (−200 to +200 ms after saccade onset). In the mid-γ band (γM: 60–120 Hz), cue decoding reached 48%, attention decoding 44%, and saccade decoding 50%. For frequencies <60 Hz, decoding accuracies sharply dropped near chance level (25%) for all task epochs. The decoding of cue and saccade direction recovered slightly for α (α: 8–12 Hz) and theta bands (θ: 4–8 Hz). The δ band (δ: 0–4 Hz) also displayed significant decoding of the saccade epoch but did not yield good predictions of cue position. In general, there was little attentional decoding for any frequency band lower than mid-γ (<60 Hz). Thus, decoding of attention was selective for frequencies >60 Hz.
Effects of spike leakage on decoding accuracy
High-frequency LFPs can be contaminated by frequency components of spikes recorded from the same electrode, specifically in the frequencies >60 Hz (Zanos et al., 2011). Because spikes recorded in area 8A contain sufficient information to encode the allocation of attention on a single-trial basis (Tremblay et al., 2015), it is possible that spike leakage could by itself explain the high decoding accuracy observed in the attention period for the mid- and high-γ bands (Fig. 2). To investigate this issue, we removed spike components from the recorded LFPs using the method proposed by Zanos et al. (2011). This method computes the spike-triggered average LFP traces and subtracts the signal-to-noise corrected average spike waveform from each point in the LFP signal at which a spike occurred. The despiked LFP signal is thus free from frequency components of the spikes isolated on the corresponding recording electrode. However, spikes originating from neurons isolated on distant electrodes might still contribute, although modestly (Lindén et al., 2011), to the potential fluctuations recorded from one electrode (our electrodes were spaced by 400 μm).
We conducted the decoding analysis on the spike-cleaned LFP dataset and contrasted it with the previous results. Spike cleaning reduced the decoding accuracy in the mid- and high-γ band by a maximum of 5% during the saccade epoch and 2.5% during the cue and attention epochs (Fig. 3A). There was no effect of spike cleaning in frequency bands <60 Hz, which is in agreement with spike leakages mainly affecting high-frequency LFPs (Zanos et al., 2011). Remarkably, despite the removal of spike remnants from LFP traces, cue (48%; 63%), attended (44%; 56%), and saccade (48%; 70%) position could still be decoded on a single-trial basis from both mid- and high-γ frequency bands, respectively (Fig. 3B).
Shared trial-to-trial variability, also termed noise correlations, is known to impact population coding (Averbeck et al., 2006; Cohen and Kohn, 2011) and to play an important role in the neural network activity underlying visual attention (Cohen and Maunsell, 2009; Mitchell et al., 2009; Ruff and Cohen, 2014). We previously found that decorrelating the spiking activity of single neurons by shuffling trial order led to improvements in the decoding accuracy of visual attention across the visual field (Tremblay et al., 2015). We investigated whether decorrelating the LFP signal would lead to similar beneficial effects.
We applied the same shuffling procedure to the LFP signal to destroy the temporal order of the trials and thus remove naturally occurring shared trial-to-trial variability. The procedure implies shuffling the trial order for each neuron independently, so that the responses from the different neurons in the ensemble would not be extracted from the same trial. This shuffling is performed only within subset of trials belonging to the same stimulus condition, so that the tuning of the neurons' responses is left untouched (Leavitt et al., 2013). Figure 4 displays the change in decoding accuracy for the different frequency bands relative to the unshuffled recorded data. Surprisingly, decorrelating the signals led to frequency- and epoch-specific improvements in decoding accuracy of up to 14% in the mid-γ band during the attention epoch, and of up to 10% in the α band during the saccade epoch. These improvements are much larger than what we have previously reported when destroying correlated spiking activity in the same area.
Redundancy of information between spikes and LFP
We found that both spikes and high-frequency LFPs encode information about the cue position, allocation of attention, and saccade endpoint. One question arising from this result is whether these two signals overlap in terms of their information content. To investigate this issue, we first contrasted the absolute decoding accuracy of spikes with the decoding accuracy of LFPs in each frequency band (Fig. 5A). For all LFP bands, spikes provided more accurate decoding of the cue position, allocation of attention, and saccade endpoint. This difference averaged 60% for frequency bands <60 Hz, and 25% for the mid- and high-γ bands (>60 Hz). Thus, in all cases, the spiking signal contained more information than the LFPs. We also compared the error patterns of the decoder when using the spike or the LFP signal to determine whether or not they would differ. In Figure 5B, we can see the confusion matrices for both signals and for all three epochs. We found that the patterns of error were qualitatively very similar between the two signals.
Next, we explored how the information in the LFPs from each recording site relates to the information carried by the spiking activity of single neurons recorded from the same site. To do so, we correlated the decoding accuracy of the LFPs recorded on every single electrode against the decoding accuracy of the spiking activity of units recorded on the corresponding electrode. We hypothesized that, if spikes from units around an electrode carry a large amount of information about the task, the LFP recorded from the same electrode should also be very informative. Figure 6 illustrates the correlation coefficient for each LFP frequency band and for the three task epochs (cue, attention, and saccade). We found particularly strong unit/LFP correlations for the mid- and high-γ frequency bands (r > 0.50, p < 0.001) across all epochs. Correlations of up to r = 0.70 indicate a strong relationship between the information content of the spiking signal and that of the high-frequency LFP recorded from the same electrode. This correlation was much weaker for frequency bands <60 Hz; that is, the maximum correlation coefficient obtained <60 Hz was r = 0.40 for the low-γ band (30–60 Hz).
We further compared the information content of the ensemble spiking activity with the information content of the ensemble LFPs to assess whether these two signals contain redundant, or complementary, information about the task. Decoding techniques are well suited for such a comparison between different signals because both are projected onto a common scale (i.e., decoding accuracy) (Quian Quiroga and Panzeri, 2009). In this analysis, we first entered the information contained in the spiking signal and obtained a baseline decoding accuracy. In a second step, we added the information contained in specific LFP bands and repeated the decoding analysis. Because some LFP bands contain information about the task (see Fig. 3B), this analysis could result in two possible outcomes. One outcome is that the decoding accuracy improves with the added information from LFPs. In this case, it would mean that some of the information in the LFPs is complementary to that of spikes. Alternatively, the decoding accuracy might not improve, which would imply that the information contained in the LFPs is redundant with that of the spikes.
We conducted this analysis in two different ways: adding LFP information on top of spikes, as explained above, or adding spiking information on top of LFPs. Figure 7 illustrates the decoding improvements for each added signal (blue represents LFP; red represents spikes), as a function of frequency band and task epochs. We found that, across all bands, adding the spiking information on top of the LFPs significantly improved the decoding accuracy, meaning that spikes contain novel information not contained in the LFPs. This improvement mainly reflects the higher absolute decoding accuracy of the spikes compared with the LFPs, as illustrated in Figure 5. On the other hand, adding LFP information on top of spike information did not improve the decoding accuracy, regardless of frequency band. Indeed, in some frequency bands, the decoding accuracy became worse when adding LFPs to the spikes. This is likely due to the vulnerability of the decoder to large amounts of noisy predictors. To account for this limitation, we ran a control analysis, including only the 10 best LFP channels on top of the spike signal (Fig. 7, green line). We found that the results mirrored those including all LFP channels, apart from a small benefit for mid- and high-γ signals during the attention epoch (<2%). This means that the task-related information contained in the power of the LFPs is redundant with that of the spiking activity.
Another way to investigate whether LFPs and spikes contain redundant information is by examining whether the LFPs and spiking codes are similar to one another. To assess this question, we trained the decoder on the normalized spiking signal and made single-trial predictions about task-related events using the normalized LFP signal. In Figure 8, this cross-signal decoding is contrasted with a decoder trained and tested using the same LFP signal. We found that, for high frequencies (i.e., low, mid, and high γ), it was possible to decode the cue position, allocation of attention, and saccade direction from LFP signals using a code obtained from spikes. The decoding accuracy for these bands was comparable with the one obtained by training and testing on the same LFP signals, meaning that the spiking code and the high-frequency LFP codes are very similar from a decoding perspective. We also found that above-chance decoding was possible in the lower-frequency bands, although limited to the cue and saccade epochs and with a performance much lower than the one obtained by training on the LFP signal. Thus, the similarity between LFP and spike codes varies as a function of the LFP frequency, higher frequencies being more similar to spikes than lower ones. Moreover, the fact that high-frequency LFPs can be well decoded when training with spikes further corroborates that these two signals contain similar information.
Effects of distractor interference on LFP
We have previously shown that a salient distractor transiently interferes with the ensemble spiking code of neurons in area 8A (Tremblay et al., 2015). When the distractor was successfully suppressed at a behavioral level, the code returned to a predistractor state a few hundred milliseconds after distractor offset. Here, we investigated whether the LFP ensemble code is as resilient to a salient visual distractor as the spiking code. To address this question, we obtained the baseline, predistractor, LFP ensemble code by training the decoder during the attention epoch of the task. This baseline attention code was then used to predict the allocation of attention before, during, and after the onset of the salient visual distractor. Any interference with the ensemble code caused by the distractor would be reflected as a decrease in the decoding accuracy. This procedure was applied separately for the mid- and high-γ bands, from which attention could be decoded (see Fig. 3B).
Figure 9A depicts the accuracy of decoders trained during the baseline predistractor epoch, and tested before, during and after distractor onset (Fig. 9A, left, black dashed rectangles). The line plot on the right displays the averaged results. We observed that the high-γ LFP band (blue line) shows a transient distractor-related decrease in decoding accuracy of ∼25%. This interference is very similar to the one previously observed in the spiking code (Fig. 9A, red dashed line). In contrast, the interference of the mid-γ was only 10%. This may be explained by the fact that this frequency band initially contains less information about the allocation of attention, leaving less room for interference. In absolute values, the distractor-related decrease in decoding accuracy was of 3% and 10% in the mid- and high-γ bands, respectively. Overall, both LFP band codes were resilient to distracting information, as expressed by their rebound to predistractor levels. Moreover, the relative amplitude of the interference observed in the spiking and high-γ codes was almost identical.
We further explored the effects of a salient distractor when simultaneously presented with the target stimuli (“Target + Distractor” trials). At a behavioral level, this distractor did not severely impair task performance (mean difference between “Target” and “Target + Distractor” trial types = 0.9%, CI = −0.8% to 2.6%, paired t test, p = 0.3) as opposed to when the distractor was presented alone (i.e., “Distractor” trials, see Fig. 1B). This behavioral robustness was previously found to be mirrored in the spiking code of neuronal ensembles in area 8A (Tremblay et al., 2015). We wondered whether the high-frequency LFP signal would show a similar effect. We addressed this question by training the decoder on “Target” trials and testing it on “Target + Distractor” trials. If the distractor interferes with the attention code of LFP ensemble activity, we should observe a decrease in the decoding accuracy relative to testing on “Target” trials.
The simultaneous distractor decreased decoding accuracy in the high-γ band, albeit not comparable with when the distractor was presented alone (Fig. 9B; maximum drop = 15% vs 25%). Similarly, the mid-γ band showed a slight decrease in decoding accuracy, smaller than the one observed in the high-γ band (5% vs 15%). Again, the smaller interference in the mid compared with the high-γ band could be explained by lower baseline decoding accuracy in the mid-γ band. Overall, these results mirror the behavioral observations: a distractor presented simultaneously with a target elicits a small and transient interference in both the spikes and the high-frequency LFP signal.
Decoding stability over time
The decoding stability over time is an important factor that could affect the reliability of a cognitive neural prosthetic using LFP signals from prefrontal cortex. As such, we investigated the stability of the LFP ensemble code over a prolonged period of time. We reasoned that, if the code is stable over time, it should be possible, for example, to use a code obtained on the first day of recording to decode activity recorded a month later. We used the mid- and high-γ band activity during the attention epoch to train the decoder on every session, and to test it on every other session during the same epoch. This created a “training session” by “testing session” matrix of decoding accuracies (Fig. 10A).
We found that the decoding accuracy was very stable over time. Ensemble codes obtained on one session could successfully decode the allocation of attention in another session that occurred days or weeks later. This demonstrates that the LFP coding of attention is generalizable over time, which is in agreement with previous observations in the spiking data (Tremblay et al., 2015). Importantly, this generalization was limited to the local ensemble; the same code could not be used to decode LFP signals captured by nearby electrodes in the same brain region (Fig. 10A, con 1 and con 2 rows and columns).
Finally, we contrasted the stability of the high-γ band LFP signal with the stability of spike decoding. We computed the decoding accuracy loss as a function of days for both signals (Fig. 10C) and found that both signals decayed as a function of time, although at different rates (general linear model test on β coefficients; t = 3.6, p < 0.001). The stability of the LFP signal decayed at a rate of 0.2% per day. The decay of the spiking signal was twice as fast, at a rate of 0.4% per day. These results indicate that the coding of attention is more stable across days using the LFP signal compared with using the spiking signal.
Discussion
Decoding of attention from γ frequencies
Attention-dependent modulation of γ frequency LFPs has been reported across several brain areas (Fries et al., 2001; Chalk et al., 2010; Khayat et al., 2010; Ray and Maunsell, 2011). In the LPFC, most studies reported modulation of γ LFPs in the FEFs and synchronization with activity in visual area V4 (Buschman and Miller, 2007; Monosov et al., 2008; Gregoriou et al., 2009, 2012). In general, these studies suggest that the γ signal contains information about the allocation of attention.
In agreement with these studies, we showed that the allocation of attention across the four visual field quadrants could be decoded from LFP frequencies >60 Hz recorded from the LPFC. Our results complement a previous report of single-trial decoding of attention using the simultaneous spiking activity of neurons recorded from the same area (Tremblay et al., 2015). Together, these results support the hypotheses that area 8A contains a neuronal map of the behavioral relevance of stimuli and is therefore a potential source of attentional signals that influence processing in the rest of the brain (Desimone and Duncan, 1995; Miller and Cohen, 2001).
One question arising from our results concerns the source of the attentional information contained in the mid- and high-γ frequencies. This information may be contained in the input signals arriving into area 8A and therefore be inherited from areas upstream, such as the lateral intraparietal area or the FEF (Monosov et al., 2008; Squire et al., 2013). On the other hand, it might simply reflect local spiking activity within area 8A. An insight into this question may be provided by a previous study in primary visual cortex that dissociated LFP activity in the low-γ range (30–80 Hz) from activity in the mid- and high-γ range (>80 Hz) (Ray and Maunsell, 2011). The authors concluded that LFP signals above a threshold of 50–80 Hz mainly reflect local spiking activity. Numerous supporting observations have been reported in the primary visual cortex (V1) (Belitski et al., 2008; Rasch et al., 2008), secondary somatosensory cortex (S2) (Ray et al., 2008), and posterior parietal regions (Pesaran et al., 2002; Hwang and Andersen, 2011). All these studies support a close relationship between the high-γ activity and spiking activity of cortical neurons. Here we showed that this relationship also holds true within the caudal prefrontal cortex.
Supporting this proposal, we found a strong correlation between the decoding accuracy using LFPs >60 Hz and using neuronal activity recorded from the same electrode (Fig. 6). This finding is also congruent with observations of tuning similarity between single-unit and γ frequency LFPs recorded in areas, such as middle temporal (Liu and Newsome, 2006), V1 (Xing et al., 2009), and the inferior temporal cortex (Kreiman et al., 2006). Moreover, we found that a decoder trained using spike rates can reliably decode the allocation of attention using the information contained in the γ LFPs. This decoding generalizability may be attributed to at least two factors: (1) the similarity between the tuning of multiunit clusters and γ LFPs in single electrodes; and (2) the similarity in the spatial distribution of tuned signals in the cortical volume covered by the MEA (Einevoll et al., 2013).
Finally, we compared the information content of spikes and LFPs ensemble activity. The information about the allocation of attention contained in the γ LFPs was found to be fully redundant with the one contained in the spiking activity of single units and multiunits. This result applied to all frequency bands, although it can only be interpreted correctly in bands that contain attentional information in the first place (i.e., mid- and high-γ bands). Similar observations have been previously reported in the primate motor and premotor cortices (Bansal et al., 2012). These results further support the idea that multiunit and high-γ activity are of similar nature (Ray et al., 2008; Ray and Maunsell, 2011; Einevoll et al., 2013) and start to raise questions about the functional role of these high-frequency oscillations in cortical processing (Ray and Maunsell, 2014).
Decoding from low-frequency LFPs
Evidence for the attention-dependent modulation of non-γ LFPs in LPFC is thinner. Some modulations are observed in the β band, although they seem to primarily affect movement cells in the FEF (Gregoriou et al., 2012), which may not be implicated in the attentional modulation of visual processing (Thompson et al., 2005). Along those lines, we found that the low-frequency LFPs did not contain sufficient information to accurately predict the allocation of attention. This finding apparently contradicts previous reports of attention influencing low-frequency LFPs in area middle temporal (Khayat et al., 2010; Esghaei and Daliri, 2014). This apparent discrepancy may be due to several reasons, including differences in the microstructure of visual and prefrontal areas. For example, early visual areas do not have the same neuronal density, the same connectivity with the thalamus, or the same sizes of neurons as the prefrontal cortex (Barbas and Pandya, 1989). Moreover, retinotopic maps in middle temporal are well defined and are limited to the contralateral visual field (Born and Bradley, 2005). This is very distinct from LPFC, where receptive fields can span the entire visual field and retinotopy is not present (Rainer et al., 1998; Lennert and Martinez-Trujillo, 2013; Tremblay et al., 2015).
Although we could not decode the allocation of attention from the power of low-frequency LFPs, we could decode cue position and saccade endpoint. It may be that these frequencies encode transient sensory and motor events more strongly than sustained attention. Favoring this hypothesis, LFPs in visual area V4 best reflect stimulus tuning during time intervals close to the stimulus onset (Mineault et al., 2013). This issue, however, needs further investigation.
Implications for neural prosthetics
Neural prosthetics are promising therapeutic applications that seek to empower patients by offering them control over artificial limbs or objects in their environment (e.g., computer cursor) (Donoghue, 2008). High degree-of-freedom control signals for these prosthetics can be extracted directly from neural spiking activity using chronic intracranial implants over motor and premotor cortical areas (Hochberg et al., 2006). However, one problem with chronic MEA implants used in brain–machine interface applications is that the isolation of single units deteriorates over time (Dickey et al., 2009; Chestek et al., 2011; Perge et al., 2013). This is in part due to factors such as movement of the array within the cortical tissue, as well as gliosis around the electrodes due to the immune response of the brain to a foreign object (Biran et al., 2005).
Our results show that, even in the absence of spikes, one can decode the allocation of attention using high-frequency LFP signals. However, the decoding accuracy was lower than when using spikes. This may be caused by the LFPs' larger integration volume and noisier nature (Buzsáki et al., 2012). On the other hand, we found that LFPs were twice as stable as spikes across a 30 d interval. In a case where the decoder cannot be retrained on a regular basis, the decay of the decoding accuracy over days for spikes is such that LFPs would surpass spikes decoding after a few weeks of recording. Thus, the greater stability of the LFP signal in the LPFC might come as an important advantage over spikes for long-term cognitive brain–machine interface applications.
We also found that destroying correlated activity between the electrodes led to significant improvements in decoding accuracy, as was previously found with spikes (Tremblay et al., 2015). This improvement was frequency-specific, with the largest increase in the mid-γ band (60–120 Hz) and during the attention epoch. Our results may appear at odds with observations of a previous study reporting that decorrelating LFP signals did not lead to improvements in decoding movement intentions (Markowitz et al., 2011). However, we did not observe the greatest improvement in accuracy during the movement epoch of our task, and the small improvement we observed during this epoch might be best explained by the visual transient happening just before the saccade. Thus, it may be that destroying correlations mainly improves the visual-attentional task component rather than the motor/saccade component. This issue, however, requires further testing. Importantly, our results could be instrumental in improving decoding accuracy of LFP-based neural prosthetics by decorrelating neural control signals before decoding.
Our study demonstrates that using LFP signals from a single implant in area 8A, it is possible to decode the allocation of attention across both visual hemifields. This is an advantage compared with other cortical areas that contain only a unilateral representation of the contralateral hemifield. Our results also demonstrate that the locus of attention can be decoded in advance of a saccade to the attended location. This may be instrumental to improve the performance of a neural motor prosthetics by restricting future movement goals to information that is behaviorally relevant, potentially shortening reaction times and improving movement accuracy. Moreover, area 8A is easily accessible for a surface MEAs (Maynard et al., 1997), which constitutes an important advantage compared with areas, such as FEF, which is located within a sulcus. Our study provides a proof of principle that LFP signals from this area can be used to decode the allocation of attention as well as movement intentions and therefore improve the performance of existing motor prosthetics, or promote the development of novel cognitive neural prosthetics (Donoghue, 2008; Andersen et al., 2010) to assist people with disabilities.
Footnotes
This work was supported by Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council, EJLB Foundation, and Canada Research Chair program grants to J.M.-T. The Natural Sciences and Engineering Research Council Alexander Graham Bell Canada Graduate Scholarship supported S.T. We thank Mr. Walter Kucharski, Mr. Stephen Nuara, and Mr. Rishi Rajalingham for technical support; and members of the J.M.-T. laboratory for useful comments on previous versions of this manuscript.
The authors declare no competing financial interests.
References
- Andersen RA, Hwang EJ, Mulliken GH. Cognitive neural prosthetics. Annu Rev Psychol. 2010;61:169–190. doi: 10.1146/annurev.psych.093008.100503. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Astrand E, Enel P, Ibos G, Dominey PF, Baraduc P, Ben Hamed S. Comparison of classifiers for decoding sensory and cognitive information from prefrontal neuronal populations. PLoS One. 2014;9:e86314. doi: 10.1371/journal.pone.0086314. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Averbeck BB, Latham PE, Pouget A. Neural correlations, population coding and computation. Nat Rev Neurosci. 2006;7:358–366. doi: 10.1038/nrn1888. [DOI] [PubMed] [Google Scholar]
- Bansal AK, Truccolo W, Vargas-Irwin CE, Donoghue JP. Decoding 3D reach and grasp from hybrid signals in motor and premotor cortices: spikes, multiunit activity, and local field potentials. J Neurophysiol. 2012;107:1337–1355. doi: 10.1152/jn.00781.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barbas H, Pandya DN. Architecture and intrinsic connections of the prefrontal cortex in the rhesus monkey. J Comp Neurol. 1989;286:353–375. doi: 10.1002/cne.902860306. [DOI] [PubMed] [Google Scholar]
- Belitski A, Gretton A, Magri C, Murayama Y, Montemurro MA, Logothetis NK, Panzeri S. Low-frequency local field potentials and spikes in primary visual cortex convey independent visual information. J Neurosci. 2008;28:5696–5709. doi: 10.1523/JNEUROSCI.0009-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Biran R, Martin DC, Tresco PA. Neuronal cell loss accompanies the brain tissue response to chronically implanted silicon microelectrode arrays. Exp Neurol. 2005;195:115–126. doi: 10.1016/j.expneurol.2005.04.020. [DOI] [PubMed] [Google Scholar]
- Born RT, Bradley DC. Structure and function of visual area MT. Annu Rev Neurosci. 2005;28:157–189. doi: 10.1146/annurev.neuro.26.041002.131052. [DOI] [PubMed] [Google Scholar]
- Bosman CA, Schoffelen JM, Brunet N, Oostenveld R, Bastos AM, Womelsdorf T, Rubehn B, Stieglitz T, De Weerd P, Fries P. Attentional stimulus selection through selective synchronization between monkey visual areas. Neuron. 2012;75:875–888. doi: 10.1016/j.neuron.2012.06.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Buschman TJ, Miller EK. Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices. Science. 2007;315:1860–1862. doi: 10.1126/science.1138071. [DOI] [PubMed] [Google Scholar]
- Buzsáki G, Anastassiou CA, Koch C. The origin of extracellular fields and currents: EEG, ECoG, LFP and spikes. Nat Rev Neurosci. 2012;13:407–420. doi: 10.1038/nrn3241. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chalk M, Herrero JL, Gieselmann MA, Delicato LS, Gotthardt S, Thiele A. Attention reduces stimulus-driven γ frequency oscillations and spike field coherence in V1. Neuron. 2010;66:114–125. doi: 10.1016/j.neuron.2010.03.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chang CC, Lin CJ. LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2. 2011 [Google Scholar]
- Chestek CA, Gilja V, Nuyujukian P, Foster JD, Fan JM, Kaufman MT, Churchland MM, Rivera-Alvidrez Z, Cunningham JP, Ryu SI, Shenoy KV. Long-term stability of neural prosthetic control signals from silicon cortical arrays in rhesus macaque motor cortex. J Neural Eng. 2011;8 doi: 10.1088/1741-2560/8/4/045005. 045005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cohen MR, Kohn A. Measuring and interpreting neuronal correlations. Nat Neurosci. 2011;14:811–819. doi: 10.1038/nn.2842. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cohen MR, Maunsell JH. Attention improves performance primarily by reducing interneuronal correlations. Nat Neurosci. 2009;12:1594–1600. doi: 10.1038/nn.2439. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Desimone R, Duncan J. Neural mechanisms of selective visual attention. Annu Rev Neurosci. 1995;18:193–222. doi: 10.1146/annurev.ne.18.030195.001205. [DOI] [PubMed] [Google Scholar]
- Dickey AS, Suminski A, Amit Y, Hatsopoulos NG. Single-unit stability using chronically implanted multielectrode arrays. J Neurophysiol. 2009;102:1331–1339. doi: 10.1152/jn.90920.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Donoghue JP. Bridging the brain to the world: a perspective on neural interface systems. Neuron. 2008;60:511–521. doi: 10.1016/j.neuron.2008.10.037. [DOI] [PubMed] [Google Scholar]
- Einevoll GT, Kayser C, Logothetis NK, Panzeri S. Modelling and analysis of local field potentials for studying the function of cortical circuits. Nat Rev Neurosci. 2013;14:770–785. doi: 10.1038/nrn3599. [DOI] [PubMed] [Google Scholar]
- Esghaei M, Daliri MR. Decoding of visual attention from LFP signals of macaque MT. PLoS One. 2014;9:e100381. doi: 10.1371/journal.pone.0100381. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Everling S, Tinsley CJ, Gaffan D, Duncan J. Filtering of neural signals by focused attention in the monkey prefrontal cortex. Nat Neurosci. 2002;5:671–676. doi: 10.1038/nn874. [DOI] [PubMed] [Google Scholar]
- Fries P, Reynolds JH, Rorie AE, Desimone R. Modulation of oscillatory neuronal synchronization by selective visual attention. Science. 2001;291:1560–1563. doi: 10.1126/science.1055465. [DOI] [PubMed] [Google Scholar]
- Fries P, Womelsdorf T, Oostenveld R, Desimone R. The effects of visual stimulation and selective visual attention on rhythmic neuronal synchronization in macaque area V4. J Neurosci. 2008;28:4823–4835. doi: 10.1523/JNEUROSCI.4499-07.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gregoriou GG, Gotts SJ, Zhou H, Desimone R. High-frequency, long-range coupling between prefrontal and visual cortex during attention. Science. 2009;324:1207–1210. doi: 10.1126/science.1171402. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gregoriou GG, Gotts SJ, Desimone R. Cell-type-specific synchronization of neural activity in FEF with V4 during attention. Neuron. 2012;73:581–594. doi: 10.1016/j.neuron.2011.12.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hochberg LR, Serruya MD, Friehs GM, Mukand JA, Saleh M, Caplan AH, Branner A, Chen D, Penn RD, Donoghue JP. Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature. 2006;442:164–171. doi: 10.1038/nature04970. [DOI] [PubMed] [Google Scholar]
- Hwang EJ, Andersen RA. Effects of visual stimulation on LFPs, spikes, and LFP-spike relations in PRR. J Neurophysiol. 2011;105:1850–1860. doi: 10.1152/jn.00802.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Khayat PS, Niebergall R, Martinez-Trujillo JC. Frequency-dependent attentional modulation of local field potential signals in macaque area MT. J Neurosci. 2010;30:7037–7048. doi: 10.1523/JNEUROSCI.0404-10.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kreiman G, Hung CP, Kraskov A, Quiroga RQ, Poggio T, DiCarlo JJ. Object selectivity of local field potentials and spikes in the macaque inferior temporal cortex. Neuron. 2006;49:433–445. doi: 10.1016/j.neuron.2005.12.019. [DOI] [PubMed] [Google Scholar]
- Leavitt ML, Pieper F, Sachs A, Joober R, Martinez-Trujillo JC. Structure of spike count correlations reveals functional interactions between neurons in dorsolateral prefrontal cortex area 8a of behaving primates. PLoS One. 2013;8:e61503. doi: 10.1371/journal.pone.0061503. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lebedev MA, Messinger A, Kralik JD, Wise SP. Representation of attended versus remembered locations in prefrontal cortex. PLoS Biol. 2004;2:e365. doi: 10.1371/journal.pbio.0020365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lennert T, Martinez-Trujillo J. Strength of response suppression to distracter stimuli determines attentional-filtering performance in primate prefrontal neurons. Neuron. 2011;70:141–152. doi: 10.1016/j.neuron.2011.02.041. [DOI] [PubMed] [Google Scholar]
- Lennert T, Martinez-Trujillo JC. Prefrontal neurons of opposite spatial preference display distinct target selection dynamics. J Neurosci. 2013;33:9520–9529. doi: 10.1523/JNEUROSCI.5156-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liebe S, Hoerzer GM, Logothetis NK, Rainer G. Theta coupling between V4 and prefrontal cortex predicts visual short-term memory performance. Nat Neurosci. 2012;15:456–462. doi: 10.1038/nn.3038. [DOI] [PubMed] [Google Scholar]
- Lindén H, Tetzlaff T, Potjans TC, Pettersen KH, Grün S, Diesmann M, Einevoll GT. Modeling the spatial reach of the LFP. Neuron. 2011;72:859–872. doi: 10.1016/j.neuron.2011.11.006. [DOI] [PubMed] [Google Scholar]
- Liu J, Newsome WT. Local field potential in cortical area MT: stimulus tuning and behavioral correlations. J Neurosci. 2006;26:7779–7790. doi: 10.1523/JNEUROSCI.5052-05.2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Markowitz DA, Wong YT, Gray CM, Pesaran B. Optimizing the decoding of movement goals from local field potentials in macaque cortex. J Neurosci. 2011;31:18412–18422. doi: 10.1523/JNEUROSCI.4165-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Maynard EM, Nordhausen CT, Normann RA. The Utah Intracortical Electrode Array: a recording structure for potential brain-computer interfaces. Electroencephalogr Clin Neurophysiol. 1997;102:228–239. doi: 10.1016/S0013-4694(96)95176-0. [DOI] [PubMed] [Google Scholar]
- Miller EK, Cohen JD. An integrative theory of prefrontal cortex function. Annu Rev Neurosci. 2001;24:167–202. doi: 10.1146/annurev.neuro.24.1.167. [DOI] [PubMed] [Google Scholar]
- Mineault PJ, Zanos TP, Pack CC. Local field potentials reflect multiple spatial scales in V4. Front Comput Neurosci. 2013;7:21. doi: 10.3389/fncom.2013.00021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mitchell JF, Sundberg KA, Reynolds JH. Spatial attention decorrelates intrinsic activity fluctuations in macaque area V4. Neuron. 2009;63:879–888. doi: 10.1016/j.neuron.2009.09.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Monosov IE, Trageser JC, Thompson KG. Measurements of simultaneously recorded spiking activity and local field potentials suggest that spatial selection emerges in the frontal eye field. Neuron. 2008;57:614–625. doi: 10.1016/j.neuron.2007.12.030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perge JA, Homer ML, Malik WQ, Cash S, Eskandar E, Friehs G, Donoghue JP, Hochberg LR. Intra-day signal instabilities affect decoding performance in an intracortical neural interface system. J Neural Eng. 2013;10 doi: 10.1088/1741-2560/10/3/036004. 036004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pesaran B, Pezaris JS, Sahani M, Mitra PP, Andersen RA. Temporal structure in neuronal activity during working memory in macaque parietal cortex. Nat Neurosci. 2002;5:805–811. doi: 10.1038/nn890. [DOI] [PubMed] [Google Scholar]
- Petrides M. Lateral prefrontal cortex: architectonic and functional organization. Philos Trans R Soc Lond B Biol Sci. 2005;360:781–795. doi: 10.1098/rstb.2005.1631. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Petrides M, Pandya DN. Dorsolateral prefrontal cortex: comparative cytoarchitectonic analysis in the human and the macaque brain and corticocortical connection patterns. Eur J Neurosci. 1999;11:1011–1036. doi: 10.1046/j.1460-9568.1999.00518.x. [DOI] [PubMed] [Google Scholar]
- Quian Quiroga R, Panzeri S. Extracting information from neuronal populations: information theory and decoding approaches. Nat Rev Neurosci. 2009;10:173–185. doi: 10.1038/nrn2578. [DOI] [PubMed] [Google Scholar]
- Rainer G, Asaad WF, Miller EK. Memory fields of neurons in the primate prefrontal cortex. Proc Natl Acad Sci U S A. 1998;95:15008–15013. doi: 10.1073/pnas.95.25.15008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rasch MJ, Gretton A, Murayama Y, Maass W, Logothetis NK. Inferring spike trains from local field potentials. J Neurophysiol. 2008;99:1461–1476. doi: 10.1152/jn.00919.2007. [DOI] [PubMed] [Google Scholar]
- Ray S, Maunsell JH. Different origins of γ rhythm and high-γ activity in macaque visual cortex. PLoS Biol. 2011;9:e1000610. doi: 10.1371/journal.pbio.1000610. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ray S, Maunsell JHR. Do γ oscillations play a role in cerebral cortex? Trends Cogn Sci (Regul Ed) 2014:1–8. doi: 10.1016/j.tics.2014.12.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ray S, Crone NE, Niebur E, Franaszczuk PJ, Hsiao SS. Neural correlates of high-γ oscillations (60–200 Hz) in macaque local field potentials and their potential implications in electrocorticography. J Neurosci. 2008;28:11526–11536. doi: 10.1523/JNEUROSCI.2848-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ruff DA, Cohen MR. Attention can either increase or decrease spike count correlations in visual cortex. Nat Neurosci. 2014;17:1591–1597. doi: 10.1038/nn.3835. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Squire RF, Noudoost B, Schafer RJ, Moore T. Prefrontal contributions to visual selective attention. Annu Rev Neurosci. 2013;36:451–466. doi: 10.1146/annurev-neuro-062111-150439. [DOI] [PubMed] [Google Scholar]
- Thompson KG, Biscoe KL, Sato TR. Neuronal basis of covert spatial attention in the frontal eye field. J Neurosci. 2005;25:9479–9487. doi: 10.1523/JNEUROSCI.0741-05.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tremblay S, Pieper F, Sachs A, Martinez-Trujillo J. Attentional filtering of visual information by neuronal ensembles in the primate lateral prefrontal cortex. Neuron. 2015;85:202–215. doi: 10.1016/j.neuron.2014.11.021. [DOI] [PubMed] [Google Scholar]
- Vinck M, Womelsdorf T, Buffalo EA, Desimone R, Fries P. Attentional modulation of cell-class-specific γ-band synchronization in awake monkey area v4. Neuron. 2013;80:1077–1089. doi: 10.1016/j.neuron.2013.08.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Womelsdorf T, Fries P, Mitra PP, Desimone R. γ-band synchronization in visual cortex predicts speed of change detection. Nature. 2006;439:733–736. doi: 10.1038/nature04258. [DOI] [PubMed] [Google Scholar]
- Xing D, Yeh CI, Shapley RM. Spatial spread of the local field potential and its laminar variation in visual cortex. J Neurosci. 2009;29:11540–11549. doi: 10.1523/JNEUROSCI.2573-09.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zanos TP, Mineault PJ, Pack CC. Removal of spurious correlations between spikes and local field potentials. J Neurophysiol. 2011;105:474–486. doi: 10.1152/jn.00642.2010. [DOI] [PubMed] [Google Scholar]