Kaufman et al. recently proposed a hypothesis of how cortical neuronal ensembles prepare movements without initiating them prematurely (Kaufman et al., 2014). Although novel and potentially paradigm-shifting, their model appears to contradict some of the previously reported results. Here I discuss several possible reasons for this contradiction.
Kaufman et al. recorded from neuronal populations in dorsal premotor cortex (PMd) and primary motor cortex (M1), in monkeys performing center-out arm reaching movements with straight and curved trajectories. The experimental task incorporated a delay period during which monkeys could see the target but were required to withhold movement until a trigger stimulus (Figure 1A). Kaufman et al. asked how it was possible that M1 and PMd, known to project to the spinal cord and to each other (Dum and Strick, 2002), modulated their activity in in a time- and direction-dependent manner during the delay but did not induce EMG responses. While the standard explanation has been that delay-period cortical activity is a subthreshold version of movement activity (Tanji and Evarts, 1976; Weinrich and Wise, 1982; Alexander and Crutcher, 1990; Riehle and Requin, 1995; Prut and Fetz, 1999), Kaufman et al. proposed an alternative explanation. They asserted that delay-period cortical modulations were confined to a null space with respect to the linear transformation that mapped neuronal activity into movements.
Mathematically, this transformation is expressed by the equation (Figure 1C):
(1) |
where t is time, Nj(t) is the j-th neural input, Xi(t) is the i-th motor output, and Wij is the matrix of linear regression weights. Nj(t) could correspond to single neurons, but in Kaufman's analysis they are principal components derived from the neuronal population activity. (Representation as principal components was needed to reduce data dimensionality and make inputs Nj(t) uncorrelated). For the conversion of M1 and PMd activity to arm EMGs, X(t) corresponds to the EMGs; and for the conversion of PMd activity into M1 activity, X(t) corresponds to M1 activity.
Kaufman et al. computed Wij for the movement period of the task. Next, they applied this transformation to the delay period and discovered that the values of Xi(t) were very small. An output equal to zero defines the null space of matrix W:
(2) |
The null-space and output-potent portions of cortical activity were quantified as the variance of the projection of N to the null space and row space of W, respectively. This analysis confirmed that the delay-period activity resided mostly in the null space (Figure 1E).
While this idea appears quite interesting, the linear transformation defined by Equation (1) and Figure 1C is not new. Indeed, this transformation matches the classical population-vector model proposed by Georgopoulos et al., where population output is represented by a sum of individual neuronal vectors (Georgopoulos et al., 1986; Figures 1D,F). In the Georgopoulos notation, index i corresponds to Cartesian coordinates x, y, and z; [W1j W2j W3j] is the vector for the j-th neuron; and [X1(t) X2(t) X3(t)] is the population vector. Georgopoulos et al. proposed that the population vector tracks movement trajectory (Georgopoulos et al., 1986) and/or mental transformation of a spatial cue into movement direction (Georgopoulos et al., 1989a), but did not apply their analysis to decoding EMGs from neuronal activity.
Given the correspondence between the two approaches, it is somewhat surprising that Georgopoulos et al. reached a very different conclusion based on their analysis of M1 data collected under experimental conditions (Figure 1B) that were very similar to the instructed-delay task of Kaufman et al. (Georgopoulos et al., 1989b; Smyrnis et al., 1992). Georgopoulos et al. reported that “the population vector during the delay period pointed in the direction of movement that was to be made later.” In other words, a portion of the delay-period neuronal activity did lay in the output-potent space of W, although it is not clear how substantial that portion was compared to the null-space activity (Figure 1F). (Kaufman's analysis should be run on Georgopoulos' data to clarify this issue).
What could be the reasons for the difference between the conclusions of the two groups? A comparison of Kaufman's and Georgopoulos' tasks reveals a distinction: Kaufman's monkeys maintained central eye fixation during the delay (Figure 1A), whereas Georgopoulos' monkeys did not do so (Figure 1B). This is an important difference because gaze angle significantly influences neuronal activity in both PMd (Boussaoud et al., 1998; Lebedev and Wise, 2001) and M1 (Baker et al., 1999). The effect of eye position on neuronal tuning to target location has been described in terms of an eye-centered coordinate frame (Batista et al., 1999). Furthermore, it has been shown that M1 and PMd process multiple variables during instructed delays rather than representing solely motor preparation. For example, PMd neurons represent orientation of selective spatial attention unrelated to the location of the motor target (Lebedev and Wise, 2001). In behavioral tasks that require reorienting attention and/or sensory-motor transformations, the population vector rotates from the initial focus of attention to the location of the target (Georgopoulos et al., 1989a; Wise et al., 1996). Additionally, delay-period activity of M1 and PMd neurons represents the elapsed time (Renoult et al., 2006; Lebedev et al., 2008).
Given this previous literature, it is reasonable to suggest that both Georgopoulos' and Kaufman's results were impacted by extra behavioral variables, such as eye position and orientation of spatial attention. Specifically, the central eye fixation requirement possibly affected directional tuning in Kaufman's experiments. When a monkey knows target location but should continue central fixation, a misalignment is introduced between the gaze angle, orientation of spatial attention and the prepared movement. Additionally, the presence of two foci of attention, the central fixation point and the target, could have resulted in relative-location encoding (Olson, 2003). All these factors could contribute to a rotation of the directional tuning characteristics away from the ones defined by the movement period. Somewhat similar rotations of neuronal preferred direction have been found for a variety of motor behaviors that incorporated contextually different task periods (Sergio and Kalaska, 1998; Johnson et al., 1999; Lebedev et al., 2005; Churchland and Shenoy, 2007). In Kaufman's case, the null space may have corresponded to an eye-centered coordinate frame and shifts in spatial attention rather than being a mechanism that suppresses premature movements.
An alternative possibility is that Kaufman et al. were right, but Georgopoulos et al. overlooked the contamination of their results by the eye position effects. In this view, target fixation by the eyes during both the delay and movement periods could have resulted in the similarity of neuronal tuning characteristics for these periods. Consequently, Georgopoulos' population vector would have pointed to the target both before and after the movement, reflecting the tendency for the eyes to fixate the target. By contrast, Kaufman's experimental design allowed to measure W for the arm movements more cleanly, without the confounding effect of target fixation. In this scenario, there are two possibilities for cortical representation of eye movements. The first possibility is that Kaufman's rules apply to the eye movements the same way they apply to the arm movements: oculomotor preparatory activity resides in the null space during the delay and then shifts into the output-potent space during the saccade. If this were true, literature on oculomotor tasks would have reported differences in neuronal preferred directions between the preparatory and saccade periods. Instead, Chen and Wise compared delay-period and pre-saccadic activity in supplementary eye field, and found that neuronal preferred directions were positively correlated for these periods (Chen and Wise, 1996). Furthermore, Kaufman et al. seem themselves to favor the second possibility, that eye movements are controlled differently from the arm movements. They mention that oculomotor control may employ a gate mechanism to inhibit saccades, with burst neurons and omnipause neurons in the brainstem (Evinger et al., 1982).
An additional point that I would like to make is about the interpretation of the linear transformation defined by equation 1. Kaufman et al. proposed that the regression weights, W, correspond to the actual connectivity between the cortex and spinal motoneurons, or between PMd and M1. Alternatively, the regression offers an artificial representation unrelated to any real connectivity. While linear regression utilizes correlations between the inputs and outputs to compute the weights and produce the best fit, it is well-known that correlation is not a proof of causality. Correlations between cortical neurons and EMGs could result from a common input or a common processing mechanism with multiple feedforward and feedback loops, instead of simple, unidirectional connectivity. For example, M1 neurons correlate with arm EMGs even when spike-triggered averaging fails to reveal short-latency connectivity (Zhuang et al., 2014). One could argue that the validity of a linear model could be tested using a cross-validation procedure, where trials or task conditions are left out. Although such tests have shows that the model generalizes to a slightly different motor condition (Santucci et al., 2005; Kaufman et al., 2014), common-input mechanism still remains a possibility. Linear regressions that assign weights to neurons to generate a desired output are commonly utilized in brain-machine interfaces (BMIs) (Humphrey et al., 1970; Wessberg et al., 2000; Lebedev et al., 2005; Lebedev, 2014), but the goal is different there. BMIs make use of the correlation between the inputs and outputs to optimize the decoding, no matter what neuronal mechanism underlies the correlation. BMI decoders typically would not generalize to a very different motor task, such as switching from forward walking to backward walking (Fitzsimmons et al., 2009), which indicates that such decoders do not capture the true causation. Overall, it is not surprising that a linear algorithm can be trained to transform cortical population activity into EMGs, or PMd activity into M1 activity, and that this algorithm would not generate any meaningful output when applied to a different task period. Yet, it is more surprising that the null space generates a more meaningful (or at least higher-amplitude) output.
In conclusion, it appears that future applications of the approach proposed by Kaufman et al. could benefit from the comparison with the results obtained with the traditional methods for assessing neuronal tuning properties, and considering the contribution of behavioral variables different from merely arm movement parameters. Some of the controversies between Kaufman et al. and Georgopoulos et al. could be addressed by more thoroughly testing the effect of eye position, for example fixation could be enforced universally, even during the reach, so that the eye-centered coding components of the neurons would remain fixed between the two epochs. At the modeling level, it may be useful to build a model that incorporates eye position as an additional output. Yet, one should be cautious when interpreting the modeling results in terms of neuronal connectivity. To avoid misleading population results, going back to single neurons and assessing their tuning properties individually (as in Georgopoulos approach) could be useful. Finally, when an interesting population effect is discovered, it would be helpful to examine whether this effect is a mere reflection of the features present in each individual neuron or a unique ensemble phenomenon invisible at the level of single neurons.
Author contributions
The author confirms being the sole contributor of this work and approved it for publication.
Conflict of interest statement
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
- Alexander G. E., Crutcher M. D. (1990). Preparation for movement: neural representations of intended direction in three motor areas of the monkey. J. Neurophysiol. 64, 133–150. [DOI] [PubMed] [Google Scholar]
- Baker J. T., Donoghue J. P., Sanes J. N. (1999). Gaze direction modulates finger movement activation patterns in human cerebral cortex. J. Neurosci. 19, 10044–10052. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Batista A. P., Buneo C. A., Snyder L. H., Andersen R. A. (1999). Reach plans in eye-centered coordinates. Science 285, 257–260. 10.1126/science.285.5425.257 [DOI] [PubMed] [Google Scholar]
- Boussaoud D., Jouffrais C., Bremmer F. (1998). Eye position effects on the neuronal activity of dorsal premotor cortex in the macaque monkey. J. Neurophysiol. 80, 1132–1150. [DOI] [PubMed] [Google Scholar]
- Chen L. L., Wise S. P. (1996). Evolution of directional preferences in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurosci. 16, 3067–3081. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Churchland M. M., Shenoy K. V. (2007). Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. J. Neurophysiol. 97, 4235–4257. 10.1152/jn.00095.2007 [DOI] [PubMed] [Google Scholar]
- Dum R. P., Strick P. L. (2002). Motor areas in the frontal lobe of the primate. Physiol. Behav. 77, 677–682. 10.1016/S0031-9384(02)00929-0 [DOI] [PubMed] [Google Scholar]
- Evinger C., Kaneko C., Fuchs A. F. (1982). Activity of omnipause neurons in alert cats during saccadic eye movements and visual stimuli. J. Neurophysiol. 47, 827–844. [DOI] [PubMed] [Google Scholar]
- Fitzsimmons N., Lebedev M., Peikon I., Nicolelis M. A. (2009). Extracting kinematic parameters for monkey bipedal walking from cortical neuronal ensemble activity. Front. Integr. Neurosci. 3:3. 10.3389/neuro.07.003.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Georgopoulos A. P., Crutcher M., Schwartz A. (1989b). Cognitive spatial-motor processes. Exp. Brain Res. 75, 183–194. 10.1007/BF00248541 [DOI] [PubMed] [Google Scholar]
- Georgopoulos A. P., Lurito J., Petrides M., Schwartz A., Massey J. (1989a). Mental rotation of the neuronal population vector. Science 243, 234–236. [DOI] [PubMed] [Google Scholar]
- Georgopoulos A. P., Schwartz A. B., Kettner R. E. (1986). Neuronal population coding of movement direction. Science 233, 1416–1419. 10.1126/science.3749885 [DOI] [PubMed] [Google Scholar]
- Humphrey D. R., Schmidt E., Thompson W. (1970). Predicting measures of motor performance from multiple cortical spike trains. Science 170, 758–762. 10.1126/science.170.3959.758 [DOI] [PubMed] [Google Scholar]
- Johnson M., Coltz J., Hagen M., Ebner T. (1999). Visuomotor processing as reflected in the directional discharge of premotor and primary motor cortex neurons. J. Neurophysiol. 81, 875–894. [DOI] [PubMed] [Google Scholar]
- Kaufman M. T., Churchland M. M., Ryu S. I., Shenoy K. V. (2014). Cortical activity in the null space: permitting preparation without movement. Nat. Neurosci. 17, 440–448. 10.1038/nn.3643 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lebedev M. (2014). Brain-machine interfaces: an overview. Transl. Neurosci. 5, 99–110. 10.2478/s13380-014-0212-z [DOI] [Google Scholar]
- Lebedev M. A., Carmena J. M., O'Doherty J. E., Zacksenhouse M., Henriquez C. S., Principe J. C., et al. (2005). Cortical ensemble adaptation to represent velocity of an artificial actuator controlled by a brain-machine interface. J. Neurosci. 25, 4681–4693. 10.1523/JNEUROSCI.4088-04.2005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lebedev M. A., O'doherty J. E., Nicolelis M. A. (2008). Decoding of temporal intervals from cortical ensemble activity. J. Neurophysiol. 99, 166–186. 10.1152/jn.00734.2007 [DOI] [PubMed] [Google Scholar]
- Lebedev M. A., Wise S. P. (2001). Tuning for the orientation of spatial attention in dorsal premotor cortex. Eur. J. Neurosci. 13, 1002–1008. 10.1046/j.0953-816x.2001.01457.x [DOI] [PubMed] [Google Scholar]
- Olson C. R. (2003). Brain representation of object-centered space in monkeys and humans. Annu. Rev. Neurosci. 26, 331–354. 10.1146/annurev.neuro.26.041002.131405 [DOI] [PubMed] [Google Scholar]
- Prut Y., Fetz E. E. (1999). Primate spinal interneurons show pre-movement instructed delay activity. Nature 401, 590–594. 10.1038/44145 [DOI] [PubMed] [Google Scholar]
- Renoult L., Roux S., Riehle A. (2006). Time is a rubberband: neuronal activity in monkey motor cortex in relation to time estimation. Eur. J. Neurosci. 23, 3098–3108. 10.1111/j.1460-9568.2006.04824.x [DOI] [PubMed] [Google Scholar]
- Riehle A., Requin J. (1995). Neuronal correlates of the specification of movement direction and force in four cortical areas of the monkey. Behav. Brain Res. 70, 1–13. 10.1016/0166-4328(94)00180-N [DOI] [PubMed] [Google Scholar]
- Santucci D. M., Kralik J. D., Lebedev M. A., Nicolelis M. A. (2005). Frontal and parietal cortical ensembles predict single-trial muscle activity during reaching movements in primates. Eur. J. Neurosci. 22, 1529–1540. 10.1111/j.1460-9568.2005.04320.x [DOI] [PubMed] [Google Scholar]
- Sergio L. E., Kalaska J. F. (1998). Changes in the temporal pattern of primary motor cortex activity in a directional isometric force versus limb movement task. J. Neurophysiol. 80, 1577–1583. [DOI] [PubMed] [Google Scholar]
- Smyrnis N., Taira M., Ashe J., Georgopoulos A. P. (1992). Motor cortical activity in a memorized delay task. Exp. Brain Res. 92, 139–151. 10.1007/BF00230390 [DOI] [PubMed] [Google Scholar]
- Tanji J., Evarts E. V. (1976). Anticipatory activity of motor cortex neurons in relation to direction of an intended movement. J. Neurophysiol. 39, 1062–1068. [DOI] [PubMed] [Google Scholar]
- Weinrich M., Wise S. P. (1982). The premotor cortex of the monkey. J. Neurosci. 2, 1329–1345. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wessberg J., Stambaugh C. R., Kralik J. D., Beck P. D., Laubach M., Chapin J. K., et al. (2000). Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 408, 361–365. 10.1038/35042582 [DOI] [PubMed] [Google Scholar]
- Wise S., Di Pellegrino G., Boussaoud D. (1996). The premotor cortex and nonstandard sensorimotor mapping. Can. J. Physiol. Pharmacol. 74, 469–482. 10.1139/y96-035 [DOI] [PubMed] [Google Scholar]
- Zhuang K. Z., Lebedev M. A., Nicolelis M. A. (2014). Joint cross-correlation analysis reveals complex, time-dependent functional relationship between cortical neurons and arm electromyograms. J. Neurophysiol. 112, 2865–2887. 10.1152/jn.00031.2013 [DOI] [PMC free article] [PubMed] [Google Scholar]