Abstract
The medial frontal cortex has been thought to be crucially involved in temporal structuring of behavior in monkeys and humans. We examined neuronal activity in the supplementary and presupplementary motor areas of monkeys to investigate how the nervous system deals with the coding of 16 motor sequences resulting from multiple actions involving bilateral use of the arms. We first found in both areas that this behavioral demand resulted in attribute-based representation of individual motor acts, reflecting functional (action) or anatomical (right/left arm) attributes. Actions were frequently represented according to a body-axis-centered reference frame (supination or pronation) regardless of the arm to be used. Moreover, behavioral sequences were primarily represented with respect to the action- or arm-use sequence rather than the sequence of individual movements. We propose that the two-dimensional attribute-based sequence representation provides a robust and efficient means of processing multiple behavioral sequences.
Introduction
Temporal structuring of multiple actions is one of the major requirements for the achievement of purposeful behaviors (Lashley, 1951; Tanji, 2001; Rosenbaum, 2010). Previous reports have demonstrated that neuronal activity in the medial motor areas of monkeys takes part in sequencing multiple movements performed with a limb or the eyes (Mushiake et al., 1991; Clower and Alexander, 1998; Shima and Tanji, 2000; Berdyyeva and Olson, 2010). Human studies have also indicated critical involvement of these areas in the organization of complex motor sequences (Gerloff et al., 1997; Amador and Fried, 2004). A question arises as to how these cortical areas deal with the temporal sequencing when the combination of motor sequences grows in number by involving multiple actions and body parts. One possible solution for avoiding difficulties in sequencing a large number of motor elements is the use of group-based sequencing. In group-based sequencing, a basis set of sequential attributes are used to construct each specific sequence. These attributes could consist of the sequence of limbs to be used and the sequence of actions. A motor sequence may be encoded in an attribute-based manner, and individual movements to be performed could be decoded later by the combination of multiple attributes. Is it possible for the neural system to arrange the temporal structure of motor events based on common attributes of individual movements rather than based on the individual movements themselves? To address this issue, we designed a behavioral task that required the sequencing of 16 permutations of individual movements containing common attributes in the anatomical and functional domains. The anatomical attribute was the motor effector used (body part), and the functional attribute was the action referenced in relation to the body axis or the manipulation of an object. We found that neuronal activity in the supplementary motor area (SMA) and presupplementary motor area (pre-SMA) of the Japanese monkey reflected the group-based sequence with respect to actions and effector use rather than the sequence of individual movements. These results suggest that information regarding individual movements is decomposed into functional (action) and anatomical (effector-use) attributes of the individual movements. The neuronal representation of each attribute appears to be sequentially arranged in parallel and then recombined to specify the next movement. This two-dimensional encoding of common attributes (action and effector use) is viewed as producing robust and efficient sequencing of complex motor behavior involving vast combinations of multiple movements.
Materials and Methods
Subjects and behavioral task.
The experimental subjects were two Japanese monkeys (Macaca fuscata; one male and one female; weighing 5.8–6.5 kg). The animals were cared for in accordance with the Guiding Principles for the Care and Use of Laboratory Animals of the National Institutes of Health and the Guidelines for Institutional Animal Care and Use published by our institute. We trained the monkeys to perform a bimanual sequential motor task. During the experiment, each animal sat in a primate chair holding a handle in each hand. For each trial of this task, the animals were required to perform a motor sequence consisting of two motor elements, each of which resulted in turning a handle at a deflection angle of >5°. One of four possible movements (left forearm supination or pronation, right forearm supination or pronation) was required for each of the two motor elements. The temporal order of the required motor sequence was selected pseudorandomly and altered in blocks of nine trials. Figure 1A illustrates the sequence of events in a trial within an experimental block. The first three trials in a block were performed under visual guidance of two instructional cues (visually guided trials; Fig. 1A, top). The color of the cue indicated left forearm supination (red) or pronation (blue) and right forearm pronation (yellow) or supination (green). For the remaining six trials in the block, the animal performed the movements instructed in the previous visually guided trials with no visual cues (memory-guided trials; Fig. 1A, bottom). At the beginning of a trial, the animal was required to place the two handles in neutral positions with its eyes fixated on the central fixation point (FP) on the screen in front. The monkey was required to maintain the handle placement and eye fixation for 1.5 s, during which the instructional cue for the first movement was presented for 0.5 s in the visually guided trials. Subsequently, the FP dimmed to serve as the first-movement trigger signal (first GO). The animal was required to perform the first movement within the reaction-time limit (1 s), and the handle was returned to the neutral position. After a delay period of 1 s, during which the instructional cue for the second movement was presented for 0.5 s (in visually guided trials), the animal was given the trigger signal for the second movement. A series of correct movements without a fixation break was rewarded with the delivery of juice 500 ms later, followed by a 1.5 s intertrial interval (ITI). During the ITI, the FP was not presented on the screen, and eye fixation was not required. After six memory-guided trials were completed, an auditory signal indicated the end of the current block and the beginning of a new block. A total of 16 two-movement sequences were presented (Fig. 1B). We examined the activity of individual neurons in the 16 permutations of the motor sequences. The focus of the present study was the analysis of the memory-guided trials. Typically, neuronal data collected during 12 memory-guided trials for each series of correct movements were included in the data file.
Reference frames for action representation.
The term “action” has been used to indicate various aspects of motor events (Rizzolatti et al., 2001; Hoshi and Tanji, 2006). In the present study, “action” referred specifically to the functional attribute of a movement, whereas “arm use” referred to an anatomical attribute (i.e., left or right forearm). Because each movement was a combination of action and arm use, the task required the animals to perform two-dimensional sequencing in terms of action and arm use. The present study used two reference frames to define an action: (1) a body-symmetric frame (pronation or supination), representing action in terms of movement toward or away from the longitudinal axis of the body (Fig. 1C, top); and (2) an object-manipulative frame (turning a handle to the left or right), representing action with regard to the object to be manipulated (Fig. 1C, bottom). For example, in the body-symmetric reference frame, left-arm and right-arm pronation were grouped together to constitute the action “pronation.” In the object-manipulative reference frame, left-arm pronation and right-arm supination were grouped together to constitute the action “rightward turn of the handle,” whereas left-arm supination and right-arm pronation constituted the action “leftward turn of the handle.” In the following, action is referred to in the body-symmetric or object-manipulative reference frame.
Surgical and recording methods.
After 18 months of training, the monkeys performed the memory-guided trials at the correct rate of >90%. An acrylic recording chamber and head-fixation bolts were then implanted on the skull of each animal under aseptic conditions using pentobarbital sodium anesthesia (30 mg/kg, i.m.) with atropine sulfate. Antibiotics and analgesics were used to prevent postsurgical infection and pain. After complete recovery from the surgery, neuronal activity was recorded in the medial part of the frontal cortex using glass-insulated Elgiloy microelectrodes, which were inserted through the dura mater using a hydraulic microdrive (MO-81; Narishige). We confirmed that the chamber had been successfully placed to cover the bilateral SMA and pre-SMA (Fig. 1D) based on physiological criteria established previously (Matsuzaka et al., 1992). Online data collection was performed using a multichannel acquisition processor and spike-sorting software (Plexon). Sorted unit activities were stored with a record of behavioral events on a computer hard drive. Statistical analyses were performed using the software package R (version 2.15.2; http://www.R-project.org/; R Development Core Team). Electromyography was performed using a pair of silver wire electrodes inserted into muscles studied. We recorded the activity of 46 forelimb and axial muscles while recording neuronal activity. Although these muscles exhibited movement-related activity, no consistent changes in activity occurred before the execution of movement. We confirmed that no task-related changes occurred in muscle activity (in forelimb muscles) of the non-instructed arm and that no arm deflection was detectable. Eye position was monitored using an infrared corneal-reflection-monitoring system at 1 kHz (Millennium G200; Matrox).
Statistical modeling to characterize neuronal selectivity.
A model-based statistical analysis of neuronal activity was used to characterize neuronal selectivity in terms of common attributes of movements and individual movements. This analysis systematically set up statistical models that represented the distribution of spike counts across all permutations of the first and second movements. Figure 2 shows the three sets of models we considered: the first and second motor-element-selective models (A) and the sequence-selective models (B). As described below, each set was further divided into attribute-coding models and a movement-based coding model. A model consisted of m Gaussian distributions of spike counts with the same variance but different means. A value of 2, 4, or 16 was assigned to m according to the statistical model chosen.
The first motor-element-selective models consisted of the body-referenced action model, the object-referenced action model, the arm model, and the movement model (Fig. 2A, top, from left to right). The body-referenced action model assumed two Gaussian distributions of spike counts (m = 2) with the same variance but different means according to the body-referenced action (pronation or supination). Similarly, we assumed two Gaussian distributions (m = 2) of spike counts for the object-referenced action model (turn left or right) and the arm model (left or right forearm). These three models were categorized as attribute-coding models because each model represented a functional or anatomical attribute of individual movements. For the remaining first movement model, we assumed four Gaussian distributions of spike counts (m = 4) with respect to the four movements (left forearm supination, left forearm pronation, right forearm pronation, or right forearm supination). This model was categorized as a movement-based coding model. The design of the second element-selective models (Fig. 2A, bottom) was similar to that of the first element-selective models.
The sequence-selective models consisted of four models: (1) the body-referenced action-sequence model; (2) the object-referenced action-sequence model; (3) the arm-sequence model; and (4) the movement-based sequence model (Fig. 2B, from left to right). The body-referenced action-sequence models assumed four Gaussian distributions (m = 4) of spike counts with the same variance but different means according to the sequences of body-referenced action (pronation–pronation, pronation–supination, supination–pronation, or supination–supination). Similarly, we assumed four Gaussian distributions (m = 4) for the object-referenced action-sequence model regarding the direction of handle rotation (turn left–turn left, turn left–turn right, turn right–turn left, and turn right–turn right) and the arm-sequence model (left arm–left arm, left arm–right arm, right arm–left arm, and right arm–right arm). These three models were categorized as attribute-coding models. The movement-based sequence model assumed independent Gaussian distributions of spike counts with respect to the 16 possible motor sequences (m = 16). This model was categorized as a movement-based coding model.
The null hypothesis of no systematic changes in neuronal spike count in a motor element or motor sequence was tested by postulating the null model consisting of a Gaussian distribution of spike counts (m = 1). Given a model consisting of m Gaussian distributions, we obtained the set of parameters (m means and one common variance) that maximized the likelihood of the model and calculated the maximum likelihood (L) by the maximum-likelihood estimation as reported previously (Sakamoto et al., 1986). The number of estimated free parameters for a model was thus m + 1.
Model evaluation and classification of neuronal activity.
We calculated a Bayesian information criterion (BIC) value to measure the goodness of fit of each model to neuronal activity as follows:
In this formula, L denotes the maximum likelihood of a given model, and N denotes the number of trials (Burnham and Anderson, 2002). The second term penalizes the use of additional free parameters. We selected the model with the smallest BIC value as the best model to characterize the activity of a neuron. Neuronal selectivity was classified according to the best model.
The interval used in the data analysis started 1.5 s before the onset of the first movement and ended at the onset of the second movement. The time course of neuron selectivity was determined by applying the model-based statistical analysis to the distribution of spike counts observed in a 200 ms centered sliding window that stepped across the analytic interval in 20 ms increments. We defined a neuron as “task related” if its activity matched any statistical model other than the null model for at least three consecutive windows.
A neuron was classified as arm-sequence selective if its activity was arm-sequence selective for whichever three consecutive windows during the interval analyzed. In this case, the onset time of sequence selectivity was defined as the first instance in which the activity satisfied the criterion. Neurons that were selective for all three sequence types (body-referenced action sequence, object-referenced action sequence, or movement sequence) and their onset times of sequence selectivity were defined in similar ways. If the activity of a neuron corresponded to two or more sequence-selective models at different onset times, it was classified according to the sequence-selective model to which it corresponded in the greatest number of windows. Assuming a Poisson distribution for the spike counts, the aforementioned analysis was performed using raw spike counts and square-root-transformed spike counts (Zar, 2010), and both counts yielded similar results.
To provide support for our BIC-based method of classification, we also performed a post hoc likelihood-ratio test to classify neuronal activity into either attribute coding or movement-based coding. This test gave the same classification as BIC did for >96% of neuronal data. Thus, we applied BIC-based classification for the present statistical analysis. To have a descriptive measure of assessing how well the best model outperformed the other models, we computed the difference in BIC (ΔBIC) between the best model and the second-best model across all the analytic time windows for all the recorded neurons. The median ΔBIC resulted in 2.23 for the pre-SMA and 2.19 for the SMA. According to the criteria established by Raftery (1995), both of these values indicate positive or stronger evidence in favor of the best model for a majority of total analytic time windows. The difference of the median ΔBIC obtained in the two areas was not significant (Mann–Whitney U test, W = 9.82 × 109, p = 0.16).
Results
Both monkeys performed the behavioral task with a success rate of >94% based on memory. The analysis of neuronal activity focused on the memory-guided trials. We analyzed activity of 911 neurons recorded in the pre-SMA and 539 in the SMA. Of these, a total of 891 pre-SMA and 532 SMA neurons were defined as task related and analyzed further. The following section addresses the issue of neuronal selectivity for individual motor elements and, subsequently, selectivity for motor sequences based on the perspectives of attribute coding and movement-based coding.
Selective activity for individual motor elements
We examined whether neuronal activity preceding the forthcoming motor elements was coded as individual movements or as their common attributes. During the 200 ms window immediately preceding the onset of the first movement (first premovement period), 306 of 891 (34%) pre-SMA neurons and 271 of 532 (51%) SMA neurons were found to be first motor-element selective. Coding the motor element based on an individual movement is the simplest form of motor-element selectivity. An example of such a neuron in the SMA is shown in Figure 3A. This neuron was most active before right forearm supination. According to the model-based statistical analysis, this neuron coded individual movements for the first motor element. In contrast, neuronal activity representing either of the two common attributes (i.e., action or arm use) was classified as attribute coding. An example of an attribute-coding neuron in the pre-SMA is shown in Figure 3B. Activity was selectively enhanced when the impending first movement was supination, regardless of arm use. This neuron was classified as a neuron encoding the first action. The SMA neuron shown in Figure 3C fired preferentially before using the left arm for the first motor element (regardless of action) and was classified as arm-use selective. In summary, the majority of neurons were attribute coding: 81% (248 of 306) in the pre-SMA and 69% (187 of 271) in the SMA (Fig. 3D).
Of the first motor-element-selective neurons, the frequency of action-selective neurons was significantly greater in the pre-SMA (159 of 306, 52%) than in the SMA (92 of 271, 34%) neurons (p = 9.0 × 10−6 by Fisher's exact test; Fig. 3D, red bars). In contrast, the proportion of movement-selective neurons (movement-based coding neurons indicated by purple bars) was significantly greater in the SMA (84 of 271, 31%) than in the pre-SMA (58 of 306, 19%; p = 5.6 × 10−4). The proportion of arm-use-selective neurons (blue bars) was greater in the SMA (35%) than in the pre-SMA (29%), although the difference was not significant.
We performed the aforementioned analysis for the neuronal activity during the 200 ms window immediately preceding the onset of the second movement (second premovement period) and found similar trends in the distribution of coding selectivity for the second motor-element-selective neurons. Overall, 317 of 891 (36%) pre-SMA neurons and 278 of 532 (52%) SMA neurons were classified as second element selective. An example of an action (pronation)-selective neuron is shown in Figure 4A. The majority of second element-selective neurons were attribute coding (Fig. 4B): 81% (256 of 317) of neurons in the pre-SMA and 64% (177 of 278) of neurons in the SMA. The proportion of action-selective neurons (red bars) was significantly greater in the pre-SMA (169 of 317, 53%) than in the SMA (85 of 278, 31%; p = 3.6 × 10−8 by Fisher's exact test). In contrast, the proportion of arm-use-selective neurons (blue bars) was greater in the SMA (33%) than in the pre-SMA (27%), although the difference was not significant. The proportion of movement-selective neurons (movement-based coding neurons indicated by purple bars) was significantly greater in the SMA (101 of 278, 36%) than in the pre-SMA (61 of 317, 19%; p = 4.7 × 10−6).
Dominance of body-symmetric reference frame for action representation
Neuronal activity representing action was characterized according to two reference frames for controlling action: (1) body-symmetric and (2) object-manipulative (Fig. 1C and Materials and Methods). We compared the proportion of neurons coding action in the body-symmetric reference frame and in the object-manipulative reference frame to determine whether one reference frame was dominant. We found that action was represented primarily in the body-symmetric reference frame. In the pre-SMA, the majority of neurons (112 of 159, 70%) were classified as body-referenced action selective, whereas 47 of 159 (30%) neurons showed selectivity for object-referenced action. The proportion of the neurons selective for body-referenced action was significantly greater than chance (binomial test, p = 1.3 × 10−7). Furthermore, body-symmetric reference frame dominance was also observed in the SMA (55 of 92, 60%). The same comparison for neuronal activity during the second premovement period yielded similar results.
Sequence-selective activity: two-dimensional sequencing with respect to action and arm use
The model-based statistical analysis to classify task-related neuronal activity (see Materials and Methods and Fig. 2) revealed that 422 of 891 (47%) pre-SMA and 260 of 532 (49%) SMA neurons were motor-sequence selective. The simplest form of motor-sequence selectivity is coding the motor sequence based on individual movements. An example neuron fired preferentially when the first movement was left pronation and when the forthcoming second movement was left supination (Fig. 5A). However, such movement-based coding was found in only a minority of motor-sequence-selective neurons in the pre-SMA (45 of 422, 11%) and SMA (40 of 260, 15%) (Fig. 5D, purple bars). More often, the neuronal activity exhibited two types of group-based sequence selectivity, preferring the sequence with regard to a common attribute of the two intended movements. An example of the first type is shown in Figure 5B, where neuronal activity preferentially increased when the first movement was left supination (LS) and the second movement was left or right supination (LS or RS), or when the first movement was right supination (RS) followed by left or right supination (LS or RS). This neuronal activity was deemed selective for the supination–supination sequence (regardless of arm use) and was classified as action-sequence selective. The second type of neuronal activity preferring sequences of a common attribute is shown in Figure 5C. Activity was preferentially enhanced if the first movement was to be performed with the right forearm and the second movement involved the left forearm. This type of activity was classified as selective for the arm-use sequence. Overall, 89% (377 of 422) of pre-SMA and 85% (220 of 260) of SMA neurons were selective for either the action sequence or arm-use sequence; these were regarded as coding the sequence in terms of motor attributes. The proportion of action-sequence-selective neurons (Fig. 5D, red bars) was significantly greater in the pre-SMA (210 of 422, 50%) than in the SMA (99 of 260, 38%; p = 0.0019 by Fisher's exact test). In contrast, the proportion of arm-sequence-selective neurons (blue bars) was significantly greater in the SMA (121 of 260, 47%) than in the pre-SMA (167 of 422, 40%; p = 0.044). These results demonstrate that, at the single-neuron level, temporal structuring of movements is formulated along two dimensions with regard to action and arm use and that neurons in the medial motor areas primarily use two-dimensional coding, rather than movement-based coding, to represent multiple motor sequences.
To determine whether the time course of the two types of sequence selectivity differed during the task, we plotted the time of appearance of sequence-selective activity for action-sequence-selective neurons (Fig. 6A) and arm-sequence-selective neurons (Fig. 6B) relative to the onset of the first and second movements. Although selective activity appeared over a wide range of times in both types, onset of activity selective for action sequence tended to occur earlier than activity selective for arm sequence in the pre-SMA. To test for statistically significant differences in the time course, we compared the percentage of early-onset action-sequence-selective and arm-sequence-selective neurons before the onset of the first movement. In the pre-SMA, 106 of 210 (50.5%) action-sequence-selective neurons and 66 of 167 (39.5%) arm-sequence-selective neurons were classified as early onset. The action-sequence-selective neurons included a significantly greater percentage of early-onset neurons than did the arm-sequence-selective neurons (Fisher's exact test, p = 0.022). However, the percentage of early-onset action-sequence-selective neurons (43 of 99, 42.4%) in the SMA was not significantly different from that of the arm-sequence-selective neurons (47 of 121, 38.8%; p = 0.29). The onset times of sequence selectivity were examined in greater detail by calculating the cumulative fraction of neurons that exhibited either type of sequence selectivity as a function of time relative to the onset of the first movement (Fig. 6C). In the pre-SMA, selectivity for the action sequence emerged significantly earlier than selectivity for the arm sequence (Kolmogorov–Smirnov test, D = 0.29, p = 7.5 × 10−6). Moreover, the median time for action-sequence selectivity (−440 ms) was significantly less than that for arm-sequence selectivity (60 ms; W = 14405, p = 4.4 × 10−5 by Mann–Whitney U test). A similar trend was observed in the SMA, although the differences were not significant. These results indicate that neural processing of attribute-based sequencing occurs earlier for the functional attribute (action) than for the anatomical attribute (arm use) in the pre-SMA.
Robustness and efficiency of two-dimensional coding
The predominance of neuronal activity representing action sequence and arm-use sequence raises the question of why two-dimensional encoding is more highly favored than movement-based sequence encoding. Considered from the perspective of information representation by a neuronal population, we find relevant literature that tackled the problem with regard to either robustness or efficiency (Rieke, 1996; Simoncelli and Olshausen, 2001; Sreenivasan and Fiete, 2011). We hypothesized that two-dimensional coding has advantages from the standpoint of robustness and efficiency in encoding behavioral sequences. To visualize this hypothesis, we constructed two neural network models: (1) a modular network that used two-dimensional coding; and (2) a non-modular network that used movement-based coding (Fig. 7) based on the framework of formal models proposed previously (Louie, 1985; Birkhoff, 1993; Hatakeyama and Tsuda, 2007). The modular network (Fig. 7A) consisted of two independent modules: (1) a module for functional attribute (action module); and (2) one for anatomical attribute (arm-use module). We assumed that each module was equipped with processing units and neural elements; a processing unit specified a particular sequence of either attribute, whereas a neural element represented action or arm use occurring in a sequence. For the non-modular network (Fig. 7B), we assumed 4 × 4 = 16 processing units, each of which corresponded to a particular sequence of individual movements. Figure 7 shows both networks operating to perform an example motor sequence “left forearm pronation–left forearm supination.” We examined the performance of these two networks in terms of robustness and efficiency.
The robustness (R) of a network was quantitatively estimated as the probability that all the processing units would produce correct signals (performance correct rate) against the accumulation of errors. Assuming that an error independently occurs with the probability p in each processing unit, R = (1 − p)8 for the modular network, whereas R = (1 − p)16 for the corresponding non-modular network. Clearly, the network performance deteriorates more rapidly in the non-modular network than in the modular one as the error probability p increases (Fig. 7C).
The efficiency of the two networks was compared by defining the search cost (C) for each network as the expected number of searches needed to specify a particular set of processing units. This C is a basis to calculate running time (or time complexity) of a search algorithm in computer science (Cormen et al., 2009). Generally, when searching for a particular unit in a list that contains N units, C is given as (1 + 2 + … + N)/N = (N + 1)/2 using a linear search (Knuth, 1998). For the non-modular network where N = 4 × 4 (Fig. 7B), C = (16 + 1)/2 = 8.5. For the corresponding modular network (Fig. 7A), a pair of appropriate processing units should be searched from two modules. Here, C is given as a pair of (4 + 1)/2, i.e., C = 5. To generalize this estimation in terms of the sequence length (k), let us consider k-element motor sequences consisting of pronation or supination of either forearm. To represent all the possible k-element sequences with a non-modular network, N = 4k processing units are required. Here, C for the determination of a specific processing unit in the non-modular network should be given by (4k + 1)/2. For the corresponding modular network, C is given as a pair of (2k + 1)/2, i.e., C = 2k + 1. Apparently, the search cost increases more rapidly in the non-modular network than in the modular one as the sequence length k increases (Fig. 7D). These calculations demonstrate the greater efficiency of the modular network over the non-modular one.
Discussion
We analyzed neuronal activity in the medial motor areas while monkeys performed a motor task that required temporal organization of 16 different sequences of bilateral arm movements. The primary aim was to determine whether neural encoding of as many as 16 motor sequences required group-based neuronal representation of movements with respect to common attributes in the functional or anatomical domain. Examination of the neuronal activity immediately preceding the execution of individual movements revealed that the representation of each forthcoming motor element in the task was primarily dependent on attribute coding in terms of action (either supination or pronation) or arm use (right or left). A subsequent examination of neuronal activity representing motor sequences revealed that a significant proportion of the activity reflected action or arm-use sequences rather than individual movement sequences per se, suggesting a predominance of two-dimensional encoding of behavioral sequences in the medial motor areas.
Group coding of functional/anatomical attributes and dominance of the body-symmetric reference frame
An analysis of the neuronal activity representing each motor element in the behavioral task revealed that the majority of neurons reflected the functional or anatomical attributes of individual movements. This tendency was more pronounced in the pre-SMA than in the SMA. Attribute coding of motor elements was observed in action-selective neurons (for functional attribute) and arm-use-selective neurons (for anatomical attribute). Action-selective neurons were more abundant in the pre-SMA than in the SMA. This finding agrees with the previous study (Fujii et al., 2002) supporting the view that the pre-SMA plays a role in effector-independent motor control. Our novel finding as to the neuronal representation of action is that the body-symmetric reference frame dominates the object-manipulative reference frame when pronation and supination are performed without visuospatial cues. Previous studies looking into the preferential use of homologous muscle activation (Kelso, 1984; Kennerley et al., 2002; Carson, 2005) suggest that movements may be grouped according to the longitudinal axis of the body using a mirror-symmetric reference frame. Nevertheless, other potential reference frames cannot be ruled out; more than one reference frame can coexist, and the prevalence of one over the other may depend on the context of the task (Swinnen and Wenderoth, 2004).
In contrast, we observed more arm-use-selective neurons in the SMA than in the pre-SMA. This observation is in line with a study using an arm-target selection task (Hoshi and Tanji, 2004). The medial motor areas are closely interconnected with the motor areas in the contralateral hemisphere (Pandya and Vignolo, 1971). Thus, the coexistence of action-selective activity and arm-use-selective activity may be useful to inform the contralateral hemisphere of action and arm use planned in the ipsilateral side (Brinkman, 1984; Tanji et al., 1987).
We found a small but sizeable number of neurons that were selective for individual movements, representing the effector and action elements of each movement. Such movement-selective neurons were more prevalent in the SMA than in the pre-SMA. Our results suggest that the pre-SMA is more involved in the abstract representation of motor elements than the SMA, whereas the SMA plays a greater role in more direct aspects of motor control. However, SMA neurons may not be involved substantially in specifying motor parameters (Tanji, 1996), encoding muscle activity (Alexander and Crutcher, 1990), or the timing of motor initiation (Tanji and Kurata, 1982; Scangos and Stuphorn, 2010). This view is supported by differences in the anatomical connectivity of the two areas. The SMA, but not the pre-SMA, has direct connections to the primary motor cortex and spinal cord (Dum and Strick, 1991; Luppino et al., 1993), whereas the pre-SMA receives afferent projections from the dorsolateral prefrontal cortex (Luppino et al., 1993; Lu et al., 1994).
Two-dimensional attribute coding of motor sequences based on action and arm use
The majority of neurons represented motor sequences with respect to functional (action) or anatomical (arm use) attributes of the individual components of the motor task. Only a small fraction of neurons represented individual movement sequences. Examination of the time of occurrence of sequence-selective activity revealed that the selectivity appeared in a wide range of the task periods. These findings are taken to indicate that neurons in the two medial motor areas take part in representing the behavioral sequences in a two-dimensional manner, with one involved in coding the action sequence and the other in coding the arm-use sequence. We noted that sequence-selective activity with regard to action emerged earlier than selectivity for arm use, despite considerable overlap. This finding is consistent with a report that suggested the role of the pre-SMA in the initiation of overlearned motor sequences or sequence chunk (Kennerley et al., 2004).
The crucial importance of the medial motor areas in the temporal organization of sequential actions has been inferred based on research in a wide range of fields (Luria, 1966; Laplane et al., 1977; Brinkman, 1984; Mushiake et al., 1991; Clower and Alexander, 1998; Grafton et al., 1998; Shima and Tanji, 2000; Berdyyeva and Olson, 2010). However, these studies did not address the way in which the nervous system processes a large number of motor sequences. A previous study addressed this problem from the perspective of categorization of motor sequences, and prefrontal neurons were shown to encode motor sequences in a category-based manner (Shima et al., 2007). In contrast, the present study dealt with even greater number of sequences involving bilateral appendages, revealing two-dimensional coding of motor sequences in the medial motor areas based on common attributes of the individual movements.
One of our novel findings as to neural encoding of motor sequences is the demonstration of the neural correlates of effector-independent motor sequencing in a nonspatial functional domain (i.e., action-sequence-selective neurons). The notion that representation of motor sequences can occur independently of effectors is supported by previous literature (Keele et al., 1995; Grafton et al., 1998; Hikosaka et al., 1999), although these reports dealt with visuospatial motor sequencing. More recently, involvement of the SMA in the intermanual transfer of motor skills was demonstrated (Perez et al., 2008). Conversely, our finding of arm-sequence-selective neurons suggests that the temporal order of effector use is regulated by the medial motor areas. This view is supported by a clinical report on patients with lesions in the medial motor areas who had difficulty in changing effector use smoothly from one hand to the other (Luria, 1966). Our findings of a substantial number of action- and arm-sequence-selective neurons and apparent differences in the time course of their appearance indicate that the neural mechanisms controlling behavioral sequences is internally decomposed into parallel processes (i.e., action sequencing and arm-use sequencing). Our study did not facilitate decomposition with the use of sensory instruction signals, and we believe that distinct sequencing modules are internally generated to subserve action-based and effector-based sequencing.
Conclusion
When confronted with the task of processing a large number of behavioral sequences involving bilateral use of the arms, neuronal activity in the SMA and pre-SMA reflects group-based representation of the functional (action) and anatomical (arm use) attributes of the individual movements. The behavioral sequence is primarily represented with respect to action or arm use rather than as the order of individual movements. The two-dimensional coding is viewed as producing robust and efficient processing of sequential information by neuronal networks in the medial motor areas. These findings provide the basis for understanding mechanisms of impairments in sequential behavior among patients with lesions in the medial motor area (Gentilucci et al., 2000) or the basal ganglia with which the medial frontal cortex is closely linked (Marsden, 1984; Graybiel, 1998).
Footnotes
This work was supported by grants from the Core Research for Evolutional Science and Technology, Japan Science and Technology Agency (T.N., H.M.), and a Grant-in-Aid for Scientific Research on Innovative Areas “Neural Creativity for Communication (Number 4103)” (Grant 24120702) of the Ministry of Education, Culture, Sports, Science, and Technology (T.N., R.H., H.M., I.T.). We thank M. Kurama, Y. Takahashi, and M. Takahashi for technical assistance and animal care. We thank H. Watanabe for mathematical simulation.
The authors declare no competing financial interests.
References
- Alexander GE, Crutcher MD. Preparation for movement: neural representations of intended direction in three motor areas of the monkey. J Neurophysiol. 1990;64:133–150. doi: 10.1152/jn.1990.64.1.133. [DOI] [PubMed] [Google Scholar]
- Amador N, Fried I. Single-neuron activity in the human supplementary motor area underlying preparation for action. J Neurosurg. 2004;100:250–259. doi: 10.3171/jns.2004.100.2.0250. [DOI] [PubMed] [Google Scholar]
- Berdyyeva TK, Olson CR. Rank signals in four areas of macaque frontal cortex during selection of actions and objects in serial order. J Neurophysiol. 2010;104:141–159. doi: 10.1152/jn.00639.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Birkhoff G. Lattice theory. Providence, RI: American Mathematical Society; 1993. [Google Scholar]
- Brinkman C. Supplementary motor area of the monkey's cerebral cortex: short- and long-term deficits after unilateral ablation and the effects of subsequent callosal section. J Neurosci. 1984;4:918–929. doi: 10.1523/JNEUROSCI.04-04-00918.1984. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burnham KP, Anderson DR. Model selection and multimodel inference: a practical information-theoretic approach. New York: Springer; 2002. [Google Scholar]
- Carson RG. Neural pathways mediating bilateral interactions between the upper limbs. Brain Res Rev. 2005;49:641–662. doi: 10.1016/j.brainresrev.2005.03.005. [DOI] [PubMed] [Google Scholar]
- Clower WT, Alexander GE. Movement sequence-related activity reflecting numerical order of components in supplementary and presupplementary motor areas. J Neurophysiol. 1998;80:1562–1566. doi: 10.1152/jn.1998.80.3.1562. [DOI] [PubMed] [Google Scholar]
- Cormen TH, Leiserson CE, Rivest RL, Stein C. Introduction to algorithms. Cambridge, MA: Massachusetts Institute of Technology; 2009. [Google Scholar]
- Dum RP, Strick PL. The origin of corticospinal projections from the premotor areas in the frontal lobe. J Neurosci. 1991;11:667–689. doi: 10.1523/JNEUROSCI.11-03-00667.1991. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fujii N, Mushiake H, Tanji J. Distribution of eye- and arm-movement-related neuronal activity in the SEF and in the SMA and Pre-SMA of monkeys. J Neurophysiol. 2002;87:2158–2166. doi: 10.1152/jn.00867.2001. [DOI] [PubMed] [Google Scholar]
- Gentilucci M, Bertolani L, Benuzzi F, Negrotti A, Pavesi G, Gangitano M. Impaired control of an action after supplementary motor area lesion: a case study. Neuropsychologia. 2000;38:1398–1404. doi: 10.1016/S0028-3932(00)00044-0. [DOI] [PubMed] [Google Scholar]
- Gerloff C, Corwell B, Chen R, Hallett M, Cohen LG. Stimulation over the human supplementary motor area interferes with the organization of future elements in complex motor sequences. Brain. 1997;120:1587–1602. doi: 10.1093/brain/120.9.1587. [DOI] [PubMed] [Google Scholar]
- Grafton ST, Hazeltine E, Ivry RB. Abstract and effector-specific representations of motor sequences identified with PET. J Neurosci. 1998;18:9420–9428. doi: 10.1523/JNEUROSCI.18-22-09420.1998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Graybiel AM. The basal ganglia and chunking of action repertoires. Neurobiol Learn Mem. 1998;70:119–136. doi: 10.1006/nlme.1998.3843. [DOI] [PubMed] [Google Scholar]
- Hatakeyama M, Tsuda I. Internal logic viewed from observation space: theory and a case study. Biosystems. 2007;90:273–286. doi: 10.1016/j.biosystems.2006.09.031. [DOI] [PubMed] [Google Scholar]
- Hikosaka O, Nakahara H, Rand MK, Sakai K, Lu X, Nakamura K, Miyachi S, Doya K. Parallel neural networks for learning sequential procedures. Trends Neurosci. 1999;22:464–471. doi: 10.1016/S0166-2236(99)01439-3. [DOI] [PubMed] [Google Scholar]
- Hoshi E, Tanji J. Differential roles of neuronal activity in the supplementary and presupplementary motor areas: from information retrieval to motor planning and execution. J Neurophysiol. 2004;92:3482–3499. doi: 10.1152/jn.00547.2004. [DOI] [PubMed] [Google Scholar]
- Hoshi E, Tanji J. Differential involvement of neurons in the dorsal and ventral premotor cortex during processing of visual signals for action planning. J Neurophysiol. 2006;95:3596–3616. doi: 10.1152/jn.01126.2005. [DOI] [PubMed] [Google Scholar]
- Keele S, Jennings P, Jones S, Caulton D, Cohen A. On the modularity of sequence representation. J Motor Behav. 1995;27:17–30. doi: 10.1080/00222895.1995.9941696. [DOI] [Google Scholar]
- Kelso JA. Phase transitions and critical behavior in human bimanual coordination. Am J Physiol. 1984;246:R1000–R1004. doi: 10.1152/ajpregu.1984.246.6.R1000. [DOI] [PubMed] [Google Scholar]
- Kennerley SW, Diedrichsen J, Hazeltine E, Semjen A, Ivry RB. Callosotomy patients exhibit temporal uncoupling during continuous bimanual movements. Nat Neurosci. 2002;5:376–381. doi: 10.1038/nn822. [DOI] [PubMed] [Google Scholar]
- Kennerley SW, Sakai K, Rushworth MF. Organization of action sequences and the role of the pre-SMA. J Neurophysiol. 2004;91:978–993. doi: 10.1152/jn.00651.2003. [DOI] [PubMed] [Google Scholar]
- Knuth DE. Sorting and searching. Reading, MA: Addison-Wesley; 1998. [Google Scholar]
- Laplane D, Talairach J, Meininger V, Bancaud J, Orgogozo JM. Clinical consequences of corticectomies involving the supplementary motor area in man. J Neurol Sci. 1977;34:301–314. doi: 10.1016/0022-510X(77)90148-4. [DOI] [PubMed] [Google Scholar]
- Lashley K. The problem of serial order in behavior. New York: Wiley; 1951. [Google Scholar]
- Louie AH. Theoretical biology and complexity: three essays on the natural philosophy of complex systems. Orlando, FL: Academic; 1985. Categorical system theory; pp. 69–163. [Google Scholar]
- Lu MT, Preston JB, Strick PL. Interconnections between the prefrontal cortex and the premotor areas in the frontal lobe. J Comp Neurol. 1994;341:375–392. doi: 10.1002/cne.903410308. [DOI] [PubMed] [Google Scholar]
- Luppino G, Matelli M, Camarda R, Rizzolatti G. Corticocortical connections of area F3 (SMA-proper) and area F6 (pre-SMA) in the macaque monkey. J Comp Neurol. 1993;338:114–140. doi: 10.1002/cne.903380109. [DOI] [PubMed] [Google Scholar]
- Luria A. Higher cortical functions in man. London: Tavistock; 1966. [Google Scholar]
- Marsden CD. Motor disorders in basal ganglia disease. Hum Neurobiol. 1984;2:245–250. [PubMed] [Google Scholar]
- Matsuzaka Y, Aizawa H, Tanji J. A motor area rostral to the supplementary motor area (presupplementary motor area) in the monkey: neuronal activity during a learned motor task. J Neurophysiol. 1992;68:653–662. doi: 10.1152/jn.1992.68.3.653. [DOI] [PubMed] [Google Scholar]
- Mushiake H, Inase M, Tanji J. Neuronal activity in the primate premotor, supplementary, and precentral motor cortex during visually guided and internally determined sequential movements. J Neurophysiol. 1991;66:705–718. doi: 10.1152/jn.1991.66.3.705. [DOI] [PubMed] [Google Scholar]
- Pandya DN, Vignolo LA. Intra- and interhemispheric projections of the precentral, premotor and arcuate areas in the rhesus monkey. Brain Res. 1971;26:217–233. doi: 10.1016/S0006-8993(71)80001-X. [DOI] [PubMed] [Google Scholar]
- Perez MA, Tanaka S, Wise SP, Willingham DT, Cohen LG. Time-specific contribution of the supplementary motor area to intermanual transfer of procedural knowledge. J Neurosci. 2008;28:9664–9669. doi: 10.1523/JNEUROSCI.3416-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Raftery AE. Bayesian model selection in social research. Sociol Methodol. 1995;25:111–163. doi: 10.2307/271063. [DOI] [Google Scholar]
- Rieke F. Spikes: exploring the neural code. Cambridge, MA: Massachusetts Institute of Technology; 1996. [Google Scholar]
- Rizzolatti G, Fogassi L, Gallese V. Neurophysiological mechanisms underlying the understanding and imitation of action. Nat Rev Neurosci. 2001;2:661–670. doi: 10.1038/35090060. [DOI] [PubMed] [Google Scholar]
- Rosenbaum D. Human motor control. Ed 2. Amsterdam: Elsevier; 2010. [Google Scholar]
- Sakamoto Y, Ishiguro M, Kitagawa G. Akaike information criterion statistics. Dordrecht, The Netherlands: Reidel; 1986. Analysis of variance models. [Google Scholar]
- Scangos KW, Stuphorn V. Medial frontal cortex motivates but does not control movement initiation in the countermanding task. J Neurosci. 2010;30:1968–1982. doi: 10.1523/JNEUROSCI.4509-09.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shima K, Tanji J. Neuronal activity in the supplementary and presupplementary motor areas for temporal organization of multiple movements. J Neurophysiol. 2000;84:2148–2160. doi: 10.1152/jn.2000.84.4.2148. [DOI] [PubMed] [Google Scholar]
- Shima K, Isoda M, Mushiake H, Tanji J. Categorization of behavioural sequences in the prefrontal cortex. Nature. 2007;445:315–318. doi: 10.1038/nature05470. [DOI] [PubMed] [Google Scholar]
- Simoncelli EP, Olshausen BA. Natural image statistics and neural representation. Annu Rev Neurosci. 2001;24:1193–1216. doi: 10.1146/annurev.neuro.24.1.1193. [DOI] [PubMed] [Google Scholar]
- Sreenivasan S, Fiete I. Grid cells generate an analog error-correcting code for singularly precise neural computation. Nat Neurosci. 2011;14:1330–1337. doi: 10.1038/nn.2901. [DOI] [PubMed] [Google Scholar]
- Swinnen SP, Wenderoth N. Two hands, one brain: cognitive neuroscience of bimanual skill. Trends Cogn Sci. 2004;8:18–25. doi: 10.1016/j.tics.2003.10.017. [DOI] [PubMed] [Google Scholar]
- Tanji J. New concepts of the supplementary motor area. Curr Opin Neurobiol. 1996;6:782–787. doi: 10.1016/S0959-4388(96)80028-6. [DOI] [PubMed] [Google Scholar]
- Tanji J. Sequential organization of multiple movements: involvement of cortical motor areas. Annu Rev Neurosci. 2001;24:631–651. doi: 10.1146/annurev.neuro.24.1.631. [DOI] [PubMed] [Google Scholar]
- Tanji J, Kurata K. Comparison of movement-related activity in two cortical motor areas of primates. J Neurophysiol. 1982;48:633–653. doi: 10.1152/jn.1982.48.3.633. [DOI] [PubMed] [Google Scholar]
- Tanji J, Okano K, Sato KC. Relation of neurons in the nonprimary motor cortex to bilateral hand movement. Nature. 1987;327:618–620. doi: 10.1038/327618a0. [DOI] [PubMed] [Google Scholar]
- Zar JH. Biostatistical analysis. Upper Saddle River, NJ: Prentice-Hall/Pearson; 2010. [Google Scholar]