Abstract
Previous work has shown that neurons in the prefrontal cortex (PFC) show selectivity for learned categorical groupings. In contrast, brain regions lower in the visual hierarchy, such as inferior temporal cortex, do not seem to favor category information over information about physical appearance. However, the role of premotor cortex (PMC) in categorization has not been studied, despite evidence that PMC is strongly engaged by well learned tasks and reflects learned rules. Here, we directly compare PFC neurons to those in the PMC during visual categorization. Unlike PFC, relatively few PMC neurons distinguished between categories of visual images during a delayed match-to-category task. However, despite the lack of category information in the PMC, more than half of the neurons in both PFC and PMC reflected whether the category of a test image did or did not match the category of a sample image (i.e., had match information). Thus, PFC neurons represented all variables required to solve the cognitive problem while PMC neurons instead represented only the final decision variable that drove the appropriate motor action required to obtain a reward. This dichotomy fits well with the PFC's hypothesized role in learning arbitrary information and directing behavior as well as the PMC's role in motor planning.
Introduction
Categorization is a fundamental cognitive function that allows us to group items by utility, providing a basis for abstract behavior (Miller, Nieder, Freedman, & Wallis, 2003; Seger & Miller, 2010). This functionality is disrupted in several neuropsychiatric disorders including schizophrenia and autism (Bolte, Holtmann, Poustka, Scheurich, & Schmidt, 2007; Kuperberg, West, Lakshmanan, & Goff, 2008; Scherf, Luna, Kimchi, Minshew, & Behrmann, 2008; Uhlhaas & Mishara, 2007). Categorization is likely to engage many brain areas; which ones likely depend on the nature of the categorization (e.g., modality, complexity, learned vs. innate) (Seger & Miller, 2010). Our laboratory has used a task that requires monkeys to determine whether two images, separated by a brief delay, belong to the same category or not (Freedman, Riesenhuber, Poggio, & Miller, 2001). This engages cognitive functions like short-term memory and decision-making for which the PFC is important. Prior studies have revealed that as many as 30–40% of randomly selected lateral PFC neurons showed activity that reflected the learned category groups of stimuli at the expense of their exact physical appearance (Cromer, Roy, & Miller, 2010; Freedman et al., 2001; Freedman, Riesenhuber, Poggio, & Miller, 2002; Roy, Riesenhuber, Poggio, & Miller, 2010). This differs from lower visual structures, such as inferior temporal cortex, which initially encodes physical appearance rather than category information (Freedman & Miller, 2008; Freedman, Riesenhuber, Poggio, & Miller, 2003).
Here, we directly compare the lateral PFC to the premotor cortex (PMC) during visual categorization. Previous work has found that parts of premotor cortex are more involved in cognitive than motor processes (Picard & Strick, 2001) and that well-practiced tasks can more strongly engage the PMC than the PFC in humans (Boettiger & D'Esposito, 2005; Della-Maggiore & McIntosh, 2005; Raichle et al., 1994). Further, in a different experiment employing an abstract rule task, we found that information about abstract rules (“same” vs. “different”) was reflected more strongly and earlier in the PMC than the PFC in well-practiced monkeys (Muhammad, Wallis, & Miller, 2006).
Methods
Data Collection
Data were collected from the same two macaque monkeys (Macaca mulatta) that were reported in our previous study (Cromer et al., 2010). These animals were cared for in accordance with National Institutes of Health guidelines and the policies of the Massachusetts Institute of Technology Committee on Animal Care. The monkeys' eye movements were recorded using an infrared eye tracking system (Iscan, Burlington, MA) at a sampling rate of 240 Hz. Neural recordings were made using extracellular electrodes (FHC Inc., Bowdoin, ME) that were lowered through the dura each day using in-house screw microdrives. Electrodes were either driven independently or in pairs and up to 32 electrodes were used during each recording session. Recording wells were positioned based on MRIs over the lateral PFC and dorsal, rostral PMC - the area receiving input from 9/46 and corresponding to 6DR in Petrides and Pandya (2006). Electrodes were lowered each day into the cortical cell layer (i.e., when neurons were easily identifiable) and allowed to settle, after which they were adjusted to obtain neurons on one or both electrodes on each microdrive. Importantly, no prescreening of neurons took place (i.e., we did not first search for neurons that were task selective and then only record those neurons). This resulted in an unbiased sample of neurons from both brain regions. Spike waveforms were amplified, digitized and then stored for subsequent offline sorting using principal components analysis (Offline Sorter, Plexon Inc., Dallas, TX). We included all well isolated neurons that were held for a minimum of 500 correct trials in our analysis. This resulted in a total of 455 prefrontal cortex neurons (358 from monkey ‘ti’ and 97 from monkey ‘lu’) and 185 premotor neurons (185 from monkey 'ti').
Visual Stimuli
Two independent sets of stimuli, Cars and Animals, were used for this study (Figure 1A). Within each set there was a single category distinction. The first category set (Cars) was categorized as either Sports Cars or Sedans, while the second set (Animals) consisted of a Cats vs. Dogs category distinction. Each category set was made up of four prototype images (two prototypes from each category, as seen in Figure 1A) and morphs between those prototypes (Figure 1B). Morph images were generated as in previous studies ensuring that multiple features were smoothly morphed without the sudden appearance of any feature and so that all images within a category set had identical color, shading, orientation and scale (Beymer & Poggio, 1996; Cromer et al., 2010; Freedman et al., 2001, 2002, 2003; Freedman, Riesenhuber, Poggio, & Miller, 2006; Jiang et al., 2007; Roy et al., 2010; Shelton, 2000). Each category set (Cars and Animals) had a fixed category boundary at 50%, meaning that an image was considered a member of a category if it contained more than a 50% contribution from a prototype in that category. During training, the image sets consisted of hundreds of morph images to prevent the monkeys from memorizing specific images. Recording sessions utilized only morphs at the 100:0, 80:20, 60:40, 40:60, 20:80, and 0:100 combination levels for each possible morph line in order to present each sample image frequently enough to obtain sufficient data for statistical analysis. This process was repeated for both category sets, so that the final recording set contained 40 possible sample images. An example morph line depicting the transition from sports car prototype a2 to sedan prototype b1 with the morph steps used during recordings is shown in Figure 1B.
Figure 1. Stimulus Set & Behavioral Task.
A: Visual stimuli were generated for two, independent category sets, Cars and Animals. The Car set was divided into "Sports Cars" vs. "Sedans" categories while the Animal set had "Cats" and "Dogs" categories. Each category set was formed based on two prototype images (shown) and morphs between those images along the four depicted morph lines (arrows) between all combinations of the prototypes within each set. B: Morphing allowed parameterization of sample images. An example morph line between Sports Car prototype a2 and Sedan prototype b1 displays images at the morph steps used for recording. Intermediate images were a mix of the two prototypes. Those images comprised of greater than 50% of one category (marked by the 'Category Boundary') were to be classified as a member of that category. Note how the 60%/40% morphs (nearest to the category boundary) are closer in physical similarity to each other than they are to the prototypes, yet they are categorized differently since they are on opposite sides of the category boundary. C: The delayed match to category task required monkeys to respond to whether a test stimulus matched the category of the sample stimulus. During the sample and delay periods, the monkeys must hold in memory the category of the sample stimulus but the outcome of the trial (i.e., the appropriate motor response) is unknown. During the test period, monkeys had to determine whether the test image was a category match to the sample image (and release the response bar) or a category non-match (and continue to hold the response bar).
Behavioral Delayed Match to Category Task
As in previous studies of categorization (Cromer et al., 2010; Freedman et al., 2001, 2002, 2003), we employed a delayed match to category test during which monkeys had to categorize a sample stimulus and then determine whether or not a test stimulus matched (i.e., came from the same category) the sample's category (Figure 1C). Monkeys initiated the task by grabbing a response bar, which caused the onset of a white fixation square to which monkeys had to maintain fixation within 2 degrees during the course of the entire trial. After a 1000ms baseline period of fixation, one of the sample images (40 possibilities - 20 from either category set) was presented for 600ms. At this time the only information available to the monkeys was the sample image itself and the category to which the monkey assigned that image. Monkeys were required to hold in mind that category information throughout a subsequent 1000ms delay period, after which time a test image was presented. This test image could be a category match (an image from the same category as the sample) or a category non-match (an image from the opposite category as the sample). In order to prevent memorization during the recording sessions when repeating the same sample images was necessary, the sample images were randomly paired with hundreds of test images that were a minimum of 80% morph from one category. These sample – test pairs were randomly selected and were changed for each recording session so that image pairing could not be memorized. For example, in Figure 1C the test image that was a sedan is a category match to the sample image that was also a sedan, whereas the sports car test image is a category non-match. Monkeys indicated whether the test image was a category match to the sample by releasing the response bar within 600ms of the test image presentation. However, if the test image was a non-match they were to continue to hold the response bar. On non-match trials the test image was turned off after 600ms and the monkeys waited through a second 600ms memory delay until the presentation of a second test image that was always a category match to the sample image when they could release the response bar. Monkeys were immediately rewarded with several drops of apple juice for correctly releasing the response bar. If the monkeys incorrectly released the response bar or made no response the trial was immediately aborted and an extended 'time-out' delay occurred before the start of the next trial.
This paradigm required the monkeys to make a response on every trial (either releasing the bar during the first or second test image) and they would receive a reward on every correct trial (reward amounts were always kept constant throughout each recording session). Furthermore, the monkeys' motor responses were dissociated from the category of the sample stimulus (i.e., knowing the category of the sample stimulus during the sample and delay phases of the trial did not tell the monkey whether they would release or hold the bar during the test phase). Only after the test stimulus appeared could the decision be made whether or not to release the response bar based on the category of the test stimulus and its relation (match or non-match) to the sample's category. Importantly, this allowed us to separately examine neural information about the sample category and the match/non-match status of the trial. Trials of each category set (i.e., Cars and Animals) and each response type (i.e., match vs. non-match) were randomly interleaved and occurred at similar frequency. Test stimuli were always from the same category set as the sample stimuli (e.g., if the sample stimulus was a Car the test stimulus was also a Car), but could either be a category match (e.g., Sports Car - Sports Car) or a category non-match (e.g., Sports Car - Sedan).
Data Analysis
Analysis Epochs
Initially, category data were analyzed over three time epochs throughout the trial. The fixation analysis epoch included the last 500ms before the onset of the sample image. During this time the eyes were stable and no images were on the screen – this served as a baseline measure of neural activity. The sample analysis epoch included data from 100 to 600 ms after sample onset and assessed the time when the sample image was present on the screen (adjusted for the typical visual delay to the PFC). The delay analysis epoch was analyzed from 300 to 1100ms after the sample offset and captured the period when no image was physically present on the screen but the monkey was holding in working memory the category of the sample image (again adjusted for the PFC neural delay). The use of these analysis epochs provided a baseline and two periods when the only information present was the sample image (and its category). The timing of these analysis epochs is consistent with our previous studies (Cromer et al., 2010; Freedman et al., 2001, 2002, 2003; Roy et al., 2010). Note that these analysis epochs were only used for statistical tests (t-tests) which identified the population of category sensitive neurons. Other analyses we present (e.g., ROCs, Mutual Information) did not restrict analysis to these time periods. Additionally, a test epoch was examined for the first 500ms after the test onset to assess the time when the match/non-match decision was made.
Randomization Tests
In order to assess latency differences between neuronal activity in the PFC and PMC, we utilized a mutual information statistic (Buschman & Miller, 2007) which, similar to an ROC statistic, gives a measure of how well a neuron encodes a distinction between two distributions. Specifically, we computed the actual mutual information for match vs. non-match trials. In order to determine the significance of this measure, we next performed randomization tests (Buschman & Miller, 2007). All trials of both types were randomly sorted and assigned to arbitrary "match" or "non-match" groups and theoretical mutual information statistics were calculated each time for a total of 5000 permutations. This provided an estimate of the population under the null hypothesis that a neuron provided no real information to dissociate trial types. A p value was then determined by summing the number of theoretical mutual information values that were less than the actual mutual information value, dividing by the number of repeats, and subtracting this value from one.
To determine the latency of neuronal encoding of the match vs. non-match distinction, we repeated the above mutual information calculations and randomizations over time in 25ms bins. We identified the first time after test stimulus onset that showed significant information (p < 0.01) based on the randomization tests. To ensure that this time best captured a period of robust neural information encoding we required that two consecutive 25ms bins met this criterion, and subsequently marked the first time bin as the time of first significance. This allowed us to create a distribution of the leading (first) times after test onset when neurons showed significant match vs. non-match information.
We next computed a cumulative first significance distribution (each time point value is the number of significant neurons at that time point and any previous time points). To compare these latency values across brain regions, we converted these values to z-scores by comparing against a population mean and standard deviation created using the same techniques on 5,000 randomly generated mutual information matrices.
Results
Behavior
Monkey 'ti' and 'lu' were both proficient on the delayed match to category task. Both monkeys’ performance was similar, so their combined performance is shown in Figure 2. Individual performance of each monkey on the task is also reported elsewhere (Cromer et al., 2010). Each monkey correctly categorized (>80% correct in all cases) images of one category as belonging to that category on most of the trials, while seldom missing classifications or incorrectly classifying images that were on the opposite side of the category boundary. Performance remained high even for morphs closest to the category boundary (i.e., those images made with 60% of one category and 40% of the opposite category). For both category sets (Cars and Animals), the monkeys' behavior showed the hallmark of perceptual categorization: a much greater distinction between than within categories, with a sharp, "step" change in behavior across the category boundary. As previously reported, monkeys made significantly more errors and reacted more slowly on the Car category set than the Animal set suggesting that the Car set was more difficult (Cromer et al., 2010). However, behavioral performance was high and well above criterion for both sets.
Figure 2. Behavioral Results.
Performance of both monkeys on the delayed match to category task with multiple, independent category distinctions across all recording sessions. Perfect performance would be 100% categorization of images >50% of one category and 0% categorization of images <50% of that one category (i.e., only classifying images >50% of a category as members of that category). Actual performance was similar and displayed a hallmark step function in behavior at the category boundary. The majority of errors came on the 60% (missed classifications) or 40% (incorrect classifications) morphs that were closest to the category boundary and therefore were expected to be the hardest to correctly categorize. Error bars represent standard error of the mean.
PFC and PMC Neural Activity to Independent Category Sets
It was previously known that PFC neurons are sensitive to categories (Freedman et al., 2001) and, in a previous report using the same PFC data used here, we reported that many PFC neurons showed category selectivity for both the Cars and Animals category sets (Cromer et al., 2010). Examples of category selectivity in single neurons are shown in Figure 3. Figure 3A shows a neuron whose firing rate is grouped according to Car category membership of the sample image. Figure 3B depicts a second neuron that categorized Cats vs. Dogs.
Figure 3. Single Neuron Examples - Category Sensitivity.
A: A single PFC neuron that showed distinct firing for stimuli of one category (i.e., Sports Cars) vs. the other category (i.e., Sedans) starting during the robust burst of firing associated with stimulus onset and persisting throughout the delay and test epochs. Note how all morph percentages on either side of the category boundary (50%) grouped together (e.g., blue vs. red lines), despite the fact that sample images near the boundary line (60%/40%, darkest lines of each color group) were closer in physical similarity. Thus, this neuron responded to the category membership of the stimuli rather than their visual properties. B: A second PFC neuron that categorized Animals (Cats vs. Dogs) starting in the mid-delay period and into the test period.
To quantify the number of neurons in both recorded brain areas that were category sensitive, we focused on neural activity during the sample and delay intervals, which is when the monkeys had to categorize the sample stimulus and retain that information in working memory. As in prior work (Cromer et al., 2010; Freedman et al., 2001, 2002; Roy et al., 2010), a t-test was performed on each neuron’s firing rate to all sample images from one category vs. all images from the other (i.e., all Sports Car vs. Sedan images or all Cat vs. Dog images) to determine whether a neuron was category sensitive (i.e., showed significant category information, p < 0.01). We have previously shown in multiple studies that the population of neurons selected by this method displays the hallmarks of categorization (Cromer et al., 2010; Freedman et al., 2001, 2002; Roy et al., 2010).
Over 1/3 of randomly selected neurons in the lateral PFC showed a significant difference between their average activity in the sample and/or delay intervals for one category set over the other (Animals = 37%, 167 of 455; Cars = 38%, 173 of 455). This was a sharp contrast to the PMC, which had relatively few neurons that were category sensitive (Animals = 9%, 16 of 185; Cars = 11%, 21 of 185). The results of these t-tests to identify category sensitive neurons in the PFC are summarized in Table 1 and for the PMC in Table 2. These tables show the number of category sensitive neurons for each category set (Cars and Animals) as well as which neurons were category sensitive for both sets, one set or the other only, or neither set. They highlight that the PFC has a much greater percentage of neurons containing category information than the PMC.
Table 1.
PFC Category Sensitivity
Animal Sensitive | Not Animal Sensitive | Total | |
---|---|---|---|
Car Sensitive | 104 (23%) | 69 (15%) | 173 (38%) |
Not Car Sensitive | 63 (14%) | 219 (48%) | 282 (62%) |
Total | 167 (37%) | 288 (63%) | 455 (100%) |
Table 1 lists the count (and percentage) of all recorded PFC neurons (455) based on whether each neuron was category sensitive (t-tests, p < 0.01) for both the Animal (Cats vs. Dogs) and Car (Sports Cars vs. Sedans) category sets, only one set or the other, or neither set. The last row and column show the sums and specify neuronal selectivity for one category set independent of selectivity for the alternative category set.
Table 2.
PMC Category Sensitivity
Animal Sensitive | Not Animal Sensitive | Total | |
---|---|---|---|
Car Sensitive | 4 (2%) | 12 (7%) | 16 (9%) |
Not Car Sensitive | 17 (9%) | 152 (82%) | 169 (91%) |
Total | 21 (11%) | 164 (89%) | 185 (100%) |
Table 2 lists the count (and percentage) of all recorded PMC neurons (185) based on whether each neuron was category sensitive (t-tests, p < 0.01) for both the Animal (Cats vs. Dogs) and Car (Sports Cars vs. Sedans) category sets, only one set or the other, or neither set. The last row and column show the sums and specify neuronal selectivity for one category set independent of selectivity for the alternative category set.
As in prior studies (Cromer et al., 2010; Freedman et al., 2002), we examined the temporal dynamics of category effects in neural activity across the entire population of recorded neurons. This is shown for the PFC and PMC in Figure 4, which details the information that each neuron carried about each category distinction as a function of time within the trial. We used a sliding window (200ms in duration) and calculated a receiver operating characteristic (ROC) statistic for each category contrast at 25ms time steps throughout the entire trial. We used rectified ROC values that indicated the level of category sensitivity, but not which category was preferred. Higher ROC values (approaching 1) indicate a larger degree of difference in neuronal activity to sample images of the different categories (orange/yellow colors) while lower ROC values (near 0.5) indicate no or weak category sensitivity (darker colors). In Figure 4, each row corresponds to a single neuron and neurons were sorted based on the time at which ROC values for each neuron reached an ROC threshold of 0.6 (Muhammad et al., 2006). Those neurons that did not reach this threshold were left unsorted at the top of each panel. Note the variability in the timing of category-related activity in the PFC (Figures 4A and 4C). Some neurons are category sensitive only transiently (short orange bands), while others maintain their selectivity over a longer duration (long orange bands). Selectivity can start early in the sample period for some neurons while other neurons do not show category selectivity until well into the delay or test periods. The peak of category selectivity varied similarly (see also Cromer et al., 2010). Most importantly, note how there is strong category information for approximately 1/3 of PFC neurons during both Animal (Figure 4A) and Car (Figure 4C) categorization, whereas relatively few PMC neurons show high category ROC values for either Animals (Figure 4B) or Cars (Figure 4D).
Figure 4. ROCs - Category Sensitivity.
ROC values showing where neurons differentiate between categories for each of the recorded 455 PFC neurons (left column) and 185 PMC neurons (right column). Bright orange colors indicate high category sensitivity. A: ROCs over time for all PFC neurons showing when there was a distinction between trials with Cat vs. Dog images (bright orange). Each row corresponds to a single neuron. Neurons were aligned if their ROC value reached 0.6 based on the earliest time of the ROC reaching this threshold. The earliest neurons show information shortly after the sample stimulus onset and approximately 1/3 of recorded neurons reach the 0.6 threshold. B: ROCs for all PMC neurons with high values indicating a distinction between Cat vs. Dog trials. Note the lack of orange coloring indicating few PMC neurons that were category sensitive. C: ROCs for all PFC neurons during Car trials indicate a large percentage of PFC neurons differentiated between Sports Cars vs. Sedans. Latencies are similar to Animal categorization but more neurons show activation during the sample period. D: ROCs for all PMC neurons during Car trials again indicate little category information in the PMC.
To further compare the strength of category selectivity of individual neurons across the two brain regions, we plotted for each neuron the mean ROC value for the Animal category distinction against its mean ROC value for the Car category distinction (Figure 5). Because the latency and duration of category selectivity was variable across neurons (Figure 4), we used the mean ROC computed using a 500ms window centered at the time of the maximum ROC from either the sample or delay periods (Cromer et al., 2010). We coded the ROC values according to whether the neurons were from the PFC (circles) or PMC (triangles), and color coded those neurons that were identified by t-test (as above, p < 0.01) to be category sensitive (PFC - yellow circles, PMC - red triangles). In this case we plotted non-rectified ROC values ranging from 0 to 1 to capture the category preference of each neuron (i.e., values near 0.5 indicate no category sensitivity whereas ROC values approaching 1 indicate greater activity for either Cats or Sports Cars while ROC values approaching 0 indicate greater activity for Dogs or Sedans). In addition to category-sensitive neurons in the PFC being more prevalent, PFC neurons also had higher mean ROCs than category-sensitive neurons from the PMC (t-test, p < 0.01). In short, compared to the PFC, the PMC had a lower percentage of category selective neurons with weaker effects.
Figure 5. Mean ROCs for each Category Scheme.
Mean ROC values for all recorded neurons in the PFC (circles) and PMC (triangles) to both category distinctions. Colored points indicate significant category sensitivity as determined via t-test for one or both categories. Values closer to the origin indicate weaker category sensitive for the given distinction (x values indicate the Animal category distinction, y values indicate the Car distinction). Data points furthest from the origin indicate those neurons with the strongest category selectivity (yellow circles). PMC neurons that were category sensitive (red triangles) had weaker category information than the strongest PFC neurons.
PFC and PMC Neural Activity to Category Match Decision
After the delay epoch, the monkey saw a test image. It had to decide whether that test image was in the same category as the sample image and, if so, release a lever. Many PFC neurons have been shown to reflect this category matching decision (Cromer et al., 2010; Freedman et al., 2001), but this has not been tested in the PMC. We found that the PMC was strongly engaged during the test image epoch. Like PFC neurons, many PMC neurons distinguished between match and non-match trials (Figure 6). Some neurons showed match enhancement, or a higher firing rate to match trials (Figure 6A) while others showed match suppression, or a lower firing rate during match trials (Figure 6B) regardless of which category set was used in the trial.
Figure 6. Single Neuron Examples - Match Sensitivity.
A: A single PMC neuron distinguished between when test images match ('match', solid lines) or did not match ('non-match', dashed lines) the sample images across trials. This distinction occurred regardless of whether images were from the animal or car category sets (lines cluster as solid vs. dashed rather than red vs. blue). This neuron's firing rate was higher during match trials so it is said to have "match enhancement". B: A single PMC neuron that distinguished match from non-match trials but had a lower firing rate for match trials and is thus characterized as having "match suppression".
We used t-tests to assess the number of neurons that distinguished between match vs. non-match trials in their average activity across the test stimulus epoch. In both brain regions, a large number of recorded neurons showed a significant (t-test, p < 0.01) effect (PFC= 42%, 190 of 455; PMC = 62%, 115 of 185). Both regions had more neurons that showed match enhancement (PFC = 55%, 104 of 190; PMC = 64%, 74 of 115) than match suppression (PFC = 45%, 86 of 190; PMC = 36%, 41 of 115).
To examine the temporal dynamics of the match/non-match effects, we again plotted rectified ROCs for each recorded neuron over time (Figure 7). This clearly demonstrates the prevalence of match selective neurons in both brain regions. There was a greater percentage in the PMC vs. PFC. The time course of activation also appears similar in both brain regions, with some neurons becoming selective shortly after the test stimulus onset and a range of activations after that time. To quantify this relationship and identify whether either the PFC or PMC encoded this information with a shorter latency, we analyzed the time to first significant selectivity of each neuron by mutual information analysis and randomization tests (see methods and Buschman & Miller, 2007). Figure 8A shows histograms of the time after test onset when each neuron first exhibited significant information about whether the test object was a match or non-match to the sample. To compare the latency of information onset across the PFC and PMC, we computed z-scores (see methods) of the cumulative first significance distribution (Figure 8B). Both brain regions first showed statistical significance (p < 0.05) information at the same latency, about 100ms after test onset, well before the monkeys' average reaction time of 284ms.
Figure 7. ROCs - Match Sensitivity.
A: ROC values for each of the recorded 455 PFC neurons across the test epoch with bright orange colors indicating sensitivity for match vs. non-match trials, aligned when neurons reached a 0.6 ROC threshold. Similar to category effects, over 1/3 of PFC neurons displayed match information. B: ROC values for each of the 185 recorded PMC neurons show that a majority of PMC neurons dissociate match from non-match trials.
Figure 8. Latencies - Match Sensitivity.
A: Histograms of the number of cells reaching significance for the first time in each 25ms time bin after test onset for the PFC (blue) and PMC (red). Note that there were 455 recorded PFC neurons and 185 PMC neurons, so raw counts are not directly comparable. B: Z-scores of the cumulative first significance distribution (see methods) allowed comparison of latencies across the PFC and PMC. Both regions reach significance (p < 0.05 or 2 standard deviations above the mean) at the 100ms time bin.
Discussion
We recorded from lateral PFC and dorsal, rostral PMC neurons while monkeys categorized images from two independent category sets (Cars and Animals). We found that over 36% of randomly selected PFC neurons were sensitive to the category of a sample image in contrast to less than 12% category sensitive neurons in the PMC. Furthermore, category sensitivity was weaker in PMC than PFC. Thus, while PFC has repeatedly been shown to be strongly involved in categorization, PMC does not appear to maintain a similar representation of visual categories. However, close to half the neurons in both brain regions reflected the category match/non-match decisions that led to a behavioral response.
While several studies have shown visual category selectivity in the PFC (Cromer et al., 2010; Freedman et al., 2001, 2002; Roy et al., 2010), it was unclear whether this could be expected for the PMC. It has previously been shown that many PMC neurons strongly reflect abstract “Same” vs. “Different” rules (Muhammad et al., 2006). In fact, rule effects were stronger and earlier in the PMC than PFC. In contrast, we found little or no effect of image category in the PMC. One possible explanation for this discrepancy is that we recorded in a more dorsal part of the PMC than Muhammad et al. (2006). However, this region does receive direct projections from the lateral PFC (Petrides & Pandya, 2006) and has been suggested to be involved in more cognitive processes (Picard & Strick, 2001). It seems more likely that the difference between studies is due to a divide between sensory and motor processing. The delayed match-to-category task was designed so that the category membership of an image was decoupled from the motor response. The category of the sample image contained no information that could be used to resolve the motor response. It was only after the appearance of the test stimulus that the monkey could decide which motor response was necessary. The monkeys in Muhammad et al. (2006) also could not predict the motor response until test stimulus presentation. However, the rules themselves (which were presented at the beginning of a trial) contained crucial information that allowed the monkeys to map the status of the test stimulus to the motor response: for “Same” the monkeys released the lever if the test image matched the sample while for “Different”, monkeys withheld a response to a match. Thus, the difference in PMC activity to categories versus abstract rules may be explained by the PMC only being strongly engaged when motor related information is being retained and processed. This interpretation is further supported by the observation that many PMC neurons were strongly and selectively activated by category matching (whether sample and test image categories matched), which finally added motor information to the category task on each trial.
In sum, while PMC neurons can reflect high-order “cognitive” information above and beyond simple premotor activity, it, unlike the PFC, is only engaged when the information has a motor component. This fits well with the PFC's hypothesized role in multimodal executive functions (Miller & Cohen, 2001) and the PMC's role in motor planning (Hoshi & Tanji, 2007; Wise, 1985).
Acknowledgments
We thank EG Antzoulatos, SL Brincat, JR Cromer, C Diogo, K MacCully, MS Machon, LN Nation, D Ouellette, MV Puig, J Rose, and M Siegel.
References
- Beymer D, Poggio T. Image representations for visual learning. Science. 1996;272(5270):1905–1909. doi: 10.1126/science.272.5270.1905. [DOI] [PubMed] [Google Scholar]
- Boettiger CA, D'Esposito M. Frontal networks for learning and executing arbitrary stimulus-response associations. J Neurosci. 2005;25(10):2723–2732. doi: 10.1523/JNEUROSCI.3697-04.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bolte S, Holtmann M, Poustka F, Scheurich A, Schmidt L. Gestalt perception and local-global processing in high-functioning autism. J Autism Dev Disord. 2007;37(8):1493–1504. doi: 10.1007/s10803-006-0231-x. [DOI] [PubMed] [Google Scholar]
- Buschman TJ, Miller EK. Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices. Science. 2007;315(5820):1860–1862. doi: 10.1126/science.1138071. [DOI] [PubMed] [Google Scholar]
- Cromer JA, Roy JE, Miller EK. Representation of multiple, independent categories in the primate prefrontal cortex. Neuron. 2010;66(5):796–807. doi: 10.1016/j.neuron.2010.05.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Della-Maggiore V, McIntosh AR. Time course of changes in brain activity and functional connectivity associated with long-term adaptation to a rotational transformation. J Neurophysiol. 2005;93(4):2254–2262. doi: 10.1152/jn.00984.2004. [DOI] [PubMed] [Google Scholar]
- Freedman DJ, Miller EK. Neural mechanisms of visual categorization: insights from neurophysiology. Neurosci Biobehav Rev. 2008;32(2):311–329. doi: 10.1016/j.neubiorev.2007.07.011. [DOI] [PubMed] [Google Scholar]
- Freedman DJ, Riesenhuber M, Poggio T, Miller EK. Categorical representation of visual stimuli in the primate prefrontal cortex. Science. 2001;291(5502):312–316. doi: 10.1126/science.291.5502.312. [DOI] [PubMed] [Google Scholar]
- Freedman DJ, Riesenhuber M, Poggio T, Miller EK. Visual categorization and the primate prefrontal cortex: neurophysiology and behavior. J Neurophysiol. 2002;88(2):929–941. doi: 10.1152/jn.2002.88.2.929. [DOI] [PubMed] [Google Scholar]
- Freedman DJ, Riesenhuber M, Poggio T, Miller EK. A comparison of primate prefrontal and inferior temporal cortices during visual categorization. J Neurosci. 2003;23(12):5235–5246. doi: 10.1523/JNEUROSCI.23-12-05235.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Freedman DJ, Riesenhuber M, Poggio T, Miller EK. Experience-dependent sharpening of visual shape selectivity in inferior temporal cortex. Cereb Cortex. 2006;16(11):1631–1644. doi: 10.1093/cercor/bhj100. [DOI] [PubMed] [Google Scholar]
- Hoshi E, Tanji J. Distinctions between dorsal and ventral premotor areas: anatomical connectivity and functional properties. Curr Opin Neurobiol. 2007;17(2):234–242. doi: 10.1016/j.conb.2007.02.003. [DOI] [PubMed] [Google Scholar]
- Jiang X, Bradley E, Rini RA, Zeffiro T, Vanmeter J, Riesenhuber M. Categorization training results in shape- and category-selective human neural plasticity. Neuron. 2007;53(6):891–903. doi: 10.1016/j.neuron.2007.02.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kuperberg GR, West WC, Lakshmanan BM, Goff D. Functional magnetic resonance imaging reveals neuroanatomical dissociations during semantic integration in schizophrenia. Biol Psychiatry. 2008;64(5):407–418. doi: 10.1016/j.biopsych.2008.03.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller EK, Cohen JD. An integrative theory of prefrontal cortex function. Annu Rev Neurosci. 2001;24:167–202. doi: 10.1146/annurev.neuro.24.1.167. [DOI] [PubMed] [Google Scholar]
- Miller EK, Nieder A, Freedman DJ, Wallis JD. Neural correlates of categories and concepts. Curr Opin Neurobiol. 2003;13(2):198–203. doi: 10.1016/s0959-4388(03)00037-0. [DOI] [PubMed] [Google Scholar]
- Muhammad R, Wallis JD, Miller EK. A comparison of abstract rules in the prefrontal cortex, premotor cortex, inferior temporal cortex, and striatum. J Cogn Neurosci. 2006;18(6):974–989. doi: 10.1162/jocn.2006.18.6.974. [DOI] [PubMed] [Google Scholar]
- Petrides M, Pandya DN. Efferent association pathways originating in the caudal prefrontal cortex in the macaque monkey. J Comp Neurol. 2006;498(2):227–251. doi: 10.1002/cne.21048. [DOI] [PubMed] [Google Scholar]
- Picard N, Strick PL. Imaging the premotor areas. Curr Opin Neurobiol. 2001;11(6):663–672. doi: 10.1016/s0959-4388(01)00266-5. [DOI] [PubMed] [Google Scholar]
- Raichle ME, Fiez JA, Videen TO, MacLeod AM, Pardo JV, Fox PT, et al. Practice-related changes in human brain functional anatomy during nonmotor learning. Cereb Cortex. 1994;4(1):8–26. doi: 10.1093/cercor/4.1.8. [DOI] [PubMed] [Google Scholar]
- Roy JE, Riesenhuber M, Poggio T, Miller EK. Prefrontal cortex activity during flexible categorization. J Neurosci. 2010;30(25):8519–8528. doi: 10.1523/JNEUROSCI.4837-09.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Scherf KS, Luna B, Kimchi R, Minshew N, Behrmann M. Missing the big picture: impaired development of global shape processing in autism. Autism Res. 2008;1(2):114–129. doi: 10.1002/aur.17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Seger CA, Miller EK. Category learning in the brain. Annu Rev Neurosci. 2010;33:203–219. doi: 10.1146/annurev.neuro.051508.135546. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shelton CR. Morphable Surface Models. International Journal of Computer Vision. 2000;38(1):75–91. [Google Scholar]
- Uhlhaas PJ, Mishara AL. Perceptual anomalies in schizophrenia: integrating phenomenology and cognitive neuroscience. Schizophr Bull. 2007;33(1):142–156. doi: 10.1093/schbul/sbl047. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wise SP. The primate premotor cortex: past, present, and preparatory. Annu Rev Neurosci. 1985;8:1–19. doi: 10.1146/annurev.ne.08.030185.000245. [DOI] [PubMed] [Google Scholar]