Human behavioral studies have shown that spatial and duration judgments can interfere with each other. We investigated the neural representation of such magnitudes in the prefrontal cortex. We found that the two magnitudes are independently coded by prefrontal neurons. We suggest that the interference among magnitude judgments might depend on the goal rather than the perceptual resource sharing.
Keywords: magnitude, monkey, prefrontal, spatial, timing
Abstract
The estimation of space and time can interfere with each other, and neuroimaging studies have shown overlapping activation in the parietal and prefrontal cortical areas. We used duration and distance discrimination tasks to determine whether space and time share resources in prefrontal cortex (PF) neurons. Monkeys were required to report which of two stimuli, a red circle or blue square, presented sequentially, were longer and farther, respectively, in the duration and distance tasks. In a previous study, we showed that relative duration and distance are coded by different populations of neurons and that the only common representation is related to goal coding. Here, we examined the coding of absolute duration and distance. Our results support a model of independent coding of absolute duration and distance metrics by demonstrating that not only relative magnitude but also absolute magnitude are independently coded in the PF.
NEW & NOTEWORTHY Human behavioral studies have shown that spatial and duration judgments can interfere with each other. We investigated the neural representation of such magnitudes in the prefrontal cortex. We found that the two magnitudes are independently coded by prefrontal neurons. We suggest that the interference among magnitude judgments might depend on the goal rather than the perceptual resource sharing.
interaction with the world is fundamental in the evaluation and coding of magnitudes, such as distance, duration, and numerosity. The estimation of temporal and spatial magnitudes is correlated (Mendez et al. 2011) and can interfere with each other, generating errors in perception in both humans and monkeys (Basso et al. 1996; Casasanto and Boroditsky 2008; Merritt et al. 2010; Mitchell and Davis 1987) and leading to the idea that both magnitudes are processed in a general magnitude system (Walsh 2003). For example, humans perform better in binding pairs of tones and lines when their durations and lengths, respectively, correlate positively (Srinivasan and Carey 2010). Stimulus dimension affects duration perception very specifically, making the perception of larger stimuli also longer (Ono and Kawahara 2007; Xuan et al. 2007). A similar result was obtained with a timing reproduction task (Rammsayer and Verner 2014). One hypothesis that could explain these results is that this effect reflects a shared common coding scheme for different magnitudes. At the neural level, this could depend on neurons having congruent coding schemes. When a neuron increases activity for higher values of a magnitude, it would do the same for other magnitudes. Conversely, when a neuron decreases its activity for higher values, it would do the same when tested for other magnitudes. Furthermore, estimations of time and space are similarly compressed by saccadic eye movements when stimuli are briefly presented just before or after the movement (Morrone et al. 2005; Ross et al. 1997). In contrast, Lambrechts et al. (2013) did not find any interference by number or space on the perception of duration on a task in which numeric and spatial information accumulated over time.
Several recent studies have reported the involvement of the prefrontal cortex (PF) in processing duration (Brody et al. 2003; Genovesio et al. 2006b; Jin et al. 2009; Lebedev et al. 2008; Ohmae et al. 2008; Oshio et al. 2006, 2008; Sakurai et al. 2004; Tsujimoto and Sawaguchi 2005; Yumoto et al. 2011), in addition to other widespread cortical and subcortical areas, including the motor and premotor cortex (Kilavik et al. 2010; Lucchetti and Bon 2001; Merchant et al. 2011b, 2013; Mita et al. 2009; Ohmae et al. 2008; Renoult et al. 2006), parietal cortex (Janssen and Shadlen 2005; Schneider and Ghose 2012), and basal ganglia (Bartolo et al. 2014; Chiba et al. 2008). At the single-cell level, PF neurons encode time and space (Genovesio et al. 2006a, b, 2012; Genovesio and Tsujimoto 2014; Hoshi et al. 2000; Lebedev et al. 2004; Merchant et al. 2011a; Saito et al. 2005) and numbers (Nieder et al. 2002). Based on these proprieties and their importance in domain-general processing (Baars et al. 2003; Duncan 2010; Wilson et al. 2010), we examined timing and spatial representations at the single-cell level in the PF. Specifically, we recorded from the individual neurons in duration and distance discrimination tasks, which required monkeys to determine which of the two stimuli, presented sequentially on a screen, were greater, either in duration of presentation or in distance from a reference point, respectively.
We have previously shown that in the decision phase, relative duration and spatial metrics (i.e., difference among specific values of the same magnitude) were represented independently in the PF, and only the goal was coded commonly by the same population (Genovesio et al. 2012). The goal was defined as the object or location that an animal chooses as a target for its action (Passingham and Wise 2012), corresponding to the blue or red stimuli in our tasks. We have advanced the hypothesis that some of the interference effects among different magnitudes could reflect the sharing of goal information in the PF. To support this hypothesis, however, we must exclude the possibility that interferences reflect common coding of each absolute magnitude in the PF, as described before, in which the neurons have the same preference for low or high values of various magnitudes. To address this question, we analyzed the activity of PF neurons during the delay that followed the presentation of an initial stimulus (S1). We identified the populations of neurons that encoded the absolute duration and spatial distance of S1 in this period and examined whether the two groups of neurons significantly overlapped in coding the two metrics more than expected by chance or showed independence.
MATERIALS AND METHODS
Behavioral Task
Two adult male rhesus monkeys (Macaca mulatta, 8.5 and 8.0 kg) performed two tasks: a duration discrimination task and a distance discrimination task (Fig. 1A). In both tasks, two stimuli were presented sequentially, and the monkeys had to select which one had the greatest magnitude—duration in the duration task and distance from a reference point in the distance task. The monkeys sat in a chair, with their heads fixed, 29 cm from a video screen. Three infrared switches, measuring 3 × 2 cm each, were placed in front of them, within reach, and used as an interface between the monkeys and the experimental task. All procedures conformed to the Guide for the Care and Use of Laboratory Animals (1996) and were approved by the National Institute of Mental Health Animal Care and Use Committee.
Fig. 1.
Experimental tasks and penetration sites for the 2 monkeys. A: sequence of events during a trial for the duration (left) and distance (right) tasks. In both cases, 2 stimuli are presented sequentially, and the monkeys are required to select later the one that lasted longer (duration task) or was presented farther from a reference point at the center of a screen (distance task). B: stimulus sets for the duration (left) and distance (right) tasks. C: composite of both monkeys, relative to sulcal landmarks. Vertical blue line, division between periarcuate (right) and dorsolateral prefrontal (left) areas. AS, arcuate sulcus; PS, principal sulcus.
The sequence of events during a trial is described in Fig. 1A and was similar in each task. A trial started when the monkeys pressed the central switch. Then, a central stimulus (white circle of 0.6° diameter) appeared for 400 or 800 ms and was followed by the presentation of the first stimulus (S1: a blue circle of 3° diameter or red square of 3 × 3° dimensions) at the center of screen. In the duration task, S1 lasted from 200 to 1,200 ms, in increments of 200 ms (i.e., 6 conditions). In the distance task, S1 always lasted 1,000 ms and was presented 8–48 mm (1.6–9.4° of visual angle) above or below the central stimulus in steps of 8 mm (i.e., 6 conditions). The duration of each S1 stimulus could be followed by each of the other different durations with equal probability. The same was true in the distance task but in terms of distances (Fig. 1B). The first delay (D1) of 400 or 800 ms separated the disappearance of S1 from presentation of the second stimulus (S2). In the duration task, S2 was presented in the same range of durations as S1, appearing at the center of the screen, but could be longer or shorter than S1. In the distance task, S2 lasted 1,000 ms and was presented above the reference point, when S1 appeared below it; otherwise, it was displayed below. The distance of S2 varied in the same range as that of S1 and could be farther or closer than S1 to the reference. Subsequently, a second delay (D2) of 0, 400, or 800 ms preceded the reappearance of the two stimuli. S1 and S2 reappeared 7.8° to the left and 7.8° to the right of the central reference, pseudorandomly determined, and their appearance served as the “go” signal. The go signal instructed the monkeys to select, within a maximum of 6 s, the stimulus that had lasted longer or was presented farther from the reference point in the duration or distance tasks, respectively. In the duration task, fixation on the center of the screen was required from the appearance of the central stimulus until the go signal. In the distance task, fixation requirements were not imposed.
An important feature of the task design for both the distance and the duration tasks was that the monkeys could not plan any motor response until after the go signal. Correct responses were rewarded with 0.1 ml fluid, whereas incorrect responses were followed by acoustic feedback. An intertrial period of 700-1,000 ms separated two consecutive trials. All variables in the task, such as the duration of D1 and D2 and the features of the stimuli, were pseudorandomly determined. For a detailed description of the duration and distance tasks, see Genovesio et al. (2009) and Genovesio et al. (2011), respectively.
Surgery
Recording chambers were implanted over the exposed dura mater of the left frontal lobe, with head restraint devices, using aseptic techniques and isofluorane anesthesia (1–3%, to effect). Monkey 1 had two, 18 mm-diameter chambers, and Monkey 2 had a single, 27 × 36-mm chamber.
Histological Analysis
Electrolytic lesions (15 mA for 10 s, anodal current) were made at selected locations. After 10 days, the animal was deeply anesthetized and afterward, perfused through the heart with formaldehyde-containing fixative. We plotted recording sites on Nissl-stained coronal sections by reference to the recovered electrolytic lesions and the marking pins inserted when we performed perfusion. Periarcuate (PA) recordings were predominantly taken from area 8, and dorsolateral PF (PFdl) included area 46 and a small population of area 12. Figure 1C shows the dividing line between the PFdl and PA recording sites.
Data Collection
We monitored eye position with an infrared oculometer (Arrington Recording, Scottsdale, AZ) and recorded single cells using quartz-insulated, platinum-iridium electrodes (0.5–1.5 MΩ at 1 kHz), positioned by a 16-electrode drive assembly (Thomas Recording, Giessen, Germany). The electrodes were arranged in a concentric array with 518 mm spacing. Spikes were discriminated online using the Multichannel Acquisition Processor (Plexon, Dallas, TX) and confirmed with the Offline Sorter (Plexon).
Neural Analyses
Neural stability.
We assessed the neurons' stability between tasks by calculating the similarity of the mean waveform and the interspike interval histogram (ISIH) in the two tasks (Dickey et al. 2009). The waveform similarity (W) was calculated by obtaining the Pearson's correlation coefficient between the mean waveforms of the neurons in each task. The similarity of ISIHs was obtained by first fitting each ISIH with a mixture of three log-normal distributions using an expectation-maximization algorithm and then computing a similarity score (I) as
where A and B are the set of eight parameters used to fit the ISIHs in the duration and distance task, respectively, and σ is a normalization factor that represents the variance of the fitting parameters and is obtained from a sample set. The two scores were then normalized and combined in one unique score S
where μpos and μneg are the mean score values of true positives and true negatives, ∑pos and ∑neg are their covariance obtained from the sample set, and x is a vector with the W′ and I′ for a neuron [x = (I′W′)]. A neuron is considered to be stable between sessions if its combined score (S) is lower than a threshold (T). We used the values of μpos, μneg, ∑pos, ∑neg, and T, obtained from Dickey et al. (2009). From the original dataset (Genovesio et al. 2009, 2011; Marcos et al. 2016), we identified 428 neurons that were recorded and stable in both behavioral tasks. From these neurons, 192 neurons were recorded in the PFdl and 236 neurons in PA.
Neural selectivity.
To identify neurons that were modulated by the duration or distance of S1, we sorted the trials by S1 duration (long or short) in the duration task and by its distance (far or near) in the distance task. In the duration task, we classified durations of S1 of 1,000–1,200 ms as long and 200–400 ms as short. In the distance task, we classified distances of S1 of 40–48 mm as far and those of 8–16 mm as near. We calculated the number of neurons that were selective for these ranges of values in the early D1 period (80–400 ms), because it is the period in which the absolute duration of S1 in the duration task and its distance in the distance task are known and should be maintained in memory before the comparison process can start. Only correct trials were considered for all analyses.
The neural selectivity for duration and distance magnitudes was examined by a one-way ANOVA test in the early D1 period for activity with long/short durations of S1 and far/near distances of S1 as factors in the duration and distance tasks, respectively. We also conducted linear regression analysis, in which we calculated the mean activity for each neuron in the early D1 period for the six specific values of duration and distance of S1 in each task and performed linear fitting of the data. Finally, we calculated the significance of the fitting using duration or distance of S1 as a predictor of the calculated firing rate.
The significance of the overlap between the distribution of neurons that were selective for the duration and distance of S1 was determined by a hypergeometric distribution test (Casella and Berger 1990). From the total number of neurons (N), we identified ndur neurons that were selective for the duration of S1, ndist neurons that were selective for its distance, and nc neurons that were selective for both. The significance of nc neurons was then calculated as the probability of selecting ndist neurons from the original group, N, and obtaining nc neurons or more that belonged to the ndur group of neurons. Mathematically, the probability of selecting nc neurons is calculated as
where . Then, the P value is estimated as the probability to observe, at least, nc common neurons belonging to the two groups, and it is calculated as the sum of the probabilities of selecting the exact nc number of neurons or more
We calculated this value for the group of neurons that were identified as selective for the duration or distance of S1 by a one-way ANOVA test and for those with its duration or distance as a significant predictor of mean neural firing rate.
The mean firing rates were plotted using a sliding window of 50 ms with steps of 5 ms. Preferred and nonpreferred durations corresponded to the mean maximum and minimum activity in early D1, respectively. To compare the activity of the neural population that was selective for the duration of S1 in the duration task with that of the same neurons in the distance task, we analogized long durations to far positions of S1 and short durations to its near positions; i.e., if a neuron preferred long durations of S1, then we assigned the far distances of S1 as the preferred distances for the distance task and its near distances as the nonpreferred ones. The same logic applied when short and long durations of S1 were its preferred and nonpreferred durations, respectively. The statistical significance of the difference in mean firing rates between conditions at the population level was calculated by a paired-sample t-test with Bonferroni correction using a nonoverlapping window of 50 ms. Only periods in which the difference between conditions is significant for at least two consecutive bins are reported.
To assess how well the neural populations represented the duration or distance of S1, we implemented a classification procedure with a neuron-dropping analysis based on the peristimulus time histogram (Foffani and Moxon 2004; Lebedev et al. 2004). We divided the trials by condition, i.e., long or short duration of S1 in the duration task or far or near distance of S1 in the distance task, and used the neural activity in the early D1 period as the predictor variable. In brief, to assess the robustness of the magnitude representation, we randomly selected one trial from the same condition for each neuron (test trials set) in the population and calculated a response template for each neuron and condition using the mean activity of all remaining trials. Then, the Euclidean distance between the response in each trial of the test set and the corresponding neuron's template was calculated. The selected trials were classified as belonging to the condition with the lowest sum of calculated distances. The neuron-dropping analysis consisted of randomly eliminating one neuron from the population in each iteration and computing the decoding accuracy using the subset of remaining neurons. This procedure was performed 1,000 times for each condition and each specific number of neurons. The neural populations consisted of the neurons uniquely selective for duration (ndur − nc) of S1 and those uniquely selected for its distance (ndist − nc).
RESULTS
Two monkeys performed the duration and distance discrimination tasks. Figure 1A shows the sequence of events in the two tasks, and Fig. 1C shows the recorded areas. The mean performance of the monkeys was high in both tasks, with correct trial rates of 81% and 79% in the duration and distance tasks, respectively. The performance of the two animals was comparable also when examined in more detail [see Supplemental Fig. 2 in Genovesio et al. (2012)]. Easier discriminations were associated with both faster responses and higher accuracy. While the monkeys performed the two tasks, 428 neurons were recorded stably in both tasks from PF. From this group of neurons, 51 neurons were recorded in PFdl and 34 in PA of Monkey 1, and 141 neurons were recorded in PFdl and 202 in PA of Monkey 2.
Fig. 2.
Venn diagram (not to scale) of the number of neurons that encode the duration and distance of S1 in the duration (black) and distance (gray) tasks, respectively. The neurons shared by the 2 groups are reported in the intersecting area (n = 13), whereas the uncommon ones are shown in their respective areas.
To examine the neural representation of absolute duration and distance, we first divided the trials by the absolute duration or distance of S1. In the duration task, the trials were split into short (200–400 ms) and long (1,000-1,200 ms) durations of S1. From the total set of neurons, we identified 113 neurons (ndur = 113; 26.4%; 57 in PFdl and 56 in PA) that were significantly modulated (P < 0.05, one-way ANOVA) by the duration of S1 in the early D1 (80–400 ms). In the distance task, we divided the trials similarly into far (40 and 48 mm) and near (8 and 16 mm) categories. From the same neural subset, 41 neurons (ndist = 41; 9.6%; 15 in PFdl and 26 in PA) were significantly modulated by the distance of S1 in the early D1 (P < 0.05, one-way ANOVA). Thus the number of neurons that encoded the duration of S1 was more than twice those that encoded its distance. We identified 13 neurons (nc = 13; 11.5% and 31.7% of neurons that were selective for duration and distance, respectively; 5 in PFdl and 8 in PA) that were selective for both the duration and distance of S1 (Fig. 2), which is not significantly different than the expected overlap if 41 neurons were randomly selected from the total of 428 neurons (P = 0.262, hypergeometric distribution test; see materials and methods). This result indicates that two populations of neurons encoded the duration and distance of S1 independently but does not indicate that neurons that encode one magnitude cannot encode another—only that this happens in the proportion that we expect by chance. The same result was obtained when looking at the number of neurons divided by area, i.e., PFdl and PA (P = 0.475 and P = 0.252, respectively, hypergeometric distribution test).
In addition to the ANOVA, we performed a linear regression analysis for each neuron in the entire population that was recorded using firing rate as the dependent variable and the duration or distance of S1 as the predictor. The duration of S1 was a significant predictor of activity in 121 neurons in the duration task, whereas 47 neurons exhibited the same effect with regard to its distance in the distance task. In these two groups, 81.8% and 72.4% of neurons for duration and distance, respectively, were also significant by one-way ANOVA. We identified 12 neurons common to both groups, which was, however, not significant from what was expected by chance (P = 0.726 hypergeometric distribution test; see materials and methods). Moreover, the correlation coefficient between the slopes of the common neurons calculated in the duration task and the ones calculated in the distance task was not significant (P = 0.120, Pearson correlation). These analyses confirmed the independence of the coding of duration and distance in the PF, even if we consider not only the magnitude-selective neurons, according to one-way ANOVA, but also the neurons with a significant linear relationship with the two magnitudes. We used the population of neurons that were identified by the one-way ANOVA test for the remaining analyses.
Figure 3A shows an example of neurons with a preference for long (preferred) vs. short (nonpreferred) durations, along with its mean firing rate in the early D1 period, sorted by duration of S1. Its activity rose exponentially with increasing durations of S1 and became saturated for the longest cases at ∼20 spikes/s. Figure 3B shows the activity of the same neuron, divided by the distance of S1 in the distance task. The neuron did not exhibit significant difference in activity between near (8–16 mm) and far (40–48 mm) placements of S1. Also shown is the mean firing rate of the neuron during the early D1 period along all distances of S1. In contrast to the modulation in its response in the duration task, in this case, the neuron exhibited a similar mean firing rate along all distances of S1.
Fig. 3.
Example neuron encoding absolute duration of S1 in the duration task but not its distance in the distance task. Each dot in the raster plot indicates the discharge of the neuron with respect to the start of D1. Mean firing rate of the neurons is shown above the raster plots. A: neural response in the duration task. The neuron shows higher activity (spikes/s) for long (1,000-1,200 ms) vs. short (200–400 ms) durations of S1. Black markers in the raster indicate the times of S1 presentation. B: activity in the distance task. In contrast to A, the neuron does not differentiate between far (40–48 mm) and near (8–16 mm) distances of S1. Insets: mean activity of the neurons calculated within the 80–400 ms after presentation of S1 (gray boxes in raster plots) for various durations (A) and distances (B) of S1.
Next, we examined the neural population response for cells that were selective by ANOVA for the duration of S1 but not for its distance. Figure 4A shows the mean activity of these neurons (100 neurons) during the duration task. This group had a significantly higher firing rate for the preferred vs. nonpreferred duration of S1 that began ∼200 ms before the end of its presentation and was maintained during the D1 period (P < 0.05/24, paired-sample t-test with Bonferroni correction). In contrast, when we analyzed the activity of the same neurons in the distance task, matching far distances with long durations and near ones with short ones to assign preferred and nonpreferred conditions (see materials and methods), the neurons did not show any significant differences in activity between conditions. Figure 4A also shows the flat response that characterized the activity of the neurons for the preferred and nonpreferred conditions and their lack of selectivity for distance of S1. We performed the same analysis with the neurons that were selective for the distance of S1 in the spatial task but not for its duration in the duration task (28 neurons). Figure 4B shows a lack of modulation in the activity of the neurons for the duration of S1 in the duration task. In contrast, as expected, they encoded its distance during the D1 period. Thus these population analyses confirm that the sharing of the representation of duration and distance for PF neurons does not exceed what is expected by chance.
Fig. 4.
Population analyses. A: mean activity of the population of neurons that significantly encode the duration of S1 in the early D1 period (80–400 ms) in the duration task. Left: mean activity of the population for preferred (thick line) and nonpreferred (thin line) S1 durations in the duration task (*P < 0.05/24, paired-sample t-test with Bonferroni correction). Right: mean activity of the same neurons in the distance task when far and near placements are considered equivalent to long and short durations of S1, respectively, and are used as references to compute preferred and nonpreferred conditions. Error bars are SE. B: mean activity of the population of neurons that significantly encode the distance of S1 in the early D1 period (80–400 ms) in the distance task. Left: mean population activity in the duration task for preferred (thick line) and nonpreferred (thin line) conditions when far and near distances are considered equivalent to long and short durations of S1, respectively. Right: mean activity of the same neurons in the distance task (*P < 0.05/24, paired-sample t-test with Bonferroni correction). Error bars are SE. FR, firing rate.
To rule out the possibility that the observed lack of neural representation of distance in the neurons that were selective for duration, and vice versa, was caused by the averaging of the activity of the population, we used a peristimulus time histogram-based classification method with neuron-dropping analysis (Foffani and Moxon 2004; Lebedev et al. 2004) (see materials and methods). The method does not assume a matching of preferences (long/short duration with far/near distance) and does not average the activity across trials and neurons but instead, considers the individual responses to single trials and sums up the contribution of the set or subsets of neurons. We observed that the long or short duration of S1 could be decoded from the activity within the early D1 period of the neurons selective for the duration of S1 in the duration task (100 neurons). The classification accuracy increased with the number of neurons considered, reaching a value of 95% of correct decoding when all neurons were used (Fig. 5A). Likewise, the far or near distance of S1 could be decoded with an accuracy of 84% using the activity from the early D1 period activity of the neurons selective for the distance in the distance task (28 neurons; Fig. 5B). However, when the same groups of neurons were tested in the distance and the duration tasks, respectively, the classification accuracies were close to chance levels in both cases, regardless of the number of neurons considered. This result confirms the lack of common magnitude coding in these two groups of neurons.
Fig. 5.
Prediction of duration and distance of S1 from neural activity. A: percentage of correctly classified cases in the duration (black) and distance (gray) tasks from the mean neural activity in the early D1 period of neurons selective for S1 duration in the duration task. The percentage of the correct classification is computed, considering groups of 1 to ndur − nc neurons. B: same analyses when the neurons selective for S1 distance during the distance task are considered (1 to ndist − nc neurons). Dashed lines indicate chance level of the classification (50%).
Among the small population of neurons selective for both duration and distance of S1 (13 neurons), one group changed preference between tasks, whereas the other group, instead, maintained the same preference between the two tasks. Specifically, nine neurons had the same preference for duration and space (long duration and long distance or short duration and short distance), whereas four neurons showed a change in preference (long duration but short distance or short duration but long distance). Although the difference in the proportion of neurons was significant (binomial test, P < 0.01), overall, our results show a small proportion of neurons with a common magnitude coding scheme, which is not significantly different from chance.
DISCUSSION
In this study, we focused on the period of the first delay after the presentation of an initial stimulus to examine the encoding and decoding of absolute magnitude and found that PF neurons encoded absolute distance and duration independently. Whereas past studies addressed the function of several brain areas in the representation of duration, we report the first examination of the possible conjunctive representation of absolute duration and distance by individual neurons in the PF.
Two studies (Eiselt and Nieder 2016; Tudusciuc and Nieder 2009) assessed the representation of space and numbers. The Tudusciuc and Nieder (2009) study, using a match-to-sample task, reported that 20% of selective neurons that were recorded in the PF represented numbers and line length, pointing to a generalist function of the PF in the representation of magnitude. Subsequently, Eiselt and Nieder (2016) evaluated the representation of numbers, line length, and spatial frequency, adopting a more demanding paradigm than the match-to-sample task of Tudusciuc and Nieder (2009). In this new task (Eiselt and Nieder 2016), monkeys were required to report whether a test quantity was “greater than” or “less than” a sample quantity, depending on the rule that was cued. In contrast to their previous study, they found no overlap among populations of neurons that encoded each magnitude. The authors attributed this discrepancy to the difference in demand between tasks, which was higher in the second experiment, in which monkeys were required to switch flexibly among rules during its performance.
Although our current tasks did not require any rule-dependent switch, the monkeys were required to base their decision on the comparison of the two stimuli. Given that the domain specificity was consistent with that of Eiselt and Nieder (2016), the key aspect is likely to be whether the subject can simply match the stimulus to the other or compare their relative values within each magnitude—not the demands of flexible rule-switching. To compare the relative magnitudes without interference (Genovesio et al. 2015), independent neural magnitudes are more efficient than a general network—a model consistent with childhood development of neural networks from holistic to fractionated, fine-tuned systems (Tsujimoto 2008; Tsujimoto et al. 2007).
Conversely, later in the task, once the goal is selected based on the comparison, the modality-specific or independent systems might become redundant. Our previous findings (Genovesio et al. 2012) concur with this hypothesis. In this earlier study, we investigated the representation of relative magnitudes in the PF and showed that neuronal activity develops over time along a specificity-generality axis, ending with generalist neurons that encode the same goal, regardless of the sensory domain that had guided the goal. In that study, however, we did not examine whether the values of the two magnitudes were coded independently before the decision process.
Our current findings fill this gap, demonstrating that absolute magnitude signals develop in a domain-specific manner in the early stages of the task—not only in the decision phase. The neurons code duration and distance metrics independently, or in other words, the number of neurons that encode both distance and duration is not higher than the one expected by chance. The independence of coding of the two absolute magnitudes thus originates as early as their initial representation and is maintained while calculating the relative value (Genovesio et al. 2012, 2015). In this series of studies, goal encoding appears as the first magnitude-independent representation, consistent with goal generation and monitoring as important functions of the PFdl (Falcone et al. 2015; Genovesio et al. 2006a, 2008, 2014a, b; Genovesio and Ferraina 2014; Kusunoki et al. 2009; Marcos and Genovesio 2016; Rainer et al. 1999; Tsujimoto 2008) and with the proposed function of goal coding as a general organizational principle in the PF (Stoianov et al. 2015).
A similar trend in the PF—from specific to general, in terms of sensory modalities rather than magnitudes—was also reported in our previous study using a strategy task (Tsujimoto et al. 2012). The cues instructed one of two strategies: “stay” with the previous response or “shift” to the alternative one. The cue could be drops of fluid reward or a visual stimulus. We found that in the PFdl, the spatial goal or response preference was represented in a modality-specific manner during the presentation of the cue. Only later in the delay period did we observe a transition from modality-specific to modality-general activity in neurons that started to share the spatial goal preference. The current findings also support our previous data on the selectivity of duration coding in a context-dependent manner (Genovesio et al. 2016). In the previous study, however, we did not compare the coding of different magnitudes, but instead, we looked at the coding of duration in different contexts. Our current findings are consistent with the traditional view of the function of the PF in bridging sensory information and motor responses (Takeda and Funahashi 2002; Wang et al. 2015) and apply to a more granular model: the modality-specific representation of absolute magnitude; comparison of relative magnitudes based on such independent absolute coding systems; and goal generation and representation, which are domain general.
In our task, the period of interest is the working memory period. In contrast to other experimental designs, in which the studied property of a stimulus is not its duration but alternative ones, such as space or numbers (Dehaene et al. 1998; Eiselt and Nieder 2016; Tudusciuc and Nieder 2009), the duration of the stimulus can only be determined after its presentation. Thus the working memory period is the only epoch in which the neural representation of duration and distance can be compared.
It is still possible that there is partial overlap of computational resources for various magnitudes at the level of the parietal cortex, in which several magnitudes have been hypothesized to share a common representational format along a common, spatially organized line (Dehaene et al. 2003; Hubbard et al. 2005). With the limitation of the discussion to space and time in support of a parietal representation of magnitudes, brain-imaging studies have shown parietal activation in tasks that require orienting one's attention to time intervals and spatial locations (Coull and Nobre 1998) and in collision tasks in which the subjects are required to integrate spatial and temporal information to predict a collision (Assmus et al. 2003). In the current and previous studies, we did not find evidence of absolute or relative common representation of two different magnitudes, besides the resource sharing for goal and action in PF.
Our results show that there is a small proportion of neurons exhibiting a common magnitude coding scheme and that the proportion is not significantly different from chance. Therefore, it is unlikely that such a small population of neurons could generate the magnitude of interference that has been reported (Basso et al. 1996; Casasanto and Boroditsky 2008; Mendez et al. 2011; Mitchell and Davis 1987). Moreover, the proportion is very low compared with the neurons that have shown to be selective for the goal in the two tasks [see Fig. 2 in Genovesio et al. (2012)]. This previous study not only showed a larger overlap of goal coding in the two tasks but also found that such neurons mostly share the same goal preference, just with few exceptions. Nevertheless, it is important to mention that not all ranges of magnitudes might interfere with each other. Indeed, only the classification of specific ranges of duration and distance into “long” and “short” categories is correlated (Mendez et al. 2011). In particular, the categorization of spatial distances within 3.7° and 8.2° correlated with the classification of durations within 200 and 1,520 ms. The range of magnitude values used in our experiment substantially overlaps with the reported ranges, providing a suitable framework to investigate the possible common neural representation of the two magnitudes. Nevertheless, we cannot completely rule out the possibility of a higher overlap in the neural coding of distance and duration if a different set of magnitude ranges were used.
Our study supports our initial hypothesis that interference among different kinds of magnitudes, such as size or duration (Xuan et al. 2007), occurs at the level of goal coding—not at the perceptual level (Genovesio et al. 2012). In support of this hypothesis, Yates et al. (2012) showed that larger stimuli are perceived longer in comparative judgments but not in equality judgments in which no goal or decision interference is possible. Further experiments are needed to confirm the generality of our results in other tasks, such as less demanding or similar tasks in which the distance and duration of the same stimulus are varied simultaneously to determine whether the independence of distance and time is maintained.
GRANTS
Support for this work was partially provided by the Division of Intramural Research of the National Institute of Mental Health (Z01MH-01092) and by the Italian Ministry of Research, “Fondo per gli investimenti della ricerca di base” FIRB 2010 (Protocol Number RBFR10G5W9_001).
DISCLOSURES
No conflicts of interest, financial or otherwise, are declared by the authors.
AUTHOR CONTRIBUTIONS
A.G. conceived and designed research; S.T. and A.G. performed experiments; E.M. and A.G. analyzed data; E.M., S.T., and A.G. interpreted results of experiments; E.M. prepared figures; E.M., S.T., and A.G. drafted manuscript; E.M., S.T., and A.G. edited and revised manuscript; E.M., S.T., and A.G. approved final version of manuscript.
REFERENCES
- Assmus A, Marshall JC, Ritzl A, Noth J, Zilles K, Fink GR. Left inferior parietal cortex integrates time and space during collision judgments. Neuroimage 20, Suppl 1: S82–S88, 2003. [DOI] [PubMed] [Google Scholar]
- Baars BJ, Ramsøy TZ, Laureys S. Brain, conscious experience and the observing self. Trends Neurosci 26: 671–675, 2003. [DOI] [PubMed] [Google Scholar]
- Bartolo R, Prado L, Merchant H. Information processing in the primate basal ganglia during sensory-guided and internally driven rhythmic tapping. J Neurosci 34: 3910–3923, 2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Basso G, Nichelli P, Frassinetti F, Di Pellegrino G. Time perception in a neglected space. Neuroreport 7: 2111–2114, 1996. [DOI] [PubMed] [Google Scholar]
- Brody CD, Hernandez A, Zainos A, Romo R. Timing and neural encoding of somatosensory parametric working memory in macaque prefrontal cortex. Cereb Cortex 13: 1196–1207, 2003. [DOI] [PubMed] [Google Scholar]
- Casasanto D, Boroditsky L. Time in the mind: using space to think about time. Cognition 106: 579–593, 2008. [DOI] [PubMed] [Google Scholar]
- Casella G, Berger RL. Statistical Inference. Belmont, CA: Duxbury, 1990. [Google Scholar]
- Chiba A, Oshio K, Inase M. Striatal neurons encoded temporal information in duration discrimination task. Exp Brain Res 186: 671–676, 2008. [DOI] [PubMed] [Google Scholar]
- Coull JT, Nobre AC. Where and when to pay attention: the neural systems for directing attention to spatial locations and to time intervals as revealed by both PET and fMRI. J Neurosci 18: 7426–7435, 1998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dehaene S, Dehaene-Lambertz G, Cohen L. Abstract representations of numbers in the animal and human brain. Trends Neurosci 21: 355–361, 1998. [DOI] [PubMed] [Google Scholar]
- Dehaene S, Piazza M, Pinel P, Cohen L. Three parietal circuits for number processing. Cogn Neuropsychol 20: 487–506, 2003. [DOI] [PubMed] [Google Scholar]
- Dickey AS, Suminski A, Amit Y, Hatsopoulos NG. Single-unit stability using chronically implanted multielectrode arrays. J Neurophysiol 102: 1331–1339, 2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Duncan J. The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour. Trends Cogn Sci 14: 172–179, 2010. [DOI] [PubMed] [Google Scholar]
- Eiselt AK, Nieder A. Single-cell coding of sensory, spatial and numerical magnitudes in primate prefrontal, premotor and cingulate motor cortices. Exp Brain Res 234: 241–254, 2016. [DOI] [PubMed] [Google Scholar]
- Falcone R, Brunamonti E, Ferraina S, Genovesio A. Neural encoding of self and another agent's goal in the primate prefrontal cortex: human-monkey interactions. Cereb Cortex. First published October 13, 2015; doi: 10.1093/cercor/bhv224. [DOI] [PubMed]
- Foffani G, Moxon KA. PSTH-based classification of sensory stimuli using ensembles of single neurons. J Neurosci Methods 135: 107–120, 2004. [DOI] [PubMed] [Google Scholar]
- Genovesio A, Brasted PJ, Wise SP. Representation of future and previous spatial goals by separate neural populations in prefrontal cortex. J Neurosci 26: 7305–7316, 2006a. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Genovesio A, Cirillo R, Tsujimoto S, Mohammad Abdellatif S, Wise SP. Automatic comparison of stimulus durations in the primate prefrontal cortex: the neural basis of across-task interference. J Neurophysiol 114: 48–56, 2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Genovesio A, Ferraina S. The influence of recent decisions on future goal selection. Philos Trans R Soc Lond B Biol Sci 369: 20130477, 2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Genovesio A, Seitz LK, Tsujimoto S, Wise SP. Context-dependent duration signals in the primate prefrontal cortex. Cereb Cortex 26: 3345–3356, 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Genovesio A, Tsujimoto S. From duration and distance comparisons to goal encoding in prefrontal cortex. Adv Exp Med Biol 829: 167–186, 2014. [DOI] [PubMed] [Google Scholar]
- Genovesio A, Tsujimoto S, Navarra G, Falcone R, Wise SP. Autonomous encoding of irrelevant goals and outcomes by prefrontal cortex neurons. J Neurosci 34: 1970–1978, 2014a. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Genovesio A, Tsujimoto S, Wise SP. Encoding goals but not abstract magnitude in the primate prefrontal cortex. Neuron 74: 656–662, 2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Genovesio A, Tsujimoto S, Wise SP. Encoding problem solving strategies in prefrontal cortex: activity during strategic errors. Eur J Neurosci 27: 984–990, 2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Genovesio A, Tsujimoto S, Wise SP. Feature and order-based timing representations in the frontal cortex. Neuron 63: 254–266, 2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Genovesio A, Tsujimoto S, Wise SP. Neuronal activity related to elapsed time in prefrontal cortex. J Neurophysiol 95: 3281–3285, 2006b. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Genovesio A, Tsujimoto S, Wise SP. Prefrontal cortex activity during the discrimination of relative distance. J Neurosci 31: 3968–3980, 2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Genovesio A, Wise SP, Passingham RE. Prefrontal-parietal function: from foraging to foresight. Trends Cogn Sci 18: 72–81, 2014b. [DOI] [PubMed] [Google Scholar]
- Hoshi E, Shima K, Tanji J. Neuronal activity in the primate prefrontal cortexin the process of motor selection based on two behavioral rules. J Neurophysiol 83: 2355–2373, 2000. [DOI] [PubMed] [Google Scholar]
- Hubbard EM, Piazza M, Pinel P, Dehaene S. Interactions between number and space in parietal cortex. Nat Rev Neurosci 6: 435–448, 2005. [DOI] [PubMed] [Google Scholar]
- Janssen P, Shadlen MN. A representation of the hazard rate of elapsed time in macaque area LIP. Nat Neurosci 8: 234–241, 2005. [DOI] [PubMed] [Google Scholar]
- Jin DZ, Fujui N, Graybiel AM. Neural representation of time in cortico-basal ganglia circuits. Proc Natl Acad Sci USA 106: 19156–19161, 2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kilavik BE, Confais J, Ponce-Alvarez A, Diesmann M, Riehle A. Evoked potentials in motor cortical local field potentials reflect task timing and behavioral performance. J Neurophysiol 104: 2338–2351, 2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kusunoki M, Sigala N, Gaffan D, Duncan J. Detection of fixed and variable targets in the monkey prefrontal cortex. Cereb Cortex 19: 2522–2534, 2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lambrechts A, Walsh V, van Wassenhove V. Evidence accumulation in the magnitude system. PLoS One 8: e82122, 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lebedev MA, Messinger A, Kralik JD, Wise SP. Representation of attended versus remembered locations in prefrontal cortex. PLoS Biol 2: e365, 2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lebedev MA, O'Doherty JE, Nicolelis MA. Decoding of temporal intervals from cortical ensemble activity. J Neurophysiol 99: 166–186, 2008. [DOI] [PubMed] [Google Scholar]
- Lucchetti C, Bon L. Time-modulated neuronal activity in the premotor cortex of macaque monkeys. Exp Brain Res 141: 254–260, 2001. [DOI] [PubMed] [Google Scholar]
- Marcos E, Genovesio A. Determining monkey free choice long before the choice is made: the principal role of prefrontal neurons involved in both decision and motor processes. Front Neural Circuits 10: 75, 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marcos E, Tsujimoto S, Genovesio A. Event- and time-dependent decline of outcome information in the primate prefrontal cortex. Sci Rep 6: 25622, 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mendez JC, Prado L, Mendoza G, Merchant H. Temporal and spatial categorization in human and non-human primates. Front Integr Neurosci 5: 10, 2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Merchant H, Crowe DA, Robertson MS, Fortes AF, Georgopoulos AP. Top-down spatial categorization signal from prefrontal to posterior parietal cortex in the primate. Front Syst Neurosci 5: 69, 2011a. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Merchant H, Pérez O, Zarco W, Gámez J. Interval tuning in the primate medial premotor cortex as a general timing mechanism. J Neurosci 33: 9082–9096, 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Merchant H, Zarco W, Pérez O, Prado L, Bartolo R. Measuring time with different neural chronometers during a synchronization-continuation task. Proc Natl Acad Sci USA 108: 19784–19789, 2011b. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Merritt DJ, Casasanto D, Brannon EM. Do monkeys think in metaphors? Representations of space and time in monkeys and humans. Cognition 117: 191–202, 2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mita A, Mushiake H, Shima K, Matsuzaka Y, Tanji J. Interval time coding by neurons in the presupplementary and supplementary motor areas. Nat Neurosci 12: 502–507, 2009. [DOI] [PubMed] [Google Scholar]
- Mitchell CT, Davis R. The perception of time in scale model environments. Perception 16: 5–16, 1987. [DOI] [PubMed] [Google Scholar]
- Morrone MC, Ross J, Burr D. Saccadic eye movements cause compression of time as well as space. Nat Neurosci 8: 950–954, 2005. [DOI] [PubMed] [Google Scholar]
- Nieder A, Freedman DJ, Miller EK. Representation of the quantity of visual items in the primate prefrontal cortex. Science 297: 1708–1711, 2002. [DOI] [PubMed] [Google Scholar]
- Ohmae S, Lu X, Takahashi T, Uchida Y, Kitazawa S. Neuronal activity related to anticipated and elapsed time in macaque supplementary eye field. Exp Brain Res 184: 593–598, 2008. [DOI] [PubMed] [Google Scholar]
- Ono F, Kawahara JI. The subjective size of visual stimuli affects the perceived duration of their presentation. Percept Psychophys 69: 952, 2007. [DOI] [PubMed] [Google Scholar]
- Oshio K, Chiba A, Inase M. Delay period activity of monkey prefrontal neurones during duration-discrimination task. Eur J Neurosci 23: 2779–2790, 2006. [DOI] [PubMed] [Google Scholar]
- Oshio K, Chiba A, Inase M. Temporal filtering by prefrontal neurons in duration discrimination. Eur J Neurosci 28: 2333–2343, 2008. [DOI] [PubMed] [Google Scholar]
- Passingham RE, Wise SP. The neurobiology of the prefrontal cortex: anatomy, evolution, and the origin of insight. Oxford, UK: Oxford University Press, 2012. [Google Scholar]
- Rainer G, Rao SC, Miller EK. Prospective coding for objects in primate prefrontal cortex. J Neurosci 19: 5493–5505, 1999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rammsayer TH, Verner M. The effect of nontemporal stimulus size on perceived duration as assessed by the method of reproduction. J Vis 14: 17, 2014. [DOI] [PubMed] [Google Scholar]
- Renoult L, Roux S, Riehle A. Time is a rubberband: neuronal activity in monkey motor cortex in relation to time estimation. Eur J Neurosci 23: 3098–3108, 2006. [DOI] [PubMed] [Google Scholar]
- Ross J, Morrone MC, Burr DC. Compression of visual space before saccades. Nature 386: 598–601, 1997. [DOI] [PubMed] [Google Scholar]
- Saito N, Mushiake H, Sakamoto K, Itoyama Y, Tanji J. Representation of immediate and final behavioral goals in the monkey prefrontal cortex during an instructed delay period. Cereb Cortex 15: 1535–1546, 2005. [DOI] [PubMed] [Google Scholar]
- Sakurai Y, Takahashi S, Inoue M. Stimulus duration in working memory is represented by neuronal activity in the monkey prefrontal cortex. Eur J Neurosci 20: 1069–1080, 2004. [DOI] [PubMed] [Google Scholar]
- Schneider B, Ghose GM. Temporal production signals in parietal cortex. PLoS Biol 10: e1001413, 2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Srinivasan M, Carey S. The long and the short of it: on the nature and origin of functional overlap between representations of space and time. Cognition 116: 217–241, 2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stoianov I, Genovesio A, Pezzulo G. Prefrontal goal codes emerge as latent states in probabilistic value learning. J Cogn Neurosci 6: 1–18, 2015. [DOI] [PubMed] [Google Scholar]
- Takeda K, Funahashi S. Prefrontal task-related activity representing visual cue location or saccade direction in spatial working memory tasks. J Neurophysiol 87: 567–588, 2002. [DOI] [PubMed] [Google Scholar]
- Tsujimoto S. The prefrontal cortex: functional neural development during early childhood. Neuroscientist 14: 345–358, 2008. [DOI] [PubMed] [Google Scholar]
- Tsujimoto S, Genovesio A, Wise SP. Neuronal activity during a cued strategy task: comparison of dorsolateral, orbital, and polar prefrontal cortex. J Neurosci 32: 11017–11031, 2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tsujimoto S, Kuwajima M, Sawaguchi T. Developmental fractionation of working memory and response inhibition during childhood. Exp Psychol 54: 30–37, 2007. [DOI] [PubMed] [Google Scholar]
- Tsujimoto S, Sawaguchi T. Neuronal activity representing temporal prediction of reward in the primate prefrontal cortex. J Neurophysiol 93: 3687–3692, 2005. [DOI] [PubMed] [Google Scholar]
- Tudusciuc O, Nieder A. Contributions of primate prefrontal and posterior parietal cortices to length and numerosity representation. J Neurophysiol 101: 2984–2994, 2009. [DOI] [PubMed] [Google Scholar]
- Walsh V. A theory of magnitude: common cortical metrics of time, space and quantity. Trends Cogn Sci 7: 483–488, 2003. [DOI] [PubMed] [Google Scholar]
- Wang L, Li X, Hsiao SS, Lenz FA, Bodner M, Zhou YD, Fuster JM. Differential roles of delay-period neural activity in the monkey dorsolateral prefrontal cortex in visual-haptic crossmodal working memory. Proc Natl Acad Sci USA 112: E214–E219, 2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wilson CR, Gaffan D, Browning PG, Baxter MG. Functional localization within the prefrontal cortex: missing the forest for the trees? Trends Neurosci 33: 533–540, 2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Xuan B, Zhang D, He S, Chen X. Larger stimuli are judged to last longer. J Vis 7: 1–5, 2007. [DOI] [PubMed] [Google Scholar]
- Yates MJ, Loetscher T, Nicholls ME. A generalized magnitude system for space, time, and quantity? A cautionary note. J Vis 12: 1–7, 2012. [DOI] [PubMed] [Google Scholar]
- Yumoto N, Lu X, Henry TR, Miyachi S, Nambu A, Fukai T, Takada M. A neural correlate of the processing of multi-second time intervals in primate prefrontal cortex. PLoS One 6: e19168, 2011. [DOI] [PMC free article] [PubMed] [Google Scholar]





