Abstract
The task of deciding how long sensory events seem to last is one that the human nervous system appears to perform rapidly and, for sub-second intervals, seemingly without conscious effort. That these estimates can be performed within and between multiple sensory and motor domains suggest time perception forms one of the core, fundamental processes of our perception of the world around us. Given this significance, the current paucity in our understanding of how this process operates is surprising. One candidate mechanism for duration perception posits that duration may be mediated via a system of duration-selective ‘channels’, which are differentially activated depending on the match between afferent duration information and the channels' ‘preferred’ duration. However, this model awaits experimental validation. In the current study, we use the technique of sensory adaptation, and we present data that are well described by banks of duration channels that are limited in their bandwidth, sensory-specific, and appear to operate at a relatively early stage of visual and auditory sensory processing. Our results suggest that many of the computational principles the nervous system applies to coding visual spatial and auditory spectral information are common to its processing of temporal extent.
Keywords: time perception, channels, visual, auditory, adaptation, duration
1. Introduction
There currently exists a marked dichotomy in our understanding of how we perceive the spatial and temporal properties of the world around us. For example, our knowledge of auditory location [1], visual position [2], size [3], orientation [4] and motion [5] processing have undergone step changes in recent decades. Relative to this body of spatial knowledge, our understanding of time perception is less well developed. This is perhaps surprising, given the critical importance of accurate temporal estimates for all aspects of sensory-motor processing, from speech perception to accurate guidance of our motor system. As recently highlighted [6], a likely cause for this dichotomy lies in the elusive nature of the neural mechanisms that underpin temporal processing. One profitable approach to probing these mechanisms is that of sensory adaptation [7]. For example, the application of adaptation techniques to questions surrounding spatial processing in the visual system have played a key role in revealing ‘channel’-based (CB) analysis and its underlying properties [8]. Equally, the auditory system appears to have dedicated channels for the estimation of location [9] and pitch [10,11]. A critical component of these CB systems is the presence of individual neural units that respond selectively to a relatively narrow range of afferent sensory information. For example, clusters of neurons in visual area V1 respond vigorously when presented with stimuli oriented close to vertical, but display relatively little activity when presented with horizontally oriented stimuli (i.e. their output is tuned) [12].
Returning to the temporal domain, it has been suggested that a similar approach could be used to construct sensory estimates of temporal extent. Specifically, a putative CB system for duration might contain neural units that respond selectively to a narrow range of stimulus durations centred on their preferred duration [13,14]. By comparing relative activation states across banks of these duration-tuned neurons, a ‘population response’ would emerge, which would signal the most likely perceived duration. Although behavioural evidence for human temporal judgements subserved by CB mechanisms remains sparse, it is noteworthy that several neurophysiological studies provide examples of visual [15,16] and auditory [17,18] neurons displaying bandpass duration tuning.
Such an arrangement would confer several advantages to the nervous system. First, population-based estimates tend to be relatively free of the potential ambiguity associated with absolute activity levels within individual channels (e.g. events with similar durations but differing levels of salience/intensity). Second, a system capable of extracting features of a population response is able to interpolate across individual channels, thus facilitating accurate estimates of duration over a range far greater than that predicted by its total number of constituent channels. However, while this framework appears theoretically feasible [13], it awaits experimental validation.
In the current study, we employ adaptation techniques to test predictions made by a CB model of temporal perception. Our findings show that recent sensory history plays a critical role in our perception of event duration. Adaptation to auditory or visual events of a consistent duration induces distortions in perceived duration that do not transfer to the non-adapted sensory modality. This effect is temporally tuned: when the relative durations of adapting and test stimuli are sufficiently different, the adapting stimulus fails to influence the perception of the test stimulus. Finally, we show that similar patterns of adaptation can be demonstrated across a range of durations spanning at least 160–640 ms, which form scaled, self-similar versions of one another. These findings provide strong support for CB models of time perception and display striking similarities to the features of the CB mechanisms known to mediate numerous perceptual estimates in the visual and auditory domains.
2. Materials and methods
(a). Participants
Nine observers (four authors and five naive) participated in the main adaptation experiments while either three or four observers participated in subsequent control experiments (see figure legends for details).
(b). Stimuli
The visual stimulus was a 100 per cent contrast isotropic Gaussian luminance blob (σ = 2.26° at a viewing distance of 57 cm) displayed against a uniform grey background (mean luminance: 47 cd m−2). The blob was presented at the centre of a gamma-corrected monitor screen (Sony Trinitron GDM FW900), which was driven by an Apple Mac Pro desktop computer running Mac OS 10.5. The visual stimulus was generated using Matlab 7.7 (Mathworks, USA) and Psychophysics Toolbox 3 (http://www.psychtoolbox.org). The auditory stimulus consisted of a burst of white noise presented via Sennheiser HD 280 headphones. Delivery of visual and auditory stimuli and the collection of observer's responses were controlled from within Matlab using custom software. The physical durations of visual and auditory stimuli were given rectangular onset–offset profiles. All timings were verified via simultaneous capture on a dual-channel oscilloscope.
(c). Procedure
(i). Main adaptation experiments
Observers adapted to sequences of visual or auditory stimuli with a fixed duration before making two interval, forced choice duration discrimination judgements as to ‘which had the longer duration—test or reference stimulus?’ The test stimulus arose from the adapted sensory modality stimuli, whereas the reference stimulus arose from the non-adapted modality (figure 1). The duration of the reference stimulus remained fixed at 320 ms, while test stimulus duration varied in seven logarithmically spaced steps from 237 to 421 ms, which were randomly interleaved within a method of constant stimuli. Adapting duration was either 0 (‘no adapt’ baseline condition; figure 2, red data; figure 3, blue data), 40, 80, 160, 240, 400, 640, 1280 or 2560 ms and remained constant within each experimental block. Following an initial adaptation period comprising 100 adapting stimulus presentations, a 2000 ms pause signalled the start of the ‘top-up’ phase, which constituted the presentation of a further four adapting durations followed by reference and then test stimulus presentations. Receipt of the subject's duration discrimination judgement (via keyboard) triggered the presentation of the next top-up and test cycle. The inter-stimulus interval (ISI) between adapting, top-up, reference and test stimuli was randomly jittered in the range 500–1000 ms. Each block contained 10 repetitions of each test duration and three blocks were added together to give a total of 30 repetitions per condition. The presentation order of each block was selected by the presentation software in a pseudorandom order (figures 2–4; electronic supplementary material, figures S1, S2 and S5).
(ii). Control experiments
Figure 4 and electronic supplementary material, figure S2 comprise data from an experiment identical to that described above, with the exception that two further ranges of test durations were investigated. These ranges were centred on 160 and 640 ms, and were coupled with adaptation ranges spanning a three-octave range centred on the middle of the test duration range.
The reproduction experiment (electronic supplementary material, figures S3 and S4) was similar to the initial adaptation experiment, with two exceptions. First, the reference stimulus was removed such that the test stimulus now appeared immediately following the final top-up stimulus presentation. Second, the duration discrimination judgement was replaced with a reproduction task (see schematic shown in electronic supplementary material, figure S3) where observers depressed a keyboard button for a duration matching their estimate of the test duration. The effects of two adapting durations (160 ms, ‘adapt short’ and 640 ms, ‘adapt long’) on reproduction of the same seven test durations (237–421 ms—as per figure 2) were examined. This process was repeated for the four conditions shown in electronic supplementary material, figure S3.
The temporal frequency control experiment (electronic supplementary material, figure S5) involved adapting to a 160 ms duration visual stimulus and was similar to the main experiments (e.g. figure 2) with the exception that average ISI was increased from 750 ms (jittered between 500 and 1000 ms, as per the data shown in figures 2 and 3) to 1385 ms (jittered between 1135 and 1635 ms). This had the effect of reducing time-averaged stimulus presentation frequency from 1.1 to 0.72 Hz (as per the 640 ms data conditions shown in figures 2 and 3).
(iii). Data analysis
Psychometric functions comprising observer's duration discrimination judgement were plotted showing the proportion of ‘test longer than reference’ responses as a function of test duration (e.g. figure 2). These functions were fitted with a logistic of the form
where α is the test duration value corresponding to the point of subjective equality (PSE; the 50% response level on the psychometric function) and θ provides an estimate of duration discrimination threshold (approximately half the offset between the 27% and 73% response levels). In this way, PSE values were obtained for all observers (figures 2–4; electronic supplementary material, figures S1, S2 and S5).
PSE data shown in figures 3 and 4 and electronic supplementary material, figure S2 were fitted with a curve based on the first derivative of a Gaussian, namely
where D is the adaption duration, σ the standard deviation of the Gaussian, A a constant related to the amplitude of the function and (xpos, ypos) the origin of the function (note that when D = xpos, PSE = ypos). The maxima and minima of this function occur at adaptor durations ±σ log units from the origin (i.e. log(D/xpos) = ±σ). The half-amplitude of this function (μ), which represents the magnitude by which the PSE deviates from baseline (i.e. the size of any illusion), is therefore given by
For the final reproduction experiment (electronic supplementary material, figures S3 and S4), the reproduced durations for each observer were averaged across test durations to give a mean reproduced duration (MRD) for each of the four conditions shown in electronic supplementary material, figure S3: (i) adapt visual duration, reproduce auditory duration; (ii) adapt auditory duration, reproduce visual duration; (iii) adapt visual duration, reproduce visual duration; and (iv) adapt auditory duration, reproduce auditory duration. For each of these conditions, the arithmetic difference between ‘adapt short’ and ‘adapt long’ was computed, then averaged across observers (n = 4), and forms the bars shown in electronic supplementary material, figure S4.
3. Results
(a). Experience dependent duration plasticity
Psychometric functions for a representative naive observer are shown in figure 2. The lateral separation in opposite directions from the ‘no adapt’ baseline condition (figure 2, red data) of the green and blue functions shows that adaptation clearly modulates the proportion of ‘test longer’ responses in a repulsive fashion. Specifically, adapting to relatively short visual or auditory durations (160 ms; figure 2, blue data) induces an expansion in the perceived test durations (237–421 ms) that is subsequently viewed (figure 2a) or heard (figure 2b). The magnitude of this effect is reflected in the physical test duration corresponding to perceived equivalence between test and reference durations (the PSE). For example, after adapting to 160 ms durations, visual PSE shifts from 330 to 289 ms, while auditory PSE shifts from 306 to 274 ms. A reciprocal pattern is observed following adaptation to relatively long durations (640 ms), where test durations undergo perceptual compression (figure 2, green data). Average PSE shifts show this effect to be consistent across observers (n = 9; see electronic supplementary material, figure S1).
This pattern of repulsion-type after-effects is broadly similar to that observed following adaptation to consistent spatial information [8]. For example, prolonged viewing of visual stimuli of a relatively high spatial frequency induces a decrease in the perceived spatial frequency of subsequently viewed stimuli [3,19]. This parallel suggests that a CB framework may be consistent with the duration after-effects shown in figure 2. However, a further prediction of CB models concerns the relationship between after-effect magnitude and the degree of similarity between adaptation and test stimuli. This is exemplified by the finding that the influence of adaptation to consistent motion [20], orientation [21] and spatial frequency [22] is constrained to situations where adapt and test stimuli fall within a limited perceptual distance of one another. This distance is typically linked to the degree of selectivity associated with the system's individual component channels (i.e. their bandwidth). In many cases, these psychophysical measurements map closely onto the underlying response properties of neurons at multiple scales of the visual system [7].
(b). Tuned duration after-effects
We investigated the possibility of duration-tuned mechanisms in humans by systematically altering the duration of the adapting stimuli while keeping the range of test stimuli constant. Average PSE values (n = 9) were extracted from the psychometric functions corresponding to each visual (figure 3a) and auditory (figure 3b) adaptation duration. Relative to the central ‘no adapt’ data point (in blue), increasing or decreasing the duration of the adapting stimuli induces a decrease or increase in PSE (in red), respectively. This reflects a relative contraction and expansion of perceived duration, which appears to increase in an approximately linear fashion over a limited range of adapter durations. Beyond this range, adaptation magnitude declines such that the longest and shortest adapters (40 and 2560 ms) induce changes in perceived duration approaching those observed in the no-adapt condition. This pattern of results is markedly similar across visual and auditory domains (cf. figure 3a,b).
In order to characterize these effects, a curve based on the first derivative of a Gaussian (see §2 for details) was fitted to the data that allowed extraction of several important parameters. While the amplitude of the visual and auditory functions—reflecting the magnitude of the adaptation effect—is similar, the bandwidths of the functions (in octaves) are slightly broader for vision than audition (1.44 versus 1.26). In other words, both modalities appear to possess approximately equivalent degrees of flexibility in response to duration adaptation, yet vision shows a greater tolerance to discrepancies between the duration of test and adaptor. Consistent with earlier reports [23–26], auditory durations are perceived as longer than their (physically identical) visual counterparts, irrespective of adaptation. This is reflected in the vertical offset between the two datasets, with a higher PSE indicating relatively shorter perceived duration.
(c). Scaled, self-similar duration channels
In addition to the tuning features described above, channel- or filter-based perceptual systems are further characterized by a trend towards banks of overlapping channels that form self-similar, scaled versions of one another. For example, the bandwidth of channels responsible for processing auditory pitch [27,28] or visual spatial frequency [22,29,30] typically form a fixed proportion of the frequency to which channel is maximally responsive. When expressed in logarithmic terms, this gives rise to tuning functions that are approximately equivalent in appearance across a large range of stimulus parameters. Given that our range of test durations (237–421 ms) contains substantial overlap with biologically significant durations such as those thought to be critical for speech perception [31,32], effects shown in figures 2 and 3 may reflect duration mechanisms that are peculiar to this test range. Alternatively, if duration channels form a generalized feature of temporal judgements in the ‘automatic’ range [33,34], comparable versions of tuning data from figure 3 should be elicited by testing at different sub-second ranges. We tested this hypothesis by examining the effect of duration adaptation on two further ranges of test durations centred on 160 and 640 ms. Each test range was paired with a corresponding range of adapting durations that formed octave steps either side of the centre of the test range (see §2 for details). Results for one representative observer are shown in figure 4. For both modalities, longer (640 ms, black curve) and shorter (160 ms, green curve) test range data show a marked degree of similarity to the 320 ms range data (in red, as per figure 3). Specifically, despite small variations in bandwidth and amplitude values across the different test ranges, a remarkable degree of similarity is evident between the three functions. This pattern of results is replicated across observers as shown in electronic supplementary material, figure S2. Channels characterized by scaled, self-similar bandwidths are entirely consistent with the data shown in figure 4.
(d). Sensory specificity
These adaptation effects appear to be limited to the adapting modality: if our duration distortions transferred between test and reference stimuli (i.e. from audition to vision and vice versa; figure 1) then both the test and (opposite sense) reference would be affected equally, resulting in no measurable effect. Nevertheless, it remains possible that a partial transfer across the modalities could mask larger after-effect magnitudes than those seen in figures 2–4. We investigated this possibility by replacing our duration discrimination judgements with a reproduction task (see schematic shown in electronic supplementary material, figure S3) where our reference stimuli were omitted. Instead, observers depressed a button for a duration that matched their estimate of the test stimulus's perceived duration (see §2 for details). Although reproduction tasks are associated with issues surrounding their criterion-dependent nature [35], by removing the relative nature of the intersensory comparisons made in figures 2–4, a more absolute measure of perceived time is made available. The results of this experiment are shown in electronic supplementary material, figure S4, where the effects of adaptation are expressed as the difference between MRDs following adaptation to 160 and 640 ms durations, with positive values indicating repulsive duration after-effects of the type observed in earlier figures and values close to zero indicating little or no effect of adaptation. While the reproduction data show some differences in the absolute value of the adaptation effects (cf. those observed with duration discrimination judgements), two key features of the data warrant consideration. First, the positive values observed for the within-modality, ‘intramodal’ adaptation conditions show that repulsive duration aftereffects are not peculiar to the methodology employed in earlier experiments. Second, these repulsive after-effects were only elicited when adaptation and test stimuli arose from the same sensory modality.
(e). Duration adaptation or temporal frequency adaptation?
Recent evidence suggests that the perception of moderately paced rhythmic auditory patterns can be slowed down or speeded up via prior exposure to relatively fast or slow tone sequences [14]. Although our observers adapted to filled durations rather than rhythmic sequences, the combination of stimulus duration and an average ISI of 750 ms (jittered between 500 and 1000 ms) provides observers with an average temporal frequency (TF) that will vary with the duration of the adapting stimulus. For example, adapting to 160 ms stimuli introduces an average TF of 1.1 Hz, whereas a 640 ms adapting stimulus provides an average TF of 0.72 Hz. In order to ascertain whether TF after-effects contribute to the effects presented thus far, we designed a control experiment where visual adapting duration was fixed at 160 ms but average ISI was manipulated to provide a TF of 1.1 Hz (see §2 for details). If our adaptation effects are driven by a TF-based mechanism, we would expect to see equivalence between the 1.1 Hz (160 ms duration stimuli) condition and the 1.1 Hz (640 ms duration stimuli) condition. However, if our effects reflect genuine duration adaptation, the 1.1 Hz (160 ms) should share similarity with the 160 ms data shown in figures 2–4. The results are shown in electronic supplementary material, figure S5, where adaptation-induced shifts in PSE are plotted—relative to the 320 ms baseline condition—for the two different TFs and adapting durations. Clearly, the closest match in after-effect magnitude and polarity is between the 0.72 Hz (160 ms) and 1.1 Hz (160 ms) conditions. This finding confirms the underlying importance of event duration—rather than interevent TF—in generating the after-effects presented here.
(f). Modelling the effects of duration adaptation
Adaptation-induced biases in perception are typically explained using a common set of assumptions: (i) stimulus properties are encoded by populations of neurons with distinct (though typically overlapping) tuning curves; (ii) adaptation selectively changes the responses of these neurons; and (iii) downstream mechanisms that decode (‘read out’) the activity of the population are unaware of these changes (for recent reviews see [36,37]). To determine whether it is possible to account for the effects of duration adaptation in a similar manner, we constructed a simple population coding model comprising sets of dedicated, modality-specific time channels. Our intention was to establish a model capable of quantitatively describing our psychophysical data with the smallest set of assumptions possible.
We began by generating a population of neurons with log-Gaussian duration tuning for each sensory modality (figure 5). Physiological evidence has previously been reported for this form of duration tuning across a range of neural structures [15–18,38–40]. Preferred durations were arbitrarily set to range from 1 to 1000 ms in equal log steps. In different simulations, we varied the number of neurons (n) and the standard deviation (σ) of the tuning functions (fixed for each modality). Adaptation was modelled as a selective modality-specific reduction in response gain that was maximal at adapted duration (Amax) and fell off with log-Gaussian profile (width set by Aσ).
Simulations mirrored the trial-by-trial structure of the psychophysical experiment, with a variable test stimulus presented to the adapted modality and a fixed 320 ms reference stimulus presented to the other modality. Neuronal responses were sampled from independent Poisson distributions centred on the value of each tuning curve for a given stimulus. We used a maximum-likelihood decoder [41] to generate a binary response on each trial. Figure 6 shows shifts in the PSE produced by the best-fitting model, alongside the corresponding empirical data. Clearly, the model is able to reproduce the repulsive shifts in perceived duration caused by adaptation and provide a reasonable approximation of the tuning of this effect (R2 = 0.9).
4. Discussion
In the current study, we present evidence that human estimates of visual and auditory temporal extent are mediated by a series of bandwidth-limited duration channels. Specifically, adaptation to fixed auditory or visual duration induces sensory-specific distortions of subsequently heard or viewed durations. The temporal spread of these distortions is limited by the temporal proximity of adaptation and test stimuli, a feature that underscores one of the key similarities between our duration-based effects and the classic literature characterizing CB visual [8] and auditory [42] processing. The fact that our data are well predicted by a generic CB model—without recourse to any novel features specific to temporal perception—emphasizes the similarities between established forms of CB perception and the effects presented in the current study.
(a). Psychophysical context
A significant aspect of our data is the seeming ability of recent experience to selectively initiate both expansion and contraction of perceived duration. This bidirectionality differentiates our effects from other recent duration-based phenomena where sensory history also appears to play a role. For example, perceived duration can be manipulated via prior exposure to dynamic visual stimuli such as flickering patches [43,44] or drifting gratings [43–45]. Similarly, it has recently been argued that perceived visual duration depends on the extent to which a stimulus is deemed to be repetitive (i.e. its relative novelty) [46]. In both instances, experimental manipulations induce a unidirectional contraction of perceived duration but, as yet, have not shown reciprocal effects.
Our CB framework provides an explanation for earlier reports showing that repeated stimulation [47] or perceptual anchoring [23] can influence subsequent duration judgements. In addition, emerging evidence from perceptual learning experiments suggests that training-related increases in duration discrimination sensitivity are tied to durations close to the centre of the trained duration range [48]. Consistent with the data shown in figure 4 and electronic supplementary material, figure S2, the magnitude and bandwidth of these learning effects are approximately constant when expressed relative to the trained range (3–4% and 8–11%, respectively [48]). Similarly, one of the defining characteristics of duration judgements is the proportional relationship between duration discrimination thresholds and mean estimated duration (Weber's law for duration). Both of these effects show a degree of proportionality consistent with the data shown in figure 4 and electronic supplementary material, figure S2, and sit comfortably within a CB framework. Specifically, because channel bandwidth appears to vary in proportion to preferred duration, a system using these channels should show precisely the kind of Weber's law behaviour that is so often observed throughout the duration perception literature [49–52]. Interestingly, the amplitude of our effects shows a small but consistent tendency to decline with increases in test duration range (figure 4; electronic supplementary material, figure S2). On first inspection, this effect is perhaps suggestive of smaller levels of response gain reduction (figure 5) at longer test duration ranges. However, it is perhaps more likely to reflect an artefactual feature introduced by the increases in the total elapsed time between successive test stimulus presentations: longer test durations are paired with proportionally longer adaptation stimuli, which have the unintended consequence of lengthening test/re-test interval (figure 1). As such, it is reasonable to speculate that some degree of temporal decay is operating at the longer test duration ranges (cf. green, red and black data in figure 4 and electronic supplementary material, figure S2). In a further control experiment, we found that adaptation failed to influence perceived duration when our train of adapting stimuli was replaced with a single adapting stimulus. This finding appears to distance our effects from rapid, attention-dependent adaptation phenomena for which neural loci are thought to reside in extra-striate areas of the cortex [53–56].
(b). Neural basis
To model our results, we have implemented a population coding framework in which stimulus duration is represented by the pattern of activation across a number of bandpass-tuned channels. A critical property of this framework is that stimuli of a particular duration stimulate (and therefore adapt) channels in a selective manner, allowing us to account for both the bidirectional (i.e. compressive and expansive) and tuned characteristics of the observed after-effects. While bandpass tuning of responses as a function of certain stimulus attributes is relatively common in sensory neurons, realizing this form of selectivity in the time domain poses unique challenges. Consider a collection of channels that each selectively responds once a particular time interval has elapsed following stimulus onset. Because of the unidirectional flow of time, the presentation of a stimulus will elicit a ‘domino effect’ in which channels respond successively one after another. In principle, repeated presentation of brief adapting stimuli might selectively adapt channels tuned to brief intervals, providing a basis for explaining expansions of perceived duration. However, as these same channels would also respond to each presentation of a longer adapting stimulus, achieving the selective adaptation required to produce compressions of perceived duration is problematic.
A simple mechanism that avoids this problem is a form of coincidence detection, in which channel activity is driven by simultaneous occurrence of sub-threshold excitatory events linked to stimulus onset and offset [18,38]. Within this scheme, different duration preferences can be generated by varying the latency of the onset event. Neurophysiological evidence for this type of tuning has been documented in the auditory midbrain (inferior colliculus) [17,18,57], primary auditory cortex [39,40], primary visual cortex [15] and prefrontal cortex [16]. Neurons within these areas display a phasic burst of spiking activity at stimulus offset, the magnitude of which is tied to the time elapsed since stimulus onset. This provides a direct physiological substrate for the modality-specific bandpass duration channels detailed in our model.
A variety of interval-coding mechanisms has been proposed, not all of which rely on dedicated timing channels [6,58]. Recent years have seen the emergence of distributed timing models, referred to as population clocks, which rely on time-dependent changes in the state of neural networks [33,59]. This approach offers considerable flexibility, permitting the continuous coding of elapsed time as well as an ability to discriminate between more complex temporal patterns. Because timing is represented in the dynamics of the entire network, it is not immediately obvious how our finding of selective duration after-effects could be accommodated within this framework. In some implementations of population clock models, different network states are read by output neurons that receive inputs from all the neurons in the network [60]. Feasibly, these output neurons could provide the basis of adaptable duration channels. However, neurophysiological evidence for this process is limited and it remains to be seen whether such a scheme could produce duration selectivity that overcomes the cascading activation problem discussed earlier.
One of the key advantages of a CB system is that the overlapping nature of these channels (figure 5) negates the need for the system to accommodate a large (potentially infinite) number of channels corresponding to every conceivable duration: by comparing differential activation levels across channels and extracting the population response [61,62], the system can interpolate between neighbouring channels' preferred durations. As outlined earlier, in addition to offering metabolic savings, such a system also affords high-resolution, low-ambiguity estimates of duration. However, this efficiency comes at a cost to the nervous system: sustained activity within individual channels (figure 5) induces repulsive biases in the population response to subsequently presented durations.
(c). Conclusions
By using sensory adaptation, we have revealed a pattern of temporal perception that is indicative of a perceptual system underpinned by a range of overlapping duration-sensitive channels. We suggest that when formulating estimates of temporal extent, the human nervous system applies some of the same computational principles that are used in the processing of many of the fundamental—yet non-temporal—properties of the world around us.
Acknowledgements
The work was supported by The Wellcome Trust (grant code 85315), The College of Optometrists and The Federation of Ophthalmic and Dispensing Opticians.
References
- 1.Blauert J. 1997. Spatial hearing. Cambridge, MA: MIT Press [Google Scholar]
- 2.Westheimer G. 1979. The spatial sense of the eye. Invest. Ophthalmol. Vis. Sci. 18, 893–912 [PubMed] [Google Scholar]
- 3.Blakemore C., Campbell F. W. 1969. On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images. J. Physiol. (Lond.) 203, 237–260 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Blakemore C., Nachmias J. 1971. The orientation specificity of two visual after-effects. J. Physiol. (Lond.) 213, 157–174 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Barlow H. B., Hill R. M. 1963. Evidence for a physiological explanation of the waterfall phenomenon and figural after-effects. Nature 200, 1345–1347 10.1038/2001345a0 (doi:10.1038/2001345a0) [DOI] [PubMed] [Google Scholar]
- 6.Ivry R. B., Schlerf J. E. 2008. Dedicated and intrinsic models of time perception. Trends Cogn. Sci. 12, 273–280 10.1016/j.tics.2008.04.002 (doi:10.1016/j.tics.2008.04.002) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Kohn A. 2007. Visual adaptation: physiology, mechanisms, and functional benefits. J. Neurophysiol. 97, 3155–3164 10.1152/jn.00086.2007 (doi:10.1152/jn.00086.2007) [DOI] [PubMed] [Google Scholar]
- 8.De Valois R., De Valois K. 1990. Spatial vision. Oxford, UK: Oxford University Press [Google Scholar]
- 9.Kashino M., Nishida S. 1998. Adaptation in the processing of interaural time differences revealed by the auditory localization aftereffect. J. Acoust. Soc. Am. 103, 3597–3604 10.1121/1.423064 (doi:10.1121/1.423064) [DOI] [PubMed] [Google Scholar]
- 10.Fletcher H. F. 1940. Auditory patterns. Rev. Mod. Phys. 12, 47–65 10.1103/RevModPhys.12.47 (doi:10.1103/RevModPhys.12.47) [DOI] [Google Scholar]
- 11.Regan D., Tansley B. W. 1979. Selective adaptation to frequency-modulated tones: evidence for an information-processing channel selectively sensitive to frequency changes. J. Acoust. Soc. Am. 65, 1249–1257 10.1121/1.382792 (doi:10.1121/1.382792) [DOI] [PubMed] [Google Scholar]
- 12.Hubel D. H., Wiesel T. N. 1968. Receptive fields and functional architecture of monkey striate cortex. J. Physiol. (Lond.) 195, 215–243 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Ivry R. B. 1996. The representation of temporal information in perception and motor control. Curr. Opin. Neurobiol. 6, 851–857 10.1016/S0959-4388(96)80037-7 (doi:10.1016/S0959-4388(96)80037-7) [DOI] [PubMed] [Google Scholar]
- 14.Becker M. W., Rasmussen I. P. 2007. The rhythm aftereffect: support for time sensitive neurons with broad overlapping tuning curves. Brain Cogn. 64, 274–281 10.1016/j.bandc.2007.03.009 (doi:10.1016/j.bandc.2007.03.009) [DOI] [PubMed] [Google Scholar]
- 15.Duysens J., Schaafsma S. J., Orban G. A. 1996. Cortical off response tuning for stimulus duration. Vision Res. 36, 3243–3251 10.1016/0042-6989(96)00040-5 (doi:10.1016/0042-6989(96)00040-5) [DOI] [PubMed] [Google Scholar]
- 16.Yumoto N., Lu X., Henry T. R., Miyachi S., Nambu A., Fukai T., Takada M. 2011. A neural correlate of the processing of multi-second time intervals in primate prefrontal cortex. PLoS ONE 6, e19168. 10.1371/journal.pone.0019168 (doi:10.1371/journal.pone.0019168) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Casseday J. H., Ehrlich D., Covey E. 1994. Neural tuning for sound duration: role of inhibitory mechanisms in the inferior colliculus. Science 264, 847–850 10.1126/science.8171341 (doi:10.1126/science.8171341) [DOI] [PubMed] [Google Scholar]
- 18.Faure P. A., Fremouw T., Casseday J. H., Covey E. 2003. Temporal masking reveals properties of sound-evoked inhibition in duration-tuned neurons of the inferior colliculus. J. Neurosci. 23, 3052–3065 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Blakemore C., Campbell F. W. 1969. Adaptation to spatial stimuli. J. Physiol. (Lond.) 200, 11–13 [PubMed] [Google Scholar]
- 20.Schrater P. R., Simoncelli E. P. 1998. Local velocity representation: evidence from motion adaptation. Vision Res. 38, 3899–3912 10.1016/S0042-6989(98)00088-1 (doi:10.1016/S0042-6989(98)00088-1) [DOI] [PubMed] [Google Scholar]
- 21.Gibson J. J., Radner M. 1937. Adaptation, aftereffect, and contrast in the perception of tilted lines. I. Quantitative studies. J. Exp. Psychol. 20, 453–467 10.1037/h0059826 (doi:10.1037/h0059826) [DOI] [Google Scholar]
- 22.Blakemore C., Nachmias J., Sutton P. 1970. Perceived spatial frequency shift: evidence for frequency-selective neurones in human brain. J. Physiol. (Lond.) 210, 727–750 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Behar I., Bevan W. 1961. The perceived duration of auditory and visual intervals: cross-modal comparison and interaction. Am. J. Psychol. 74, 17–26 10.2307/1419819 (doi:10.2307/1419819) [DOI] [PubMed] [Google Scholar]
- 24.Goldstone S., Lhamon W. T. 1974. Studies of auditory-visual differences in human time judgment. I. Sounds are judged longer than lights. Percept. Motor Skills 39, 63–82 [DOI] [PubMed] [Google Scholar]
- 25.Walker J. T., Scott K. J. 1981. Auditory-visual conflicts in the perceived duration of lights, tones, and gaps. J. Exp. Psychol. Human 7, 1327–1339 10.1037/0096-1523.7.6.1327 (doi:10.1037/0096-1523.7.6.1327) [DOI] [PubMed] [Google Scholar]
- 26.Wearden J. H., Edwards H., Fakhri M., Percival A. 1998. Why ‘sounds are judged longer than lights’: application of a model of the internal clock in humans. Q. J. Exp. Psychol. Sect. B 51, 97–120 [DOI] [PubMed] [Google Scholar]
- 27.Patterson R. D. 1976. Auditory filter shapes derived with noise stimuli. J. Acoust. Soc. Am. 59, 640–654 10.1121/1.380914 (doi:10.1121/1.380914) [DOI] [PubMed] [Google Scholar]
- 28.Zwicker E. 1961. Subdivision of the audible frequency range into critical bands (frequenzgruppen). J. Acoust. Soc. Am. 33, 248. 10.1121/1.1908630 (doi:10.1121/1.1908630) [DOI] [Google Scholar]
- 29.Devalois R. L., Albrecht D. G., Thorell L. G. 1982. Spatial-frequency selectivity of cells in macaque visual-cortex. Vision Res. 22, 545–559 10.1016/0042-6989(82)90113-4 (doi:10.1016/0042-6989(82)90113-4) [DOI] [PubMed] [Google Scholar]
- 30.Sachs M. B., Nachmias J., Robson J. G. 1971. Spatial-frequency channels in human vision. J. Opt. Soc. Am. 61, 1176. 10.1364/JOSA.61.001176 (doi:10.1364/JOSA.61.001176) [DOI] [PubMed] [Google Scholar]
- 31.Ackermann H., Graber S., Hertrich I., Daum I. 1997. Categorical speech perception in cerebellar disorders. Brain Lang. 60, 323–331 10.1006/brln.1997.1826 (doi:10.1006/brln.1997.1826) [DOI] [PubMed] [Google Scholar]
- 32.Schirmer A. 2004. Timing speech: a review of lesion and neuroimaging findings. Cognit. Brain Res. 21, 269–287 10.1016/j.cogbrainres.2004.04.003 (doi:10.1016/j.cogbrainres.2004.04.003) [DOI] [PubMed] [Google Scholar]
- 33.Karmarkar U. R., Buonomano D. V. 2007. Timing in the absence of clocks: encoding time in neural network states. Neuron 53, 427–438 10.1016/j.neuron.2007.01.006 (doi:10.1016/j.neuron.2007.01.006) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Lewis P. A., Miall R. C. 2003. Distinct systems for automatic and cognitively controlled time measurement: evidence from neuroimaging. Curr. Opin. Neurobiol. 13, 250–255 10.1016/S0959-4388(03)00036-9 (doi:10.1016/S0959-4388(03)00036-9) [DOI] [PubMed] [Google Scholar]
- 35.Wearden J. H., Lejeune H. 2008. Scalar properties in human timing: conformity and violations. Q. J. Exp. Psychol. 61, 569–587 10.1080/17470210701282576 (doi:10.1080/17470210701282576) [DOI] [PubMed] [Google Scholar]
- 36.Schwartz O., Hsu A., Dayan P. 2007. Space and time in visual context. Nat. Rev. Neurosci. 8, 522–535 10.1038/nrn2155 (doi:10.1038/nrn2155) [DOI] [PubMed] [Google Scholar]
- 37.Series P., Stocker A. A., Simoncelli E. P. 2009. Is the homunculus ‘aware’ of sensory adaptation? Neural Comput. 21, 3271–3304 10.1162/neco.2009.09-08-869 (doi:10.1162/neco.2009.09-08-869) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Aubie B., Becker S., Faure P. A. 2009. Computational models of millisecond level duration tuning in neural circuits. J. Neurosci. 29, 9255–9270 10.1523/JNEUROSCI.1085-09.2009 (doi:10.1523/JNEUROSCI.1085-09.2009) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Galazyuk A. V., Feng A. S. 1997. Encoding of sound duration by neurons in the auditory cortex of the little brown bat, Myotis lucifugus. J. Comp. Physiol. A 180, 301–311 10.1007/s003590050050 (doi:10.1007/s003590050050) [DOI] [PubMed] [Google Scholar]
- 40.He J. F., Hashikawa T., Ojima H., Kinouchi Y. 1997. Temporal integration and duration tuning in the dorsal zone of cat auditory cortex. J. Neurosci. 17, 2615–2625 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Jazayeri M., Movshon J. A. 2006. Optimal representation of sensory information by neural populations. Nat. Neurosci. 9, 690–696 10.1038/nn1691 (doi:10.1038/nn1691) [DOI] [PubMed] [Google Scholar]
- 42.Malmierca M. S., Irvine D. R. F. 2005. Auditory spectral processing. San Diego, CA: Elsevier Academic Press [Google Scholar]
- 43.Ayhan I., Bruno A., Nishida S., Johnston A. 2009. The spatial tuning of adaptation-based time compression. J. Vision 9, 1–12 10.1167/9.11.2 (doi:10.1167/9.11.2) [DOI] [PubMed] [Google Scholar]
- 44.Johnston A., Arnold D. H., Nishida S. 2006. Spatially localized distortions of event time. Curr. Biol. 16, 472–479 10.1016/j.cub.2006.01.032 (doi:10.1016/j.cub.2006.01.032) [DOI] [PubMed] [Google Scholar]
- 45.Burr D., Tozzi A., Morrone M. C. 2007. Neural mechanisms for timing visual events are spatially selective in real-world coordinates. Nat. Neurosci. 10, 423–425 [DOI] [PubMed] [Google Scholar]
- 46.Pariyadath V., Eagleman D. M. 2008. Brief subjective durations contract with repetition. J. Vision 8, 1–6 10.1167/8.16.11 (doi:10.1167/8.16.11) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Walker J. T., Irion A. L., Gordon D. G. 1981. Simple and contingent aftereffects of perceived duration in vision and audition. Percept. Psychophys. 29, 475–486 10.3758/BF03207361 (doi:10.3758/BF03207361) [DOI] [PubMed] [Google Scholar]
- 48.Bartolo R., Merchant H. 2009. Learning and generalization of time production in humans: rules of transfer across modalities and interval durations. Exp. Brain Res. 197, 91–100 10.1007/s00221-009-1895-1 (doi:10.1007/s00221-009-1895-1) [DOI] [PubMed] [Google Scholar]
- 49.Getty D. J. 1975. Discrimination of short temporal intervals: a comparison of two models. Percept. Psychophys. 18, 1–8 10.3758/BF03199358 (doi:10.3758/BF03199358) [DOI] [Google Scholar]
- 50.Jazayeri M., Shadlen M. N. 2010. Temporal context calibrates interval timing. Nat. Neurosci. 13, 1020–1026 10.1038/nn.2590 (doi:10.1038/nn.2590) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Miyazaki M., Nozaki D., Nakajima Y. 2005. Testing Bayesian models of human coincidence timing. J. Neurophysiol. 94, 395–399 10.1152/jn.01168.2004 (doi:10.1152/jn.01168.2004) [DOI] [PubMed] [Google Scholar]
- 52.Westheimer G. 1999. Discrimination of short time intervals by the human observer. Exp. Brain Res. 129, 121–126 10.1007/s002210050942 (doi:10.1007/s002210050942) [DOI] [PubMed] [Google Scholar]
- 53.Kovacs G., Cziraki C., Vidnyanszky Z., Schweinberger S. R., Greenlee M. W. 2008. Position-specific and position-invariant face aftereffects reflect the adaptation of different cortical areas. NeuroImage 43, 156–164 10.1016/j.neuroimage.2008.06.042 (doi:10.1016/j.neuroimage.2008.06.042) [DOI] [PubMed] [Google Scholar]
- 54.Kovacs G., Zimmer M., Harza I., Vidnyanszky Z. 2007. Adaptation duration affects the spatial selectivity of facial aftereffects. Vision Res. 47, 3141–3149 10.1016/j.visres.2007.08.019 (doi:10.1016/j.visres.2007.08.019) [DOI] [PubMed] [Google Scholar]
- 55.Muller K. M., Wilke M., Leopold D. A. 2009. Visual adaptation to convexity in macaque area v4. Neuroscience 161, 655–662 10.1016/j.neuroscience.2009.03.070 (doi:10.1016/j.neuroscience.2009.03.070) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Roach N. W., McGraw P. V. 2009. Dynamics of spatial distortions reveal multiple time scales of motion adaptation. J. Neurophysiol. 102, 3619–3626 10.1152/jn.00548.2009 (doi:10.1152/jn.00548.2009) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Brand A., Urban A., Grothe B. 2000. Duration tuning in the mouse auditory midbrain. J. Neurophysiol. 84, 1790–1799 [DOI] [PubMed] [Google Scholar]
- 58.Mauk M. D., Buonomano D. V. 2004. The neural basis of temporal processing. Annu. Rev. Neurosci. 27, 307–340 10.1146/annurev.neuro.27.070203.144247 (doi:10.1146/annurev.neuro.27.070203.144247) [DOI] [PubMed] [Google Scholar]
- 59.Buonomano D. V., Merzenich M. M. 1995. Temporal information transformed into a spatial code by a neural-network with realistic properties. Science 267, 1028–1030 10.1126/science.7863330 (doi:10.1126/science.7863330) [DOI] [PubMed] [Google Scholar]
- 60.Buonomano D. V., Laje R. 2010. Population clocks: motor timing with neural dynamics. Trends Cogn. Sci. 14, 520–527 10.1016/j.tics.2010.09.002 (doi:10.1016/j.tics.2010.09.002) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Levinson E., Sekuler R. 1976. Adaptation alters perceived direction of motion. Vision Res. 16, 779–781 10.1016/0042-6989(76)90189-9 (doi:10.1016/0042-6989(76)90189-9) [DOI] [PubMed] [Google Scholar]
- 62.Mather G. 1980. The movement aftereffect and a distribution-shift model for coding the direction of visual movement. Perception 9, 379–392 10.1068/p090379 (doi:10.1068/p090379) [DOI] [PubMed] [Google Scholar]