Abstract
Most neurons in the primary visual cortex initially respond vigorously when a preferred stimulus is presented, but adapt as stimulation continues. The functional consequences of adaptation are unclear. Typically a reduction of firing rate would reduce single neuron accuracy as less spikes are available for decoding, but it has been suggested that on the population level, adaptation increases coding accuracy. This question requires careful analysis as adaptation not only changes the firing rates of neurons, but also the neural variability and correlations between neurons, which affect coding accuracy as well. We calculate the coding accuracy using a computational model that implements two forms of adaptation: spike frequency adaptation and synaptic adaptation in the form of short-term synaptic plasticity. We find that the net effect of adaptation is subtle and heterogeneous. Depending on adaptation mechanism and test stimulus, adaptation can either increase or decrease coding accuracy. We discuss the neurophysiological and psychophysical implications of the findings and relate it to published experimental data.
Keywords: Visual adaptation, Primary visual cortex, Population coding, Fisher Information, Cortical circuit, Computational model, Short-term synaptic depression, Spike-frequency adaptation
1 Introduction
Adaptation is a reduction in the firing activity of neurons to prolonged stimulation. It is a ubiquitous phenomenon that has been observed in many sensory brain regions, such as auditory (Shu et al. 1993; Ulanovsky et al. 2004), and somatosensory (Ahissar et al. 2000) cortices, as well as in primary visual cortex (V1) (Ohzawa et al. 1982; Carandini and Ferster 1997; Gutnisky and Dragoi 2008). In addition to response reduction, adaptation has been observed to deform the tuning curves (Muller et al. 1999; Dragoi et al. 2000; Ghisovan et al. 2008a, b), which is thought to lead to perceptual after-effects, such as the tilt after-effect (Jin et al. 2005; Schwartz et al. 2007, 2009; Kohn z2007; Seriès et al. 2009).
Adaptation is hypothesized to be functionally important for coding sensory information (Kohn 2007; Schwartz et al. 2007). On the single neuron level, the reduction in firing rate should reduce coding accuracy, since it will typically become harder to discriminate two similar stimuli when firing rates are lowered. However, on the population level the accuracy is determined not only by the firing rates, but also by the correlations between neurons. In primary visual cortex it has been observed that adaptation reduces correlations, which can improve population coding accuracy (Gutnisky and Dragoi 2008). However, it is currently unknown how accuracy is affected when both changes in firing rates and changes in the correlations are taken into account.
The coding accuracy of a population response can be analyzed using Fisher Information, which gives an upper bound to the accuracy that any decoder can achieve. Importantly, the Fisher Information takes the effects of correlations in neural variability (so called noise correlations) into account. Depending on the exact structure of the correlations, the Fisher Information can either increase or decrease with correlation strength (Oram et al. 1998; Abbott and Dayan 1999; Sompolinsky et al. 2002; Seriès et al. 2004; Averbeck et al. 2006). Therefore a precise determination of the correlation structure is required, which is difficult to accomplish experimentally since vast amounts of data are required. Moreover, experimental probe stimuli that measure coding before and after adaptation can induce additional adaptation, possibly obscuring the effect of the adaptor.
Here we study this issue using a computational model of primary visual cortex. We implement a variety of possible adaptation mechanisms and study coding accuracy before and after adaptation. We find that the precise adaptation mechanism and its parameters lead to diverse results: accuracy can decrease but under certain conditions also increase after adaptation. The changes in information due to tuning curves changes resulting are typically opposite from the changes in information due to correlations changes.
2 Methods
2.1 Network setup
The model of V1, Fig. 1(a), was a rate-based version of the ring model (Ben-Yishai et al. 1995; Somers et al. 1995; Teich and Qian 2003). The model did not pretend to be a full model of the visual system, but included essential cortical mechanisms that can produce adaptation. In the model, each of the N = 128 neurons was labeled by its preferred orientation θ, which ranged between −90 and 90 degrees. The instantaneous firing rate R̄θ (spikes per second) was proportional to the rectified synaptic current.
(1) |
where [x]+ = max(x, 0). The constant b is the background firing rate and κ represents the gain to produce the firing rate R̄θ for a given input I. Parameter values can be found in Table 1. We also used smoother rectification functions (van Rossum et al. 2008); however, this did not affect the results. The above firing rate model had the advantage of being much more efficient than a spiking model, while Fisher information in spiking models (Seriès et al. 2004) and rate models (Spiridon and Gerstner 2001) have been found to be qualitatively similar. Moreover, implementation of realistic variability across a wide range of firing rates is challenging in spiking models (for a review see e.g., Barbieri and Brunel 2008).
Table 1.
Meaning | Symbol | Value |
---|---|---|
Neuron’s preferred orientation | θ | (−90, 90) degrees |
Adapter orientation | ψ | 0 degrees |
Test orientation | φ | (−90, 90) degrees |
Time decay of synaptic current | τ | 10 ms |
Amplitude of thalamocortical input | aff | 4.0 |
Gaussian width of thalamocortical input | σff | 45.0 |
Gain for excitatory intracortical input | gexc | 0.2 |
Interaction power for excitatory connections | Aexc | 2.2 |
Gain for inhibitory intracortical input | ginh | 2.5 |
Interaction power for inhibitory connections | Ainh | 1.4 |
Probability of excit. transmitter release | U | 0.02 |
Recovering time for synaptic depression | τ | 600 ms |
Background firing rate | b | 4 Hz |
Input current to firing rate gain | κ | 4.0 Hz |
Fano Factor | FF | 1.5 |
Time decay for spike frequency adaptation (SFA) | τsfa | 50 ms |
Gain for spike frequency adaptation | gsfa | 0.05 |
For each neuron the synaptic current had a triple angular dependence and evolved in time according to
(2) |
where ψ is the adapter angle, φ is the test stimulus angle, and τ is the synaptic time constant (Dayan and Abbott 2001). The current consisted of (1) feed-forward excitatory input Iff from the LGN, (2) excitatory Iexc and inhibitory Iinh input mediated by lateral connections with a center-surround (Mexican-hat) profile subject to short-term synaptic depression, and (3) an adaptation current Isfa which described spike frequency adaptation.
2.1.1 Network connections
The input Iff represented feed-forward excitatory input from LGN. Except for Fig. 8 it was assumed not to be subject to adaptation (Boudreau and Ferster 2005). It was modeled as a Gaussian profile with periodic boundary conditions:
(3) |
where σff represents the Gaussian width of stimulus profile and aff its amplitude.
Lateral connections mediated the excitatory (Iexc) and inhibitory (Iinh) inputs to neuron i according to
(4) |
where θj and θi represented respectively the pre- and postsynaptic neurons, the constants g were recurrent gain factors, and Rθ (φ, ψ, t) was a noisy realization of the firing rate (see below). The variables x in Eq. (4) represented the efficacy of the synapses subject to short-term plasticity (see below as well).
The functions and in Eq. (4) define the connection strength between cells θi and θj. We use (Teich and Qian 2003)
(5) |
and
(6) |
where
(7) |
The functions and were normalized with the constant C so that the sum of connections from any cell to the rest equals 1, that is 1/C = Σi|K(θi)|.
The exponents Aexc and Ainh control the range of interaction; the smaller they are, the flatter and wider the connection profile. We used a center-surround or Mexican-hat profile for the connection, satisfying Aexc > Ainh, as in previous studies (Ben-Yishai et al. 1995; Teich and Qian 2003; Seriès et al. 2004). The precise profile of lateral inhibition is not well known. However, we found that in order to obtain sharpening (from a broad thalamocortical input to a sharp cortical neuron response, Fig. 1(b)) the shape of inhibition was not critical, i.e. both long range inhibition or a flat profile gave similar results.
2.1.2 Synaptic short-term plasticity model
In the model cortical synaptic short-term depression affected the lateral connections only; the afferents from the LGN did not depress as observed experimentally (Boudreau and Ferster 2005). We used a phenomenological model of short-term depression (Tsodyks and Markram 1997): The fraction of available neurotransmitter x of a synapse of a presynaptic neuron with orientation θ was
where U is the release probability. The variable x ranged between zero and one, with zero corresponding to a fully depleted synapse and one to a non-depressed synapse. Before stimulation and in the control condition, all x were set to one. The constant τrec was the recovery time from depletion to resting conditions. During prolonged stimulation, the steady state of the depression variable is smaller when the recovery time is slower, because . We only included depression in the excitatory connections (Galarreta and Hestrin 1998; Teich and Qian 2003; Chelaru and Dragoi 2008). We found that the opposite situation, namely stronger depression of inhibitory connections, lead to a unstable network activity.
2.1.3 Spike frequency adaptation
Spike frequency adaptation was implemented using a standard first-order model (Benda and Herz 2003)
The time constant τsfa was set to 50 ms and the gain gsfa was chosen so that the firing-rate reduction of the neuron to the adapter stimulus is comparable to that produced by synaptic depression.
2.2 Single neuron variability model
The responses of cortical neurons are typically highly variable, e.g. Tolhurst et al. (1983). To fit our noise model we used extra-cellular single unit recordings from neurons in area V1 of macaque presented with 300 ms stimuli (Oram et al. 1999). For each recorded cell, the grating orientation that elicited the maximal response was labeled as the “preferred orientation” (peak), and all orientations were given relative to the peak (22.5, 45, 67.5 and 90 degrees). For n = 19 different cells, 8 different orientations were tested with 3 stimulus types: gratings, bars lighter than background, bars darker than background. The spike rate was counted in 50 ms bins. The firing rate for each orientation was calculated as the arithmetic mean across the different stimulus types. In addition, symmetric orientations (e.g. peak at +22.5 degrees and peak at −22.5 degrees) were collapsed, yielding 60 trials for the peak and the orthogonal orientation and 20 trials for all other orientations. The variability was expressed in terms of the Fano Factor (FF), which is the spike count variance across trials divided by the mean spike count. We found that the FF was to a good approximation constant across time and independent of stimulus orientation, nor did the Fano Factor depend on the firing rate, implying that the noise was multiplicative.
To model this variability we added multiplicative noise to each neuron’s activity. The noise is added after its input current is converted to the firing rate Eq. (1), and noise reflects the stochastic nature of spikes generation. We set
where the noise η was Gaussian white noise, i.e. 〈η(t)〉 = 0, and 〈η(t)η(t′)〉 = δt,t′, and R̄θ denotes the average over all the trials. To achieve a given Fano Factor the required amplitude of the noise was set according to . The added noise is temporally uncorrelated, reflecting the approximate Poisson-like nature of cortical activity.
A sample trial is illustrated in Fig. 1(b) (red dots). To study how the trial-to-trial variability of the single cell affects the population coding, we ran simulations using FF = 0.50, 1.00, 1.50, Fig. 5(c) and (d). In addition, to further investigate the generality of our results we used two alternative noise models: (1) Poisson distributed firing rates with mean R̄ (unity Fano Factor), and (2) additive Gaussian white noise. We found that, although the absolute scale of the Fisher Information differed, the adaptation affected the information exactly identically for all test angles. In other words the effect of the adaptation was independent of exact noise model.
For the common input noise model, Fig. 7, the feed-forward input was corrupted with a multiplicative noise source that was identical on a given trial for all neurons Iff(θ, φ) = (1 +η)Īff(θ, φ), where η was a Gaussian random number with zero mean and unit variance.
2.2.1 Correlated variability
In the visual cortex the response variability is correlated (Nelson et al. 1992; Gawne et al. 1996; Kohn and Smith 2005). Although the noise in the model is temporally and spatially uncorrelated, the lateral synaptic coupling between the neurons will mix the noise from different neurons, resulting in correlated noise in the network (Seriès et al. 2004). The covariance matrix, Fig. 3 (top row), across trials was defined as
where Ri = Rθi was the firing rate of neuron i and R̄ the average across trials. Although only the q-matrix enters in the Fisher Information, experimental data is often reported using normalized correlation coefficients. The (Pearson-r) correlation coefficient cij was obtained by dividing the covariance matrix by the variances, , Fig. 3 (bottom row).
The Mexican-hat connectivity produced a covariance matrix with both positive and negative correlation, corresponding to excitatory (short range) and inhibitory (long range) lateral connections, similar to other models (Spiridon and Gerstner 2001; Seriès et al. 2004).
2.3 Quantifying population coding accuracy
To quantify the accuracy of the population code we used the Fisher Information, which is a function of the tuning of individual neurons and the noise correlations.
where R is the population response vector. For Gaussian distributed responses it equals (Wu et al. 2004; Abbott and Dayan 1999)
Note that in contrast to population coding studies with homogeneous tuning curves where the FI is constant, here the FI depends both on the stimulus angle of adapter ψ and the stimulus angle of the probe φ. The first term is given by
(8) |
where R̄′ denotes first derivative of R̄ with respect to the stimulus orientation φ, and is the inverse co-variance matrix. This term governs the discrimination performance of the optimal linear estimator and provides an upper bound to any linear estimator (Shamir and Sompolinsky 2004).
The second term equals
(9) |
For a covariance matrix independent of the stimulus orientation q′(φ, ψ) = 0, so that FI2(φ, ψ) = 0.
To calculate the derivatives appearing in Eqs. (8) and (9), we discretized the stimulus space with a resolution of h = 180/N, with N the number of neurons. The first derivative of the tuning curve of the neuron i was computed as , and similar for the derivative of the correlation matrix in Eq. (9). To accurately estimate the Fisher Information we used 12,000 trials for each data point, as too few trials lead to an overestimate of the Fisher Information (by some 5% when using only 4,000 trials).
The Fano Factor dependence for both terms can be analytically calculated; applying the Fano Factor definition, the covariance matrix is , where cij are pairwise correlations. For a population of neurons with the identical FF (as is the case here), FI1 scales with 1/FF, while FI2 is independent of FF for our noise model; this is illustrated for the control condition in Fig. 5 (bottom row).
The above calculation of the Fisher Information, Eqs. (8) and (9), assume Gaussian distributed responses. Due to the rectification in our model, Eq. (1) this won’t hold for the smallest firing rates. Unfortunately, there are no known results for the Fisher Information of correlated, non-Gaussian distributed responses, and a full sampling of the response probability distribution is computationally prohibitive. However, most of the information is coded where the tuning curve is steep. In these regions the firing rates are about half the maximum rate (Fig. 2(d)), and the Gaussian approximation is appropriate.
2.3.1 Simulation protocol
The adaptation protocol is illustrated in Fig. 1(c). For each trial, we ran the network without input until the neural activity stabilized (~150 ms), after which an adapter stimulus with orientation ψ was presented for 300 ms during which the network adapted. After this adaptation period, the adaptation state of the network was frozen, i.e. no further adaptation took place. The response to a stimulus with orientation φ was tested using equilibration of the network activity of 450 ms. The activity at the end of this period corresponded to a single trial response.
2.4 Decoders of the population activity
We measured how adaptation modified the performances of two decoders or estimators: a Population Vector decoder and a winner-take-all decoder (Jin et al. 2005). For winner-take-all decoding the estimate was simply the (non-adapted) preferred orientation of the neuron with highest firing rate. For the population vector decoder the responses of all neurons were vector summed with an orientation equal to the neuron’s preferred orientation before adaptation.
For each decoder, we computed both the bias b(θ) and the discrimination threshold T(θ). The bias is the difference between the mean perceived orientation and the actual presented stimulus orientation. The discrimination threshold follows from the trial-to-trial standard deviation in the estimate, σ (θ) as
(10) |
where D is the discrimination criterion, chosen to be 1, corresponding to an error rate of ~76%. The Cramer–Rao bound on the discrimination threshold is given by (Seriès et al. 2009)
(11) |
3 Results
To study how adaptation affects coding, we used a well studied recurrent network model of area V1, the so called ring model (Ben-Yishai et al. 1995; Somers et al. 1995; Teich and Qian 2003). Neurons in the network were described by their firing rate and received feedforward input from the LGN and lateral input via a center-surround profile, Fig. 1(a) and (b) and Section 2. The noise model of the neurons was based on extra-cellular single unit recordings from neurons in area V1 recorded using a variety of visual stimuli (see Section 2). The variability was modelled by a Gaussian, stimulus independent, multiplicative noise with a Fano Factor of 1.5.
Neural adaptation occurs through multiple mechanisms. Here we focused on two distinct mechanisms both believed to contribute significantly to the adaptation of the neural responses to prolonged stimulation: (1) Spike frequency adaptation (SFA), in which the neuron’s firing rate decreases during sustained stimulation (Sanchez-Vives et al. 2000a, b; Benda and Herz 2003), and (2) short-term synaptic depression (SD) of the excitatory intra-cortical connections, so that sustained activation of the synapses reduces synaptic efficacy (Finlayson and Cynader 1995; Varela et al. 1997; Chung et al. 2002; Best and Wilson 2004). Synaptic depression is comparatively strong in visual cortex as compared to other areas (Wang et al. 2006).
In the adaptation protocol, Fig. 1(c), an adaption inducing stimulus with an angle ψ was presented for 300 ms, after which the population response to a test stimulus with orientation φ was measured. To insure that the models were comparable, the parameters were set such that the adaptation mechanisms reduced the firing rates of neurons tuned to the adapter orientation equally, see Fig. 2(a) and (b).
3.1 Effect of adaptation on single neuron tuning
First we studied how the different adaptation mechanisms changed the single neuron tuning curves. Note that in homogeneous ring networks the response of a neuron before adaptation is a function of a single variable only, namely the difference between the stimulus angle φ and the neuron’s preferred angle θ. Adaptation, however, renders the system in-homogeneous and the responses were characterized by three angles: The angle of the adapter stimulus ψ, always set to 0 degrees, the angle of the test stimulus, and the preferred orientation of the neuron. (The preferred orientation of a neuron refers to its preferred orientation before adaptation).
Both SD and SFA reduced the responses of neurons at the adapter orientation, in addition the tuning curves deformed, see Fig. 2(a) and (b). We characterized the effect of adaptation on preferred orientation shift, tuning curve slope and tuning curve width:
Tuning curve shift (Fig. 2(c))
Adaptation shifts the tuning curve (characterized by the center of mass). For both SD and SFA the tuning curves shifted towards the adapter stimulus. Attractive shifts after adaptation have been reported before in V1 (Ghisovan et al. 2008a, b), and in area MT (Kohn and Movshon 2004), although repulsive shift have been observed in V1 as well (Muller et al. 1999; Dragoi et al. 2000).
Tuning curve slope (Fig. 2(d))
The derivative of the firing rate with respect to stimulus angle, or slope, is an important determinant of accuracy. In the absence of correlations the Fisher information is proportional to the slope (see Eq. (8), Section 2). We plotted the slope of the tuning curve as a function of the test orientation for a neuron responding preferentially to the adapter orientation. For test angles close to the adapter orientation (<20 degrees), SD reduced the absolute value of slope relative to the control condition (solid line), but SFA increased the slope. Thus, for this neuron the increase in the slope occurring for SFA increases the coding accuracy around those orientations. For test angles further from the adapter orientation (ranging from 45 to 57 degrees) both SD and SFA showed a decreasing slope.
Tuning curve width (Fig. 2(e))
The width was computed as the angular range for which the neuron’s response exceeded the background firing rate. (Similar results were obtained using the width at half height). For both SD and SFA the width narrowed close to the adapter orientation and widened at orthogonal angles.
3.2 Effects of adaptation on noise correlations
Coding accuracy is not only determined by the properties of the single neuron tuning curves, but also critically depends on the noise in the response and the correlations in the noise between the neurons (Abbott and Dayan 1999; Sompolinsky et al. 2002; Gutnisky and Dragoi 2008). These noise correlations describe the common fluctuations from trial to trial between two neurons. The noise was modeled by independent multiplicative noise to the firing rates of the individual neurons, mimicking the Poisson-like variability observed in vivo (Section 2). In the model direct and indirect synaptic connections lead to correlations in the activity and its variability. For instance, if a neuron is by chance more active on a given trial, neurons which receive excitatory connections from it will tend to be more active as well.
We first studied the correlations in the control condition. Figure 3(a) top illustrates them for a stimulus angle of zero degrees. In analogy with experiments we also characterized them by the Pearson-r correlation coefficients. The correlation coefficients in the control condition are shown in Fig. 3(a) (bottom). Only neurons with a preferred angle between approximately −45 and +45 degrees were activated by this stimulus (the square region in the center of the matrix), and could potentially show correlation.
The correlations were strongest for neurons with similar preferred angles but that responded quite weakly to the stimulus, while neurons that had approximately orthogonal tuning (−45 and +45 degrees) showed negative correlation, as observed previously (Spiridon and Gerstner 2001; Seriès et al. 2004). The reason is that the noise causes fluctuations in the position of the activity bump (the attractor state) in the network, while its shape is approximately preserved. In nearby neurons for which the stimulus was at the edge of their receptive fields, such fluctuation lead to large, common rate fluctuations and hence strong correlation. In contrast, the responses of neurons in the center of the population, although noisy, were only weakly correlated as the precise position of the attractor state hardly affected their firing rates. The correlations might appear weak in comparison to experimental data. This is further discussed below (‘Effect of common input noise’).
Adaptation led to changes in the noise correlation, Fig. 3(b) and (c) (bottom row). Spike frequency adaptation (SFA) increased noise correlations, whilst synaptic depression (SD) decreased them. The latter is easy to understand. Synaptic depression weakens the lateral connections, and thus reduces correlations, shifting the operation of the network toward a feedforward mode. Figure 3(d) shows the correlations between neighboring neurons, showing the shape of the correlations and the effect of the adaptation in one graph.
3.3 Effect of adaptation on coding accuracy
Next we combined the effects of adaptation on tuning curves and correlations to calculate population coding accuracy as measured by the Fisher Information, see Section 2. The Fisher Information before and after adaptation is plotted as a function of test orientation in Fig. 4(a). Before adaptation the information is independent of the test angle as the network is homogeneous (solid line). After adaptation, the information becomes dependent on test angle (dashed curves).
Only for SFA and only for test angles close to the adapter, the Fisher Information and hence accuracy increased. This peak was caused by the sharpening of the tuning curves near the adapter angle (see below). For all other combination of test orientation and adaptation mechanism the Fisher Information was slightly reduced. Interestingly, the shapes of the curves for SD and SFA are similar in that the Fisher Information peaked at the adapter angle.
Next, we explored the effect of the correlations on the information. We shuffled responses effectively removing any correlations. We subtracted the full Fisher Information from the Fisher Information using shuffled responses, Fig. 4(b). That this difference was always positive indicates that correlations always reduced the accuracy. After SD adaptation shuffling led to smaller increase than in control, consistent with the de-correlation caused by synaptic depression. For SFA the effect of correlations was more dominant for orientations close to the adapter angle, consistent with Fig. 3(c), and decreased for orientations far from the adapter angle.
As both individual tuning curves and the correlations change under adaptation, we further distinguished their contributions to the Fisher Information. First, we calculated the Fisher Information using adapted tuning curves and non-adapted correlations, Fig. 4(c). Because the correlations were now fixed to the control condition, changes in the Fisher Information are a consequence of the changes in tuning curves only. The Fisher Information resembled Fig. 4(a), indicating that the deformations of the tuning curves are important. For SFA, the tuning curve slope increased near to the adapter angle, Fig. 2(d), resulting in a prominent peak in the Fisher Information.
Finally we calculated the Fisher Information using non-adapted tuning curves but adapted correlations to reveal the information changes due to changes in correlations only, Fig. 4(d). Consistent with Fig. 3(b) and (c), with synaptic depression the Fisher Information increased for most orientations as the correlations are reduced. Also for SFA, the Fisher Information increased at almost all stimulus angles, except at a stimulus angle of zero degrees. In summary, when only adaptation of the correlations was taken into account, the information increased for most conditions. This finding is consistent with recent experimental data (Gutnisky and Dragoi 2008), where adaptation of the noise correlations were shown to increase population accuracy.
Although we typically observed opposite effects of changes in tuning curves and changes in correlation on the information (Fig. 4(c) and (d)), the total effect of the adaptation on coding is not simply the linear sum of the two. They interact non-linearly and therefore the total adaptation induced change of the Fisher Information in Fig. 4(a) is different from the sum of Fisher Information changes from Fig. 4(c) and (d).
The Fisher Information can be split in two terms, FI1 and FI2 (see Section 2). Interestingly, both contributions to the Fisher Information, Eqs. (8) and (9), were affected almost identically by adaptation, Fig. 5(a) and (b). The FI2 is much smaller than FI1 for the given number of neurons, but it should be noted that the second term is extensive in the number of neurons, even in the presence of correlations, while the FI1 term saturates when correlations are present and the population is homogeneous (Shamir and Sompolinsky 2004). Because the almost identical effects of adaptation on the two terms, the effect of adaptation on the sum of the two terms will be independent on their relative contribution, suggesting that our results will be valid for a wider range of neuron numbers. In heterogeneous populations this saturation of FI1 dissolves (Wilke and Eurich 2002; Shamir and Sompolisnky 2006), opening the possibility of an interesting interplay between adaptation and heterogeneity, where for instance adaptation yields a heterogeneous response. However, the readout has to be optimized for the heterogeneity (Shamir and Sompolisnky 2006), which is inconsistent with our decoding set-up (below) and we don’t examine this possibility here any further.
3.4 Reading out the population code
Because it is not known how populations of neurons are read-out by the nervous system, we analyzed how two well-known decoders, the winner-take-all and the Population Vector decoder, are affected by adaptation (see Section 2). Importantly, if the decoder does not have access to the state of adaptation, as we assumed here, its estimate will typically be biased (Seriès et al. 2009). For the two decoders, the bias profile was virtually identical, Fig. 6(a) and (b). Both SD and SFA led to strong tilt after-effects (repulsive shift away from the adapter orientation). As observed before, the tuning of individual neurons can behave differently from the population tuning (Teich and Qian 2003). The population bias can be opposite from the individual tuning curve shift, cf. Fig. 6 to Fig. 2(c). The reason is that the population vector weights the individual responses according to their firing rate. Therefore, although a neural tuning curve could shift towards the adapter orientation, if the rate is sufficiently reduced, the population vector shifts away from the adapter orientation.
For unbiased estimators the Cramer–Rao bound dictates that the minimum obtainable variance is given by the Fisher Information. For biased estimators where the bias is non-uniform this is no longer true. Instead, for biased estimators, the Fisher Information forms a bound on the decoder’s discrimination threshold (see Section 2 and Seriès et al. (2009)). Conveniently this is also the quantity that is typically assessed psychophysically. The discrimination threshold in the angle estimate in the two decoders is shown in Fig. 6(c) and (d). The threshold is inversely proportional to the Fisher information. Interestingly, for the winner-take-all decoder not only SFA but also SD increase performance at zero degrees. This is further illustrated in panel (e)–(f), where the threshold is plotted relative to the Fisher Information. This ratio is a measure of the biased decoder efficiency, a value of one indicating a perfect decoder. Unsurprisingly the population vector decoder (Fig. 6(e)) is more efficient than the winner-take-all (Fig. 6(f)), which, unlike the population vector, does not average over neurons to reduce fluctuations.
The population vector readout has a decent efficiency across conditions, perhaps suggesting that using a linear readout is sufficient to study the effects of adaptation on coding. However even under the Gaussian noise assumption an optimal linear discriminator can not extract all information from a correlated, heterogeneous (i.e. adapted) population (Shamir and Sompolisnky 2006), necessitating the calculation of the full Fisher Information to analyze the effect of adaptation on coding.
3.5 Effect of common input noise on correlations and coding accuracy
In our model the correlations were typically weak (<0.03) and neurons with orthogonal preferred angles were anti-correlated. There is a current debate about the strength of correlations in experimental data. A recent study in monkey V1 found average correlations coefficients of value 0.010 ± 0.002 (SEM), while there was a weak but significant relation between tuning curve similarity and correlation, so that more similar neurons show a higher correlation (Ecker et al. 2010). Negative correlations occurred in a substantial fraction of pairs. These findings are in line with our model.
In contrast, however, most other (older) studies show much stronger correlations in spike counts. Among nearby neurons with similar preferred orientations it is ≈ 0.2 (range 0.1 … 0.4) (Nelson et al. 1992; Gawne et al. 1996; DeAngelis et al. 1999; Smith and Kohn 2008). Again the correlations are generally somewhat less for neurons with different preferred orientations, but typically still above 0.1. Pairwise correlations between neurons with similar tuning were found to be only weakly dependent on stimulus orientation (Kohn and Smith 2005).
One possible explanation for this discrepancy is that there is an additional source of correlation in those data that is not present in the model. In particular, common input noise in the LGN could be the source of this missing correlation. We implemented LGN noise in the model that introduced common fluctuations in V1, enhancing the noise correlation and giving them a large offset, Fig. 7 (right column). Although the common input noise substantially increased the correlations to values compatable to the above cited works, the effect on the Fisher Information is negligible, cf. Fig. 7 (bottom row). The limited effect of common input noise on the coding accuracy can be understood from the fact that common input noise can be extracted away by a decoder (Sompolinsky et al. 2002). A simple algorithm would be to first calculate the population averaged activity on each trial, subtract it from the activity in all neurons and then decode relative to the average activity.
3.6 Effect of input adaptation on coding accuracy
Although there is evidence that in the LGN input does not adapt (Boudreau and Ferster 2005), we also tested the case where the input did adapt through synaptic depression. Parameters were adjusted so that the same response reduction after adaptation was achieved as SD and SFA. The adaptation reduces the drive to the V1 network. The adaptation effects on tuning curves and Fisher Information are shown in Fig. 8. These results are very similar to those found for synaptic depression. However, in contrast to SD, the correlations before and after adaptation were virtually identical (not shown), as adapting the input did not affect the lateral connections.
4 Discussion
We built a recurrent network model of primary visual cortex to address how adaptation affects population coding accuracy. Although a variety of models have modeled adaptation by imposing changes in the tuning curves, e.g. Jin et al. (2005), our model is the first to model the adaptation biophysically, thus directly relating biophysical adaptation to coding. From the adaptation mechanism, it predicts the concurrent changes in tuning curves, correlations, and coding. For synaptic depression (SD), we observed at the adapter orientation a strong reduction of tuning curve width, attractive shifts of the individual tuning curves, and strong repulsive population shifts. The case of spike frequency adaptation (SFA) was qualitatively comparable to SD with regards to tuning curves, but the changes in the coding accuracy were distinct (see below).
Experimental data on adaptation-induced tuning curves changes are unfortunately diverse and contradictory. Increased widths at the adapter orientation and repulsive shifts have been reported in V1 (Dragoi et al. 2000), while other studies in V1 reported a width reduction to the adapter stimulus and repulsive shifts (Muller et al. 1999). Yet another study reported typically attractive shifts for longer adaptation times (12 min) and repulsive shifts for short adaptation times, with no explicit quantification of width variations of the tuning curves (Ghisovan et al. 2008a, b). Finally, electrophysiological data from direction selective cells in area MT show a strong narrowing at the adapter orientation and attractive shifts, but that same study observed no shift in V1 tuning (Kohn and Movshon 2004).
Next, we examined the effect of adaptation on coding accuracy by means of the Fisher Information. We studied how Fisher Information depends on test orientation and precise adapting mechanism. The Fisher Information represented in Fig. 4(a) showed larger Fisher Information for orientations close to the adapter orientation in the case of SFA. This was due to the increased slope of the tuning curves after adaptation. The increase in information occurred despite increased noise correlations. In the case of SD the accuracy decreased, despite a reduction in the correlations, Fig. 3, which was however not enough to counter the decrease in accuracy due to tuning curve changes, Fig. 4(c). The changes in coding accuracy can partly be understood from the changes in the tuning curve slopes. But our results also show explicitly that both changes in the tuning curves and in the correlations need to be taken into account to determine the net effect of adaptation on coding.
We also considered the case where the input connections are adapting. It should be noted that whether the LGN-V1 connections are subject to short term synaptic depression is matter of debate (Boudreau and Ferster 2005; Jia et al. 2004). Inclusion of synaptic depression in the LGN-V1 connections reduced the drive of V1 for neurons close to the adapter. The results for both the tuning curve and Fisher Information changes is very comparable to SD, Fig. 8.
To compare these findings to psychophysics we implemented two common decoders which yield adaptation-induced biases and accuracy. Both decoders showed repulsive tilt after-effects. Both attractive and repulsive have been reported experimentally, typically showing repulsion close to the adapter and weak attraction far away (Schwartz et al. 2007, 2009; Clifford et al. 2000). Although we do find repulsion close to the adapter, the weak attraction for orthogonal orientation is not reproduced here. This could be due either to differences in the activity or to a different readout mechanism.
Data on orientation discrimination performance after adaptation is limited, Two studies found a slight improvement for orientation discrimination around 0 degrees, but a higher (worse) threshold for intermediate angles (Regan and Beverley 1985; Clifford et al. 2001). More data is available for motion adaptation which has been argued to resemble orientation data (Clifford 2002). The overall pattern is similar: no or small improvement at the adapter and worse performance for intermediate angles, see Seriès et al. (2009) and references therein. These results match our result for the SFA adaptation model. One study found a lower (better) threshold for angles close to 90 degrees (Clifford et al. 2001), never present in our model.
4.1 Model assumptions and extensions
Like any model, our model has certain limitations and is based on a number of assumptions; we discuss them here. First, the model is not spiking, but rate based. Of course a spiking model is in principle more realistic and could lead to different results, but apart from the difficulty tuning a spiking network model, in particular obtaining the right noise and correlations is far from trivial, such a model would be computationally challenging given the number of trials required to calculate the Fisher Information. Encouragingly however, in studies of non-adapting networks, a rate model with phenomenological variability lead to a similar covariances as a network with spiking neurons (Spiridon and Gerstner 2001; Seriès et al. 2004).
We assumed that the noise stems either from the neurons in the network or from common LGN modulation. Additional sources of noise do probably exists, including correlated noise sources such as other common input, common feedback, or common modulation, both stationary and adapting. Although such noises could be included in the model but too little is known about noise sources and their correlations to allow for strong conclusions on this point.
Our model focuses on brief adaptation paradigms of up to a few hundred ms, as cellular and synaptic adaptation is best characterized on those time scales. We have used simple phenomenological models of synaptic and cellular adaptation. As a result the dynamics of the observed changes in coding are simple as well (longer adaptation will give stronger effects). However, although the used models are well supported by empirical data, adaptation processes are known to be much more complicated biophysically and manifest multiple nonlinearities and timescales. For longer adaptation periods, other adaptation processes might be activated, e.g., Sanchez-Vives et al. (2000a), Wark et al. (2007), and Ghisovan et al. (2008b), which would require modified adaptation models. Despite these limitations, one could in principle consider cases where the network is continuously stimulated, as would occur under natural stimulation. Our results suggest that the coding accuracy would show a strong history dependence. Furthermore, the net effect of the synaptic depression is expected to be less, as the synapses will be in a somewhat depressed state already. Unfortunately, a detailed analysis of this scenario seems currently computationally prohibitive.
Finally, we assumed a model in which the tuning curves are sharpened by the recurrent connections. Previous studies, without adaptation, have contrasted coding in such networks with coding in feedforward networks with no or much less recurrence and found that the recurrence induces correlations that strongly degrade the coding (Spiridon and Gerstner 2001; Seriès et al. 2004), but see also Oizumi et al. (2010). Inline with those findings, we find that the correlations induced by the recurrent connections, severely reduce the information, see Fig. 4(c). Whether the primary visual cortex is recurrently sharpened or dominated by feed-forward drive is a matter of debate (Ferster and Miller 2000). In the feedforward variant of our model without any recurrence, noise correlations will be absent. Thus the tuning curves and the noise determine the information content and the changes caused by adaptation. This situation is comparable to calculating the information using uncorrelated (i.e. shuffled) responses, Fig. 4(b).
4.2 Conclusion
This study shows how various single neuron adaptation mechanisms lead to changes in the tuning curves and it shows how this then translates to shifts in the population properties and changes in coding accuracy. Our results explicitly show that both changes in the tuning curves and in the correlations need to be taken into account to determine the net effect of adaptation on coding. The experimentally observed biases and accuracies are more consistent with our model that has spike frequency adaptation on the single neuron level rather than with the synaptic depression model.
Acknowledgments
We thank to Adam Kohn, Odelia Schwartz, Walter Senn, Andrew Teich, Andrea Benucci, Klaus Obermayer and Lyle Graham for useful comments and suggestions. This research was funded by EPSRC COLAMN project (JMC and MvR). JMC was funded by the Fulbright Commission to visit the CNL Lab at the Salk Institute. TJS is supported by Howard Hughes Medical Institute. DM received funding to visit Edinburgh from the High-Power-Computing European Network (HPC-EUROPA Ref. RII3-CT-2003-506079). JMC is currently funded by the Spanish Ministerio de Ciencia e Innovacion, through a Ramon y Cajal Research Fellowship. JMC thanks the computer facilities from the COLAMN Computer Cluster (University of Plymouth), the Edinburgh Parallel Computing Center and the Edinburgh Compute and Data Facility.
Contributor Information
Jesus M. Cortes, Email: jcortes@decsai.ugr.es, Institute for Adaptive and Neural Computation, School of Informatics, University of Edinburgh, Edinburgh, UK
Daniele Marinazzo, Email: daniele.marinazzo@parisdescartes.fr, Laboratoire de Neurophysique et Physiologie, CNRS UMR 8119, Université Paris Descartes, Paris, France.
Peggy Series, Email: pseries@inf.ed.ac.uk, Institute for Adaptive and Neural Computation, School of Informatics, University of Edinburgh, Edinburgh, UK.
Mike W. Oram, Email: mwo@st-andrews.ac.uk, School of Psychology, University of St Andrews, St Andrews, UK
Terry J. Sejnowski, Email: terry@salk.edu, Howard Hughes Medical Institute, The Salk Institute, San Diego, CA 92037, USA. Division of Biological Science, University of California, San Diego, CA 92093, USA
Mark C. W. van Rossum, Email: mvanross@inf.ed.ac.uk, Institute for Adaptive and Neural Computation, School of Informatics, University of Edinburgh, Edinburgh, UK
References
- Abbott LF, Dayan P. The effect of correlated variability on the accuracy of a population code. Neural Computation. 1999;11:91–101. doi: 10.1162/089976699300016827. [DOI] [PubMed] [Google Scholar]
- Ahissar E, Sosnik R, Haidarliu S. Transformation from temporal to rate coding in a somatosensory thalamo-cortical pathway. Nature. 2000;406:302–306. doi: 10.1038/35018568. [DOI] [PubMed] [Google Scholar]
- Averbeck BB, Latham PE, Pouget A. Neural correlations, population coding and computation. Nature Reviews Neuroscience. 2006;7(5):358–366. doi: 10.1038/nrn1888. [DOI] [PubMed] [Google Scholar]
- Barbieri F, Brunel N. Can attractor network models account for the statistics of firing during persistent activity in prefrontal cortex? Front Neuroscience. 2008;2(1):114–122. doi: 10.3389/neuro.01.003.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Benda J, Herz A. A universal model for spike-frequency adaptation. Neural Computation. 2003;15:2523–2564. doi: 10.1162/089976603322385063. [DOI] [PubMed] [Google Scholar]
- Ben-Yishai R, Bar-Or RL, Sompolinksy H. Theory of orientation tuning in visual cortex. Proceedings of the National Academy of Sciences of the United States of America. 1995;92:3844–3848. doi: 10.1073/pnas.92.9.3844. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Best AR, Wilson DA. Coordinate synaptic mechanisms contributing to olfactory cortical adaptation. Journal of Neuroscience. 2004;24(3):652–660. doi: 10.1523/JNEUROSCI.4220-03.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boudreau C, Ferster D. Short-term depression in thalamocortical synapses of cat primary visual cortex. Journal of Neuroscience. 2005;25:7179–7190. doi: 10.1523/JNEUROSCI.1445-05.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carandini M, Ferster D. A tonic hyperpolarization underlying contrast adaptation in cat visual cortex. Science. 1997;276:949–952. doi: 10.1126/science.276.5314.949. [DOI] [PubMed] [Google Scholar]
- Chelaru M, Dragoi V. Asymmetric synaptic depression in cortical networks. Cerebral Cortex. 2008;18:771–788. doi: 10.1093/cercor/bhm119. [DOI] [PubMed] [Google Scholar]
- Chung S, Li X, Nelson S. Short-term depression at thalamocortical synapses contributes to rapid adaptation of cortical sensory responses in vivo. Neuron. 2002;34:437–446. doi: 10.1016/s0896-6273(02)00659-1. [DOI] [PubMed] [Google Scholar]
- Clifford CW. Perceptual adaptation: Motion parallels orientation. Trends in Cognitive Sciences. 2002;6(3):136–143. doi: 10.1016/s1364-6613(00)01856-8. [DOI] [PubMed] [Google Scholar]
- Clifford CW, Wenderoth P, Spehar B. A functional angle on some after-effects in cortical vision. Proceedings Royal Society London B. 2000;267(1454):1705–1710. doi: 10.1098/rspb.2000.1198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Clifford CW, Wyatt AM, Arnold DH, Smith ST, Wenderoth P. Orthogonal adaptation improves orientation discrimination. Vision Research. 2001;41(2):151–159. doi: 10.1016/s0042-6989(00)00248-0. [DOI] [PubMed] [Google Scholar]
- Dayan P, Abbott L. Theoretical neuroscience. The MIT Press; 2001. [Google Scholar]
- DeAngelis GC, Ghose GM, Ohzawa I, Freeman RD. Functional micro-organization of primary visual cortex: Receptive field analysis of nearby neurons. Journal of Neuroscience. 1999;19(10):4046–4064. doi: 10.1523/JNEUROSCI.19-10-04046.1999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dragoi V, Sharma J, Sur M. Adaptation-induced plasticity of orientation tuning in adult visual cortex. Neuron. 2000;28:287–298. doi: 10.1016/s0896-6273(00)00103-3. [DOI] [PubMed] [Google Scholar]
- Ecker AS, Berens P, Keliris GA, Bethge M, Logothetis NK, Tolias AS. Decorrelated neuronal firing in cortical microcircuits. Science. 2010;327(5965):584–587. doi: 10.1126/science.1179867. [DOI] [PubMed] [Google Scholar]
- Ferster D, Miller KD. Neural mechanisms of orientation selectivity in the visual cortex. Annual Review of Neuroscience. 2000;23(1):441–471. doi: 10.1146/annurev.neuro.23.1.441. [DOI] [PubMed] [Google Scholar]
- Finlayson P, Cynader M. Synaptic depression in visual cortex tissue slices: An in vitro model for cortical neuron adaptation. Experimental Brain Research. 1995;106:145–155. doi: 10.1007/BF00241364. [DOI] [PubMed] [Google Scholar]
- Galarreta M, Hestrin S. Frequency-dependent synaptic depression and the balance of excitation and inhibition in the neocortex. Nature Neuroscience. 1998;1(7):587–594. doi: 10.1038/2822. [DOI] [PubMed] [Google Scholar]
- Gawne TJ, Kjaer TW, Hertz JA, Richmond BJ. Adjacent visual cortical complex cells share about 20% of their stimulus-related information. Cerebral Cortex. 1996;6(3):482–489. doi: 10.1093/cercor/6.3.482. [DOI] [PubMed] [Google Scholar]
- Ghisovan N, Nemri A, Shumikhina S, Molotchnikoff S. Synchrony between orientation-selective neurons is modulated during adaptation-induced plasticity in cat visual cortex. BMC Neuroscience. 2008a;9:60. doi: 10.1186/1471-2202-9-60. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ghisovan N, Nemri A, Shumikhina S, Molotchnikoff S. Visual cells remember earlier applied target: Plasticity of orientation selectivity. PLoS One. 2008b;3(11):e3689. doi: 10.1371/journal.pone.0003689. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gutnisky D, Dragoi V. Adaptive coding of visual information in neural populations. Nature. 2008;452:220–224. doi: 10.1038/nature06563. [DOI] [PubMed] [Google Scholar]
- Jia F, Xie X, Zhou Y. Short-term depression of synaptic transmission from rat lateral geniculate nucleus to primary visual cortex in vivo. Brain Research. 2004;1002(1–2):158–161. doi: 10.1016/j.brainres.2004.01.001. [DOI] [PubMed] [Google Scholar]
- Jin DZ, Dragoi V, Sur M, Seung HS. Tilt aftereffect and adaptation-induced changes in orientation tuning in visual cortex. Journal of Neurophysiology. 2005;94(6):4038–4050. doi: 10.1152/jn.00571.2004. [DOI] [PubMed] [Google Scholar]
- Kohn A. Visual adaptation: Physiology, mechanisms, and functional benefits. Journal of Neurophysiology. 2007;97:3155–3164. doi: 10.1152/jn.00086.2007. [DOI] [PubMed] [Google Scholar]
- Kohn A, Movshon A. Adaptation changes the direction tuning of macaque MT neurons. Nature Neuroscience. 2004;7:764–772. doi: 10.1038/nn1267. [DOI] [PubMed] [Google Scholar]
- Kohn A, Smith M. Stimulus dependence of neural correlation in primary visual cortex of the macaque. Journal of Neuroscience. 2005;25:3661–3673. doi: 10.1523/JNEUROSCI.5106-04.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Muller J, Metha A, Krauskopf J, Lennie P. Rapid adaptation in visual cortex to the structure of images. Science. 1999;285:1405–1408. doi: 10.1126/science.285.5432.1405. [DOI] [PubMed] [Google Scholar]
- Nelson JI, Salin PA, Munk MH, Arzi M, Bullier J. Spatial and temporal coherence in cortico-cortical connections: A cross-correlation study in areas 17 and 18 in the cat. Visual Neuroscience. 1992;9(1):21–37. doi: 10.1017/s0952523800006349. [DOI] [PubMed] [Google Scholar]
- Ohzawa I, Sclar G, Freeman R. Contrast gain control in the cat visual cortex. Nature. 1982;298:266–268. doi: 10.1038/298266a0. [DOI] [PubMed] [Google Scholar]
- Oizumi M, Miura K, Okada M. Analytical investigation of the effects of lateral connections on the accuracy of population coding. Physical Review E, Statistical, Nonlinear and Soft Matter Physics. 2010;81(5 Pt 1):051905. doi: 10.1103/PhysRevE.81.051905. [DOI] [PubMed] [Google Scholar]
- Oram MW, Foldiak P, Perrett DI, Sengpiel F. The ‘ideal homunculus’: Decoding neural population signals. Trends in Neurosciences. 1998;21:259–265. doi: 10.1016/s0166-2236(97)01216-2. [DOI] [PubMed] [Google Scholar]
- Oram MW, Wiener MC, Lestienne R, Richmond BJ. Stochastic nature of precisely timed spike patterns in visual system neuronal responses. Journal of Neurophysiology. 1999;81:3021–3033. doi: 10.1152/jn.1999.81.6.3021. [DOI] [PubMed] [Google Scholar]
- Regan D, Beverley KI. Postadaptation orientation discrimination. Journal of the Optical Society of America A. 1985;2(2):147–155. doi: 10.1364/josaa.2.000147. [DOI] [PubMed] [Google Scholar]
- Sanchez-Vives M, Nowak L, McCormick D. Cellular mechanisms of long-lasting adaptation in visual cortical neurons in vitro. Journal of Neuroscience. 2000a;20:4286–4299. doi: 10.1523/JNEUROSCI.20-11-04286.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sanchez-Vives M, Nowak L, McCormick D. Membrane mechanisms underlying contrast adaptation in cat area 17 in vivo. Journal of Neuroscience. 2000b;20:4267–4285. doi: 10.1523/JNEUROSCI.20-11-04267.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schwartz O, Hsu A, Dayan P. Space and time in visual context. Nature Reviews Neuroscience. 2007;8(7):522–535. doi: 10.1038/nrn2155. [DOI] [PubMed] [Google Scholar]
- Schwartz O, Sejnowski TJ, Dayan P. Perceptual organization in the tilt illusion. Journal of Visualization. 2009;9(4):19.1–1920. doi: 10.1167/9.4.19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Seriès P, Latham PE, Pouget A. Tuning curve sharpening for orientation selectivity: Coding efficiency and the impact of correlations. Nature Neuroscience. 2004;7(10):1129–1135. doi: 10.1038/nn1321. [DOI] [PubMed] [Google Scholar]
- Seriès P, Stocker AA, Simoncelli EP. Is the homunculus “aware” of sensory adaptation? Neural Computation. 2009;21(12):3271–3304. doi: 10.1162/neco.2009.09-08-869. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shamir M, Sompolinsky H. Nonlinear population codes. Neural Computation. 2004;16(6):1105–1136. doi: 10.1162/089976604773717559. [DOI] [PubMed] [Google Scholar]
- Shamir M, Sompolisnky H. Implications of neuronal diversity on population coding. Neural Computation. 2006;18:1951–1986. doi: 10.1162/neco.2006.18.8.1951. [DOI] [PubMed] [Google Scholar]
- Shu Z, Swindale N, Cynader M. Spectral motion produces an auditory after-effect. Nature. 1993;364:721–723. doi: 10.1038/364721a0. [DOI] [PubMed] [Google Scholar]
- Smith MA, Kohn A. Spatial and temporal scales of neuronal correlation in primary visual cortex. Journal of Neuroscience. 2008;28(48):12591–12603. doi: 10.1523/JNEUROSCI.2929-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Somers DC, Nelson SB, Sur M. An emergent model of orientation selectivity in cat visual cortical simple cells. Journal of Neuroscience. 1995;15(8):5448–5465. doi: 10.1523/JNEUROSCI.15-08-05448.1995. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sompolinsky H, Yoon H, Kang K, Shamir M. Population coding in neuronal systems with correlated noise. Physical Review E. 2002;64:51904. doi: 10.1103/PhysRevE.64.051904. [DOI] [PubMed] [Google Scholar]
- Spiridon M, Gerstner W. Effect of lateral connections on the accuracy of the population code for a network of spiking neurons. Network. 2001;12:409–421. [PubMed] [Google Scholar]
- Teich A, Qian N. Learning and adaptation in a recurrent model of v1 orientation selectivity. Journal of Neurophysiology. 2003;89:2086–2100. doi: 10.1152/jn.00970.2002. [DOI] [PubMed] [Google Scholar]
- Tolhurst DJ, Movshon JA, Dean AF. The statistical reliability of signals in single neurons in cat and monkey visual cortex. Vision Research. 1983;23:775–785. doi: 10.1016/0042-6989(83)90200-6. [DOI] [PubMed] [Google Scholar]
- Tsodyks M, Markram H. The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. Proceedings of the National Academy of Sciences of the United States of America. 1997;94:719–723. doi: 10.1073/pnas.94.2.719. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ulanovsky N, Las L, Farkas D, Nelken I. Multiple time scales of adaptation in auditory cortex neurons. Journal of Neuroscience. 2004;24:10440–10453. doi: 10.1523/JNEUROSCI.1905-04.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Rossum MCW, van der Meer MAA, Xiao D, Oram MW. Adaptive integration in the visual cortex by depressing recurrent cortical circuits. Neural Computation. 2008;20(7):1847–1872. doi: 10.1162/neco.2008.06-07-546. [DOI] [PubMed] [Google Scholar]
- Varela JA, Sen K, Gibson J, Fost J, Abbott LF, Nelson SB. A quantitative description of short-term plasticity at excitatory synapses in layer 2/3 of rat primary visual cortex. Journal of Neuroscience. 1997;17(20):7926–7940. doi: 10.1523/JNEUROSCI.17-20-07926.1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang Y, Markram H, Goodman PH, Berger TK, Ma J, Goldman-Rakic PS. Heterogeneity in the pyramidal network of the medial prefrontal cortex. Nature Neuroscience. 2006;9(4):534–542. doi: 10.1038/nn1670. [DOI] [PubMed] [Google Scholar]
- Wark B, Lundstrom BN, Fairhall A. Sensory adaptation. Current Opinion in Neurobiology. 2007;17(4):423–429. doi: 10.1016/j.conb.2007.07.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wilke SD, Eurich CW. Representational accuracy of stochastic neural populations. Neural Computation. 2002;14:155–189. doi: 10.1162/089976602753284482. [DOI] [PubMed] [Google Scholar]
- Wu S, Amari S, Nakahara H. Information processing in a neuron ensemble with the multiplicative correlation structure. Neural Networks. 2004;17(2):205–214. doi: 10.1016/j.neunet.2003.10.003. [DOI] [PubMed] [Google Scholar]