Skip to main content
eLife logoLink to eLife
. 2017 Apr 19;6:e25827. doi: 10.7554/eLife.25827

Synaptic input sequence discrimination on behavioral timescales mediated by reaction-diffusion chemistry in dendrites

Upinder Singh Bhalla 1,*
Editor: Frances K Skinner2
PMCID: PMC5426902  PMID: 28422010

Abstract

Sequences of events are ubiquitous in sensory, motor, and cognitive function. Key computational operations, including pattern recognition, event prediction, and plasticity, involve neural discrimination of spatio-temporal sequences. Here, we show that synaptically-driven reaction-diffusion pathways on dendrites can perform sequence discrimination on behaviorally relevant time-scales. We used abstract signaling models to show that selectivity arises when inputs at successive locations are aligned with, and amplified by, propagating chemical waves triggered by previous inputs. We incorporated biological detail using sequential synaptic input onto spines in morphologically, electrically, and chemically detailed pyramidal neuronal models based on rat data. Again, sequences were recognized, and local channel modulation downstream of putative sequence-triggered signaling could elicit changes in neuronal firing. We predict that dendritic sequence-recognition zones occupy 5 to 30 microns and recognize time-intervals of 0.2 to 5 s. We suggest that this mechanism provides highly parallel and selective neural computation in a functionally important time range.

DOI: http://dx.doi.org/10.7554/eLife.25827.001

Research Organism: Rat

Introduction

Activity sequences have long been recognized as a fundamental constituent of neural processing. Lorente de No suggested that reverberatory activity sequences in small networks could sustain activity (Lorente de No, 1938). Hebb's idea of cell assemblies suggested that ensembles of cells encoded a particular neuronal concept, but also that there was sequential activation within the group of cells forming the assembly (Hebb, 1949).

Many sensory systems process sequential stimuli, and these are typically mapped to ensembles of sequentially active neurons (Bouchard and Brainard, 2016; Broome et al., 2006; Carrillo-Reid et al., 2015). Deeper in the brain, hippocampal place cells represent a higher-order cognitive map of space, yet here too sequences occur when the animal moves through spatial locations represented by the place cells (Wilson and McNaughton, 1994). The hippocampus exhibits other forms of sequential activity in the form of fast replay events (Jadhav et al., 2012; Wilson and McNaughton, 1994) and stimulus-bridging activity that emerges during associative learning (MacDonald et al., 2011) and trace conditioning (Modi et al., 2014). Thus, there are numerous neural correlates both of sequences, and of processing steps that recognize them.

The idea of synfire chains examines conditions for self-sustaining sequential activity to occur in multiple layers of a network (Abeles, 1982). This is non-trivial, as excessive activation can lead to runaway epileptiform activity, whereas insufficient activation causes decay of the activity wave (Kumar et al., 2008; Mehring et al., 2003). Neural networks that can recognize such sequences are well-established. For example, events may be run through a delay line, so that the oldest event is delayed more, the next event less, and so on, so that they all arrive at the neural network at the same time. Thus, the time-sequence is flattened in time and classical attractor networks can recognize patterns in the sequence (Tank and Hopfield, 1987). Time-varying attractor networks have also been shown to be able to implement and recognize sequences (Lee, 2002). Time-invariance is a desirable feature of sequence recognition circuits, since the same order of events may take place at different speeds. Recursive networks using supervised learning, and short-term synaptic plasticity have been shown to be implement time-invariance (Barak and Tsodyks, 2006; Goudar and Buonomano, 2015; Laje and Buonomano, 2013).

While networks can carry out sequence recognition, they make limited use of the rich dynamics of biological neurons. The theory of Hierarchical Temporal Memory builds on the idea of sequence-recognizing neurons and networks as a way to perform complex temporal computation (George and Hawkins, 2009; Hawkins and Ahmad, 2016). Even the ability to recognize simultaneous closely-localized synaptic input has interesting computational implications (Hawkins and Ahmad, 2016), The current study extends this to patterns of input both in time and space.

One of the first biophysical proposals for subcellular sequence recognition was made by Rall, who showed theoretically that synaptic events propagate down the dendritic tree with a small delay. By timing synaptic inputs to coincide with this delay, Rall predicted that ordered input should yield a larger response than reversed input (Rall, 1964). A stronger version of this mechanism was experimentally demonstrated by Branco et al. (2010) who used glutamate uncaging to provide sequential input along a pyramidal neuron dendrite. They showed that NMDA receptor amplification of 'inward' sequences (distal to proximal) gave rise to about 40% larger somatic depolarization than 'outward' sequences, for rapid (~40 ms) sequences. However, many interesting neural sequences occur at slower time-scales.

At least three attributes should converge for single neurons to achieve and report sequence recognition in the noisy context of neural activity. First, the neurons should recognize inputs coming in the correct order in space and time. Second, the selectivity for the correct input over scrambled input and background noise should be strong enough for there to be reliable discrimination. Third, recognized sequences should trigger activity changes either by way of changed firing, or by way of plasticity. In the current study, we use theory and reaction-diffusion modeling to show how the first condition may be achieved, and develop detailed multi-scale models to address the second and third.

Results

As the setting for this study, we considered a network in which ensembles of neurons are active in sequence, for example, place cells in the hippocampus as an animal moves along a linear track (Figure 1). We assumed that a single neuron from each of these ensembles projects onto a given postsynaptic cell, which is the focus of our analysis. The projections are ordered such that they converge onto a succession of spines located on a short stretch of dendrite on this cell, in the same spatial and temporal order as the activation of the ensembles. We ignored all other network context. We first treated this system in the abstract, as sequentially ordered activation of segments of a one-dimensional reaction-diffusion system with abstract chemistry. We asked if the reaction system could discriminate sequential from scrambled input. We then mapped the discrimination mechanism to a signaling pathway modeled as mass-action reaction-diffusion chemistry in a similar cylindrical geometry, but ornamented with dendritic spines. We then tested discrimination when we embedded mass-action chemistry into a morphologically and electrically detailed neuronal model receiving sequential input on a series of synapses, through ligand-gated ion channels. Finally, we asked if ion channel modulation by sequence discrimination chemistry in small dendritic zones, could affect neuronal firing.

Figure 1. Sequential activity, from behavior to dendrite.

Figure 1.

Top: Linear arena in which a rat moves, with indicated locations of 5 place cells (color coded green, yellow, orange, red, and maroon in order.). The place cells are representatives of 5 neuronal ensembles (colored clouds), each active in one of the five locations on the arena. The neuronal ensembles each send a single axonal projection in spatial order to a small dendritic segment on a postsynaptic neuron, with an average spacing S between connected spines. Note that spines need not be immediately adjacent to each other. Below, buildup of reactant following input activity with the appropriate timing, corresponding to the rat moving at a speed which the dendritic chemistry recognizes.

DOI: http://dx.doi.org/10.7554/eLife.25827.002

Abstract reaction-diffusion systems support sequence recognition

We first analyzed the requirements for chemical reaction-diffusion systems to achieve selectivity for spatially and temporally ordered inputs. In doing these calculations, we utilized 'spherical cow' models of chemistry: highly reduced formulations with just two diffusive state variables A and B, interpreted as molecules undergoing 1-dimensional diffusion (Figure 2A,B). The reaction system received input from a third molecule, designated as Ca (Figure 2A,B). In all cases, molecule B inhibited A.

Figure 2. Responses and sequence selectivity of four abstract models involving molecules A and B.

Figure 2.

Columns are the respective models. (A) Model equations. (B) Model schematics. Arrows indicate excitation, plungers indicate inhibition. In the FHN model, A has a fast self-excitation and a slow self-inhibition. In the Switch model, we indicate a multiplicative inhibition of A by an arrow from B onto the self-inhibition arrow of A. (C) Response of point (non-spatial) model to a 1 s wide Gaussian input of Ca2+ (red dot) and a steady pulse of Ca2+ (green line). Input amplitudes: 1, 10, 0.4, and 1 respectively. (D-G) Response of molecule A in one-dimensional reaction-diffusion form of model to sequential input at five locations. (D) Time-course of response at five locations to ordered input. Locations are color-coded in the sequential order blue, green, red, cyan, purple. (E) Time-course of response at five locations to scrambled input. Note that the FHN and Switch models have much lower responses to scrambled as compared to ordered input. The Neg. FF model has a lower response at two of its locations. (F, G) Snapshot of spatial profile of response to ordered (F) and scrambled (G) input. Snapshot is at time 18.4, 14.2, 16.3 and 18.4 s respectively.

DOI: http://dx.doi.org/10.7554/eLife.25827.003

The abstract models were initially formulated to implement reaction-diffusion wave propagation at a speed that matched the arrival of sequential input. We implemented two models with this property: the FitzHugh-Nagumo form, which is a known stimulus-triggered, oscillating, and propagating wave system (Fitzhugh, 1961; Nagumo et al., 1962); and a bistable reaction-diffusion system, which again is a known substrate for propagating waves (Keener and Sneyd, 1998). To the bistable switch system, we added inhibitory feedback to restore the switch to baseline after a delay. In addition to these models with complex dynamics, we implemented a system with feedback inhibition, and a system with feedforward inhibition. These simpler models were designed to test if inhibitory feedback or feedforward systems, coupled with diffusion, could achieve selectivity in the absence of an amplifying positive feedback process.

Our criterion for sequence recognition was that ordered inputs should elicit high total activity of a signaling molecule A, whereas scrambled inputs should elicit low levels of activity. Total activity here means the sum of activity of A over the duration and spatial extent of the stimulus.

To investigate the temporal responses of these 'reaction' systems, we first delivered impulse (red dot) and step-function (green line) input to non-spatial versions of the models (Figure 2C). Each model exhibited a large impulse response. Two of the models (feedforward inhibition and state-switching) exhibited only a transient response to the sustained input. The negative feedback model, as expected, had a transient strong response followed by a shallow sustained response. The FitzHugh-Nagumo model, again as expected, oscillated.

We then implemented 1-dimensional reaction-diffusion versions of these models (Figure 2, methods). We delivered Ca2+ stimuli at five equally spaced points on the reaction system. Each Ca2+ stimulus followed a Gaussian time-profile:

Ca=exp(((phaset)2)/(2 width2)) (1)

Here, phase defines the timing of each input, t is time, and width is the duration of the Ca2+ pulse.

The only difference between the sequential and scrambled stimuli was their order ([0,1,2,3,4] and [2,1,4,3,0], respectively (methods)).

The results of these simulations are compared in Figure 2D–G. First, we found that the simple feedback inhibition model showed no input sequence-dependent difference in total activity. This can be seen in terms of time-response at the five stimulus points (Figure 2D,E), and also in terms of spatial profile of A at the end of the stimulus (Figure 2F,G, Video 1).

Video 1. Time-and-space series of response of negative feedback model to sequential (blue) and scrambled (red) input.

Download video file (448.5KB, mp4)
DOI: 10.7554/eLife.25827.004

DOI: http://dx.doi.org/10.7554/eLife.25827.004

Then, we observed that the feedforward inhibition model showed a small amount of selectivity (Figure 2D–G). This arose because the A response was diminished at two of the input points when the input was scrambled (Video 2).

Video 2. Time-and-space series of response of negative feedforward model to sequential (blue) and scrambled (red) input.

Download video file (267.2KB, mp4)
DOI: 10.7554/eLife.25827.005

DOI: http://dx.doi.org/10.7554/eLife.25827.005

The FitzHugh-Nagumo (FHN) model was strongly selective, with a large buildup of response only when the input was sequential (Figure 2 third column, Video 3). We interpret this as arising when the propagating wave from the FHN equation arrived at successive input points just when the input was also present.

Video 3. Time-and-space series of response of FitzHuge-Nagumo model to sequential (blue) and scrambled (red) input.

Download video file (507.4KB, mp4)
DOI: 10.7554/eLife.25827.006

DOI: http://dx.doi.org/10.7554/eLife.25827.006

The switching model was the most selective (Figure 2 last column, Video 4). This was because it built up to a large, sustained response lasting several seconds, provided the successive inputs were in the same position as the diffusively propagating activity of A.

Video 4. Time-and-space series of response of bistable switch model to sequential (blue) and scrambled (red) input.

Download video file (499.4KB, mp4)
DOI: 10.7554/eLife.25827.007

DOI: http://dx.doi.org/10.7554/eLife.25827.007

Thus, this set of simulations showed that several reaction-diffusion like systems were capable of sequence selectivity. Strong selectivity emerged from a supralinear buildup of responses when diffusively propagating activity was aligned with successive inputs, and suppression due to inhibition when the alignment was off.

Reaction systems select for distinct speeds and length-scales of sequential input

We next asked how the different reaction systems were tuned to different spatial and temporal intervals. We devised a scalar metric, Q, of the degree of sequential ordering of stimuli, as a first step. We plotted the ordinal position of the input against the ordinal value of its arrival time. Thus, a perfect sequence would arrive at positions [0,1,2,3,4] at times [0,1,2,3,4]. We used the quantity

Q=mR2 (2)

as the measure of how ordered the sequence was. Here, m = slope and R = regression coefficient of best-fit line. R2 provides a measure of linearity of the sequence, and m assigns it a magnitude and sign. With this measure, the sequence [0,1,2,3,4] has Q = 1; [4,3,2,1,0] has Q = −1, and [4,0,2,1,3] has Q = −0.001. Examples of regression plots used to generate Q for different sequences are presented in Figure 3A,B.

Figure 3. Sequence selectivity for different models.

Figure 3.

(A, B) Regression plots for sample sequences. (A) Perfect forward sequence [0,1,2,3,4] (red, Q = 1) and reverse sequence [4,3,2,1,0] (blue, Q = −1). (B) Scrambled sequence [4,0,2,1,3] (red, Q = −0.001) and [0,1,3,2,4] (blue, Q = 0.729). (C, E, G, I) Scatter plots of chemical system selectivity (measured as total activation of molecule A over time and space) against Q. There are 5! = 120 points, each being the outcome of a single simulation with a different sequence. In each plot the blue cross is the perfect forward sequence (whose timeseries is shown in Figure 2D), and the red cross is the scrambled sequence [2,1,4,3,0], whose timeseries is shown in Figure 2E. (D, F, H, J) Matrix of selectivity as a function of total length of stimulus zone and interval time between successive stimuli. In each plot, the asterisk is placed on the matrix entry obtained from the spacing and interval parameters used for the scatter plot to its left. In other words, the selectivity value for that matrix entry is obtained from Equation 3 using the Atot scores from the scatter plot. (C,D) Feedback model. This shows no selectivity. (E, F) Inhibitory feedforward model. Scatter plot in E represents calculations performed at time/distance values of (3 s, 4 mm). This shows low selectivity, as seen by slightly higher Atot for Q values of +1 and −1. (G,H) FitzHugh-Nagumo, scatter plot at (2 s, 2 mm). The model is selective in a narrow, diagonal range of time and distance. Its score is somewhat reduced because of the high baseline of Atot. (I,J) Switching model, scatter plot at (3 s, 4 mm). This is highly selective over a wide range of time and distance. Only the perfect forward and reverse sequences have high values of Atot.

DOI: http://dx.doi.org/10.7554/eLife.25827.008

We then compared our reaction readout A with the metric Q, to see how well each of our four reaction systems could discriminate sequence order (Figure 3C,E,G,I). Here, we ran simulations with each of the possible permuted input sequences. In each run, we summed the level of A over all five stimulus points, and from the time of the first stimulus till the end of the run, in order to obtain a cumulative estimate of the response. This total A value (Atot) was plotted against the Q metric for each of these permuted sequences (Figure 3C,E,G,I). If the chemical system was highly selective, we expected that only one or two points in the scatter plot should have a high value of Atot, and these should be the points with Q around +1 or −1. Chemical systems that did not exhibit sequence discrimination should have similar values of Atot for all sequences.

The results were as expected from the individual runs from Figure 2. Specifically, the inhibitory feedback system had poor tuning, there was a small amount of selectivity for the feedforward inhibition case, and strong selectivity for the FitzHugh-Nagumo and switching cases. Each of these outcomes had been observed in Figure 2 for just the sequential and a single scrambled stimulus, and in Figure 3 we found that it generalized to the entire set of sequence permutations. Note that the modeled reaction-diffusion system was spatially symmetric and did not distinguish between forward and backward sequences. An analysis of symmetry breaking arising from incorporation of biological detail is out of the scope of the current paper.

We next asked how selective each reaction system became, when the inputs were delivered at different time and space intervals. The time and space intervals were specified as parameters for each simulation run. We devised a metric for reaction network sequence selectivity, based on a comparison of responses to sequential vs. scrambled inputs:

Selectivity=(Asequentialmean(Atot))/max(Atot) (3)

Provided the system responds more strongly to sequential input than to any other order, selectivity should be in the range from zero (unselective) to one (highly selective). Asequential is Atot for the sequential stimulus, mean(Atot) is the mean of Atot over all permutations of the stimulus order, and max(Atot) is the maximum value of Atot for all permutations of stimulus order.

To compute Selectivity, we carried out simulations of the model for all possible non-repeating patterns of input, and obtained Atot in each case (Figure 3, first column). Selectivity was then estimated as per Equation 3. We repeated these calculations for each point in the matrix of timing and spacing values, to obtain a grid of selectivity values (Figure 3D,F,H,J). As already seen from Figure 2, the feedback inhibition model had low selectivity in all cases. The feedforward inhibition model showed a diagonal band of weak selectivity such that rapid stimuli in close proximity as well as slower stimuli at greater distances were preferred. The FitzHugh-Nagumo case was much more strongly selective, but also had a similar diagonal band. In both these cases we interpret this as there being an intrinsic propagation speed of the chemical activity wave, and if the inputs were timed and spaced accordingly, the response built up. The switching model was strongly selective, and had a large diffuse zone of strong selectivity centred around (2 s, 4 μm).

Thus, each of the three sequence-selective reaction systems had a preferred range of stimulus timing and spacing, but the FHN and switch forms had much higher selectivity.

Sequence speed selectivity scales with reaction rates and diffusion constants

As a further analysis on our abstract models, we asked how sequence speed selectivity scaled with rates and diffusion parameters. This scaling is important because it determines the spatial extent of the sequence selective zones that we propose to exist in the dendritic tree. It is also important as it defines the time-scales of sequential events that may be recognized by such reaction-diffusion mechanisms.

We first tested the most straightforward assumption, that sequence propagation speed was proportional to chemical rate and diffusion constants. To do this, we scaled all rates and the diffusion constants by the same factor, and reduced the stimulus width by the same factor. We ran the same grid of stimulus space and time intervals as above. As expected, scaling all the chemical and diffusion rates also scaled the sequence speed to which the network had the strongest response. As the rates were increased, the best tuning was at shorter time intervals but roughly the same spatial intervals. (Figure 4A–E). However, different stimulus strengths were needed to obtain strong tuning in these runs. We therefore also examined dependence of tuning on stimulus strength, and observed that the tuning zone also depended on stimulus strength (Figure 4F,G). This is because the selectivity occurs when the stimulus is strong enough that the ordered sequence leads to pathway activation, but not so strong that the stimulus overrides the inhibitory reactions and produces indiscriminate activation. To better understand the range of sequence selectivity, we varied each of the parameters of the model one at a time with respect to the reference model. We carried out this 1-dimensional parameter sensitivity sweep for the FHN and switching models (Figure 4—figure supplements 1 and 2). In each case we computed Asequential (blue traces), and compared it to mean(Atot) averaged over 12 input patterns, 11 of which were scrambled (green traces, methods). We also computed sequence selectivity as per Equation 3 (red traces). We found that selectivity was robust to some parameters, such as diffusion constants, but fragile (range ~20%) with respect to some rate constants and stimulus amplitude. These models were intended to be illustrative and to explore the properties of sequence-selective systems. Hence, we did not optimize the models for robustness.

Figure 4. Sequence tuning ranges in space and time.

(A-D) tuning for rates of 1, 2, 3 and 4 times basal, respectively. (E) Plot of speed of sequence as a function of the rate scale factor. (F, G) Preferred space/time of tuning shifts with stimulus amplitude. (F) 90% basal. (G) 110% basal.

DOI: http://dx.doi.org/10.7554/eLife.25827.009

Figure 4.

Figure 4—figure supplement 1. Parameter sensitivity for FHN (FitzHugh-Nagumo) reaction-diffusion model.

Figure 4—figure supplement 1.

In each plot, the blue trace is the summed concentration of A for the sequential stimulus, and the green plot is the mean of summed A over all permutations of the stimulus. A is summed over time since start of stimulus till end of simulation, and also summed over all five stimulus points. In each plot, the red trace is the selectivity metric (Equation 3). Note that the selectivity is largest when the ratio of blue to green traces is largest. Because of the high baseline in the FHN model, as seen in the blue and green traces, the selectivity (red traces) remains under 0.5. In each plot the x axis is scale factor of selected parameter with respect to the default model. Panel (A) Stimulus amplitude. (B) stimulus width. (C) Diffusion constant of molecule A. (D) Diffusion constant of molecule B. (E) rate constant for ‘t’ variable in FHN equations. (F) rate constant a. (G) rate constant b. (H) Offset term for variable A. (I) Offset term for variable B. Most parameters give good tuning for a range of ±10% around reference (1.0), but k_a is still more sensitive.
Figure 4—figure supplement 2. Parameter sensitivity for switch (Propagating bistable switch) reaction-diffusion model.

Figure 4—figure supplement 2.

Plot traces are as in Figure 4—figure supplement 1. Panel (A) Stimulus amplitude. (B) stimulus width. (C) Diffusion constant of molecule A. (D) Diffusion constant of molecule B. (E-L) Rate constants used in model. The model was sensitive to stimulus amplitude, and the rate terms k1a, k2a and k4a, and less sensitive for the rest. We classified sensitive parameters as those where selectivity fell below 0.5 for a parameter range of ±10% or less.

Thus, by varying rates for reactions and diffusion, we were able to achieve good sequence selectivity over a broad range of time-intervals (0.5–4 s between stimuli) and spatial intervals (2–6 μm between stimuli).

Mass-action reaction-diffusion system based on MAPK feedback discriminates sequences

We next asked if above design principles for sequence selectivity could be applied to a mass-action reaction-diffusion system. We based our mass-action model on a published, reduced model of MAPK feedback and bistability (Bhalla, 2011). The model already exhibited the switch-like turnon behavior of our abstract 'switch' model. The other key aspect of the abstract model was delayed turnoff of activity. There are several known inhibitory feedback turnoff mechanisms for the MAPK pathway (Lake et al., 2016). We therefore added a MAPK-activated protein phosphatase to cause delayed turnoff of the kinase. The other changes we made to the published MAPK model were (a) to remove the synaptic signaling leading to receptor turnover in the spine and (b) to add diffusible CaM as a Ca2+ buffer. With the exception of active PKC, Raf, and the ion channels, all molecules were diffusible. The model schematic is shown in Figure 5A, and the full model specification is presented in supplementary material. This model formulation is a semi-quantitative map to the far more detailed and tightly constrained models of this pathway in the literature (Bhalla and Iyengar, 1999; Resat et al., 2003). Ca2+ stimuli were delivered in the PSD and diffused into the dendrite (Methods). Model responses to brief (1 s) and square step function (100 s) Ca2+ inputs are shown in Figure 5B,C, both measured in the dendrite. As expected, there is a strong switch-like turnon to Ca2+ stimuli, followed by delayed inhibition. We ran this model in a cylindrical geometry ornamented with spines at ~1.1 μm intervals (Materials and methods, Figure 5D). We provided sequential and scrambled Ca2+ input to 5 of the spines separated by ~3 μm each, and observed good sequence selectivity (Figure 5E,F).

Figure 5. Mass action model of a MAPK switch exhibits sequence selectivity.

Figure 5.

(A) Schematic of model chemistry. Black arrows indicate binding or activation reactions, plunger indicates inhibition, and bent arrow indicates enzyme activity. Broad cyan arrows indicate diffusion of Ca2+ and CaM between PSD, spine head, and dendrite. CaM buffers the incoming Ca2+ from the PSD. (B) Ca2+ responses seen at the dendrite, to input delivered at PSD. PSD stimulus was two pulses of 1 s, 160 mM Ca2+, separated by 50 s. After a delay of 100 s, a step of 160 mM Ca2+ was delivered for 50 s. (C) MAPK-P response to the Ca2+ stimulus. Note strong inhibition of the response to the second pulse, and rapid decline of response to the 50 step stimulus. (D) Geometry of 1-D reaction-diffusion model, with 49 spines. Dendrite diameter was 1 μm and length was 60 μm. The five stimulated spines are in red, each identified by a color coded number. (E) Response of system to sequential input [0,1,2,3,4] on indicated spines spaced ~3 μm apart, at intervals of 3 s. Each input was delivered to the PSD of the stimulated spine, at 160 μM, for 2.9 s. MAPK-P was recorded from the dendrite subdivision attached to each of the stimulated spines. Plot colors indicate stimulated spine from D. (F) Response to scrambled input, in the order [4,0,3,1,2]. The response to scrambled input had a smaller amplitude and lasted for a shorter time. Plot colors are as per spine numbers in D.

DOI: http://dx.doi.org/10.7554/eLife.25827.012

Thus, we showed that a mass-action reaction-diffusion system exhibited sequence selectivity when it had switch-like turnon with delayed turnoff by negative feedback. This configuration had been predicted by the abstract models.

Sequence selectivity works in a biologically detailed multiscale neuronal model with noisy input

We then asked whether biochemical sequence recognition would 'work' in the more complex context of active neurons receiving background activity in a network. We brought in biological detail at the following levels: (a) Model neuron morphology based on anatomical reconstructions (>3000 segments), including >5700 spines spaced at ~1 μm. (b) Voltage-gated ion channels distributed throughout the cell, based on published models. (c) Background glutamatergic Poisson synaptic input at 0.1 Hz on all spines. (d) Background GABAergic synaptic input with an 8 Hz theta modulation on proximal dendritic compartments. Due to the background synaptic input, the model exhibited theta-modulated sub-threshold oscillations, with spiking activity at ~1 Hz (Figure 6B). (e) Stimuli in the form of spike trains arriving on AMPA and NMDA receptors on subsets of spines. (f) Ca2+ dynamics following synaptic ion flux, including diffusion between spine and dendrite, and buffering by calmodulin, in all spines and dendrites (Video 5). (g) The reduced MAPK model described above, was distributed throughout the dendritic tree in ~6000 diffusive compartments (Figure 6A). (h) Chemical calculations in the spines were carried out using a stochastic method (Gillespie Stochastic Systems Algorithm, methods) for the runs used to calculate selectivity.

Video 5. Calcium influx into spines and dendrites due to random background and sequential stimulation in detailed single-neuron model.

Download video file (1.7MB, mp4)
DOI: 10.7554/eLife.25827.015

DOI: http://dx.doi.org/10.7554/eLife.25827.015

Figure 6. Sequence selectivity in detailed electrical+chemical signaling model.

(A) Morphology of model. Dendrite diameters are scaled up by 2, and spine diameters and lengths by four for visualization. Stimulus was given in four zones on the cell, indicated in red and by diameters scaled up by 10x. (B) Example somatic intracellular potential and spike train of model neuron. (C) Ca2+ responses to Poisson synaptic volley at mean rate 20 Hz, measured in PSD (blue), spine head (green) and dendrite (red). (D) Sequence selectivity in the distal apical zone. Heavy solid lines are P-MAPK-P levels under the stimulated spines, for sequential input. Strong buildup occurs for three of the spines. Dashed lines are corresponding MAPK-P levels for scrambled input. Only the sequential input responses lead to build up. (E-G) Matrix of sequence selectivity in basal dendrite zone, for different input spacing in time and space. Three different runs are shown, with the same morphology but different random number seeds for the background and stimulus synaptic input. (H) Selectivity in proximal oblique dendrite zone, using 40% larger spine dimensions. (I) Selectivity in distal apical dendrite using 20% larger spines. (J) Selectivity matrix in proximal primary apical dendrite shows no sequence selectivity even with 40% larger spines.

DOI: http://dx.doi.org/10.7554/eLife.25827.013

Figure 6.

Figure 6—figure supplement 1. In each plot, the blue trace is the summed concentration of MAPK-P for the sequential stimulus, and the green plot is the mean of summed MAPK-P over 12 permutations of the stimulus.

Figure 6—figure supplement 1.

MAPK-P is summed over time since start of stimulus till end of simulation, and also summed over all five stimulus points. In each plot, the red trace is the selectivity metric (Equation 3, Materials and methods). (A) Stimulus spike rate. (B) Spatial density of LCa channel over basal and apical dendrites. Somatic LCa was held uniform at 40 S/m^2. (C) Diffusion constant for Ca2+. (D) Forward rate constant for Ca2+ activation of Raf, which acts as input to the signaling pathway.

We first ran a direct comparison of a sequential input train [0,1,2,3,4] compared with a scrambled train with sequence [4,0,3,1,2]. We picked time and space intervals of (3 s, 4 μm) based on preliminary calculations for tuning. We delivered the input sequence on a basal dendritic branch (Figure 6A). We selected a set of 5 spines, spaced at ~3 μm. Each spine was stimulated with a Poisson spike burst lasting 2 s at 20 Hz on the AMPA and NMDA receptors. With these parameters, the [Ca2+] reached ~40 μM in the PSD, ~35 μM in the spine head, and ~1 μM in the region of dendrite immediately below the stimulated spine (e.g., Figure 6C). Similar Ca2+ levels were obtained when stimuli were delivered in other regions of the dendrite. The exception was the primary apical dendrite, in which dendritic Ca2+ only reached ~0.5 μM. This is an expected outcome of diluting out the Ca2+ arriving from the spine, since the diameter of the primary dendrite was ~2 μm as compared to ~1.0 μm in the other stimulus regions. With these parameters, we observed strong selectivity in MAPK activity for sequential stimuli as compared to scrambled in the basal dendrite (Figure 6D, solid lines for sequential vs. dashed for scrambled).

We then asked how this multiscale model responded to a range of time and space intervals in each of the stimulated zones. Because the calculations were expensive, we used a modified version of the selectivity metric (Equation 3) in which we computed outcomes of only 12 stimulus patterns rather than the exhaustive 120 possible permutations (Materials and methods). In each case, we used MAPK-P in place of the molecule ‘A’ for calculating selectivity (Equation 3). For efficiency, we delivered the stimulus patterns simultaneously in the 4 zones of the cell (Figure 6A). Similar tuning was observed in test simulations where stimuli were delivered only in a single zone.

We observed strong sequence selectivity in the basal dendrite zone, for a restricted range of space and time intervals, as expected from the earlier calculations (Figure 6E–G). We repeated the calculations using different random seeds to generate different background and stimulus spiking input to the model neuron. We found that the responses of individual runs, and hence selectivity, were somewhat noisy (Figure 6E–G).

We next investigated whether the response selectivity was manifested in different regions of the cell. We found that there were indeed strongly sequence selective responses in oblique dendrites and distal apical dendritic regions, but these required stronger stimuli (Figure 6H,I; Videos 6 and 7). In these runs, we had to increase the diameters of spine heads and spine shafts by 40% and 20% respectively to obtain sufficient dendritic Ca2+ influx, and hence selectivity. The reference spine models had a shaft of 1 µm length x 0.2 µm diameter, and a head of length and diameter 0.5 µm. We did not observe sequence recognition in the primary apical dendrite (Figure 6J). Even the strongest stimuli applied in this location elicited only small Ca2+ elevations, with weak downstream MAPK responses, and no pattern selectivity.

Video 6. MAPK-P activity in apical dendrite zone following sequential synaptic input.

Download video file (2.9MB, mp4)
DOI: 10.7554/eLife.25827.016

Note high and sustained buildup of MAPK-P activity in a small zone of ~25 microns.

DOI: http://dx.doi.org/10.7554/eLife.25827.016

Video 7. MAPK-P activity in apical dendrite zone following scrambled synaptic input.

Download video file (2.9MB, mp4)
DOI: 10.7554/eLife.25827.017

Note that the activity is low and short-lasting.

DOI: http://dx.doi.org/10.7554/eLife.25827.017

We performed a limited parameter sensitivity analysis for the detailed cell model, focusing on biophysical and biochemical parameters involved in triggering or responding to Ca2+. We chose these parameters since stimulus range had been one of the most sensitive parameters for the abstract models. We individually varied stimulus strength, L-type Ca2+ channel density, Ca2+ diffusion, and the activation of Raf by Ca2+. Each of these runs was performed with distinct random seeds and stochasticity in spike-trains and in chemical kinetics in spines. Even though we had not fine-tuned the model for robustness, we found that the model retained selectivity (at least 50% of best selectivity) over a factor of ~2 or more for all parameters except the Raf affinity for Ca2+ (Figure 6—figure supplement 1). The latter parameter could be varied by ±15% about its reference. While this list is not exhaustive, it does suggest that the sequence selectivity of the detailed model is fairly robust, and somewhat more so than the abstract models.

Thus, we showed that intracellular signaling pathways exhibited selectivity for ordered synaptic input, even when considerable morphological and electrical detail and noisy input were incorporated. Selectivity became noisier with this additional detail, and different zones of the cell required different synaptic efficacies to achieve selectivity. With the current parameters the selectivity was on the time-scale of seconds, with successive inputs spaced apart by a few microns.

Sequence-signaling triggered channel modulation may influence cellular firing

There are multiple possible outcomes of local sequential activity-triggered chemical signaling. These include synaptic plasticity, dendrite remodeling, and electrical changes through channel modulation. For the purposes of the current study, we focused on the third, namely channel modulation leading to changes in electrical activity, since this defines how the neuron may report the presence of a sequence to other cells in the neuronal network. Similar brief, strong synaptic input on small sections of distal dendrites has been reported to cause strong changes in activity of striatal spiny neurons by triggering a transition to an ‘up’ state (Plotkin et al., 2011).

We utilized the same morphologically detailed pyramidal neuron model as above, and asked if local channel modulations over the length scale of about 20 μm could alter somatic spiking. We assumed that MAPK activity, or other signaling events downstream of sequence selective chemistry, could perform channel modulation through phosphorylation or triggering of channel insertion. For example, MAPK phosphorylates and modulates KA (Yuan et al., 2002) Kir6.2 (Lin and Chai, 2008), and Na(v) 1.7channels (Stamboulian et al., 2010). MAPK is also implicated in control of trafficking of AMPA receptors (Keifer et al., 2007). We did not simulate these modulation events explicitly since the computations were very lengthy and we wished to perform many repeats to estimate the distribution of the firing rates following channel modulation. Instead we ran just the electrical cell model for an initial settling period of 1 s, and then used the simulation script to modify the selected channel conductance to represent its modulation. Following this we ran the model for another 3 s in each case. We applied these channel modulations to the same four regions of the cell which we had tested for sequence discrimination. We examined modulation of KA, Na, nonselective leak, NMDAR and AMPAR channels.

We estimated the statistics of firing following these modulatory changes through repeated simulations of the control condition (100 repeats) and each modulation condition (40 repeats), each with different random number seeds. We found that modulation of the Na channel, and increase in nonselective leak conductance in the apical and primary dendrites could increase firing rates by large factors (Figure 7A,B).

Figure 7. Firing rate changes in response to channel modulation in small zones on the dendritic tree.

Figure 7.

Error bars are standard deviation. (A) Modulation of Na current. (B) Adding nonselective Leak current. (C) Modulation of GluR in the presence of the same synaptic input as was used as a stimulus for the sequential input. (D) Schematic of convergence of inputs from different ensembles onto one dendritic zone. The numbered clouds represent input ensembles from which a single neuron projects to the indicated location on the dendrite.

DOI: http://dx.doi.org/10.7554/eLife.25827.018

In initial runs, modulation of NMDA and AMPA receptors had no effect. This was because the random background synaptic input to these receptors was low, at 0.1 Hz. Since the receptors were activated at this low rate, their effect on cell firing was minimal. However, in these calculations, we had omitted the synaptic input that triggered the chemical cascades. Based on the time-course of build-up of MAPK-P (Figure 5E, Figure 6D), the MAPK-P activity was already high by the time of the last synaptic burst in the sequence of inputs. We therefore repeated the calculations, and additionally incorporated a single burst of synaptic input to the NMDA and AMPA receptors for the same duration and frequency as in the full multiscale cell model (Figure 6).

With this change, we found that a 10x increase in AMPAR conductance in the 20 μm zone in the apical dendrite led to a doubling in cell firing (Figure 7C). A similar manipulation in the primary dendrite led to a shallower increase, about 1.5x.

Thus, chemical signaling, even in rather small regions of the apical dendrite, may lead to a rapid change in cell firing by local channel modulation. However, large channel modulations were needed to elicit sufficiently large (e.g., 50%) changes in in firing rate that could be detected over the noisy background.

Discussion

We postulate that recursive sequence recognition is a fundamental computational operation in the brain, and that this operation may be implemented by neurons able to recognize spatially and temporally sequential input on behavioral time-scales (seconds). In this study, we have examined three key parts of such a hypothesis. (1) At the chemical level, we have examined a set of abstract rate equations coupled by linear diffusion, and identified key motifs that support sequence recognition. (2) At the dendrite level, we have shown that these abstract principles of reaction-diffusion mediated sequence recognition carry over to much more detailed and biologically motivated neuronal models. These models are multiscale composite models, and explore the length-scales and physiological detail relevant to the current hypothesis. (3) At the cell level, we have shown that local, 20 μm channel modulation can elicit changes in somatic spiking. 20 μm is within the range of our predicted sequence-activated signaling that could lead to channel modulation by phosphorylation or insertion.

We envision a network configuration where at the input level, there are ensembles of neurons that are active in a defined sequence in some sensory, motor or other context. We focus our analysis on a specific postsynaptic neuron, which receives a projection from each of the preceding ensembles, such that each synapse is located within a few μm of the next.

Firing change, synaptic plasticity, and morphological change may result from biochemical sequence recognition

There are several synaptically activated pathways that may fit the profile of state switching with feedback inhibition. Based on our abstract models (Figure 2), these are candidates for implementing sequence selectivity. These include four major kinases (PKA, PKC, MAPK, CaMKII) and a variety of second-messenger and metabotropic pathways (Bhalla and Iyengar, 1999; Kim et al., 2011; Lisman and Zhabotinsky, 2001). Thus, though we illustrate our findings using the MAPK pathway, we suggest that other mechanisms may also apply. Biochemical events have multiple outcomes on cell physiology, and even with the one example of MAPK pathway output we suggest that these may (at least) include firing rate changes, plasticity, and morphological change.

On the rapid time-scale of seconds, MAPK modulates multiple ion channels in the cell. These include KA (Yuan et al., 2002), Kir6.2 (Lin and Chai, 2008), Na(v)1.7 channels (Stamboulian et al., 2010), and MAPK also influences trafficking of AMPA receptors (Keifer et al., 2007). As analyzed in Figure 7, modulation of some of these target channels can lead to immediate changes in cell firing. While the amount of modulation required for an effect is quite large in some cases, we stress that these were proof-of-principle calculations. A more exhaustive calculation would require better cellular physiology including more channel types, full multiscale calculations of the biochemistry leading up to channel modulation, and multiple simultaneous targets. Similar small length-scale events have been shown to affect cellular firing in striatal neurons (Plotkin et al., 2011), suggesting that this outcome of sequence selection may also be plausible. It has also been shown that local signaling can lead to changes in dendritic excitability, again modulating cell-wide firing (Narayanan and Johnston, 2010).

On a slightly longer time-scale, MAPK is upstream of numerous plasticity events (Smolen et al., 2006). These include phosphorylation and insertion of receptors (Keifer et al., 2007), modulation of dendritic protein synthesis (Tsokas et al., 2007), and transcriptional control (Rosenblum et al., 2002). The computational outcome of synaptic plasticity has been extensively analyzed, but to our knowledge there are no learning rules that factor in sequential activity. It is intriguing to note that our analysis of dendrite-based local chemical activation has parallels with the phenomenon of synaptic tagging (Frey and Morris, 1997). In both cases, synaptic input can amplify events in nearby, weakly-stimulated synapses. We speculate that sequence recognition and its conversion to plasticity events may share mechanisms with synaptic tagging.

Finally, MAPK activation is known to play a role in learning-associated morphological change in neurons (Tyler et al., 2002). This raises the possibility that its activation through sequence-selectivity rules may lead to addition of new synapses, or reconfiguration of dendrite geometry and spine placement. Such changes would affect the same reaction-diffusion events that underlie sequence selectivity, leading to interesting multiscale feedback dynamics.

Sequence recognition confers substantial computational capabilities on single cells

Our model of sequence recognition in the neuron implements a potentially powerful form of cellular computation, leading to multiple possible outcomes as discussed above. It is interesting to estimate how much computation this represents. For simplicity, we consider computation in terms of immediate firing rate changes (discussed above), though plasticity and morphological change are also computational outcomes.

If we take a 5-stage sequence, a perfect sequence recognizer would distinguish 1 from 5! possible sequences, or 1 in 120. Longer sequences would have exponentially steeper discrimination ratios, but this places increasingly stringent constraints on network connectivity due to the requirement of having the inputs close to each other. Based on our simulations, biochemical reactions in the presence of noisy input are not as clean in their sequence selectivity as the abstract models (Figure 6 vs. Figure 3) but nevertheless do achieve good discrimination. In addition to being able to discriminate an ordered sequence from among many others, it is desirable that there be a large difference in chemical signal amplitude between ordered and scrambled sequences. Figures 2, 3 and 5 suggest that ratios in the range of 1:5 may be achievable, and 1:2 should be common.

Next, we estimate how many such sequence recognition blocks there might be in a neuron. For this analysis, we draw on the results of the biochemical calculations for an estimate of a sequence recognition zone, of ~10 μm (Figure 6), and the result that sequence discrimination should happen over most of the dendritic tree except for the trunk of the primary apical dendrite (Figure 6J). Say the set of spines occupies 10 μm. The most conservative calculation requires that these blocks do not overlap, so in a pyramidal neuron with about 10000 μm of dendritic length we have ~1000 blocks. If we permit blocks to slide by one input at a time, there are five times as many sequence recognition blocks, i.e., ~5000. If the sequence lasts 10 s, a single block performs 0.1 sequence recognitions per second. Thus, the neuron may perform 500 sequence discriminations each second. Calcium-induced Calcium release (CICR) based sequence logic (discussed below) is much faster, and may be able to increase this by a factor of 10. It is out of scope of the current study to estimate how many of the 500 possible sequential inputs would be active and in order at any given instant, but it is clear that the outcome of such sequence discrimination across the cell would be much more selective than a simple sum of the synaptic inputs that underlie the sequences. Leaving aside the plasticity effects, the readout of these sequence discriminations could be an ongoing modulation of cellular firing.

A still more speculative calculation suggests that single-neuron sequence recognition may provide a way to handle the combinatorial explosion of possible input sequences. Assume that sequential inputs converge to 10 μm stretches of dendrite, having spine spacing σ = 0.5 μm. Assume that the sequence-recognition biochemistry tolerates a spatial slop of ±1.5 μm, or ±3 synapses, for each input. Then there are ~7 possible synaptic inputs for each stage of the sequence, and the overall block of 5 inputs may receive 75, or ~17000 sequences of length 5. Using our calculation above, each neuron has ~5000 blocks, and so can recognize ~8.5×107 sequences. Thus, with many assumptions about connectivity and sparsity, this mechanism of single-neuron sequence recognition suggests that single neurons may recognize very large numbers of input patterns through the combinatorics of synaptic convergence.

The key distinction between these two calculations is that the first indicates the computational capacity of a neuron, whereas the second considers the diversity of inputs it can act upon. Overall, our study suggests that sequence computation in the time domain, coupled with the combinatorics of spatially organized input along dendrites, result in extremely parallel and efficient computation at the single-neuron level.

Single-cell sequence recognition may act on a continuum of timescales

Neural activity sequences occur at a range of timescales. A striking example of this is the mapping of behaviorally-driven place-cell sequences (seconds) to rapid, 100 ms time-scale replay sequences (Wilson and McNaughton, 1994). The distinctive aspect of our current analysis is that it works for slow behavioral time-scales of seconds, which is typically challenging for electrical network computations (but see [Barak and Tsodyks, 2006; Goudar and Buonomano, 2015]). Our analysis suggests that chemical mechanisms can also support faster sequence recognition on the same length-scales (Figure 4). One way this might be implemented in the cell could be a faster kinase cascade than MAPK, such as PKA or PKC (Bhalla, 2002). Another might be local CICR, which has already been proposed to support propagating wave activity in dendrites (Hagenston et al., 2008; Kapur et al., 2001; Larkum et al., 2003; Lee et al., 2016; Plotkin et al., 2013; Ross, 2012) These have faster dynamics, of the order of 100 μm/s. Further, dendritic Ca2+ imaging suggests that the length-scale of dendritic CICR is similar (~10–20 μm) to that envisaged for sequence recognition in our study (Hagenston et al., 2008; Kapur et al., 2001; Larkum et al., 2003). Simulation studies have previously suggested that CICR may be a mechanism for integration of inputs and resulting in graded, persistent activity (Loewenstein and Sompolinsky, 2003). This study has some parallels with our analysis, in particular the presence of a propagating wavefront of chemical (Ca2+) activation. However, in the earlier CICR model the wavefront propagation was modulated by the summed synaptic input to the neuron rather than local and specific sequential synaptic input, which is the basis of our study.

Individual chemical implementations of sequence recognition in our study operate over a range of about 2–5 μm and 1.5–4 s (Figures 4 and 6). While this is fairly robust as seen from a parameter sensitivity viewpoint, it falls far short of time-invariance. Rate modulation or stimulus amplitude may shift this to some extent (Figure 4) but a given cell, in a given state of modulation or activity, will recognize sequences only within a relatively small range. One possible way to extend the range is to have multiple chemical pathways each carry out sequence discrimination in parallel. It would be interesting to see how the chemistry of multiple sequence recognizers may interact. Alternatively, time-invariance may not be a feature of single neurons, but may arise in a network where different neurons recognize different time-ranges. Different cell-types with different chemical mechanisms for sequence-recognition would be likely to operate in substantially different time regimes. It is interesting to speculate that there may be useful computational implications of having different cells ‘tuned’ to different sequence speeds.

Still faster sequence recognition (~40 ms) has been demonstrated in the electrical domain, where forward sequences can be discriminated from backward (Branco et al., 2010). This electrical mechanism has been shown to have ~40% discrimination between forward and backward patterns, rather than the strong selectivity among permutations of patterns shown by our chemical system. Thus this form of electrical sequence recognition is likely to operate in different network contexts than our proposed chemical recognition mechanism.

Together, we suggest that chemical and CICR-based sequence recognition may span the range of timescales from 200 ms to 10 s. It is interesting to speculate that these may coexist, thus permitting the same segment of dendrite to recognize slow behaviorally-driven sequences and also much faster replays of the same sequence.

Sequence recognition is testable

Our hypothesis of single-cell sequence recognition is readily testable using current technology. Its chemical basis may be examined in brain-slice using local agonist application or sequential glutamate uncaging followed by microscopic readouts of activity reporters for candidate pathways. Such experiments have already been done to examine CICR triggered by synaptic inputs converging to adjacent synapses (Hagenston et al., 2008; Plotkin et al., 2013). These show that there is indeed a buildup of Ca2+ along small, 20 μm stretches of dendrite, under suitable stimulus conditions. If local biochemical signaling leads to changes in cellular firing-rate (e.g., Figure 7, [Plotkin et al., 2011]), then sequential uncaging along with patch recordings should report these. Further, pharmacological experiments in the slice would readily be able to tease apart possible mechanisms.

Another implication of the proposed reaction-diffusion mechanism for sequence recognition is that it suggests mechanisms for coupling genetic polymorphisms and mutations to a specific aspect of neuronal computation. For example, small changes in reaction rates may shift the preferred timescale of recognized sequences (Figure 4), but large changes may eliminate tuning altogether. It would be interesting to see if there is a correlation between specific dendritic signaling genes and psychophysical measures of sequence computation.

In summary, we propose a novel computational function of single neurons, to recognize slow sequences on behavioral timescales, and to exploit combinatorics of input projections to carry out such recognition in a massively parallel manner. We have used simulations of abstract chemistry and detailed multiscale neuronal physiology to understand implications and constraints for such computation to occur. We suggest that this multiscale cellular signaling process may underlie computationally powerful sequence recognition mediated by single neurons.

Materials and methods

All modeling was carried out using MOOSE, the Multiscale Object-Oriented Simulation Environment (Ray and Bhalla, 2008). MOOSE is freely available, open source, and licensed under the GNU Public License version 3. It can be downloaded from moose.ncbs.res.in and GitHub https://github.com/BhallaLab/moose (Bhalla et al., 2016). MOOSE utilizes the GNU Scientific Library (GSL) Runge-Kutta-Fehlberg fifth order method for chemical computations, and a custom-written branching 1-D diffusion solver using the backward Euler (implicit) method. Stochastic chemical calculations were carried out using a custom-written optimized version of the Gillespie Stochastic Systems Algorithm. Pseudo-random numbers were generated by the Mersenne twister (Matsumoto and Nishimura, 1998). Electrical computations utilized a custom version of the branched nerve equation solution methods described by Hines (Hines, 1984). This has been validated by comparison with other simulators (Gleeson et al., 2010). Interfaces between chemical and electrical signaling components of the model utilized adaptor classes in MOOSE, which average over spatial and temporal discretization differences between the two methods. For example, electrical calculations (yielding Ca2+ values) utilize a much smaller timestep (~50 μs; 5 μm) but typically employ a larger spatial step than chemical calculations (~1 ms, 1 μm). The adaptors synchronized the chemical and electrical models every millisecond using first-order corrections to each model system. Electrical model morphologies were either geometrical (cylindrical) or derived from published cell reconstructions available on NeuroMorpho.org (Ascoli et al., 2007; Dougherty et al., 2012). Spines were positioned along dendrites using Poisson statistics with a specified mean spacing between spines (1 μm in the full cell model). Spines were modeled as a cylindrical head (0.5 μm length and diameter) on a cylindrical shaft (1 μm length, 0.2 μm diameter). In some simulations the spine dimensions were scaled up by 20% or 40%. Channel kinetics were derived from Traub et al. (1991). Analysis and plotting was done using Python, NumPy, and MatPlotLib. Simulations were carried out on a variety of Linux workstations, and large calculations were carried out on Linux clusters. Figure generation code for Figures 2, 5 and 6 is available as supplementary material.

Abstract reaction-diffusion calculations (Figures 24) were carried out in a 1-dimensional geometry with spatial discretization of 1 μm. In order to represent reactions occurring in a spatially restricted region in or under dendritic spines, the reaction systems were active only in five equally spaced 1 μm patches, but diffusion took place throughout the 100 μm length of the model.

Selectivity calculations were performed according to Equation 3. In this equation, Atot is computed for each permutation of the sequence. This is expensive as there are 120 permutations for a sequence of length 5. Therefore exhaustive permutations were only performed for Figures 3 and 4. In order to generate sequence selectivity matrices for Figure 6 and for all the sensitivity analyses, we took every tenth permutation (including the first one, [0,1,2,3,4]), for a total of 12 permutations. The order of permutations was as generated by the Python library call itertools.permutations. The resultant sequences were: [0,1,2,3,4], [0,2,4,1,3], [0,4,2,1,3], [1,2,0,3,4 , 1,3,4,0,2 , 2,0,3,1,4 , 2,3,0,1,4 , 2,4,3,0,1 , 3,1,2,0,4 , 3,4,0,1,2 , 4,0,3,1,2 , 4,2,1,0,3]. Here [0,1,2,3,4] means that synapse 0 fires first, then synapse 1, then synapse two and so on. In Figure 6—figure supplement 1 we modified Equation 3 slightly by computing Asequential as the mean of 5 runs with the same, sequential stimuli. This was done because the stochastic spiking and chemical calculations introduced considerable variability in the estimate of Asequential. In this figure the mean(Atot) term in Equation 3 took this mean value of Asequential, and Atot for the other 11 permutations, as the set over which the mean was computed.

Chemical models are available in the supplementary material in tabular form and as GENESIS/kkit files, and will be hosted on http://doqcs.ncbs.res.in and ModelDB. Electrical models are available in supplementary material in tabular form and as MOOSE scripts. The morphology file is from NeuroMorpho.org (Ascoli et al., 2007; Dougherty et al., 2012) and attached in the supplementary material as the file VHC-neuron.CNG.swc.

Acknowledgements

I acknowledge funding support from NCBS/TIFR and the Department of Science and Technology grant SR/CSI/66/2013 under the Cognitive Science Research Initiative. Large simulations were carried out in the NCBS Supercomputing facility. I acknowledge Arvind Kumar and Sahil Moza for comments on the project.

Funding Statement

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Funding Information

This paper was supported by the following grants:

  • National Centre for Biological Sciences Plan 4142 to Upinder Singh Bhalla.

  • Department of Science and Technology, Ministry of Science and Technology SR/CSI/66/2013 to Upinder Singh Bhalla.

Additional information

Competing interests

USB: Reviewing editor, eLife.

Author contributions

USB, Conceptualization, Resources, Data curation, Software, Formal analysis, Supervision, Funding acquisition, Validation, Investigation, Visualization, Methodology, Writing—original draft, Project administration, Writing—review and editing.

Additional files

Source code 1. This set of source files is provided to illustrate generation of numerical portions of Figure 2, Figure 5, and Figure 6.

The contents of the zip file include a README.txt, which has the file information and running instructions. In addition, it has script files for various parts of the figures, as well as model specification files for the chemical channel, and morphological parameters. Files include:

DOI: http://dx.doi.org/10.7554/eLife.25827.019

elife-25827-code1.zip (294.4KB, zip)
DOI: 10.7554/eLife.25827.019
Supplementary file 1. The supplementary data file specifies chemical reactions and parameters for the MAPK model.

It also specifies channel equations and parameters for the full cell model used in Figures 6 and 7. Finally, it specifies the channel distributions in the full cell model.

DOI: http://dx.doi.org/10.7554/eLife.25827.020

elife-25827-supp1.docx (21KB, docx)
DOI: 10.7554/eLife.25827.020

Major datasets

The following previously published dataset was used:

Ascoli GA,Donohue DE,Halavi M,2007,NeuroMorpho.org,http://neuromorpho.org/neuron_info.jsp?neuron_name=VHC-neuron,Publicly available at NeuroMorpho.org (accession no: NMO_09573)

References

  1. Abeles M. Local Cortical Circuits: An Electrophysiological Study. Berlin: Springer; 1982. [Google Scholar]
  2. Ascoli GA, Donohue DE, Halavi M. NeuroMorpho.Org: a central resource for neuronal morphologies. Journal of Neuroscience. 2007;27:9247–9251. doi: 10.1523/JNEUROSCI.2055-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Barak O, Tsodyks M. Recognition by variance: learning rules for spatiotemporal patterns. Neural Computation. 2006;18:2343–2358. doi: 10.1162/neco.2006.18.10.2343. [DOI] [PubMed] [Google Scholar]
  4. Bhalla US, Iyengar R. Emergent properties of networks of biological signaling pathways. Science. 1999;283:381–387. doi: 10.1126/science.283.5400.381. [DOI] [PubMed] [Google Scholar]
  5. Bhalla US. Mechanisms for temporal tuning and filtering by postsynaptic signaling pathways. Biophysical Journal. 2002;83:740–752. doi: 10.1016/S0006-3495(02)75205-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Bhalla US. Multiscale interactions between chemical and electric signaling in LTP induction, LTP reversal and dendritic excitability. Neural Networks. 2011;24:943–949. doi: 10.1016/j.neunet.2011.05.001. [DOI] [PubMed] [Google Scholar]
  7. Bhalla US, Ray S, HarshaRani GV, Singh D, Dudani N. MOOSE simulator. e5ac4a0https://github.com/BhallaLab/moose GitHub. 2016
  8. Bouchard KE, Brainard MS. Auditory-induced neural dynamics in sensory-motor circuitry predict learned temporal and sequential statistics of birdsong. PNAS. 2016;113:9641–9646. doi: 10.1073/pnas.1606725113. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Branco T, Clark BA, Häusser M. Dendritic discrimination of temporal input sequences in cortical neurons. Science. 2010;329:1671–1675. doi: 10.1126/science.1189664. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Broome BM, Jayaraman V, Laurent G. Encoding and decoding of overlapping odor sequences. Neuron. 2006;51:467–482. doi: 10.1016/j.neuron.2006.07.018. [DOI] [PubMed] [Google Scholar]
  11. Carrillo-Reid L, Miller JE, Hamm JP, Jackson J, Yuste R. Endogenous sequential cortical activity evoked by visual stimuli. Journal of Neuroscience. 2015;35:8813–8828. doi: 10.1523/JNEUROSCI.5214-14.2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Dougherty KA, Islam T, Johnston D. Intrinsic excitability of CA1 pyramidal neurones from the rat dorsal and ventral Hippocampus. The Journal of Physiology. 2012;590:5707–5722. doi: 10.1113/jphysiol.2012.242693. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Fitzhugh R. Impulses and physiological States in Theoretical models of Nerve membrane. Biophysical Journal. 1961;1:445–466. doi: 10.1016/S0006-3495(61)86902-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Frey U, Morris RG. Synaptic tagging and long-term potentiation. Nature. 1997;385:533–536. doi: 10.1038/385533a0. [DOI] [PubMed] [Google Scholar]
  15. George D, Hawkins J. Towards a mathematical theory of cortical micro-circuits. PLoS Computational Biology. 2009;5:e1000532. doi: 10.1371/journal.pcbi.1000532. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Gleeson P, Crook S, Cannon RC, Hines ML, Billings GO, Farinella M, Morse TM, Davison AP, Ray S, Bhalla US, Barnes SR, Dimitrova YD, Silver RA. NeuroML: a language for describing data driven models of neurons and networks with a high degree of biological detail. PLoS Computational Biology. 2010;6:e1000815. doi: 10.1371/journal.pcbi.1000815. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Goudar V, Buonomano DV. A model of order-selectivity based on dynamic changes in the balance of excitation and inhibition produced by short-term synaptic plasticity. Journal of Neurophysiology. 2015;113:509–523. doi: 10.1152/jn.00568.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Hagenston AM, Fitzpatrick JS, Yeckel MF. MGluR-mediated calcium waves that invade the soma regulate firing in layer V medial prefrontal cortical pyramidal neurons. Cerebral Cortex. 2008;18:407–423. doi: 10.1093/cercor/bhm075. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Hawkins J, Ahmad S. Why neurons have thousands of Synapses, a Theory of sequence memory in Neocortex. Frontiers in Neural Circuits. 2016;10 doi: 10.3389/fncir.2016.00023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Hebb DO. The Organization of Behavior. Wiley; 1949. [Google Scholar]
  21. Hines M. Efficient computation of branched nerve equations. International Journal of Bio-Medical Computing. 1984;15:69–76. doi: 10.1016/0020-7101(84)90008-4. [DOI] [PubMed] [Google Scholar]
  22. Jadhav SP, Kemere C, German PW, Frank LM. Awake hippocampal sharp-wave ripples support spatial memory. Science. 2012;336:1454–1458. doi: 10.1126/science.1217230. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Kapur A, Yeckel M, Johnston D. Hippocampal mossy fiber activity evokes Ca2+ release in CA3 pyramidal neurons via a metabotropic glutamate receptor pathway. Neuroscience. 2001;107:59–69. doi: 10.1016/S0306-4522(01)00293-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Keener J, Sneyd J. Mathematical Physiology. New York: Springer; 1998. [Google Scholar]
  25. Keifer J, Zheng ZQ, Zhu D. MAPK signaling pathways mediate AMPA receptor trafficking in an in vitro model of classical conditioning. Journal of Neurophysiology. 2007;97:2067–2074. doi: 10.1152/jn.01154.2006. [DOI] [PubMed] [Google Scholar]
  26. Kim M, Park AJ, Havekes R, Chay A, Guercio LA, Oliveira RF, Abel T, Blackwell KT. Colocalization of protein kinase A with adenylyl cyclase enhances protein kinase A activity during induction of long-lasting long-term-potentiation. PLoS Computational Biology. 2011;7:e1002084. doi: 10.1371/journal.pcbi.1002084. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Kumar A, Rotter S, Aertsen A. Conditions for propagating synchronous spiking and asynchronous firing rates in a cortical network model. Journal of Neuroscience. 2008;28:5268–5280. doi: 10.1523/JNEUROSCI.2542-07.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Laje R, Buonomano DV. Robust timing and motor patterns by taming Chaos in recurrent neural networks. Nature Neuroscience. 2013;16:925–933. doi: 10.1038/nn.3405. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Lake D, Corrêa SA, Müller J. Negative feedback regulation of the ERK1/2 MAPK pathway. Cellular and Molecular Life Sciences. 2016;73:4397–4413. doi: 10.1007/s00018-016-2297-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Larkum ME, Watanabe S, Nakamura T, Lasser-Ross N, Ross WN. Synaptically activated Ca2+ waves in layer 2/3 and layer 5 rat neocortical pyramidal neurons. The Journal of Physiology. 2003;549:471–488. doi: 10.1113/jphysiol.2002.037614. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Lee DL. Pattern sequence recognition using a time-varying Hopfield network. IEEE Transactions on Neural Networks. 2002;13:330–342. doi: 10.1109/72.991419. [DOI] [PubMed] [Google Scholar]
  32. Lee KF, Soares C, Thivierge JP, Béïque JC. Correlated synaptic inputs drive dendritic calcium amplification and Cooperative plasticity during Clustered Synapse Development. Neuron. 2016;89:784–799. doi: 10.1016/j.neuron.2016.01.012. [DOI] [PubMed] [Google Scholar]
  33. Lin YF, Chai Y. Functional modulation of the ATP-sensitive potassium channel by extracellular signal-regulated kinase-mediated phosphorylation. Neuroscience. 2008;152:371–380. doi: 10.1016/j.neuroscience.2008.01.003. [DOI] [PubMed] [Google Scholar]
  34. Lisman JE, Zhabotinsky AM. A model of synaptic memory: a CaMKII/PP1 switch that potentiates transmission by organizing an AMPA receptor anchoring assembly. Neuron. 2001;31:191–201. doi: 10.1016/s0896-6273(01)00364-6. [DOI] [PubMed] [Google Scholar]
  35. Loewenstein Y, Sompolinsky H. Temporal integration by calcium dynamics in a model neuron. Nature Neuroscience. 2003;6:961–967. doi: 10.1038/nn1109. [DOI] [PubMed] [Google Scholar]
  36. Lorente de No R. Analysis of the activity of the chains of internuncial neurons. Journal of Neurophysiology. 1938;1:195–206. [Google Scholar]
  37. MacDonald CJ, Lepage KQ, Eden UT, Eichenbaum H. Hippocampal "time cells" bridge the gap in memory for discontiguous events. Neuron. 2011;71:737–749. doi: 10.1016/j.neuron.2011.07.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Matsumoto M, Nishimura T. Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator. ACM Transactions on Modeling and Computer Simulation. 1998;8:3–30. doi: 10.1145/272991.272995. [DOI] [Google Scholar]
  39. Mehring C, Hehl U, Kubo M, Diesmann M, Aertsen A. Activity dynamics and propagation of synchronous spiking in locally connected random networks. Biological Cybernetics. 2003;88:395–408. doi: 10.1007/s00422-002-0384-4. [DOI] [PubMed] [Google Scholar]
  40. Modi MN, Dhawale AK, Bhalla US. CA1 cell activity sequences emerge after reorganization of network correlation structure during associative learning. eLife. 2014;3:e01982. doi: 10.7554/eLife.01982. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Nagumo J, Arimoto S, Yoshizawa S. An active pulse transmission line simulating nerve axon. Proceedings of the IRE. 1962;50:2061–2070. doi: 10.1109/JRPROC.1962.288235. [DOI] [Google Scholar]
  42. Narayanan R, Johnston D. The h current is a candidate mechanism for regulating the sliding modification threshold in a BCM-like synaptic learning rule. Journal of Neurophysiology. 2010;104:1020–1033. doi: 10.1152/jn.01129.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Plotkin JL, Day M, Surmeier DJ. Synaptically driven state transitions in distal dendrites of striatal spiny neurons. Nature Neuroscience. 2011;14:881–888. doi: 10.1038/nn.2848. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Plotkin JL, Shen W, Rafalovich I, Sebel LE, Day M, Chan CS, Surmeier DJ. Regulation of dendritic calcium release in striatal spiny projection neurons. Journal of Neurophysiology. 2013;110:2325–2336. doi: 10.1152/jn.00422.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Rall W. Theoretical significance of dendritic trees for neuronal input-output relations. In: R.Reiss, editor. Neural Theory and Modeling. Stanford, CA: Stanford Univ. Press; 1964. pp. 73–97. [Google Scholar]
  46. Ray S, Bhalla US. PyMOOSE: interoperable scripting in Python for MOOSE. Frontiers in Neuroinformatics. 2008;2:6. doi: 10.3389/neuro.11.006.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Resat H, Ewald JA, Dixon DA, Wiley HS. An integrated model of epidermal growth factor receptor trafficking and signal transduction. Biophysical Journal. 2003;85:730–743. doi: 10.1016/S0006-3495(03)74516-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Rosenblum K, Futter M, Voss K, Erent M, Skehel PA, French P, Obosi L, Jones MW, Bliss TV. The role of extracellular regulated kinases I/II in late-phase long-term potentiation. Journal of Neuroscience. 2002;22:5432–5441. doi: 10.1523/JNEUROSCI.22-13-05432.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Ross WN. Understanding calcium waves and sparks in central neurons. Nature Reviews Neuroscience. 2012;13:157–168. doi: 10.1038/nrn3168. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Smolen P, Baxter DA, Byrne JH. A model of the roles of essential kinases in the induction and expression of late long-term potentiation. Biophysical Journal. 2006;90:2760–2775. doi: 10.1529/biophysj.105.072470. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Stamboulian S, Choi JS, Ahn HS, Chang YW, Tyrrell L, Black JA, Waxman SG, Dib-Hajj SD. ERK1/2 mitogen-activated protein kinase phosphorylates sodium channel na(v)1.7 and alters its gating properties. Journal of Neuroscience. 2010;30:1637–1647. doi: 10.1523/JNEUROSCI.4872-09.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Tank DW, Hopfield JJ. Neural computation by concentrating information in time. PNAS. 1987;84:1896–1900. doi: 10.1073/pnas.84.7.1896. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Traub RD, Wong RK, Miles R, Michelson H. A model of a CA3 hippocampal pyramidal neuron incorporating voltage-clamp data on intrinsic conductances. Journal of Neurophysiology. 1991;66:635–650. doi: 10.1152/jn.1991.66.2.635. [DOI] [PubMed] [Google Scholar]
  54. Tsokas P, Ma T, Iyengar R, Landau EM, Blitzer RD. Mitogen-activated protein kinase upregulates the dendritic translation machinery in long-term potentiation by controlling the mammalian target of rapamycin pathway. Journal of Neuroscience. 2007;27:5885–5894. doi: 10.1523/JNEUROSCI.4548-06.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Tyler WJ, Alonso M, Bramham CR, Pozzo-Miller LD. From acquisition to consolidation: on the role of brain-derived neurotrophic factor signaling in hippocampal-dependent learning. Learning & Memory. 2002;9:224–237. doi: 10.1101/lm.51202. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Wilson MA, McNaughton BL. Reactivation of hippocampal ensemble memories during sleep. Science. 1994;265:676–679. doi: 10.1126/science.8036517. [DOI] [PubMed] [Google Scholar]
  57. Yuan LL, Adams JP, Swank M, Sweatt JD, Johnston D. Protein kinase modulation of dendritic K+ channels in Hippocampus involves a mitogen-activated protein kinase pathway. Journal of Neuroscience. 2002;22:4860–4868. doi: 10.1523/JNEUROSCI.22-12-04860.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
eLife. 2017 Apr 19;6:e25827. doi: 10.7554/eLife.25827.023

Decision letter

Editor: Frances K Skinner1

In the interests of transparency, eLife includes the editorial decision letter and accompanying author responses. A lightly edited version of the letter sent to the authors after peer review is shown, indicating the most substantive concerns; minor comments are not usually included.

Thank you for submitting your article "Synaptic input sequence discrimination on behavioral time-scales mediated by reaction-diffusion chemistry in dendrites" for consideration by eLife. Your article has been favorably evaluated by Timothy Behrens (Senior Editor) and three reviewers, one of whom, Frances K Skinner (Reviewer #1), is a member of our Board of Reviewing Editors. The following individuals involved in review of your submission have agreed to reveal their identity: Paul Smolen (Reviewer #2) and Kim T Blackwell (Reviewer #3).

The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.

While all of the reviewers felt that this was interesting and significant work, there was a clear consensus that several aspects of the paper were unclear and thus subsequently confusing.

Overall, it was felt that the author needed to expand on his explanations and descriptions in several places. The specific points that need expansion, revision and further explanations in the paper are:

1) the 4 models

2) Q equation has issues

3) sensitivity of the results

Besides this, the reviewers have various issues in their comments (details that seem to need fixing) that should be responded to (see below).

Reviewer #1:

This is an interesting theoretical, computational study that considers sequence discrimination at the level of the single cell (rather than networks) including slower timescales (hundreds and milliseconds and slower). Reaction-diffusion modeling and detailed multi-scale models are used to show attributes of recognizing input in the correct order and over scrambled input and background noise, as well as showing an effect on firing.

While interesting, the manuscript could be more fully explained and expanded in several places to help the reader fully grasp the situation. Also, various details seemed a bit strange to me, and further discussion on some points seem warranted. Specifics are:

1) The author gives the context of place cells (Figure 1), but it would be helpful to explain this a bit further I think. That is, each neuronal ensemble sends a projection to a dendritic segment etc. Should this be considered as a particular postsynaptic cell? Should the network context be ignored, is this on multiple segments of a given cell, cells in a network, or does it matter in the context, etc.? I realize that the focus is on the single cell, and perhaps it doesn't really matter overall for the work, but some consideration/description of this would be helpful to the reader in setting the envisioned context. This would be further helpful in the Discussion when timescales are estimated and discussed.

2) For Figure 2, the author could expand on his 4 models and molecules A and B and Ca – that is, a schematic of the overall relationship would be helpful. Perhaps some sort of simple MAPK pathway (generic as for the 4 models) could be illustrated? The author says "The results were as expected" (subsection “Reaction systems select for distinct speeds and length-scales of sequential input”) in referring to Figure 7 – expand on why this is please. Figure 3 process not quite clear to me – left x-axis 'sequence score' is obtained how? The color on the right is Q, right? – please label.

It was not immediately obvious to me how a Q of -0.001 would be obtained for the sequence given – please explain and/or demonstrate/illustrate more fully.

2-6 μm spatial intervals given in text but in figures, the high Q values (color) are at tens of μm – I think that I am missing something or perhaps confused.

3) Multi-compartment model details are specified as taken from mostly from Traub et al. 1991, but the reference is not listed in the bibliography. Potassium reversal potential of -15 mV seems a bit depolarized, and I assume 60 mV for resting is a typo (-60 mV?). 1 ohm.m2 is 1000mS/cm2 for Rm, and seems rather high? The values in Figure 7 to see effect in firing are even larger by a lot which is perhaps a bit concerning?

4) Does it matter that there is no Ih in the model, which is well-known to be non-uniformly distributed in pyramidal dendrites. Would this be expected to affect the results?

5) Subsection “Sequence speed selectivity scales with reaction rates and diffusion constants” – "As expected, we found that as the rates were increased…". Why? As there was not a complete explanation for the 4 models, this 'expectation' suffers here too.

Reviewer #2:

This is an interesting paper dealing with an important topic in computational neuroscience, sequence discrimination. But some important points need to be addressed. I am asking for a little extra work – not an exhaustive analysis – in only one of my comments, comment 1, given that parameter sensitivity analysis is a common, substantial concern in all modeling studies.

1) Some parameter sensitivity analysis should be done for some of the key results. For example, in Figure 2, rightmost column, it appears that parameter values may be "tuned" to be close to bistability, so that stimuli can give relatively long, but eventually declining, response plateaus. Although, the numbers in the equations above do look pretty generic. Similarly, for Figures 2C and 2D, and other figures that show strong sequence selectivity, how dependent is this selectivity on values of rate constants and other parameters? I'm not asking for an exhaustive analysis, but some degree of analysis and discussion of sensitivity should be given for a few of the key results. For example the sensitivity of the results of Figure 6G, which presents selectivity for the most realistic model, should be discussed.

2) The selectivity criterion in Equation 3 cannot be correct as defined. The quantity Q, from Equation 2, is only related to the input, not the response, so Eq. 3 is also not related to the response. But of course selectivity, as plotted in the right column of Figure 3 and later, is related to the response. In Eq. 3, should Q be simply replaced by the average or maximum of the variable A, and in later cases should A be replaced by MAPK-P?

3) In the subsection “Sequence speed selectivity scales with reaction rates and diffusion constants” the author describes how by varying rates he can achieve good sequence selectivity over a broad range of time intervals, and in the Introduction it is noted that such time-invariance is a "desirable feature". But, for a single neuron or dendrite, the rate constants are presumably fixed, or at least do not vary in anticipation of stimulus time scales? So, I don't see how to get time invariance in a single neuron. So then, how does the author envision getting time invariance in a real neural network? Does he envision different neurons in the network will have different parameters so that they will respond to different time scales? These issues should be addressed in the Discussion.

4) For the channel modulations that underlie the simulations of Figure 7, it is never discussed whether these modulations would result from activation of the MAPK signaling pathway simulated in the rest of the paper. The channel modulations are imposed ad hoc. It would be good to connect these portions of the paper, if not by simulations of MAPK effects on channels, then at least by discussing to what extent some or all of these modulations are thought to be downstream of MAPK activation and are a plausible readout or result of the sequentially amplified activation of the MAPK pathway simulated previously.

5) In the Discussion, large numbers are given for how many sequence discriminations a neuron can perform per second and how many sequences a neuron can discriminate. But I am skeptical of these estimates because no discussion is given of what it means operationally for a neuron, a cell, to "discriminate" a sequence. It seems to me that a change in electrical firing rate or spike timing is needed to say a neuron has discriminated a sequence. Or, a change in synaptic plasticity. A transient biochemical response in a dendrite, just by itself, doesn't seem to me sufficient to constitute "discrimination" by the neuron. These caveats should be noted and discussed.

6) In the Methods, it is stated with regard to the simulations of Figure 7 that we ran the model for 1 second to let the cell settle, before modulating channels. But clarification is needed since 1 second is not enough to allow simulated biochemical pathways to come to equilibrium in the models. Especially in the realistic simulations of Figure 6, how much simulated time was allowed from when biochemical variables were initialized to when stimuli were given.

7) Figure 4F and 4G is a particular instance of the sensitivity issue in comment 1. Here a 20% change in stimulus amplitude leads to a very large change in the selectivity pattern. Is this sensitivity of pattern to stimulus amplitude typical for the models?

Reviewer #3:

The research addresses the important problem of pattern recognition by neurons. Specifically, what mechanisms allow a neuron to discriminate sequence a-b-c from c-b-a, where a, b, c are each a different synaptic input. The ability to discriminate temporal pattern is more difficult than discriminating which synaptic inputs are present. This issue has been addressed in specialized, direction selective cells, but the more general problem has not been investigated. A major strength of the manuscript is that the authors use both a simple, analytical model as well as biophysically and biochemically realistic neuron models to demonstrate principles underlying the results and to demonstrate the plausibility of neurons in tissue accomplishing temporal discrimination. Using the simple models, the author analyzes and presents the critical factors constraining sequence specificity. By using realistic model, the author demonstrates that sequence specificity can be implemented by neurons in tissue, since these simulations include background synaptic inputs, including theta modulated GABA input. For the most part the results are quite clear. There are only two aspects that need better exposition.

1) Though the difference in selectivity is apparent in Figure 3, it is not clear what exactly is being plotted. I understand using R^2, which gives values between 1 (i.e., good) -1 (i.e., bad) for Q if m=1, but I don't understand why add the term m into Q Equation 2. In addition, why does Equation 3 use Q as the selectivity measure. The first time I read this page, I thought that Q was the selectivity measure. Then, I realized that Q was just a convenient way to obtain a monotonic x axis value, and that the important information was in a graph of A versus Q. But then Equation 3 claims to plot a selectivity value which is a function of Q, not A. A more detailed illustration of how values in Figure 3 are obtained (one value from right side graph and one value from left side graph) would be quite helpful. Also, where does the temporal interval come into this equation?

2) The results in the subsection “Local dendritic channel modulations may influence cellular firing”, describing the effect of channel modulation need a bit more explanation. In particular, it is quite surprising that an increase in leak conductance would increase firing rate. Since leak channels are typically potassium channels, I would expect an increase in leak conductance to not only make the cell less sensitive to depolarizing current, but also hyperpolarize the branch a bit, unless Eleak is rather depolarized. An intuitive explanation for this result would be helpful. Also, I don't understand how these manipulations are related to sequence discrimination. Wouldn't these channel modulations change firing rate for all sequences? Or perhaps the neuron can better discriminate the correct from incorrect sequence?

eLife. 2017 Apr 19;6:e25827. doi: 10.7554/eLife.25827.024

Author response


While all of the reviewers felt that this was interesting and significant work, there was a clear consensus that several aspects of the paper were unclear and thus subsequently confusing.

Overall, it was felt that the author needed to expand on his explanations and descriptions in several places. The specific points that need expansion, revision and further explanations in the paper are:

1) the 4 models

2) Q equation has issues

3) sensitivity of the results

I thank the editor and reviewers for their thoughtful comments. I have addressed all the points brought up. Briefly,

1) I have added schematics and text to explain the structure and derivation of the 4 models.

2) I have fixed a regrettable mistake in Equation 3, where I had a different meaning for the Q symbol from Equation 2.

3) I have performed parameter sensitivity analyses for the abstract and detailed models, and presented these in supplementary figures.

In addition, I have gone through the other comments by the reviewers and made numerous revisions to address these.

Besides this, the reviewers have various issues in their comments (details that seem to need fixing) that should be responded to (see below).

Reviewer #1:

[…] While interesting, the manuscript could be more fully explained and expanded in several places to help the reader fully grasp the situation. Also, various details seemed a bit strange to me, and further discussion on some points seem warranted. Specifics are:

1) The author gives the context of place cells (Figure 1), but it would be helpful to explain this a bit further I think. That is, each neuronal ensemble sends a projection to a dendritic segment etc. Should this be considered as a particular postsynaptic cell? Should the network context be ignored, is this on multiple segments of a given cell, cells in a network, or does it matter in the context, etc.? I realize that the focus is on the single cell, and perhaps it doesn't really matter overall for the work, but some consideration/description of this would be helpful to the reader in setting the envisioned context. This would be further helpful in the Discussion when timescales are estimated and discussed.

Thank you for pointing this out. I have rewritten the introductory paragraph and added extra explanatory words in the figure legend to clarify these points.

“We assumed that a single neuron from each of these ensembles projects onto a given postsynaptic cell, which is the focus of our analysis. The projections are ordered such that they converge onto a succession of spines located on a short stretch of dendrite on this cell, in the same spatial and temporal order as the activation of the ensembles. We ignored all other network context.”

I have also updated the Discussion section:

“We envision a network configuration where at the input level, there are ensembles of neurons that are active in a defined sequence in some sensory, motor or other context. We focus our analysis on a specific postsynaptic neuron, which receives a projection from each of the preceding ensembles, such that each synapse is located within a few microns of the next.”

2) For Figure 2, the author could expand on his 4 models and molecules A and B and Ca – that is, a schematic of the overall relationship would be helpful. Perhaps some sort of simple MAPK pathway (generic as for the 4 models) could be illustrated?

In Figure 2, I have added a new row of panels (B) with schematics for the four models. I have updated the figure legend to explain these schematics.

The author says "The results were as expected" (subsection “Reaction systems select for distinct speeds and length-scales of sequential input”) in referring to Figure 7 – expand on why this is please.

I have expanded on this as follows: “If the chemical system is highly selective, we expect that only one or two points in the scatter plot should have a high value of Atot, and these should be the points with Q around +1 or -1. […] Each of these outcomes had been observed in Figure 2 for just the sequential and a single scrambled stimulus, and in Figure 3 we found that it generalized to the entire set of sequence permutations.”

Figure 3 process not quite clear to me – left x-axis 'sequence score' is obtained how? The color on the right is Q, right? – please label.

I apologize for lack of clarity around Equation 3 and this figure. The left x axis is Q and the color on the right is the selectivity, from Equation 3. This is now corrected on the figure and in the text.

It was not immediately obvious to me how a Q of -0.001 would be obtained for the sequence given – please explain and/or demonstrate/illustrate more fully.

I have introduced new panels A and B in Figure 3 to illustrate the computation of Q.

2-6 μm spatial intervals given in text but in figures, the high Q values (color) are at tens of μm – I think that I am missing something or perhaps confused.

This was indeed confusing, as a result of my using the total activated length rather than the spatial intervals between synapses, for just this figure. I have corrected it in the new Figure 3 and Figure 4.

3) Multi-compartment model details are specified as taken from mostly from Traub et al. 1991, but the reference is not listed in the bibliography.

Fixed.

Potassium reversal potential of -15 mV seems a bit depolarized, and I assume 60 mV for resting is a typo (-60 mV?).

Reversal potential is as per Traub 1991, but I agree it is a bit depolarized. I didn’t want to get into reconfigurations of the channel properties for the current study so I left it as is.

Corrected resting potential to -60 mV.

1 ohm.m2 is 1000mS/cm2 for Rm, and seems rather high?

This is 10,000 ohm.cm^2, or 0.1 mS/cm^2, which is what Traub used. I understand that this is a fairly typical value.

The values in Figure 7 to see effect in firing are even larger by a lot which is perhaps a bit concerning?

This is indeed an important point. In the revision I have strengthened the point that the required modulations are large. From the Discussion:

“While the amount of modulation required for an effect is quite large in some cases, we stress that these were proof-of-principle calculations. […] Similar small length-scale events have been shown to affect cellular firing in striatal neurons (Plotkin et al., 2011), suggesting that this outcome of sequence selection may also be plausible.”

4) Does it matter that there is no Ih in the model, which is well-known to be non-uniformly distributed in pyramidal dendrites. Would this be expected to affect the results?

I don’t think the absence of Ih affects the results. For the purposes of sequence recognition, the biggest impact would be if Ca2+ dynamics were to be affected, since Ca2+ is the input to the signaling pathways. This may indeed occur from Ih regulation of local excitability. However, in the revision, I have explored parameter sensitivity to four Ca2+ related parameters (Figure 6—figure supplement 1). In particular, LCa density could be varied from 0 to 10 S/m^2 without much effect on the selectivity. Given that even a Ca2+ channel isn’t having much effect, I feel that the omission of Ih is unlikely to change the core results.

5) Subsection “Sequence speed selectivity scales with reaction rates and diffusion constants” – "As expected, we found that as the rates were increased…". Why? As there was not a complete explanation for the 4 models, this 'expectation' suffers here too.

I have added a couple of lines to explain this. Additionally, as discussed above, the four models are explained in much more detail and with new figure panels.

“As expected, scaling all the chemical and diffusion rates also scaled the sequence speed to which the network had the strongest response. As the rates were increased, the best tuning was at shorter time intervals but roughly the same spatial intervals.”

Reviewer #2:

This is an interesting paper dealing with an important topic in computational neuroscience, sequence discrimination. But some important points need to be addressed. I am asking for a little extra work – not an exhaustive analysis – in only one of my comments, comment 1, given that parameter sensitivity analysis is a common, substantial concern in all modeling studies.

Thank you. I have now done some parameter sensitivity analysis as indicated below.

1) Some parameter sensitivity analysis should be done for some of the key results. For example, in Figure 2, rightmost column, it appears that parameter values may be "tuned" to be close to bistability, so that stimuli can give relatively long, but eventually declining, response plateaus.

The ‘switch’ model in the rightmost column is in fact a one-shot, that is, a switch with a delayed turnoff. This is now shown in the schematic in Figure 2B, and also in the new text explaining how the abstract models were developed:

“To the bistable switch system we added inhibitory feedback to restore the switch to baseline after a delay.”

Although, the numbers in the equations above do look pretty generic. Similarly, for Figures 2C and 2D, and other figures that show strong sequence selectivity, how dependent is this selectivity on values of rate constants and other parameters? I'm not asking for an exhaustive analysis, but some degree of analysis and discussion of sensitivity should be given for a few of the key results. For example the sensitivity of the results of Figure 6G, which presents selectivity for the most realistic model, should be discussed.

Thank you for bringing this up, it is a matter that is important and is now systematically addressed. These are in Figure 4—figure supplements 1 and 2 and are described in the following new paragraph:

“To better understand the range of sequence selectivity, we varied each of the parameters of the model one at a time with respect to the reference model. […] These models were intended to be illustrative and to explore the properties of sequence-selective systems. Hence we did not optimize the models for robustness.”

I have also done a smaller parameter sweep for the full cell model, which is not exhaustive because there are a large number of parameters and it would be slow to do a sweep for all parameters (~12 CPU hours each run * 12 sequences * 4 technical repeats * (6 to 8) values per parameter):

“We performed a limited parameter sensitivity analysis for the detailed cell model, focusing on biophysical and biochemical parameters involved in triggering or responding to Ca2+. […] While this list is not exhaustive, it does suggest that the sequence selectivity of the detailed model is fairly robust, and somewhat more so than the abstract models.”

2) The selectivity criterion in Equation 3 cannot be correct as defined. The quantity Q, from Equation 2, is only related to the input, not the response, so Eq. 3 is also not related to the response. But of course selectivity, as plotted in the right column of Figure 3 and later, is related to the response. In Eq. 3, should Q be simply replaced by the average or maximum of the variable A, and in later cases should A be replaced by MAPK-P?

I am sorry about this mistake. I had mistakenly used Q to refer to the variable now called Atot in the text. The reviewer correctly identifies A as the variable in question, and MAPK-P in later figures.

Selectivity = (Asequential – mean(Atot))/max(Atot) Equation 3”

3) In the subsection “Sequence speed selectivity scales with reaction rates and diffusion constants” the author describes how by varying rates he can achieve good sequence selectivity over a broad range of time intervals, and in the Introduction it is noted that such time-invariance is a "desirable feature". But, for a single neuron or dendrite, the rate constants are presumably fixed, or at least do not vary in anticipation of stimulus time scales? So, I don't see how to get time invariance in a single neuron. So then, how does the author envision getting time invariance in a real neural network? Does he envision different neurons in the network will have different parameters so that they will respond to different time scales? These issues should be addressed in the Discussion.

In the Discussion I have added the following paragraph under the heading “Single-cell sequence recognition may act on a continuum of timescales”:

“Individual chemical implementations of sequence recognition in our study operate over a range of about 2-5 microns and 1.5-4 seconds (Figure 4, 6). […] It is interesting to speculate that there may be useful computational implications of having different cells ‘tuned’ to different sequence speeds.”

4) For the channel modulations that underlie the simulations of Figure 7, it is never discussed whether these modulations would result from activation of the MAPK signaling pathway simulated in the rest of the paper. The channel modulations are imposed ad hoc. It would be good to connect these portions of the paper, if not by simulations of MAPK effects on channels, then at least by discussing to what extent some or all of these modulations are thought to be downstream of MAPK activation and are a plausible readout or result of the sequentially amplified activation of the MAPK pathway simulated previously.

I thank the reviewer for this useful suggestion to improve the linkage between the chemical events and the electrical events. I have added text to explain how the simulations were run and how MAPK or other signaling may be upstream of these channel modulations.

“We assumed that MAPK activity, or other signaling events downstream of sequence selective chemistry, could perform channel modulation through phosphorylation or triggering of channel insertion. […] Instead we ran just the electrical cell model for an initial settling period of 1 second, and then used the simulation script to modify the selected channel conductance to represent its modulation. Following this we ran the model for another 3 seconds in each case.”

5) In the Discussion, large numbers are given for how many sequence discriminations a neuron can perform per second and how many sequences a neuron can discriminate. But I am skeptical of these estimates because no discussion is given of what it means operationally for a neuron, a cell, to "discriminate" a sequence. It seems to me that a change in electrical firing rate or spike timing is needed to say a neuron has discriminated a sequence. Or, a change in synaptic plasticity. A transient biochemical response in a dendrite, just by itself, doesn't seem to me sufficient to constitute "discrimination" by the neuron. These caveats should be noted and discussed.

I agree that this discussion should have been related more clearly to the analysis in Figure 7, and to other possible downstream effects of sequence recognition. In order to address this, I have moved the Discussion section “Plasticity is a likely target…” to the first part of the Discussion, and I have renamed and substantially expanded this section to indicate the kinds of outcome one may get from sequence recognition chemistry. It is now headed “Firing change, synaptic plasticity and morphological change may result from biochemical sequence recognition”. This leads into the discussion on “Sequence recognition confers substantial computational capabilities on single cells”. I have further added the following lines to put it in context:

“For simplicity, we consider computation in terms of immediate firing rate changes (discussed above), though plasticity and morphological change are also computational outcomes.”

6) In the Methods, it is stated with regard to the simulations of Figure 7 that we ran the model for 1 second to let the cell settle, before modulating channels. But clarification is needed since 1 second is not enough to allow simulated biochemical pathways to come to equilibrium in the models. Especially in the realistic simulations of Figure 6, how much simulated time was allowed from when biochemical variables were initialized to when stimuli were given.

I agree that this was not explained sufficiently. In the main text I have added a paragraph to explain the procedure:

“We did not simulate these modulation events explicitly since the computations were very lengthy and we wished to perform many repeats to estimate the distribution of the firing rates following channel modulation. Instead we ran just the electrical cell model for an initial settling period of 1 second, and then used the simulation script to modify the selected channel conductance to represent its modulation. Following this we ran the model for another 3 seconds in each case.”

7) Figure 4F and 4G is a particular instance of the sensitivity issue in comment 1. Here a 20% change in stimulus amplitude leads to a very large change in the selectivity pattern. Is this sensitivity of pattern to stimulus amplitude typical for the models?

Please see response to comment 1. Yes, several parameters are quite sensitive.

“We found that selectivity was robust to some parameters, such as diffusion constants, but fragile (range ~20%) with respect to some rate constants and stimulus amplitude. These models were intended to be illustrative and to explore the properties of sequence-selective systems. Hence we did not optimize the models for robustness.”

Reviewer #3:

[…] 1) Though the difference in selectivity is apparent in Figure 3, it is not clear what exactly is being plotted. I understand using R^2, which gives values between 1 (i.e., good) -1 (i.e., bad) for Q if m=1, but I don't understand why add the term m into Q Equation 2.

I apologize for several points of confusion in this section. To address this, I have added two plots to Figure 3 to illustrate how the metric Q works. I have also added some text:

R2 provides a measure of linearity of the sequence, and m assigns it a magnitude and sign. With this measure, the sequence [0,1,2,3,4] has Q = 1; [4,3,2,1,0] has Q = -1, and [4,0,2,1,3] has Q = -0.001. Examples of regression plots used to generate Q for different sequences are presented in Figure 3A, B.”

In addition, why does Equation 3 use Q as the selectivity measure. The first time I read this page, I thought that Q was the selectivity measure. Then, I realized that Q was just a convenient way to obtain a monotonic x axis value, and that the important information was in a graph of A versus Q. But then Equation 3 claims to plot a selectivity value which is a function of Q, not A.

This was an error on my part, and I had used the term Q incorrectly in Equation 3. It is now fixed:

“Selectivity = (Asequential – mean(Atot))/max(Atot) Equation 3”

Provided the system responds more strongly to sequential input than to any other order, selectivity should be in the range from zero (unselective) to one (highly selective). Asequential is Atot for the sequential stimulus, mean(Atot) is the mean of Atot over all permutations of the stimulus order, and max(Atot) is the maximum value of Atot for all permutations of stimulus order.”

A more detailed illustration of how values in Figure 3 are obtained (one value from right side graph and one value from left side graph) would be quite helpful.

I now indicate (using asterisks), which point on the right hand heatmap plot comes from the left hand graph, in Figure 3. I also specify (using crosses) which of the points on the left hand panel in Figure 3 comes from the examples in Figure 2.

Also, where does the temporal interval come into this equation?

For Equation 2 I state: “We plotted the ordinal position of the input against the ordinal value of its arrival time.” So, temporal interval is factored out.

In Equation 3, the temporal and spatial intervals must be supplied to the simulation as control parameters. I have added the line:

“The time and space intervals were specified as parameters for each simulation run.”

2) The results in the subsection “Local dendritic channel modulations may influence cellular firing”, describing the effect of channel modulation need a bit more explanation. In particular, it is quite surprising that an increase in leak conductance would increase firing rate. Since leak channels are typically potassium channels, I would expect an increase in leak conductance to not only make the cell less sensitive to depolarizing current, but also hyperpolarize the branch a bit, unless Eleak is rather depolarized. An intuitive explanation for this result would be helpful.

Thank you for pointing out this source of confusion. I had implemented the leak conductance as a nonselective cation current leak, which reverses close to 0 mV. I now state this explicitly in the text and figure legend. In preliminary calculations I had also played with modulating Ih, the HCN channel, but since its voltage-dependent effects were not incorporated into the cell model I didn’t pursue this.

Also, I don't understand how these manipulations are related to sequence discrimination. Wouldn't these channel modulations change firing rate for all sequences? Or perhaps the neuron can better discriminate the correct from incorrect sequence?

This is an important point that other reviewers have also brought up. I now have new paragraphs in the main text and in the Discussion to explain the intended link between the chemical events of sequence discrimination, and the channel modulation. These are detailed above.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Source code 1. This set of source files is provided to illustrate generation of numerical portions of Figure 2, Figure 5, and Figure 6.

    The contents of the zip file include a README.txt, which has the file information and running instructions. In addition, it has script files for various parts of the figures, as well as model specification files for the chemical channel, and morphological parameters. Files include:

    DOI: http://dx.doi.org/10.7554/eLife.25827.019

    elife-25827-code1.zip (294.4KB, zip)
    DOI: 10.7554/eLife.25827.019
    Supplementary file 1. The supplementary data file specifies chemical reactions and parameters for the MAPK model.

    It also specifies channel equations and parameters for the full cell model used in Figures 6 and 7. Finally, it specifies the channel distributions in the full cell model.

    DOI: http://dx.doi.org/10.7554/eLife.25827.020

    elife-25827-supp1.docx (21KB, docx)
    DOI: 10.7554/eLife.25827.020

    Articles from eLife are provided here courtesy of eLife Sciences Publications, Ltd

    RESOURCES