Abstract
Using a computational model of the Caenorhabditis elegans connectome dynamics, we show that proprioceptive feedback is necessary for sustained dynamic responses to external input. This is consistent with the lack of biophysical evidence for a central pattern generator, and recent experimental evidence that proprioception drives locomotion. The low-dimensional functional response of the Caenorhabditis elegans network of neurons to proprioception-like feedback is optimized by input of specific spatial wavelengths which correspond to the spatial scale of real body shape dynamics. Furthermore, we find that the motor subcircuit of the network is responsible for regulating this response, in agreement with experimental expectations. To explore how the connectomic dynamics produces the observed two-mode, oscillatory limit cycle behavior from a static fixed point, we probe the fixed point’s low-dimensional structure using Dynamic Mode Decomposition. This reveals that the nonlinear network dynamics encode six clusters of dynamic modes, with timescales spanning three orders of magnitude. Two of these six dynamic mode clusters correspond to previously-discovered behavioral modes related to locomotion. These dynamic modes and their timescales are encoded by the network’s degree distribution and specific connectivity. This suggests that behavioral dynamics are partially encoded within the connectome itself, the connectivity of which facilitates proprioceptive control.
Author Summary
The nematode C. elegans lives a complex and rich life despite having only 302 neurons. The full connectivity between these neurons (its “connectome”) has been measured, making it an ideal model system for understanding how neural processing generates behavior. However, unlike most animals, it doesn’t appear to have neural circuits dedicated to generating rhythmic motion. Even the simple rhythmic behavior of forward locomotion is believed to be ultimately driven by stretch-receptive proprioception as the worm changes body shape. Computational models of connectome dynamics can capture behavioral responses, making them valuable for studying neural dynamics. We consider a model of the full-connectome dynamics which, without external input, is in a static neural state. We show that proprioception-like input can bring the system into a rhythmic state similar to locomotion. We then show that arbitrary external inputs across all neurons can only excite some combination of six neural patterns, and that the shape and dynamics of these patterns are determined by the connectome. Furthermore, two of these patterns correspond to forward locomotion, such that the connectome facilitates locomotion-like responses. We thus find that the connectome itself is not random, but is ideally tuned for generating behavior.
Introduction
The exact process through which the nematode Caenorhabditis elegans (C. elegans) generates the rhythmic activity necessary for locomotion remains unclear [1]. In many other species, a Central Pattern Generator (CPG) is typically the source of rhythmic activity [2–6]. There is insufficient experimental evidence to support the existence of a CPG in the C. elegans neuronal network [7, 8]. Experimental and computational evidence shows that proprioception within motorneurons plays an important role in driving and modulating forward locomotion [9, 10], and it has been hypothesized that this proprioceptive feedback is what ultimately generates rhythmic locomotion [10], rather than any dedicated circuitry in the neuronal network. Using a computational model for the connectome dynamics of C. elegans [11], we provide strong theoretical and computational support, through the emerging method of dynamic mode decomposition, for the hypothesis that proprioception within motorneurons does indeed encode and drive rhythmic activity.
Critical to assessing how sustained, low-dimensional dynamic activity is generated, is understanding the role the network’s connectivity graph (its “connectome”) plays in generating rhythmic motion. The structure of a neuronal network’s connectivity often determines how the network operates as a whole [12, 13], encoding key behavioral responses characterized by low-dimensional patterns of activity [14–19]. However, the exact importance of the specific connectivity of a network is unclear, and neuronal network dynamics are often computationally modeled using uniform random networks [20–27]. In C. elegans, however, the structure of the connectome is clearly not random, and it may further play a critical role in helping to generate or facilitate rhythmic responses. This is suggested by the fact that computational models of the connectome can generate motorneuron oscillations related to forward locomotion in response to constant stimuli even without proprioception (and even when modeling neural dynamics alone, with no coupled muscular, bodily or environmental modeling) [11]. This suggests that oscillatory, stereotyped responses are, at some level, encoded within the connectome.
There is, however, an important caveat to this result: oscillatory output occurs only due to an unrealistic stimulus, consisting of a constant input into the tail-touch mechanoreceptor sensory neuron pair PLM (i.e. the touch-receptive posterior lateral microtubule cells) [28]. In the absence of constant stimulus, the neural state will collapse onto a static, stable fixed point, i.e. a state of no movement. This is illustrated in Panel (A) of Fig 1. This is clearly not realistic; the actual worm is not constantly receiving tail-touch stimulus during every moment at which it crawls forward. As illustrated in Panel (B), the system will quickly decay back to static equilibrium after any random stimulus. A more realistic response to an impulse may perhaps look more like Panel (C): if the worm is in a pause state, a momentary stimulus should be capable of driving it into sustained motion. This lack of sustained oscillation can be explained by the model’s lack of feedback, specifically by the lack of stretch-receptive proprioception within B-class motorneurons, which is known to drive and regulate locomotion [9].
This study thus considers the following questions about the model in [11]: Is it consistent with a framework of proprioception-driven locomotion? If so, do the low-dimensional output patterns encoded by the connectome facilitate proprioceptive control? In other words, does the system’s equilibrium have a low-dimensional dynamical structure which facilitates responses related to locomotion?
In this manuscript, we demonstrate that proprioceptive feedback is indeed necessary and sufficient for sustained dynamic responses to external input. This is consistent with the lack of biophysical evidence for a central pattern generator driving locomotion, and the evidence that proprioception drives locomotion. Explicitly, we use the spatial location of specific motorneurons to drive them with a sinusoidal traveling wave, approximating strech-receptive proprioception during locomotion. The functional response of the network to this proprioception-like input is optimized by specific spatial wavelengths, specifically optimal locomotion responses are driven by input with spatial scales consistent with C. elegans body shape dynamics, i.e. eigenworm-like structures [29]. We then repeat this investigation for perturbed networks, including a modification in which all but the experimentally-characterized locomotion subcircuit is ablated. This reveals that the motor subcircuit alone generates a functional response nearly identical to that of the full connectome. However, we find that the locomotory motorneurons are not by themselves sufficient, and that locomotory interneurons are crucial to regulating the response, even though they are not stimulated directly.
By applying Dynamic Mode Decomposition to the network data, we discover that the dynamics encode six clusters of dynamic modes with timescales spanning three orders of magnitude. Two of these six dynamic mode clusters correspond to previously-discovered behavioral modes related to locomotion. The dynamic modes and timescales are encoded by the network’s degree distribution and specific connectivity. This suggests that behavioral dynamics are partially encoded within the connectome itself, the connectivity of which facilitates proprioceptive control. Thus our results suggest a framework in which the neural network is not the source of spontaneous oscillation, but rather is structured to facilitate specific proprioception-driven oscillation responses. More broadly, our application of Dynamic Mode Decomposition to network dynamics demonstrates its utility at discovering, from activity data alone, the responses which a network may be encoded to promote or inhibit.
Results
Perturbation Response and Dynamic Modes
Given the lack of evidence for a CPG within the network, it is interesting that the system is able to generate oscillation in response to a non-oscillatory input, and that this oscillation appears related to locomotion [11]. However, it is clearly unrealistic that such oscillation would require a constant, explicit external input, and would otherwise collapse to a fixed point (i.e. a static neural pattern). The dynamical structure of this fixed point, from which we wish to drive the system into sustained oscillatory motion, can be investigated through impulse-response experiments.
In each of 100 separate trials, we model the dynamics of the full somatic nervous system of 279 neurons (where there are 302 neurons total, 282 within the somatic nervous system, and 279 of those which make synaptic connections [30]). We perturbed the system from equilibrium with a short stimulus distributed randomly across all 279 neurons. The system was then allowed to freely decay back to the fixed point, and the decaying neuron voltages were recorded (providing data as shown in Fig 2). We observed that, in all trials, the system decayed back to the same fixed point regardless of input stimulus.
We find that these dynamics are well-described by a few modes (i.e. specific spatial patterns of neural activation), each of which decay exponentially bringing the system back to the fixed point. Applying Dynamic Mode Decomposition to the data gives us both these spatial modes and their decay time constants. Interestingly, we find the following: (1) in all trials the dynamics are well-described by only six modes, (2) DMD gives approximately the same six modes regardless of the random stimulus direction, and (3) the time constants of the modes are well-separated and span three orders of magnitude. Examples of DMD modes and the spatial information which they contain are shown in Fig 2.
These modes can be interpreted as the components of a low-dimensional manifold to which the dynamics are constrained around the fixed point. In other words, an arbitrary stimulus into all 279 neurons can effectively only excite some combination of these six neural patterns. This is what we mean by the fixed point having “low-dimensional structure”.
Relation of Dynamic Modes to Forward Motion
How does this low-dimensional structure relate to the previously-observed, locomotion-like oscillatory response? To answer this, we note that the PLM response in [11] is characterized by three modes (the “PLM modes”, which define the spatial activity patterns implicated in this response): (1, 2) the two modes defining the plane in which the limit cycle proceeds (the “PLM plane”), which we call the “plane modes”, and (3) the displacement between the equilibrium fixed point and the center of the limit cycle, which we call the “displacement mode”. These modes and their relation to the fixed point and limit cycle are depicted in the “Phase-Plane Dynamics” illustration of Fig 3.
We investigate the biological meaning of our dynamic modes by calculating their projections onto the PLM modes. This reveals that two of the six dynamic modes correspond to previously-discovered PLM modes. These projection values quantify the similarity between the spatial patterns of the previously-discovered, physiologically meaningful PLM modes and the DMD modes which we inferred from our random impulse trials. Fig 4 shows the magnitude of each dynamic mode’s projection onto the displacement mode and PLM plane. Corresponding numerical values are given in Tables 1, 2 and 3. We compare these against the projections of 1,000 random modes. Both the displacement mode and the PLM Plane have a single dynamic mode projecting strongly onto them. Therefore the low-dimensional structure of the fixed point facilitates responses in both the displacement mode and PLM Plane directions, with a highly distinct timescale for each response.
Table 1.
τ | Upper | 75th Pct. | Median | 25th Pct. | Lower | Spread |
---|---|---|---|---|---|---|
Mode 1 | 0.00067 | 0.00057 | 0.00052 | 0.00048 | 0.00039 | 27.6% |
Mode 2 | 0.00172 | 0.00159 | 0.00151 | 0.00146 | 0.00128 | 14.6% |
Mode 3 | 0.00489 | 0.00466 | 0.00455 | 0.00445 | 0.00412 | 8.5% |
Mode 4 | 0.00920 | 0.00886 | 0.00872 | 0.00856 | 0.00822 | 5.6% |
Mode 5 | 0.03065 | 0.02816 | 0.02681 | 0.02568 | 0.02264 | 14.9% |
Mode 6 | 0.09705 | 0.09324 | 0.09094 | 0.08736 | 0.08126 | 8.7% |
Numerical values of the timescales in Fig 4. The consistency of timescales resulting from different trials is given by the “spread”, calculated as (Upper − Lower)/(2 × Median).
Table 2.
Disp. | Upper | 75th Pct. | Median | 25th Pct. | Lower |
---|---|---|---|---|---|
Mode 1 | 0.03858 | 0.01996 | 0.01178 | 0.00597 | 0.00043 |
Mode 2 | 0.06829 | 0.03442 | 0.02325 | 0.01089 | 0.00120 |
Mode 3 | 0.05698 | 0.03109 | 0.01701 | 0.00717 | 0.00021 |
Mode 4 | 0.32392 | 0.28287 | 0.26850 | 0.25110 | 0.21387 |
Mode 5 | 0.02002 | 0.01063 | 0.00514 | 0.00204 | 0.00013 |
Mode 6 | 0.01659 | 0.00891 | 0.00507 | 0.00248 | 0.00017 |
Random | 0.13578 | 0.06584 | 0.03813 | 0.01850 | 0.00012 |
Numerical values of the Displacement Mode Projections in Fig 4.
Table 3.
Plane | Upper | 75th Pct. | Median | 25th Pct. | Lower |
---|---|---|---|---|---|
Mode 1 | 0.07575 | 0.04464 | 0.03250 | 0.02130 | 0.00117 |
Mode 2 | 0.15038 | 0.10588 | 0.08901 | 0.06892 | 0.02930 |
Mode 3 | 0.36243 | 0.31583 | 0.30094 | 0.27032 | 0.21088 |
Mode 4 | 0.15740 | 0.13069 | 0.11906 | 0.10745 | 0.09184 |
Mode 5 | 0.04889 | 0.03529 | 0.02791 | 0.02014 | 0.00476 |
Mode 6 | 0.02739 | 0.01454 | 0.00976 | 0.00588 | 0.00021 |
Random | 0.18629 | 0.10235 | 0.07133 | 0.04601 | 0.00214 |
Numerical values of the PLM Plane Projection in Fig 4.
Mode 4, which projects strongly onto the displacement mode, is particularly interesting. It has the most consistent timescale between trials (see Table 1). Additionally, all other dynamic modes have a particularly low projection onto the displacement mode (i.e. a significantly lower median projection than random modes). This suggests that the low-dimensional structure of the fixed point facilitates responses in that direction with a particularly consistent timescale. Thus periodic perturbations of the correct timescale could perturb the system off of the fixed point in the direction of the limit cycle; we discuss these implications further in the Discussion.
Dynamic Modes Result from Connectivity
The role of the connectome, the experimentally validated network connectivity, was investigated by repeating the perturbation experiments but with randomly changed network connectivities. We considered the following variations: (A) a network with the same degree distribution, with node degrees and connections randomly assigned; (B) random connectivity with the same total number of edges.
Results from these cases are summarized in Fig 5. In (A), where the degree distribution is maintained, there are still six modes. However, timescales vary somewhat from the original, and the projections are completely changed. In (B), which has a different degree distribution, the number of modes and all of their properties are qualitatively different. This establishes that the dynamic modes and timescales are encoded by both the network’s degree distribution and specific connectivity.
Driven Oscillatory Response
We have established that random impulses can drive the system in the direction of the displacement mode. However, given the apparent global stability of the fixed point, an additional mechanism is required for sustained dynamic responses to external input. Proprioception may allow initial perturbations to grow into the desired limit cycle associated, for instance, with forward motion.
We thus investigated the following question: could stretch-receptive proprioceptive feedback within B-class motorneurons give rise to motorneuron oscillations which are qualitatively similar to PLM-driven oscillations? Since locomotion consists approximately of sinusoidal bends propagating along the body [31, 32], it suffices to drive B-class motorneurons with sinusoidal inputs, as determined by their location along the axis of the body and their position on the dorsal/ventral side (noting that the C. elegans lays on its side while it crawls [32]).
Fig 6 shows the motorneuron dynamics resulting from different sinusoidal inputs into B-class motorneurons. For certain spatial wavelengths, a limit cycle does occur which is qualitatively similar on the PLM plane. Note that there is a smooth transition between the rows of Fig 6, and that the middle row is the most similar to the PLM-driven cycle (as quantified by the Procrustes distance, a measure of shape similarity used more extensively later in the text). This middle row corresponds to a spatial driving wavenumber of k = 0.886 or, equivalently, a spatial driving wavelength (per unit body-length) of λ/L = 1/0.886 = 1.13. This value lies well within the range of body-shape wavelengths which, depending on the resistance of the environment, are seen to fall into the range λ/L ∈ (0.5, 1.75) (specifically, see Fig 1(e) of [33]). Note that the variation within this range depends directly upon the environmental resistance, which is not included within our model.
Temporal frequency did not have an effect on the shape of the limit cycle, consistent with the experimental observations that the spatial wavelength of C. elegans locomotion does not depend on temporal frequency [32]. As discussed further in the Discussion, this suggests that our model, if integrated with a mechanical body model in future work, could be made consistent with a system of feedback-driven oscillations.
Driven Response on Isolated Subcircuits
An advantage of a full-connectome modeling approach is that it readily enables simulated ablation experiments, in which we may simulate the network with an arbitrary subset of neurons removed. Physiologically, we expect that the response to driving the B-class motorneurons should depend not only upon the neurons which are being driven directly, but also upon associated neurons within the subcircuit of the connectome regulating locomotion, as described in [28, 34–37] and pictured in Fig 7(A). We therefore demonstrate that the experimentally-characterized locomotion subcircuit is, by itself, sufficient to reproduce these results. Furthermore, we elucidate the roles of each of its components.
We therefore investigate the following questions: is the experimentally-characterized locomotion subcircuit by itself sufficient to reproduce these results? If so, what is the relative contribution of its different components?
Fig 7(B) shows the PLM-Plane cycle in response to sinusoidal driving of B-class motorneurons, as in Fig 6 (using a driving wavenumber k = 0.886). In addition to calculating this response using the full Connectome, we repeat this simulation with various portions of the network ablated: (1) with all neurons ablated except for the locomotion subcircuit; (2) keeping only the locomotory inter-and motorneurons; (3) keeping only the locomotory motorneurons. We observe that the locomotion subcircuit alone, with the rest of the connectome ablated, reproduces a nearly identical cycle shape. Similarly, when only locomotion inter- and motorneurons are included, the cycle is minimally distorted. However, ablating the locomotory interneurons causes considerable distortion of the cycle, despite the fact that these neurons are not driven directly. Thus we find that these interneurons are crucial in regulating the driven response, which is consistent with evidence for the role of these interneurons in locomotion [28, 36].
We can quantify the degree to which the cycle is distorted by taking the full connectome’s cycle and the ablated connectome’s cycle and computing their Procrustes distance (a measure from statistical shape analysis which increases as the cycle shapes become increasingly dissimilar). The Procrustes Distance (P.D.) of each cycle appears in Fig 7(B), below each distorted cycle. We further used this to calculate the amount of cycle distortion when each individual component of the locomotory circuit was ablated from the full connectome, allowing for the assessment in each neuron’s relative importance in regulating the response. The individual ablations leading to the highest degree of distortion are included in Fig 7(C). Notably, this identifies neurons known to be crucial for the worm’s locomotion ability: experimentally ablating AVB and DVA, for example, are each known to cause significantly distorted forward locomotion [28, 36].
Discussion
In this manuscript, we have introduced the Dynamic Mode Decomposition as a diagnostic tool to characterize impulse-response experiments on a nonlinear networked system. This revealed that the network is structured to generate a low-dimensional response at distinct timescales ranging over several orders of magnitude, and that two of these dynamic modes are related to the previously-characterized “forward motion” response to PLM-stimulation. It is possible that proprioceptive feedback could sustain a limit cycle but not be sufficient to bring the system to said limit cycle from the equilibrium fixed point. In other words, the limit cycle would need to be “jumpstarted”, with a separate mechanism transporting the system from the fixed point near to the cycle. Were this the case, it would suggest a physiological purpose for the low-dimensional fixed-point structure which we detect: stimuli of the correct timescales could selectively perturb the system towards the limit cycle, to a point from which the proprioceptive feedback could be effective. In this view, it is interesting and suggestive that Mode 4, associated with the Displacement Mode, has the most tightly-constrained timescales of all the modes.
Repeating this analysis for different connectivities suggested that these dynamic modes and timescales are encoded by both the network’s degree distribution and specific connectivity. A random graph, with the same number of nodes and connections but a different degree distribution, leads to a completely different number of modes. This suggests that the number of dynamical timescales is encoded by the degree distribution, as six timescales are recovered for any network with the same degree distribution. However, the specific timescale values and the neuronal makeup of these modes is not preserved. The degree to which each mode projects onto our biophysiologically-relevant directions, and with what specific dynamical timescale, depends on the specific wiring of the connectome. Thus behavioral dynamics are partially encoded within the connectome itself, the connectivity of which facilitates proprioceptive control. Said another way, the stereotyped worm connectome seems to be optimized for its behavioral repertoire.
The usefulness of these insights as they apply to the actual system, however, depend on the model’s compatibility with a framework of proprioception-generated oscillation. Thus we further show that sinusoidal input into the putatively proprioceptive B-class motorneurons does, indeed, drive a limit cycle at certain spatial wavelengths, consistent with the spatial wavelengths seen experimentally. Given that the worm crawls with a sinusoidal body shape [31, 32], this suggests that motorneuron proprioception could indeed drive the limit cycle, which in turn could drive sinusoidal movement. A proprioceptive mechanism such as this is necessary for sustained dynamic responses to external input. Furthermore, we showed that the motor subcircuit alone is capable of sustaining these results, and that this circuit’s interneurons are crucial to regulating the response despite not being driven directly. Indeed, we found that the interneurons which were most important to regulating the response within our simulation were those which have been shown to have this exact role experimentally. Despite this apparent consistency, the development of such a feedback rule remains nontrivial. Without a coupled biomechanical model that includes muscle activation, any feedback rule which we might implement on the present model would be no less artificial than our direct sinusoidal stimulus, which is biophysiologically reasonable.
However, modeling the worm’s body and environment is ultimately crucial to fully understanding its behavior [7, 10, 33, 38–40]. This study prescribes multiple studies for future computational connectome models which are fully integrated with biomechanical body and environmental models (as exemplified by projects such as OpenWorm [41]). Specifically, it introduces the following questions: (1) When motorneuron proprioception and other external feedback is turned off within a model, does the system decay into a fixed point? If so, an identical study can be performed to probe that fixed point’s low-dimensional structure. (2) Do the dynamic modes relate to the oscillatory dynamics which occur during locomotion? (3) If proprioception/feedback is turned back on while the system is in its fixed point, does the system proceed into a spontaneous limit cycle, and if so, how? Is periodic noise or other stimulation of a specific timescale necessary for such a transition?
More broadly, this work demonstrates the utility of Dynamic Mode Decomposition in relating the specific connectivity of a network to the multi-scale, low-dimensional structure of its dynamical responses. The methods of this manuscript are able to directly relate connectivity to dynamics even for large, nonlinear networked systems. Future work will further investigate this relationship, with implications for the design of nonlinear networks.
Methods
Modeling the C. elegans Connectome
Our model for the C. elegans simulates the neuronal dynamics of its full connectome, as obtained from [30]. This network consists of the 279 somatic neurons which make synaptic connections. Between these neurons, there are 6393 synaptic connections and 890 gap junctions, and the connectivity between neurons cannot be considered sparse. Further details on the network’s structural properties are available in [30], and further information, including about putative functions of individual neurons, is collected within WormAtlas [42].
Experiments show that many neurons in the organism are effectively isopotential, such that membrane voltage is a meaningful state variable [43]. Wicks et al. constructed a single-compartment membrane model for neuron dynamics [44], which we later adapted to incorporate recent connectomic data [11]. We assume that the membrane voltage dynamics of neuron i is governed by:
(1) |
The parameter Ci represents the whole-cell membrane capacitance, the membrane leakage conductance and Ecell the leakage potential of neuron i. The external input current is given by . Neural interaction via gap junctions and synapses are modeled by the input currents (gap) and (synaptic). Their equations are given by:
(2) |
(3) |
We treat gap junctions between neurons i and j as ohmic resistances with total conductivity . We assume that is also modulated by a synaptic activity variable si, which is governed by
(4) |
Here ar and ad correspond to growth and decay time, and ϕ is the sigmoid function ϕ(vi;κ, vth) = 1/(1 + exp(−β(vi − vth))).
Simulations were performed in MATLAB via Euler’s method, using timesteps of h = 10−6s. The data was downsampled by recording v(t) every Δt = 3 × 10−5s, yielding a data matrix:
(5) |
where tk+1 − tk = Δt. The value of Δt was chosen to be sufficiently low so as to not affect the outcome of the analysis.
Model Parameters
We keep all parameter values from [11]. The number of gap junctions and number of synapses Nijs are taken from the large component of the full connectome, i.e. the 279 neurons as considered in Varshney, et al. [30]. Each individual synapse and gap junction is assigned an equal conductivity of g = 100pS (such that and ). The values of cell membrane conductance and capacitance are Gc = 10pS and C = 1pF. The synaptic growth and decay constants are kept as ar = 1 s−1 and ad = 5 s−1. All neurons are modeled as identical except for their connectivity and the assignment of them as excitatory or inhibitory (where Ej will have one of two values corresponding to these classes).
Random Perturbations
For each random perturbation simulation, a random external input IExt was applied to all neurons for a duration of 10−5s, after which the system was allowed to decay. Output was recorded from all neurons after the cessation of input. Each was drawn from a Gaussian distribution, after which the total IExt was then normalized to have a fixed total input amplitude of |IExt| = 10mA.
Dynamic Mode Decomposition
This section describes the method of Dynamic Mode Decomposition [45–52], which we apply to our simulated neural voltage data V. Specifically, we use it to relate the voltages at timestep tk to the following timestep tk+1 as follows:
(6) |
where is the linear operator which is the best-fit solution for all pairs. Note that this does not imply that the underlying dynamics are linear; DMD is connected to nonlinear dynamical systems through the Koopman operator [50]. We can express this relationship in matrix form by constructing two data matrices and as follows:
(7) |
(8) |
This allows us to write Eq (6) as:
(9) |
The dynamic mode decomposition of the data matrices (X, X′) is given by the leading eigendecomposition of the matrix A, which is defined as follows:
(10) |
where † denotes the Moore-Penrose pseudoinverse [47]. The pseudoinverse of X can be found by calculating its singular value decomposition, truncated at r singular values:
(11) |
Here * denotes the complex conjugate transpose, and are matrices with orthonormal columns, and is diagonal. The diagonal entries of Σ are the singular values, and are proportional to the percentage of energy within each mode. We choose the smallest set of r modes which capture 99% of the energy.
We can thus approximate the linear operator A as follows:
(12) |
We are interested in the dynamics projected upon the lower-dimensional subspace as defined by the first r columns of . Rather than calculating the n × n matrix , we project onto the low-dimensional subspace to calculate the r × r reduced order operator :
(13) |
The eigendecomposition gives the eigenvectors wj and eigenvalues λj of the reduced-order system. The eigenvalues are equal to those of the full-dimensional , and the corresponding eigenvectors can be used to exactly calculate the full-dimensional dynamic modes of the system [47]. For λj ≠ 0, the dynamic mode corresponding to wj is:
(14) |
The DMD modes take the eigenvectors of the reduced-order system and project them back to the full-dimensional space. In our system, this means that a dynamic mode ϕj will be a vector of length 279, with each element corresponding to the relative activation of a neuron within each mode. Since these dynamic modes correspond to the eigenvectors of the low-dimensional system, the modes give the dynamically-decoupled low-dimensional patterns which will exponentially grow/decay and/or oscillate with timescales given by their respective eigenvalues λj. The state of the system just after perturbation may be written in terms of these modes:
(15) |
After k timesteps Δt = tk+1 − tk, the system will then be within the state:
(16) |
We can also write the solution for an arbitrary time t as:
(17) |
The continuous decay constant τj can be directly calculated from the DMD eigenvalue as follows:
(18) |
In general, τj may be complex with any sign. Clearly, Re(τj) > 0 will lead to exponential decay, Re(τj) < 0 will lead to exponential growth, and Im(τj) ≠ 0 will lead to oscillation. For all trials within this manuscript, however, the resulting τj values were seen to be positive and real, due to the dynamics of the dataset being well described by non-oscillatory decay.
Dynamic Mode Properties
The properties of the resultant modes are summarized in the boxplots of Figs 4 and 5. These were generated from MATLAB function boxplot.m. Default settings are used in Fig 4, and in Fig 5 the settings are changed such that no points are treated are outliers.
The PLM modes are calculated by taking the singular value decomposition of the PLM-driven limit cycle, as in [11]). The PLM modes include the displacement mode d and plane modes p1, p2, as illustrated in Fig 3. Each of these modes are a vector of length 279, with each element corresponding to the relative activation of a neuron’s membrane voltage. Each represents a neural pattern which is dynamically active which the system while it is in the PLM-driven limit cycle, which is argued in [11] to represent a neural proxy for forward locomotion.
The projection metrics are defined as the projections of each dynamic mode vector ϕi onto the displacement mode vector d and onto the PLM Plane {p1, p2}. Specifically:
(19) |
(20) |
The random projections in Fig 4 are calculated similarly, but using a randomly-generated mode in place of an actual DMD mode. For each random mode, each element is chosen from a Gaussian distribution and the mode is then normalized.
Altered Connectomes
We repeated our Dynamic Mode Decomposition analysis for altered networks with (A) the same degree distribution, but altered specific connectivity, and (B) random graphs with the same total number of connections. For both cases, we generated 5 distinct altered networks, for which we performed 10 impulse-response trials each. We calculated the DMD results (decay constants τ and displacement mode/PLM plane projections) for each set of trials. Thus for both (A) and (B) we obtained 5 sets of 10 τ/projection values each, each set corresponding to a different altered network. Fig 3 plots the distributions of results for all altered networks of a given type (i.e. plotting all 50 values for each mode).
All altered connectomes with the same degree distribution, in all of their random-impulse response trials, yield six dynamic modes, as shown in Fig 3(A). This is the same number modes as is produced by the standard connectome, and thus the distributions of τ and projection values may be directly compared. We wish to determine if the results which we obtain from the altered connectome are statistically different from those which we obtain from the standard connectome. For each of the 5 altered connectomes, we compare the altered and standard τ/projection distributions using the two-sample Kolmogorov-Smirnov test, with the null hypothesis that they are from the same distribution (computed in MATLAB using the built-in function kstest2.m). The maximum p-values for each distribution from the set of tests is shown in Table 4. At a significance level of p = 0.05, we can conclude that altering the specific connectivity alters the following results: the τ values of Modes 2, 3, 4, 5 and 6; the displacement mode projections of Modes 4, 5 and 6; and the plane mode projections of Modes 3, 4 and 6.
Table 4.
Maximum p-Values | τ Dists. | Disp. Dists. | Plane Dists. |
---|---|---|---|
Mode 1 | 0.2885 | 0.9987 | 0.8608 |
Mode 2 | 0.0004 | 0.2233 | 0.9590 |
Mode 3 | 1.796 × 10−5 | 0.289 | 8.126 × 10−9 |
Mode 4 | 1.776 × 10−8 | 3.663 × 10−9 | 8.126 × 10−9 |
Mode 5 | 5.120 × 10−6 | 0.0070 | 0.0938 |
Mode 6 | 0.0107 | 0.0131 | 0.0107 |
Maximum p-values, for the null hypothesis that the τ/projection values for the Altered Connectomes in Fig 3(A) are from the same distribution as those for the Standard Connectome. Specifically, we compare the two distributions using the two-sample Kolmogorov-Smirnov test. At the p = 0.05 level we can conclude that the following distributions are significantly different after changing the specific connectivity: the τ values of Modes 2, 3, 4, 5 and 6; the displacement mode projections of Modes 4, 5 and 6; and the plane mode projections of Modes 3, 4 and 6.
All of the random graphs, in all of their trials, yielded four dynamic modes, as shown in Fig 3(B). As is apparent in the Fig, Mode 3 is notable for having very consistent projection values onto each mode. Note, however, that this mode is trivial: it is simply equal for all nodes (i.e. it is the vector for each of the i ∈ (1, 279) neurons). This mode, though trivial, will have a higher projection value than will sparser modes which select the “wrong” neurons.
Sinusoidal Driving of B-Class Motorneurons
In approximating proprioceptive input, we sinusoidally drove all B-class motorneurons, using an external input of the following form:
(21) |
Input sign was given based on the dorsal/ventral location of the motorneuron. Input amplitude A affected only the amplitude of the cycle and was set at A = 30 Arb. Units to yield a qualitatively similar cycle amplitude. Temporal frequency ω appeared to affect the response only by changing the cycle period. Spatial wavelength k varied between trials (as shown in Fig 6). x was assigned to each neuron based on its soma position.
Soma position data originates from [30], and was retrieved from the “Neuronal Wiring” section of WormAtlas [42]. The use of the soma position is a simplification: proprioception in B-class motorneurons is believed to be due to stretch reception within the long axons posterior to the soma [9].
The plane dynamics plotted in Figs 6 and 7 were calculated by taking the projection of the full-dimensional dynamics v(t) onto the plane modes p1 and p2. This gives the cycle dynamics projected into the low-dimensional space, as in [11].
Regulation of Driven Cycle by Subcircuits
We also calculated the response to sinusoidal driving of B-class motorneurons for networks with various neurons removed. We were particularly interested in the role of the motor subcircuit in regulating the response. As in [34], we take the following neuron groups as comprising the motor circuit:
Motor Circuit Sensory Neurons: ALM, AVM, PLM
Motor Circuit Interneurons: AVA, AVB, AVD, AVE, ASH, AQR, DVA, PVC, PQR
Motor Circuit Motorneurons: DA, DB, DD, VA, VB, VD
“Simulated ablation” of a neuron is done similarly to how it was performed in [11], i.e. by simply removing the connections of selected neurons. In other words, we use the same model, with the connectivity data altered such that:
(22) |
Specifically, we calculate the driven limit cycle response, projected onto the PLM plane, for the following ablation sets:
Ablating all neurons except those in the motor circuit
Ablating all neurons except interneurons and motorneurons in the motor circuit
Ablating all neurons except motorneurons in the motor circuit
Ablating all neuron groups in the motor circuit individually (except for B-class motorneurons)
Procrustes Measure of Cycle Similarity
Procrustes Distance (PD) measures the dissimilarity between shapes, and we use it to quantify the similarity between the shapes of the limit cycles pre- and post-ablation. We use the function procrustes.m from MATLAB’s Statistics and Machine Learning Toolbox. We collect N data points from each trajectory and annotate their (x, y) coordinates in a (2 × N) shape matrix S. The PD between two distinct shapes SA and SB is then given by
(23) |
In other words, it finds the optimal (2D) rotation matrix R, scaling factor b > 0, and translation vector to minimize the sum of the squares of the distances between all points. Intuitively, it compares the shapes of the cycles while ignoring any translation, rotation, or scaling. Note that trajectories must be pre-processed to extract data points for a single period of the cycle. Cycles are also interpolated using MATLAB’s spline.m function to ensure that they have the same number of data points. Both limit cycles must also be phase-aligned, which we achieve by finding the relative phase that minimizes the Procrustes Distance. This results in a score which increases as the post-ablation cycle becomes increasingly dissimilar in shape to the pre-ablation cycle.
Acknowledgments
JLP thanks Bill and Melinda Gates for their active support of the Institute for Disease Modeling.
Data Availability
The Connectome data used within our model is available from Varshney et al, 2011 (http://dx.doi.org/10.1371/journal.pcbi.1001066). All other relevant information is included within the paper.
Funding Statement
SLB acknowledges support from the U.S. Air Force Center of Excellence on Nature Inspired Flight Technologies and Ideas (FA9550-14-1-0398, http://nifti.washington.edu/). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1. Gjorgjieva J, Biron D, Haspel G. Neurobiology of Caenorhabditis elegans Locomotion: Where Do We Stand? BioScience. 2014;64(6):476–486. 10.1093/biosci/biu058 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Brown T. The intrinsic factors in the act of progression in the mammal. Proc R Soc Lond B Biol Sci. 1911; 84(572): 308–319. 10.1098/rspb.1911.0077 [DOI] [Google Scholar]
- 3. Delcomyn F. Neural basis of rhythmic behavior in animals. Science. 1980;210:492–498. 10.1126/science.7423199 [DOI] [PubMed] [Google Scholar]
- 4. Marder E, Calabrese R. Principles of rhythmic motor pattern generation. Physiological Reviews. 1996;76:687–717. [DOI] [PubMed] [Google Scholar]
- 5. Mullins O, Hackett J, Buchanan J, Friesen W. Neuronal control of swimming behavior: Comparison of vertebrate and invertebrate model systems. Progress in Neurobiology. 2011;93:244–269. 10.1016/j.pneurobio.2010.11.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Marder E. Motor pattern generation. Current Opinion in Neurobiology. 2000;10:691–698. 10.1016/S0959-4388(00)00157-4 [DOI] [PubMed] [Google Scholar]
- 7. Niebur E, Erdos P. Theory of the locomotion of nematodes: Control of the somatic motor neurons by interneurons. Mathematical Biosciences. 1993;118:51–82. 10.1016/0025-5564(93)90033-7 [DOI] [PubMed] [Google Scholar]
- 8. Cohen N, Sanders T. Nematode locomotion: dissecting the neuronal-environmental loop. Curr Opin Neurobiol. 2014;25:99–106. [DOI] [PubMed] [Google Scholar]
- 9. Wen Q, Po M, Hulme E, Chen S, Liu X, Kwok S, et al. Proprioceptive coupling within motor neurons drives C. elegans forward locomotion. Neuron. 2012;76:750–761. 10.1016/j.neuron.2012.08.039 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Boyle J, Berri S, Cohen N. Gait Modulation in C. elegans: An Integrated Neuromechanical Model. Frontiers in Computational Neuroscience. 2012;6:10 10.3389/fncom.2012.00010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Kunert J, Schlizerman E, Kutz J. Low-dimensional functionality of complex network dynamics: Neuro-sensory integration in the Caenorhabditis elegans Connectome. Phys Rev E. 2014;89:052805 10.1103/PhysRevE.89.052805 [DOI] [PubMed] [Google Scholar]
- 12. Watts D, Strogatz S. Collective dynamics of small-world networks. Nature. 1998;393(6684):440–442. 10.1038/30918 [DOI] [PubMed] [Google Scholar]
- 13. Park H, Friston K. Structural and functional brain networks: From connections to cognition. Science. 2013;342:1238411 10.1126/science.1238411 [DOI] [PubMed] [Google Scholar]
- 14. Broome B, Jayaraman V, Laurent G. Encoding and decoding of overlapping odor sequences. Neuron. 2006;51(4):467–482. 10.1016/j.neuron.2006.07.018 [DOI] [PubMed] [Google Scholar]
- 15. Byron M, Cunningham J, Santhanam G, Ryu S, Shenoy K, Sahani M. Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity. Adv Neural Inform Process Syst. 2009; p. 1881–1888. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Churchland M, Cunningham J, Kaufman M, Foster J, Nuyujukian P, Ryu S, et al. Neural population dynamics during reaching. Nature. 2012;487:51–56. 10.1038/nature11129 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Machens C, Romo R, Brody C. Functional, but not anatomical, separation of what and when in prefrontal cortex. J Neurosci. 2010;30(1):350–360. 10.1523/JNEUROSCI.3276-09.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Laurent G. Olfactory network dynamics and the coding of multidimensional signals. Nat Rev Neurosci. 2002;3:884–895. 10.1038/nrn964 [DOI] [PubMed] [Google Scholar]
- 19. J P, Cunningham YB. Dimensionality reduction for large-scale neural recordings. Nature Neuroscience. 2014;17:1500–1509. 10.1038/nn.3776 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. van Vreeswijk C, Sompolinsky H. Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science. 1996;. [DOI] [PubMed] [Google Scholar]
- 21. Amit D, Brunel N. Dynamics of a recurrent network of spiking neurons before and following learning. Network. 1997;8:373–404. 10.1088/0954-898X_8_4_003 [DOI] [Google Scholar]
- 22. Brunel N. Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J Comput Neurosci. 2000;8:183–208. 10.1023/A:1008925309027 [DOI] [PubMed] [Google Scholar]
- 23.Vogels T, Abbott L. Signal propagation and logic gating in networks of integrate-and-fire neurons.;. [DOI] [PMC free article] [PubMed]
- 24. Destexhe A, Contreras D. Neuronal computations with stochastic network states. Science. 2006;314:85 10.1126/science.1127241 [DOI] [PubMed] [Google Scholar]
- 25. Morrison A, Aertsen A, Diesmann M. Spike-timing-dependent plasticity in balanced random networks. Neural Comput. 2007;19:1437–1467. 10.1162/neco.2007.19.6.1437 [DOI] [PubMed] [Google Scholar]
- 26. Hertz J. Cross-correlations in high-conductance states of a model cortical network. Neural Comput. 2010;22:427–447. 10.1162/neco.2009.06-08-806 [DOI] [PubMed] [Google Scholar]
- 27. Renart A, la Rocha JD, Bartho P, Hollender L, Parga N, Reyes A, et al. The asynchronous state in cortical circuits. Science. 2010;327:587–590. 10.1126/science.1179850 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Chalfie M, Sulston JE, White JG, Southgate E, Thomson JN, Brenner S. The neural circuit for touch sensitivity in Caenorhabditis elegans. J Neurosci. 1985;5(4):956–964. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Stephens G, Johnson-Kerner B, Bialek W, Ryu W. Dimensionality and dynamics in the behavior of C. elegans. PLOS Computational Biology. 2008;4(4). 10.1371/journal.pcbi.1000028 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Varshney LR, Chen BL, Paniagua E, Hall DH, Chklovski DB. Structural Properties of the Caenorhabditis elegans Neuronal Network. PLoS Comput Biol. 2011;7(2):e1001066 10.1371/journal.pcbi.1001066 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Gray J, Lissmann H. The Locomotion of Nematodes. J Exp Biol. 1964;41:135–154. [DOI] [PubMed] [Google Scholar]
- 32. Karbowski J, Cronin C, Seah A, Mendel J, Cleary D, Sternberg P. Conservation rules, their breakdown, and optimality in Caenorhabditis sinusoidal locomotion. J Theoretical Biol. 2006;242(3):652–669. 10.1016/j.jtbi.2006.04.012 [DOI] [PubMed] [Google Scholar]
- 33. Berri S, Boyle J, Tassieri M, Hope I, Cohen N. Forward locomotion of the nematode C. elegans is achieved through modulation of a single gait. HFSP J. 2009;3:186–193. 10.2976/1.3082260 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Altun Z.F. and Hall D.H. 2011. Nervous system, general description In WormAtlas. [Google Scholar]
- 35. Zheng Y, Brockie PJ, Mellem JE, Madsen DM, Maricq AV. Neuronal Control of Locomotion in C. elegans Is Modified by a Dominant Mutation in the GLR-1 Ionotropic Glutamate Receptor. Neuron. 1999; 24(2):347–361. 10.1016/S0896-6273(00)80849-1 [DOI] [PubMed] [Google Scholar]
- 36. Li W, Feng Z, Sternberg PW, Xu XZS. A C. elegans stretch receptor neuron revealed by a mechanosensitive TRP channel homologue. Nature. 2006; 440:684–687. 10.1038/nature04538 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. White JG, Southgate E, Thomson JN, Brenner S. The structure of the nervous system of the nematode C. elegans. Philos. Trans. R. Soc. Lond. Series B. Biol. Sci. 1986; 314: 1–340. 10.1098/rstb.1986.0056 [DOI] [PubMed] [Google Scholar]
- 38. Fang-Yen C, Wyart M, Xie J, Kawai R, Kodger T, Chen S, et al. Biomechanical analysis of gait adaptation in the nematode Caenorhabditis elegans. Proc Natl Acad Sci USA. 2010;107:20323–20328. 10.1073/pnas.1003016107 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Sznitman J, Shen X, Sznitman R, Arratia P. Propulsive force measurements and flow behavior of undulatory swimmers at low Reynolds number. Phys Fluids. 2010;22:121901 10.1063/1.3529236 [DOI] [Google Scholar]
- 40. Shen X, Arratia P. Undulatory swimming in viscoelastic fluids. Phys Rev Lett. 2011;106:208101 10.1103/PhysRevLett.106.208101 [DOI] [PubMed] [Google Scholar]
- 41. Szigeti B, Gleeson P, Vella M, Khayrulin S, Palyanov A, Hokanson J, et al. OpenWorm: an open-science approach to modeling Caenorhabditis elegans. Frontiers in Computational Neuroscience. 2014;8:137 10.3389/fncom.2014.00137 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Altun ZF, Herndon LA, Crocker C, Hall DH. WormAtlas; 2002–2016. http://www.wormatlas.org.
- 43. Goodman MB, Hall DH, Avery L, Lockery SR. Active Currents Regulate Sensitivity and Dynamic Range in C. elegans. Neuron. 1998;20:763–772. 10.1016/S0896-6273(00)81014-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Wicks S, Roehrig C, Rankin C. A Dynamic Network Simulation of the Nematode Tap Withdrawal Circuit: Predictions Concerning Synaptic Function Using Behavioral Criteria. J Neurosci. 1996;16(12):4017–4031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Schmid P. Dynamic Mode Decomposition of numerical and experimental data. J Fluid Mech. 2010;656:5–28. 10.1017/S0022112010001217 [DOI] [Google Scholar]
- 46. Rowley C, Mezic I, Bagheri S, Schlatter P, Henningson D. Spectral analysis of nonlinear flows. J Fluid Mech. 2009;641:115–127. 10.1017/S0022112009992059 [DOI] [Google Scholar]
- 47. Tu J, Luchtenburg D, Rowley C, Luchtenburg D, Brunton S, Kutz J. On dynamic mode decomposition: theory and applications. J Comput Dyn. 2014;1:391–421. 10.3934/jcd.2014.1.391 [DOI] [Google Scholar]
- 48. Chen K, Tu J, Rowley C. Variants of dynamic mode decomposition: Boundary condition, Koopman, and Fourier analyses. J Nonlin Sci. 2012;22:887–915. 10.1007/s00332-012-9130-9 [DOI] [Google Scholar]
- 49. Kutz JN, Fu X, Brunton SL. Multi-Resolution Dynamic Mode Decomposition. SIAM Journal on Applied Dynamical Systems. 2016;15(2):713–735. Preprint. Available: arXiv:1506.00564. 10.1137/15M1023543 [DOI] [Google Scholar]
- 50. Mezic I. Analysis of fluid flows via spectral properties of the Koopman operator. Ann Rev Fluid Mech. 2013;45:357–378. 10.1146/annurev-fluid-011212-140652 [DOI] [Google Scholar]
- 51. Brunton B, Johnson L, Ojemann J, Kutz J. Extracting spatial-temporal coherent patterns in large-scale neural recordings using dynamic mode decomposition. Journal of Neuroscience Methods. 2016;258:1–15. 10.1016/j.jneumeth.2015.10.010 [DOI] [PubMed] [Google Scholar]
- 52. Proctor JL, Brunton SL, Kutz JN. Dynamic mode decomposition with control. SIAM Journal on Applied Dynamical Systems. 2016;15(1):142–161. 10.1137/15M1013857 [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The Connectome data used within our model is available from Varshney et al, 2011 (http://dx.doi.org/10.1371/journal.pcbi.1001066). All other relevant information is included within the paper.