Significance
We develop a theoretical model, grounded in known properties of neural dynamics and synaptic plasticity, that can fuse information gathered from the past history of velocity and sequence of encountered landmarks during exploratory behavior, to construct a self-consistent internal representation of space. Moreover, through model reduction techniques, we obtain conceptual insights into how consistent internal spatial representations naturally emerge through an elastic relaxation process in an effective spring–particle system. We verify several experimentally testable predictions of our model involving the spatial behavior of grid cells in the medial entorhinal cortex, as well as suggest additional experiments.
Keywords: grid cells, attractor dynamics, theoretical neuroscience, spatial memory, navigation
Abstract
Upon encountering a novel environment, an animal must construct a consistent environmental map, as well as an internal estimate of its position within that map, by combining information from two distinct sources: self-motion cues and sensory landmark cues. How do known aspects of neural circuit dynamics and synaptic plasticity conspire to accomplish this feat? Here we show analytically how a neural attractor model that combines path integration of self-motion cues with Hebbian plasticity in synaptic weights from landmark cells can self-organize a consistent map of space as the animal explores an environment. Intriguingly, the emergence of this map can be understood as an elastic relaxation process between landmark cells mediated by the attractor network. Moreover, our model makes several experimentally testable predictions, including (i) systematic path-dependent shifts in the firing fields of grid cells toward the most recently encountered landmark, even in a fully learned environment; (ii) systematic deformations in the firing fields of grid cells in irregular environments, akin to elastic deformations of solids forced into irregular containers; and (iii) the creation of topological defects in grid cell firing patterns through specific environmental manipulations. Taken together, our results conceptually link known aspects of neurons and synapses to an emergent solution of a fundamental computational problem in navigation, while providing a unified account of disparate experimental observations.
How might neural circuits learn to create a long-term map of a novel environment and use this map to infer where one is within the environment? This pair of problems is challenging because of their nested, chicken and egg nature. To localize where one is in an environment, one first needs a map of the environment. However, in a novel environment, no such map is yet available, so localization is not possible. Similarly, building a map of a novel environment from scratch can be difficult when one cannot even determine one’s own location in the environment. Thus, neural circuits must create a map over time, through exploration in a novel environment, without initially having access to any global estimate of position within the environment. This chicken and egg problem is known in the robotics literature as simultaneous localization and mapping (SLAM) (1).
Here we explore how known aspects of neural circuit dynamics and synaptic plasticity can conspire to self-organize, through exploration, a solution to the problem of creating a global, consistent map of a novel environment. In particular, neural circuits receive two fundamentally distinct sources of information about position: (i) signals indicating the speed and direction of the animal, which can be path integrated over time to update the animal’s internal estimate of position, and (ii) sensory cues from salient, fixed landmarks in the environment. To create a map of the environment, neural circuits must combine these two distinct information sources in a self-consistent fashion so that sensory cues and self-motion cues are always in coregister.
For example, consider the act of walking from landmark A to landmark B. Sensory perception of landmark A triggers a pattern of neural activity, and subsequent walking from A to B evolves this activity pattern, through path integration, to a final pattern. Conversely, sensory perception of landmark B itself triggers a neural activity pattern. Any circuit that maps space must obey a fundamental self-consistency condition: The neural activity pattern generated by perception of A, followed by path integration from A to B, must match the neural activity pattern triggered by perception of B alone. Only in this manner can neural activity patterns be in one to one correspondence with physical positions in space and become independent of the past trajectory used to reach any physical location.
In the following, we develop an analytic theory for how neuronal dynamics and synaptic plasticity can generate self-consistent neural maps of space upon exploration through a novel environment. Moreover, our analytic theory makes experimentally testable predictions about neural correlates of space. Indeed, many decades of recordings in multiple brain regions have revealed diverse neural correlates of spatial maps in the brain. In particular, the medial entorhinal cortex (MEC) contains neurons encoding for direction, velocity, and landmarks, as well as grid cells exhibiting striking firing patterns reflecting an animal’s spatial location (2–6). Moreover, the geometry of these firing patterns depends on the shape of the environment being explored (7–10). In particular, these grid firing patterns can be deformed in irregular environments (11, 12), in a manner evocative of deformations of solids forced into an irregular container, suggesting a mechanical model for these deformations (13–15). Also, these firing patterns are not simply driven by current sensory cues; there is evidence for path integration (16–18) in that firing patterns appear almost immediately (2), phase differences are preserved across environments (19), and firing patterns become noisier the longer an animal is away from a landmark (20, 21) and can shift, depending on which landmark the animal most recently encountered (22, 23).
Despite this wealth of experimental observations, no mechanistic circuit model currently explains how known aspects of neuronal dynamics and synaptic plasticity can conspire to learn, through exploration, a self-consistent internal map of a novel environment that both behaves like a deformable medium and also retains, at higher order, some knowledge of recently encountered landmarks. Here, we show how an attractor network that combines path integration of velocity with Hebbian learning (22, 24–26) of synaptic weights from landmark cells can self-organize to generate all of these outcomes. Intriguingly, a low-dimensional reduced model of the combined neuronal and synaptic dynamics provides analytical insight into how self-consistent maps of the environment can arise through an emergent, elastic relaxation process involving the synaptic weights of landmark cells.
Model Reduction of an Attractor Network Coupled to Sensorimotor Inputs
Our theoretical framework (SI Appendix, section II) assumes the existence of three interacting neural components: (i) an attractor network capable of realizing a manifold of stable neural activity patterns, (ii) a population of velocity-tuned cells that carry information about the animal’s motion, and (iii) a population of sensory-driven landmark cells that fire if and only if the animal is in a particular region of space. Our goal is to understand how these three populations can interact together and self-organize through synaptic plasticity, sculpted by experience, to create a self-consistent internal map of the environment. Here, we describe the neuronal and synaptic dynamics of each component in turn, as well as describe a model reduction approach to obtain a low-dimensional reduced description of the entire plastic circuit dynamics. Our low-dimensional description provides insight into how self-consistency of the neural map emerges naturally through an elastic relaxation process between landmarks.
A Manifold of Stable States from Attractor Network Dynamics.
We first consider a 1D attractor network consisting of a large population of neurons whose connectivity is determined by their position on an abstract ring, as in Fig. 1. For analytical simplicity, we take a neural field approach (27), so that position on the ring of neurons is described by a continuous coordinate , with the firing rate of a neuron at position given by . Each neuron interacts with neighboring neurons through a translation invariant connectivity, yielding the dynamics
[1] |
Here defines the synaptic weight from a cell at position to a cell at , is a single-neuron time constant, and is a nonlinearity. Many appropriate choices of and , corresponding for example to short-range excitation and long-range inhibition, will yield a family of stable, or steady-state, localized bump activity patterns , parameterized by the position of their peak (28, 29) (Fig. 1). This 1D family of stable bump activity patterns can itself be thought of as ring of stable firing patterns in the space of all possible firing patterns. Just as indexes a family of neurons on the neural sheet, the coordinate indexes the different stable neural activity patterns, with a particular value of corresponding to a stable bump on the neural ring centered at coordinate . For simplicity we set units such that the coordinate along the neural ring and the coordinate along the ring of stable attractor patterns are both angles, defined modulo . Thus, and are phase variables denoting position along the neural ring and the ring of bump-attractor patterns, respectively.
Motions Along the Attractor Manifold Due to External Inputs.
So far, the attractor network described above has a ring of stable bump activity patterns parameterized by the periodic coordinate , but these neural activity patterns are as yet unanchored to physical space. We will eventually show how to anchor the coordinate along the attractor manifold to the actual position of the animal in physical space. However, to appropriately form such an internal map of position, and thereby map the environment, the attractor state must be influenced by external inputs from both velocity- and landmark-sensitive cells in a self-consistent manner.
Path Integration Through Velocity-Conjunctive Attractor Cells.
Following refs. 28 and 29, we achieve path integration by coupling the attractor network to velocity-conjunctive attractor cells such that east (west) movement-selective cells form feedforward synapses onto the attractor ring that are shifted in the positive (negative) direction (Fig. 2 A and B). When these inputs are weak compared with the recurrent inputs determining the bump pattern (SI Appendix, section III), we can show analytically that this choice of connectivity leads to path integration:
[2] |
Here, is a constant of proportionality that relates animal velocity to the rate of phase advance in the attractor network (/field spacing). Thus, the connectivity of the velocity-conjunctive attractor cells in Fig. 2 A and B ensures that as the animal moves east (west) along a 1D track, the attractor phase moves clockwise (counterclockwise), at a speed proportional to velocity. Solving Eq. 2 allows us to recover path integration (Fig. 2C), where the resulting integrated attractor phase is only a function of current position :
[3] |
The collection of neurons in the attractor traces out periodic firing patterns as a function of spatial position, all with the same period but different phases.
However, even though these 1D grid cell firing patterns are now a function of physical space, they still are not yet anchored to the environment. There is as yet no mechanism to set the phase of each cell relative to landmarks, and indeed these grid patterns rapidly decohere without anchoring to landmarks, as demonstrated experimentally (20, 30). Coupling the attractor network to landmark-sensitive cells can solve this problem.
Landmark Cells.
We model each landmark cell as a purely sensory-driven cell with a firing rate that depends on location through . Here is the firing field of the landmark cell. An example of a landmark cell could, for example, be an entorhinal border cell (4). Every landmark cell forms feedforward connections onto each cell in the attractor network at ring position with a synaptic strength .
Consider for example a single landmark cell whose synaptic strength as a function of position on the neural ring consists of a single bump centered at a particular location (Fig. 2D). When the landmark inputs are weak relative to the recurrent inputs that determine the shape of the bump pattern, then the external landmark inputs will not change the shape of the attractor bump, but will cause it only to change its position. Intuitively, landmark cell firing should cause the attractor bump to move to the location on the ring at which the landmark cell provides its peak synaptic strength. Thus, we expect the attractor phase to move to and be pinned at the phase .
We confirm this intuition analytically in SI Appendix, section III.2 by deriving an effective dynamics obeyed by the attractor phase in response to landmark cell input:
[4] |
Here, is a force law that determines how a landmark cell with peak synaptic strength at causes the attractor phase to move. We have also introduced a parameter that controls how strongly landmark cells influence the attractor phase. Generically, the force law is positive (negative) when its argument is positive (negative). Thus, it acts as a restoring force: When each landmark cell fires, it causes the attractor phase to flow toward the phase corresponding to the location of the landmark cell’s peak outgoing synaptic strength. An attractor phase that is smaller (larger) than the landmark cell synapses’ peak location will increase (decrease) and settle down at (Fig. 2D). In SI Appendix, section III.2, we show how to analytically compute the force law governing the velocity of the bump peak; in general, the force law will have the same qualitative features as . [See SI Appendix, section VI for attractor dynamics where is exactly .]
In summary, we have so far described path integration dynamics that enable the attractor phase to move in response to motion in Eq. 2 and pinning dynamics of a landmark cell that force the attractor phase to move to a particular phase through Eq. 4. However, there is as yet no mechanism to enforce consistency between the attractor phases arrived at through path integration and the various attractor phases arrived at through pinning by landmark cells. We next introduce Hebbian plasticity of efferent landmark cell synapses during exploration while both path integration and landmark cells are active. This plasticity will self-organize each landmark cell’s pinning phase (i.e., the position of its peak synaptic strength profile onto the attractor network), to yield a self-consistent spatial map.
Hebbian Learning of Landmark Cell Synapses.
We assume that each synapse from a landmark cell to an attractor cell at position undergoes Hebbian plasticity with some weight decay, thereby learning to reinforce attractor patterns that are active when the landmark cell fires. Moreover, we assume plasticity acts slowly, over a timescale that is much longer than the timescale over which exploration occurs. Hebbian learning then drives the synaptic strengths of each landmark cell toward the long-time average of attractor patterns that occur conditioned on cell firing (Fig. 3 B2) through (SI Appendix, section III.5)
[5] |
Combined Neural and Synaptic Dynamics During Navigation.
Because the learned synaptic weight profiles of each landmark cell tend to become localized, we can approximate the entire weight profile of landmark cell by a single number that closely reflects the position on the ring at which the landmark cell provides its peak synaptic excitation (see SI Appendix, section III.6 for details). Also, because the attractor bump is close to this distribution when the landmark cell fires, we can derive simplified, linearized equations for the combined neural and synaptic dynamics valid after the initial steps of learning (SI Appendix, section IV):
[6] |
[7] |
In essence Eqs. 6 and 7 constitute a significant model reduction of Eqs. 1 and 5. In this reduction, the entire pattern of neural activity of the attractor network is summarized by a single number , denoting a point, or phase, on the ring manifold of stable attractor states. Similarly, the entire pattern of synaptic weights from landmark cell into the attractor network is summarized by a single number , denoting the learned attractor network phase associated with the landmark cell’s synapses.
Intuitively, the reduced Eq. 6 describes both path integration and dynamics in which each landmark cell attempts to pin the attractor phase to the landmark cell’s learned phase, , each time the physical position of the animal is within the landmark’s firing field . In turn, synaptic plasticity described in Eq. 7 aligns the learned pinning phase of each landmark cell to the average of the attractor phases that occur when the animal is in the firing field of the landmark cell (Fig. 3).
As we will see below, as an animal explores its environment, these coupled dynamics between attractor phase and landmark pinning phases settle into a self-consistent steady state such that the attractor phase yields an internal estimate of the animal’s current position that is, to first order, largely independent of the history of the animal’s previous trajectory. Moreover, each landmark cell learns a pinning phase , consistent with the location of its firing field in physical space.
Learning a Simple Environmental Geometry
We now examine solutions to these equations to understand how neuronal dynamics and synaptic plasticity conspire to yield a consistent map of the environment. To build intuition, we first consider the dynamics of Eqs. 6 and 7 for the simple case of an animal moving back and forth between the walls of a 1D box of length , at a constant speed , yielding a total time of to complete a full cycle (Fig. 4A). In this environment we assume two landmark cells with firing fields localized at the east (west) wall. Their pinning phases () encode the peak position of their outgoing synaptic weights. How does circuit plasticity yield a consistent environmental representation through exploration?
We build intuition in the limit , where landmark cells fully anchor the attractor state when the animal touches the edge. At , the animal starts at the west wall at physical position . Through Eq. 6, the west border cell pins the initial attractor phase so that . At , the animal travels to the east wall at physical position , and the attractor phase advances due to path integration to become . However, upon encountering the east wall, the east border cell pins the attractor phase to .
Before any learning, there is no guarantee that the east border cell pinning phase equals the attractor phase , obtained by starting at the west wall and moving to the east wall; sensation and path integration might disagree (Fig. 4B). However, plasticity described in Eq. 7 will act to move closer to . Then as the animal returns to the left wall at time , path integration will retard the attractor phase , and an encounter with the west wall leads the west border cell to pin the attractor phase to . Again, there is no guarantee that the west border cell pinning phase agrees with the attractor phase obtained by starting at the east wall and traveling to the west wall, but circuit plasticity will change to reduce this discrepancy. Overall, plasticity over multiple cycles of exploration (Fig. 3 B2) yields the iterative dynamics
Thus, the phase difference between the pinning phases of the two landmark cells will approach the phase advance incurred by path integration between the two landmarks. Thus, learning can precisely coregister sensation and path integration so that these two information sources yield a consistent map of space (Fig. 4C). In particular, the attractor phase assigned by the composite circuit to any point in the interior of the environment now becomes independent of which direction the animal is traveling, in contrast to the case before learning (compare the assigned interior phases in Fig. 4B with those in Fig. 4C).
Learning as an Elastic Relaxation Between Landmarks
To gain further insight into the learning dynamics, it is useful to interpret the periodic attractor phase as an internal estimate of position through the “unrolled” coordinate variable . Likewise, we can replace the landmark phase with another linear variable , denoting the internal representation of the position of landmark (Fig. 4D). This enables us to associate physical positions to landmark cells, or more precisely their pinning phases, although these assigned positions are defined only up to shifts of the grid period. By “unrolling” the learning rule of Eq. 7, we derive the learning and plasticity dynamics of unrolled phase for the landmark cells over the long timescale of exploration,
[8] |
[9] |
where (SI Appendix, section V).
These dynamics for the two landmark cell synapses in unrolled phase are equivalent to those of two particles at physical positions and , connected by an overdamped spring with rest length and spring constant (Fig. 4E). If the separation between the particles is less (greater) than , then the spring is compressed (extended), yielding a repulsive (attractive) force between the two particles. Learning stabilizes the two particle positions when their separation equals the spring rest length, so that .
This condition in unrolled phase is equivalent to the fundamental consistency condition for a well-defined spatial map, namely that the phase advance due to path integration equals the phase difference between the pinning phases of landmark cells (Fig. 4C). However, the utility of the unrolled phase representation lies in revealing a compelling picture of how a spatially consistent map arises from the combined neuronal and synaptic dynamics, through simple, emergent first-order relaxational dynamics of landmark particles connected by damped springs. As we see below, this simple effective particle–spring description of synaptic plasticity in response to spatial exploration generalizes to arbitrary landmarks in arbitrary 2D environments.
We note that if the environment has not been fully learned or has been recently deformed, the internal representation of landmarks will lag behind the true geometry for a time, leading to “boundary-tethered” firing fields seen in refs. 22, 25, and 31. Additionally (SI Appendix, section V), we have solved the dynamics when the firing fields of the border cells have a finite extent and the landmark cells have a finite strength , and we find the dynamics obey those of Eqs. 8 and 9, with a different rest length .
Generalization to 2D Grid Cells
To make contact with experiments, we generalize all of the above to 2D space. Now grid cells live on a periodic 2D neural sheet, where each cell has position . The analogue of Eq. 1 is
[10] |
where includes short-range excitation and long-range inhibition (Fig. 5A). Attractor dynamics on this sheet can yield a 2D family of steady-state bump activity patterns with hexagonal symmetry (SI Appendix, section VII). The attractor state is now a 2D phase on the periodic rhombus (Fig. 5B). Velocity-conjunctive attractor cells yield a generalization of Eq. 2:
[11] |
Here we have replaced in 1D with , a two-by-two matrix that translates 2D animal velocity into phase advance in the 2D attractor network. determines both grid spacing and orientation.
We again assume the effect of landmark cells on the attractor network is strong enough to affect the position of the bump pattern, but not strong enough to change its shape. Then learned Hebbian synaptic weights of landmark cell onto the attractor network can be expressed as a weighted superposition of attractor bump patterns with weighting coefficients :
[12] |
The learning dynamics are then (see SI Appendix, section XI1 for a proof)
[13] |
where is a distribution over the periodic rhombus (Fig. 5C). Also, each landmark cell will affect the attractor phase through
[14] |
where is a 2D force law that pulls toward . In general, a landmark cell will pull the attractor state on the rhombus toward the center of mass of the cell’s synaptic weights when viewed as a density over the rhombus (Fig. 5C).
Combined 2D Neural and Synaptic Dynamics During Exploration
By combining the effects of path integration in Eq. 11 with landmark cells in Eq. 14, we obtain the full dynamics of the 2D attractor phase driven by both animal velocity and landmark encounters:
[15] |
Now in an analogy to Fig. 4D, we can unroll the attractor phase into a 2D linear variable , reflecting an internal estimate of the animal’s physical position (up to the grid period). Furthermore, by linearizing the force law, we can simplify Eq. 15 by summarizing by its mean phase and then unrolling it to obtain another position variable reflecting an internal estimate of the center of mass of landmark firing-field (Fig. 5D and SI Appendix, section VII.4.D). In analogy to Eqs. 6 and 7 this yields dynamics for the 2D internal position and landmark estimates given a 2D animal trajectory :
[16] |
[17] |
Spatial Consistency Through Emergent Elasticity
We showed in Eqs. 8 and 9 and Fig. 4 D and E that the emergence of spatial consistency between path integration and landmarks through Hebbian learning dynamics, during exploration of a simple 1D environment, could be understood as the outcome of an elastic relaxation process between landmark cell synapses, viewed as particles in physical space connected by damped springs. Remarkably, this result generalizes far beyond this simple environment. As long as the exploration dynamics are time reversible [time reversible means that for any , the reverse path is equally likely], the learning dynamics of any set of landmark cells in any 2D geometry yield this particle–spring interpretation:
[18] |
The spring constant is related to the frequency with which the animal moves between each pair of landmark firing fields , while the rest displacement is the average change in unrolled attractor phase as the animal moves from firing-field to firing-field , roughly related to the distance between the landmark firing fields. Precise expressions for the spring constants and rest lengths are derived from the statistics of exploration in SI Appendix, section VIII.
Overall, this elastic relaxation process converges toward an internal map where all pairs of landmark cell synapses, viewed as particles in unrolled phase, or physical space, become separated by the physical distance between their firing fields. This convergence ensures a consistent internal environmental map of external space in which velocity-based path integration of attractor phase starting at the pinning phase of landmark and ending at landmark will yield an integrated phase consistent with the pinning phase of landmark itself. These relaxation dynamics explain path-dependent shifts in firing patterns observed in recently deformed environments (22). Also, the experimental observation in ref. 10 that, in multicompartment environments, consistent maps within compartments form before consistent maps between compartments is also explained by these relaxation dynamics. In essence, the longest-lived learning mode of the relaxation dynamics corresponds to differences in maps between compartments.
Furthermore, as we explain in the next three sections, these relaxation dynamics yield several experimental predictions: (i) systematic path-dependent shifts in fully learned 2D environments, (ii) mechanical deformations in complex environments, and (iii) the prediction of creation of topological defects in grid cell firing patterns through specific environmental manipulations.
Path Dependence in 2D Environments
We saw above that exploration in a simple 1D geometry led to a consistent internal map in which the attractor network phase was mapped onto the current physical position alone, independent of path history (Fig. 4C). This consistency arises through the elastic relaxation process in Eqs. 8 and 9, which makes the distance between the landmark cells in unrolled phase equal to the physical distance between their firing fields , just like two particles connected by a spring with rest length (Fig. 4E). This situation will generalize to 2D if there are only two landmarks, namely a west and an east border cell (Fig. 6 A1). However, it becomes more complex with the addition of a third landmark cell, for example a south border cell (Fig. 6 A2).
In this case, east and west landmark particles will be connected by a spring of rest length , as before, but they will each also be connected to the south landmark particle with springs. Intuitively, as the animal travels from the east or west walls to the south walls, the landmark pinning phases of each of these three border cells will be attracted toward each other. (More complex, nonoverlapping distributions yield the same deformations.) The combined three-particle elastic system will settle into an equilibrium configuration in which the difference in unrolled phase between east and west landmarks will be less than the physical separation or equivalently the rest length of the spring connecting them. This in turn implies that the attractor phase assigned to any physical position in the interior will be relatively phase advanced (retarded) if the mouse is on a trajectory leaving the west (east) wall. This path dependence in the attractor phase is entirely analogous to that seen in Fig. 4B. However, the reason is completely different. In Fig. 4B, the landmark particles are not separated by the rest length of the spring connecting them because the environment is not fully learned and so the particles are out of equilibrium, whereas in Fig. 6 A2, the particles are not separated by the rest length, even in a fully learned environment, because additional springs from the south landmark create excess compression (See SI Appendix, section IX for details).
This theory makes a striking experimentally testable prediction, namely that even in a fully learned 2D environment, grid cell firing fields, when computed on subsets of mouse trajectories conditioned on leaving a particular border, will be shifted toward that border (Fig. 6B). This shift occurs because at any given position, the attractor phase depends on the most recently encountered landmark. In particular, on a west to east (east to west) trajectory, the attractor phase will be advanced (retarded) relative to an east to west (west to east) trajectory. Thus, on a west to east trajectory, the advanced phase will cause grid cells to fire earlier, yielding west-shifted grid cell firing fields as a function of position. Similarly on an east to west trajectory, grid fields will be east shifted. In summary, the theory predicts grid cell firing patterns conditioned on trajectories leaving the west (east) border will be shifted west (east). While we have derived this prediction qualitatively using the conceptual mass–spring picture in Fig. 6 A2, we confirm this intuition through direct numerical simulations of the full circuit dynamics in Eqs. 13 and 15 (Fig. 6 C2). Under reasonable parameters, our simulations can yield path-dependent shifts of up to 2 cm toward the wall the animal last touched (SI Appendix, section XII).
We searched for such subtle shifts in a population of 143 grid cells from 14 different mice that had been exploring a familiar, well-learned, 1-m open field (SI Appendix, section XII.2), using two separate analyses, based on cross-correlations and spike shifts with respect to field centers.
Cross-Correlations.
One method for detecting a systematic firing-field shift across many grid fields is to cross-correlate firing-rate maps conditioned on trajectories leaving two different borders (SI Appendix, section IX.1.A). For example, for each cell, we can ask how much and in what direction we must shift its west border-conditioned firing field to match, or correlate as much as possible with, the same cell’s east-conditioned firing field. In particular, for each cell, we can compute the correlation coefficient between a spatially shifted west-conditioned field and an unshifted east-conditioned field and plot the average correlation coefficient as a function of this spatial shift. The theory predicts that we will have to shift the west-conditioned firing field eastward to match the east-conditioned firing field (Fig. 7A). This prediction is confirmed by a peak in the cross-correlation as a function of spatial shift when the spatial shift is positive or directed east (Fig. 7B). A similar logic holds for north and south.
Overall, this analysis shows that grid patterns are shifted toward the most recently encountered wall, both for the north–south (NS) walls (3 cm, , binomial test; , sign-flip test) and the east–west (EW) walls (1.5 cm, , binomial test; , sign-flip test), matching the sign and magnitude seen in simulations.
Firing-Field Centers.
These results can be corroborated by computing shifts in spikes relative to firing-field centers, when conditioning spikes on the path history (SI Appendix, section IX.1.B). For each firing-field center, we calculate the average spike position within that firing field conditioned on the animal having last touched a particular wall. For each cell, we calculate the average shift across all firing fields and examine how the shifts depend on which wall the animal last touched. Again, the patterns are shifted toward whichever wall the animal last touched (Fig. 7C) for both the NS walls (0.5 cm, , binomial test; , sign-flip test) and the EW walls (0.5 cm, , binomial test; , sign-flip test). The discrepancy in the estimated magnitude of the shift between the methods of analysis is likely due to poorly defined firing fields; a method based on firing-field centers will give a lower signal-to-noise ratio, and thus a lower shift magnitude, than the cross-correlogram method.
Mechanical Deformations in Complex Environments
Another experimental observation that can be reproduced by our theory is the distortion (11) of grid cell patterns seen in an irregular environment (Fig. 8A). Landmark cells with firing fields distributed across an entire wall will pull the attractor phase to its associated landmark pinning phase regardless of where along the wall the animal is. The presence of a diagonal wall then causes the average attractor phase as a function of position to curve toward the wall, yielding spatial grid cell patterns that curve away from the wall (Fig. 8 B1, B2, C1, and C2). Previous theoretical accounts of this grid cell deformation have relied on purely phenomenological models that treated individual grid cell firing fields as particles with mostly repulsive interactions (15), without a clear mechanistic basis underlying this interaction. Our model instead provides a clear mechanistic basis for such deformations, grounded in the interaction between attractor-based path integration and plastic landmark cells. Such dynamics yield an emergent elasticity where the particles are landmark cell synapses rather than individual firing-field centers.
Topological Defects in Grid Fields: A Prediction
While the dynamics of the linearized Eqs. 16 and 17 will always flow to the same relative landmark representations , this is not the case for the full dynamics of Eqs. 13 and 15, which can learn multiple different stable landmark cell synaptic configurations. One striking example of this is the ability of the learning dynamics to generate “topological defects,” where the number of firing fields traversed is not the same for two different paths (Fig. 9 A and B and SI Appendix, section XII). An environmental geometry capable of supporting these defects will yield a set of firing patterns that depends not only on the final geometry, but also on the history of how this geometry was created (Fig. 9C).
Discussion
Overall, we have provided a theoretical framework for exploring how sensory cues and path integration may work together to create a consistent internal representation of space. Our framework is grounded in biologically plausible mechanisms involving attractor-based path integration of velocity and Hebbian plasticity of landmark cells. Moreover, systematic model reduction of these combined neural and synaptic dynamics yields a simple and intuitive emergent elasticity model in which landmark cell synapses act like particles sitting in physical space connected by damped springs whose rest length is equal to the physical distance between landmark firing fields. This simple emergent elasticity model not only provides a conceptual explanation of how neuronal dynamics and synaptic plasticity can conspire to self-organize a consistent map of space in which sensory cues and path integration are in register, but also provides predictions involving small shifts in firing fields even in fully learned environments, potential topological defects in grid cells, and grid cell mechanical deformation when borders are irregular. Furthermore, a special case of this model can explain sudden grid cell remapping events in altered virtual reality environments as the disagreement between landmarks and path integration is gradually increased; the model remaps due to sudden phase transitions in its dynamics (32).
This work opens up many interesting avenues. For example, further explorations of the nonlinear regime of our model may yield interesting experimental signatures that distinguish different modes of interaction between attractors, path integrators, and landmark cells. Incorporating heterogeneity of neural representations observed in MEC (33) into our framework is another intriguing direction. Also, as the reliability of sensory and velocity cues changes, it is interesting to ask what higher-order mechanisms may differentially regulate the effect of landmarks and velocity on the internal representation of space. More generally, our theory provides a unified framework for understanding how systematic variations in environmental geometry and the statistics of environmental exploration interact to precisely sculpt neural representations of space.
Supplementary Material
Acknowledgments
We thank Daniel Fisher for helpful discussions and Kenneth Harris for helpful comments on the manuscript. We thank Malcolm Campbell, Robert Munn, and Caitlin Mallory for assistance in gathering data. We thank the Office of Naval Research, the Simons and James S. McDonnell Foundations (L.M.G. and S.G.), the McKnight Foundation (S.G.), the New York Stem Cell Foundation, Whitehall Foundation, National Institutes of Mental Health MH106475, a Klingenstein–Simons fellowship (L.M.G.), an Urbanek fellowship (S.A.O.), and a Stanford Interdisciplinary Graduate Fellowship (K.H.) for support.
Footnotes
The authors declare no conflict of interest.
This article is a PNAS Direct Submission. D.B.C. is a guest editor invited by the Editorial Board.
This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10.1073/pnas.1805959115/-/DCSupplemental.
References
- 1.Thrun S, Burgard W, Fox D. Probabilistic Robotics. MIT Press; Cambridge, MA: 2005. [Google Scholar]
- 2.Hafting T, Fyhn M, Molden S, Moser M-B, Moser EI. Microstructure of a spatial map in the entorhinal cortex. Nature. 2005;436:801–806. doi: 10.1038/nature03721. [DOI] [PubMed] [Google Scholar]
- 3.Moser EI, et al. Grid cells and cortical representation. Nat Rev Neurosci. 2014;15:466–481. doi: 10.1038/nrn3766. [DOI] [PubMed] [Google Scholar]
- 4.Solstad T, Boccara CN, Kropff E, Moser M-B, Moser EI. Representation of geometric borders in the entorhinal cortex. Science. 2008;322:1865–1868. doi: 10.1126/science.1166466. [DOI] [PubMed] [Google Scholar]
- 5.Kropff E, Carmichael JE, Moser M-B, Moser EI. Speed cells in the medial entorhinal cortex. Nature. 2015;523:419–424. doi: 10.1038/nature14622. [DOI] [PubMed] [Google Scholar]
- 6.Sargolini F, et al. Conjunctive representation of position, direction, and velocity in entorhinal cortex. Science. 2006;312:758–762. doi: 10.1126/science.1125572. [DOI] [PubMed] [Google Scholar]
- 7.Stensola T, Stensola H, Moser M-B, Moser EI. Shearing-induced asymmetry in entorhinal grid cells. Nature. 2015;518:207–212. doi: 10.1038/nature14151. [DOI] [PubMed] [Google Scholar]
- 8.Barry C, Hayman R, Burgess N, Jeffery KJ. Experience-dependent rescaling of entorhinal grids. Nat Neurosci. 2007;10:682–684. doi: 10.1038/nn1905. [DOI] [PubMed] [Google Scholar]
- 9.Barry C, Ginzberg L, O’Keefe J, Burgess N. Grid cell firing patterns signal environmental novelty by expansion. Proc Natl Acad Sci USA. 2012;109:17687–17692. doi: 10.1073/pnas.1209918109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Carpenter F, Manson D, Jeffery K, Burgess N, Barry C. Grid cells form a global representation of connected environments. Curr Biol. 2015;25:1176–1182. doi: 10.1016/j.cub.2015.02.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Krupic J, Bauza M, Burton S, Barry C, O’Keefe J. Grid cell symmetry is shaped by environmental geometry. Nature. 2015;518:232–235. doi: 10.1038/nature14153. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Krupic J, Bauza M, Burton S, O’Keefe J. Local transformations of the hippocampal cognitive map. Science. 2018;359:1143–1146. doi: 10.1126/science.aao4960. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Krupic J. Brain crystals. Science. 2015;350:47–48. doi: 10.1126/science.aad3002. [DOI] [PubMed] [Google Scholar]
- 14.Krupic J, Bauza M, Burton S, O’Keefe J. Framing the grid: Effect of boundaries on grid cells and navigation. J Physiol. 2016;594:6489–6499. doi: 10.1113/JP270607. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Krupic J, Bauza M, Burton S, Lever C, O’Keefe J. How environment geometry affects grid cell symmetry and what we can learn from it. Philos Trans R Soc Lond B Biol Sci. 2014;369:20130188. doi: 10.1098/rstb.2013.0188. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.McNaughton BL, Battaglia FP, Jensen O, Moser EI, Moser M-B. Path integration and the neural basis of the cognitive map. Nat Rev Neurosci. 2006;7:663–678. doi: 10.1038/nrn1932. [DOI] [PubMed] [Google Scholar]
- 17.Evans T, Bicanski A, Bush D, Burgess N. How environment and self-motion combine in neural representations of space. J Physiol. 2016;594:6535–6546. doi: 10.1113/JP270666. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Raudies F, Hinman JR, Hasselmo ME. Modelling effects on grid cells of sensory input during self-motion. J Physiol. 2016;594:6513–6526. doi: 10.1113/JP270649. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Fyhn M, Hafting T, Treves A, Moser M-B, Moser EI. Hippocampal remapping and grid realignment in entorhinal cortex. Nature. 2007;446:190–194. doi: 10.1038/nature05601. [DOI] [PubMed] [Google Scholar]
- 20.Hardcastle K, Ganguli S, Giocomo LM. Environmental boundaries as an error correction mechanism for grid cells. Neuron. 2015;86:827–839. doi: 10.1016/j.neuron.2015.03.039. [DOI] [PubMed] [Google Scholar]
- 21.Giocomo LM. Environmental boundaries as a mechanism for correcting and anchoring spatial maps. J Physiol. 2016;594:6501–6511. doi: 10.1113/JP270624. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Keinath AT, Epstein RA, Balasubramanian V. 2017 Environmental deformations dynamically shift the spatial metric of the brain. bioRxiv: www.biorxiv.org/content/early/2017/08/10/174367. Preprint, published August 10, 2017.
- 23.Ocko S, Hardcastle K, Giocomo L, Ganguli S. 2017 Evidence for Optimal Bayesian Cue Combination of Landmarks and Velocity in the Entorhinal Cortex. Available at cosyne.org/cosyne17/Cosyne2017_program_book.pdf. Accessed November 19, 2018.
- 24.Milford MJ, Wyeth GF, Prasser D. IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA’04. Vol 1. IEEE; Piscataway, NJ: 2004. RatSLAM: A hippocampal model for simultaneous localization and mapping; pp. 403–408. [Google Scholar]
- 25.Pollock E, Desai N, Wei X-X, Balasubramanian V. 2018. Dynamic self-organized error-correction of grid cells by border cells. arXiv:1808.01503. Preprint, posted August 5, 2018.
- 26.Mulas M, Waniek N, Conradt J. Hebbian plasticity realigns grid cell activity with external sensory cues in continuous attractor models. Front Comput Neurosci. 2016;10:13. doi: 10.3389/fncom.2016.00013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Deco G, Jirsa VK, Robinson PA, Breakspear M, Friston K. The dynamic brain: From spiking neurons to neural masses and cortical fields. PLoS Comput Biol. 2008;4:1–35. doi: 10.1371/journal.pcbi.1000092. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Samsonovich A, McNaughton BL. Path integration and cognitive mapping in a continuous attractor neural network model. J Neurosci. 1997;17:5900–5920. doi: 10.1523/JNEUROSCI.17-15-05900.1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Burak Y, Fiete IR. Accurate path integration in continuous attractor network models of grid cells. PLoS Comput Biol. 2009;5:e1000291. doi: 10.1371/journal.pcbi.1000291. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Chen G, Manson D, Cacucci F, Joseph Wills T. Absence of visual input results in the disruption of grid cell firing in the mouse. Curr Biol. 2016;26:2335–2342. doi: 10.1016/j.cub.2016.06.043. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Gothard KM, Skaggs WE, Bruce L. Dynamics of mismatch correction in the hippocampal ensemble code for space: Interaction between path integration and environmental cues. J Neurosci. 1996;16:8027–8040. doi: 10.1523/JNEUROSCI.16-24-08027.1996. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Campbell MG, et al. Principles governing the integration of landmark and self-motion cues in entorhinal cortical codes for navigation. Nat Neurosci. 2018;21:1096–1106. doi: 10.1038/s41593-018-0189-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Hardcastle K, Maheswaranathan N, Ganguli S, Giocomo LM. A multiplexed, heterogeneous, and adaptive code for navigation in medial entorhinal cortex. Neuron. 2017;94:375–387.e7. doi: 10.1016/j.neuron.2017.03.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.