Abstract
Nervous systems’ computational abilities are an evolutionary innovation, specializing and speed-optimizing ancient biophysical dynamics. Bioelectric signalling originated in cells' communication with the outside world and with each other, enabling cooperation towards adaptive construction and repair of multicellular bodies. Here, we review the emerging field of developmental bioelectricity, which links the field of basal cognition to state-of-the-art questions in regenerative medicine, synthetic bioengineering and even artificial intelligence. One of the predictions of this view is that regeneration and regulative development can restore correct large-scale anatomies from diverse starting states because, like the brain, they exploit bioelectric encoding of distributed goal states—in this case, pattern memories. We propose a new interpretation of recent stochastic regenerative phenotypes in planaria, by appealing to computational models of memory representation and processing in the brain. Moreover, we discuss novel findings showing that bioelectric changes induced in planaria can be stored in tissue for over a week, thus revealing that somatic bioelectric circuits in vivo can implement a long-term, re-writable memory medium. A consideration of the mechanisms, evolution and functionality of basal cognition makes novel predictions and provides an integrative perspective on the evolution, physiology and biomedicine of information processing in vivo.
This article is part of the theme issue ‘Basal cognition: multicellularity, neurons and the cognitive lens’.
Keywords: regeneration, bioelectricity, planaria, bistability, memory, cognitive science
1. Introduction
Living bodies exhibit remarkable anatomical plasticity: the ability to reach specific, highly complex anatomical outcomes from a range of starting configurations and despite often drastic perturbations. Regulative development in many species can produce normal individuals when embryos are cut into pieces or multiple embryos are combined [1,2]. During metamorphosis, tadpoles with facial organs in abnormal positions nevertheless become normal frogs by moving these organs in un-natural paths until a correct frog face is made [3]. Indeed, classical work by Farinella-Ferruza showed that tails transplanted to the flank of salamanders gradually metamorphose into limbs, as individual cells act to turn a very abnormal large-scale configuration into the correct species-specific anatomical layout [4,5]. Many species, such as salamanders, regenerate whole organ systems, such as appendages, jaws or eyes, when these are amputated in adulthood [6]. These observations highlight the amazing ability of tissues to make decisions about large-scale anatomy and re-adjust it dynamically to reduce the distance in morphospace between the current configuration and a specific target morphology.
Despite the recent progress in the molecular biology of genetic components necessary for regeneration or embryonic morphogenesis, important gaps exist in our understanding of the algorithms that are sufficient to implement such robust pattern homeostasis [7]. From an engineering perspective, biological systems can execute closed-loop controls that modulate cell activity towards minimizing the error (anatomical distance in morphospace) between the current, possibly injured, anatomy and the correct species-specific target morphology. How do living systems measure their organ-level geometric states, and store the geometric setpoints towards which cell activity must work? How do cells know when the ‘correct’ anatomy has been restored, so that proliferation and remodelling can cease?
These are critical open questions, likely requiring not only molecular genetics but also concepts from control theory, cybernetics and computer science. At stake are numerous important endpoints. Regenerative medicine is stalled by the complexity explosion of genetic data: radical repair therapies require an understanding of how to trigger organ-level rebuilding and exert rational control over anatomical outcomes from tweaking molecular-level components. Similarly, repair of birth defects towards a correct anatomy, or the creation of entirely novel bodies for bioengineered synthetic living machines, require the ability to induce cells to build to a specific pattern. Even the cancer problem could be solved if we knew what signals normally keep cells harnessed towards a specific structure (and away from unicellular-like behaviour of metastasis) and cause them to stop proliferating once the target morphology has been reached.
2. Tissue decision-making: an evolutionary perspective on anatomical control
One approach to this problem focuses on the decision-making of cellular collectives, treating them as information-processing systems with complex, modular responses and the ability to implement several possible large-scale outcomes. Thus, developmental biologists and workers in regenerative medicine may be able to control their behaviour via signals and inputs, not by rewiring or micro-managing their molecular networks. The field of basal cognition seeks to understand the evolutionary history of learning and problem-solving in animals by studying the mechanisms of computation, memory and decision-making in ancient, pre-neural life forms [8–14]. This is relevant to problems of regeneration and development because it suggests the use of techniques from cognitive science and computational neuroscience to understand the information flow that leads to cell group behaviours [15]. We conjectured [16–18] that anatomical homeostasis is a process that relies on pattern memory—biophysical properties stored in tissues that encode, to some rough level of detail, important aspects of the anatomy towards which cells will build (and which, once achieved, causes further activity to stop).
Cognitive neuroscience studies neural circuits that implement memory and goal-directed behaviour. However, nerves evolved from more primitive cell types that made use of ion channels, neurotransmitters and synaptic plasticity long before brains evolved [10,19,20]. The ability to process information via electrical signalling is as old as bacterial biofilms, as has been amply shown by recent work from the Süel lab [21–24]. Evolution has exploited the convenience of bioelectric circuits for coordinating cell activity in many contexts outside of the nervous system, including in plants, fungi, algae, etc. [25–31]. Therefore, we have been pursuing the idea that sophisticated cognitive memory may be an evolutionary elaboration of a much more primitive and ancient system, whose job was to remember body configurations to guide cell behaviour in morphogenesis before the arrival of nervous systems (which then further specialized to, e.g. remember configurations of the outside world to guide whole animal behaviour). This perspective predicts that by manipulating the dynamics of non-neural bioelectric networks, it should be possible to induce coherent, predictable changes to large-scale anatomy.
Indeed, it is now clear that slow bioelectric communication among all cells in the body, from the earliest stages of embryogenesis, is critical for patterning outcomes [32,33]. Endogenous bioelectric patterns are required for the normal morphogenesis of the brain [34,35], wing [36,37], face [38,39] and eye [40]. Mechanistic experiments in model systems [41] are complemented by studies of human channelopathies—mutations in ion channel genes that have been characterized by several groups and shown to cause birth defect syndromes in human patients [42–44]. Furthermore, it is now possible to induce regenerative repair of complex appendages in non-regenerative conditions [45,46], and even reprogramme tumours into normal tissue [47–50], by specific manipulation of ion channels that implement bioelectric state transitions in vivo. Beyond recreating the genome-default anatomical features, it was recently found that genomically wild-type animals (with no DNA editing) could be made to build heads belonging to other living species ∼150 million years distant, simply by manipulating the bioelectric network during regeneration [51,52].
Taken together, this body of work suggests that evolution exploited the powerful, convenient computational capabilities of electric circuits to implement anatomical repair control loops, just as it did for (closed-loop) behavioural circuits in the brain [53–55]. Cells communicate electrically to sense anatomical states at long range [56], and use electric circuits to organize into networks that produce voltage prepatterns guiding gene expression and morphogenesis [57]. Research is now ongoing to refine computational models of information processing by non-neural bioelectric networks [58–64], which are becoming accurate enough that they can suggest interventions that repair complex birth defects such as brain mispatterning [65]. Moreover, elegant synthetic biology work such as that from Adam Cohen's group has begun to implement bioelectric circuits in minimal artificial tissue models [66–68].
The frontier in this field is to understand the bioelectric code: the mapping of bioelectric states in tissues to the patterns they encode. This is analogous to the research programme in neuroscience called neural decoding, which is attempting to decode the cognitive content (e.g. a specific visual image or scene representation) implemented by brain states and dynamics, on a moment-by-moment basis [69–71]. This is usually done by exploiting machine learning algorithms that are trained on specific instances of the problem (e.g. a person's brain activations when he or she is attending to specific visual images); but the question of how exactly brain states and dynamics carry information and content remains open (and could be informed by parallel investigation of evolutionarily ancient and perhaps simpler information storage systems in non-neural tissues). Below, we discuss a recent finding in the field of developmental biology, which is unique because it focuses on the stochastic, dynamic nature of pattern memory processes.
3. Planarian regeneration: stable and stochastic pattern memories
Planaria are flatworms with complex anatomy and amazing regenerative abilities: when cut into pieces, each fragment knows exactly what to build and where to regenerate a complete, normal worm [72,73]. Recent studies reveal that this process is partly mediated by bioelectric signalling [74]. Specifically, the decisions of where to place heads on a fragment (and how many heads there should be) are mediated by a bioelectric circuit [75,76]. Critically, this circuit implements a long-term stable and re-writable pattern memory (figure 1a): once it is altered (by a brief pharmacological exposure that targets electrical connections between cells) to encode a bi-polar head–head state (instead of a head–tail configuration), subsequent fragments continue to form two-headed worms with no further manipulation [77]. The axial polarity and head number are thus set by a physiological memory system that stably holds the information needed to guide regeneration—a transient (48 h) stimulus permanently alters the pattern to which fragments regenerate in the future. It is an example of epigenetics in Waddington's original sense of the term: a non-genomic, re-writable medium for information that controls growth and form. Recent work has identified functional and molecular parallels of epigenetic pattern control between planaria and the classic example of non-genomic (cortical) inheritance seen in protozoa [78,79]. This suggests ancient and conserved physical media across which evolution diversified its patterning control systems [80]. Here, we focus not on the permanent and stable re-writing of target morphology by the persistent two-head phenotype but on a fascinating new phenomenon: stochastic target morphology.
4. Hypothesis: bistability in memory systems
When a cohort of planaria are cut into pieces and treated with a reagent that targets their bioelectric networks, some regenerate as two-headed and some do not. For over a decade, we called the resulting one-head worms ‘escapees’, thinking that the vagaries of physiological diversity lowered the penetrance of the drug treatment and left some worms unaffected. However, recutting these seemingly normal animals revealed a remarkable outcome [81,82]: their fragments likewise produce one-head and two-head animals in roughly the same ratio. Thus, there are three kinds of worms: true wild-types that always produce one-head worms, two-head worms that always produce two-head worms and ‘Cryptic’ one-head worms that have a destabilized target morphology. These Cryptic worms have a bioelectric circuit that has been permanently shifted into a state in which it spontaneously settles into a two-headed or a Cryptic state upon each cut (and this change did not require genomic manipulation). The state diagram summarizing these results is shown in figure 1c. Similar phenomena have been seen in bacterial ‘persisters’ [83,84], but to our knowledge, this is the first example of a discrete, permanently destabilized target morphology in metazoa.
Two interesting facts should be noted. First, the decision whether to make one head or two is made by each fragment independently: two pieces cut from the same worm do not always make the same choice—each piece undertakes its own ‘coin flip’ between those outcomes (it is not set by the parent worm). Second, this decision is stochastic at the level of the fragment, not the individual cells. Thus, what we do not observe are mosaic, speckled worms in which 70% of the cells want to make one head and 30% want to make two. Rather, each cell in the fragment agrees with the group decision to make one head or two (at a 70–30 frequency at the population level). The bistability here is at the level of the cellular collective. Indeed, the basic phenomenon of head/tail regeneration reveals that it is not a local, cell-level decision because the two wounds produced by bisection of a normal worm have radically different anatomical outcomes (head from one wound, tail from the other) despite the fact that the cells were immediately adjacent neighbours before the cut and thus were at the same positional information level along the axis. Thus, proper regeneration in the normal case, as in the modified scenarios described above, requires cells to communicate across significant distances to determine what structures exist, and which must be made anew [62,81,85,86].
This same phenomenon, where bioelectric networks enable group decisions within a large cell field, has also been described in left–right patterning (where targeting the decision by ion channel perturbations induces randomization of entire left or ride side identities, not individual cells [87]) and in the conversion of melanocytes to melanoma (where bioelectric modulation causes a percentage of tadpoles, not of cells within one tadpole, to fully transform [88,89]). The stochasticity at the level of populations, but tight coordination within one individual, raises profound questions about noise, group behaviour and decision-making of multi-agent ‘swarms’ that are not well understood but have many implications not only for biology and biomedicine but for dynamical systems and computational approaches to swarms of biological and robotic agents at many scales. Certainly, the problem of unifying the activity of numerous distributed, noisy micro-agents, such as bioelectrically active neural cells, into a unified cognitive system with a coherent and functionally centralized decision-making capacity is a familiar problem in cognitive neuroscience.
Efforts are currently underway to mechanistically characterize and control the biophysical components of this stochastic process. Significant insights can come from the fields of psychology and computational neuroscience. Indeed, the overall dynamics, in which a system can choose one of multiple global outcomes from the same starting conditions, resembles the way visual perceptual systems exhibit bistability and flip stochastically between two alternative interpretations of the same ambiguous stimulus, e.g. either a duck or a rabbit for the famous duck–rabbit illusion, but never something in between a duck and a rabbit (figure 2). Bistable perceptions, such as the duck–rabbit illusion or the Necker cube, have often been modelled in terms of a neural circuit (e.g. an attractor neural network) having two attractor states. Bistable perceptual phenomena in these neural networks depend on alternations between two attractors, which can be induced by noise or intrinsic network dynamics [90,91]. Recurrent networks with attractor dynamics are also popular in the study of decision-making, where two alternative choices represent two basins of attraction of the network, and the selection of one attractor or the other (i.e. the decision) is guided by external stimuli, endogenous network dynamics and feedback loops [92,93].
Since the pioneering work of Grossberg [94] and Hopfield [95], attractor networks have been used in computational neuroscience to explain the formation and retrieval of memories, too. Put simply, associative memories can be learned by creating stable neural activity patterns or attractors. An attractor network can, therefore, encode multiple discrete memories in its attractor states, each having its own basin of attraction [96]. The memories can be retrieved from incomplete cues or stimuli, because the network dynamics perform pattern completion and typically evolve from an(y) initial state towards one stable, attractor state encoding a memory. Once it reaches one of the attractors, the system usually remains there, even after signal removal, hence implementing a memory function (at least until a new stimulus or an endogenous fluctuation changes the network state). Attractor (or more generally dynamical) networks having multiple stable states (or attractors) can under some conditions exhibit a bistable character and spontaneous fluctuations and switches between the stable states [97] as well as more stable transitions between multiple stable states and attractors, hence determining dynamical sequences of activation rather than settling in one attractor [98,99]. The presence of positive feedback is one condition promoting bistability and permitting brief inputs to switch the system from one attractor state to another. Interestingly, positive feedback mechanisms have also been shown to promote forms of bistability that determine cell fate decisions [100–102].
In sum, this discussion of dynamical networks exemplifies the idea that memory (and decision-making) can be dynamically realized through bistability or multistability in the dynamics of the underlying network. Empirically, examples of bistable behaviour have been reported in both single neurons and neuronal networks [103–105].
This body of work in neuroscience can provide a global-level insight into analogous processes conducted by bioelectric networks that include non-neural cells. One possible way to understand the ability of Cryptic planaria to regenerate either one- or two-headed forms stochastically is that a planarian body can have two (or more) latent pattern memories, but only one gets expressed upon injury. Below we discuss in more detail another example from computational neuroscience: the functioning of episodic memory mechanisms in the mammalian hippocampus, which is considered an excellent model system to study memory and attractor dynamics and also exhibits a form of bistability.
5. The hippocampal episodic memory code
It is widely assumed that the hippocampus can encode multiple (episodic) memories and spatial representations [106]. As discussed above, the episodic memories may be ‘stored’ as attractor states in (hippocampal) recurrent neural networks; this representation is convenient as it is high capacity (because it minimizes interferences between different memories) and affords pattern completion, thus permitting complete memories to be recalled from a subset of the cues that were present when they were first encoded; see [95,96] for computational analyses using Hopfield-style neural networks. Indeed, a large body of empirical and theoretical work supports the hypothesis that the hippocampus may encode memories and spatial representations such as place cells (e.g. hippocampal cells that code for specific spatial locations) as distinct attractor states [107]. The hippocampus encodes distinct spatial representations for different spatial maps. It has been shown that in the rodent hippocampus, a gradual morphing of the spatial environment that the animal experiences produces an abrupt transition between spatial representations of two distinct maps, hence lending support to the attractor hypothesis [108].
Interestingly, episodic memories may not be encoded as single states in the hippocampus, but as sequences of states. Rodent research has elucidated that episodic memories that relate to spatial navigation, such as, for example, spatial trajectories to specific reward locations, may be encoded as sequences of place cells that code for specific spatial locations along the trajectory—in such a way that each episode corresponds to a sequence of place cells, not a single place cell.
The ‘stored’ sequences can be activated by external cues but they can also be endogenously (re)generated in a time-compressed manner, in at least two ways. First, so-called sharp-wave ripple (SWR) sequences arise spontaneously when the animal is sleeping or during wakeful rest [109]. SWR sequences are expressed as part of the (very fast) neural SWR complex, can span several metres [110], and are non-local, i.e. they need not (and usually do not) encode the animal's current location. For example, when the animal sleeps, SWR sequences usually ‘replay’ experienced trajectories in a forward or a reverse direction [111]. SWR sequences have been widely implied in memory consolidation and planning [112–115].
Second, so-called theta sequences are present during active spatial navigation, when the hippocampus expresses a theta rhythm (one theta sequence for each theta cycle) [116]. Theta sequences are typically shorter than SWR sequences and are local, i.e. they include an ordered set of place cells that code for a few previous positions, the current position and a few future positions of the animal. Theta sequences have been mainly implied in memory encoding, short-term prediction [117] and—importantly for our discussion—the estimation of the current navigation context or episode.
6. Theta flickering: temporal bistability in memory
Above we discussed how the hippocampus may function as an attractor network encoding memories or spatial representations as stable states or sequences of stable states, which can then be retrieved by incomplete cues (or endogenously reactivated in the absence of external stimuli). However, there are cases in which a rodent abruptly enters a novel environment and, in those cases, spatial representations (and episodic memories) of the past and the present environment compete for selection. Interestingly, in the hippocampus, this competitive process is resolved as a series of rapid switches between two (or perhaps more) competing sets of spatial representations or theta sequences expressed by the same hippocampal network—a phenomenon called ‘theta flickering’ [118].
Specifically, in a rodent experiment in which the environmental cues were instantaneously changed (as if the animal was ‘teleported’), the hippocampus expressed a sort of ‘bistability’ of episodic memories, with repeated switches between spatial representations of the past and the present environment (expressed in different theta cycles) and then settled on the correct representation (i.e. of the present environment) after a few cycles [118]. In other words, within each theta cycle, it was possible to decode a spatial representation that referred to either the previous or the current environment, but not both simultaneously (figure 3).
In sum, theta flickering in the hippocampus illustrates the possibility of having two simultaneous but conflicting memories and rapidly flickering between them. This can be considered a kind of temporal bistability, as the two memories are expressed sequentially (i.e. in different theta cycles), without overlaps within single theta cycle, similar to the case of binocular rivalry. From an attractor network viewpoint, this phenomenon can arise when the same neural network rapidly switches between multiple competing stable states or sequences of stable states.
7. A generative modelling perspective on flickering and stochastic memories
There is another (not mutually exclusive) perspective on flickering and stochastic memories that comes from the field of statistics and Bayesian inference. In this perspective, the brain encodes a probabilistic internal model of external events and dynamics [119,120]. This model includes a distribution of (latent) states or memories that can be stochastically resampled to generate novel, imaginary experiences that resemble (but are not identical to) stored memories—hence the label ‘generative’.
From a generative modelling perspective, theta flickering may support contextual estimation, e.g. the estimation of the spatial context or map the animal is currently in, by reactivating hippocampal spatial representations (or sequences) corresponding to different maps. When the animal is uncertain about being in environment 1 or 2, it may stochastically sample from its hippocampal spatial memories of environment 1 (in one theta cycle) and then of environment 2 (at the next theta cycle) and match these sampled representations with the incoming sensory cues. This error-correction mechanism that eventually converges to the correct hypothesis (e.g. I am in environment 1) when prediction errors generated by one of the two competing memories are minimized [113,121,122]. In other words, reactivating spatial representations of different maps permits using them as alternative hypotheses to be tested against sensory cues and the competition settles the generative model in one hypothesis or the other. This mechanism is analogous to the competition between options occurring within dynamical network models of decision-making, or between alternative percepts in binocular rivalry, but rests on the possibility to sample stochastically from a generative model rather than on bistable neural network.
The idea of sampling stochastically from generative models has been extensively explored in computational neuroscience [123–125]. One of the most popular incarnations of this idea in machine learning is the variational autoencoder or VAE [126], which learns a low-dimensional internal representation or ‘memory’ of its training data (e.g. images or videos) that affords a good reconstruction of the same data as well as the generation of novel examples of unseen data (e.g. novel images that combine parts of learned images).
The VAE comprises two components, both usually implemented as (deep) neural networks, trained together using backpropagation. The first component, the encoder, learns to compress its inputs in a low-dimensional feature vector or ‘compressed memory’ Z. The second component, the decoder, learns to reconstruct the input using the feature vector Z, produced by the encoder—which implies that the VAE must learn (low-dimensional) Z vectors that capture essential components of its inputs. What makes the VAE particularly efficient is that, during learning, it enforces both an accurate reconstruction of the input and the acquisition of internal Z codes that are not sparse (or too spread from a prior distribution) and afford good interpolation.
The elements of Z are (Gaussian) probability distributions (more specifically, the VAE learns two vectors, one for Z means and one for Z standard deviations), which can be stochastically sampled after learning to generate novel examples of data that are similar but not identical to the training data (e.g. novel face images that combine features of observed faces). The VAE and similar generative models hence provide a more constructivist view of memory compared to attractor networks, as they store (and sample from) a model of the data, not the data themselves.
There are several other examples of computational models that incorporate similar principles (of generative modelling) to VAE, but are more concerned with biological realism. These include, for example, predictive coding models of visual perception [119,127], active inference models of action dynamics [128–130] and networks of spiking neurons [131–133], which may shed light on biological implementations of probabilistic ‘memories’ of data and stochastic resampling from memory, as in the case of hippocampal theta-paced flickering [113].
8. Memory consolidation and construction
Generative models like the VAE are viable methods to learn (probabilistic) memories that can be stochastically resampled. Yet, the memory systems of biological organisms are much more sophisticated than our current machine learning models. In biological brains, memory is plausibly a systems-level function, to which several brain areas may contribute differentially.
According to the influential ‘dual memories’ theory, novel memories are first acquired by the hippocampus (whose connectivity affords rapid, one-shot learning) and successively transferred to and consolidated in the cortex (where learning is slower)—with SWR sequences possibly playing a key role in such memory consolidation process [134]. The general idea is that (episodic) hippocampal memories are ‘replayed’ multiple times, especially overnight, and the replays essentially ‘train’ the cortex to form its (semantic) memories. Supporting this view is the fact that interrupting replays interferes with memory consolidation [135,136]. Note that similar ‘experience replay’ and ‘generative replay’ methods are widely used in machine learning to improve the robustness of neural networks during training [122,137,138]. Recent studies are increasingly showing that the interplay between hippocampal and cortical networks may be more sophisticated and bidirectional than previously believed, hence permitting the reciprocal shaping of episodic and semantic memories during consolidation [113,139].
This also implies that during consolidation, memories not only become stronger (in the sense that they are protected from interference) but they can also change, at least partially. It has long been known that memory consolidation and retrieval—but of course also memory-based imagination [140–142]—are highly constructive processes [143–145]. One example of constructive memory is the fact that some memories can be (unconsciously) completed with information that is coherent with them, or just imagined—thus giving rise to ‘false memories’, e.g. the memory that Tom was at my last birthday party. Similarly, specific elements not initially present in an episodic memory can ‘intrude’ later on, when the memory is consolidated or retrieved—perhaps to make the memory (retrospectively) coherent with novel information (e.g. if I am told that Tom was at the party); with some ‘schematic’ information (e.g. Tom attends all parties); or with one's self-image. These examples suggest that memory consolidation and retrieval may be better seen as constructive, inferential processes rather than verbatim storages of events. Remarkably, this kind of consolidation and embellishment also occurs in morphogenesis: Cryptic planaria, with an altered bioelectric memory but normal one-headed anatomy, have an approximately 30% chance in each recutting and regeneration round (a memory recall event) of becoming permanently two-headed—a stronger phenotype (with a more robustly altered pattern memory, since middle fragments of two-head worms never give rise to anything but two-head worms). In the next section, we discuss how brief changes in bioelectric state result in novel anatomical modifications that are long-term stable and can actually get stronger over time.
9. Long-term bioelectric memory in planarian tissues
One of the novel aspects of our hypothesis is the claim that tissue bioelectric states can underlie long-term memory. In other words, the planarian case may be analogous to the case of an attractor network, where the system is placed in a different attractor state of the bioelectric circuit guiding head number and stays there even after removal of the triggering stimulus that altered the bioelectric target morphology. This is unexpected, as standard models of tissue physiology treat bioelectric patterns as house-keeping parameters that quickly revert to normal levels after modulation. Thus, we tested this counterintuitive prediction in planaria by depolarizing the somatic tissues, and examining their bioelectric state weeks later (figure 4).
Ionophore treatment is a reliable method to manipulate resting membrane voltage (Vmem) in planaria because it collapses concentration gradients of specific ions and thus modifies resting potential. We used the ionophore Nigericin, a specific ionophore of potassium as we have previously found transient soaks in nigericin to consistently result in significant depolarization of somatic tissue during drug treatment [81]. To assess whether induced bioelectric states could persist over longer periods of time, long after the ionophore is removed, intact D. japonica were treated with a 0.27 µM Nigericin with a 15 mM K-Gluconate (sigma Aldrich G4500) solution for 3 days, after which the solution was washed out and samples were cultured in Poland Spring water (at 13°C to prevent fissioning). After three weeks in water, membrane polarization was quantified using the voltage-sensitive dye DiBAC4(3) [81,82,146]. Relative membrane polarization was tracked at two different time points: worms that had been removed from Nigericin and were put in water for one week (one week washout), worms that had been removed from Nigericin 3 weeks prior to DiBAC imaging (three week washout), and a wild-type control group that had never been drug-treated. Both of the Nigericin-treated groups were significantly depolarized relative to controls (**p < 0.01 Student's T-test), while there were no significant differences between the treated samples. Note also that the altered pattern gets stronger between one and three weeks (with no further treatment), as discussed above in the context of consolidation and construction of memories in the brain. These data reveal the remarkable fact that very brief alterations of bioelectric mechanics are remembered by tissue as long-term stable alterations in resting membrane potential in planaria.
10. Conclusion
Regeneration highlights numerous aspects of robust control that are challenging to explain via purely molecular-genetic pathway paradigms. These include: the ability of cellular systems to coordinate activity across large distances, to process spatial information at multiple scales (including those much bigger than single cells), to integrate stochastic and noisy behaviour of micro-agents into organ-level decisions, to store ‘potential’, future, or ‘counterfactual’ pattern memories that may be latent (not expressed as anatomy now, but guiding future anatomical events if recalled by injury) in addition to ones that are expressed (as control of morphogenetic mechanisms in the current anatomy), and to organize activity that works towards specific invariant outcomes (anatomical specifications) despite perturbations. Decades of work in neuroscience provide a rich background from which to seek novel perspectives on this problem. Consistent with this, bistability has been described in bioelectric phenomena at many scales—from ion channels to individual neurons, neural circuits and whole tissues [147–153]. Importantly, the similarity between decision-making mediated by neuronal tissue and decision-making during active morphogenesis is not only a functional metaphor [154], but this similarity also reflects profound molecular conservation of mechanisms, as neural networks evolved from ancient pre-neural bioelectric mechanisms that were guiding morphogenesis long before they were sped up and harnessed to the control of motile organism-level behaviour.
Thus, we suggest that this deep symmetry between control of cell behaviour by pre-neural networks and control of animal behaviour by the nervous system can drive a rich experimental research programme. Just some of the future opportunities include: the use of experiences and sensory data to train tissues and organs to specific morphogenetic outcomes via behaviour-shaping paradigms, the use of pharmacological tools targeting brain memory pathways to modify stored pattern memories (and thus anatomy) in vivo, the extension of neural network modelling tools and content extraction pipelines (used in neural decoding) to understand the anatomical states encoded in developmental bioelectric prepatterns and develop strategies for reading and writing pattern memories (as well as constructing synthetic tissues capable of holding and acting on such memories), and the use of psychopharmacological agents (neurotransmitter drugs, hallucinogens, etc.) to modify the perception and processing of structural ‘sensory’ data as cells and tissues ascertain the current anatomical layout of the body. It is likely that concepts from computational psychiatry [155–157] may have a lot of bearing on the systems-level causes in complex disease states like cancer [158,159] and birth defects [160,161]. The consilience of tools and conceptual approaches between the study of cognitive memory and the efforts to control growth and form is not only likely to transform regenerative medicine and synthetic bioengineering, but may also help cognitive neuroscience understand how computational agents (proto-minds) arise from cellular structure.
Acknowledgements
We thank many people in the neuroscience, AI and regenerative biology communities for many helpful discussions.
Data accessibility
Primary data are available as electronic supplementary material.
Author contributions
G.P. and M.L. conceived the ideas and wrote most of the manuscript. F.D. and J.L.P. performed the ionophore experiments and produced the figure and text analyzing the ionophore data.
Competing interests
We declare we have no competing interests.
Funding
M.L. is supported by the Paul G. Allen Frontiers Group (via an Allen Discovery Center Award 12171), as well as the Templeton World Charity Foundation (WCF0089/AB55 and TWCF0140). This research has received funding from the European Union's Horizon 2020 Framework Programme for Research and Innovation under the Specific Grant Agreement No. 785907 (Human Brain Project SGA2 to G.P.).
References
- 1.Lawrence PA, Levine M. 2006. Mosaic and regulative development: two faces of one coin. Curr. Biol. 16, R236-R239. ( 10.1016/j.cub.2006.03.016) [DOI] [PubMed] [Google Scholar]
- 2.Shelton JN. 1988. Embryo manipulation in research and animal production. Aust. J. Biol. Sci. 41, 117-132. ( 10.1071/BI9880117) [DOI] [PubMed] [Google Scholar]
- 3.Vandenberg LN, Adams DS, Levin M. 2012. Normalized shape and location of perturbed craniofacial structures in the Xenopus tadpole reveal an innate ability to achieve correct morphology. Dev. Dyn. Off. Publ. Am. Assoc. Anat. 241, 863-878. ( 10.1002/dvdy.23770) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Farinella-Ferruzza N. 1956. The transformation of a tail into limb after xenoplastic transplantation. Experientia 12, 304-305. ( 10.1007/BF02159624) [DOI] [Google Scholar]
- 5.Holtfreter J. 1955. Transformation of a tail into a limb or gill-like structures. J. Exp. Zool. 129, 623-648. ( 10.1002/jez.1401290310) [DOI] [Google Scholar]
- 6.McCusker C, Gardiner DM. 2011. The axolotl model for regeneration and aging research: a mini-review. Gerontology 57, 565-571. ( 10.1159/000323761) [DOI] [PubMed] [Google Scholar]
- 7.Pezzulo G, Levin M. 2016. Top-down models in biology: explanation and control of complex living systems above the molecular level. J. R. Soc. Interface 13, 20160555. ( 10.1098/rsif.2016.0555) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Baluška F, Levin M. 2016. On having no head: cognition throughout biological systems. Cogn. Sci. 7, 902. ( 10.3389/fpsyg.2016.00902) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Calvo P, Baluška F. 2015. Conditions for minimal intelligence across eukaryota: a cognitive science perspective. Front. Psychol. 6, 1329. ( 10.3389/fpsyg.2015.01329) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Keijzer F, van Duijn M, Lyon P. 2013. What nervous systems do: early evolution, input–output, and the skin brain thesis. Adapt. Behav. 21, 67-85. ( 10.1177/1059712312465330) [DOI] [Google Scholar]
- 11.Lyon P. 2015. The cognitive cell: bacterial behavior reconsidered. Front. Microbiol. 6, 264. ( 10.3389/fmicb.2015.00264) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Lyon P. 2006. The biogenic approach to cognition. Cogn. Process. 7, 11-29. ( 10.1007/s10339-005-0016-8) [DOI] [PubMed] [Google Scholar]
- 13.Reid CR, Garnier S, Beekman M, Latty T. 2015. Information integration and multiattribute decision making in non-neuronal organisms. Anim. Behav. 100, 44-50. ( 10.1016/j.anbehav.2014.11.010) [DOI] [Google Scholar]
- 14.Vallverdu J, et al. 2018. Slime mould: the fundamental mechanisms of biological cognition. Biosystems 165, 57-70. ( 10.1016/j.biosystems.2017.12.011) [DOI] [PubMed] [Google Scholar]
- 15.Manicka S, Levin M. 2019. The cognitive lens: a primer on conceptual tools for analysing information processing in developmental and regenerative morphogenesis. Phil. Trans. R. Soc. B 374, 20180369. ( 10.1098/rstb.2018.0369) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Bessonov N, Levin M, Morozova N, Reinberg N, Tosenberger A, Volpert V. 2015. Target morphology and cell memory: a model of regenerative pattern formation. Neural Regen. Res. 10, 1901-1905. ( 10.4103/1673-5374.165216) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Blackiston D, Shomrat T, Levin M. 2015. The stability of memories during brain remodeling: a perspective. Commun. Integr. Biol. 8, e1073424. ( 10.1080/19420889.2015.1073424) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Pezzulo G, Levin M. 2015. Re-membering the body: applications of computational neuroscience to the top-down control of regeneration of limbs and other complex organs. Integr. Biol. 7, 1487-1517. ( 10.1039/C5IB00221D) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Keijzer FA. 2017. Evolutionary convergence and biologically embodied cognition. Interface Focus 7, 20160123. ( 10.1098/rsfs.2016.0123) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Fields C, Bischof J, Levin M. 2020. Morphological coordination: a common ancestral function unifying neural and non-neural signaling. Physiology 35, 16-30. ( 10.1152/physiol.00027.2019) [DOI] [PubMed] [Google Scholar]
- 21.Humphries J, Xiong L, Liu J, Prindle A, Yuan F, Arjes HA, Tsimring L, Süel GM. 2017. Species-independent attraction to biofilms through electrical signaling. Cell 168, 200-209.e12. ( 10.1016/j.cell.2016.12.014) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Prindle A, Liu J, Asally M, Ly S, Garcia-Ojalvo J, Süel GM. 2015. Ion channels enable electrical communication in bacterial communities. Nature 527, 59-63. ( 10.1038/nature15709) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Yang C-Y, Bialecka-Fornal M, Weatherwax C, Larkin JW, Prindle A, Liu J, Garcia-Ojalvo J, Süel GM. 2020. Encoding membrane-potential-based memory within a microbial community. Cell Syst. 10, 417-423.e3. ( 10.1016/j.cels.2020.04.002) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Liu J, Martinez-Corral R, Prindle A, Lee DD, Larkin J, Gabalda-Sagarra M, Garcia-Ojalvo J, Süel GM. 2017. Coupling between distant biofilms and emergence of nutrient time-sharing. Science 356, 638-642. ( 10.1126/science.aah4204) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Lund EJ, Rosene HF. 1947. Bioelectric fields and growth. With a bibliography of continuous bioelectric currents and bioelectric fields in animals and plants by HF Rosene. Austin, Texas: University of Texas Press. [Google Scholar]
- 26.Miller AL. 1989. Ion currents and growth regulators in plant root development. Biol. Bull. 176, 65-70. ( 10.2307/1541651) [DOI] [PubMed] [Google Scholar]
- 27.Rathore KS, Goldsworthy A. 1985. Electrical control of growth in plant tissue cultures. Bio/technology 3, 253-254. [Google Scholar]
- 28.Goldsworthy A. 1983. The evolution of plant action potentials. J. Theor. Biol. 103, 645-648. ( 10.1016/0022-5193(83)90287-4) [DOI] [Google Scholar]
- 29.Goodwin B, Pateromichelakis S. 1979. The role of electrical fields, ions, and the cortex in the morphogenesis of Acetabularia. Planta 145, 427-435. ( 10.1007/BF00380096) [DOI] [PubMed] [Google Scholar]
- 30.Baluška F, Mancuso S. 2013. Ion channels in plants: from bioelectricity, via signaling, to behavioral actions. Plant Signal. Behav. 8, e23009. ( 10.4161/psb.23009) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Mathews AP. 1903. Electrical polarity in the hydroids. Am. J. Physiol.-Leg. Content 8, 294-299. ( 10.1152/ajplegacy.1903.8.4.294) [DOI] [Google Scholar]
- 32.Bates E. 2015. Ion channels in development and cancer. Annu. Rev. Cell Dev. Biol. 31, 231-247. ( 10.1146/annurev-cellbio-100814-125338) [DOI] [PubMed] [Google Scholar]
- 33.Levin M, Martyniuk CJ. 2017. The bioelectric code: an ancient computational medium for dynamic control of growth and form. Biosystems 164, 76-93. ( 10.1016/j.biosystems.2017.08.009) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Pai VP, Lemire JM, Chen Y, Lin G, Levin M. 2015. Local and long-range endogenous resting potential gradients antagonistically regulate apoptosis and proliferation in the embryonic CNS. Int. J. Dev. Biol. 59, 327-340. ( 10.1387/ijdb.150197ml) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Pai VP, Lemire JM, Pare JF, Lin G, Chen Y, Levin M. 2015. Endogenous gradients of resting potential instructively pattern embryonic neural tissue via notch signaling and regulation of proliferation. J. Neurosci. 35, 4366-4385. ( 10.1523/JNEUROSCI.1877-14.2015) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Dahal GR, Pradhan SJ, Bates EA. 2017. Inwardly rectifying potassium channels influence Drosophila wing morphogenesis by regulating Dpp release. Development 144, 2771-2783. ( 10.1242/dev.146647) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.George LF, Pradhan SJ, Mitchell D, Josey M, Casey J, Belus MT, Dahal GR, Bates EA. 2019. Ion channel contributions to wing development in Drosophila melanogaster. G3 Bethesda 9, 999-1008. ( 10.1534/g3.119.400028) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Adams DS, Uzel SG, Akagi J, Wlodkowic D, Andreeva V, Yelick PC, Devitt-Lee A, Pare JF, Levin M. 2016. Bioelectric signalling via potassium channels: a mechanism for craniofacial dysmorphogenesis in KCNJ2-associated Andersen-Tawil Syndrome. J. Physiol. 594, 3245-3270. ( 10.1113/JP271930) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Vandenberg LN, Morrie RD, Adams DS. 2011. V-ATPase-dependent ectodermal voltage and pH regionalization are required for craniofacial morphogenesis. Dev. Dyn. 240, 1889-1904. ( 10.1002/dvdy.22685) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Pai VP, Aw S, Shomrat T, Lemire JM, Levin M. 2012. Transmembrane voltage potential controls embryonic eye patterning in Xenopus laevis. Development 139, 313-323. ( 10.1242/dev.073759) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.McLaughlin KA, Levin M. 2018. Bioelectric signaling in regeneration: mechanisms of ionic controls of growth and form. Dev. Biol. 433, 177-189. ( 10.1016/j.ydbio.2017.08.032) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Kortum F, et al. 2015. Mutations in KCNH1 and ATP6V1B2 cause Zimmermann-Laband syndrome. Nat. Genet. 47, 661-667. ( 10.1038/ng.3282) [DOI] [PubMed] [Google Scholar]
- 43.Masotti A, et al. 2015. Keppen-Lubinsky syndrome is caused by mutations in the inwardly rectifying K+ channel encoded by KCNJ6. Am. J. Hum. Genet. 96, 295-300. ( 10.1016/j.ajhg.2014.12.011) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Tristani-Firouzi M, Etheridge SP. 2010. Kir 2.1 channelopathies: the Andersen-Tawil syndrome. Pflugers Arch. 460, 289-294. ( 10.1007/s00424-010-0820-6) [DOI] [PubMed] [Google Scholar]
- 45.Adams DS, Masi A, Levin M. 2007. H+ pump-dependent changes in membrane voltage are an early mechanism necessary and sufficient to induce Xenopus tail regeneration. Development 134, 1323-1335. ( 10.1242/dev.02812) [DOI] [PubMed] [Google Scholar]
- 46.Tseng AS, Beane WS, Lemire JM, Masi A, Levin M. 2010. Induction of vertebrate regeneration by a transient sodium current. J. Neurosci. 30, 13 192-13 200. ( 10.1523/JNEUROSCI.3315-10.2010) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Chernet BT, Adams DS, Lobikin M, Levin M. 2016. Use of genetically encoded, light-gated ion translocators to control tumorigenesis. Oncotarget 7, 19 575-19 588. ( 10.18632/oncotarget.8036) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Chernet BT, Fields C, Levin M. 2015. Long-range gap junctional signaling controls oncogene-mediated tumorigenesis in Xenopus laevis embryos. Front. Physiol. 5, 519. ( 10.3389/fphys.2014.00519) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Chernet BT, Levin M. 2013. Transmembrane voltage potential is an essential cellular parameter for the detection and control of tumor development in a Xenopus model. Dis. Model. Mech. 6, 595-607. ( 10.1242/dmm.010835) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Chernet BT, Levin M. 2014. Transmembrane voltage potential of somatic cells controls oncogene-mediated tumorigenesis at long-range. Oncotarget 5, 3287-3306. ( 10.18632/oncotarget.1935) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Emmons-Bell M, et al. 2015. Gap junctional blockade stochastically induces different species-specific head anatomies in genetically wild-type Girardia dorotocephala flatworms. Int. J. Mol. Sci. 16, 27 865-27 896. ( 10.3390/ijms161126065) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Sullivan KG, Emmons-Bell M, Levin M. 2016. Physiological inputs regulate species-specific anatomy during embryogenesis and regeneration. Commun. Integr. Biol. 9, e1192733. ( 10.1080/19420889.2016.1192733) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Cisek P. 2019. Resynthesizing behavior through phylogenetic refinement. Atten. Percept. Psychophys. 81, 2265-2287. ( 10.3758/s13414-019-01760-1) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Pezzulo G, Castelfranchi C. 2009. Thinking as the control of imagination: a conceptual framework for goal-directed systems. Psychol. Res. 73, 559-577. ( 10.1007/s00426-009-0237-z) [DOI] [PubMed] [Google Scholar]
- 55.Pezzulo G, Cisek P. 2016. Navigating the affordance landscape: feedback control as a process model of behavior and cognition. Trends Cogn. Sci. 20, 414-424. ( 10.1016/j.tics.2016.03.013) [DOI] [PubMed] [Google Scholar]
- 56.Busse SM, McMillen PT, Levin M. 2018. Cross-limb communication during Xenopus hindlimb regenerative response: non-local bioelectric injury signals. Development 145, dev164210. ( 10.1242/dev.164210) [DOI] [PubMed] [Google Scholar]
- 57.Levin M, Pezzulo G, Finkelstein JM. 2017. Endogenous bioelectric signaling networks: exploiting voltage gradients for control of growth and form. Annu. Rev. Biomed. Eng. 19, 353-387. ( 10.1146/annurev-bioeng-071114-040647) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Cervera J, Pietak A, Levin M, Mafe S. 2018. Bioelectrical coupling in multicellular domains regulated by gap junctions: a conceptual approach. Bioelectrochemistry 123, 45-61. ( 10.1016/j.bioelechem.2018.04.013) [DOI] [PubMed] [Google Scholar]
- 59.Pietak A, Levin M. 2016. Exploring instructive physiological signaling with the bioelectric tissue simulation engine (BETSE). Front. Bioeng. Biotechnol. 4, 55. ( 10.3389/fbioe.2016.00055) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Pietak A, Levin M. 2017. Bioelectric gene and reaction networks: computational modelling of genetic, biochemical and bioelectrical dynamics in pattern regulation. J. R Soc. Interface 14, 20170425. ( 10.1098/rsif.2017.0425) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Cervera J, Levin M, Mafe S. 2020. Bioelectrical coupling of single-cell states in multicellular systems. J. Phys. Chem. Lett. 11, 3234-3241. ( 10.1021/acs.jpclett.0c00641) [DOI] [PubMed] [Google Scholar]
- 62.Cervera J, Meseguer S, Levin M, Mafe S. 2020. Bioelectrical model of head-tail patterning based on cell ion channels and intercellular gap junctions. Bioelectrochemistry 132, 107410. ( 10.1016/j.bioelechem.2019.107410) [DOI] [PubMed] [Google Scholar]
- 63.Cervera J, Pai VP, Levin M, Mafe S. 2019. From non-excitable single-cell to multicellular bioelectrical states supported by ion channels and gap junction proteins: electrical potentials as distributed controllers. Prog. Biophys. Mol. Biol. 149, 39-53. ( 10.1016/j.pbiomolbio.2019.06.004) [DOI] [PubMed] [Google Scholar]
- 64.Cervera J, Manzanares JA, Mafe S, Levin M. 2019. Synchronization of bioelectric oscillations in networks of nonexcitable cells: from single-cell to multicellular states. J. Phys. Chem. B 123, 3924-3934. ( 10.1021/acs.jpcb.9b01717) [DOI] [PubMed] [Google Scholar]
- 65.Pai VP, Pietak A, Willocq V, Ye B, Shi NQ, Levin M. 2018. HCN2 rescues brain defects by enforcing endogenous voltage pre-patterns. Nat. Commun. 9, 1-5. ( 10.1038/s41467-018-03334-5) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.McNamara HM, Dodson S, Huang Y-L, Miller EW, Sandstede B, Cohen AE. 2018. Geometry-dependent arrhythmias in electrically excitable tissues. Cell Syst. 7, 359-370. ( 10.1016/j.cels.2018.08.013) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.McNamara HM, Zhang H, Werley CA, Cohen AE. 2016. Optically controlled oscillators in an engineered bioelectric tissue. Phys. Rev. X 6, 031001. ( 10.1103/physrevx.6.031001) [DOI] [Google Scholar]
- 68.McNamara HM, Salegame R, Al Tanoury Z, Xu H, Begum S, Ortiz G, Pourquie O, Cohen AE. 2020. Bioelectrical signaling via domain wall migration. Nat. Phys. 16, 357-364. ( 10.1038/s41567-019-0765-4) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Johnson A, Fenton AA, Kentros C, Redish AD. 2009. Looking for cognition in the structure within the noise. Trends Cogn. Sci. 13, 55-64. ( 10.1016/j.tics.2008.11.005) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Kay KN, Naselaris T, Prenger RJ, Gallant JL. 2008. Identifying natural images from human brain activity. Nature 452, 352-355. ( 10.1038/nature06713) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Wallis JD. 2018. Decoding cognitive processes from neural ensembles. Trends Cogn. Sci. 22, 1091-1102. ( 10.1016/j.tics.2018.09.002) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Levin M, Pietak AM, Bischof J. 2018. Planarian regeneration as a model of anatomical homeostasis: recent progress in biophysical and computational approaches. Semin. Cell Dev. Biol. 87, 125-144. ( 10.1016/j.semcdb.2018.04.003) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Salo E, et al. 2009. Planarian regeneration: achievements and future directions after 20 years of research. Int. J. Dev. Biol. 53, 1317-1327. ( 10.1387/ijdb.072414es) [DOI] [PubMed] [Google Scholar]
- 74.Durant F, Lobo D, Hammelman J, Levin M. 2016. Physiological controls of large-scale patterning in planarian regeneration: a molecular and computational perspective on growth and form. Regen. Oxf 3, 78-102. ( 10.1002/reg2.54) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Beane WS, Morokuma J, Lemire JM, Levin M. 2013. Bioelectric signaling regulates head and organ size during planarian regeneration. Development 140, 313-322. ( 10.1242/dev.086900) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Beane WS, Morokuma J, Adams DS, Levin M. 2011. A chemical genetics approach reveals H,K-ATPase-mediated membrane voltage is required for planarian head regeneration. Chem. Biol. 18, 77-89. ( 10.1016/j.chembiol.2010.11.012) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Oviedo NJ, Morokuma J, Walentek P, Kema IP, Gu MB, Ahn JM, Hwang JS, Gojobori T, Levin M. 2010. Long-range neural and gap junction protein-mediated cues control polarity during planarian regeneration. Dev. Biol. 339, 188-199. ( 10.1016/j.ydbio.2009.12.012) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Beisson J. 2008. Preformed cell structure and cell heredity. Prion 2, 1-8. ( 10.4161/pri.2.1.5063) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Pilling OA, Rogers AJ, Gulla-Devaney B, Katz LA. 2017. Insights into transgenerational epigenetics from studies of ciliates. Eur. J. Protistol. 61, 366-375. ( 10.1016/j.ejop.2017.05.004) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Fields C, Levin M. 2017. Multiscale memory and bioelectric error correction in the cytoplasm–cytoskeleton-membrane system. Wiley Interdiscip. Rev. Syst. Biol. Med. 10, e1410. ( 10.1002/wsbm.1410) [DOI] [PubMed] [Google Scholar]
- 81.Durant F, Bischof J, Fields C, Morokuma J, LaPalme J, Hoi A, Levin M. 2019. The role of early bioelectric signals in the regeneration of planarian anterior/posterior polarity. Biophys. J. 116, 948-961. ( 10.1016/j.bpj.2019.01.029) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Durant F, Morokuma J, Fields C, Williams K, Adams DS, Levin M. 2017. Long-term, stochastic editing of regenerative anatomy via targeting endogenous bioelectric gradients. Biophys. J. 112, 2231-2243. ( 10.1016/j.bpj.2017.04.011) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Balaban NQ, Merrin J, Chait R, Kowalik L, Leibler S. 2004. Bacterial persistence as a phenotypic switch. Science 305, 1622-1625. ( 10.1126/science.1099390) [DOI] [PubMed] [Google Scholar]
- 84.Kussell E, Kishony R, Balaban NQ, Leibler S. 2005. Bacterial persistence: a model of survival in changing environments. Genetics 169, 1807-1814. ( 10.1534/genetics.104.035352) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Pietak A, Bischof J, LaPalme J, Morokuma J, Levin M. 2019. Neural control of body-plan axis in regenerating planaria. PLoS Comput. Biol. 15, e1006904. ( 10.1371/journal.pcbi.1006904) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Bischof J, Day ME, Miller KA, LaPalme J, Levin M. 2019. Nervous system and tissue polarity dynamically adapt to new morphologies in planaria. bioRxiv, 815688. ( 10.1101/815688) [DOI]
- 87.Levin M, Thorlin T, Robinson KR, Nogi T, Mercola M. 2002. Asymmetries in H+/K+-ATPase and cell membrane potentials comprise a very early step in left-right patterning. Cell 111, 77-89. ( 10.1016/S0092-8674(02)00939-X) [DOI] [PubMed] [Google Scholar]
- 88.Lobikin M, Lobo D, Blackiston DJ, Martyniuk CJ, Tkachenko E, Levin M. 2015. Serotonergic regulation of melanocyte conversion: a bioelectrically regulated network for stochastic all-or-none hyperpigmentation. Sci. Signal 8, ra99. ( 10.1126/scisignal.aac6609) [DOI] [PubMed] [Google Scholar]
- 89.Lobo D, Lobikin M, Levin M. 2017. Discovering novel phenotypes with automatically inferred dynamic models: a partial melanocyte conversion in Xenopus. Sci. Rep. 7, 41339. ( 10.1038/srep41339) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Moreno-Bote R, Rinzel J, Rubin N. 2007. Noise-induced alternations in an attractor network model of perceptual bistability. J. Neurophysiol. 98, 1125-1139. ( 10.1152/jn.00116.2007) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Deco G, Martí D. 2007. Deterministic analysis of stochastic bifurcations in multi-stable neurodynamical systems. Biol. Cybern. 96, 487-496. ( 10.1007/s00422-007-0144-6) [DOI] [PubMed] [Google Scholar]
- 92.Wang X-J. 2008. Decision making in recurrent neuronal circuits. Neuron 60, 215-234. ( 10.1016/j.neuron.2008.09.034) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Wang X-J. 2002. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36, 955-968. ( 10.1016/S0896-6273(02)01092-9) [DOI] [PubMed] [Google Scholar]
- 94.Grossberg S. 1968. Some nonlinear networks capable of learning a spatial pattern of arbitrary complexity. Proc. Natl Acad. Sci. USA 59, 368-372. ( 10.1073/pnas.59.2.368) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.Hopfield JJ. 1982. Neural networks and physical systems with emergent collective computational abilities. Proc. Natl Acad. Sci. USA 79, 2554-2558. ( 10.1073/pnas.79.8.2554) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Amit DJ, Gutfreund H, Sompolinsky H. 1985. Storing infinite numbers of patterns in a spin-glass model of neural networks. Phys. Rev. Lett. 55, 1530-1533. ( 10.1103/PhysRevLett.55.1530) [DOI] [PubMed] [Google Scholar]
- 97.Kirillov AB, Myre CD, Woodward DJ. 1993. Bistability, switches and working memory in a two-neuron inhibitory-feedback model. Biol. Cybern. 68, 441-449. ( 10.1007/BF00198776) [DOI] [PubMed] [Google Scholar]
- 98.Miller P, Katz DB. 2010. Stochastic transitions between neural states in taste processing and decision-making. J. Neurosci. 30, 2559-2570. ( 10.1523/JNEUROSCI.3047-09.2010) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99.Rabinovich MI, Huerta R, Varona P, Afraimovich VS. 2008. Transient cognitive dynamics, metastability, and decision making. PLoS Comput. Biol. 4, e1000072. ( 10.1371/journal.pcbi.1000072) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 100.Xiong W, Ferrell JE. 2003. A positive-feedback-based bistable ‘memory module’ that governs a cell fate decision. Nature 426, 460-465. ( 10.1038/nature02089) [DOI] [PubMed] [Google Scholar]
- 101.Burrill DR, Silver PA. 2010. Making cellular memories. Cell 140, 13-18. ( 10.1016/j.cell.2009.12.034) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 102.Doncic A, Atay O, Valk E, Grande A, Bush A, Vasen G, Colman-Lerner A, Loog M, Skotheim JM. 2015. Compartmentalization of a bistable switch enables memory to cross a feedback-driven transition. Cell 160, 1182-1195. ( 10.1016/j.cell.2015.02.032) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 103.Merriam EB, Netoff TI, Banks MI. 2005. Bistable network behavior of layer I interneurons in auditory cortex. J. Neurosci. 25, 6175-6186. ( 10.1523/JNEUROSCI.0512-05.2005) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 104.Loewenstein Y, Mahon S, Chadderton P, Kitamura K, Sompolinsky H, Yarom Y, Häusser M. 2005. Bistability of cerebellar Purkinje cells modulated by sensory stimulation. Nat. Neurosci. 8, 202-211. ( 10.1038/nn1393) [DOI] [PubMed] [Google Scholar]
- 105.Shu Y, Hasenstaub A, McCormick DA. 2003. Turning on and off recurrent balanced cortical activity. Nature 423, 288-293. ( 10.1038/nature01616) [DOI] [PubMed] [Google Scholar]
- 106.McNaughton BL, Morris RGM. 1987. Hippocampal synaptic enhancement and information storage within a distributed memory system. Trends Neurosci. 10, 408-415. ( 10.1016/0166-2236(87)90011-7) [DOI] [Google Scholar]
- 107.Treves A, Rolls ET. 1994. Computational analysis of the role of the hippocampus in memory. Hippocampus 4, 374-391. ( 10.1002/hipo.450040319) [DOI] [PubMed] [Google Scholar]
- 108.Wills TJ, Lever C, Cacucci F, Burgess N, O'Keefe J. 2005. Attractor dynamics in the hippocampal representation of the local environment. Science 308, 873-876. ( 10.1126/science.1108905) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 109.Buzsáki G. 2015. Hippocampal sharp wave-ripple: a cognitive biomarker for episodic memory and planning. Hippocampus 25, 1073-1188. ( 10.1002/hipo.22488) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 110.Davidson TJ, Kloosterman F, Wilson MA. 2009. Hippocampal replay of extended experience. Neuron 63, 497-507. ( 10.1016/j.neuron.2009.07.027) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 111.Foster DJ, Wilson MA. 2006. Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature 440, 680-683. ( 10.1038/nature04587) [DOI] [PubMed] [Google Scholar]
- 112.Buzsáki G, Tingley D. 2018. Space and time: the hippocampus as a sequence generator. Trends Cogn. Sci. 22, 853-869. ( 10.1016/j.tics.2018.07.006) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 113.Pezzulo G, Kemere C, van der Meer M. 2017. Internally generated hippocampal sequences as a vantage point to probe future-oriented cognition. Ann. N. Y. Acad. Sci. 1396, 144-165. ( 10.1111/nyas.13329) [DOI] [PubMed] [Google Scholar]
- 114.Pezzulo G, van der Meer MAA, Lansink CS, Pennartz CMA. 2014. Internally generated sequences in learning and executing goal-directed behavior. Trends Cogn. Sci. 18, 647-657. ( 10.1016/j.tics.2014.06.011) [DOI] [PubMed] [Google Scholar]
- 115.Pfeiffer BE, Foster DJ. 2013. Hippocampal place-cell sequences depict future paths to remembered goals. Nature 497, 74-79. ( 10.1038/nature12112) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 116.Foster DJ, Wilson MA. 2007. Hippocampal theta sequences. Hippocampus 17, 1093-1099. ( 10.1002/hipo.20345) [DOI] [PubMed] [Google Scholar]
- 117.Lisman J, Redish AD. 2009. Prediction, sequences and the hippocampus. Phil. Trans. R. Soc. B 364, 1193-1201. ( 10.1098/rstb.2008.0316) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 118.Jezek K, Henriksen EJ, Treves A, Moser EI, Moser M-B. 2011. Theta-paced flickering between place-cell maps in the hippocampus. Nature 478, 246-249. ( 10.1038/nature10439) [DOI] [PubMed] [Google Scholar]
- 119.Friston KJ. 2005. A theory of cortical responses. Phil. Trans. R Soc. B 360, 815-836. ( 10.1098/rstb.2005.1622) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 120.Doya K, Ishii S, Pouget A, Rao RPN (eds). 2007. Bayesian brain: probabilistic approaches to neural coding, 1st edn. Cambridge, MA: MIT Press. See http://www.amazon.com/exe℅bidos/redirect?tag=citeulike07-20&path=ASIN/026204238X. [Google Scholar]
- 121.Penny WD, Zeidman P, Burgess N. 2013. Forward and backward inference in spatial cognition. PLoS Comput. Biol. 9, e1003383. ( 10.1371/journal.pcbi.1003383) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 122.Stoianov I, Maisto D, Pezzulo G.. 2020. The hippocampal formation as a hierarchical generative model supporting generative replay and continual learning. bioRxiv, 908889. ( 10.1101/2020.01.16.908889) [DOI]
- 123.Dayan P, Hinton GE, Neal RM, Zemel RS. 1995. The Helmholtz machine. Neural Comput. 7, 889-904. ( 10.1162/neco.1995.7.5.889) [DOI] [PubMed] [Google Scholar]
- 124.Fiser J, Berkes P, Orbán G, Lengyel M. 2010. Statistically optimal perception and learning: from behavior to neural representations. Trends Cogn. Sci. 14, 119-130. ( 10.1016/j.tics.2010.01.003) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 125.Hinton GE. 2007. To recognize shapes, first learn to generate images. Prog. Brain Res. 165, 535-547. ( 10.1016/S0079-6123(06)65034-6) [DOI] [PubMed] [Google Scholar]
- 126.Kingma DP, Welling M. 2013. Auto-encoding variational bayes. ArXiv Prepr. ArXiv13126114.
- 127.Rao RP, Ballard DH. 1999. Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79-87. ( 10.1038/4580) [DOI] [PubMed] [Google Scholar]
- 128.Friston KJ, FitzGerald T, Rigoli F, Schwartenbeck P, Pezzulo G. 2016. Active inference: a process theory. Neural Comput. 29, 1-49. ( 10.1162/NECO_a_00912) [DOI] [PubMed] [Google Scholar]
- 129.Pezzulo G, Rigoli F, Friston K. 2018. Hierarchical active inference: a theory of motivated control. Trends Cogn. Sci. 22, 294-306. ( 10.1016/j.tics.2018.01.009) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 130.Pezzulo G, Rigoli F, Friston KJ. 2015. Active inference, homeostatic regulation and adaptive behavioural control. Prog. Neurobiol. 136, 17-35. ( 10.1016/j.pneurobio.2015.09.001) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 131.Buesing L, Bill J, Nessler B, Maass W. 2011. Neural dynamics as sampling: a model for stochastic computation in recurrent networks of spiking neurons. PLoS Comput. Biol. 7, e1002211. ( 10.1371/journal.pcbi.1002211) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 132.Klampfl S, Maass W. 2013. Emergence of dynamic memory traces in cortical microcircuit models through STDP. J. Neurosci. 33, 11 515-11 529. ( 10.1523/JNEUROSCI.5044-12.2013) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 133.Rueckert E, Kappel D, Tanneberg D, Pecevski D, Peters J. 2016. Recurrent spiking networks solve planning tasks. Sci. Rep. 6, 21142. ( 10.1038/srep21142) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 134.McClelland JL, McNaughton BL, O'Reilly RC. 1995. Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychol. Rev. 102, 419-457. ( 10.1037/0033-295X.102.3.419) [DOI] [PubMed] [Google Scholar]
- 135.Ego-Stengel V, Wilson MA. 2010. Disruption of ripple-associated hippocampal activity during rest impairs spatial learning in the rat. Hippocampus 20, 1-10. ( 10.1002/hipo.20707) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 136.Girardeau G, Benchenane K, Wiener SI, Buzsáki G, Zugaro MB. 2009. Selective suppression of hippocampal ripples impairs spatial memory. Nat. Neurosci. 12, 1222-1223. ( 10.1038/nn.2384) [DOI] [PubMed] [Google Scholar]
- 137.Andrychowicz M, et al. 2017. Hindsight experience replay. In Advances in neural information processing systems 30 (eds I Guyon, UV Luxburg, S Bengio, H Wallach, R Fergus, S Vishwanathan, R Garnett), pp. 5048–5058. Red Hook, NY: Curran Associates. [Google Scholar]
- 138.Shin H, Lee JK, Kim J, Kim J.. 2017. Continual learning with deep generative replay. ArXiv170508690 Cs.
- 139.Penagos H, Varela C, Wilson MA. 2017. Oscillations, neural computations and learning during wake and sleep. Curr. Opin. Neurobiol. 44, 193-201. ( 10.1016/j.conb.2017.05.009) [DOI] [PubMed] [Google Scholar]
- 140.Addis DR, Cheng T, Roberts RP, Schacter DL. 2011. Hippocampal contributions to the episodic simulation of specific and general future events. Hippocampus 21, 1045-1052. ( 10.1002/hipo.20870) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 141.Atance CM, OíNeill DK. 2001. Episodic future thinking. Trends Cogn. Sci. 5, 533-539. ( 10.1016/S1364-6613(00)01804-0) [DOI] [PubMed] [Google Scholar]
- 142.Gilbert DT, Wilson TD. 2007. Prospection: experiencing the future. Science 317, 1351-1354. ( 10.1126/science.1144161) [DOI] [PubMed] [Google Scholar]
- 143.Schacter DL. 2012. Constructive memory: past and future. Dialog. Clin. Neurosci. 14, 7. ( 10.31887/DCNS.2012.14.1/dschacter) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 144.Schacter DL, Addis DR, Hassabis D, Martin VC, Spreng RN, Szpunar KK. 2012. The future of memory: remembering, imagining, and the brain. Neuron 76, 677-694. ( 10.1016/j.neuron.2012.11.001) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 145.Schacter DL, Addis DR. 2007. The cognitive neuroscience of constructive memory: remembering the past and imagining the future. Phil. Trans. R. Soc. B 362, 773-786. ( 10.1098/rstb.2007.2087) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 146.Oviedo NJ, Nicolas CL, Adams DS, Levin M. 2008. Live imaging of planarian membrane potential using DiBAC4(3). CSH Protoc. 2008, pdb prot5055. ( 10.1101/pdb.prot5055) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 147.Rana MA, Yao N, Mukhopadhyay S, Zhang F, Warren E, Payne C. 2016. Modeling the effect of nanoparticles & the bistability of transmembrane potential in non-excitable cells. In 2016 American Control Conf. (ACC), 6–8 July 2016, pp. 400-405. Boston, MA: IEEE. [Google Scholar]
- 148.Law R, Levin M. 2015. Bioelectric memory: modeling resting potential bistability in amphibian embryos and mammalian cells. Theor. Biol. Med. Model. 12, 22. ( 10.1186/s12976-015-0019-9) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 149.Cang C, Aranda K, Ren D. 2014. A non-inactivating high-voltage-activated two-pore Na+ channel that supports ultra-long action potentials and membrane bistability. Nat. Commun. 5, 5015. ( 10.1038/ncomms6015) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 150.van Mil H, van Heukelom JS, Bier M. 2003. A bistable membrane potential at low extracellular potassium concentration. Biophys. Chem. 106, 15-21. ( 10.1016/S0301-4622(03)00135-2) [DOI] [PubMed] [Google Scholar]
- 151.Williams SR, Christensen SR, Stuart GJ, Häusser M. 2002. Membrane potential bistability is controlled by the hyperpolarization-activated current IH in rat cerebellar Purkinje neurons in vitro. J. Physiol. 539, 469-483. ( 10.1113/jphysiol.2001.013136) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 152.Foppen RG, Van Mil H, van Heukelom JS. 2002. Effects of chloride transport on bistable behaviour of the membrane potential in mouse skeletal muscle. J. Physiol. 542, 181-191. ( 10.1113/jphysiol.2001.013298) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 153.Marom S. 1994. A note on bistability in a simple synapseless ‘point neuron’ model. Netw. Comput. Neural Syst. 5, 327-331. ( 10.1088/0954-898X_5_3_001) [DOI] [Google Scholar]
- 154.Grossberg S. 1978. Communication, memory, and development. Prog. Theor. Biol. 5, 183-232. ( 10.1016/B978-0-12-543105-7.50012-9) [DOI] [Google Scholar]
- 155.Adams RA, Huys QJ, Roiser JP. 2016. Computational psychiatry: towards a mathematically informed understanding of mental illness. J. Neurol. Neurosurg. Psychiatry 87, 53-63. ( 10.1136/jnnp-2015-310737) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 156.Friston KJ, Stephan KE, Montague R, Dolan RJ. 2014. Computational psychiatry: the brain as a phantastic organ. Lancet Psychiatry 1, 148-158. ( 10.1016/S2215-0366(14)70275-5) [DOI] [PubMed] [Google Scholar]
- 157.Wang XJ, Krystal JH. 2014. Computational psychiatry. Neuron 84, 638-654. ( 10.1016/j.neuron.2014.10.018) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 158.Huang S, Ingber DE. 2006. A non-genetic basis for cancer progression and metastasis: self-organizing attractors in cell regulatory networks. Breast Dis. 26, 27-54. ( 10.3233/BD-2007-26104) [DOI] [PubMed] [Google Scholar]
- 159.Moore D, Walker SI, Levin M. 2017. Cancer as a disorder of patterning information: computational and biophysical perspectives on the cancer problem. Converg. Sci. Phys. Oncol. 3, 043001. ( 10.1088/2057-1739/aa8548) [DOI] [Google Scholar]
- 160.Hernandez-Diaz S, Levin M. 2014. Alteration of bioelectrically-controlled processes in the embryo: a teratogenic mechanism for anticonvulsants. Reprod. Toxicol. 47, 111-114. ( 10.1016/j.reprotox.2014.04.008) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 161.Herrera-Rincon C, Levin M. 2018. Booting up the organism during development: pre-behavioral functions of the vertebrate brain in guiding body morphogenesis. Commun. Integr. Biol. 11, e1433440. ( 10.1080/19420889.2018.1433440) [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Primary data are available as electronic supplementary material.