Abstract
It is widely assumed in developmental biology and bioengineering that optimal understanding and control of complex living systems follows from models of molecular events. The success of reductionism has overshadowed attempts at top-down models and control policies in biological systems. However, other fields, including physics, engineering and neuroscience, have successfully used the explanations and models at higher levels of organization, including least-action principles in physics and control-theoretic models in computational neuroscience. Exploiting the dynamic regulation of pattern formation in embryogenesis and regeneration requires new approaches to understand how cells cooperate towards large-scale anatomical goal states. Here, we argue that top-down models of pattern homeostasis serve as proof of principle for extending the current paradigm beyond emergence and molecule-level rules. We define top-down control in a biological context, discuss the examples of how cognitive neuroscience and physics exploit these strategies, and illustrate areas in which they may offer significant advantages as complements to the mainstream paradigm. By targeting system controls at multiple levels of organization and demystifying goal-directed (cybernetic) processes, top-down strategies represent a roadmap for using the deep insights of other fields for transformative advances in regenerative medicine and systems bioengineering.
Keywords: top-down, integrative, cognitive modelling, developmental biology, regeneration, remodelling
1. Introduction
If you want to build a ship, don't herd people together to collect wood, and don't assign them tasks and work, but teach them to long for the endless immensity of the sea.
—Antoine de Saint-Exupery, ‘Wisdom of the Sands’.
1.1. Levels of explanation: the example of pattern regulation
Most biological phenomena are complex—they depend on the interplay of many factors and show adaptive self-organization under selection pressure [1]. One of the most salient examples is the regulation of body anatomy. A single fertilized egg gives rise to a cell mass that reliably self-assembles into the complex three-dimensional structure of a body. Crucially, however, bioscience needs to understand more than the feedforward progressive emergence of a stereotypical pattern. Some animals have the remarkable ability to compensate for huge external perturbations during embryogenesis, and as adults can regenerate amputated limbs or heads, remodel whole organs into other organs if grafted to ectopic locations (figure 1a), and reprogramme-induced tumours into normal structures (reviewed in [4,5]). These capabilities reveal that biological structures implement closed-loop controls that pursue shape homeostasis at many levels, from individual cells to the entire body plan.
Biologists work towards two main goals: understanding the system to make predictions and inferring manipulations that lead to desired changes. The former is the province of developmental and evolutionary biology, whereas the latter is a requirement for regenerative medicine. Consider the phenomenon of trophic memory in deer antlers (reviewed in [6]). Every year, some species of deer regenerate a specific branching pattern of antlers. However, if an injury is made to the bone at a specific location, an ectopic tine will be formed for the next few years in that same location within the three-dimensional structure that is regenerated by the growth plate at the scalp (figure 1b). This requires the system to remember the location of the damage, store the information for months and act on it during local cell growth decisions made during regeneration so as to produce a precisely modified structure. What kind of model could explain the pattern memory and suggest experimental stimuli to rationally edit the branching pattern towards a desired configuration? Related problems of forming and accessing memories, and using them to make decisions and take actions, are widely studied in neuroscience. We suggest that these parallels are not just analogies, but should be taken seriously: methods developed within computational and systems neuroscience to study memory, decision and action functions can be beneficial to study equivalent problems in biology and regenerative medicine.
The current paradigm in biology and regenerative medicine assumes that models are best specified in terms of molecules. Gene regulatory networks and protein interaction networks are sought as the best explanations. This has motivated the use of a mainly bottom-up modelling approach, which focuses on the behaviour of individual molecular components and their local interactions. The companion concept is that of emergence, and it is thought that future developments in complexity science can explain the appearance of large-scale order, resulting from the events described by molecular models. This approach has had considerable success in some areas [7]. However, it has been argued [8,9] that an exclusive focus on the molecular level (versus higher levels, such as those which refer to tissue geometry, or even lower levels, such as quantum mechanical events) is unnecessarily limiting. It is not known whether bottom-up strategies can optimally explain large-scale properties such as self-repairing anatomy, or whether they best facilitate interventions strategies for rationally altering systems-level properties. However, it has been observed that a number of biological systems seem to use highly diverse underlying molecular mechanisms to reach the same high-level (e.g. topological) goal state (figure 1c), suggesting a kind of ‘implementation independence’ principle that focuses attention on the global state as a homeostatic target for cellular and molecular activities.
1.2. Top-down models: a complement to emergence
However, top-down models, which have been very effectively exploited in sciences such as physics, computer science and computational neuroscience, present a complementary strategy. Top-down approaches focus on system-wide states as causal actors in models and on the computational (or optimality) principles governing global system dynamics. For example, while motor control (neuro)dynamics stem from the interactive behaviour of millions of neurons, one can also describe the neural motor system in terms of a (kind of) feedback control system, which controls a ‘plant’ (the body) and steers movement by minimizing ‘cost functions’ (e.g. realizes trajectories that have minimum jerk) [10]. This view emerged, because the inception of cognitive science and cybernetics [11–13], and might apply more generally not only to the motor system, but also to behaviour and cognition [14]. Formal tools such as optimal feedback control [15], Bayesian decision theory [16] and the free energy principle [17] are routinely used in computational neuroscience to explain most cognitive functions, from motor control to multimodal integration, memory, cognitive planning and social interaction [18]. Related normative approaches derived (for example) from machine learning, artificial intelligence or reinforcement learning are widely used to explain several aspects of neuronal architecture such as receptive fields [19], neuronal coding [20] and dopamine function [21] by appealing to optimality principles and rational analysis [22]. Despite starting in a top-down manner from optimality principles, these approaches make contact with data—as optimality principles generate testable predictions—and have guided empirical research in many fields, becoming dominant in some of them, such as computational motor control and neuroeconomics.
Many biological functions, such as pattern homeostasis, are readily viewed in terms of systems that seek to acquire and maintain specific large-scale states. A central example is dynamic anatomical re-configuration; pattern homeostasis, as seen in highly regenerative animals, is difficult to explain or control via molecular-level models. This is because the global control metrics (e.g. ‘number of fingers’) that trigger and regulate subsequent remodelling are not defined at the level of individuals cells or molecules; indeed, large-scale anatomical goal states can activate multiple distinct mechanistic pathways to satisfy the homeostatic process (a kind of implementation independence; figure 1c). These global metrics can be conceptualized as order parameters in dynamical systems or as controlled variables (or set points) in cybernetic and control-theoretic models. We argue that top-down control models provide a valuable complement to the toolkit of cell biologists, evolutionary biologists, bioengineers and workers in regenerative medicine because they provide a mechanistic roadmap for optimal explanation and control of some complex systems.
The main goal of this article is to introduce, motivate and demystify top-down approaches for biologists and to enable deep concepts from other fields to impact the most critical open questions of systems biology. Least-action principles are one example of top-down principles that fundamentally transformed understanding in basic physics, and it has been in use for centuries in that field [23,24]. Perhaps the most representative example of a top-down approach in biology is the theory of evolution by natural selection [25]. The theory is not necessarily tied to one specific mechanism—and indeed some of the underlying mechanisms such as genes were only discussed much later—but it provided a context to understand many (if not all) biological phenomena across the field, from molecular biology to genetics and physiology, and to formulate detailed process models. One reason why top-down approaches have not been popular in modern biology (with exceptions, see below) is that they apparently embed a ‘dangerous’ notion of teleology, directedness, purpose or finalism. After all, evolutionary theory rejects the idea that processes are ‘directed’ towards some ‘final goal’ or ‘final cause’—it rejects ‘finalistic’ thinking and the idea that there is ‘purpose’ beyond biology. However, three points are in order.
First, top-down models do not entail a problematic kind of teleology [26–28]. Goal directedness is not ‘magical thinking’, but can be mapped to specific mechanistic models of homeostasis that are already widely used in many fields. For example, feedback systems that are popular in control theory and cybernetics do encode a desired state (or set point), but this is not the kind of ‘final cause’ that biologists should be worried about [27]. It has nothing to do with claims of a purpose to the trajectory of evolution, and it does not imply claims of first-person consciousness. A set point can be as simple as a desired ‘plant’ state in motor control (e.g. my finger pressing a button), a desired interoceptive state in homeostasis (e.g. satiation) or a desired temperature for a thermostat. The ontological status of these set points is innocuous with respect to issues of ‘evolutionary thinking versus finalisms’, and it is an empirical question whether animals use internally represented goal states with various levels of complexity (from ‘my finger pressing a button’ to ‘my face on the cover of Time magazine’) to guide their decisions [29,30], as opposed to simpler (e.g. stimulus–response mechanisms)—or both. Often, living organisms or machine learning algorithms can learn goals or set points of a system experience, so it cannot be assumed that they are innate. Our discussion of top-down controls explicates goal directedness via (extended) homeostatic mechanisms within existing organisms, thus offering specific hypotheses on how they may acquire increasingly more complex and distal goals [14,31].
Second, one might imagine that teleological thinking would offer a misguided view of causation; after all, it is commonly assumed that causation in biological phenomena should be from the parts (micro) to the whole (macro), for example, from cells to organisms. However, issues of causality are heavily discussed in philosophy, neuroscience, social science and many other fields [32–39]. Purely bottom-up views are increasingly challenged by theories of micro–macro interactions—i.e. the idea that causality goes in both directions, and that efficient causality can be ascribed to multiple levels of description of a system [40,41]. For brevity, we do not discuss the philosophical issues of top-down causation here, referring the reader to many recent above-cited discussions. Our view is that empirical success in facilitating understanding and control is of paramount importance, overriding a priori commitments to particular levels of explanation.
Third, although several researchers in computational and systems neuroscience have proposed that formal tools such as feedback control, Bayesian decision theory and error minimization are literally implemented in the brain (e.g. the Bayesian brain hypothesis), one can also use the same concepts in a purely descriptive-and-predictive way, without committing to the ontological status of their constructs (e.g. the construct of set point). In other words, scientists can describe biological systems ‘as-if’ they had purpose (in the cybernetic sense), using an operational approach that only appeals to the explanatory power of the theory and the constructs. For example, the notion of (minimization of) a free energy gradient, which originated in thermodynamics, can be used to study biological systems such as cell movement [42] or brain dynamics [17]. In this perspective, top-down models may be seen as formal tools that enlarge a scientist's methodological toolbox and might potentially increase predictive power of theories. In a similar vein, Dennett [43] has proposed that when we want to explain the behaviour of our conspecifics we use an ‘intentional stance’—we describe others as having goals and intentions—because this stance gives greater predictive power compared to (say) trying to predict another's behaviour in terms of the laws of mechanics. The ‘intentional stance’ is preferred for its predictive power, irrespective of the fact that humans have or do not have real goals or intentions. Here, in other words, is a pragmatic criterion of success (in prediction and control) that should guide the adoption of an intentional stance. The same criterion of success might motivate the choice of modelling any given biological system as a system that has purpose (and can be modelled in terms of feedback control) versus a system is composed of interacting parts (and can be modelled by differential equations that describe these parts separately), or a mixture of both.
In other words, one can avoid philosophical issues about ontological reductionism, formulating the success criterion of biological explanations in empirical, unambiguous terms, which appeal to pragmatic criteria such as predictive power, controllability (of experimental manipulations) and causal explanation. If one considers predictive power, the best model is the one that allows the most efficient prediction and control of large-scale pattern formation. In this perspective, only the outcome matters—the ability to induce desired, predictable changes in large-scale shape, regardless of whether the model is formulated in terms of genes, information, topological concepts or anything else. In this, we hold to an empirical criterion of success, looking for whatever class of approaches offers the best results for regulating shape in regenerative and synthetic bioengineering approaches. One can also consider a more broadly causal explanation (and the achievement of higher levels of generality) as a criterion for success [44]—it is in this perspective that Popper argued that scientific discovery goes ‘from the known to the unknown’ [45]. To achieve this, some models appeal to latent (or hidden) states that describe or hypothesize underlying regularities that are not directly observable in the data stream but need to be inferred. For example, in object perception, one can assume that the visible input stream (e.g. the stimulation of the retina) is a function of a mixture of two latent causes, the identity of the object and its location (and/or pose). One can use methods such as Bayesian inference to infer probabilistically the latter from the former [46]. Deep neural networks [47] and Bayesian non-parametric methods [48,49] are widely used in machine learning and computational neuroscience to infer latent states of this kind directly from data.
Being able to formulate a scientific theory without necessarily committing to the ontological status of its entities has contributed to the success of mature sciences. Some examples are the principle of least action, which can be regarded as fundamental in physics as it explains a range of physical phenomena [50] and the principle of least effort, which is popular in many sciences, from ecology to communication [51]. The principle of least action, which is related to free energy minimization, which we discuss below [17], describes a physical system as following a path (of least effort) in an abstract ‘configuration space’. It can be used to obtain equations of motion for that system without necessarily assuming the ontological reality of the ‘path’ or any finalism in the ‘final state’. Is the same approach possible and/or useful in biology? For example, if one focuses on the domain of patterning and growth, the question would be: can we design top-down models that describe (and permit to reprogramme) anatomical structure at the level of large-scale shape specification (e.g. body morphologies) rather than micromanaging single cells or molecular signalling pathways? Would such models be useful and effective?
As a contribution towards a better understanding of top-down modelling in biology, in the following, we discuss in more detail some success cases in computational neuroscience. We first briefly review some concepts of top-down modelling, and we successively focus in more detail on one specific example: the free energy principle. This and other concepts from computational neuroscience and computer science can enrich the study of many complex biosystems, even those not associated with brains [52,53]. We then discuss how this methodology can be successfully applied to other areas of bioscience, specifically developmental/regenerative biology. Finally, we briefly describe what a top-down research programme in biology would look like and discuss the benefits that would result for areas of bioengineering and medicine.
2. Examples of top-down modelling
There is no fundamental conflict between emergence and top-down control [54–56]. However, different strategies are needed to make use of the less familiar side of the coin, and these are not often appreciated in molecular biology. Several mature sciences have, for many decades now, thrived on the basis of quantitative models focused on information and goal-directed mechanisms in both living organisms and engineered artefacts: computational/systems neuroscience and computer science/cybernetics. Here, we discuss a set of concepts from these fields to broaden the horizons of workers in regenerative bioengineering, briefly covering several outsider ideas that may move this field beyond the current gap of complex pattern control.
A characteristic feature distinguishes top-down models from emergent models, and these can be observed in physical sciences at many levels. It is the acknowledgement that higher levels beyond the molecular can have their own unique dynamics that offer better (e.g. more parsimonious and potent) explanatory power than models made at lower levels [57,58]. For example, the laser involves a kind of ‘circular’ causality which occurs in the continuous interplay between macrolevel resonances in the cavity guiding, and being reinforced by, self-organization of the molecular behaviour [59,60].
Another example is the ‘virtual governor’ phenomenon, which arises in an elaborate power grid consisting of many individual alternating-current generators that interact to achieve a kind of ‘entrainment’. The remarkable thing is that this system is optimally controlled not by managing the individual generators (which falls prey to instability), but rather by managing a ‘virtual governor’ that controls the entire system and is precisely defined by its various components [13,61]. This virtual governor has no physical location; it is an emergent relational property or phenomenon of the entire system. However, there is a sense in which it has causal control of the individual units, because managing it gives the best control over the system as a whole. Indeed, anticipating links between these concepts and cognitive neuroscience, Dewan & Sperry [61,62] suggest that this dynamic can help explain instructive control of executive mental states over the pattern of neuronal firing and subsequent behavioural activity. Much as a boiler is best regulated by policies that manage pressure and temperature, and not the individual velocities of each of the gas molecules, biological systems may be best amenable to models that include information structures (organ shape, size, topological arrangements and complex anatomical metrics) not defined at the molecular or cellular level but nevertheless serving as the most causally potent ‘knobs’ regulating the large-scale outcomes.
Yet another example is the Boltzmann definition of entropy that captures the statistical properties of a system composed of myriads of elements, rather than tracking the behaviour of the individual elements. In thermodynamics, not only entropy, but also several other macroscopic variables such as temperature or pressure describe the average behaviour of a large number of microscopic elements. Statistical methods permit linking macro- and the microlevels and characterizing causal relations between them, in both a bottom-up (i.e. a given temperature results from specific kinds of microscopic dynamics) and top-down way (i.e. raising the temperature of an object has cascading effects on its microconstituents). In this latter example, one can establish rules that govern the system but depend on concepts and ‘control parameters’ that exist at levels higher than the microcomponents [41]. This idea meshes well with the concept of an emergent property of a system. Note that here, emergent properties are not just by-products to be measured (outputs), but they can also actually be controlled to change the behaviour of the system (emergent inputs). The exploitation of high-level control knobs in biological systems represents a major challenge and opportunity for biomedicine, which is struggling to regulate systems outputs such as cancer reprogramming and patterning of complex growing organs.
More broadly, one can consider that the success of whole fields such as thermodynamics has been fuelled by top-down approaches, which in many cases have paved the way to the proposal of specific mechanistic models. For example, a phenomenological model of superconductivity [63] was developed much before a mechanistic (microscopic) model [64] was available. This is an example in which not only the phenomenological model was self-consistent and capable of non-trivial predictions, but it was also so precise that it specified which detailed mechanism to look for at the microscopic level.
There is a class of models that is widely used in computational neuroscience that nicely combines top-down and bottom-up aspects. These include dynamical systems models in which trajectories through a state space emerge under the (implicit) imperative to reach an attractor, steady state or limit cycle. The dynamics of attractors have been widely studied in physics and, since the pioneering work of Hopfield [65], there is a flourishing body of literature that uses this concept to model semantics and computation implemented by neuronal dynamics. The benefit of attractors is that they illustrate how a mechanistic system can evolve towards a stable state or set of states—hence they nicely capture the emergence of complex patterns. At the same time, the concept of an attractor is a general high-level descriptor of bottom-up self-organization processes; if the system reaches an attractor basin, then certain specific details are not required to understand its behaviour (e.g. it goes towards the basin of attraction regardless of its initial state). The concept of attractors as causal factors in networks is currently being explored in cancer and synthetic biology applications [66,67]. Moreover, hybrid approaches have been developed that combine control engineering and dynamical systems, for example, by designing individual components (e.g. cells or their components) as controllers with a specifically designed function, but then letting their interactions emerge through self-organization and distributed computation [68].
The idea that behaviour is regulated towards specific states or set points is also key in cybernetic and feedback control models. In these models, however, it is a feedback signal that usually regulates behaviour, not attractor dynamics. A central component of most cybernetic models is a comparator that compares current (sensory) and desired states (set points) and triggers an action that ‘fills the gap’ if it detects a discrepancy between them. These models were initially applied to homeostatic processes, but have been extended to a variety of control and cognitive tasks [14]. For example (figure 2), the TOTE model [27] has been proposed as a general architecture for cognitive processing, and its acronym exemplifies the functioning of the feedback-based, error-correction cycle described above: test (i.e. compare set point and current state), operate (e.g. trigger an action), test (i.e. execute the same comparison as above after the action is completed), exit (if the set point has been reached). This is a somewhat simplified control scheme, and there are now numerous control models that include additional components, including predictors (i.e. internal models that predict the sensory consequences of executed actions), additional comparators (which compare, for example, actual and predicted sensory stimuli), state, estimators, inverse models and planners; see [10] for a review. What is more relevant in this context is that, in principle, the same (stylized) model can be applied to a set of operations as diverse as motor control (figure 2b) and growth and regeneration (figure 2c). See below for a more detailed discussion of the application of TOTE or TOTE-like systems to biological phenomena.
Another key concept in the top-down toolbox of many sciences is that of information. Models in which information transfer plays a central role have been developed in artificial life and cognitive science [70,71]. Robotic control systems have been realized that are able to autonomously learn an increasingly sophisticated repertoire of skills by iteratively maximizing information measures, for example, their empowerment: roughly, the number of actions an agent can do in the environment or its ‘potential for control’, as measured by considering how much Shannon information actions ‘inject’ into the environment and the sensors [72]. Empowerment or related information measures (for example, predictive information, homeokinesis and others [73]) can provide universal metrics of progress of agents' perceptual-motor capabilities and permit them to learn new skills without pre-specifying learning goals.
3. Successful top-down modelling in computational neuroscience: the case of free energy
As a paradigmatic example of top-down modelling in computational neuroscience, we next discuss in more detail one of these examples: brain predictive processing under the free energy principle [17]. Free energy is a general principle stemming from physics, and is increasingly providing guidance to understand key aspects of cognition and neuronal architecture, including hierarchical brain processing [74], decision-making [31,75], planning [69,76] and psychosis [77].
The free energy principle starts from a simple evolutionary consideration: in order to survive, animals need to occupy a restricted (relatively rare) set of ‘good states’ that essentially define their evolutionary niche (e.g. places where they can find food) and avoid the others (e.g. underwater for a terrestrial animal). To this aim, animal brains are optimized to process environmental statistics and guide the animal towards these ‘good states’, which is done by using an error-correction mechanism to minimize a distance measure (prediction error or surprise, see below) between the current sensed state and the desired good states [78]. In this perspective, the free energy approach can be seen as an extension of homeostatic principles (i.e. to maintain the free energy minimum) to the domains of perception, action and cognition [31]. Despite the simplicity of its assumptions, this approach has deep implications for brain structure and function [17,69]. Indeed, to allow adaptive control (towards the desired states), the brain needs to learn a so-called generative (Bayesian) model of the statistics of its environment, which describes both environmental dynamics (necessary for accurate perception) and action–outcome contingencies (necessary for accurate action control). This generative model has necessarily a hierarchical form, reflecting the fact that environmental and action dynamics are multilevel and operate at a hierarchy of timescales [79]. The hierarchy is arranged according to the principles of predictive coding, where hierarchically higher and lower brain areas reciprocally exchange ‘messages’—which encode (top-down) predictions and (bottom-up) prediction errors, respectively—and the same scheme is replicated across the whole hierarchy. A similar scheme can be defined for physiological states of the body [80,81], and perhaps even of anatomical states implemented by cellular remodelling activities [52].
Perception corresponds in this architecture to the ‘inverse problem’ of inferring the causes of sensory stimulations; for example, inferring that the pattern of stimulation of an animal's retina is caused by the presence of an apple in front of it [82]. This problem is called inverse, because the generative model encodes how the causes (the apple) produce the sensory observations (a pattern on the animal's retina), e.g. the probability to sense a given retina stimulation given the presence of an apple. However, to infer/reconstruct the causes, it is necessary to ‘invert’ the direction of causality of the model, i.e. calculate the probability of an apple given the retina stimulation. The inverse problem is solved using the logic of predictive coding: perceptual hypotheses encoded at higher hierarchical levels (e.g. seeing an apple versus a pear) produce competing predictions that are propagated downward in the hierarchy, and compared with incoming sensory stimuli (say, seeing red)—and the difference between the predicted and sensed stimuli (a prediction error) is propagated upward, helping revise the initial hypotheses, until prediction error (or free energy more precisely) is minimized and the correct hypothesis (apple) is inferred. This inference is precision-weighted (where precision is the inverse of variance of a distribution), meaning that the higher the uncertainty of a sensation, the lower its influence on hypothesis revision. This scheme has been used to model several perceptual tasks, including also aberrant cases (e.g. hallucinations and false inference) owing to precision misregulations [77]; and operates equally for different modalities (exteroceptive, interoceptive and proprioceptive).
To implement action control, the aforementioned predictive coding scheme requires at least two additional components: desired (goal) states that are encoded at high hierarchical levels as (Bayesian) ‘priors’ and are endowed with high precision, and motor reflexes that essentially execute actions. In this extended scheme, called active inference, the priors encoded at high hierarchical levels (e.g. I have an apple in my hand) have very high precision and thus cannot be (easily) revised based on bottom-up prediction errors and external stimuli. For this, they functionally play the role of goals—i.e. states that the agent seeks to achieve by acting, as in the TOTE model introduced earlier—rather than just hypotheses as in the case of perceptual inference. Based on such priors, the system generates ‘strong’ predictions that are propagated downward in the hierarchy and enslave action. This mechanism follows the usual logic of predictive coding, in which relatively more abstract beliefs at a higher layer (e.g. having an apple in the hand) produce a cascade of predictions of more elementary exteroceptive and proprioceptive sensations at lower layers (e.g. the sight of red and the feeling of a round object in my hand). If there is no apple in my hand, these apple-related predictions give rise to strong prediction errors (i.e. between the apple I expect to see and feel and the absence of apple that I actually see and feel). The key difference between perceptual processing and active inference is the way these prediction errors are minimized. In perceptual processing, one can change one's own hypotheses about having an apple. However, if the priors encoded at higher hierarchical levels are too strong, this is not possible: the only way to minimize prediction errors is to make one's predictions true by acting—that is, engage reflex arcs to grasp an apple. This is why one can consider that active inference is predictive coding extended with reflex arcs [69]. However, this architecture can be beyond mere reflex arcs and proximal action. If an apple is not directly available, then the same architecture (opportunely augmented) can steer a more complex pattern of behaviour such as searching for the apple with the eyes and then grasping it, or even buy an apple. In this perspective, action control corresponds to minimizing prediction errors by engaging arc reflexes (or action sequences in more complex cases), not by revising hypotheses as in the case of perception. This would only be the case if the system's goals are strong enough and the predictions they generate have high precision. This active inference scheme has been used to model a variety of control tasks, including hand [83] and eye movements [84] and has been extended to planning processes, in which essentially free energy minimization spans across actions sequences, not just short-term actions such as grasping an apple [69,76,85,86].
The free energy principle is now widely used in computational neuroscience and constitutes one of the few examples of ‘unified’ theories of brain and cognition. The usefulness of the top-down approach intrinsic in this framework, which proceeds from first principles (free energy minimization), is apparent in many domains of cognitive neuroscience, including perceptual, motor and learning domains [17]. The top-down approach has also proven to be effective at the level of detailed neuronal computations; for example, in the explanation of the structure and information flow in ‘canonical cortical microcircuits’—neuronal microcircuits that recur widely through the cortex and are considered to be the putative building blocks of cortical computations [87]. What is remarkable in this example is that formal constraints that one can derive from predictive coding, such as asymmetric top-down and bottom-up message passing between neurons (encoding predictions and prediction errors, respectively), describe particularly well key anatomic and physiological aspects (e.g. intrinsic connectivity) of neuronal populations within and across cortical microcircuits. In this example, it was possible to proceed from first principles and derive specific and testable predictions, for example, about the connectivity and functional roles of the elements of canonical microcircuits, as well as their characteristic rhythms and frequencies (e.g. slower frequencies such as beta for top-down predictions and faster frequencies such as gamma for bottom-up prediction errors).
The free energy principle has been recently applied to the control patterning and regeneration, in which high-level anatomical goal states must functionally interface with the molecular and cellular events that implement them [52]. Shape regulation may be efficiently understood and manipulated as a kind of memory/recall process, analogous to a scheme in which generative models memorize patterns and error-correction mechanisms trigger actions that involve body changes (e.g. growth and differentiation) that restore them as necessary. Cells are initially undifferentiated and have to ‘find their place’ in the final body morphology (here, a simple morphology with head, body and tail; figure 3a). In the simulation, genetic codes parametrize a generative model that is identical for all cells, and essentially describes ‘what chemotactic signals the cell should expect/sense’ at a(ny) given location if the final form was achieved (figure 3b)—but note that the generative model or part of it can also be learned. The model addresses the epigenetic process through which each cell ‘finds a place’ in the morphology. This is a difficult (inverse) problem, made more challenging by the fact that a cell can only sense the ‘right’ (expected) signals when all the other cells are in place. This problem is solved by inverting the cells' generative models and minimizing free energy—except for the fact that here the problem is intrinsically multi-agent (or multi-cell): each cell has to (minimize free energy and) reach its unique place and express the ‘right’ signals, which, in turn, permits the other cells to reach their own places. Key to the model is the fact that migration and differentiation are considered to be the cell's actions (figure 3c) that move the cell towards the desired state (in which it senses the right signals) and the whole organism towards the target morphology (figure 3d). In short, each cell can use the aforementioned active inference scheme to select the appropriate action(s) that minimize its free energy (figure 3e), and the minimum of (variational) free energy can only be achieved when each cell is in a different place in the morphology, and the whole organism has thus composed the desired form (or in other words, the free energy of individual cells and of the ensemble are strictly related). Subsequent simulations in the same study show that, besides pattern formation, the same method can be used to model pattern regeneration, when part of the morphology is disrupted by injury [52].
This example illustrates a possible use of top-down modelling principles to model biological phenomena such as patterning and regeneration. One emerging aspect is that in this computational model there is no contradiction between normative, top-down principles and ‘emergentist’ dynamical views that are popular in biology, as both are specified within the same framework. Indeed, one can equivalently describe the patterning and self-assembly process as minimization of free energy, and as the emergent property of cells that share a generative model (an ‘autopoietic’ process [88]). This points to the more general fact that top-down and bottom-up perspectives are not necessarily in contradiction but can be integrated and act synergistically. Free energy enables biological phenomena from both top-down and bottom-up perspectives to be simultaneously addressed. From a top-down perspective, it provides a normative principle (or ‘objective function’) that describes—or in a sense, prescribes—the collective behaviour of the system, and the function it is optimizing. From a bottom-up perspective, it can provide specific process models of probabilistic and inferential computations.
This facilitates the exploration of functional and mechanistic analogies between dynamic regulation of patterning and cognitive function (e.g. decision and memory) [53]. One example is the parallel between cognitive and cell decisions. In hierarchical predictive coding architectures, perception and decision-making are not purely bottom-up, sensory-guided processes but rather result from a (Bayes-optimal) combination of prior information (and memory) and current sensory evidence [84,89]. Mechanistically, this is achieved through a continuous and reciprocal exchange of top-down and bottom-up signals, which convey prior information and prediction errors, respectively. In principle, one can use the same scheme to analyse cellular decisions during morphogenesis, which would therefore be a function of both, top-down information based on network memories (priors) and bottom-up signals (e.g. chemical/electrical signals from their neighbours). The current understanding of cognitive (e.g. decision, categorization, pattern completion and memory) processes [53,90] in neural cells provides rich, rigorous inspiration for understanding top-down influences over non-excitable cell behaviour during their navigation within the complex in vivo environment.
4. Implementing top-down models in biology: a roadmap to regenerative medicine
Regenerative medicine seeks to control large-scale patterns, to turn tumours into functional tissues, repair birth defects and guide the formation of missing or damaged organs. The gulf between a wealth of high-resolution genetic data and the systems-level anatomical properties that need to be controlled is growing, despite increasing sophistication at the molecular level. We propose that adding top-down modelling to the toolkit of developmental biologists can help achieve cross-level integration and result in transformative functional capabilities.
Tadpoles significantly remodel their faces during their journey of becoming a frog. Remarkably, tadpoles created with a very abnormal positioning of the head organs nevertheless achieve normal head structure, by moving the various organs through novel paths in order to enact the correct frog target morphology [91]. Understanding how this system activates remodelling trajectories that reach the same goal state despite different starting configurations (i.e. not the evolutionarily default normal sequence of movements) is the kind of advance that will be needed to unlock regenerative abilities in patients and artificial bioengineered constructs. A top-down model would specify how the target morphology is represented within tissues, what cellular processes underlie the computations that drive the system from a novel starting condition to that goal state (and stop when it has been achieved), and how those computations about large-scale anatomical metrics become transduced into low-level marching orders for cells and molecular signalling cascades.
How are such phenomena to be understood? Perhaps, a kind of least-action principle in regenerative remodelling might define a cellular network that functions to minimize the distance (in energy) between the current morphology and the target morphology, by steps that alter cell motility, differentiation and proliferation by optimizing some variables, such as measured differences between size/shape of specific components and a stored ‘correct’ value. Note that this is quite distinct from the current paradigm, in which it is assumed that no target morphology or map exists at any level of description, and the result (e.g. settling in one of the local minima of the system) is always an emergent outcome of purely local interactions. Similar schemes have been suggested, for example using field property minimization models for understanding physical forces as controls of morphogenesis [92–94].
Models in this field will need to be explicit about the size of decision-making units (cells, cell networks or whole organs), what these units measure [95,96] and how they represent large-scale goal states internally [97]. How might cellular networks implement a TOTE-like homeostatic system which needs to represent global quantities (size and shape of organs), and issue local decisions to cells, based on comparisons to a stored memory or representation of a target morphology? There are many ways in which cell networks can compute, including chemical gradients [98–100], genetic and protein networks [101,102] and cytoskeletal state machines [103–105], but one obvious choice for exploration in the context of top-down modelling is endogenous developmental bioelectricity [106–109].
Ionic dynamics were exploited by evolution in the development of brains for good reason: ion channels and electrical synapse proteins (gap junctions) enable electrical activity to modify voltage and resistance [110], implementing feedback loops that underlie plasticity in networks, thus serving as the substrate for logic elements and memory from which higher computation (brain function) can be built up. Crucially, ion channel, electrical synapse and neurotransmitter hardware is far older than brains; the evolution of the CNS and its impressive cognitive abilities co-opted these tricks from a far earlier cellular control system that drove pattern regulation, physiological homeostasis and behaviour in single cells and primitive metazoans (these concepts are reviewed in more depth in [111,112]). Thus, it is possible that top-down control, an important component of brain function, is likewise reflective of similar control strategies implemented by non-neural cells during embryogenesis, regeneration and cancer suppression (figure 4a,b illustrates the extensive functional and molecular conservation between the interplay of ion channel-based hardware and its resulting electric pattern-mediated software in the brain and the body during behaviour and pattern regulation, respectively).
While many other physical and chemical modalities are involved in pattern regulation, bioelectric circuits have a number of properties that suggest that they are a highly tractable first target for modelling and intervention via top-down approaches. Recent data have revealed that dynamic endogenous bioelectric gradients, present throughout many tissues (not just excitable nerve and muscle) not only specifically control cell behaviour, but serve as global integrators of information across the body that instructively guide patterning, growth control, organ identity and topological arrangement of complex structures [106,113]. Patterns of bioelectric signalling have been shown to serve as master regulators (module activators) and prepatterns for complex anatomical structures, coordinating downstream gene expression cascades and single cell behaviours towards specific patterning outcomes [114–116]. The extensive use of bioelectric circuits to represent information and guide activity in the brain offers conceptual and experimental tools for unravelling how tissues perform the computations needed to implement dynamic remodelling (figure 1) and developing interventions that alter the encoded information structures to achieve complex patterning goals without micromanaging molecular-level events. The organizing role for global patterning by somatic bioelectrical circuits, and their high intrinsic suitability for cellular circuits implementing plasticity and memory, suggest this layer of biological regulation as a facile entry point into the quantitative understanding of how high-level goal states may be encoded in tissues.
A number of laboratories are investigating (with ever-higher mechanistic resolution) how global electrical states regulate downstream cellular processes inside cells [115,117]. This must now be accompanied by the development of new ways to model the integrated information flow and decision-making that may be mediated by somatic bioelectricity to enable flexible shape homeostasis (figure 4c–g illustrates the progressive levels of organization and information encoding from gene networks that specify tissue components to the pattern-editing algorithms that drive large-scale anatomical change). This effort may involve neural net-like models storing stable body organ configurations as memories and fleshing out the mechanistic links between attractors in circuits' bioelectrical state space and anatomical morphospace. One possible conceptual approach (illustrated in figure 5) is to view specific pattern outcomes as stable attractors in the state space of a distributed non-neural electric network, representing pattern memories that are stable and yet labile (can be re-written). In such networks, voltage-mediated output signals control downstream gene expression cascades and the behaviour of many cells, leading to specific patterning outcomes. Concepts from computational neuroscience may be especially useful for this nascent field, systems in which low-level mechanisms (same as some of those guiding patterning) and top-level goals coexist and can be productively studied. This field serves as proof-of-principle of integration across multiple levels of organization—the key challenge in regenerative biology and medicine.
5. Conclusion
Next-generation bioengineering must move beyond direct assembly of cell types and exploit the modularity and adaptive control seen throughout developmental biology. The major knowledge gap involves our understanding of how complex shape arises from, and is dynamically remodelled by, the physical activity and information processing of smaller subunits (not necessarily cells). The current paradigm in the field is bottom-up, focusing on genetic networks and protein interactions. If we understand the molecular networks within cells, we should be able to tame the emergence of large-scale structures from those microlevel processes. Our ultimate goal, however, is the programming of shape by specifying organs and their topological relationships, instead of attempting to micromanage the construction at the ‘machine language’ level [129,130]. Here, we have discussed a complementary, top-down approach, which can encompass the known molecular elements that implement pattern formation: chemical gradients [131–134], physical forces [135–137] and bioelectrical signalling [108,115,138–140].
Numerous examples of pattern formation exist [141], in which spatial order is generated by emergence from collective low-level dynamics. In contrast, top-down strategies incorporate models in which the key functional elements are not molecules, but higher-order structures defined at larger scales. Examples include ‘organs’, ‘positional coordinates’, ‘size control’, ‘topological adjacency’ and similar concepts. Top-down models can be as quantitative as the familiar bottom-up systems biology examples, but they are formulated in terms of building blocks that cannot be defined at the level of gene expression and treat those elements as bona fide causal agents (which can be manipulated by interventions and optimization techniques). The advantages of top-down models, which are apparent in many mature sciences such as physics and computer science, is that they hold the promise to surmount an inverse problem that is intrinsic in biological modelling [6]. The near-impossibility of determining which low-level components must be tweaked in order to achieve a specific system-level outcome is a problem that plagues most complex systems. This is clearly seen in the state of our field today, where the ever-growing mountain of high-resolution molecular pathway data cannot be directly mined to determine which proteins need to be introduced or removed to, for example, predictably change the shape of even a relatively simple structure such as an ear.
In this article, we have discussed normative principles and top-down modelling in both computational neuroscience and biology. We have reviewed top-down modelling approaches that are popular (and in some cases even dominant) in other research fields such as physics, computational neuroscience, computer science and cybernetics. They can be useful for biology at large by demystifying some of their key concepts such as teleology and enabling quantitative models of control systems that operate at levels of organization above molecules. Indeed, there are examples of top-down models with greater predictive power than any available bottom-up candidates; for example, the field-based models of intercalary regeneration that not only explain the puzzling appearance of supernumerary limbs [142–144], but also extend the work to intercalation on a single-cell level, displaying a profound conservation of pattern control principles that span levels of organization from the single cell to the entire organ [92–94,145].
We have focused on a specific class of models—based on the free energy principle—and offered a proof-of-principle example of its use in biology: the case of patterning and the self-assembly of a simple body morphology. However, there are numerous other top-down modelling tools that have been developed in computational neuroscience, computer science, physics, control theory and engineering, which have great potential to be re-used in biology. We have also briefly mentioned some of these concepts, such as feedback control methods or least-action principles in physics. A full review of these concepts is beyond the scope of this article, but see [53]. This does not mean that using a top-down approach is necessarily error-proof. Appealing to first principles or simplicity is often heuristic—but, as for any other approach, empirical validation is a key criterion for scientific acceptance of a theory.
Neuroscience has long grappled with issues of goal directedness, and searched for ways to integrate levels (from the biochemical to that of propositional mental content); it is the one example of a science that has produced mechanistic explanations linking cellular activity to planning and complex memories [146]. The analogies are many, and biology has much to learn from this field. For example, the attempt to understand how the activity of cells underlies large-scale decision-making (e.g. control of shape, size and organ identity relative to the rest of the body plan) is parallel to the programme of explaining complex cognitive functions via the nested activity of increasingly less-informed units, such as brain networks, cell assemblies or single cells. Moreover, the current paradigm in biology of exclusively tracking physical measurable and ignoring internal representation and information structures in patterning contexts quite resemble the ultimately unsuccessful behaviourist programme in psychology and neuroscience [147].
The top-down perspective that we have stressed here is not intended to replace existing approaches, but to offer unique insights and complement existing more bottom-up efforts based on emergence from molecular pathway models. Models derived from the top-down perspective need to be evaluated as to their empirical validity based on the degree of prediction and control they allow over the large-scale patterning of growth and form. Successful models will facilitate the appearance of a ‘compiler’ able to convert design goals at the level of morphology into cell-level instructions that can be applied to reach the desired anatomical results. In this, computer science offers an ideal example of systems that are understood synthetically, from electric currents to the high-level data representation, control loops and formal reasoning that their circuits implement.
Future research will identify specific pros and cons of top-down versus bottom-up approaches in biology—as well as their possible integration. A key aspect of top-down models that make them particularly appealing for the field of patterning and regeneration is that they offer an intuitive starting point to control outcomes that are too complex to implement directly. For example, even if stem cell biologists knew how to make any desired cell type from an undifferentiated progenitor, the task of assembling them into a limb would be quite intractable. Similarly, the insights of molecular developmental biology have not revealed the control circuitry that would enable making a self-repairing robot. If it were discovered that somatic tissues actively represent anatomical goal states, then it may be possible to rationally modify those pattern memories and let cells build the needed structures (for repairing birth defects, regenerating injured organs or constructing artificial biobots). Top-down approaches offer the possibility of offloading the computational complexity onto cells, allowing the bioengineer to specify target states instead of micromanaging the processes of growth and morphogenesis. Applications along these lines are already coming online, from work that exploits the same mechanisms used by the brain to implement goal-seeking behaviour—bioelectrical computation—in non-neural cells. The field of developmental bioelectricity has begun to explore top-down (modular) control of organ regeneration [148], as well as drastic reprogramming of metazoan body architecture (despite a normal genome) by rewiring physiological network states [120–122]. Editing of ‘pattern memories’ in vivo, such as the permanent conversion of genomically wild-type planaria into a two-headed form [120–122], represent the first novel capabilities arising from the pursuit of the proposed research programme at the bench, and are likely just the tip of the iceberg.
Future research should investigate in depth what models can be adapted from computational neuroscience to biological modelling—especially if the molecular conservation of mechanisms can be exploited for parallel insights into pattern memory. One example application may be the effort to understand cell signalling during pattern control by leveraging on the analogies with information flow (synaptic exchanges) implied in a specific cognitive operation such as perceptual (e.g. visual) processing. Leading theories of perceptual processing in neuroscience follow a predictive coding (or similar) scheme based on interactive, top-down and bottom-up processing pathways. In these models, perceptual processing is a function of what you expect and not (just) of stimuli; this is quite literal, in the sense that what is propagated upward in a predictive coding hierarchy is a prediction error (roughly, the difference between expected and sensed stimulus), not the stimulus itself [89]. Future models of how cells interpret incoming signals may use a similar (predictive coding) scheme, not a purely feedforward scheme. There are numerous other examples of brain computations (e.g. evidence accumulation, normalization, winner-take-all selection) that are well characterized in terms of neural circuits and synaptic exchanges, and which may provide insights to study cell signalling and other biological phenomena [90,149,150]. Establishing a quantitative, predictive, mechanistic understanding of goal-directed morphogenesis will enrich many fields, forging new links to information and cognitive sciences, and perhaps even help neuroscientists understand the semantics of electrical states in the brain. In addition to novel capabilities for regenerative medicine and synthetic bioengineering [151], the conceptual advance of including top-down strategies is likely to strongly potentiate the well-recognized need for cross-level integration across biology.
Acknowledgements
We thank Christopher Fields, Alexis Pietak, Karl Friston, Paul Davies, Sara Walker and many other people in the community for helpful discussion of these topics. We thank Joshua Finkelstein and the referees for very helpful comments on the manuscript during revision.
Authors' contributions
M.L. and G.P. conceived and wrote the paper together.
Competing interests
We declare we have no competing interests.
Funding
M.L. gratefully acknowledges support of an Allen Discovery Center award from The Paul G. Allen Frontiers Group, the G. Harold and Leila Y. Mathers Charitable Foundation, and the Templeton World Charity Foundation (TWCF0089/AB55 and TWCF0140).
References
- 1.Ross J, Arkin AP. 2009. Complex systems: from chemistry to systems biology. Proc. Natl Acad. Sci. USA 106, 6433–6434. ( 10.1073/pnas.0903406106) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Farinella-Ferruzza N. 1956. The transformation of a tail into limb after xenoplastic transplantation. Experientia 12, 304–305. ( 10.1007/BF02159624) [DOI] [Google Scholar]
- 3.Bubenik AB, Pavlansky R. 1965. Trophic responses to trauma in growing antlers. J. Exp. Zool. 159, 289–302. ( 10.1002/jez.1401590302) [DOI] [PubMed] [Google Scholar]
- 4.Levin M. 2012. Morphogenetic fields in embryogenesis, regeneration, and cancer: non-local control of complex patterning. Biosystems 109, 243–261. ( 10.1016/j.biosystems.2012.04.005) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Mustard J, Levin M. 2014. Bioelectrical mechanisms for programming growth and form: taming physiological networks for soft body robotics. Soft Robot. 1, 169–191. ( 10.1089/soro.2014.0011) [DOI] [Google Scholar]
- 6.Lobo D, Solano M, Bubenik GA, Levin M. 2014. A linear-encoding model explains the variability of the target morphology in regeneration. J. R. Soc. Interface 11, 20130918 ( 10.1098/rsif.2013.0918) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Munjal A, Philippe J-M, Munro E, Lecuit T. 2015. A self-organized biomechanical network drives shape changes during tissue morphogenesis. Nature 524, 351–355. ( 10.1038/nature14603) [DOI] [PubMed] [Google Scholar]
- 8.Beloussov LV. 2001. Morphogenetic fields: outlining the alternatives and enlarging the context. Rivista Di Biologia-Biol. Forum 94, 219–235. [PubMed] [Google Scholar]
- 9.Noble D. 2012. A theory of biological relativity: no privileged level of causation. Interface Focus 2, 55–64. ( 10.1098/rsfs.2011.0067) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Shadmehr R, Smith MA, Krakauer JW. 2010. Error correction, sensory prediction, and adaptation in motor control. Annu. Rev. Neurosci. 33, 89–108. ( 10.1146/annurev-neuro-060909-153135) [DOI] [PubMed] [Google Scholar]
- 11.Ashby WR. 1952. Design for a brain. Oxford, UK: Wiley. [Google Scholar]
- 12.Powers WT. 1973. Behavior: the control of perception. Hawthorne, NY: Aldine. [Google Scholar]
- 13.Wiener N. 1948. Cybernetics: or control and communication in the animal and the machine. Cambridge, MA: The MIT Press. [Google Scholar]
- 14.Pezzulo G, Cisek P. 2016. Navigating the affordance landscape: feedback control as a process model of behavior and cognition. Trends Cogn. Sci. 20, 414–424. ( 10.1016/j.tics.2016.03.013) [DOI] [PubMed] [Google Scholar]
- 15.Todorov E. 2004. Optimality principles in sensorimotor control. Nat. Neurosci. 7, 907–915. ( 10.1038/nn1309) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Kording KP, Wolpert DM. 2006. Bayesian decision theory in sensorimotor control. Trends Cogn. Sci. 10, 319–326. ( 10.1016/j.tics.2006.05.003) [DOI] [PubMed] [Google Scholar]
- 17.Friston K. 2010. The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 11, 127–138. ( 10.1038/nrn2787) [DOI] [PubMed] [Google Scholar]
- 18.Jeannerod M. 2006. Motor cognition. Oxford, UK: Oxford University Press. [Google Scholar]
- 19.Olshausen BA, Field DJ. 1996. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381, 607–609. ( 10.1038/381607a0) [DOI] [PubMed] [Google Scholar]
- 20.Pouget A, Beck JM, Ma WJ, Latham PE. 2013. Probabilistic brains: knowns and unknowns. Nat. Neurosci. 16, 1170–1178. ( 10.1038/nn.3495) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Schultz W, Dayan P, Montague PR. 1997. A neural substrate of prediction and reward. Science 275, 1593–1599. ( 10.1126/science.275.5306.1593) [DOI] [PubMed] [Google Scholar]
- 22.Anderson JR. 1983. The architecture of cognition. Cambridge, MA: Harvard University Press. [Google Scholar]
- 23.Feynman R. 1942. The principle of least action in quantum mechanics. PhD thesis, Princeton University, Princeton, NJ.
- 24.Ogborn J, Hanc J, Taylor EF. 2006. Action on stage: historical introduction. In Presented at the GIREP Conf.
- 25.Darwin C. 1859. On the origin of species by means of natural selection, or the preservation of favoured races in the struggle for life. London, UK: John Murray. [PMC free article] [PubMed] [Google Scholar]
- 26.Nagel E. 1979. Teleology revisited and other essays in the philosophy and history of science. New York, NY: Columbia University Press. [Google Scholar]
- 27.Rosenblueth A, Wiener N, Bigelow J. 1943. Behavior, purpose and teleology. Philos. Sci. 10, 18–24. ( 10.1086/286788) [DOI] [Google Scholar]
- 28.Ruse M. 1989. Teleology in biology: is it a cause for concern? Trends Ecol. Evol. 4, 51–54. ( 10.1016/0169-5347(89)90143-2) [DOI] [PubMed] [Google Scholar]
- 29.Pezzulo G, Verschure PF, Balkenius C, Pennartz CM. 2014. The principles of goal-directed decision-making: from neural mechanisms to computation and robotics. Phil. Trans. R. Soc. B 369, 20130470 ( 10.1098/rstb.2013.0470) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Pezzulo G, Castelfranchi C. 2009. Thinking as the control of imagination: a conceptual framework for goal-directed systems. Psychol. Res. 73, 559–577. ( 10.1007/s00426-009-0237-z) [DOI] [PubMed] [Google Scholar]
- 31.Pezzulo G, Rigoli F, Friston KJ. 2015. Active inference, homeostatic regulation and adaptive behavioural control. Prog. Neurobiol. 134, 17–35. ( 10.1016/j.pneurobio.2015.09.001) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Auletta G, Ellis GF, Jaeger L. 2008. Top-down causation by information control: from a philosophical problem to a scientific research programme. J. R. Soc. Interface 5, 1159–1172. ( 10.1098/rsif.2008.0018) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Ellis GF. 2009. Top-down causation and the human brain. In Downward causation and the neurobiology of free will, pp. 63–81. Berlin, Germany: Springer. [Google Scholar]
- 34.Ellis GFR. 2008. On the nature of causation in complex systems. Trans. R. Soc. South Africa 63, 69–84. ( 10.1080/00359190809519211) [DOI] [Google Scholar]
- 35.Ellis GFR, Noble D, O'Connor T. 2012. Top-down causation: an integrating theme within and across the sciences? Introduction. Interface Focus 2, 1–3. ( 10.1098/rsfs.2011.0110) [DOI] [Google Scholar]
- 36.Jaeger L, Calkins ER. 2012. Downward causation by information control in micro-organisms. Interface Focus 2, 26–41. ( 10.1098/rsfs.2011.0045) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Juarrero A. 2009. Top-down causation and autonomy in complex systems. In Downward causation and the neurobiology of free will, pp. 83–102. Berlin, Germany: Springer. [Google Scholar]
- 38.Noble D. 2008. Genes and causation. Phil. Trans. R. Soc. A 366, 3001–3015. ( 10.1098/rsta.2008.0086) [DOI] [PubMed] [Google Scholar]
- 39.Soto AM, Sonnenschein C, Miquel PA. 2008. On physicalism and downward causation in developmental and cancer biology. Acta Biotheor. 56, 257–274. ( 10.1007/s10441-008-9052-y) [DOI] [PubMed] [Google Scholar]
- 40.Auletta G, Colage I, Jeannerod M. 2013. Brains top down: is top-down causation challenging neuroscience? Singapore: World Scientific. [Google Scholar]
- 41.Hoel EP, Albantakis L, Tononi G. 2013. Quantifying causal emergence shows that macro can beat micro. Proc. Natl Acad. Sci. USA 110, 19 790–19 795. ( 10.1073/pnas.1314922110) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Kravchenko-Balasha N, Shin YS, Sutherland A, Levine RD, Heath JR. 2016. Intercellular signaling through secreted proteins induces free-energy gradient-directed cell movement. Proc. Natl Acad. Sci. USA 113, 5520–5525. ( 10.1073/pnas.1602171113) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Dennett D. 1987. The intentional stance. Cambridge, MA: MIT Press. [Google Scholar]
- 44.Mäkelä T, Annila A. 2010. Natural patterns of energy dispersal. Phys. Life Rev. 7, 477–498. ( 10.1016/j.plrev.2010.10.001) [DOI] [PubMed] [Google Scholar]
- 45.Popper KR. 1963. Conjectures and refutations. London, UK: Routledge and Kegan Paul. [Google Scholar]
- 46.Kersten D, Yuille A. 2003. Bayesian models of object perception. Curr. Opin. Neurobiol. 13, 150–158. ( 10.1016/S0959-4388(03)00042-4) [DOI] [PubMed] [Google Scholar]
- 47.Hinton GE. 2007. Learning multiple layers of representation. Trends Cogn. Sci. 11, 428–434. ( 10.1016/j.tics.2007.09.004) [DOI] [PubMed] [Google Scholar]
- 48.Gershman SJ, Blei DM. 2012. A tutorial on Bayesian nonparametric models. J. Math. Psychol. 56, 1–12. ( 10.1016/j.jmp.2011.08.004) [DOI] [Google Scholar]
- 49.Stoianov I, Genovesio A, Pezzulo G. 2015. Prefrontal goal codes emerge as latent states in probabilistic value learning. J. Cogn. Neurosci. 28, 140–157. ( 10.1162/jocn_a_00886) [DOI] [PubMed] [Google Scholar]
- 50.Feynman R. 1967. The character of physical law. Cambridge, MA: MIT Press; See https://mitpress.mit.edu/books/character-physical-law (accessed 8 April 2016). [Google Scholar]
- 51.Zipf GK. 1949. Human behavior and the principle of least effort: an introduction to human ecology. Boston, MA: Addison-Wesley Press. [Google Scholar]
- 52.Friston K, Levin M, Sengupta B, Pezzulo G. 2015. Knowing one's place: a free-energy approach to pattern regulation. J. R. Soc. Interface 12, 20141383 ( 10.1098/rsif.2014.1383) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Pezzulo G, Levin M. 2015. Re-membering the body: applications of computational neuroscience to the top-down control of regeneration of limbs and other complex organs. Integr. Biol. 7, 1487–1517. ( 10.1039/C5IB00221D) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Ellis GFR. 2012. Top-down causation and emergence: some comments on mechanisms. Interface Focus 2, 126–140. ( 10.1098/rsfs.2011.0062) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Okasha S. 2012. Emergence, hierarchy and top-down causation in evolutionary biology. Interface Focus 2, 49–54. ( 10.1098/rsfs.2011.0046) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Pernu TK, Annila A. 2012. Natural emergence. Complexity 17, 44–47. ( 10.1002/cplx.21388) [DOI] [Google Scholar]
- 57.Anderson PW. 1972. More is different. Broken symmetry and nature of hierarchical structure of science. Science 177, 393 ( 10.1126/science.177.4047.393) [DOI] [PubMed] [Google Scholar]
- 58.Gu M, Weedbrook C, Perales A, Nielsen MA. 2009. More really is different. Physica D 238, 835–839. ( 10.1016/j.physd.2008.12.016) [DOI] [Google Scholar]
- 59.Haken H. 1983. Advanced synergetics: instability hierarchies of self-organizing systems and devices. Berlin, Germany: Springer. [Google Scholar]
- 60.Haken H, Wunderlin A, Yigitbasi S. 1995. An introduction to synergetics. Open Syst. Inf. Dyn. 3, 97–130. ( 10.1007/BF02228811) [DOI] [Google Scholar]
- 61.Dewan EM. 1976. Consciousness as an emergent causal agent in the context of control system theory. In Consciousness and the brain: a scientific and philosophical inquiry (ed. Globus GMG.), pp. 181–198. New York, NY: Plenum Press. [Google Scholar]
- 62.Sperry RW. 1969. A modified concept of consciousness. Psychol. Rev. 76, 532–536. ( 10.1037/h0028156) [DOI] [PubMed] [Google Scholar]
- 63.Landau LD, Ginzburg VL. 1950. On the theory of superconductivity. Zh. Eksp. Teor. Fiz. 20, 1064. [Google Scholar]
- 64.Bardeen J, Cooper LN, Schrieffer JR. 1957. Microscopic theory of superconductivity. Phys. Rev. 106, 162–164. ( 10.1103/PhysRev.106.162) [DOI] [Google Scholar]
- 65.Hopfield JJ. 1982. Neural networks and physical systems with emergent collective computational abilities. Proc. Natl Acad. Sci. USA 79, 2554–2558. ( 10.1073/pnas.79.8.2554) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Davies PC, Demetrius L, Tuszynski JA. 2011. Cancer as a dynamical phase transition. Theor. Biol. Med. Model. 8, 30 ( 10.1186/1742-4682-8-30) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Huang S, Ernberg I, Kauffman S. 2009. Cancer attractors: a systems view of tumors from a gene network dynamics and developmental perspective. Semin. Cell Dev. Biol. 20, 869–876. ( 10.1016/j.semcdb.2009.07.003) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Sole RV, Macia J. 2013. Expanding the landscape of biological computation with synthetic multicellular consortia. Nat. Comput. 12, 485–497. ( 10.1007/s11047-013-9380-y) [DOI] [Google Scholar]
- 69.Friston K, Daunizeau J, Kilner J, Kiebel SJ. 2010. Action and behavior: a free-energy formulation. Biol. Cybern. 102, 227–260. ( 10.1007/s00422-010-0364-z) [DOI] [PubMed] [Google Scholar]
- 70.Balduzzi D, Tononi G. 2008. Integrated information in discrete dynamical systems: motivation and theoretical framework. PLoS Comput. Biol. 4, e1000091 ( 10.1371/journal.pcbi.1000091) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Edlund JA, Chaumont N, Hintze A, Koch C, Tononi G, Adami C. 2011. Integrated information increases with fitness in the evolution of animats. PLoS Comput. Biol. 7, e1002236 ( 10.1371/journal.pcbi.1002236) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Klyubin AS, Polani D, Nehaniv CL. 2005. Empowerment: a universal agent-centric measure of control. IEEE C Evol. Computat. 1, 128–135. [Google Scholar]
- 73.Martius G, Herrmann JM, Der R. 2007. Guided self-organisation for autonomous robot development. In Advances in artificial life, vol. 4648 (eds FAlmeida Costa E, Rocha L, Costa E, Harvey I, Coutinho A), pp. 766–775. Berlin, Germany: Springer. [Google Scholar]
- 74.Friston K. 2008. Hierarchical models in the brain. PLoS Comput. Biol. 4, e1000211 ( 10.1371/journal.pcbi.1000211) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Friston K, Schwartenbeck P, FitzGerald T, Moutoussis M, Behrens T, Dolan RJ. 2014. The anatomy of choice: dopamine and decision-making. Phil. Trans. R. Soc. B 369, 20130481 ( 10.1098/rstb.2013.0481) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Friston K, Rigoli F, Ognibene D, Mathys C, Fitzgerald T, Pezzulo G. 2015. Active inference and epistemic value. Cogn. Neurosci. 6, 187–214. ( 10.1080/17588928.2015.1020053) [DOI] [PubMed] [Google Scholar]
- 77.Adams RA, Stephan KE, Brown HR, Frith CD, Friston KJ. 2013. The computational anatomy of psychosis. Front. Psychiatry 4, 47 ( 10.3389/fpsyt.2013.00047) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Friston K. 2013. Life as we know it. J. R. Soc. Interface 10, 20130475 ( 10.1098/rsif.2013.0475) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Kiebel SJ, Daunizeau J, Friston KJ. 2008. A hierarchy of time-scales and the brain. PLoS Comput. Biol. 4, e1000209 ( 10.1371/journal.pcbi.1000209) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Pezzulo G. 2014. Why do you fear the bogeyman? An embodied predictive coding model of perceptual inference. Cogn. Affect. Behav. Neurosci. 14, 902–911. ( 10.3758/s13415-013-0227-x) [DOI] [PubMed] [Google Scholar]
- 81.Seth AK. 2013. Interoceptive inference, emotion, and the embodied self. Trends Cogn. Sci. 17, 565–573. ( 10.1016/j.tics.2013.09.007) [DOI] [PubMed] [Google Scholar]
- 82.von Helmholtz H. 1866. Concerning the perceptions in general. In Treatise on physiological optics, vol. 3 (ed. Southall JPC.). New York, NY: Dover. [Google Scholar]
- 83.Friston K, et al. 2012. Dopamine, affordance and active inference. PLoS Comput. Biol. 8, e1002327 ( 10.1371/journal.pcbi.1002327) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Friston K, Adams RA, Perrinet L, Breakspear M. 2012. Perceptions as hypotheses: saccades as experiments. Front. Psychol. 3, 151 ( 10.3389/fpsyg.2012.00151) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Pezzulo G, Cartoni E, Rigoli F, Pio-Lopez L, Friston K. 2016. Active inference, epistemic value, and vicarious trial and error. Learn. Mem. 23, 322–338. ( 10.1101/lm.041780.116) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Friston K, FitzGerald T, Rigoli F, Schwartenbeck P, O'Doherty J, Pezzulo G. 2016. Active inference and learning. Neurosci. Biobehav. Rev. 68, 862–879. ( 10.1016/j.neubiorev.2016.06.022) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Bastos AM, Usrey WM, Adams RA, Mangun GR, Fries P, Friston KJ. 2012. Canonical microcircuits for predictive coding. Neuron 76, 695–711. ( 10.1016/j.neuron.2012.10.038) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.Maturana HR, Varela FJ. 1980. Autopoiesis and cognition: the realization of living. Dordrecht, Holland: D Reidel. [Google Scholar]
- 89.Rao RP, Ballard DH. 1999. Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79–87. ( 10.1038/4580) [DOI] [PubMed] [Google Scholar]
- 90.Lisman J. 2015. The challenge of understanding the brain: where we stand in 2015. Neuron 86, 864–882. ( 10.1016/j.neuron.2015.03.032) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Vandenberg LN, Adams DS, Levin M. 2012. Normalized shape and location of perturbed craniofacial structures in the Xenopus tadpole reveal an innate ability to achieve correct morphology. Dev. Dyn. 241, 863–878. ( 10.1002/dvdy.23770) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Brandts WA. 1993. A field model of left–right asymmetries in the pattern regulation of a cell. IMA J. Math. Appl. Med. Biol. 10, 31–50. ( 10.1093/imammb/10.1.31) [DOI] [PubMed] [Google Scholar]
- 93.Brandts WAM, Trainor LEH. 1990. A nonlinear field model of pattern-formation: intercalation in morphalactic regulation. J. Theor. Biol. 146, 37–56. ( 10.1016/S0022-5193(05)80043-8) [DOI] [Google Scholar]
- 94.Brandts WAM, Trainor LEH. 1990. A nonlinear field model of pattern-formation: application to intracellular pattern reversal in Tetrahymena. J. Theor. Biol. 146, 57–85. ( 10.1016/S0022-5193(05)80044-X) [DOI] [Google Scholar]
- 95.Hironaka K, Morishita Y. 2012. Encoding and decoding of positional information in morphogen-dependent patterning. Curr. Opin. Genet. Dev. 22, 553–561. ( 10.1016/j.gde.2012.10.002) [DOI] [PubMed] [Google Scholar]
- 96.Ogawa K, Miyake Y. 2011. Generation model of positional values as cell operation during the development of multicellular organisms. Biosystems 103, 400–409. ( 10.1016/j.biosystems.2010.12.002) [DOI] [PubMed] [Google Scholar]
- 97.Rosen R. 1985. Anticipatory systems: philosophical, mathematical, and methodological foundations, 1st edn. Oxford, UK: Pergamon Press. [Google Scholar]
- 98.Gorgcki J, Gorgcka FN. 2007. Chemical wave based programming in reaction-diffusion systems. Int. J. Unconv. Comput. 3, 259–270. [Google Scholar]
- 99.Scarle S. 2009. Implications of the Turing completeness of reaction-diffusion models, informed by GPGPU simulations on an XBox 360: cardiac arrhythmias, re-entry and the halting problem. Comput. Biol. Chem. 33, 253–260. [DOI] [PubMed] [Google Scholar]
- 100.Schumann A, Adamatzky A. 2009. Toward semantical model of reaction-diffusion computing. Kybernetes 38, 1518–1531. ( 10.1108/03684920910991504) [DOI] [Google Scholar]
- 101.Ling H, Samarasinghe S, Kulasiri D. 2013. Novel recurrent neural network for modelling biological networks: oscillatory p53 interaction dynamics. Biosystems 114, 191–205. ( 10.1016/j.biosystems.2013.08.004) [DOI] [PubMed] [Google Scholar]
- 102.Watson RA, Buckley CL, Mills R, Davies A. 2010. Associative memory in gene regulation networks. In 12th Int. Conf. on the Synthesis and Simulation of Living Systems, Odense, Denmark, 19–23 August 2010, pp. 194–201. Cambridge, MA: MIT Press.
- 103.Craddock TJ, Tuszynski JA, Hameroff S. 2012. Cytoskeletal signaling: is memory encoded in microtubule lattices by CaMKII phosphorylation? PLoS Comput. Biol. 8, e1002421 ( 10.1371/journal.pcbi.1002421) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 104.Craddock TJ, Beauchemin C, Tuszynski JA. 2009. Information processing mechanisms in microtubules at physiological temperature: model predictions for experimental tests. Biosystems 97, 28–34. ( 10.1016/j.biosystems.2009.04.001) [DOI] [PubMed] [Google Scholar]
- 105.Hameroff SR, Craddock TJ, Tuszynski JA. 2010. ‘Memory bytes’—molecular match for CaMKII phosphorylation encoding of microtubule lattices. J. Integr. Neurosci. 9, 253–267. ( 10.1142/S0219635210002482) [DOI] [PubMed] [Google Scholar]
- 106.Bates E. 2015. Ion channels in development and cancer. Annu. Rev. Cell Dev. Biol. 31, 231–247. ( 10.1146/annurev-cellbio-100814-125338) [DOI] [PubMed] [Google Scholar]
- 107.Adams DS. 2008. A new tool for tissue engineers: ions as regulators of morphogenesis during development and regeneration. Tissue Eng. Part A 14, 1461–1468. ( 10.1089/ten.tea.2008.0080) [DOI] [PubMed] [Google Scholar]
- 108.McCaig CD, Rajnicek AM, Song B, Zhao M. 2005. Controlling cell behavior electrically: current views and future potential. Physiol. Rev. 85, 943–978. ( 10.1152/physrev.00020.2004) [DOI] [PubMed] [Google Scholar]
- 109.Nuccitelli R. 2003. Endogenous electric fields in embryos during development, regeneration and wound healing. Radiat. Prot. Dosimetry 106, 375–383. ( 10.1093/oxfordjournals.rpd.a006375) [DOI] [PubMed] [Google Scholar]
- 110.Palacios-Prado N, Bukauskas FF. 2009. Heterotypic gap junction channels as voltage-sensitive valves for intercellular signaling. Proc. Natl Acad. Sci. USA 106, 14 855–14 860. ( 10.1073/pnas.0901923106) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 111.Buznikov GA, Lambert HW, Lauder JM. 2001. Serotonin and serotonin-like substances as regulators of early embryogenesis and morphogenesis. Cell Tissue Res. 305, 177–186. ( 10.1007/s004410100408) [DOI] [PubMed] [Google Scholar]
- 112.Baluška F, Levin M. 2016. On having no head: cognition throughout biological systems. Front. Psychol. 7, 902. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 113.Levin M. 2014. Endogenous bioelectrical networks store non-genetic patterning information during development and regeneration. J. Physiol. 592, 2295–2305. ( 10.1113/jphysiol.2014.271940) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 114.Sullivan KG, Emmons-Bell M, Levin M. 2016. Physiological inputs regulate species-specific anatomy during embryogenesis and regeneration. Commun. Integr Biol. 9, e1192733 ( 10.1080/19420889.2016.1192733) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 115.Levin M. 2014. Molecular bioelectricity: how endogenous voltage potentials control cell behavior and instruct pattern regulation in vivo. Mol. Biol. Cell 25, 3835–3850. ( 10.1091/mbc.E13-12-0708) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 116.Levin M. 2013. Reprogramming cells and tissue patterning via bioelectrical pathways: molecular mechanisms and biomedical opportunities. Wiley Interdiscip. Rev. Syst. Biol. Med. 5, 657–676. ( 10.1002/wsbm.1236) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 117.Nakajima K, et al. 2015. KCNJ15/Kir4.2 couples with polyamines to sense weak extracellular electric fields in galvanotaxis. Nat. Commun. 6, 8532 ( 10.1038/ncomms9532) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 118.Stoianov I, Zorzi M. 2012. Emergence of a ‘visual number sense’ in hierarchical generative models. Nat. Neurosci. 15, 194–196. ( 10.1038/nn.2996) [DOI] [PubMed] [Google Scholar]
- 119.Cox DD, Dean T. 2014. Neural networks and neuroscience-inspired computer vision. Curr. Biol. 24, R921–R929. ( 10.1016/j.cub.2014.08.026) [DOI] [PubMed] [Google Scholar]
- 120.Durant F, Lobo D, Hammelman J, Levin M. 2016. Physiological controls of large-scale patterning in planarian regeneration: a molecular and computational perspective on growth and form. Regeneration 3, 78–102. ( 10.1002/reg2.54) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 121.Emmons-Bell M, et al. 2015. Gap junctional blockade stochastically induces different species-specific head anatomies in genetically wild-type Girardia dorotocephala flatworms. Int. J. Mol. Sci. 16, 27 865–27 896. ( 10.3390/ijms161126065) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 122.Oviedo NJ, Morokuma J, Walentek P, Kema IP, Gu MB, Ahn JM, Hwang JS, Gojobori T, Levin M. 2010. Long-range neural and gap junction protein-mediated cues control polarity during planarian regeneration. Dev. Biol. 339, 188–199. ( 10.1016/j.ydbio.2009.12.012) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 123.Donnarumma F, Prevete R, Trautteur G. 2012. Programming in the brain: a neural network theoretical framework. Connect. Sci. 24, 71–90. ( 10.1080/09540091.2012.684670) [DOI] [Google Scholar]
- 124.Buonomano DV, Maass W. 2009. State-dependent computations: spatiotemporal processing in cortical networks. Nat. Rev. Neurosci. 10, 113–125. ( 10.1038/nrn2558) [DOI] [PubMed] [Google Scholar]
- 125.Donnarumma F, Maisto D, Pezzulo G. 2016. Problem solving as probabilistic inference with subgoaling: explaining human successes and pitfalls in the tower of Hanoi. PLoS Comput. Biol. 12, e1004864 ( 10.1371/journal.pcbi.1004864) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 126.Pai VP, Martyniuk CJ, Echeverri K, Sundelacruz S, Kaplan DL, Levin M. 2015. Genome-wide analysis reveals conserved transcriptional responses downstream of resting potential change in Xenopus embryos, axolotl regeneration, and human mesenchymal cell differentiation. Regeneration 3, 3–25. ( 10.1002/reg2.48) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 127.Tseng A-S, Levin M. 2012. Transducing bioelectric signals into epigenetic pathways during tadpole tail regeneration. Anatom. Rec. 295, 1541–1551. ( 10.1002/ar.22495) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 128.Tseng A, Levin M. 2013. Cracking the bioelectric code: probing endogenous ionic controls of pattern formation. Commun. Integr. Biol. 6, e22595 ( 10.4161/cib.22595) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 129.Doursat R, Sayama H, Michel O. 2013. A review of morphogenetic engineering. Nat. Comput. 12, 517–535. ( 10.1007/s11047-013-9398-1) [DOI] [Google Scholar]
- 130.Levin M. 2011. The wisdom of the body: future techniques and approaches to morphogenetic fields in regenerative medicine, developmental biology and cancer. Regen. Med. 6, 667–673. ( 10.2217/rme.11.69) [DOI] [PubMed] [Google Scholar]
- 131.Kim S, Kim HJ, Jeon NL. 2010. Biological applications of microfluidic gradient devices. Integr. Biol. (Camb.) 2, 584–603. ( 10.1039/c0ib00055h) [DOI] [PubMed] [Google Scholar]
- 132.Morishita Y, Hironaka K. 2013. Systems approach to developmental biology: designs for robust patterning. IET Syst. Biol. 7, 38–49. ( 10.1049/iet-syb.2012.0042) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 133.Sheeba CJ, Andrade RP, Palmeirim I. 2014. Limb patterning: from signaling gradients to molecular oscillations. J. Mol. Biol. 426, 780–784. ( 10.1016/j.jmb.2013.11.022) [DOI] [PubMed] [Google Scholar]
- 134.Slack J. 2014. Establishment of spatial pattern. Wiley Interdiscip. Rev. Dev. Biol. 3, 379–388. ( 10.1002/wdev.144) [DOI] [PubMed] [Google Scholar]
- 135.Brouzes E, Farge E. 2004. Interplay of mechanical deformation and patterned gene expression in developing embryos. Curr. Opin. Genet. Dev. 14, 367–374. ( 10.1016/j.gde.2004.06.005) [DOI] [PubMed] [Google Scholar]
- 136.Mammoto A, Mammoto T, Ingber DE. 2012. Mechanosensitive mechanisms in transcriptional regulation. J. Cell Sci. 125, 3061–3073. ( 10.1242/jcs.093005) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 137.von Dassow M, Davidson LA. 2011. Physics and the canalization of morphogenesis: a grand challenge in organismal biology. Phys. Biol. 8, 45002 ( 10.1088/1478-3975/8/4/045002) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 138.Beloussov LV. 2013. Morphogenesis can be driven by properly parametrised mechanical feedback. Eur. Phys. J E Soft Matter 36, 132 ( 10.1140/epje/i2013-13132-x) [DOI] [PubMed] [Google Scholar]
- 139.Chang F, Minc N. 2014. Electrochemical control of cell and tissue polarity. Annu. Rev. Cell Dev. Biol. 30, 317–336. ( 10.1146/annurev-cellbio-100913-013357) [DOI] [PubMed] [Google Scholar]
- 140.Stewart S, Rojas-Munoz A, Izpisua Belmonte JC. 2007. Bioelectricity and epimorphic regeneration. Bioessays 29, 1133–1137. ( 10.1002/bies.20656) [DOI] [PubMed] [Google Scholar]
- 141.Raspopovic J, Marcon L, Russo L, Sharpe J. 2014. Modeling digits. Digit patterning is controlled by a Bmp-Sox9-Wnt Turing network modulated by morphogen gradients. Science 345, 566–570. ( 10.1126/science.1252960) [DOI] [PubMed] [Google Scholar]
- 142.Papageorgiou S. 1984. A hierarchical polar coordinate model for epimorphic regeneration. J. Theor. Biol. 109, 533–554. ( 10.1016/S0022-5193(84)80157-5) [DOI] [PubMed] [Google Scholar]
- 143.Meinhardt H. 1983. A boundary model for pattern formation in vertebrate limbs. J. Embryol. Exp. Morphol. 76, 115–137. [PubMed] [Google Scholar]
- 144.French V. 1981. Pattern regulation and regeneration. Phil. Trans. R. Soc. Lond. B 295, 601–6171. ( 10.1098/rstb.1981.0163) [DOI] [PubMed] [Google Scholar]
- 145.Nelsen EM, Frankel J. 1989. Maintenance and regulation of cellular handedness in Tetrahymena. Development 105, 457–471. [DOI] [PubMed] [Google Scholar]
- 146.Verschure P, Pennartz CMA, Pezzulo G. 2014. The why, what, where, when and how of goal-directed choice: neuronal and computational principles. Phil. Trans. R. Soc. B 369, 20130483 ( 10.1098/rstb.2013.0483) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 147.Skinner BF. 1938. The behavior of organisms: an experimental analysis. New York, NY: Appleton-Century-Crofts. [Google Scholar]
- 148.Tseng AS, Beane WS, Lemire JM, Masi A, Levin M. 2010. Induction of vertebrate regeneration by a transient sodium current. J. Neurosci. 30,13 192–13 200. ( 10.1523/JNEUROSCI.3315-10.2010) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 149.Carandini M. 2012. From circuits to behavior: a bridge too far? Nat. Neurosci. 15, 507–509. ( 10.1038/nn.3043) [DOI] [PubMed] [Google Scholar]
- 150.Gold JI, Shadlen MN. 2007. The neural basis of decision making. Annu. Rev. Neurosci. 30, 535–574. ( 10.1146/annurev.neuro.29.051605.113038) [DOI] [PubMed] [Google Scholar]
- 151.Levin M, Pezzulo G, Finkelstein JM. In press Endogenous bioelectric signaling networks: exploiting voltage gradients for control of growth and form. Ann. Rev. Biomed. Eng. [DOI] [PMC free article] [PubMed] [Google Scholar]