Skip to main content
UKPMC Funders Author Manuscripts logoLink to UKPMC Funders Author Manuscripts
. Author manuscript; available in PMC: 2022 Oct 1.
Published in final edited form as: Curr Opin Neurobiol. 2022 Aug 17;76:102620. doi: 10.1016/j.conb.2022.102620

Efficient information coding and degeneracy in the nervous system

Pavithraa Seenivasan 1, Rishikesh Narayanan 1,
PMCID: PMC7613645  EMSID: EMS154634  PMID: 35985074

Abstract

Efficient information coding (EIC) is a universal biological framework rooted in the fundamental principle that system responses should match their natural stimulus statistics for maximizing environmental information. Quantitatively assessed through information theory, such adaptation to the environment occurs at all biological levels and timescales. The context dependence of environmental stimuli and the need for stable adaptations make EIC a daunting task. We argue that biological complexity is the principal architect that subserves deft execution of stable EIC. Complexity in a system is characterized by several functionally segregated subsystems that show a high degree of functional integration when they interact with each other. Complex biological systems manifest heterogeneities and degeneracy, wherein structurally different subsystems could interact to yield the same functional outcome. We argue that complex systems offer several choices that effectively implement EIC and homeostasis for each of the different contexts encountered by the system.

Introduction

The incredible similarity between pearl white and cotton white and the consequent inability to choose one can be discomforting. Nonetheless, an experienced painter who has been regularly exposed to the palette of colors can distinguish them unmistakably well. Such adaptation in responses dependent on the statistical prevalence of specific stimuli can be explained by a fundamental principle called efficient information coding (EIC) (see Box 1 for definitions of important terms). Across a range of neural scales and systems, EIC is accomplished by adaptively matching the response properties of the system to the natural statistics of the stimuli [15]. Information-theoretic analyses [6] provide a strong substrate for formalizing and assessing EIC from the perspective of maximizing stimulus information in system responses.

Box 1. Definitions of important terms.

Efficient information coding

An overarching principle that states that systems can efficiently process their inputs by matching their response properties to their natural stimulus statistics, together maximizing information transfer [116]. Although certain definitions of efficient coding also encompass energy efficiency, our focus here is exclusively on information transfer efficiency.

Complex system

A system in which smaller parts are functionally segregated or differentiated across a diversity of functions but shows increasing degrees of functional integration when more and more of its parts interact [17].

Degeneracy

The ability of elements that are structurally different to perform the same function or yield the same output [17]. Degeneracy has been shown to be prevalent across all scales of neural systems [1824].

Homeostasis

Homeostasis is a self-regulating process by which biological systems tend to maintain stability while adjusting to conditions that are optimal for survival.

Structural redundancy

Structural redundancy in systems refers to structurally identical elements performing the same functions to ensure fail safe operation wherein an identical substitute executes the function in an identical manner when the original component is unable to. Structural redundancy is fundamentally different from degeneracy, where structurally distinct elements are involved in executing the same function. While redundancy can exist even in simple systems, degeneracy is defined to be emergent in complex systems as a consequence of functional integration of functionally segregated structures/subsystems. Structural redundancy does not offer several advantages of degeneracy, including evolvability and robustness to component-specific perturbations [17,20,22].

Information redundancy

Information redundancy in encoding refers to information being redundantly represented by different neurons or networks of neurons [1,2,5]. Information redundancy hampers efficiency, thus making redundancy reduction as an important aspect of achieving EIC.

There are several reasons why EIC is a daunting task. First, the response properties of the system must continually match context-dependent and time-varying stimulus prevalence. Second, multiple timescales associated with various stimulus attributes underscore a need to distinguish temporary environmental fluctuations from persistent changes. Third, adaptations should maintain system stability by recruiting concomitant homeostatic processes that do not hamper EIC. Finally, it is critical to recognize that the rules governing the emergence of EIC could be distinct across scales. Despite these, there is a growing body of evidence that the nervous system robustly accomplishes EIC across all scales.

In this review, we present a unified synthesis with illustrative examples from several species and multiple scales of the nervous system to first demonstrate the ubiquity of EIC. We also build a systematic case that the complexity of the brain is pivotal in its ability to meet the formidable challenges faced in achieving multiscale EIC. Complexity in a system is characterized by several functionally segregated subsystems that manifest a high degree of functional integration when they interact with each other [17]. A characteristic feature of such complex systems is their ability to show degeneracy, whereby structurally different subsystems could interact to yield the same functional outcome [17]. Here, we postulate that degeneracy offers a substrate for simultaneously achieving EIC and homeostasis (Box 1). Our postulate follows from the several degrees of freedom available to a complex system, in terms of the disparate interactions among different subsystems that yield the same functional goal of stable EIC.

EIC spans multiple scales

Biological signals can be assessed at multiple hierarchical scales, ranging from molecular-to systems-level readouts. While the activity in a receptor population conveys a subcellular response to external stimuli involving its agonists, population activity of neurons constitutes a systems-level code of sensory stimuli. Physiology across scales could be characterized by a well-defined pair of natural stimulus and response, thereby extending the concept of natural stimulus statistics to all biological scales. Such extensions have facilitated the evaluation of EIC as a match between natural stimulus statistics and system responses across all scales, while also accounting for naturally observed dynamics of stimulus attributes [69,16,2527] (Figure 1).

Figure 1. Efficient information coding across different scales of analysis. (a) Systems scale efficient coding.

Figure 1

Left, audio waveforms depicting human vocalization of the phrases ‘efficient coding’, ‘degeneracy’, and ‘natural statistics’ as representative examples of natural stimuli processed by the auditory system. Center, each of the different curves represent the response properties of different neurons in the auditory system. Plotted is the minimal intensity of auditory pure tones at different frequencies required to elicit a neuronal response. The threshold is minimum at the respective characteristic frequency for each neuron, with increases observed on either side. Different neurons respond maximally to different characteristic frequencies, together spanning the range of natural auditory stimuli. Right, dynamical filters that were derived from natural sound statistics matched with the response properties of auditory neurons [12,13]. (b) Cellular scale efficient coding. Left, illustration of extracellular (top) and intracellular (bottom) waveforms, depicting naturally occurring inputs to rodent hippocampal neurons as the animal traversed a linear arena [14,48], manifesting pronounced theta-frequency oscillations. Center, the response properties of neurons in the hippocampal region resemble a band-pass filter, with peak response in the theta-frequency range [53]. Right, dynamical filters derived as the spike-triggered average manifest theta-band characteristic frequency [58]. Inset shows the magnitude spectrum of the spike-triggered average . (c) Molecular scale efficient coding. Left, a synaptic structure showing vesicular release and postsynaptic receptors. The histogram depicts the distribution of the neurotransmitter concentration in the cleft, with the cyan rectangle covering a majority of the naturally observed concentration ranges. Center, the occupancy characteristics of the postsynaptic receptors are aligned with the natural statistics of transmitter concentrations (cyan rectangle), thus allowing for the efficient transfer of information. Right, receptors manifest desensitization, which can be interpreted as a slowly decaying negative feedback loop. In the case of multiple neurotransmitter releases, both the frequency of the releases and the neurotransmitter concentration for each release play important roles in determining the efficacy of dynamical information transfer (inset). The impact of desensitization on the responses is larger when either the frequency or the concentration is high. The natural frequency of neurotransmitter release should be aligned with the neurotransmitter concentration, the receptor occupancy statistics, and the desensitization kinetics for efficient information transfer [100,101].

Exploration of EIC at the systems scale traces its origin to the path-breaking frameworks proposed by Attneave [1] and Barlow [2]. The elegant observation that the response of a neuron in the blowfly visual system matched the cumulative distribution of natural stimuli (luminance contrasts) [35] constituted an important step for the EIC framework. Ever since, EIC achieved through the match between neuronal response properties and natural stimulus statistics has been demonstrated across visual [7,9,11,15,2832], auditory (Figure 1a) [12,13,33], olfactory [10,34,35], and electrosensory [36,37] modalities. Importantly, although the EIC framework was proposed from a sensory neuroscience perspective, several studies provide lines of evidence for its manifestation in brain regions implicated in cognitive functions such as spatial navigation [14,38,39], value estimation and decision making [4042]. More generally, EIC could explain states of other parts of the nervous system involved in learning complex task paradigms, perception, and motor command execution [4347].

Information from the external world is typically represented by action-potential firing properties of individual neurons, through changes in firing frequencies and/or the timing of action potentials. The parameters intrinsic to individual neurons (morphology, ion-channel, and synaptic distributions) critically govern their ability to generate specific patterns or rates of action potentials. Alterations to single neuron properties result in massive changes to information transfer across individual neurons, even if the afferent information impinging on their synapses remain unchanged [14,38,48,49]. For instance, changes limited to ion-channel distributions critically alter the efficiency of spatial information transfer through the rate [38] or phase [14] codes in place cells. Therefore, studies analyzing the efficiency of information transfer in neural responses to external stimuli must account for the physiology of individual neurons as a critical cog in the transformation of natural stimulus statistics to a useable dynamic range of responses [14,38,50,51].

At the neuronal scale, EIC implies a match between single-neuron response properties and the statistics of different attributes of the impinging network activity [50,5256]. In achieving EIC, single neurons adaptively tune their intrinsic properties (including ion-channel conductances) to match their response properties to the natural statistics of dendritic inputs [5052,55,56]. Neurons in the hippocampus receive theta-modulated inputs, which translate to strong theta-frequency oscillations in their extracellular and intracellular potentials [57] (Figure 1b). The matched response properties, involving theta-frequency band-pass filtering in the impedance profile [53] and in the spike-triggered average [54,58] along the somato–dendritic axis of hippocampal pyramidal neurons, constitute an example of neuronal-scale EIC (Figure 1b).

Extensive studies involving the EIC framework at the molecular scale [6,2527,5968] are driven by the recognition that information about an endogenous ligand could be efficiently transmitted by matching the receptor’s response properties to natural statistics of the ligand (Figure 1c). The stimulus is defined by the abundance and the dynamics of the ligand, and the response is either the output of the receptor or of a downstream signaling cascade involving receptor activation. A recurring theme across EIC studies at the molecular scale invokes signaling motifs [69], specifically negative feedback loops, that maximize information transfer and alleviate the problem of molecular noise [25,59,60,64,66,70].

Degeneracy supports EIC

Degeneracy is a ubiquitous biological phenomenon involving the interactions between structurally distinct components yielding similar function [17]. The manifestation of degeneracy across all neural scales and the roles of degeneracy in achieving biological robustness are well established [1723]. Despite this, the powerful role of degeneracy as a substrate for learning, neural coding, and concomitant homeostasis is only beginning to be explored [14,20,21,24,38,48,49,71,72].

Degeneracy in EIC could manifest as system-to-system variability or as an individual system employing distinct context-dependent routes at different instances. A simple illustration of efficient information transfer occurring with these different manifestations is visualized with human communication involving written and verbal forms of different languages, dynamical gestures, and different contexts [17]. The availability of several routes to encode, adapt, match, and respond to persistent changes in natural stimulus statistics offers unique advantages to the system in maintaining robust EIC. Specifically, consider a scenario where a certain component or route fails to perform, owing to the dynamical state of the system or the component’s engagement in a different function. Degeneracy then provides a substrate for EIC through recruitment of different components/routes to execute the same task.

Degeneracy as a substrate for simultaneously achieving both EIC and homeostasis is particularly appealing because biological systems continually adapt to noisy dynamical stimuli exhibiting context-dependent natural statistics. Specifically, as the external stimuli is continually changing, there is a need to simultaneously maintain several variables within physiologically plausible levels. The availability of disparate routes ensures that the system has several degrees of freedom to simultaneously achieve these outcomes without cross-interferences. Degeneracy also favors evolvability of efficient coding by virtue of disparate structural components adapting differently to environmental changes, together offering a substrate for adaptive innovations in achieving EIC in a perpetually changing environment [17,22].

Degeneracy forms a reliable substrate to achieve similar information transfer efficiency through several non-unique routes. At the behavioral scale, animals are required to dynamically rely on and effectively use information from various sensory modalities to achieve functional goals such as mate attraction [73] and finding prey [74]. An outstanding example for degeneracy in systems-scale EIC involves information transfer about the identity, abundance, and dynamics of odorants by the olfactory system (Figure 2b). Through degeneracy, a parametric space spanning activity dynamics of disparate neuronal populations, random synaptic connectivity, and differential olfactory receptor abundance (Figure 2b) contributes to stereotypic functional outcomes in the olfactory system [34,35,7578]. With reference to network-scale degeneracy in EIC, response decorrelation (reducing information redundancy is a fundamental principle governing the EIC framework; see Box 1) could be achieved through disparate forms of neural-circuit heterogeneities either individually or synergistically [71,72].

Figure 2. Degeneracy in the emergence of efficient information coding across scales.

Figure 2

(a) Definition of degeneracy in the emergence of efficient information coding. In examples below, disparate combinations of parameters yield a similar efficiency in information transfer involving one or more stimulus attributes. (b) Degeneracy in efficient information coding involving systems scale parameters. Left, schematic representation of olfactory circuitry in Drosophila melanogaster. PN: projection neuron. KC: Kenyon cells. MBON: mushroom body output neuron. The PN-KC connectivity is different in the two diagrams [75,76]. The abundance of olfactory receptors is also dependent on the odor concentrations, pointing to efficient encoding that accounts for natural stimulus statistics [34,35]. Center, the parametric space includes the abundance of specific olfactory receptors across different animals, neural activity dynamics during odor presentation, the synaptic connectivity across different brain regions. Right, the information space accounts for odor identity (top), odor concentration (middle), and the spatiotemporal dynamics of odor (bottom). There are lines of evidence that disparate connectivity patterns between PN and KC result in stereotypic responses downstream [75,76]. Similar observations about random connectivity and stereotypic function have been made in the mammalian olfactory system as well [77,78]. (c) Degeneracy in efficient information coding involving cellular scale parameters. Left, schematic representation of the rodent hippocampus. CA1: Cornu Ammonis 1. CA3: Cornu Ammonis 3. DG: Dentate gyrus. Place cells in the CA1 manifest place-specific firing. Center, the parametric space includes the morphology of neurons, their biophysical properties (e.g. passive properties, ion-channel expression and distribution), and the distribution of synapses across the dendritic arbor [48,49]. Right, spatial information is transmitted through rate and phase codes. There are lines of evidence for the expression of ion-channel degeneracy in efficient spatial information transfer through rate [38] or phase [14] codes. (d) Degeneracy in efficient information coding involving molecular scale parameters. Left, illustration of a receptor on a cell surface responding to its endogenous agonist at natural concentrations through the activation of downstream signaling cascades. Shown is a scenario where receptor activation recruits a feedback motif, eventually resulting in transcriptional changes. Center, the parametric space includes the different subunits that the receptor is composed of, the phosphorylation status of different residues on these subunits, the properties and abundance of down-stream signaling molecules, and the signaling motifs recruited by individual receptors. Shown are two different scenarios with disparate subunit composition, phosphorylation status, and signaling motifs (positive vs. negative feedback). Right, the information space involves agonist concentration (top) and dynamics (bottom) and recruits the activation and dynamics of signaling molecules [26,60,79]. The bottom panel shows two graphs with phasic versus tonic dynamics of agonist encountered by the receptors [25]. There are lines of evidence for degeneracy in signaling dynamics involving disparate signaling molecules and pathways [65].

The transformation of synaptic inputs to single-neuron responses is a critical step in the cascade of transformations required for EIC of sensory stimuli by neural responses. Therefore, sensory information transfer is governed by cellular—scale parameters that mediate the input—output characteristics of individual neurons. However, efficient coding studies exploring degeneracy with reference to the impact of cellular—scale parameters on neural responses to external stimuli have been far and few. There is evidence for degeneracy in the expression of efficient spatial information transfer through rate or phase codes in hippocampal neurons (Figure 2c). These studies demonstrate that disparate combinations of cellular—scale parameters (morphology, synaptic distributions, and ion-channel expression) result in a similar efficiency in spatial information transfer [14,38].

In the molecular-scale parametric space involving receptor identity, downstream signaling motifs, post-translational modifications on receptor subunits, information typically relates to the abundance and dynamics of agonist molecules [25,26,60,79] (Figure 2d). Although the scope for the expression of degeneracy in EIC is higher at the molecular scale, given the broad parametric space, exploration has been limited. However, there are clear lines of evidence for degeneracy in signaling dynamics involving disparate signaling molecules and pathways [65].

Heterogeneities and EIC

Heterogeneity is an inescapable reality in biological systems. Heterogeneities in the brain span molecular diversity, cell-to-cell, circuit-to-circuit, and animal-to-animal variability in characteristic properties. There are also pronounced functional distinctions in encoding and decoding strategies as well as behavioral and perceptual differences. The relationship between EIC and heterogeneities has been explored from three perspectives across scales. The simplest perspective considers heterogeneities in the parametric space as a natural consequence of the manifestation of degeneracy in the functional space of EIC. Specifically, if different individuals within a population achieve EIC through disparate parametric combinations, pronounced inter-individual heterogeneity in underlying parameters are naturally expected. The manifestation of degeneracy and heterogeneities implies that a mechanism that enhances information transfer in one individual might be detrimental in another owing to distinctions in mechanisms that yielded EIC.

A second perspective, through the lens of reducing information redundancy [31,50,71,80,81], provides evidence that heterogeneities favor the emergence of EIC by forming a substrate for individual units to encode distinct information about afferent stimuli (Box 1). Such active recruitment of heterogeneities allows decorrelated responses across units, yielding efficient and non-redundant distribution of information. A recent study reported that intercellular heterogeneities within skeletal muscle fibers enhance information transmission (Figure 3a) owing to such response diversity [82]. Biophysical heterogeneities across cells in the cochlear nucleus [83] and inferior colliculus [84] have been shown to improve population coding of auditory stimuli. Different forms of neural-circuit heterogeneities have been shown to enhance decorrelation or network information transmission through either temporal or rate coding strategies [71,72,85,86].

Figure 3. Heterogeneities and efficient information coding.

Figure 3

(a) Illustration of a scenario where heterogeneity in response properties contributes to efficient coding. Left, schematic showing the flow of information from stimulus to neurons to muscle fibers, eventually resulting in muscle contraction. Center, the top panel shows heterogeneities in neural responses, with different neurons showing different threshold values (θi). The bottom panel illustrates heterogeneities in muscle output in response to neural inputs. Right, cell-to-cell variability across muscle fibers results in efficient information coding by enhancing representation for a larger stimulus range [44,82]. (b) Illustration of a scenario where the implementation of efficient coding can explain the emergence of heterogeneity in response to properties of different cells within the same system. Left, schematic of weakly electric fish (Apteronotus leptorhynchus) showing the section (yellow line) of the brain (gray) expanded below. Shown in the expanded version are three segments — centromedial (CMS), centrolateral (CLS), and lateral (LS) — of the electrosensory lateral line lobe in the brain. Representative E (blue) and I (red) cells, two distinct classes of pyramidal cells in the electrosensory lateral line lobe, are shown in the further zoomed version below. Derived from Hoffman and Chacron [36]. Right: Top, the E versus I heterogeneity within the pyramidal neuron population has been implicated in sparse neural coding, whereby E- and I-cells selectively respond to conductors versus non-conductors in the fishs natural environment, respectively. Middle, big (red) and small (blue) chirp signals consequent to natural interactions associated with courtship and aggressive encounters with other fishes, respectively. Shown are the amplitude modulation (AM) envelope and the electric organ discharge (EOD) for both signals. The second order envelope is also shown for the big chirp signal (dashed black line). Bottom, I cells prefer big chirps and respond with increased firing rates (left), whereas E cells preferentially respond to small chirps with spike bursts (right). Here, the emergence of heterogeneity in the pyramidal cell population is an effect of different sub-populations matching different aspects of the stimulus statistics toward eliciting preferential responses to different signals.

A third perspective explains response heterogeneities to be consequent to EIC, whereby different sub-populations match their response properties to respective natural stimulus statistics. As a broad example, the response profiles of auditory and visual neurons are critically dependent on the natural stimulus statistics they encode [87]. The functional heterogeneity involving two kinds of pyramidal neurons (E vs. I cells) in the electrosensory lobe of electric fishes (Figure 3b) are related to their preferential responses to different afferent stimuli associated with aggressive and courtship communication signals [80]. More subtly, heterogeneity across I-cells has been shown to govern efficient encoding of the quality of the courtship signals [80]. In mice, the dorsal and ventral retinal circuits manifest differential color-opponency, by virtue of distinct spectral characteristics of the cones that form their respective natural stimulus statistics [30].

Adaptation and stability

Correlational lines of evidence for EIC are typically based on a match between information-maximizing filters that are derived from natural stimulus statistics and experimentally observed response characteristics [9,11, 12,29,3335]. On the other hand, studies that causally test the efficient coding hypothesis recruit interventional methods that perturb the natural stimulus statistics to assess if responses adapt to match the altered stimulus statistics. Such systematic manipulations to natural stimulus statistics have been performed across sensory modalities and have provided evidence supporting EIC. In the visual system, monocular deprivation or altered distributions of stimulus orientations (Figure 4a) were employed to demonstrate adaptations matching altered statistics [88,89]. Monaural deprivations or exposure to specific tone frequencies resulted in matching alterations in the organization of auditory cortex [9093]. Nostril closure or altered odorant exposures resulted in changes in the abundance and properties of the olfactory neurons [34,35,94]. Importantly, specific plasticity and neuro-modulatory mechanisms have been identified to mediate adaptive strategies that lead to efficient codes [91,95,96]. Such adaptation has also been addressed from a dynamical perspective with the continual matching of response properties to time-varying inputs [15,16].

Figure 4. Plasticity and homeostasis in efficient information coding.

Figure 4

(a) Illustrative of a scenario where a change in natural statistics triggers the change in response properties, maintaining efficient information coding. Left: natural visual stimulus is endowed with all orientations. The cortical area is allocated uniformly across all orientations (purple). Right: an artificial intervention, involving rearing of animals in a striped environment, enhances the prevalence of inputs oriented at 135°. The cortical area allocated for 135° is higher (green) than other orientations [89]. Observational approaches to efficient coding assess the relationship between natural stimulus statistics and response characteristics to unveil a match. Interventional approaches, such as the example provided here, add further evidence for efficient coding by demonstrating that targeted manipulations to stimulus statistics introduce matching changes in response properties. (b) Illustration of a scenario where efficient information coding is hampered when response properties change, but natural statistics remain unaltered. Left: a synaptic structure showing vesicular release and the postsynaptic response depicted as an electrical deflection. The histogram depicts the distribution of the neurotransmitter concentration in the cleft, with the cyan rectangle covering a majority of the naturally observed concentration ranges. Center: the occupancy characteristics of the postsynaptic receptors (purple line) are aligned with the natural statistics of transmitter concentrations (cyan rectangle). The postsynaptic response (amplitude of electrical deflection; red circles) spans the entire dynamic range (purple rectangle) thus allowing for the efficient transfer of information conveyed by the naturally occurring transmitter concentrations. Right: a leftward shift in the occupancy characteristics of the postsynaptic receptors (from purple to green) results in misalignment of the transmitter concentration distribution (cyan rectangle) and the occupancy profile (green). Consequently, the postsynaptic response (red dots) to naturally occurring neurotransmitter concentration starts at high values, yielding saturating responses for a large range of natural concentrations. The dynamic range of responses (green rectangle) is limited under such misalignment. The bottom plots of the center and the right panels also depict zoomed versions of the receptor occupancy profiles (purple and green lines, respectively) from the top plots. A linear relationship between postsynaptic response and receptor occupancy is assumed here but that relationship could change in response to changes in neuronal morphology or intrinsic properties. Efficient information transfer could be hampered because of misalignment in this relationship as well. There are examples of hampered efficient coding of agonist concentration with misalignment in receptor characteristics and downstream signaling characteristics [59]. (c) Left, illustration of a neuron (cyan) receiving excitatory (E) and inhibitory (I) inputs. Right, illustration of voltage responses, depicted as deflections from resting membrane potential (RMP), for three distinct scenarios for the proportion of E versus I inputs to the neuron. Top, High E–Low I: Vth = RMP+40 mV, Vavg = RMP+10 mV. Middle, Balanced E–1: Vth = RMP+30 mV, Vavg = RMP. Bottom, Low E-High I, action potential threshold, Vth = RMP+20 mV, average response voltage, Vavg = RMP-10 mV. The purple ticks above each panel depict spike times based on the voltage response crossing the respective Vth. Note that the number of spikes elicited in each of these three configurations was the same (NAP = 11) because of concomitant changes in the E-I ratio and Vth. (d) The balance between excitation-inhibition and intrinsic excitability (E–1–IE) is critical for the emergence of homeostasis and efficient coding. Top: plot of the threshold voltage (Vth) versus the average response voltage (Vavg) derived from the three cases depicted in panel c, each eliciting the same number of action potentials. Bottom: a generalized depiction of the plot from the top panel showing intrinsic excitability versus synaptic drive. As a higher Vth translates to lower excitability, this generalized plot illustrates the requirement of E–1–IE balance in maintaining concomitant homeostasis and efficient coding [14].

In contrast to these examples where system responses showed adaptive plasticity to altered natural stimulus statistics, there could be changes in system responses that are not triggered by changes in environmental stimulus distributions. For instance, efficient coding of natural ligand abundance is achieved through negative feedback mechanisms that match receptor occupancy and a downstream response [59]. Perturbations to the signaling cascades without change in ligand distributions introduce misalignment of the dose—response relationship, resulting in response saturation and noise amplification [59,79]. Similarly, perturbations to postsynaptic receptor identity or input—output characteristics, without changes in transmitter statistics, would yield misalignment between the natural stimulus statistics of transmitter abundance and receptor occupancy. Such misalignments of the useful response range result in the saturation of postsynaptic responses and a loss of information about transmitter abundance (Figure 4b). Together, it is essential to assess perturbations (induced by activity, neuromodulation, or pathology) to response properties that hamper EIC by misalignment of response characteristics with natural stimulus distributions.

Continual adaptations to natural stimulus statistics need to sustain concomitant stability to avoid pathological adaptations and maintain homeostasis. Different measures for homeostasis have been proposed across scales, including excitation-inhibition (E–I) balance at the network scale, firing rate and voltage levels at the cellular scale, and calcium levels at the molecular scale [9799]. A unified metric that accounts for E–I balance and intrinsic excitability (IE, which governs firing rates and voltage levels for a specific synaptic drive) is the E—I–IE balance [14]. Homeostasis of firing rate can be achieved if the E—I ratio is counterbalanced by changes in action potential threshold that governs IE (Figure 4c). Importantly, it has been shown that EIC is achieved when there is a counterbalancing relationship between the overall synaptic drive (E–I) and neuronal gain (IE) [14]. Finally, strong lines of evidence for degeneracy in homeostatic maintenance [21,24,97], together with degeneracy in EIC explored earlier, suggest degeneracy as a efficacious substrate for achieving efficient encoding and concurrent homeostasis [14,38,71].

Conclusions

Our synthesis spanning several species and multiple scales demonstrates EIC as a generalized biological principle. We argued that biological complexity and ensuing degeneracy are central cogs in the concurrent emergence of EIC and homeostasis. We emphasized the critical roles for parametric heterogeneities as well as dynamics (associated with the stimulus and the response spaces) in improving information transfer. We postulate the interplay between EIC and homeostasis as a universal repeating motif whose balance governs biological systems across scales. The recognition of the ubiquitous nature of these governing principles and explorations focused on degeneracy as a substrate for their concurrent emergence would pave the way for deducing the beneficiary roles of complexity across all biological systems [17].

Acknowledgments

The authors thank members of the cellular neurophysiology laboratory for helpful discussions and comments on a previous version of the manuscript. The authors acknowledge funding support from the Wellcome Trust-DBT India Alliance (Senior fellowship to RN; IA/S/16/2/502727), the Department of Biotechnology through the DBT-IISc partnership program (RN), and the Ministry of Education (RN & PS).

Footnotes

CRediT author statement

Pavithraa Seenivasan: Conceptualization; Visualization; Writing — original draft; Writing — review & editing.

Rishikesh Narayanan: Conceptualization; Visualization; Writing — original draft; Writing — review & editing.

Conflict of interest statement

None declared.

References

Papers of particular interest, published within the period of review, have been highlighted as: • of special interest; •• of outstanding interest

  • 1.Attneave F. Some informational aspects of visual perception. Psychol Rev. 1954;61:183–193. doi: 10.1037/h0054663. [DOI] [PubMed] [Google Scholar]
  • 2.Barlow HB. In: Sensory communication. Rosenblith WA, editor. The MIT Press; 1961. Possible principles underlying the transformation of sensory messages; pp. 217–234. [Google Scholar]
  • 3.Laughlin S. A simple coding procedure enhances a neuron’s information capacity. Z Naturforsch C Biosci. 1981;36:910–912. [PubMed] [Google Scholar]
  • 4.van Hateren JH. Theoretical predictions of spatiotemporal receptive fields of fly LMCs, and experimental validation. J Comp Physiol. 1992;171:157–170. [Google Scholar]
  • 5.Atick JJ. Could information theory provide an ecological theory of sensory processing? Network. 1992;3:213–251. doi: 10.3109/0954898X.2011.638888. [DOI] [PubMed] [Google Scholar]
  • 6.Brenner N, Bialek W, de Ruyter van Steveninck R. Adaptive rescaling maximizes information transmission. Neuron. 2000;26:695–702. doi: 10.1016/s0896-6273(00)81205-2. [DOI] [PubMed] [Google Scholar]
  • 7.Fairhall AL, Lewen GD, Bialek W, de Ruyter Van Steveninck RR. Efficiency and ambiguity in an adaptive neural code. Nature. 2001;412:787–792. doi: 10.1038/35090500. [DOI] [PubMed] [Google Scholar]
  • 8.Hermundstad AM, Briguglio JJ, Conte MM, Victor JD, Balasubramanian V, Tkacik G. Variance predicts salience in central sensory processing. Elife. 2014;3 doi: 10.7554/eLife.03722. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Tesileanu T, Conte MM, Briguglio JJ, Hermundstad AM, Victor JD, Balasubramanian V. Efficient coding of natural scene statistics predicts discrimination thresholds for grayscale textures. Elife. 2020;9 doi: 10.7554/eLife.54347. [•• This study constitutes an extension and generalization of Hermundstad et al., 2014 that suggests that visual sensitivity to natural world is maximal along the directions of highest variability in the feature space (using binary textures). In Tesileanu et al., 2020, they extend this from binary to a larger set of grayscale texture space. With this, they show that the visual sensitivity from human psychophysics data matches the variability in stimulus space, in accordance with the ‘variance is salience’ hypothesis (Hermundstad et al., 2014), an implication of the efficient coding framework] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Kostal L, Lansky P, Rospars JP. Efficient olfactory coding in the pheromone receptor neuron of a moth. PLoS Comput Biol. 2008;4:e1000053. doi: 10.1371/journal.pcbi.1000053. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Bell AJ, Sejnowski TJ. The “independent components” of natural scenes are edge filters. Vision Res. 1997;37:3327–3338. doi: 10.1016/s0042-6989(97)00121-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Lewicki MS. Efficient coding of natural sounds. Nat Neurosci. 2002;5:356–363. doi: 10.1038/nn831. [DOI] [PubMed] [Google Scholar]
  • 13.Smith EC, Lewicki MS. Efficient auditory coding. Nature. 2006;439:978–982. doi: 10.1038/nature04485. [DOI] [PubMed] [Google Scholar]
  • 14.Seenivasan P, Narayanan R. Efficient phase coding in hippocampal place cells. Physical Review Research. 2020;2:033393. doi: 10.1103/PhysRevResearch.2.033393. [•• This study defined efficiency in spatial encoding, generalizing the EIC framework beyond primary sensory coding. Importantly, it showed that cellular scale parameters and their impact on the single-neuron properties are critical in the maximization of efficient information transfer. A misalignment in the gain of the neuron and the overall synaptic drive results in loss of the useful dynamic range. Quantitatively, the study demonstrates that counterbalancing compensations involving the overall synaptic drive (defined by the excitation-inhibition, E–I balance) and intrinsic excitability (IE) of the neuron drives efficient coding. Thus, the study proposes the use of E–I–IE balance instead of the traditionally employed E–I balance that doesn’t account for single-neuron physiology. Assessing the role of different ion-channels in efficient coding, the study demonstrated degeneracy in the emergence of efficient phase coding along with homeostasis of characteristic singleneuron physiology (including firing rate). An important contribution of this study is the assessment of efficient information transfer through a temporal code of external information, rather than the use of rate-based information transfer] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Mlynarski WF, Hermundstad AM. Efficient and adaptive sensory codes. Nat Neurosci. 2021;24:998–1009. doi: 10.1038/s41593-021-00846-0. [•• The authors in this study present a theoretical framework that assesses the dynamic trade-off between accurate information transmission of stimuli and the ability to detect momentary fluctuations in the environment. Further, they show that the rules derived by accounting for such trade-offs match experimental observations. Importantly, this study provides lines of evidence for the significance of dynamics in efficient coding frameworks] [DOI] [PubMed] [Google Scholar]
  • 16.Mlynarski WF, Hermundstad AM. Adaptive coding for dynamic sensory inference. Elife. 2018;7 doi: 10.7554/eLife.32055. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Edelman GM, Gally JA. Degeneracy and complexity in biological systems. Proc Natl Acad Sci U S A. 2001;98:13763–13768. doi: 10.1073/pnas.231499798. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Beverly M, Anbil S, Sengupta P. Degeneracy and neuromodulation among thermosensory neurons contribute to robust thermosensory behaviors in Caenorhabditis elegans. J Neurosci. 2011;31:11718–11727. doi: 10.1523/JNEUROSCI.1098-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Goaillard JM, Marder E. ion channel degeneracy, variability, and Covariation in neuron and circuit Resilience. Annu Rev Neurosci. 2021;44:335–357. doi: 10.1146/annurev-neuro-092920-121538. [•• A synthesis of findings on ion-channel degeneracy, with clear definitions about different aspects of the universal principle of degeneracy in biological systems. It is critical to note that ion-channel degeneracy could be measured with reference to functions defined in different scales. For instance, ion-channel degeneracy could be assessed with reference to characteristic physiological properties of individual neurons, as well as with reference to the ability of a neural circuit to generate rhythmic behavior] [DOI] [PubMed] [Google Scholar]
  • 20.Kamaleddin MA. Degeneracy in the nervous system: from neuronal excitability to neural coding. Bioessays. 2022;44:e2100148. doi: 10.1002/bies.202100148. [DOI] [PubMed] [Google Scholar]
  • 21.Rathour RK, Narayanan R. Degeneracy in hippocampal physiology and plasticity. Hippocampus. 2019;29:980–1022. doi: 10.1002/hipo.23139. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Whitacre J, Bender A. Degeneracy: a design principle for achieving robustness and evolvability. J Theor Biol. 2010;263:143–153. doi: 10.1016/j.jtbi.2009.11.008. [DOI] [PubMed] [Google Scholar]
  • 23.Rathour RK, Narayanan R. Homeostasis of functional maps in active dendrites emerges in the absence of individual channelostasis. Proc Natl Acad Sci U S A. 2014;111:E1787–E1796. doi: 10.1073/pnas.1316599111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Mishra P, Narayanan R. Stable continual learning through structured multiscale plasticity manifolds. Curr Opin Neurobiol. 2021;70:51–63. doi: 10.1016/j.conb.2021.07.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Purvis JE, Lahav G. Encoding and decoding cellular information through signaling dynamics. Cell. 2013;152:945–956. doi: 10.1016/j.cell.2013.02.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Selimkhanov J, Taylor B, Yao J, Pilko A, Albeck J, Hoffmann A, Tsimring L, Wollman R. Accurate information transmission through dynamic biochemical signaling networks. Science. 2014;346:1370–1373. doi: 10.1126/science.1254933. [•• An example of the use of EIC principles in molecular scale information transmission. The study explores external and internal noise in biochemical reactions using rigorous information-theoretic analyses to demonstrate that accounting for the dynamics of the system would reduce noise-induced loss in information] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Tang Y, Adelaja A, Ye FX, Deeds E, Wollman R, Hoffmann A. Quantifying information accumulation encoded in the dynamics of biochemical signaling. Nat Commun. 2021;12:1272. doi: 10.1038/s41467-021-21562-0. [•• A molecular-scale example of the use of EIC principles in analyzing cellular responses to environmental changes, which are encoded in the dynamical patterns of signaling proteins. The study develops a quantitative information-theoretic framework to assess signaling dynamics in the presence of internal noise. Employing different stimulus configurations, the study demonstrates that information-theoretic analysis needs to account for specific temporal phases of stimulus and response dynamics. These quantitative tools could be extended to analyses of EIC in other scales of analyses to account for stimulus/response dynamics and system-to-system variability] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Olshausen BA, Field DJ. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature. 1996;381:607–609. doi: 10.1038/381607a0. [DOI] [PubMed] [Google Scholar]
  • 29.Soto F, Hsiang JC, Rajagopal R, Piggott K, Harocopos GJ, Couch SM, Custer P, Morgan JL, Kerschensteiner D. Efficient coding by midget and parasol ganglion cells in the human retina. Neuron. 2020;107:656–666.:e655. doi: 10.1016/j.neuron.2020.05.030. [• The authors in this study perform large-scale recordings from the midget and parasol ganglion cells of the human retina and show that their response properties are tuned to extract maximal information from environmental stimuli. Specifically, the spatio-temporal receptive fields and the asymmetric on and off response functions of both cell types are such that a larger dynamic range of stimulus is encoded in addition to information maximization] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Szatko KP, Korympidou MM, Ran Y, Berens P, Dalkara D, Schubert T, Euler T, Franke K. Neural circuits in the mouse retina support color vision in the upper visual field. Nat Commun. 2020;11:3481. doi: 10.1038/s41467-020-17113-8. [• This study reports that neural circuits within the mouse ventral retina are tuned to extract color information owing to the dominant presence of color-opponent cells in the ventral retina. The study traces the origins for this to the differential localization of cones: the dorsal retina is endowed with two types of cones but most cones in the ventral retina display the same spectral preference. Thus, the complexity of chromatic processing in downstream retinal circuits increased because of the specific types of inputs arriving from the cones, whereby non-linear center-surround interactions created specific color-opponent output channels to the brain. In other words, neurons in the ventral retina tune themselves to extract maximal color-based information resulting in the ventral (but not the dorsal) retinal circuity capable of color opponency aiding in efficient color perception. The efficiently matched circuit-scale processing depended on the natural stimuli they receive, and together enabled robust detection of predators by extracting color information from the upper visual field] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Chalk M, Marre O, Tkacik G. Toward a unified theory of efficient, predictive, and sparse coding. Proc Natl Acad Sci U S A. 2018;115:186–191. doi: 10.1073/pnas.1711114115. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Simoncelli EP. Vision and the statistics of the visual environment. Curr Opin Neurobiol. 2003;13:144–149. doi: 10.1016/s0959-4388(03)00047-3. [DOI] [PubMed] [Google Scholar]
  • 33.Rodriguez FA, Chen C, Read HL, Escabi MA. Neural modulation tuning characteristics scale to efficiently encode natural sound statistics. J Neurosci. 2010;30:15969–15980. doi: 10.1523/JNEUROSCI.0966-10.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Tesileanu T, Cocco S, Monasson R, Balasubramanian V. Adaptation of olfactory receptor abundances for efficient coding. Elife. 2019;8 doi: 10.7554/eLife.39279. [•• The authors present lines of evidence of efficient coding in the olfactory system of the fly. Specifically, they show that the abundance of olfactory receptors is tuned to the environmental statistics of odorants. Fundamentally, this provides an explanation to empirical observations relating to the differential abundance of olfactory receptors based on stimulus statistics. Additionally, the model also presents predictions about the relationship between environmental odorant statistics and receptor abundance dynamics] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Ibarra-Soria X, Nakahara TS, Lilue J, Jiang Y, Trimmer C, Souza MA, Netto PH, Ikegami K, Murphy NR, Kusma M, et al. Variation in olfactory neuron repertoires is genetically controlled and environmentally modulated. Elife. 2017;6 doi: 10.7554/eLife.21476. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Hofmann V, Chacron MJ. Differential receptive field organizations give rise to nearly identical neural correlations across three parallel sensory maps in weakly electric fish. PLoS Comput Biol. 2017;13:e1005716. doi: 10.1371/journal.pcbi.1005716. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Huang CG, Metzen MG, Chacron MJ. Feedback optimizes neural coding and perception of natural stimuli. Elife. 2018;7 doi: 10.7554/eLife.38935. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Roy A, Narayanan R. Spatial information transfer in hippocampal place cells depends on trial-to-trial variability, symmetry of place-field firing, and biophysical heterogeneities. Neural Netw. 2021;142:636–660. doi: 10.1016/j.neunet.2021.07.026. [•• The relationship between tuning curves and information transfer has been studied across different sensory modalities. This study extends such analyses, involving stimulus-specific information metrics, to spatial information transfer and spatial tuning curves in place cells of the hippocampus. Demonstrating a critical role of single-neuron parameters (ion-channel distribution, synaptic distribution) in spatial information transfer, the study also unveils degeneracy in the ability of the cell to maximize information transfer. The study shows that high trial-to-trial variability in neural responses reduces spatial information transfer] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Sharif F, Tayebi B, Buzsaki G, Royer S, Fernandez-Ruiz A. Subcircuits of Deep and Superficial CA1 place cells support efficient spatial coding across heterogeneous environments. Neuron. 2021;109:363–376.:e366. doi: 10.1016/j.neuron.2020.10.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Tobler PN, Fiorillo CD, Schultz W. Adaptive coding of reward value by dopamine neurons. Science. 2005;307:1642–1645. doi: 10.1126/science.1105370. [DOI] [PubMed] [Google Scholar]
  • 41.Padoa-Schioppa C. Range-adapting representation of economic value in the orbitofrontal cortex. J Neurosci. 2009;29:14004–14014. doi: 10.1523/JNEUROSCI.3751-09.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Polania R, Woodford M, Ruff CC. Efficient coding of subjective value. Nat Neurosci. 2019;22:134–142. doi: 10.1038/s41593-018-0292-0. [• A systems-scale example for efficient information coding beyond primary sensory processing. In evaluating EIC, the study considered subjective preference-based decisions as the response and the structure of values in the environment as the stimulus. The authors argue that the decision process involves maximization of information in value representations, while accounting for resource constraints. This study provides an example of EIC by showing that preference-based decisions could be explained by information-maximizing transmission of subjective values in a limited-capacity system] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Koay SA, Charles AS, Thiberge SY, Brody CD, Tank DW. Sequential and efficient neural-population coding of complex task information. Neuron. 2022;110:328–349.:e311. doi: 10.1016/j.neuron.2021.10.020. [•• An example of systems scale EIC that extends this fundamental principle beyond primary sensory processing. This study recorded activity patterns of a population of neocortical neurons as animals performed a complex dynamic task. The authors report an instance of EIC by demonstrating that task variables with high correlation were represented by modes of neural population that showed low correlations] [DOI] [PubMed] [Google Scholar]
  • 44.Wada T, Hironaka K-i, Kuroda S. Cell-to-cell variability serves as information not noise. Current Opinion in Systems Biology. 2021;27 [Google Scholar]
  • 45.Gershman SJ, Niv Y. Learning latent structure: carving nature at its joints. Curr Opin Neurobiol. 2010;20:251–256. doi: 10.1016/j.conb.2010.02.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Sims CR. Efficient coding explains the universal law of generalization in human perception. Science. 2018;360:652–656. doi: 10.1126/science.aaq1118. [DOI] [PubMed] [Google Scholar]
  • 47.Tesileanu T, Olveczky B, Balasubramanian V. Rules and mechanisms for efficient two-stage learning in neural circuits. Elife. 2017;6 doi: 10.7554/eLife.20944. [•• This study views the mechanistic basis of vocalization learning in bird songs from an efficient coding perspective. Particularly, the authors show that the activity in the LMAN circuit are tuned to the plasticity mechanisms in the output RA circuit. Further, they show that a mismatch between the LMAN activity and plasticity at the RA synapses impairs learning. The study is thus an example of how the efficient coding framework underlies the shaping of not just the response distributions, but also plasticity rules in non-sensory regions] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Basak R, Narayanan R. Spatially dispersed synapses yield sharply-tuned place cell responses through dendritic spike initiation. J Physiol. 2018;596:4173–4205. doi: 10.1113/JP275310. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Basak R, Narayanan R. Robust emergence of sharply tuned place-cell responses in hippocampal neurons with structural and biophysical heterogeneities. Brain Struct Funct. 2020;225:567–590. doi: 10.1007/s00429-019-02018-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Wang XJ, Liu Y, Sanchez-Vives MV, McCormick DA. Adaptation and temporal decorrelation by single neurons in the primary visual cortex. J Neurophysiol. 2003;89:3279–3293. doi: 10.1152/jn.00242.2003. [DOI] [PubMed] [Google Scholar]
  • 51.Remme MW, Donato R, Mikiel-Hunter J, Ballestero JA, Foster S, Rinzel J, McAlpine D. Subthreshold resonance properties contribute to the efficient coding of auditory spatial cues. Proc Natl Acad Sci USA. 2014;111:E2339–E2348. doi: 10.1073/pnas.1316216111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Stemmler M, Koch C. How voltage-dependent conductances can adapt to maximize the information encoded by neuronal firing rate. Nat Neurosci. 1999;2:521–527. doi: 10.1038/9173. [DOI] [PubMed] [Google Scholar]
  • 53.Narayanan R, Johnston D. Long-term potentiation in rat hippocampal neurons is accompanied by spatially widespread changes in intrinsic oscillatory dynamics and excitability. Neuron. 2007;56:1061–1075. doi: 10.1016/j.neuron.2007.10.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Das A, Narayanan R. Active dendrites regulate spectral selectivity in location-dependent spike initiation dynamics of hippocampal model neurons. J Neurosci. 2014;34:1195–1211. doi: 10.1523/JNEUROSCI.3203-13.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Narayanan R, Johnston D. Functional maps within a single neuron. J Neurophysiol. 2012;108:2343–2351. doi: 10.1152/jn.00530.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Mease RA, Famulare M, Gjorgjieva J, Moody WJ, Fairhall AL. Emergence of adaptive computation by single neurons in the developing cortex. J Neurosci. 2013;33:12154–12170. doi: 10.1523/JNEUROSCI.3263-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Colgin LL. Mechanisms and functions of theta Rhythms. Annual review of neuroscience. 2013;36:295–312. doi: 10.1146/annurev-neuro-062012-170330. [DOI] [PubMed] [Google Scholar]
  • 58.Das A, Rathour RK, Narayanan R. Strings on a Violin: location dependence of frequency tuning in active dendrites. Front Cell Neurosci. 2017;11:72. doi: 10.3389/fncel.2017.00072. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Yu RC, Pesce CG, Colman-Lerner A, Lok L, Pincus D, Serra E, Holl M, Benjamin K, Gordon A, Brent R. Negative feedback that improves information transmission in yeast signalling. Nature. 2008;456:755–761. doi: 10.1038/nature07513. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Cheong R, Rhee A, Wang CJ, Nemenman I, Levchenko A. Information transduction capacity of noisy biochemical signaling networks. Science. 2011;334:354–358. doi: 10.1126/science.1204553. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Levchenko A, Nemenman I. Cellular noise and information transmission. Curr Opin Biotechnol. 2014;28:156–164. doi: 10.1016/j.copbio.2014.05.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Mehta P, Goyal S, Long T, Bassler BL, Wingreen NS. Information processing and signal integration in bacterial quorum sensing. Mol Syst Biol. 2009;5:325. doi: 10.1038/msb.2009.79. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Tkacik G, Callan CG, Jr, Bialek W. Information flow and optimization in transcriptional regulation. Proc Natl Acad Sci U S A. 2008;105:12265–12270. doi: 10.1073/pnas.0806077105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Lestas I, Vinnicombe G, Paulsson J. Fundamental limits on the suppression of molecular fluctuations. Nature. 2010;467:174–178. doi: 10.1038/nature09333. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Uda S, Saito TH, Kudo T, Kokaji T, Tsuchiya T, Kubota H, Komori Y, Ozaki Y, Kuroda S. Robustness and compensation of information transmission of signaling pathways. Science. 2013;341:558–561. doi: 10.1126/science.1234511. [DOI] [PubMed] [Google Scholar]
  • 66.Cohen-Saidon C, Cohen AA, Sigal A, Liron Y, Alon U. Dynamics and variability of ERK2 response to EGF in individual living cells. Mol Cell. 2009;36:885–893. doi: 10.1016/j.molcel.2009.11.025. [DOI] [PubMed] [Google Scholar]
  • 67.Chan TE, Stumpf MPH, Babtie AC. Gene Regulatory network inference from single-cell data using Multivariate information measures. Cell Syst. 2017;5:251–267.:e253. doi: 10.1016/j.cels.2017.08.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Bowsher CG, Swain PS. Environmental sensing, information transfer, and cellular decision-making. Curr Opin Biotechnol. 2014;28:149–155. doi: 10.1016/j.copbio.2014.04.010. [DOI] [PubMed] [Google Scholar]
  • 69.Alon U. An introduction to systems Biology: Design principles of biological circuits. edn Second. Chapman and Hall/CRC Press; Boca Raton, FL, USA: 2019. [Google Scholar]
  • 70.Voliotis M, Perrett RM, McWilliams C, McArdle CA, Bowsher CG. Information transfer by leaky, heterogeneous, protein kinase signaling systems. Proceedings of the National Academy of Sciences of the United States of America. 2014;111:E326–E333. doi: 10.1073/pnas.1314446111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Mishra P, Narayanan R. Disparate forms of heterogeneities and interactions among them drive channel decorrelation in the dentate gyrus: degeneracy and dominance. Hippocampus. 2019;29:378–403. doi: 10.1002/hipo.23035. [•• Decorrelation of neural responses is a central tenet within the broad EIC framework. This study demonstrates that response decorrelation could be achieved through several routes, specifically involving intrinsic, synaptic, structural, and afferent heterogeneities in neural circuits. This study also offers a unique convergence of cellular- (whereby neuronal characteristic physiology is achieved through disparate structural components) and network-scale degeneracy (showing the emergence of decorrelation through disparate combinations of neural-circuit heterogeneities)] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Mishra P, Narayanan R. Ion-channel regulation of response decorrelation in a heterogeneous multi-scale model of the dentate gyrus. Curr Res Neurobiol. 2021;2:100007. doi: 10.1016/j.crneur.2021.100007. [• This multi-scale study employs a network that incorporates several forms of neural-circuit heterogeneities in a physiologically relevant manner. The authors demonstrate that perturbation to several different ion channels altered network decorrelation in a differential manner, warning against one-to-one mappings between ion channels and network scale physiology] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Stafstrom JA, Hebets EA. Female mate choice for multimodal courtship and the importance of the signaling background for selection on male ornamentation. Current Zoology. 2013;59:200–209. [Google Scholar]
  • 74.Gomes DG, Page RA, Geipel I, Taylor RC, Ryan MJ, Halfwerk W. Bats perceptually weight prey cues across sensory systems when hunting in noise. Science. 2016;353:1277–1280. doi: 10.1126/science.aaf7934. [DOI] [PubMed] [Google Scholar]
  • 75.Caron SJ, Ruta V, Abbott LF, Axel R. Random convergence of olfactory inputs in the Drosophila mushroom body. Nature. 2013;497:113–117. doi: 10.1038/nature12063. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Mittal AM, Gupta D, Singh A, Lin AC, Gupta N. Multiple network properties overcome random connectivity to enable stereotypic sensory responses. Nat Commun. 2020;11:1023. doi: 10.1038/s41467-020-14836-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Schaffer ES, Stettler DD, Kato D, Choi GB, Axel R, Abbott LF. Odor perception on the two Sides of the brain: Consistency Despite Randomness. Neuron. 2018;98:736–742.:e733. doi: 10.1016/j.neuron.2018.04.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Miyamichi K, Amat F, Moussavi F, Wang C, Wickersham I, Wall NR, Taniguchi H, Tasic B, Huang ZJ, He Z, et al. Cortical representations of olfactory input by trans-synaptic tracing. Nature. 2011;472:191–196. doi: 10.1038/nature09714. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Brennan MD, Cheong R, Levchenko A. Systems biology. How information theory handles cell signaling and uncertainty. Science. 2012;338:334–335. doi: 10.1126/science.1227946. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Marsat G, Maler L. Neural heterogeneity and efficient population codes for communication signals. J Neurophysiol. 2010;104:2543–2555. doi: 10.1152/jn.00256.2010. [DOI] [PubMed] [Google Scholar]
  • 81.Balasubramanian V. Heterogeneity and efficiency in the brain. Proc IEEE. 2015;103:1346–1358. [Google Scholar]
  • 82.Wada T, Hironaka KI, Wataya M, Fujii M, Eto M, Uda S, Hoshino D, Kunida K, Inoue H, Kubota H, et al. Single-cell information analysis reveals that skeletal muscles incorporate cell-to-cell variability as information not noise. Cell Rep. 2020;32:108051. doi: 10.1016/j.celrep.2020.108051. [•• This study extends the idea of efficient coding to the motor system, unveiling an efficacious role for inter-cellular heterogeneity in increasing the dynamic range of responses towards maximizing transmitted information. The study demonstrates response diversity effect, whereby an information channel made of multiple cells transmitted more information in the presence of inter-cellular heterogeneity than in its absence. This is achieved by enhanced gradations in the response consequent to the summation of the variable responses across different cells] [DOI] [PubMed] [Google Scholar]
  • 83.Ahn J, Kreeger LJ, Lubejko ST, Butts DA, MacLeod KM. Heterogeneity of intrinsic biophysical properties among cochlear nucleus neurons improves the population coding of temporal information. J Neurophysiol. 2014;111:2320–2331. doi: 10.1152/jn.00836.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Holmstrom LA, Eeuwes LB, Roberts PD, Portfors CV. Efficient encoding of vocalizations in the auditory midbrain. J Neurosci. 2010;30:802–819. doi: 10.1523/JNEUROSCI.1964-09.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Shamir M, Sompolinsky H. Implications of neuronal diversity on population coding. Neural Comput. 2006;18:1951–1986. doi: 10.1162/neco.2006.18.8.1951. [DOI] [PubMed] [Google Scholar]
  • 86.Tripathy SJ, Padmanabhan K, Gerkin RC, Urban NN. Intermediate intrinsic diversity enhances neural population coding. Proc Natl Acad Sci USA. 2013;110:8248–8253. doi: 10.1073/pnas.1221214110. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.Sharma J, Angelucci A, Sur M. Induction of visual orientation modules in auditory cortex. Nature. 2000;404:841–847. doi: 10.1038/35009043. [DOI] [PubMed] [Google Scholar]
  • 88.Hubel DH, Wiesel TN, LeVay S, Barlow HB, Gaze RM. Plasticity of ocular dominance columns in monkey striate cortex. Philos Trans R Soc Lond B Biol Sci. 1977;278:377–409. doi: 10.1098/rstb.1977.0050. [DOI] [PubMed] [Google Scholar]
  • 89.Sengpiel F, Stawinski P, Bonhoeffer T. Influence of experience on orientation maps in cat visual cortex. Nat Neurosci. 1999;2:727–732. doi: 10.1038/11192. [DOI] [PubMed] [Google Scholar]
  • 90.Recanzone GH, Schreiner CE, Merzenich MM. Plasticity in the frequency representation of primary auditory cortex following discrimination training in adult owl monkeys. J Neurosci. 1993;13:87–103. doi: 10.1523/JNEUROSCI.13-01-00087.1993. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 91.Kilgard MP, Merzenich MM. Cortical map reorganization enabled by nucleus basalis activity. Science. 1998;279:1714–1718. doi: 10.1126/science.279.5357.1714. [DOI] [PubMed] [Google Scholar]
  • 92.Zhang LI, Bao S, Merzenich MM. Persistent and specific influences of early acoustic environments on primary auditory cortex. Nat Neurosci. 2001;4:1123–1130. doi: 10.1038/nn745. [DOI] [PubMed] [Google Scholar]
  • 93.Homma NY, Hullett PW, Atencio CA, Schreiner CE. Auditory cortical plasticity dependent on environmental noise statistics. Cell Rep. 2020;30:4445–4458.:e4445. doi: 10.1016/j.celrep.2020.03.014. [• This study reports a causal line of evidence for efficient encoding in the auditory cortex from a developmental (critical period plasticity) standpoint. Specifically, the authors reared rat pups in various spectro-temporally modulated noise statistics to find an enhanced signal-innoise detection performance, as a consequence. This is an interesting interventional study that directly shows that early exposure to rich noise statistics alters response properties of auditory cortical neurons such that their ability to extract the signal embedded within noise, is enhanced] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 94.Dias BG, Ressler KJ. Parental olfactory experience influences behavior and neural structure in subsequent generations. Nat Neurosci. 2014;17:89–96. doi: 10.1038/nn.3594. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95.Martelli C, Fiala A. Slow presynaptic mechanisms that mediate adaptation in the olfactory pathway of Drosophila. Elife. 2019;8 doi: 10.7554/eLife.43735. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96.Hooks BM, Chen C. Circuitry underlying experience-dependent plasticity in the mouse visual system. Neuron. 2020;106:21–36. doi: 10.1016/j.neuron.2020.01.031. [• This article reviews the architectural circuitry of the mouse visual pathway from retina through the cortex and thalamus on the grounds of relating them to experience-dependent critical period plasticity. Importantly, the authors discuss how the connectivity profiles through the visual system precisely match sensory experience not just at the retina, but all the way up to the thalamo-cortical projections, standing to testify the multiscale nature of experience-dependent plasticity and hence efficient codes] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97.Turrigiano GG. The dialectic of Hebb and homeostasis. Philos Trans R Soc Lond B Biol Sci. 2017;372 doi: 10.1098/rstb.2016.0258. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 98.Santin JM, Schulz DJ. Membrane voltage is a direct feedback signal that influences correlated ion channel expression in neurons. Curr Biol. 2019;29:1683–1688.:e1682. doi: 10.1016/j.cub.2019.04.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99.Deneve S, Machens CK. Efficient codes and balanced networks. Nat Neurosci. 2016;19:375–382. doi: 10.1038/nn.4243. [DOI] [PubMed] [Google Scholar]
  • 100.Pugh JR, Raman IM. GABAA receptor kinetics in the cerebellar nuclei: evidence for detection of transmitter from distant release sites. Biophys J. 2005;88:1740–1754. doi: 10.1529/biophysj.104.055814. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 101.DiGregorio DA, Rothman JS, Nielsen TA, Silver RA. Desensitization properties of AMPA receptors at the cerebellar mossy fiber granule cell synapse. J Neurosci. 2007;27:8344–8357. doi: 10.1523/JNEUROSCI.2399-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES