Abstract
The Wilson–Cowan model of interacting neurons (1973) is one of the most influential papers published in Biological Cybernetics (Kybernetik). This paper and a companion paper published in 1972 have been cited over 1000 times. Rather than focus on the microscopic properties of neurons, Wilson and Cowan analyzed the collective properties of large numbers of neurons using methods from statistical mechanics, based on the mean-field approach. New experimental techniques to measure neuronal activity at the level of large populations are now available to test these models, including optical recording of brain activity with intrinsic signals and voltage sensitive dyes, and new methods for analyzing EEG and MEG. These measurement techniques have revealed patterns of coherent activity that span centimetres of tissue in the cerebral cortex. Here the underlying ideas are reviewed in a historic context.
TheWilson–Cowan (1972; 1973) model is a set of differential equations that describe the time evolution of the mean level of activity of populations of neurons, using the now familiar nonlinear sigmoidal function to represent the interactions between the populations. This mean-field approach has been used to address many problems in computational neuroscience (Sejnowski 1976a; Amit and Brunel 1997; Brunel 2000; Latham et al. 2000; Hertz et al. 2004; Renart et al. 2007). TheWilson–Cowan model has also been the starting point for many extensions. The special case with symmetric connectivity allowed an energy function to be defined and was analyzed by Hopfield (1982) and Hopfield and Tank (1986). They showed that the point attractors in this model could be used to store content-addressable memories and that constraint satisfaction problems could also be solved with these equations. Continuum extensions have also been proposed (van Hemmen 2004), where the differences with excitable media are analyzed.
Another important special case is the “balanced” network, in which the excitatory and inhibitory inputs on average cancel (Shadlen and Newsome 1998; Haider et al. 2006; Renart et al. 2007). In the balanced condition, fluctuations can drive the neuron to fire, thereby producing an irregular firing patterns. Equations governing the second-order correlations and covariances have been proposed and used to study balanced networks (Sejnowski 1976b; van Vreeswijk and Sompolinsky 1996, 1998; Moreno-Bote and Parga 2006; Soula and Chow2007; El Boustani and Destexhe 2009). Similar approaches were also proposed for networks of binary neuron models (Hinton and Sejnowski 1983; Ackley et al. 1985; Ohira and Cowan 1993; Ginzburg and Sompolinsky 1994). A field-theoretic approach that generalizes the mean-field equations is also under way (Buice et al. 2009).
Other extensions include more complex intrinsic properties of neurons such as spike-frequency adaptation and bursting. In the simplest case, it is possible to obtain a second-order mean-field model by using a discretized time frame (Soula and Chow 2007), or in continuous-time (El Boustani and Destexhe 2009). The core of this approach is the “transfer function”, which relates the output of the neuron (firing rate and its variance) to its inputs (mean rate and variance of excitatory and inhibitory inputs). Transfer functions can be estimated analytically using the Fokker–Planck approach (Tuckwell 1988; Abbott and van Vreeswijk 1993; Brunel and Sergi 1998; Brunel 2000; Fourcaud and Brunel 2002). However, such results apply only to continuous-time descriptions, and exact solutions are possible only for current-based models, which are not realistic and cannot take into account properties of neurons obtained from conductance measurements in vivo. More realistic transfer functions can be obtained from approximations (Kuhn et al. 2004) or numerical estimates (Kumar et al. 2008; Soula and Chow 2007). It should also be possible to estimate the transfer function directly from real cortical neurons in vitro using a dynamic-clamp with injection of different combinations of conductance-based excitatory and inhibitory synaptic inputs (Bal and Destexhe, work in progress).
The derivation of theWilson–Cowan model depended on taking the “thermodynamic limit” (in which the number of neurons approaches infinity), but finite-size effects in systems with a finite number of neurons can be important. This results in intermediate “mesoscopic” models that may be appropriate for modelling intermediate spatial scales, such as the number of neurons covered by a camera pixel in optical imaging, which ranges from hundreds to thousand of neurons (Brunel 2000; Renart et al. 2007; Soula and Chow 2007; El Boustani and Destexhe 2009). The extension of this approach to the spatial domain is a challenge for future studies.
To conclude, we have listed here just a few of the many theoretical developments that the Wilson–Cowan model has inspired. As experimental advances in recording from large populations of neurons are refined it will be possible to test the predictions of these models. Multi-scale models are now being developed that will integrate macroscopic models at large spatial scales with models at the microscopic scale, such as the Hodgkin–Huxley biophysical models of single neurons.
Footnotes
Open Access This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
Contributor Information
Alain Destexhe, Unité de Neurosciences Intégratives et Computationnelles (UNIC), Centre National de la Recherche Scientifique (CNRS), 91198 Gif-sur-Yvette, France, alain.destexhe@unic.cnrs-gif.fr.
Terrence J. Sejnowski, The Salk Institute/CNL, P.O. Box 85800, San Diego, CA 92186-5800, USA
References
- Abbott LF, van Vreeswijk C. Asynchronous states in networks of pulse-coupled oscillators. Phys Rev E. 1993;48:1483–1490. doi: 10.1103/physreve.48.1483. [DOI] [PubMed] [Google Scholar]
- Ackley DH, Hinton GE, Sejnowski TJ. A learning algorithm for Boltzmann machines. Cogn Sci. 1985;9:147–169. [Google Scholar]
- Amit DJ, Brunel N. Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cereb Cortex. 1997;7:237–252. doi: 10.1093/cercor/7.3.237. [DOI] [PubMed] [Google Scholar]
- Buice M, Cowan JD, Chow CC. Generalized activity equations for neural networks. Neural Comput. 2009 (in press) [Google Scholar]
- Brunel N. Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J Comput Neurosci. 2000;8:183–208. doi: 10.1023/a:1008925309027. [DOI] [PubMed] [Google Scholar]
- Brunel N, Sergi S. Firing frequency of leaky integrate-and-fire neurons with synaptic currents dynamics. J Theor Biol. 1998;195:87–95. doi: 10.1006/jtbi.1998.0782. [DOI] [PubMed] [Google Scholar]
- El Boustani S, Destexhe A. A master equation formalism for macroscopic modelling of asynchronous irregular activity states. Neural Comput. 2009;21:46–100. doi: 10.1162/neco.2009.02-08-710. [DOI] [PubMed] [Google Scholar]
- Fourcaud N, Brunel N. Dynamics of the firing probability of noisy integrate-and-fire neurons. Neural Comput. 2002;14:2057–2110. doi: 10.1162/089976602320264015. [DOI] [PubMed] [Google Scholar]
- Ginzburg I, Sompolinsky H. Theory of correlations in stochastic neural networks. Phys Rev. 1994;50:3171–3191. doi: 10.1103/physreve.50.3171. [DOI] [PubMed] [Google Scholar]
- Haider B, Duque A, Hasenstaub AR, McCormick DA. Neocortical network activity in vivo is generated through a dynamic balance of excitation and inhibition. J Neurosci. 2006;26:4535–4545. doi: 10.1523/JNEUROSCI.5297-05.2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Hemmen JL. Continuum limit of discrete neuronal structures: Is cortical tissue an "excitable" medium? Biol Cybern. 2004;91:347–358. doi: 10.1007/s00422-004-0530-2. [DOI] [PubMed] [Google Scholar]
- Hertz J, Lerchner A, Ahmadi M. Mean field methods for cortical network dynamics. In: Érdi P, et al., editors. Computational neuroscience: cortical dynamics. Berlin: Springer; 2004. pp. 71–89. [Google Scholar]
- Hinton GE, Sejnowski TJ. Optimal perceptual inference; Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR); Washington DC: IEEE Computer Society; 1983. pp. 448–453. [Google Scholar]
- Hopfield JJ. Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci. 1982;79:2554–2558. doi: 10.1073/pnas.79.8.2554. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hopfield JJ, Tank DW. Computing with neural circuits: a model. Science. 1986;233:625–633. doi: 10.1126/science.3755256. [DOI] [PubMed] [Google Scholar]
- Kuhn A, Aertsen A, Rotter S. Neuronal integration of synaptic input in the fluctuation-driven regime. J Neurosci. 2004;24:2345–2356. doi: 10.1523/JNEUROSCI.3349-03.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kumar A, Schrader S, Aertsen A, Rotter S. The high-conductance state of cortical networks. Neural Comput. 2008;20:1–43. doi: 10.1162/neco.2008.20.1.1. [DOI] [PubMed] [Google Scholar]
- Latham PE, Richmond BJ, Nelson PG, Nirenberg S. Intrinsic dynamics in neuronal networks. I. Theory. J Neurophysiol. 2000;83:808–827. doi: 10.1152/jn.2000.83.2.808. [DOI] [PubMed] [Google Scholar]
- Moreno-Bote R, Parga N. Auto-and crosscorrelograms for the spike response of leaky integrate-and-fire neurons with slow synapses. Phys Rev Lett. 2006;96 doi: 10.1103/PhysRevLett.96.028101. 028101. [DOI] [PubMed] [Google Scholar]
- Ohira T, Cowan JD. Master-equation approach to stochastic neurodynamics. Phys Rev E. 1993;48:2259–2266. doi: 10.1103/physreve.48.2259. [DOI] [PubMed] [Google Scholar]
- Renart A, Moreno-Bote R, Wang XJ, Parga N. Mean-driven and fluctuation-driven persistent activity in recurrent networks. Neural Comput. 2007;19:1–46. doi: 10.1162/neco.2007.19.1.1. [DOI] [PubMed] [Google Scholar]
- Sejnowski TJ. On global properties of neuronal interaction. Biol Cybern. 1976a;22:85–95. doi: 10.1007/BF00320133. [DOI] [PubMed] [Google Scholar]
- Sejnowski TJ. On the stochastic dynamics of neuronal interaction. Biol Cybern. 1976b;22:203–211. doi: 10.1007/BF00365086. [DOI] [PubMed] [Google Scholar]
- Shadlen MN, Newsome WT. The variable discharge of cortical neurons: implications for connectivity, computation, and information coding. J Neurosci. 1998;18:3870–3896. doi: 10.1523/JNEUROSCI.18-10-03870.1998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Soula H, Chow CC. Stochastic dynamics of a finite-size spiking neural network. Neural Comput. 2007;19:3262–3292. doi: 10.1162/neco.2007.19.12.3262. [DOI] [PubMed] [Google Scholar]
- Tuckwell HC. Introduction to theoretical neurobiology. Cambridge: Cambridge University Press; 1988. [Google Scholar]
- van Vreeswijk C, Sompolinsky H. Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science. 1996;274:1724–1726. doi: 10.1126/science.274.5293.1724. [DOI] [PubMed] [Google Scholar]
- van Vreeswijk C, Sompolinsky H. Chaotic balanced state in a model of cortical circuits. Neural Comput. 1998;10:1321–1371. doi: 10.1162/089976698300017214. [DOI] [PubMed] [Google Scholar]
- Wilson HR, Cowan JD. Excitatory and inhibitory interactions in localized populations of model neurons. Biophys J. 1972;12:1–24. doi: 10.1016/S0006-3495(72)86068-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wilson HR, Cowan JD. A mathematical theory of the functional dynamics of nervous tissue. Kybernetik. 1973;13:55–80. doi: 10.1007/BF00288786. [DOI] [PubMed] [Google Scholar]