Skip to main content
Scientific Reports logoLink to Scientific Reports
. 2022 Dec 19;12:21870. doi: 10.1038/s41598-022-26392-8

Power spectrum and critical exponents in the 2D stochastic Wilson–Cowan model

I Apicella 1,2, S Scarpetta 2,3, L de Arcangelis 4, A Sarracino 5, A de Candia 1,2,
PMCID: PMC9763404  PMID: 36536058

Abstract

The power spectrum of brain activity is composed by peaks at characteristic frequencies superimposed to a background that decays as a power law of the frequency, f-β, with an exponent β close to 1 (pink noise). This exponent is predicted to be connected with the exponent γ related to the scaling of the average size with the duration of avalanches of activity. “Mean field” models of neural dynamics predict exponents β and γ equal or near 2 at criticality (brown noise), including the simple branching model and the fully-connected stochastic Wilson–Cowan model. We here show that a 2D version of the stochastic Wilson–Cowan model, where neuron connections decay exponentially with the distance, is characterized by exponents β and γ markedly different from those of mean field, respectively around 1 and 1.3. The exponents α and τ of avalanche size and duration distributions, equal to 1.5 and 2 in mean field, decrease respectively to 1.29±0.01 and 1.37±0.01. This seems to suggest the possibility of a different universality class for the model in finite dimension.

Subject terms: Computational neuroscience, Phase transitions and critical phenomena

Introduction

In the last two decades, the hypothesis that the brain operates near a critical point has gained a large evidence. The first experiments pointing in this direction were done on organotypic cultures and acute slices of rat cortex1, where scale-free distributions of activity avalanches were found. Since then, the hypothesis has been confirmed in many systems in vitro and in vivo, from cortical activity of awake monkeys2 to the resting MEG of human brain3. The distribution of avalanche sizes is found to scale as P(S)S-α, that of avalanche durations as P(T)T-τ, while the mean size of avalanches scales as STγ as a function of the duration48. A good indicator of criticality is believed to be given by the scaling relation γ=τ-1α-1, as originally predicted in the theory of crackling noise9,10, as well as by the collapse of rescaled shapes of avalanches of different durations4,7,8. The simple branching model of avalanche propagation predicts exponents α=3/2, τ=2 and γ=2, observed in some experimental realizations1,11 and in models of neural dynamics, including the fully-connected stochastic Wilson–Cowan model7. However, some experimental results have found an exponent γ around 1.3, not compatible with the value 2 predicted by the branching process universality class, even when the scaling relation is experimentally satisfied. For instance, results on spike avalanches measured in the urethane-anesthetized rat cortex12, cultured cortical networks4, ex-vivo recordings of the turtle visual cortex5, and somatosensory barrel cortex of the anesthetized rat13, have found γ around 1.3 with the scaling relation γ=τ-1α-1 satisfied.

Another important feature of neuronal dynamics is the power-law decay P(f)f-β of the power spectrum of EEG, MEG, resting state fMRI, and local field potential as a function of frequency1418, once the peaks corresponding to characteristic frequencies of oscillations have been subtracted. The values of β are found to be between 1 and 1.3 in the EEG and MEG of healthy patients16,17, while they are around 2 for epileptic patients19. On quite general grounds, the exponent β is predicted to be equal to the exponent γ of the relation STγ9. It seems therefore that there are at least two universality classes in brain dynamics, one that can be called the “mean-field” class, represented by the branching model and the fully-connected Wilson–Cowan model, that is characterized by α3/2 and βγτ2 (the equality is exact for the branching model), and another characterized by a lower value of the exponents, βγ1.3, α1.3, τ1.4. The experimental measurement of γ around 1.3, not compatible with the value of branching process, opened a debate, and it raised the question if a different model, with a different universality class12,20, might be required to explain the critical brain data4,5,12,13, or if different mechanisms, such as subsampling21, should be invoked to reconcile data with branching model.

In the present paper we study the 2D version of the stochastic Wilson–Cowan model7,22, where neurons are distributed uniformly on a 2D lattice, and connections between them decay exponentially with the distance. We can tune the network topology from 2D to fully-connected by changing the ratio between the range λ of the exponential decay of the connections, and the side of the lattice L. While in the fully-connected case the dynamics of the model is completely described by specifying two variables, the fraction of active excitatory and inhibitory neurons, in the 2D case one needs to define such fractions at each site of the lattice. As a consequence, while the fully-connected model is characterized by just two characteristic relaxation times, in the 2D model one finds a whole spectrum of times, related to the different Fourier modes of the neural activity. By making a system size expansion one finds that, if the number of neurons on each site of the lattice is large, the dynamical equations governing the evolutions of the Fourier modes decouple, and each mode obeys to the same equations of the fully-connected model, but with a different relaxation time.

Independently of the network topology, the model shows a critical point at a characteristic value of a parameter measuring the difference between the strength of excitatory and inhibitory connections. For values above the critical point, the model displays a self-sustained dynamics even in the absence of external input. At the critical point, one of the characteristic times diverges, related to the mode k=0 in spatially extended topologies, while the times of the other modes scale as |k|-2. This feature, together with the density of the wave numbers which scales as |k| in two dimensions, gives rise to a power spectrum that is proportional to f-1 (pink noise).

In the next section we introduce the model, then we study the power spectrum and relaxation functions of the firing rate in the linear case (large neuron density). We then look at the avalanche size and duration distributions, and show that at the critical point the distributions are scale free, with exponents depending on the topology of the system. Finally, we show that the exponents β and γ have approximately the same dependence on the inverse frequency and duration of avalanches, respectively, and in the 2D model tend respectively to 1 and 1.3 at low frequency and large durations.

The model

Let us consider a two-dimensional L×L lattice, where on each site there are nE=NE/L2 excitatory and nI=NI/L2 inhibitory neurons, with connections depending on the distance rij measured in lattice spacings, as shown in the scheme in Fig. 1. Note that all pairs i and j of neurons belonging to the same site have distance rij=0, so that inside one lattice site the network is fully-connected. Neurons are modeled as in22, namely they can be in two states, active and quiescent. The rate of transition from active to quiescent state is α for all the neurons, while the rate from quiescent to active state is given by an activation function f(si) of the input si of the i-th neuron, given by

si=jwijaj+hi, 1

where aj=0,1 if the j-th neuron is quiescent or active respectively, wij are the connections between neurons, and hi is an external input. We consider the activation function

f(s)=βtanh(s)ifs>0,0ifs0. 2

In the following we set α=0.1 ms-1, and β=1 ms-1. We study here a version of the model where the connections between neurons do not depend only on the type of presynaptic neuron, as in the fully-connected case, but depend also on the distance between neurons. Namely, the connection between neurons j (pre-synaptic) and i (post-synaptic) is given by

wij=12NE(w~0,0+w~s,0)e-rij/λifjis excitatory,12NI(w~0,0-w~s,0)e-rij/λifjis inhibitory, 3

where we have defined w~0,0=jwij as the sum of all the connections incoming in one neuron, which we take to be the same for all neurons, w~s,0=j|wij|, and rij is the distance between neurons. The second subscript in w~0,0 and w~s,0 refers to the wave-number k=0, see Eq. (13). The normalization factors NE and NI are defined as NE=jEe-rij/λ, NI=jIe-rij/λ, where E and I are respectively the set of all excitatory and inhibitory neurons. Note that, when λL, we recover the fully-connected model, well studied in the past7,22,23. On the other hand, when Lλ, the topology of the connections changes to two-dimensional.

Figure 1.

Figure 1

Schematic representation of the 2D model. On each site of the lattice there are nE excitatory and nI inhibitory neurons. Connections between neurons depend on the type of neuron (excitatory or inhibitory) and on the distance measured in lattice spacings. Neurons on the same site have rij=0.

We consider the same input hih for all neurons. As the connections wij depend only on the distance between neurons, and the input h is the same for different neurons, the system is translationally invariant. The fraction Σ of active neurons is a stochastic variable that at stationarity fluctuates around the fixed point value, given by the equation (see "Methods" section)

αΣ0=(1-Σ0)f(s0), 4

with s0=w~0,0Σ0+h. Note that Eq. (4) does not depend on the chosen topology of the connections, fully-connected or sparse or depending on the distance, but only on the condition that the sum of incoming connections w~0,0 is the same for all neurons, because this makes the system translationally invariant and the fixed point activity Σ0 equal for all the lattice sites. In Ref.7 it was shown that there is a critical point at h=0 and w~0,0=β-1α. For w~0,0 larger than the critical value, an attractive fixed point with Σ0>0 exists even when the external input h0. In the case of the fully-connected model, the connections wij do not depend on the spatial position of neurons, but only on the functional type (excitatory or inhibitory) of the pre-synaptic and post-synaptic neuron. In Refs.7,22,23 a further simplification was considered, that wij depends only on the type of the pre-synaptic neuron, and is given by wij=12NE(w~0,0+w~s,0) if j is excitatory and wij=12NI(w~0,0-w~s,0) if j is inhibitory. In this case, the temporal autocorrelation function of time dependent variables, like the fraction of active neurons or the firing rate, can be written in the limit of large number of neurons as23

X(t)X(0)-X02A1e-t/τ1+A2e-t/τ2,

where X(t) is the variable considered, X0 is its average value in time, A1 and A2 are constant coefficients, and τ1, τ2 are the characteristic relaxation times. While τ2 is always small, and lower than α-1, the time τ1 diverges at the critical point7.

In the fully-connected case, the state of the system depends only on two variables Σ and Δ, that correspond to the sum and difference between the fractions of activated excitatory and inhibitory neurons; conversely for connections depending on the distance, the values Σr and Δr on each site of the lattice are necessary to characterize the activity. They are defined as

Σr=12mrnE+lrnI,Δr=12mrnE-lrnI,

where mr and lr are respectively the number of active excitatory and inhibitory neurons on the lattice site r. Equivalently, we can use the Fourier transforms Σk and Δk, where k’s are L2 different wave vectors. As the system is translationally invariant, the fixed point is characterized by Σk=Δk=0 for k0. Moreover, for the wave vector k=0, at the fixed point Δ0=0 (this is a consequence of the fact that connections do not depend on the post-synaptic neuron), while Σ0 obeys the same Eq. (4) of the fully-connected case. Therefore, for w~0,0β-1α, the fixed point value Σ0 goes to zero when the external input h0, while for w~0,0>β-1α it remains finite even for h0.

A quantity that will be considered in the following is the local firing rate, defined as

Rr(t)=1-Σrf(sr), 5

where sr is the input defined by Eq. (1) of neurons on site r. Note that all the neurons on site r have the same input. The probability that a neuron on site r fires (makes a transition from inactive to active state) in the interval of time Δt is Rr(t)Δt.

Temporal correlations and power spectrum

We now consider a variable Xr(t) defined on a site r, that can be for instance the fraction of active neurons Σr(t), or the firing rate Rr(t), given by a superposition of all its Fourier components,

Xr(t)=1LkXk(t)e-ik·r.

As shown in "Methods", for large number of neurons different Fourier components of the activity decouple, and obey the same evolution equation of the total activity in the system with full connectivity. Therefore the autocorrelation function of Xr(t) will be given by the sum of the autocorrelation functions of its Fourier components,

CX(t)=Xr(t)Xr(0)-Xr(0)2Xr(0)2-Xr(0)2kXk(t)Xk(0)-Xk(0)2kA1,ke-t/τ1,k+A2,ke-t/τ2,k.

While A2,k and τ2,k remain always finite and small, A1,k and τ1,k diverge proportionally to |k|-2 at the critical point. In particular τ1,k-1D0|k|2, where D0 is a constant defined in "Methods", see Eq. (17). The power spectrum of the activity on a site of the lattice is given by the Wiener-Khinchin theorem as the temporal Fourier transform of the autocorrelation function,

P(f)=0dtcos(2πft)C(t),

and given the dependence of A1,k and τ1,k on the wave number at the critical point, in a system with a two-dimensional structure one finds a dependence P(f)1/f for frequencies between fmin=L-2D0 and fmax=λ-2D0, where L is the linear size of the lattice and λ the range of the connections (see "Methods"). Note that the exponent of the power spectrum depends on the dimension of the space, in particular P(f)f-1/2 in d=3, P(f)log(1/f) in d=4, and P(f)=const. (white noise) in dimension d>4. At frequencies ffmax only the Fourier components with the fastest relaxation time fmax-1 survive in the spectrum, so that P(f)f-2 in any spatial dimension.

In Fig. 2A,B we show the dependence of the autocorrelation function and of the power spectrum on the distance with respect to the critical point, which is given by w~0,0=β-1α=0.1 and h=0. Far from the critical point, the distribution of times for different wave vectors is narrow, the autocorrelation decays exponentially with good approximation and the power spectrum can be described by a Lorentzian. Near the critical point, we have a wide distribution of times, that gives rise to a 1/f decay in the spectrum. As shown in Fig. 2A, the corresponding relaxation function exhibits the slow decays a-blnt for a wide interval of times24.

Figure 2.

Figure 2

(A) Autocorrelation and (B) power spectrum of the single site firing rate in a two-dimensional L×L model, in the linear approximation (number of neurons N), as a function of the distance from the critical point. We set L=100, w~s,0=13.8, w~0,0=0.1, and external input h between 10-4 and 10-8. The connections between neurons depend on the distance as in Eq. (3), with λ=1.

As shown in Fig. 3A,B, the 1/f dependence of the spectrum depends not only on the distance from the critical point, but also on the range of the connections. If the range λ grows, the autocorrelation functions and power spectrum tend to those of the fully-connected system, that is characterized by just two correlation times τ1 and τ2, where τ2 is a short time of the order of α-1 while τ1 is large near the critical point, so that the autocorrelation is well described at long times by a single exponential. In Fig. 3C, we show the power spectrum evaluated in systems where connections decay as a power law. Namely, in Eq. (3), instead of the factor e-r/λ we put a factor min(1,r-ω). The case ω=0 coincides with the case λ=, and gives again the 1/f2 decay of the spectrum. Larger values of ω correspond to connections decaying more quickly, and for ω4 one finds the 1/f decay characteristic of short range connections.

Figure 3.

Figure 3

(A) Autocorrelation and (B) power spectrum of the single site firing rate in a two-dimensional L×L model, in the linear approximation (number of neurons N), as a function of the range λ of the interactions. We set L=100, w~s,0=13.8, w~0,0=0.1, h=10-8, and λ between 1 and . Note that in the limit λ= the system is no longer 2D but fully-connected. The exponent β of the power-law decay of the power spectrum P(f)f-β is β=1 for the 2D model (λL) in agreement with the analytical predictions in section "Methods", while β=2 in the fully-connected case (λ=). (C) Power spectrum for connections decaying as a power law r-ω, with the same L, w~s,0, w~0,0 and h of panels A and B. In this case β=2 for ω=0, while β=1 for ω4.

Relation between avalanche and power spectrum exponents

In this section we compare the size and duration distributions of avalanches of activity of a site of the lattice in the 2D case (with short range connections) and in the fully-connected model. In the following we set nE=nI=108 neurons for each site, and compare the behaviour of the network with L=40 and λ=1 (2D), with that of a network with L=1 (fully-connected). We remark here that in a network with L=1 the distance between all neurons is zero, so that in Eq. (3) the connections wij depend only on the type of neuron, and the model coincides with the model studied in7,22,23, with full connectivity.

We simulated the system with Langevin dynamics, see Eq. (7). To speed up the simulations, we have set the connections wij in Eq. (3) to zero when rij>3λ. We made 60 different runs both for L=1 and L=40, for respectively 3.5×107 ms and 2.5×105 ms, discarding the first 107 and 4×104 ms, and collecting the avalanches on all sites in the 2D system. We define an avalanche as follow: we divide the time in discrete bins of width δ=1 ms, and consider the time evolution of the activity on a single site. We identify an avalanche as a continuous series of time bins in which there is at least one spike (i.e., a transition of one neuron from a quiescent to an active state in the site being considered).  Note that, when simulating the system with Langevin dynamics Eq. (7), we extract the number of spikes in the interval δ from a Poissonian distribution with mean equal to the temporal integral over δ of the firing rate defined in Eq. (5) multiplied by the number of neurons in the site.

We remark here that avalanches are relative to the activity on a single site, so an avalanche begins and ends when the activity on the considered lattice site is zero, regardless of the activity on the other sites of the lattice. The size of the avalanche is defined as the total number of spikes of neurons belonging to the site considered, while the duration is the number of time bins of the avalanche multiplied by the width δ of the bins. Note that all the lattice sites are equivalent, because the connections are translationally invariant and boundary conditions are periodic, so we expect the same distribution of sizes and durations on all the sites of the network. Therefore, to improve statistics, we compute the average of the distributions over all the sites of the lattice.

The distributions of avalanche size and duration are expected to follow power-law scalings, P(S)S-α and P(T)T-τ. In Fig. 4 we report the results for the 2D system (L=40, blue dots) and the fully-connected system (L=1, red dots), for the size distribution (A) and duration distribution (B). The distributions show a clear dependence on the topology of the network. In the fully-connected model (red dots), exponents are α=1.48±0.01 and τ=2.05±0.01, very close to the values characteristic of the branching model of neural dynamics, as already observed in7. In the 2D system (blue dots), after a small size and duration regime characterized by exponents close to one, one finds, up to the cut-off of the distributions, a scaling regime with exponents α=1.29±0.01 and τ=1.37±0.01, markedly smaller than the mean-field values.

Figure 4.

Figure 4

(A) Avalanche size distribution P(S) for a 2D system with L=40, with a range of connections λ=1 (blue dots) and for a fully-connected system with L=1 (red dots). Other parameters are w~s,0=13.8, w~0,0=0.1, h=10-8, δ=1 ms. The number of neurons is 108 per site. (B) Avalanche duration distribution P(T) for the same system and parameters. The fits of the power-law exponents are done with the Python program “powerlaw”25 in the ranges indicated by the black lines.

We have then considered the relation S(T) between the duration of an avalanche and its mean size (Fig. 5A), for the same system and parameters of Fig. 4. We fit the measured data, in the same ranges of Fig. 4B, with a power law Tγ. Also in this case, we observe a marked difference between the fully-connected model (red dots), where the exponent is γ=2.04±0.01, and the 2D system where γ=1.35±0.01. Note that in both cases the expected relation9,10

γ=τ-1α-1, 6

is approximately satisfied. As for the size and duration distributions, in the 2D system the scaling regime for durations 103<T<5×104 ms is preceded by a different scaling behaviour with an exponent close to 2.

Figure 5.

Figure 5

(A) Mean size of an avalanche S(T) as a function of its duration, for the same system and parameters of Fig. 4; (B) Exponent γ of a fit of S(T) with a function Tγ, in a sliding window [T,10T]. The dashed lines show the exponents given by the fits of S(T) in panel (A), and used in Fig. 6 for the collapse of the avalanche shapes. (C) Same as in (A), but showing also S(T) for many sizes between L=1 and L=100. (D) Power spectrum P(f) of the single site firing rate; (E) Exponent β of a fit of the power spectrum P(f) with a function f-β, in a sliding window [0.1f,f]. To make the comparison with panel B easier, the scale on the x-axis is inverted: high frequencies (small times) are on the left, low frequencies (large times) on the right, (F) Exponent γ of the fit of S(T) for different sizes of the lattice. The fit is restricted to mean sizes in the range [5×106,108].

To put in evidence the dependence of the exponent γ on the range of durations chosen for the fit, in Fig. 5B we show the exponent γ of a fit of S(T) with a power law Tγ in a sliding window [T,10T]. Intervals of durations where the exponent is nearly constant represent ranges where S(T) can be well fitted by a power law. In the fully-connected case (red dots) there is a range of durations, between 102 and 103 ms, where S(T)Tγ with γ2, as already observed in7, while for longer durations the exponent drops to lower values due to the cut-off of the distribution. On the other hand, in the 2D case (blue dots), we observe a range between 103 and 104 where S(T)Tγ with γ1.3.

To investigate the relation between the exponent γ of S(T) and the exponent β of the power spectrum, in Fig. 5D we plot the power spectrum P(f) of the single site firing rate defined in Eq. (5), for the same system size and parameters of Fig. 5A,B and Fig. 4. The power spectrum of the fully-connected system is well fitted by a Lorentzian, with a white noise behaviour for frequencies lower than 1 Hz, and a decay with an exponent β=1.98±0.02 for frequencies larger than 1 Hz. Conversely the spectrum of the 2D system, as anticipated analitically for the N case, shows a decay with an exponent β=1.02±0.02 for frequencies between 0.05 and 1 Hz, intermediate between white noise at lower frequencies (not shown) and brown noise at higher ones. As we have done with the exponent γ in Fig. 5B, in Fig. 5E we plot the exponent β of a fit P(f)f-β in a sliding window of range [0.1f,f]. Comparing Fig. 5E with Fig. 5B, it can be seen that exponents γ and β have a similar dependence respectively on the avalanche duration and on the inverse frequency. In the case of the fully-connected system (red dots) both exponents are around 2 in the ranges [102,103] ms and [1, 10] Hz, and decay to lower values for longer avalanches or smaller frequencies. In the case of the 2D system the exponents are nearly constant in the ranges [103,104] ms and [0.1, 1] Hz, although they tend to quite different values, namely β1, γ1.3. The reason of this discrepancy is to be further investigated.

In Fig. 5C we show S(T) for different sizes of the lattice, from L=1 (fully-connected case) to L=40, while in Fig. 5F we plot the exponent γ measured by fits of the data in panel C in a range of mean sizes between 5×106 and 108. It can be seen that the exponent remains near to γ=2 for small sizes, and drops to a value near γ=1.3 for large lattices.

Scaling of the shape of avalanches

Together with the relation Eq. (6), another test of the “criticality” hypothesis for avalanche activity, is the scaling of the shape of the avalanches. Denoting with V(t) the mean number of spikes observed at time t during an avalanche of duration T, the total size of the avalanche is given by S=0TdtV(t)Tγ, so it is expected that the normalized shape V(t)T1-γ depends only on the rescaled time t/T. This relation should hold as long as the mean size S(T) is well fitted by a power law Tγ, that is for durations where the exponent of the sliding window fits are nearly constant in Fig. 5B. Looking at Fig. 5B, we expect a collapse of the shapes in the interval 102<T<103 ms for the fully-connected system, with a value γ2.04, and in the interval 103<T<104 ms for the 2D system, with a value γ1.35. We highlight such values of γ by dashed lines in the figure. The collapse of the shapes is indeed quite well verified, for such values and duration ranges, as shown in Fig. 6A,B. Note that, as expected, an exponent γ2 corresponds to a shape that is nearly parabolic (fully-connected system), while in the case of the 2D system the exponent γ1.3 corresponds to a more flattened shape26.

Figure 6.

Figure 6

(A) Average shape of the avalanches having duration in an interval [T/1.09,1.09T] centered on the duration T listed in the legend, divided by T1-γ, for the same parameters of Fig. 4 and for the fully-connected system (L=1); (B) The same for the 2D system (L=40).

Dependence on the fraction of inhibitory neurons

In this section we investigate the role of the ratio between excitatory and inhibitory neurons, by simulating the system also for a fraction 80/20 of excitatory and inhibitory neurons, more similar to cortical networks. The total number of neurons on each site of the lattice is 2×108 as in the previously studied (50/50) case, so that we have nE=1.6×108 and nI=4×107. Note that, as it is apparent from Eq. (3), the strength of the excitatory/inhibitory synapses is inversely proportional to the number of excitatory/inhibitory neurons, so that if the number of inhibitory neurons is decreased, the strength of inhibitory connections is correspondingly increased. In this way we ensure that the critical point corresponds to the same value of w~0,0=β-1α and h=0.

In Fig. 7 we compare the four cases considered: fully-connected 50/50, fully-connected 80/20, 2D 50/50 and 2D 80/20. We note that the fraction of inhibitory neurons affects only the cut-off in the distributions P(S) and P(T), while the mean avalanche size S(T) and the power spectrum P(f) are not affected. Moreover the cut-off has a significative change only in the 2D system, and is much less affected in the fully-connected case. In the insets of Fig. 7A,B, we report a collapse of the 50/50 and 80/20 distributions in the 2D case, showing that the cutoff is approximately four (three) times smaller in the 80/20 case for the size (duration) distributions.

Figure 7.

Figure 7

(A) Avalanche size distribution P(S) for the fully-connected and 2D models, and two different fractions of excitatory and inhibitory neurons, 50/50 and 80/20. The total number of neurons on each site is 2×108 in all cases. Other parameters as in Figs. 4 and 5 . Inset: collapse of the distributions in the 2D case. The cut-off Sc is 4×108 in the 50/50 case and 108 in the 80/20 case. (B) Avalanche duration distribution. Inset: collapse of the distributions in the 2D case. The cut-off Tc is 3×104 in the 50/50 case and 104 in the 80/20 case. (C) Mean size of the avalanche as a function of the duration. (D) Power spectrum of the firing rate.

In conclusion, we can affirm that the observed dependence of critical exponents on the spatial dimensionality is preserved also for different fractions of inhibitory neurons.

Conclusions

We have studied the stochastic Wilson–Cowan model on a 2D lattice, with connections decaying exponentially with the distance. We use a connection weight that decays exponentially with distance to model the structural anatomical connectivity that exhibits exponential decay with distance. Recent research indeed, using data from retrograde tracer injections, shows that influence of interareal distance on connectivity patterns is conform to an exponential distance rule (EDR), according to which the projection lengths decay exponentially with inter-areal separation2831. Spatial decay constant is of order of few mm for white matter, and few tenths of mm for gray matter, in mouse and macaque,28,29. Notably, in the 2D model, as in the fully-connected case, varying the difference between the strength of excitatory and inhibitory connections, the model undergoes a second order transition from a phase where the activity tends to zero in absence of external input, to a phase where the activity is self-sustained even in absence of external inputs. At the critical point, one of the relaxation times diverge. While the fully-connected model is characterized by just two relaxation times, one of which is always lower than α-1, where α is the deactivation rate of neurons, the 2D system has a spectrum of relaxation times, related to the different Fourier modes that can be defined on the lattice. Such relaxation times become proportional to D0-1|k|-2 at the critical point, where D0 is a constant and, as a consequence, the model in 2D shows a logarithmic decay of the relaxation functions and a f-1 behaviour of the power spectrum, in an interval of frequencies between fmin=L-2D0 and fmax=a-2D0, where L is the lattice size, λ is the range of connections, and D0 is defined in Eq. (17). We emphasize that the 1/f behaviour is observed for the single site activity (or the activity of a localized group of sites), being the superposition of all the Fourier components with a spectrum of relaxation times. Conversely, the activity of the entire system corresponds to the single Fourier component k=0 and therefore exhibits a 1/f2 behavior. Moreover, we have shown that the change in the behaviour of the power spectrum is related to a marked change in the exponents of the avalanche distributions. Note that, in the case of the 2D system, we have defined avalanches considering the activity on a single site and not in the whole system, in order to use the same signal considered to define the power spectrum. This choice has been also determined by the observation that, in a large 2D system, activity in the entire system never goes to zero, which would make the introduction of a thresholding procedure necessary to define avalanches. Clearly, although avalanches are measured locally, their distribution reflects the activity of all the sites of the system. In the 2D case, the exponents α and τ of the size and duration distributions become smaller than the ones predicted in the mean-field case, respectively α1.3 and τ1.4, while the exponent γ that relates the mean size to the avalanche duration decreases from 2 to 1.3. It remains to be understood the discrepancy between γ and the exponent β of the power spectrum. Notably in the 2D model the avalanche shape collapse is quite well verified with a value γ1.35, showing a more flattered shape, while it is γ2 in the fully-connected case.

Discrepancy between the fully-connected γ2 prediction and the exponent γ1.3 observed in some experiments12, with a large interval of exponents α and τ of the size and duration distributions all falling on the γ1.3 line, may be attributed to the effective topology of the measured activity. For example measurement able to record spiking activity of large areas of neuronal populations may reflect the structured topology of the network, while more localized measures (in highly connected areas) may be better approximated by mean-field i.e. fully-connected topology. It would be interesting to compare the corresponding scaling behavior of the power spectra of experimental activity in different topological conditions, to confirm the existence of different universality classes.

Methods

We consider a two-dimensional lattice of L×L sites. On each site there are nE=NE/L2 excitatory neurons and nI=NI/L2 inhibitory ones. Define mr and lr respectively the number of active excitatory and inhibitory neurons on the site r=(x,y), with x,y=0,,L-1.

In the Gaussian noise approximation, the temporal evolution of the system can be effectively described in terms of the coupled non-linear Langevin equations32

dmrdt=-αmr+(nE-mr)f(sr(e))+αmr+(nE-mr)f(sr(e))ηE,r(t), 7a
dlrdt=-αlr+(nI-lr)f(sr(i))+αlr+(nI-lr)f(sr(i))ηI,r(t), 7b

where α is the rate of deactivation of the neurons, f(s) is the input dependent rate of activation, sr(e) and sr(i) are respectively the inputs of the excitatory and inhibitory neurons on site r. They are given by

sr(e)=1nErwrr(ee)mr-1nIrwrr(ei)lr+hr(e),sr(i)=1nErwrr(ie)mr-1nIrwrr(ii)lr+hr(i).

where nE-1wrr(ee) is the strength of the connection between excitatory neurons on site r and those on site r, etc...hr(e) and hr(i) are the external inputs, ηE,r(t) and ηI,r(t) are Gaussian white noise functions.

The fractions of active neurons xr=mr/nE, yr=lr/nI obey therefore the equations

dxrdt=-αxr+(1-xr)f(sr(e))+nE-1/2αxr+(1-xr)f(sr(e))ηE,r(t), 8a
dyrdt=-αyr+(1-yr)f(sr(i))+nI-1/2αyr+(1-yr)f(sr(i))ηI,r(t). 8b

Let us suppose now that connections depend only on the distance |r-r|, and the external input is independent of the site, hr(e)=h0(e), hr(i)=h0(i). In these hypotheses the fixed point of Eq. (8) is the same for all sites, and corresponds to xr=x0, yr=y0, with

αx0=(1-x0)f(s0(e)),αy0=(1-y0)f(s0(i)),

and

s0(e)=rwrr(ee)x0-rwrr(ei)y0+h0(e),s0(i)=rwrr(ie)x0-rwrr(ii)y0+h0(i).

We can perform a system size expansion, changing variables from the fractions of active neurons xr and yr to the deviations of the fractions with respect to the fixed point. Defining xr=x0+nE-1/2ξE,r, yr=y0+nI-1/2ξI,r, substituting in Eq. (8), and neglecting terms that are small when the number of neurons is large, we obtain the linear Langevin equations

dξE,rdt=-α+f(s0(e))ξE,r+(1-x0)f(s0(e))rwrr(ee)ξE,r-rwrr(ei)ξI,r+2αx0ηE,r(t), 9a
dξI,rdt=-α+f(s0(i))ξI,r+(1-y0)f(s0(i))rwrr(ie)ξE,r-rwrr(ii)ξI,r+2αy0ηI,r(t). 9b

The Eq. (9) are translationally invariant and linear, therefore it is convenient to perform a Fourier transform and define

ξ~E,k=1Lreik·rξE,r,ξE,r=1Lke-ik·rξ~E,k,ξ~I,k=1Lreik·rξI,r,ξE,r=1Lke-ik·rξ~I,k,

where k=2πL(kx,ky), with kx,ky=0,,L-1.

Substituting in (9), we obtain the decoupled equations for each of the L×L pairs of Fourier modes ξ~E,k and ξ~I,k,

ddtξ~E,kξ~I,k=-α-f(s0(e))+(1-x0)f(s0(e))w~k(ee)-(1-x0)f(s0(e))w~k(ei)(1-y0)f(s0(i))w~k(ei)-α-f(s0(i))-(1-y0)f(s0(i))w~k(ii)ξ~E,kξ~I,k+2αx0ηE,k(t)2αy0ηI,k(t) 10

where w~k(ee)=reik·(r-r)wrr(ee), etc..., ηE,k(t)ηE,k(t)=δk,-kδ(t-t), etc...

If the connections do not depend on the post-synaptic neuron, but only on the pre-synaptic one, that is w~k(ee)=w~k(ie)=w~k(e), w~k(ei)=w~k(ii)=w~k(i), and the external input is h0(e)=h0(i)=h, we can further simplify the equations, making the variable substitution ξ~Σ,k=ξ~E,k+ξ~I,k2, ξ~Δ,k=ξ~E,k-ξ~I,k2. In this case, the fixed point values x0 and y0 of the excitatory and inhibitory fraction of active neurons are the same, so that we can define x0=y0=Σ0, and s0(e)=s0(i)=s0, and the matrix in Eq. (10) becomes upper triangular

ddtξ~Σ,kξ~Δ,k=-1/τ1,kw~ff,k0-1/τ2,kξ~Σ,kξ~Δ,k+αΣ0ηΣ,k(t)ηΔ,k(t). 11

where

τ1,k-1=α+f(s0)-(1-Σ0)f(s0)w~0,k, 12a
τ2,k-1=α+f(s0), 12b
w~ff,k=(1-Σ0)f(s0)w~s,k, 12c

and

w~0,k=w~k(e)-w~k(i)=rwrr(e)-wrr(i)cosk·(r-r), 13a
w~s,k=w~k(e)+w~k(i)=rwrr(e)+wrr(i)cosk·(r-r), 13b

where we have used the fact that wrr(e)=wrr(e), wrr(i)=wrr(e). Note that τ2,k is independent of k. The fixed point input s0 can be written as s0=w~0,0Σ0+h, and we report here for convenience the form of the fixed point equation,

αΣ0=(1-Σ0)f(s0). 14

As we have seen, each of the Fourier modes behaves exactly as the total fraction of neurons in the model with all-to-all connections, but with parameters τ1,k, w~ff,k that depend on the Fourier mode k. The autocorrelation function of the fluctuations ξ~Σ,k is therefore given by23

ξ~Σ,k(t)ξ~Σ,-k(0)=A1,ke-t/τ1,k+A2,ke-t/τ2,k,

where

A1,k=αΣ0τ1,k2τ2,k22(τ1,k2-τ2,k2)τ1,kτ2,k-2+τ1,kw~ff,k2-τ1,k-1,A2,k=-αΣ0τ1,k2τ2,k3w~ff,k22(τ1,k2-τ2,k2).

By performing an inverse Fourier transform, we can find the autocorrelation function of ξΣ,r=ξE,r+ξI,r2, which is given by

CΣ(t)=ξΣ,r(t)ξΣ,r(0)=1L2kξ~Σ,k(t)ξ~Σ,-k(0).

The power spectrum of the variable ξΣ,r(t) is therefore given by the Wiener-Khinchin theorem as

P(f)=0dtcos(2πft)CΣ(t)=1L2kA1,kτ1,k1+4π2τ1,k2f2+A2,kτ2,k1+4π2τ2,k2f2.

The linear Eq. (10) depend basically on parameters defined at the fixed point. The fixed point can undergo different kinds of transitions (bifurcations). We will consider here the case of the transcritical bifurcation, where one of the eigenvalues of the matrix in Eq. (11) vanishes, in particular we will consider the case in which the eigenvalue τ1,0-1 corresponding to the mode k=0 vanishes, so that

α+f(s0)-(1-Σ0)f(s0)w~0,0=0. 15

For values of |k| smaller than λ-1, where λ is the range of the connections wrr(e) and wrr(i), taking the first two terms of the Taylor expansion of the cosine in Eq. (13a), we have

w~0,kw~0,0-|k|22rwrr(e)-wrr(i)|r-r|2cos2θ=w~0,0-πd/2|k|22Γ(1+d/2)0drrd+1wr(e)-wr(i), 16

where θ is the angle between k and r-r, d is the dimension of the space, and Γ(x) is the Gamma function. Putting this expression in Eq. (12a), and using Eq. (15), we obtain that τ1,k-1D0|k|2, where

D0=πd/2(1-Σ0)f(s0)2Γ(1+d/2)0drrd+1wr(e)-wr(i). 17

The values of τ1,k therefore diverge for |k|0, so that we can consider τ1,kτ2,k for low values of the wave number. In this case, we can approximate

A1,kαΣ021+τ2,k2w~ff,k2τ1,k.

Therefore both τ1,k and A1,k diverge for |k|0, while τ2,k, A2,k e w~ff,k remain finite. Neglecting terms relative to τ2,k in the power spectrum, we obtain

P(f)=αΣ02L21+τ2,k2w~ff,k2kD0-2|k|-41+4π2D0-2|k|-4f2.

In d spatial dimensions, the density of wave numbers is L2πdkd-1dk, and changing the sum with an integral

P(f)=αΣ0Ld-2(4π)2D0d/21+τ2,k2w~ff,k2f/fmaxf/fminx(2-d)/21+x2dxf(d-4)/2, 18

where fmax=λ-2D0 with λ the range of the connections, while fmin=L-2D0. For fminffmax and d<4, the integral is approximately independent of f, so that P(f)f(d-4)/2. In particular P(f)1/f in d=2 and P(f)1/f1/2 in d=3. In d=4 there is a divergence x-1 in the integrand, so that P(f)-logf, while for d>4 the divergence exactly cancels the factor f(d-4)/2, so that the spectrum becomes constant (white noise). Note that the previous derivation holds only for λL, otherwise the condition fminffmax cannot be met.

Acknowledgements

AdC, IA and LdA acknowledge financial support from the MIUR PRIN 2017WZFTZP “Stochastic forecasting in complex systems”. AS acknowledges financial support form MIUR PRIN 201798CZLJ. LdA and AS acknowledge support from Program (VAnviteLli pEr la RicErca: VALERE) 2019 financed by the University of Campania “L. Vanvitelli”.

Author contributions

All authors designed the project, conceived the model and planned the simulations. I.A. performed the simulations and analyzed data. All authors wrote and reviewed the manuscript.

Data availability

The datasets analysed during the current study are available from the corresponding author on reasonable request.

Competing interests

The authors declare no competing interests.

Footnotes

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Beggs JM, Plenz D. Neuronal avalanches in neocortical circuits. J. Neurosci. 2003;23:11167. doi: 10.1523/JNEUROSCI.23-35-11167.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Petermann T, Thiagarajan TC, Lebedev MA, Nicolelis MA, Chialvo DR, Plenz D. Spontaneous cortical activity in awake monkeys composed of neuronal avalanches. Proc. Natl. Acad. Sci. 2009;106:15921. doi: 10.1073/pnas.0904089106. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Shriki O, Alstott J, Carver F, Holroyd T, Henson RN, Smith ML, Coppola R, Bullmore E, Plenz D. Neuronal avalanches in the resting meg of the human brain. J. Neurosci. 2013;33:7079. doi: 10.1523/JNEUROSCI.4286-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Friedman N, Ito S, Brinkman BA, Shimono M, Lee DeVille E, Dahmen KA, Beggs JM, Butler TC. Universal critical dynamics in high resolution neuronal avalanche data. Phys. Rev. Lett. 2012;108:208102. doi: 10.1103/PhysRevLett.108.208102. [DOI] [PubMed] [Google Scholar]
  • 5.Shew W, Clawson WW, Pobst J. Adaptation to sensory input tunes visual cortex to criticality. Nat. Phys. 2015;11:659. doi: 10.1038/nphys3370. [DOI] [Google Scholar]
  • 6.Scarpetta S, Apicella I, Minati L, de Candia A. Hysteresis, neural avalanches, and critical behavior near a first-order transition of a spiking neural network. Phys. Rev. E. 2018;97:062305. doi: 10.1103/PhysRevE.97.062305. [DOI] [PubMed] [Google Scholar]
  • 7.de Candia A, Sarracino A, Apicella I, de Arcangelis L. Critical behaviour of the stochastic Wilson–Cowan model. PLoS Comput. Biol. 2021;17:e1008884. doi: 10.1371/journal.pcbi.1008884. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Nandi MK, Sarracino A, Herrmann HJ, de Arcangelis L. On the scaling of avalanche shape and activity spectrum in neuronal networks. Phys. Rev. E. 2022;106:024304. doi: 10.1103/PhysRevE.106.024304. [DOI] [PubMed] [Google Scholar]
  • 9.Kuntz MC, Sethna JP. Noise in disordered systems: The power spectrum and dynamic exponents in avalanche models. Phys. Rev. B. 2000;62:11699. doi: 10.1103/PhysRevB.62.11699. [DOI] [Google Scholar]
  • 10.Sethna JP, Dahmen KA, Myers CR. Crackling noise. Nature. 2001;410:242. doi: 10.1038/35065675. [DOI] [PubMed] [Google Scholar]
  • 11.Miller Stephanie R, Yu Shan, Plenz Dietmar. The scale-invariant, temporal profile of neuronal avalanches in relation to cortical γ–oscillations. Sci. Rep. 2019;9:1–14. doi: 10.1038/s41598-019-52326-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Fontenele AJ, de Vasconcelos NA, Feliciano T, Aguiar LA, Soares-Cunha C, Coimbra B, Dalla Porta L, Ribeiro S, Rodrigues AJ, Sousa N, Carelli PV, Copelli Mauro. Criticality between cortical states. Phys. Rev. Lett. 2019;122:208101. doi: 10.1103/PhysRevLett.122.208101. [DOI] [PubMed] [Google Scholar]
  • 13.Mariani B, Nicoletti G, Bisio M, Maschietto M, Oboe R, Leparulo A, Suweis S, Vassanelli S. Neuronal avalanches across the rat somatosensory barrel cortex and the effect of single whisker stimulation. Front. Syst. Neurosci. 2021;15:709677. doi: 10.3389/fnsys.2021.709677. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Novikov E, Novikov A, Shannahoff-Khalsa D, Schwartz B, Wright J. Scale-similar activity in the brain. Phys. Rev. E. 1997;56:R2387. doi: 10.1103/PhysRevE.56.R2387. [DOI] [Google Scholar]
  • 15.Bedard C, Kroeger H, Destexhe A. Does the 1/f frequency scaling of brain signals reflect self-organized critical states? Phys. Rev. Lett. 2006;97:118102. doi: 10.1103/PhysRevLett.97.118102. [DOI] [PubMed] [Google Scholar]
  • 16.Dehghani N, Bedard C, Cash S, Halgren E, Destexhe A. Comparative power spectral analysis of simultaneous elecroencephalographic and magnetoencephalographic recordings in humans suggests non-resistive extracellular media. J. Comput. Neurosci. 2010;29:405. doi: 10.1007/s10827-010-0263-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Pritchard W. The brain in fractal time: 1/f-like power spectrum scaling of the human electroencephalogram. Int. J. Neurosci. 1992;66:119. doi: 10.3109/00207459208999796. [DOI] [PubMed] [Google Scholar]
  • 18.Zarahn E, Aguirre G, Esposito MD. Empirical analyses of bold fmri statistics. Neuroimage. 1997;5:179. doi: 10.1006/nimg.1997.0263. [DOI] [PubMed] [Google Scholar]
  • 19.He BJ, Zempel JM, Snyder AZ, Raichle ME. The temporal structures and functional significance of scale-free brain activity. Neuron. 2010;66:353. doi: 10.1016/j.neuron.2010.04.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Dalla Porta Leonardo, Copelli Mauro. Modeling neuronal avalanches and long-range temporal correlations at the emergence of collective oscillations: Continuously varying exponents mimic m/eeg results. PLoS Comput. Biol. 2019;15:e1006924. doi: 10.1371/journal.pcbi.1006924. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Carvalho TTA, Fontenele AJ, Girardi-Schappo M, Feliciano T, Aguiar LAA, Silva TPL, de Vasconcelos NAP, Carelli P PV, Copelli M. Subsampled directed-percolation models explain scaling relations experimentally observed in the brain. Front. Neural Circuits. 2021;14:576727. doi: 10.3389/fncir.2020.576727. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Benayoun M, Cowan JD, van Drongelen W, Wallace E. Avalanches in a stochastic model of spiking neurons. PLoS Comput. Biol. 2010;6:e1000846. doi: 10.1371/journal.pcbi.1000846. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Sarracino A, Arviv O, Shriki O, de Arcangelis L. Predicting brain evoked response to external stimuli from temporal correlations of spontaneous activity. Phys. Rev. Res. 2020;2:033355. doi: 10.1103/PhysRevResearch.2.033355. [DOI] [Google Scholar]
  • 24.Hooge FN, Bobbert PA. On the correlation function of 1/f noise. Phys. B. 1997;239:223. doi: 10.1016/S0921-4526(97)00332-3. [DOI] [Google Scholar]
  • 25.Alstott J, Bullmore E, Plenz D. A python package for analysis of heavy-tailed distributions. PLoS One. 2014;9:e95816. doi: 10.1371/journal.pone.0085777. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Baldassarri A. Universal excursion and bridge shapes in abbm/cir/bessel processes. J. Stat. Mech. Theory Exp. 2021;8:083211. doi: 10.1088/1742-5468/ac1404. [DOI] [Google Scholar]
  • 27.Ercsey-Ravasz M, Markov Nikola T, Lamy C, Van Essen DC, Knoblauch K, Toroczkai Z, Kennedy H. A predictive network model of cerebral cortical connectivity based on a distance rule. Neuron. 2013;80:184–197. doi: 10.1016/j.neuron.2013.07.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Gămănuţ R, Kennedy H, Toroczkai Z, Ercsey-Ravasz M, Van Essen DC, Knoblauch K, Burkhalter A. The mouse cortical connectome characterized by an ultra dense cortical graph maintains specificity by distinct connectivity profiles. Neuron. 2018;97(3):698. doi: 10.1016/j.neuron.2017.12.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Horvát S, Gămănuţ R, Ercsey-Ravasz M, Magrou L, Gămănuţ B, Van Essen DC, et al. Spatial embedding and wiring cost constrain the functional layout of the cortical network of rodents and primates. PLoS Biol. 2016;14:e1002512. doi: 10.1371/journal.pbio.1002512. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Markov NT, Ercsey-Ravasz M, Van Essen DC, Knoblauch K, Toroczkai Z, Kennedy H. Cortical high-density counterstream architectures. Science. 2013;342:1238406. doi: 10.1126/science.1238406. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Markov NT, Ercsey-Ravasz M, Lamy C, Ribeiro Gomes AR, Magrou L, Misery P, Giroud P, Barone P, Dehay C, Toroczkai Z, Knoblauch K, Van Essen DC, Kennedy H. The role of long-range connections on the specificity of the macaque interareal cortical network. Proc. Natl. Acad. Sci. 2013;110v:5187–5192v. doi: 10.1073/pnas.1218972110. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.van Kampen, N. G. Stochastic Processes in Physics and Chemistry (North Holland, 2007)

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The datasets analysed during the current study are available from the corresponding author on reasonable request.


Articles from Scientific Reports are provided here courtesy of Nature Publishing Group

RESOURCES