Abstract
A model for NMDA-receptor-mediated synaptic currents in leaky integrate-and-fire neurons, first proposed by Wang (J Neurosci, 1999), has been widely studied in computational neuroscience. The model features a fast rise in the NMDA conductance upon spikes in a pre-synaptic neuron followed by a slow decay. In a general implementation of this model which allows for arbitrary network connectivity and delay distributions, the summed NMDA current from all neurons in a pre-synaptic population cannot be simulated in aggregated form. Simulating each synapse separately is prohibitively slow for all but small networks, which has largely limited the use of the model to fully connected networks with identical delays, for which an efficient simulation scheme exists. We propose an approximation to the original model that can be efficiently simulated for arbitrary network connectivity and delay distributions. Our results demonstrate that the approximation incurs minimal error and preserves network dynamics. We further use the approximate model to explore binary decision making in sparsely coupled networks.
Introduction
A model for a leaky integrate-and-fire neuron with NMDA-receptor-mediated synaptic currents generating persistent activity proposed by Wang and Brunel (Wang, 1999; Brunel & Wang, 2001; Wang, 2002), based on earlier kinetic modeling work by Destexhe et al. (1994), has been widely adopted in computational neuroscience, both for spiking-neuron and mean-field models (Wong & Wang, 2006; Deco & Jirsa, 2012). The model features a two-dimensional nonlinear system of ordinary differential equations for the presynaptic gating variable
. Due to the nonlinearity of the system, the synaptic current in a postsynaptic neuron cannot be simulated in aggregated form. In a general implementation of the model, all synapses must be simulated explicitly, which is prohibitively expensive for all but small networks. In the specific case of a fully connected network with identical delays, the sum over all presynaptic gating variables is identical for all neurons and can be simulated globally instead of individually for each neuron. The original model is, therefore, mainly of use in the case of fully connected networks with identical delay.
Noting that the presynaptic gating variable
only depends on the spike history of the presynaptic neuron, we show that the NMDA dynamics can be approximated by an exponential decay between spikes and a history-dependent jump upon spikes. This form allows the summed gating variables in postsynaptic neurons to be reduced to a single variable, which can be efficiently simulated regardless of network connectivity or delay distribution. In the present work, we derive the approximate model and empirically characterize the error by comparing the original model and the approximation in neurons receiving identical input spikes. We show that errors in the synaptic currents vanish rapidly and that the effect on the membrane potential is small. Furthermore, we reproduce the binary decision-making network studied by Wang (2002) and Wong and Wang (2006) with both the approximate model and the original model. We find that the model dynamics are well-preserved in the approximation. Benchmarks show a significant speedup for the approximate model compared to a general implementation of the original model designed for arbitrary connectivity and delay distributions. Leveraging the flexibility and enhanced performance of the approximate model, we explore the dynamics of a sparsely connected binary decision-making network. A reference implementation of our approximate model is made available in the NEST simulator (Graber et al., 2024) as model iaf_bw_2001.
Methods
In this section, we first describe the original model, followed by the derivation of the approximate model. We then present the network models used in this paper and our benchmarking setup.
Description of the original model
The original model (Brunel & Wang, 2001) is a conductance-based leaky integrate-and-fire neuron with a synaptic NMDA current given by
![]() |
1 |
![]() |
2 |
![]() |
3 |
where
,
and
are model parameters, and
are the spike times of neuron j. See Table 1 for the complete model equations and Table 2 for parameter values.
Table 1.
Description of decision-making network following the guidelines of Nordlie et al. (2009)
| A | Model summary | ||||
| Populations | Three excitatory, one inhibitory, three external | ||||
| Network model | Fully connected | ||||
| Neuron model | Local populations: leaky integrate-and-fire, external: Poisson generator | ||||
| Synapse model | Conductance-based, with fixed strength for each pair of populations | ||||
| B | Populations | ||||
| Name | Symbol | Size | |||
| Selective A |
|
|
|||
| Selective B |
|
|
|||
| Nonselective |
|
|
|||
| Inhibitory | I |
|
|||
| C | Connectivity | ||||
| Source | Target | Weight | Delay | Receptors | Connection rule |
|
|
|
|
AMPA,NMDA | Fully connected |
|
|
|
|
AMPA,NMDA | Fully connected |
|
|
|
|
AMPA,NMDA | Fully connected |
|
|
|
|
AMPA,NMDA | Fully connected |
|
|
1 |
|
AMPA,NMDA | Fully connected |
| I |
|
1 |
|
GABA | Fully connected |
| D | Neuron model | ||||
| Type | Leaky integrate-and-fire neuron | ||||
| Description | Dynamics of membrane potential (neuron ): |
||||
- Spike emission at times with
|
|||||
| - Subthreshold dynamics: | |||||
|
|||||
where is the membrane capacitance, the membrane potential, the membrane conductance, and the synaptic inputs. |
|||||
- Reset + refractoriness:
|
|||||
| Solved with RKF45 with adaptive step size, where spikes are checked at intervals of dt. | |||||
Membrane potential is initialized as at . |
|||||
| E | Synapse model | ||||
| Type | Conductance-based currents | ||||
| Description |
|
||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
| F | Signals | ||||
| Name | Target | Description | |||
|
|
Constant rate Poisson generator with rate and weight 1. Active from to . |
|||
|
|
Poisson generator with rates sampled from every and weight 1. Active from to . |
|||
|
|
Poisson generator with rates sampled from every and weight 1. Active from to . |
Table 2.
Parameters for decision-making network from Wang (2002)
| Symbol | Description | ||
|---|---|---|---|
| Neuron parameters | |||
| Excitatory neurons | Inhibitory neurons | ||
|
Membrane capacitance | 500 pF | 250 pF |
|
Absolute refractory period | 2 ms | 1 ms |
|
Firing threshold |
mV |
mV |
|
Reset membrane potential |
mV |
mV |
|
Passive leak reversal potential |
mV |
mV |
|
NMDA gating variable gain factor | 0.5 ms-1 | 0.5 ms-1 |
|
Magnesium ion concentration | 1.0 mM | 1.0 mM |
|
AMPA synaptic time constant | 2 ms | 2 ms |
|
GABA synaptic time constant | 2 ms | 2 ms |
|
NMDA synaptic rise time constant | 2 ms | 2 ms |
|
NMDA synaptic decay time constant | 100 ms | 100 ms |
|
Leak conductance | 25 nS | 20 nS |
|
AMPA conductance | 0.05 nS | 0.04 nS |
|
GABA conductance | 1.3 nS | 1.0 nS |
|
NMDA conductance | 0.165 nS | 0.13 nS |
| Population parameters | |||
|
Total number of excitatory neurons | 1600 | |
|
Total number of inhibitory neurons | 400 | |
| f | Fraction of each selective population | 0.15 | |
| Connection parameters | |||
|
Synaptic delay period | 0.5 ms | |
|
Potentiated weight | 1.7 | |
|
Depressed weight |
|
|
| Signal parameters | |||
|
External input rate | 2400 sp/s | |
|
Base signal rate to selective populations | 40 sp/s | |
|
Coherence scaling factor selective pop. A | 0.4 | |
|
Coherence scaling factor selective pop. B | 0.4 | |
| Simulation parameters | |||
|
Simulation duration | 4000 ms | |
| dt | Time resolution | 0.1 ms | |
Simplified NMDA gating dynamics
We will focus solely on the NMDA gating variables
and
. For simplicity, we use the shorthand notation
and
to represent
and
, respectively. Assuming that neuron j last spiked at time zero and does not spike again until time t, the solution to Eq. (3) is given by
![]() |
4 |
where
is the value immediately after the spike. By substituting the solution for
into Eq. (2), we obtain the following expression for the time evolution of
until t:
![]() |
5 |
We obtain the formal solution by applying an integrating factor as follows:
![]() |
6 |
where
and
are the initial conditions. J(t) is the integral
![]() |
where
. This integral does not have a closed-form solution.
We seek an approximation of the form
![]() |
7 |
where
is the—as yet unknown—initial value of the function immediately after spiking. We further assume that
has decayed to 0 before neuron j fires its next spike, so that
jumps to
as the next spike is fired. We determine
as a function of the value of
immediately before spiking, by requiring that the approximation is asymptotically equal to the true solution, i.e.,
![]() |
8 |
By substituting Eqs. (6) and (7) into Eq. (8), we find that
![]() |
9 |
where
![]() |
10 |
Substituting
, the integral
can be expressed in the limit as
![]() |
where
is the lower incomplete gamma function (DLMF, 2024, Eq. 8.2.1). Thus, Eq. (9) can be evaluated as
![]() |
11 |
We define two constants
![]() |
12 |
![]() |
13 |
which depend solely on the synaptic parameters. For a presynaptic neuron j, let
be the time of the previous spike and
the time immediately before the next spike. Then, according to the definition of our approximation, we have
![]() |
The value of
at
, immediately after the spike, is then given by
![]() |
In a postsynaptic neuron, the sum over all presynaptic
is aggregated in a single variable. Therefore, the change in
upon the spike, rather than its value immediately after the spike, must be transmitted to the postsynaptic neuron to update the aggregated variable. The change in
upon the spike at time t is
![]() |
with
. The change
can then be transmitted to all postsynaptic neurons and added to their aggregated S input variable. The aggregated NMDA gating variable in a postsynaptic neuron can be simulated using the following differential equation
![]() |
14 |
Reference implementations of both the approximate model and the original model can be found in the NEST simulator under the model names iaf_bw_2001 and iaf_bw_2001_exact, respectively.
Network models
Here we describe the network model used to validate the approximation and for exploring decision-making in sparsely connected networks respectively, as well as our benchmarking setup.
Decision-making network
To validate the approximation in a practical use case, we replicate the decision-making network model originally studied by Wang (2002). This network consists of three excitatory populations and one inhibitory population, all of which are recurrently connected. An external population, modeled as a Poisson process, projects equally onto all recurrent neurons. The selective populations
and
each comprise a fraction f of the total number of excitatory neurons, while the nonselective population
comprises the remaining fraction
of excitatory neurons. The selective populations receive a transient stimulus in the form of spikes onto AMPA synapses from an additional Poisson process. The relative strength of the transient stimulus received by the selective populations is determined by the input coherence
of the signal. The rate of the transient stimulus is given by
,
. In this study, we consider the case where
sp/s, and
.
A concise description of the model is provided in Table 1, and the parameter values used are listed in Table 2.
Sparse decision-making network
To investigate the dynamics of a sparsely connected decision-making network, we change the connectivity rule to random fixed in-degree
without multapses (Senk et al., 2022). Here,
denotes the connection probability from presynaptic population X onto postsynaptic population Y, and
denotes the size of presynaptic population X. When
for all
and
, the fully connected network is recovered.
For the first two seconds of the simulations, all outgoing NMDA connections from the selective populations are replaced by a constant “
-current” with value
, which is added to the right-hand side of Eq. 14 for all populations. Here,
is the connection probability from presynaptic selective population A onto postsynaptic population X, and
is the corresponding synaptic weight. This drives the aggregated
-value in the postsynaptic neurons towards the value it would take if all
-values in selective population A were 1, and the corresponding values for selective population B were 0, effectively clamping them. After 2 seconds, the NMDA connections are restored and the “
-current” is removed. If the given connectivity admits an asymmetric state, i.e., a state where one of the selective populations has higher activity than the other, the network will relax into it.
By varying the values of the connection probabilities within the network, we can determine the values that support decision-making dynamics. Simulations were run with
for all pairs of populations except
(internal connectivity within each selective population) and
(inhibitory-selective connectivity). These two connectivity values were systematically varied across 33 evenly spaced points in the interval [0.2, 1.0] for each pair.
Benchmarking setup
We use the fully-connected decision-making network to measure simulation times, but with
. This results in a network with one excitatory and one inhibitory population and steady-state activity. We scale the network size from 1.28 times to 10.24 times the size of the original network in powers of 2. These network sizes, comprising from 2560 to 20480 neurons, were chosen to be evenly divisible across up to 128 parallel threads. Due to the all-to-all connectivity and the pairing of AMPA and NMDA synapses, this results in a network of about 755 million synapses for the largest network size. Synaptic conductances for all recurrent connections were scaled inversely with network size to approximately maintain network dynamics.
We benchmark four different implementations of this model: Using NEST and our approximation (iaf_bw_2001), using NEST and the original model (iaf_bw_2001_exact) as well as two implementations in Brian2 as external references. The first of these is a restricted implementation that only supports fully connected networks with equal delays (Wimmer & Stimberg, 2023), while the other allows arbitrary connectivity; it is inspired by Moreni et al. (2025). Neuron models in NEST used an adaptive Runge-Kutta-Fehlberg-45 numerical solver, which has a slightly higher computational cost than the Runge-Kutta-4 numerical solver used in the Brian2 simulations.
Benchmark results reported here were obtained with NEST 3.8 (Graber et al., 2024) on the JURECA supercomputer at the Jülich Supercomputing Center equipped with AMD EPYC 7742 CPUs providing 128 compute cores. Simulations were performed using 8 and 128 threads. Eight threads are the minimum required to simulate the largest network size with NEST.
Results
We assess the accuracy of the approximate model using two approaches. First, we examine the differences in NMDA current and membrane potential between neurons with exact and approximate NMDA dynamics when they receive synaptic activations from a Poisson process at different rates. Second, we reproduce the binary decision-making network studied by Wang (2002) and Wong and Wang (2006) using both the exact and approximate models to compare the dynamics of each network. Furthermore, leveraging the flexibility and improved performance offered by the approximation, we explore the dynamics of the binary decision-making network with sparse connectivity.
Errors in NMDA-receptor-mediated currents and membrane potential
While the original model has a finite rise time in the NMDA gating variable, characterized by the time constant
, the approximate model introduces an instantaneous jump. Immediately after any given spike, the error in the gating variable of the approximation will then be
, where
is the value of the gating variable immediately before the spike. In a postsynaptic neuron, the effect on the synaptic current due to NMDA receptors will be through the coupling described by Eq. (1), and the error of the synaptic current will also rise instantaneously. The errors of the membrane potential are filtered through Eq. (15) and will increase at a finite rate. Due to the instantaneous jump in the NMDA gating variable caused by a spike, the postsynaptic current will be higher in the approximate model compared to the exact model. As the gating variable of the exact model increases, the error rapidly decreases on the time scale of
. Figure 1 shows an example of
and
for both the exact and approximate models in a simulation where they receive identical input at 20 sp/s. For the synaptic currents, the error jumps instantaneously and decays on a short time scale. The error in membrane potential rises on a short time scale and decays over a longer time scale.
Fig. 1.
NMDA-receptor-mediated synaptic currents and membrane potential. For both the exact model (dashed orange lines) and the approximate model (solid blue lines), a postsynaptic neuron receives identical input spikes. The resulting NMDA receptor-mediated synaptic currents and the error
is shown in the top half, while the membrane potential and corresponding error is shown in the bottom half. The red dots indicate the spike arrival times. The plots on the right side shows the same data as on the left, but zoomed in to provide a clearer view of the effect of individual spikes
Because the error of the approximate NMDA gating variable from a single spike decreases rapidly and its differential equation is linear, the errors do not accumulate over time but instead depend only on the number of spikes in the immediate past. If the neuron receives sufficiently high input to reach the threshold, the small differences between the exact model and the approximate model will result in small changes to the exact timing of spike events. These errors in spike times accumulate, and in such cases, the differences between simulations of the exact model and the approximate model receiving identical input become more pronounced.
Figure 2 shows the root mean square difference (RMS) between membrane potentials from simulations of the exact model and the approximate model. Both models receive identical inputs from a presynaptic population with Poisson spikes, with variations in presynaptic population size, presynaptic firing rate, and synaptic connection weights. As the total input—determined by the product of the number of presynaptic neurons, their firing rate, and the synaptic connection weight—increases, the RMS difference remains minimal until the postsynaptic neuron begins to fire. Once the postsynaptic neuron fires, the difference in membrane potential between the exact model and the approximate model increases rapidly due to the differences in spike times. The NMDA gating variable in the approximate model is higher than in the exact model, causing the approximate model to spike slightly earlier when given identical input.
Fig. 2.
RMS of difference in voltage traces. The root mean square (RMS) of the difference between the voltage traces of the exact and approximate models in a simulation where a postsynaptic neuron receives NMDA currents from a presynaptic population of Poisson neurons. The color of the dots indicates the synaptic connection weight (w), ranging from 0.1 to 100. The size of each dot is proportional to the square root of the presynaptic population size
, varying from 1 to 3200. The total input is calculated as
, where
is the presynaptic firing rate. The three insets show the time series of the membrane potential of the exact model (orange) and the approximation (blue) in simulations where the neuron respectively exhibits high, low, and no spiking activity
Reproducing the Wang (2002) binary decision-making network
In the binary decision-making network studied by Wang (2002) and Wong and Wang (2006), described in Section 2.3.1, NMDA receptor-mediated synaptic currents are crucial for enabling the network to sustain high activity within the selective populations. During the period when the selective populations receive a transient stimulus, the network transitions into an asymmetric state, characterized by high activity in one of the selective populations and low activity in the other. After the transient stimulus period, the network may either maintain the asymmetric state or, with a certain probability, revert to a state where both populations have equal activity.
Figure 3 compares the dynamics of the binary decision-making network when modeled using the exact and approximate models. The figure shows three example simulations of the network at different coherence levels, similar to Figure 2 in Wang (2002). The network dynamics are qualitatively similar for both the exact and approximate models; however, for the approximate model, the selective population with higher activity shows slightly increased activity. This is due to the marginally higher values of the NMDA gating variable in the approximate model. At coherence level
, both selective populations have an equal probability of transitioning into the high activity state. As coherence increases, the stimulus to selective population A also increases, thereby increasing the probability that the network will transition into a state where population A has the higher activity. By performing multiple simulations at different coherence levels, the probability of making the correct choice—which is defined as selecting population A for
because it receives a stronger stimulus—can be determined as a function of the coherence level.
Fig. 3.
Comparison of the exact and approximate models in binary decision-making network dynamics. Simulations of a binary decision-making network using both the exact and the approximate models for three different coherence levels. The network connectivity, external inputs, and stimuli are identical across both models. Each panel shows a spike raster of 100 neurons from selective populations A and B at the top, and the population activity, measured by averaging the summed population spiking histogram over 50 ms time bins, at the bottom. The vertical lines indicate the start and end of the transient stimulus
Figure 4 shows the probability of making a correct choice at different levels of coherence after 2 seconds of stimulation as in Figure 4 of (Wang, 2002). For both the exact and approximate models, 400 simulations were run at coherence levels
. The winner is determined as the selective population with the highest activity after the stimulus period. A 90% confidence interval is estimated using bootstrapping by independently resampling the simulations 5000 times with replacement and calculating the probability for each trial. The error bars represent the confidence interval at each coherence level. Our results for the exact and approximated model agree well with the results from Wang (2002), which are shown by the black line in Fig. 4. It shows the Weibull function
for parameters
and
reported by Wang (2002) as optimal fit to their simulation results.
Fig. 4.

Decision-making accuracy. The probability of the network making the correct decision—defined as selective population A maintaining higher activity after the stimulus is turned off—as a function of the coherence level,
. For each coherence level
, the probability is calculated by performing 400 simulations for both the exact (orange dots) and the approximate (blue dots) models and determining the proportion of simulations where population A wins. The data points are slightly offset along the x-axis for clarity, although they are all simulated with the same coherence level value. A 90% confidence interval, estimated by bootstrapping, is represented by the error bars. The black line shows the Weibull function fitted by Wang (2002) for the same experimental setup
Benchmarks
Figure 5 summarizes our benchmark experiments, with detailed timings for the largest network size provided in Table 3. The implementations in NEST (dark brown) and Brian2 (dark blue) supporting arbitrary connectivity and using the exact NMDA neuron model are more than two orders of magnitude slower than the approximating (NEST, light brown) and restricted (Brian2, light blue) implementations, reducing the wall-clock time required for simulating one second of model time from hours to seconds. Simulation times scale quadratically with network size for the general exact case in both NEST and Brian2, because the effort to integrate NMDA dynamics increases quadratically. Brian2 is faster than NEST in this case (7.6 times for the largest network size), presumably because Brian2 generates more efficient code by just-in-time compilation compared to NEST’s prebuilt binary. The choice of ODE integrator has a minor effect (data not shown) as has the slight difference in firing rates we observed1.
Fig. 5.

Network simulation time for different model implementations and network sizes. Solid lines show the time required to simulate 1 s model time for the exact implementation (dark brown) and approximation (light brown) in NEST, and the unrestricted (dark blue) and restricted (light blue) implementations in Brian2, all simulated on eight threads. The dashed light brown line shows the NEST approximation for 8 MPI processes with 16 threads each. The dash-dotted grey line marks a quadratic, the dotted grey line a linear increase in simulation time with network size. Data are from a single simulation per data point. As the data are very clear, evolve systematically with size and the different implementations differ by factors, we prioritized energy conservation rather than collecting statistics.
Table 3.
Simulation times for the largest network size
| NEST | Brian2 | |||
|---|---|---|---|---|
| Exact | Approximation | Approx ( ) |
Unrestricted | Restricted |
| 57659.4 s | 29.2 s | 2.2 s | 7610.1 s | 10.1 s |
Data are shown for all four implementation for eight threads and for the approximation in NEST also for 8 MPI processes with 16 threads each. These are the same data as the rightmost data points in Fig. 5
Using the same amount of computational resources (eight threads or CPU cores), the approximation in NEST is about 2.9 times slower than the restricted implementation in Brian2. Exploiting NEST’s hybrid parallelization capabilities (Plesser et al., 2007), we found 8 MPI processes using 16 threads each to be the optimal configuration to use all 128 cores available on a compute node. With this configuration, NEST simulated the largest network size in 2.2 s for 1 s of model time, i.e., about 4.6 times faster than the restricted and 3460 times faster than the unrestricted model in Brian2. Brian2 does not support MPI parallelization and we did not observe any improvement in simulation times beyond eight threads in a single process (data not shown).
Interestingly, the MPI-parallel simulation of the approximation in NEST shows linear scaling of simulation time with problem size, even though the number of synapses in the network grows quadratically also in this case. The most plausible explanation for this observation is that integrating the dynamics of the neurons including their aggregated synaptic conductances dominates computation in this case, while the actual cost of spike transmission becomes negligible.
Binary decision-making in sparsely coupled networks
Since our approximation allows for arbitrary network connectivity, we investigate the dynamics of a decision-making network with sparse connectivity, described in Section 2.3.2. To determine whether a particular connectivity supports decision-making, we clamp the value of
of all outgoing NMDA-synapses from selective population A to 1, and from selective population B to 0 for two seconds. We denote the population-averaged value of
over all neurons in selective population A by
, and equivalently for selective population B. Once the clamp is released, the network dynamics are allowed to evolve freely, and
decreases while
increases. If a stable, asymmetric state where
exists, the network will relax into this state.
Figure 6A and B show
and
from the decision-making network with 100% and 95% connectivity between all populations, respectively. Eight simulations with different seeds were run, and the individual time series are shown in the figures. In the 95% connectivity simulations, synaptic weights were scaled by a factor of 1/0.95. Even with this minor reduction in connectivity, the asymmetric state becomes unstable, leading the network to converge toward a symmetric state. Without scaling the weights, a mere one percent decrease in connectivity suffices to destabilize the asymmetric state.
Fig. 6.
Decision-making dynamics in a sparsely coupled network. (A) Population-averaged values of
(blue lines) and
(orange lines) from eight differently seeded simulations of a fully connected network. (B) Same as (A), but for a network with 95% connectivity, where the recurrent conductances are scaled by a factor of 1/0.95. (C) and (D) Same as (A) and (B), but for a network with 20% base connectivity, where the intra-selective connectivity and inhibitory-selective connectivity have been adjusted; see text for details. The values of these connectivities are indicated by the red and blue dots respectively in (E) and (F). (E) Expectation of the
for times
, for a base connectivity of 20%, where the intra-selective and inhibitory-selective connectivities are adjusted. The values are also averaged over eight independent simulations. (F) Similar to (E), but for the difference 
The stability of the asymmetric state depends on the winning selective population’s ability to maintain a high NMDA current while ensuring sufficient recurrent inhibition to suppress the losing population. To explore this, we performed simulations of a sparsely connected network where the internal connectivity within each selective population, as well as the connectivity between inhibitory and selective populations, were systematically varied. Starting with a base connectivity of
, simulations were run with adjustments to intra-selective (
and
, see Table 1C) and inhibitory-selective connectivity (
and
), taking independent values on the interval [0.2, 1.0]. Figures 6C and 6D show examples from simulations with 20% base connectivity, but where the intra-selective and inhibitory-selective connectivities have been adjusted to regain decision-making dynamics. The values of the adjusted connectivities are indicated by the red and blue dots in Fig. 6E and F respectively. For the example in Fig. 6C, the network is in a state similar to that of the fully connected network shown in 6A. In contrast, the example in Fig. 6D, which features higher intra-selective connectivity, demonstrates a significantly larger difference between
and
.
Figure 6E and F show the expected value of
and the expected value of
, respectively, taken over the time interval
, and averaged over the eight independent simulations. Figure 6E illustrates that the expected value of
is highly contingent upon both inhibitory-selective connectivity and intra-selective connectivity. As inhibitory connectivity increases,
quickly becomes almost entirely suppressed above a certain threshold, which is roughly linearly dependent on the selective connectivity. The expected difference between
and
, shown in Fig. 6F, reveals the required balance between intra-selective and inhibitory-selective connectivity for the network to support decision-making dynamics. A minimum level of both inhibitory and selective connectivity is required, and, generally, for any given level of inhibitory connectivity, increasing the selective connectivity increases the distance
. For low levels of inhibitory-selective connectivity,
, with values increasing with the intra-selective connectivity. There are sharp upper and lower boundaries given by the level of inhibitory-selective connectivity, between which the two selective populations take on different levels of activity. Below the lower boundary, both populations are in a high activity state, and above the upper boundary, both populations are suppressed. It is important to note that synaptic conductances were kept constant in these simulations; varying them would likely change the connectivity balance needed to maintain decision-making dynamics.
Discussion
In the present work, we have developed an approximate model of the NMDA-receptor-mediated synaptic currents proposed by Wang (1999), Brunel and Wang (2001), and Wang (2002) for leaky integrate-and-fire neurons. The original model features a gating variable that is modeled by a two-dimensional system of ordinary differential equations, for which the total synaptic inputs from a presynaptic population cannot be simulated in aggregated form, except for in the case of fully connected networks with identical delays. Two features of the original model are important to capture. First, the long time constant of the gating variable which is an order of magnitude larger than those of AMPA or GABA synapses, and second, the saturation of the gating variable as its value increases.
The approximate model is constructed such that it follows a simple exponential function between synaptic events, and with instantaneous rise times at all synaptic events while being asymptotically equal to the original model. This allows the sum over postsynaptic gating variables to be reduced to a single differential equation per neuron. The decay time constant is set explicitly to be the same as that of the original value. Since the rise time of the gating variable is typically taken to be very short compared to the decay time, reducing it to an instantaneous jump is not a large deviation from the original model. The magnitude of the jump in the gating variable after a synaptic event decreases as the value of the gating variable itself increases, such that it saturates, although the maximum value the approximate value can reach is slightly larger than one. As such, the interpretation of the gating variable as the fraction of open ion channels is not technically valid, but for practical purposes it is not important.
The error introduced by the approximation is mainly limited to the first few milliseconds after synaptic events and rapidly decays after (Fig. 1). Due to the instantaneous jump, the approximation gives higher values than the original model, which causes the NMDA currents to also be higher. Reducing the conductance slightly can help correct this, although in practice the effect is negligible. In the membrane potential, the subthreshold errors introduced by the approximation are less noticeable, as they are exponentially filtered with the larger membrane time constant. For the case of both models receiving identical input strong enough to cause spiking, there will be an error in the membrane potential that accumulates as the spike times are shifted (Fig. 2). In networks, this effect frequently will not be relevant, as sources of stochasticity such as Poissonian input and randomized connections will have a much stronger effect on exact spike timings. For the case of the binary decision-making network studied by Wang (2002) and Wong and Wang (2006), we show that the dynamics of the network are preserved (Fig. 3), and closely replicate the overall decision-making results (Fig. 4).
The approximate model reduces simulation time for network models with arbitrary connectivity by over two orders of magnitude, from hours to seconds per second of model time. Fully exploiting NEST’s parallel capabilities, we achieved simulation times only slightly longer than twice the time simulated. This significant improvement enables the systematic exploration of larger networks with plausible network structure, overall size and connection density including the NMDA dynamics introduced by Wang (2002). In contrast, the restricted implementation can only be used to simulate networks with all-to-all connectivity and identical delays.
The simulation-time and firing-rate differences we observed between NEST and Brian2 suggest further investigations into both the performance and correctness of simulators (see also Van Albada et al., 2018). The all-to-all network due to Wang (2002) is likely not suitable as a reference benchmark for this purpose as all-to-all connectivity severely limits scalability and, for large networks, biological plausibility. Instead, the network model recently proposed by Moreni et al. (2025) might take on a similar role for models including NMDA-dynamics as the Potjans-Diesmann microcircuit model (Potjans & Diesmann, 2014) has had in driving simulation technology for networks composed of simpler neuron models (Senk et al., 2025).
The principal motivation behind developing an approximate model is to enable the study of networks of arbitrary topology. We applied the approximate model to a sparsely connected decision-making network, to see how sparseness affects the dynamics of the network. The fully connected decision making network has been studied extensively both numerically and analytically (Brunel & Wang, 2001; Wang, 2002; Wong & Wang, 2006). For models with instantaneous synapses, a complete mean-field theory has been developed (Amit & Brunel, 1997; Brunel, 2000). For the synaptic models studied here, a set of mean-field equations of the population firing rates of the fully connected decision making network can be constructed under a series of approximations, one of which is that the main sources of variation in the membrane potential are the AMPA synapses activated by the external Poisson population (Brunel & Wang, 2001). In a sparse decision-making network, there is significant variation also in the recurrent GABA and NMDA synapses, which have different time constants. In this setting, the same mathematical approach cannot be taken, and numerical simulations must be relied on instead.
We have shown that the ability of the sparse network to exhibit decision-making behavior is highly sensitive to the degree of connectivity, particularly the balance between the intra-selective connectivity and the inhibitory-selective connectivity (Fig. 6). For the particular parameter values chosen here, we found that there is a range of intra-selective and inhibitory-selective connectivities that support decision-making dynamics, and which influence the level of asymmetry in activity between the two selective populations. In particular, high intra-selective connectivities of over 50% were required, and significantly lower inhibitory-selective connectivities of around 25%–40%. The exact balance is also dependent on the synaptic strengths and conductances, which were not systematically varied in the same experiment.
Conclusion
The approximate model of NMDA-receptor-mediated synaptic currents in leaky integrate-and-fire neurons presented in this paper shows behavior close to that of the original model by Wang and Brunel (Wang, 1999; Brunel & Wang, 2001; Wang, 2002). Synaptic currents in the exact and approximate model differ only for a few milliseconds after each incoming spike, leaving the dynamics of networks largely unaffected. While the original model is widely used, its practical applications are mostly restricted to fully connected networks with identical delays. By reducing simulation times by more than two orders of magnitude, our approximation to NMDA dynamics enables the investigation of more general networks of relevant size in close to real time without imposing restrictions on network connectivity or the distribution of synaptic delays.
Acknowledgements
We thank S. Vennemo, J. Mejias & G. Moreni for inspiring discussions in an early stage of the project. HEP thanks the Käte Hamburger Kolleg: Cultures of Research (c:o/re), RWTH Aachen, for financial support and hospitality (BMBF funding code 01UK2104) and NMBU for sabbatical leave. Preliminary simulations were performed at Jülich Supercomputing Center on compute resources funded by EU Horizon 2020 grants 754304 (DEEP-EST) and 800858 (ICEI). Final results presented here were obtained at Jülich Supercomputing Center using compute time granted by the JARA Vergabegremium for the JARA Partition of the supercomputer JURECA at Forschungszentrum Jülich under computation grant JINB33.
Author Contributions
Conceptualization: J-EWS, NH, HEP. Formal Analysis: J-EWS. Validation: J-EWS, NH, HEP. Writing - Original Draft Preparation: J-EWS. Writing - Review & Editing: J-EWS, NH, HEP.
Funding
Open access funding provided by Norwegian University of Life Sciences. Open access funding provided by Norwegian University of Life Sciences. This work has received partial funding from the European Union’s Horizon 2020 Framework Programme for Research and Innovation under Specific Grant Agreement 945539 (HBP SGA3).
Data Availability
No datasets were generated or analysed during the current study.
Code Availability
The code used to generate the data and figures are available at: https://github.com/janskaar/approximate_NMDA_model
Declarations
Competing Interests
The authors declare no competing interests.
Footnotes
Firing rates in simulations performed with Brian2 are approximately 10% lower than those obtained with NEST for the exact model. We plan to investigate this elsewhere.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- Amit, D. J., & Brunel, N. (1997). Dynamics of a recurrent network of spiking neurons before and following learning. Network: Computation in Neural Systems,8(4), 373. 10.1088/0954-898X/8/4/003 [Google Scholar]
- Brunel, N. (2000). Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. Journal of Computational Neuroscience,8(3), 183–208. 10.1023/A:1008925309027 [DOI] [PubMed] [Google Scholar]
- Brunel, N., & Wang, X.-J. (2001). Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. Journal of Computational Neuroscience,11(1), 63–85. 10.1023/A:1011204814320 [DOI] [PubMed] [Google Scholar]
- Deco, G., & Jirsa, V. K. (2012). Ongoing cortical activity at rest: criticality, multistability, and ghost attractors. Journal of Neuroscience,32(10), 3366–3375. 10.1523/JNEUROSCI.2523-11.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Destexhe, A., Mainen, Z. F., & Sejnowski, T. J. (1994). Synthesis of models for excitable membranes, synaptic transmission and neuromodulation using a common kinetic formalism. Journal of Computational Neuroscience,1(3), 195–230. 10.1007/BF00961734 [DOI] [PubMed] [Google Scholar]
- DLMF (2024). NIST Digital Library of Mathematical Functions. In: F. W. J. Olver, A. B. Olde Daalhuis, D. W. Lozier, B. I. Schneider, R. F. Boisvert, C. W. Clark, B. R. Miller, B. V. Saunders, H. S. Cohl, & M. A. McClain (eds.) Release 1.2.2 of 2024-09-15. https://dlmf.nist.gov/
- Graber, S., Mitchell, J., Kurth, A.C., Terhorst, D., Skaar, J.-E.W., Schöfmann, C.M., Kunkel, S., Trensch, G., Haug, N., Mallett, D., Andriyovich, P.Y., Otazu Porter, X., Lee, A.Y., & Plesser, H.E. (2024). NEST, 3.8. Zenodo 10.5281/zenodo.12624784
- Moreni, G., Dorcioman, R. A., Pennartz, C. M. A., & Mejias, J. F. (2025). Cell-type-specific firing patterns in a V1 cortical column model depend on feedforward and feedback-driven states. PLoS Computational Biology,21(4), 1012036. 10.1371/journal.pcbi.1012036 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nordlie, E., Gewaltig, M.-O., & Plesser, H. E. (2009). Towards reproducible descriptions of neuronal network models. PLoS Computational Biology,5(8), 1000456. 10.1371/journal.pcbi.1000456 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Plesser, H.E., Eppler, J.M., Morrison, A., Diesmann, M., & Gewaltig, M.-O. (2007). Efficient parallel simulation of large-scale neuronal networks on clusters of multiprocessor computers. In: A.-M. Kermarrec, L. Bougé, & T. Priol (eds.) Euro-Par 2007: Parallel processing. Lecture Notes in Computer Science (vol. 4641, pp. 672–681). Berlin: Springer. 10.1007/978-3-540-74466-5
- Potjans, T. C., & Diesmann, M. (2014). The cell-type specific cortical microcircuit: Relating structure and activity in a full-scale spiking network model. Cerebral Cortex (New York, N.Y.: 1991),24, 785–806. 10.1093/cercor/bhs358 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Senk, J., Kurth, A., Furber, S., Gemmeke, T., Golosio, B., Heittmann, A., Knight, J.C., Müller, E., Noll, T., Nowotny, T., Coppola, G.P., Peres, L., Rhodes, O., Rowley, A., Schemmel, J., Stadtmann, T., Tetzlaff, T., Tiddia, G., Albada, S.J., Villamar, J., Diesmann, M. (2025). Constructive community race: Full-density spiking neural network model drives neuromorphic computing. 10.48550/arXiv.2505.21185
- Senk, J., Kriener, B., Djurfeldt, M., Voges, N., Jiang, H.-J., Schüttler, L., Gramelsberger, G., Diesmann, M., Plesser, H. E., & Albada, S. J. V. (2022). Connectivity concepts in neuronal network modeling. PLOS Computational Biology,18(9), 1010086. 10.1371/journal.pcbi.1010086 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Albada, S. J., Rowley, A. G., Senk, J., Hopkins, M., Schmidt, M., Stokes, A. B., Lester, D. R., Diesmann, M., & Furber, S. B. (2018). Performance comparison of the digital neuromorphic hardware SpiNNaker and the Neural Network Simulation Software NEST for a full-scale cortical microcircuit model. Frontiers in Neuroscience,12, 291. 10.3389/fnins.2018.00291 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang, X.-J. (1999). Synaptic basis of cortical persistent activity: The importance of NMDA receptors to working memory. Journal of Neuroscience,19(21), 9587–9603. 10.1523/jneurosci.19-21-09587.1999 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang, X.-J. (2002). Probabilistic decision making by Slow reverberation in cortical circuits. Neuron,36(5), 955–968. 10.1016/S0896-6273(02)01092-9 [DOI] [PubMed] [Google Scholar]
- Wimmer, K., Stimberg, M.: Example: Wang_2002. In Brian 2 Documentation. (2023). https://brian2.readthedocs.io/en/2.7.1/examples/frompapers.Wang_2002.html Accessed 2024-07-10
- Wong, K.-F., & Wang, X.-J. (2006). A recurrent network mechanism of time integration in perceptual decisions. Journal of Neuroscience,26(4), 1314–1328. 10.1523/JNEUROSCI.3733-05.2006 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
No datasets were generated or analysed during the current study.
The code used to generate the data and figures are available at: https://github.com/janskaar/approximate_NMDA_model


























































































































