Abstract
In cognition, response times and choices in decision-making tasks are commonly modeled using Drift Diffusion Models (DDMs), which describe the accumulation of evidence for a decision as a stochastic process, specifically a Brownian motion, with the drift rate reflecting the strength of the evidence. In the same vein, the Poisson counter model describes the accumulation of evidence as discrete events whose counts over time are modeled as Poisson processes. This model has a spiking neurons interpretation as these processes are used to model neuronal activities. However, these models lack a learning mechanism and are limited to tasks where participants have prior knowledge of the categories. To bridge the gap between cognitive and biological models, we propose a biologically plausible Spiking Neural Network (SNN) model for decision-making that incorporates a learning mechanism and whose neurons activities are modeled by a multivariate Hawkes process. First, we show a coupling result between the DDM and the Poisson counter model, establishing that these two models provide similar categorizations and reaction times and that the DDM can be approximated by spiking Poisson neurons. To go further, we show that a particular DDM with correlated noise can be derived from a Hawkes network of spiking neurons governed by a local learning rule. In addition, we designed an online categorization task to evaluate the model predictions. This work provides a significant step toward integrating biologically relevant neural mechanisms into cognitive models, fostering a deeper understanding of the relationship between neural activity and behavior.
Keywords: Spiking Neural Network, Decision-making, Hawkes process, Local learning rule, Drift diffusion model
Introduction
One of the main challenges of the 21st century is to bridge the gap between brain and behavior, and computational models are a fundamental tool researchers use to address this challenge. In this line, developing biologically realistic models to understand the decision-making processes of humans and animals is a key focus in neuroscience and cognition.
A prominent model in cognition is the Drift Diffusion Model (DDM), introduced by Ratcliff (1978, 1981, 1988) who demonstrated how the DDM could accurately predict outcomes such as accuracy, reaction times, and error latencies across various decision-making tasks. The model achieves this by integrating evidence over time, with a drift rate reflecting evidence strength and decision boundaries representing the thresholds for making a decision. Initially designed for two-choice experiments, it extends to multiple choices by modeling evidence accumulation as a multidimensional drift-diffusion process, with each component competing against the others (Roxin 2019). The reasons for the growing attention to the DDM are multiple. It has been shown to provide accurate descriptions of accuracy and reaction time data across a wide range of psychological tasks, including perceptual tasks (Ratcliff and Rouder 1998; Ditterich 2006; Brunton et al. 2013) and value-based choices (Ratcliff and McKoon 2008; Philiastides and Ratcliff 2013; Hutcherson et al. 2015).
It is also supported by neurobiological evidence: in the 1990s and 2000s, neurobiologists like Shadlen and Newsome provided crucial neurobiological evidence supporting the DDM by showing that neural activity in brain areas such as the lateral intraparietal area (LIP) reflects the accumulation of sensory evidence, consistent with DDM predictions (Shadlen and Newsome 1996; Gold and Shadlen 2001; Ratcliff et al. 2007; Shadlen and Kiani 2013). However, DDMs do not directly include the modeling of neuronal activity.
Biologically relevant decision-making models (Brody et al. 2003; Machens et al. 2005; Deco and Martí 2007) rely on perceptual information to guide the choice between behaviors. A straightforward approach involves two interacting groups of neurons, each defined by its average firing rate. Decision-making in this context is modeled as a transition from a spontaneous state (where both groups have similar firing rates) to a decision state (characterized by a high or low activity ratio between the groups), and this process is often represented as a stochastic dynamical system. Such models effectively approximate reaction times and can be used to compute biologically meaningful information. For example, Carrillo et al. (2011) offer a mathematical analysis of these systems in nonlinear scenarios and computes the probability of reaching specific decisions and the average time required to do so. Other approaches than evidence accumulation can be implemented in such models: for instance, Insabato et al. (2010) propose a decision confidence mechanism. However, none of these models are linked to the DDM nor show such accurate descriptions of real accuracy or reaction times.
Simpler than these models and more similar to the Drift Diffusion Model, the Poisson counter model (LaBerge 1994; Ratcliff and Smith 2004) represents evidence accumulation as discrete events, with their counts over time modeled as homogeneous Poisson processes. This approach aligns with how neuroscientists often use Poisson processes to model neuronal activity based on firing rates, offering a spiking neuron interpretation: evidence accumulation can be seen as the spike counts of neurons coding for potential responses. Smith and Van Zandt (2000) extend the counter model by incorporating inhomogeneous Poisson processes. However, since the Poisson process is not well-suited for modeling the interactions between neurons, this approach is limited to representing individual neurons coding for categories and cannot capture the dynamics of more complex networks of spiking neurons.
A common tool to model spike trains of interacting neurons is the multivariate Hawkes process (Hawkes 1971), which is a self-exciting and mutually exciting point process. Its field of application is not limited to neuroscience: it is well-adapted to model earthquake data (Türkyilmaz et al. 2013), financial transactions (Bacry et al. 2015), health data (Bao et al. 2017), social networks (Zhou et al. 2013), or more generally, any sequences of events such that the occurrence of an event influences the probability of further events to occur.
Poisson and Hawkes processes seem to be promising microscopic processes to explain the power of the DDM prediction. Indeed diffusion approximations of Poisson and Hawkes processes have been investigated in several contexts. For instance, Bacry et al. (2013) provide a functional central limit theorem for multivariate Hawkes processes for finance applications, and Ethier and Kurtz (1986) as well as Bretagnolle and Massart (1989) provide strong approximations of the Poisson process by a Brownian process. Strong approximations by diffusive limits have also been derived to study mean field limits of networks of interacting neurons (Erny et al. 2023), and Besançon et al. (2024) provide coupling results between Poisson and Hawkes processes in one dimension. Additionally, Chevallier et al. (2021) establish strong error bounds and numerical schemes for the diffusion approximation of multi-class Hawkes processes.
However, neither the DDM, the Poisson counter model, nor the other biologically relevant decision-making models discussed here incorporate a learning mechanism. These models are limited to tasks where participants already possess prior knowledge of the possible responses. In the DDM, for instance, this prior knowledge is represented by the value of the drift rate, while in stochastic dynamical systems, it is captured by the (fixed) strength of synaptic connections. For example, Deco and Martí (2007) assume that synaptic connections between neurons are the result of a Hebbian learning mechanism that has taken place before the model they propose.
On the other hand, learning mechanisms are at the heart of artificial neural networks (ANNs), the first of which is the perceptron (Rosenblatt 1957), inspired by the structure and function of biological neurons and their networks. This biological inspiration has continued to influence the development of increasingly advanced machine learning models, such as convolutional neural networks (Le Cun et al. 1989), which draw their inspiration from biological processes observed in the visual cortex by Hubel and Wiesel (1962). Conversely, machine learning algorithms play a central role in implementing spiking neural networks (SNNs) (Tavanaei et al. 2019). These networks, more complex than ANNs, model neuronal activity through sequences of spikes, mimicking the electrical pulses of biological neurons. Particularly relevant for studying the brain’s neural code, SNNs also offer insights into the design of energy-efficient algorithms (Stone 2018). To be realistic, SNNs are typically trained using local learning rules such as Hebbian learning (Hebb 2005) or spike-timing-dependent plasticity (Caporale and Dan 2008). However, spiking neural networks (SNNs) are typically not designed to model decision-making tasks. They do not inherently account for reaction times and are primarily optimized for achieving strong empirical performance by mimicking the functioning of the brain rather than making decisions that closely resemble human behavior.
The focus of the present work is to bridge the gap between decision-making models used in cognition and brain-inspired models of spiking neurons, and to establish that prior knowledge assumed in decision-making models may be the result of a biologically relevant learning mechanism. First, we introduce both a drift diffusion model and a Poisson counter model, outlining conditions under which each produces accurate decisions (Theorems 2.3 and 2.5). As an initial step toward deriving the DDM from spiking neuron-based models, we establish a coupling between the two models, establishing that they provide similar categorizations and reaction times (Theorem 2.6). This approximation holds in the asymptotic case where the number of neurons is large, which is consistent with brain recordings indicating that concepts are often encoded by coordinated groups of neurons, commonly referred to as neuronal assemblies (Singer et al. 1997; Gerstein et al. 1989).
To go further, we introduce a biologically inspired Spiking Neural Network (SNN) model for decision-making. This model integrates a learning mechanism and is provably close to the drift diffusion model. Neuronal activity within the network is represented by a multivariate Hawkes process, which accounts for interactions between neurons. The output neurons encode possible decisions, with their spike counts representing evidence accumulation for respective responses, which makes our model a Hawkes counter model. Synaptic connections are adjusted via a local learning rule provided by the expert aggregation framework (Cesa-Bianchi and Lugosi 2006). In Jaffard et al. (2024), we introduced a simpler version of the network. The focus of this work was to prove theoretically that a biologically plausible neural network could learn using local mechanisms only. Building on this foundation, Jaffard et al. (2026) extended the network by incorporating hidden layers specifically designed to detect neuronal synchronizations. This extension not only advanced the theoretical results from Jaffard et al. (2024) but also demonstrated that our algorithm automatically produces neuronal assemblies in the sense that the network can encode several concepts and that the same neuron in the intermediate layers might be activated by more than one concept. Additionally, we provided an in-depth analysis of the types of concepts the network can encode and numerical results on handwritten digits dataset. However, this initial version was not suited to model decision-making tasks as it was unable to model reaction times.
The model presented in the current work is a refined version of this network, which introduces two key differences from these earlier versions. First, neuronal activities are modeled in continuous time rather than discrete time, which is more realistic and closer to the drift diffusion model and Poisson counter model. Second, we have incorporated dynamic decision durations, allowing the model to account for reaction times alongside decision-making processes, unlike the fixed decision durations used previously. These improvements enable the model to be compared with other models such as the DDM or the Poisson counter model.
We analyze the network’s asymptotic behavior (Proposition 3.3) and provide conditions under which the model delivers accurate decisions (Theorem 3.5). Additionally, we establish a coupling between our model and the DDM (Theorem 3.6) thanks to strong approximations similar to Ethier and Kurtz (1986), demonstrating that a DDM with correlated noise can be approximated by a Hawkes network of spiking neurons capable of learning via local rules.
To evaluate our model, we designed an online categorization task in which participants were asked to classify stimuli – rockets in this case – defined by four characteristics, with one randomly selected feature serving as the basis for learning. Such feature-based tasks have long been central to cognitive science (Nosofsky 1986; Love et al. 2004), providing valuable insights into how individuals learn to group stimuli based on shared characteristics. This well-established paradigm made it a natural starting point for testing our model. By analyzing participants’ reaction times and choices, we demonstrate the utility of the Hawkes counter model in studying learning and decision-making processes. We describe the experiment we designed and detail its implementation within our model. We prove that the network can learn to perform this task successfully (Proposition 4.1). Furthermore, we estimate model parameters for individual participants, enabling a detailed analysis of their learning behaviors.
Section 2 introduces the decision-making task we aim to model, along with the drift diffusion model and the Poisson counter model, including their mathematical analyses and coupling. Section 3 outlines the Hawkes counter model for decision-making tasks with learning and its corresponding mathematical analysis and coupling with the DDM. Section 4 details our experiment and its analysis based on our model. All notations defined in the main text are listed in Appendix A, and any proofs not included in the main text are provided in Appendix C.
Drift diffusion and poisson counter models
Framework
We aim to model first the following decision-making task: a participant sequentially categorizes objects, each having a nature from a set , into one of several categories belonging to a set J. Each category is a subset of , and together the categories form a partition of . Participants may encounter the same object nature multiple times; for example, the first object presented might be a blue circle, as might the tenth object. See Figure 1 for an illustration of the categorization task studied in Section 4, and Figure 2 for another example.
Fig. 1.
Illustration of our online experiment available at https://3ia-demos.inria.fr/mel/en/. The participant has to learn to classify rockets into two categories: those that can land on the moon and those that cannot. They are successively presented with rockets for which they have to propose a category (left picture). After each categorization, feedback is provided on their answers (right picture)
Fig. 2.
Illustrative example of objects natures, categories, presented objects and evidence accumulation for the presented object for the DDM. Here, there are 4 object natures, 2 categories and 6 presented objects. The chosen response is the category coded by the first process to reach threshold , i.e., and the corresponding reaction time is
In the present section, we present two models: the drift diffusion model and the Poisson counter model. They provide predictions for both categorizations and reaction times. These models assume that participants already possess prior knowledge about object natures and categories, and do not describe scenarios where participants must learn the categories of the presented objects.
For both models, we give explicit conditions under which they predict correct categorizations with high probability. Then, we prove a coupling result between the models indicating that these two models provide very similar reaction times and categorizations.
For , we denote and . Also when quantities have several indices, the dropping of one index corresponds to the sequence on this index. For instance, whereas and . If two sets of indices are available, typically I and J, to avoid confusion, we use the set instead of the index. For instance, . Also is the infinite norm.
Drift Diffusion model
The model
During the presentation of the object, the accumulation of evidence of the categories is modeled by a dimensional drifted Brownian motion with mean vector defined by , and diagonal covariance matrix defined by , , where o is the nature of the object and is the drift. Therefore, the process coding for evidence accumulation in favor of category j can be rewritten as
| 1 |
where the are independent standard Brownian motions. The object is categorized in the category coded by the first process among the processes of to reach a certain threshold before a limit duration T. We denote
| 2 |
Remark 2.1
The law of is the inverse Gaussian Distribution with parameters and (Lovric (2025), p.687).
The winning process is then
| 3 |
Note that and depend on m but we drop the index for simplicity. However, if , it means that accumulation evidence is not sufficient to reach a decision and the model does not categorize the object. The corresponding reaction time of the whole system is then . Note that the processes are indexed by time which is not a ‘time’, but a ‘present time’ since it is set back to 0 at each presentation of a new object. See Figure for an example of evidence accumulation modeled by the DDM.
Note that in general, in drift diffusion models, the scaling is not necessarily the square root of the drift. We study this specific case because it allows the approximations by spiking neural models that we present further on. Note also that the drift and scaling do not evolve with the number of presented objects m: they represent prior knowledge about the categories and object natures and are fixed. The higher the drift , the higher the average accumulation of evidence in favor of category j.
Theoretical guarantees
Before detailing the specific conditions under which the model predicts the correct category, it is worth recalling that the fundamental relationships between decision time, accuracy, and evidence accumulation parameters are already well-established in the literature. For instance, Wagenmakers et al. (2007) demonstrated through the EZ-diffusion model that there are explicit, closed-form equations directly linking observable accuracy and response times to the underlying drift rate and decision threshold. Furthermore, the joint distribution of choice probabilities and decision times under time constraints has been rigorously analyzed; Fudenberg et al. (2018) mapped the exact conditions and optimal sequential sampling policies required to guarantee accurate choices within specific time windows. While the results establishing the conditions for correct prediction in drift-diffusion processes are known, the following theorem builds upon this theoretical tradition to establish the specific margin conditions required for the present framework.
Let us study under which conditions the model predicts the correct category. We assume that the participant has prior knowledge about the categories, which takes the form of the following assumption. Let .
Assumption 2.2
(Margin()) For every category , for every , for every object nature we have
Theorem 2.3
Let and let m be a fixed positive integer. Let and suppose Assumption 2.2 (Margin()) holds. Then there exist positive constants and depending only on the index parameters such that if and if the threshold satisfies
| 4 |
then with probability larger than we have that for all nature , if we denote by its category (i.e. ), the choice (3) and the reaction time (2) that take place at the presentation of the object of nature o, satisfy
See Appendix C.2 for a version of this result with exact constants.
In other words, this theorem states that for a fixed object m, if the limit duration T is large enough then as soon as the threshold verifies (4), object m is correctly classified with probability more than . The lower bound comes from the condition that the process coding for category should be the first to reach , whereas the upper bound in O(T) comes from the condition that should be reached before limit duration T. Note that the exact expressions of the constants provided in Appendix C.2 indicate that as expected, the larger , i.e., the larger the gap between the drift of the process coding for the true category and the other drifts, the lower the bound on T and the larger the size of the thresholds interval enabling a correct categorization with high probability.
Poisson counter model
The model
For each presented object, the evidence in favor of the categories takes now the form of discrete events whose counts over time are modeled by a dimensional homogeneous Poisson process with intensity vector depending only on the nature o of the presented object. Similarly as for the DDM, the object is categorized in the category coded by the first process among the processes of to reach threshold before limit duration T. We denote
| 5 |
the hitting time of process . The winning process is then
| 6 |
However, if , it means that evidence accumulation is not sufficient to reach a decision and the model does not categorize the object. Note that as before, the hitting time and choice depend on m but we drop the index for simplicity. The corresponding reaction time is then .
Similar to the DDM, here the intensities do not evolve with the number of presented objects m: they represent prior knowledge about the categories and object natures and are fixed. The higher the intensity , the higher the average accumulation of evidence in favor of category j.
The Poisson process is commonly used to model the activities of spiking neurons coding information through their firing rate, and which do not interact as a network. Therefore, the Poisson counter model can have the following interpretation: each category j is coded by a spiking neuron j whose activity when presented with the object is . The spike count of neuron j represents the accumulation of evidence in favor of category j.
Theoretical guarantees
Similar to the continuous diffusion framework, the fundamental conditions governing accuracy and response times in discrete Poisson counter models are already well-documented. Analytical solutions for choice probabilities and first-passage times in discrete race architectures have been extensively characterized, notably by Smith and Van Zandt (2000). Furthermore, the mathematical conditions under which one Poisson process reliably reaches a decision threshold before competing processes-as well as the associated bounds on error rates-rely on established combinatorial formulas and large deviation bounds. While these general mechanics of discrete evidence accumulation are known, the following theorem formalizes the specific intensity margin conditions required for correct prediction within the context of our proposed framework.
We can conduct a similar analysis as for the DDM by assuming a similar assumption representing prior knowledge about the categories. Let .
Assumption 2.4
(Margin()) For every category , for every , for every object nature we have
Theorem 2.5
Let and let m be a fixed positive integer. Let and suppose Assumption 2.4 (Margin()) holds. Then there exist positive constants , and depending only on the index parameters such that if and if the threshold satisfies
| 7 |
where , then with probability larger than we have that for all nature , if we denote by its category (i.e. ), the choice (6) and the reaction time (5) that take place at the presentation of the object of nature o, satisfy
See Appendix C.3 for a version of this result with exact constants.
Similarly as Theorem 2.3 about the DDM, this theorem provides conditions on the threshold under which the model predicts the correct category with high probability. Regarding the limit duration T, the upper bound has the same order of magnitude in O(T). Here, the lower bound depends on the quantity , which was not the case in Theorem 2.3. Finally, it should be noted that similarly as in Theorem 2.3, the exact constant values provided in Appendix C.3 indicate that the larger the constant , the larger the size of the possible thresholds interval.
Coupling between drift diffusion model and poisson counter model
In this section, we explain the high similarity between the behaviors of the Poisson model and the Drift Diffusion model by proving that one model can be strongly approximated by the other and that both models provides similar reaction times, up to negligible terms. Indeed, under a certain framework, we can build a coupling between the processes given by the two models. Here, we assume that we dispose of n independent copies of the Poisson counter model: during the presentation of object m, each category j is coded by n independent Poisson processes, all having intensity where o is the nature of object m. The evidence in favor of category j is then the sum of the count of the n processes coding for category j and is denoted by . By independence of the neurons coding for category j, the process is then a homogeneous Poisson process with intensity . The presented object is classified in the category coded by the first process among the family of processes to reach the threshold (or not classified at all if none of the processes reaches ). We chose here the threshold to be proportional to n to allow the coupling to take place. Up to this modification, the decision-making process is identical to (5) and (6).
The consideration of n copies of the Poisson counter model is motivated by both mathematical and biological considerations. From a mathematical point of view, the diffusion approximation requires an increasing number of jumps of the underlying Poisson process. From a biological perspective, empirical evidence from brain recordings indicates that concepts are often encoded by coordinated groups of neurons, commonly referred to as neuronal assemblies (Singer et al. 1997; Gerstein et al. 1989). Accordingly, it is reasonable to model a given feature as being represented by multiple neurons and it seems natural that the transition between the neural scale (Poisson counter model) and behavioral scale (drift diffusion model) occurs through an increasing number of neurons. The assumption that these copies are independent is introduced solely for mathematical tractability.
The following theorem is established by means of a coupling between this model and the drift diffusion model with drift .
Theorem 2.6
Let , the nature of the object and . Let a family of mutually independent Poisson processes with intensities . Suppose the vector verifies for every . Then there exist absolute constants and a dimensional drifted Brownian motion defined by (1) such that for every ,
| 8 |
For , let us define the hitting times and . Let and . Consequently, there exist absolute positive constants d and e and positive constants , , and depending only on the index parameters such that if , then with probability more than , all the following inequalities hold jointly:
- The processes and verify
- The hitting times verify
- The hitting times verify
- The difference between the hitting times and verifies
See Appendix C.4 for more precise version of this result.
The proof of the theorem, provided in Appendix C.4, relies on a coupling result between Poisson and Brownian processes established by Ethier and Kurtz (1986), concentration inequalities, and a novel inequality for Brownian processes that we derived.
With this theorem, we establish a coupling between the Poisson counter model and the drift diffusion model by bounding the supremum of their trajectories on all . Since are growing linearly with n, the bound in of (8) is very strong. Note that the theorem would still hold for dependent processes but the coupled processes would have inherited from this dependence. Note also that the assumption for every is easy to satisfy: since the processes with intensity stay equal to zero and never reach , we can consider the set of processes with positive intensities instead of J.
Besides, in this framework where the threshold is linear in n, we establish for every j the convergence of the hitting times of both Poisson process and Brownian process to , which is the hitting time of the deterministic processes and , with rate in . Furthermore, we prove that the difference between these two hitting times decreases faster than their convergence rate. This ensures that for large n, both models select the same category (the one with larger ), and we can apply the same bound to the difference between the reaction times of the two models: we have
with high probability. This result explains in particular how reaction times that are modeled by Poisson counter processes, and which are more biologically relevant, might exhibit a behavior like the DDM and have therefore similar adequation to real data.
Hawkes counter model
Framework
In this section, we want to model a different decision-making task: the participant does not have prior knowledge about the categories anymore. Similarly as before, the participant has to categorize objects having natures belonging to a set into one of several categories belonging to a set J. The participant sees the objects sequentially and is given the true answer after each categorization, which allows for learning the categories. Therefore, unlike in the previous task, after each presentation of an object, the participant knows better the categories: the average strength of the evidence accumulation in favor of the categories will change when presented with a new object. The total number of presented objects which allow the participant to learn the categories is denoted by M, and the sequential presentation of these M objects is called a learning phase. We suppose that at the end of the learning phase, the participant has learned to recognize the object categories, and the average strength of the evidence accumulation in favor of the categories will not change anymore.
The model
We model this new experiment by a spiking neural network inspired by a previous work in discrete time and without reaction times (Jaffard et al. 2024). During the presentation of the object, the accumulation of evidence of the categories is modeled by a dimensional Hawkes process with conditional intensity defined below. This multivariate process represents the output nodes activity of a spiking neural network.
The object is presented for a duration of at least and until either the spike count of one of the processes of reaches the threshold , or the maximum allowed duration is reached. This minimal duration , which was not present in the previous sections, is here to ensure that the network learns the task and that its answers remain accurate once learning is finished. For , We denote
| 9 |
The winning process is then
| 10 |
and if then object m is categorized in category . However, if it means that accumulation evidence is not sufficient to reach a decision and the model does not categorize the object. The corresponding reaction time of the whole system is . Similarly as for the drift diffusion and Poisson counter models, the processes are indexed by time which is set back to 0 at each new object.
An illustration of the network is given on Figure 3 for the case of the experiment described in Section 4. The input layer codes for features describing the object natures. The set of input neurons is denoted by I, and an element denotes both an input neuron and the feature it is encoding. For instance, in the experiment of Section 4, the objects are rockets and the features are the shape of the head, body and fins and the number of flames. The output layer codes for the categories in which the objects are classified: the activity of the output neurons represents the evidence accumulation in favor of each category. Therefore, the set of output neurons is denoted by J, and an element denotes both an output neuron and the category it is coding for.
Fig. 3.
Illustrative example of the network used to model the experiment described in section 4. The task is to classify rockets into two categories, and . The input neurons code for different shapes of head, body, fins and flames. The presented object excites the input neurons coding for its features, whereas other input neurons stay silent. The output neurons start spiking with a conditional intensity depending on their connection with the input neurons. The spike train of each neuron is represented on top of it. The first spike count to reach the threshold is the one of neuron : therefore, the rocket is categorized in category
Input neurons activity. During the presentation of the object, the input neuron starts spiking as a homogeneous Poisson process with intensity depending only on the nature o of the presented object and representing how pronounced feature i is in object nature o. For instance, in the modeling of the experiment described in Section 4, we use a binary code: either the rocket has feature i and the input neuron i starts spiking with a strictly positive fixed intensity, either the object does not have the feature and the corresponding input neuron i stays silent (i.e., its intensity is equal to 0). We assume that the processes are mutually independent.
Output neurons activity. During the presentation of the object, evidence accumulation in favor of category j is modeled by the activity of the output neuron , which starts spiking as a Hawkes process , which, in contrast to the Poisson process, allows to take into account interactions with presynaptic neurons. Its conditional intensity at time t of the presentation of the object is given by:
where is a non negative function and is the synaptic weight between input neuron i and output neuron j: it represents the strength of their connection during the presentation of the object. We denote by the norm of g. The weights are in the simplex: for every , and , and they may be seen as a probability distribution over the set of presynaptic neurons of j. We denote by the total weight family. Note that here, we are in the special case of a multivariate Hawkes process without self-interactions (but with mutual interactions).
Learning rule. The network learns by updating its synaptic weights after each presented object by using an expert aggregation algorithm (Cesa-Bianchi and Lugosi 2006) thanks to this local paradigm: each presynaptic neuron i can be seen as an expert and the strength of the connection between i and the postsynaptic neuron j varies based on gains derived from these connections. After the presentation of the object, the postsynaptic neuron j attributes the following gain to the presynaptic neuron i:
where o is the nature of the presented object, is the total number of presented objects belonging to category j during the learning phase and
| 11 |
is the empirical firing rate of input neuron i during duration . This gain can be interpreted as follows: if the presented object belongs to category j, neuron j should spike frequently to be the first to reach the threshold . Therefore, it assigns positive gains to its presynaptic neurons, with these gain being proportional to their firing rates, thereby strengthening its connections with the input neurons that encode the most relevant features describing category j. Conversely, if the presented object does not belong to category j, neuron j should spike less to avoid reaching the threshold before the neuron coding for the object’s true category. In this case, it assigns negative gains (i.e., losses) to its presynaptic neurons in order to reduce the strength of its connections with the most active neurons when presented with objects it should not encode. Note that neuron j does not need to know what the other neurons are doing to attribute the gains. Also note that the gain depends on the ratio , that is roughly speaking the proportion of objects in each category, and the larger , the better the estimation of the input neurons firing rates.
We denote by the cumulated gain of input neuron i w.r.t. output neuron j until the object. Then after the presentation of the object, the weights of neuron j are updated using the expert aggregation EWA (Exponentially Weighted Average) (Cesa-Bianchi and Lugosi 2006):
| 12 |
where the parameter is called the learning rate and determines how fast the network learns. In what follows, we choose
| 13 |
Note that this learning rule is local: the gains used by neuron j and therefore the update of the synaptic weights depend only on the activity of its presynaptic neurons.
We denote by the -algebra generated by every event which happened until the end of the presentation of the object and the trivial algebra. Note that the weights are -measurable.
Additions over the previous model. This new version differs from the model that we proposed in Jaffard et al. (2024) by two main features. In this previous work, the neurons activities were defined in discrete time, and every object was presented during a fixed duration: the presented object was classified in the category of the output neuron with the highest spike count at the end of the presentation. Here, the neurons activities are defined in continuous time and the objects are presented for dynamic durations. To model behavior, we introduced a threshold and a limit duration, which allowed to model participant reaction times and the possibility that the participant will not decide between the different categories if not enough evidence has been accumulated.
Comparison with the Poisson counter model and interpretation. Similarly to the Poisson counter model, the evidence accumulation in favor of the different categories are interpreted as spike counts of neurons coding for these categories. However, unlike the Poisson counter model, the intensities of the output neurons are not given arbitrarily as prior knowledge about the categories, but are learned with a local rule as the network sees new objects. Our model can have the following interpretation: the input layer is a Poisson counter model which can recognize simple features, and an output layer is added and trained to recognize more complex concepts. This is biologically relevant since in the brain, elementary concepts can be depicted by the responses of individual neurons, whereas more intricate ones are represented by groups of interconnected neurons that work together (Singer et al. 1997).
Mathematical analysis
In this section, we establish theoretical guarantees for our model. We begin by analyzing the asymptotic behavior of the network weights, which provides insights into the network behavior after the learning phase. Next, we outline the conditions necessary for the network to accurately categorize new objects following the learning process. This successful performance stems not from prior knowledge of the categories but from the learning phase itself. Finally, we demonstrate that the drift diffusion model can be derived from our model, establishing that it can be approximated by complex networks of interacting neurons having a learning mechanism.
Asymptotic behavior
Let us study the network’s asymptotic behavior. We introduce a notation: given a set E and a quantity indexed by , we denote its mean by .
Definition 3.1
(Feature discrepancy) Let and . The feature discrepancy of input neuron i w.r.t. output neuron j is
The feature discrepancy of input neuron i w.r.t. output neuron j measures how sensible neuron i is to category j by comparing its average firing rate when presented with objects of category j to its average firing rate when presented with objects of other categories. We can now define the set of input neurons which are the most sensible to category j by , as well as the gap in discrepancy when
which measures how sensible the best input neurons are with respect to the others.
Assumption 3.2
During the learning phase, each nature o has been presented the same amount of times to the network, i.e., times.
Proposition 3.3
Let and . Suppose Assumption 3.2 holds. For , let the weight family such that . Then there exist positive constants and depending only on the index parameters such that if
then with probability , at the end of the learning phase, the synaptic weights verify for all
where is defined by (13).
See Appendix 1 for a version of this result with exact constants.
In Proposition 3.3, we prove that the network weights converge to a limit family and we provide rates of convergence. The error is twofold. The first part, in where is the minimum duration for which an object is presented, comes from the randomness of the system and is derived using concentration inequalities to control how good is the estimation of by (11). The second part, in where M is the number of objects presented during the learning phase, comes from the use of the expert aggregation algorithm EWA: the larger the gap in discrepancy, the faster the convergence. This limit family has the following interpretation: at the limit, output neuron j is connected only and with equal strength to input neurons which are the most sensible to category j.
Note that this asymptotic analysis is feasible because the weight-update rule has a simple form. To our knowledge, no comparable results exist for learning rules such as Spike-timing-dependent plasticity (STDP), for which the update formulas are more complex.
This result can be compared to Theorem 3.4 of Jaffard et al. (2024) which describes the asymptotic behavior of the network in discrete time with fixed object presentation durations. The present error has the same order of magnitude, where the number of time steps of each presented objects is replaced by the minimum duration of each object presentation .
Theoretical guarantees
At the limit (M and tend to infinity), the network’s weights are the deterministic family given by Proposition 3.3. For , let
which is the asymptotic average firing rate of neuron j when objects with nature o are presented. Therefore, the average number of spikes of neuron j on [0, t] with weights when presented with an object of nature o is
where . Hence, on average, the first neuron whose spike count reaches threshold is the one with highest . This leads to the following new notion of margin. Let .
Assumption 3.4
(Margin()) For every category , for every , for every object nature we have
It means that at least in the limit the same gap as the ones for DDM and Poisson counter model holds. Since we explicitly know the limit family , this assumption can be interpreted as a condition on the categories and the features represented by the input neurons . This condition holds when the categories can be described as combinations of relevant features. In Section 4.4, we prove that this assumption is satisfied in the task performed by the participants of the experiment. For a detailed characterization of the categories learnable by the discrete time network, we refer the reader to Section 4.2.4 of Jaffard et al. (2026), where we describe the categories learnable by an extended version of our network that includes hidden layers, but no reaction time.
This assumption can be related to Assumption 2.2 (Margin()) on the drift of the DDM and Assumption 2.4 (Margin()) on the intensities of the Poisson counter model. Indeed, similarly as in the theoretical studies of these two models, we need an assumption on the average evidence accumulation in favor of the several categories. However, unlike for the DDM and the Poisson counter model, this assumption does not reflect prior knowledge on the categories, but the ability of our network to code for the categories. It is only after the network has learned that it reaches these firing rates.
Under these assumptions, we can formulate the following result.
Theorem 3.5
Let and , and . Let and suppose Assumptions 3.2 and 3.4 (Margin ()) hold. There exist positive constants and depending only on the index parameters such that if the parameters M, , T, and verify
| 14 |
where ,
| 15 |
| 16 |
| 17 |
and
| 18 |
then with probability larger than , we have that for all nature of the object presented after the learning phase, that is the object, if we denote by its category, the choice (10) and the reaction time (9) satisfy
See Appendix C.6 for a more precise version of this result.
This theorem provides conditions on the minimal duration , maximal duration T, number of presented objects during the learning phase M and threshold required for the model to correctly categorize objects after learning. Let us start by commenting on these conditions.
Sufficient learning phase duration: The network effectively learns the categories if M verifies (14), ensuring a long enough learning phase.
Sufficient minimal observation time for learning objects: The network has sufficient time to infer the input neurons firing rate to update its synaptic weights if verifies (15).
Sufficient maximal observation time: The network has sufficient time to detect differences in spike counts between the true category process and others if T verifies (16).
Sufficient threshold: The spike count difference between the true category process and others is significant at decision time if verifies (17).
Sufficiently low threshold: The network has a sufficiently low threshold to be able to take a decision before limit duration T if verifies (18).
Note that we always have and if the function g has compact support of negligible length with respect to T, as it is assumed in the following section, then . In this case, the upper bound on (18) has the same order of magnitude regarding the limit duration T as those in Theorem 2.3 for the DDM and Theorem 2.5 for the Poisson counter model, i.e., in O(T). It is reasonable to make such an assumption because a participant’s reaction time is typically around a few seconds and in practice we chose in the experiment described in Section 4, whereas the effect of a presynaptic neuron’s spike on a postsynaptic neuron, represented by the support of the function g, lasts only a few milliseconds.
The same way as for the constant quantifying the larger drift for the DDM and the constant quantifying the larger gap in intensity for the Poisson counter model, here, the value of the constants given in Appendix C.6 indicate that the larger , i.e., the larger the gap between the limit firing rate of the output neuron coding for the true category and the other output neurons, the larger the size of the thresholds interval enabling a correct categorization with high probability. Similarly as in Theorem 2.3, we need the maximal duration T to be sufficiently large (16) and unlike in Theorems 2.3 and 2.5 where there was no learning mechanism, additional assumptions are needed here regarding and M to ensure a correct learning. Note that all these assumptions become weaker as increases.
The proof, detailed in Appendix C.6, relies on several key components. First, concentration inequalities are employed to prove that the processes are closely approximated by their compensators. Proposition 3.3 is then used to show that these compensators are close to the average spike counts with limit weights. Finally, Assumption 3.4 is applied to derive conditions under which the network correctly categorizes the new object.
Coupling between the Drift Diffusion Model and the Hawkes Counter Model
Similarly as for the Poisson counter model (Section 2.4), we can build a coupling between the processes given by the drift diffusion model and the Hawkes counter model under a certain framework. Here, we work conditionally to what happened until object m, whether it is during learning or post learning: the synaptic weights are therefore assumed to be deterministic. For the same reasons as in Section 2.4, we suppose that we dispose of n independent copies of the network, and each independent network is governed by the same weights . During the presentation of object m, for each feature i, there are n input neurons spiking as a Poisson processes with intensity where o is the nature of object m: we denote by the sum of their count, which is a Poisson process with intensity by independence. In the same way, there are n output neurons coding for the same category . The evidence in favor of category j is then the sum of their counts and is denoted , which is a Hawkes process with intensity
| 19 |
Note that two other frameworks lead to the same processes: only one network of size with input neurons intensities , but also one network with input neurons and only output neurons.
During the presentation of the object, the average evidence accumulation in favor of category j at present time t of object m is then
where with o the nature of the presented object.
Theorem 3.6
Let , , and the nature of the object. Let be a dimensional Hawkes process with intensity function defined by (19) and let . We assume that the function g has compact support included in , that its norm does not depend on n, and that . Then there exist positive constants and depending only on the index parameters such that if , then there exists a -dimensional drifted Brownian motion with correlated noise with mean vector defined by , and covariance matrix defined by ,
such that with probability more than , all the following inequalities hold jointly.
- The processes and verify
20 - The hitting times defined for by verify
- The hitting times defined for by verify
- The difference between the hitting times and verifies
21
This theorem, established by means of a coupling between the Hawkes counter model and the drift diffusion model, enables to bound the supremum of their trajectories over all .
The proof, provided in Appendix C.7, builds on the same coupling result between Poisson and Brownian processes established by Ethier and Kurtz (1986), which we previously used to prove Theorem 2.6 and new inequalities that we derived for Brownian and Hawkes processes.
To achieve this, we had to assume that , i.e., that for every . This is easy to satisfy: indeed, if , it means that neurons coding for category j are not linked to any input neuron currently active, therefore we are in the non interesting case where the process stays equal to zero and never reach . We can then consider the set of processes such that instead of J with no loss of generality. We also had to assume that g has compact support decreasing at a rate of . This implies that the number of spikes influencing a group of n neurons encoding the same category j does not scale linearly with n, as it would if g had a fixed support, but rather grows at a rate of . This assumption further ensures that , meaning the mean vector of the drifted Brownian motion given by the theorem closely resembles that of classical diffusion processes. Unlike in the model described in Section 2.2 and in Theorem 2.6, where we established a strong approximation result between the DDM and the Poisson counter model, the drift of process does not depend only on the nature o of the presented object, but also on the presentation number m through its dependency in the weights . The covariance matrix of the process is also not diagonal: the processes of are correlated, reflecting the natural dependencies within neural networks. They can be expressed as solutions of the |J|-dimensional stochastic differential equation, which is defined for each process j as follows:
Each represents an independent noise source, while the collection introduces correlated noise terms across all processes. This correlation arises from the shared influence of the same input neurons on each output neuron in our model. The obtained bound on the trajectories (20) is in , which is less tight than the bound established in Theorem 2.6 for the trajectories of the Poisson counter model and the drift diffusion model. This is due to the greater complexity of the Hawkes counter model.
Besides, similarly as in Theorem 2.6 for Poisson and Brownian processes, we establish for every j the convergence of the hitting times of both Hawkes process and Brownian process to , which is the hitting time of the deterministic processes and . However, unlike in Theorem 2.6 where the limit hitting time depends on prior knowledge , here the limit hitting time depends on , i.e., on the learning stage of the model. Furthermore, we prove that the difference between these two hitting times decreases faster than , which is an upper bound on their respective convergence rate to their common limit. The resulting bound (21) is less tight than the similar bound of Theorem 2.6 due to the fact that the bound on the trajectories (20) is also less tight in this case.
Therefore, this theorem ensures that both models select the same category , and we can apply the same bound to the difference between the reaction times of the two models: we have
establishing that both models provide similar reaction times and categorizations.
Consequently, this theorem confirms that the dynamics of evidence accumulation for category decisions are similar in both models. Extending beyond the results established in Section 2.4, this finding demonstrates that DDMs can emerge from complex models of interacting spiking neurons with a learning mechanism. This provides new insights into the biological interpretation of DDMs and supports the idea that the prior knowledge assumed in these models can arise through a learning process.
Note that this result is more general than the setting considered in the preceding sections. First, it provides a bound on the difference between the trajectories of the two models over all of , and thus does not rely on either the maximal duration T or the minimal duration introduced in the Hawkes counter model. Second, it applies to any deterministic choice of weights ; in particular, the weights may arise from a different learning rule, such as STDP.
The experiment
To validate our model, we designed a categorization task in the form of an online video game, accessible at https://3ia-demos.inria.fr/mel/en/. The goal of the game was for participants to learn which rockets displayed on the screen were capable of reaching the moon and which were not. We opted for a video game format rather than a classical categorization task to make the activity more engaging, particularly for younger participants. The game was coded to allow flexibility in the difficulty of the categorization task. For this experiment, participants were presented with the easiest level (details provided in the Stimuli and Categories Section 4.2).
Participants
A total of 99 participants, including 45 middle school students and 54 undergraduate students, were recruited for the study. Middle school students (23 male, 22 female) ranged in age from 11 to 15 years (M = 12.13, SD = 1.15), while undergraduate students were all aged between 18 and 25. All participants reported normal or corrected-to-normal vision. The study was approved by the ethics committee of Université Côte d’Azur and was conducted in accordance with relevant guidelines and regulations (ethics approval number ). All participants provided informed consent prior to participation. Participants were recruited via one of their teachers. Middle school students performed the task at school whereas undergraduate students performed it at home.
Stimuli and categories
The set of stimuli consisted of 16 unique rockets, each defined by four characteristics, with two possible features for each: the shape of the head (sharp or round), the shape of the body (straight or round), the shape of the fins (straight or curved), and the number of flames (one or three). These rockets are illustrated in Figure 4. As mentioned above, participants were administered the easiest level of the categorization task. At this difficulty level, the categories were formed based on a single characteristic selected randomly at the beginning of the task. Rockets were divided into two groups: those with one feature of the chosen characteristic and those with the alternative feature. For example, if the selected characteristic was the shape of the head, rockets with a sharp head were categorized as capable of landing on the moon, while rockets with a round head were categorized as unable to land on the moon. Alternatively, rockets with a round head could also have been assigned to the “capable of landing on the moon" category, as the assignment was made randomly. From these two categories, five rockets from each group were randomly selected, resulting in 10 unique rockets presented during the learning phase. The remaining six rockets were used in the transfer phase.
Fig. 4.
The 16 objects
Procedure
Participants performed the task on a computer. Middle school students were supervised by their teachers, and undergraduate students performed the task at home. Prior to the experiment, participants completed a series of demographic questions and received detailed instructions on how to perform the task. The experiment consisted of two phases: a learning phase and a transfer phase. In the learning phase, participants were asked to determine which rockets were capable of landing on the moon and received immediate feedback on the correctness of their responses. Stimuli were presented one at a time at the center of the screen for 5 seconds. To help participants track time, a clock icon was displayed. After viewing each stimulus, participants made their decision by selecting one of two buttons labeled ‘Yes’ or ‘No’ to indicate whether the rocket could land on the moon. Upon selecting a button, feedback on the correctness of the response was presented for 2 seconds, including a visual cue in the form of a green checkmark for correct responses or a red cross for incorrect ones. Additionally, an animation briefly depicted whether the rocket was able to land on the moon. If participants did not provide a response within 5 seconds, a ‘time is up’ icon appeared on the screen. To reinforce learning, a progression bar was displayed at the top left of the screen, with a green checkmark appearing each time a correct response was given. Participants were required to correctly classify 15 consecutive rockets to pass the learning phase. The 10 unique rockets were presented in a random order and repeated until the participant reached the learning criterion, with a new random order at each repetition. After the learning phase, participants proceeded to the transfer phase, where they were instructed to classify new rockets that had not been presented in the learning phase. Stimuli were presented in the same manner as in the learning phase. In this phase, six new rockets were presented three times in a random order, resulting in a total of 18 trials. No feedback was provided during the transfer phase. Participants could choose to withdraw from the experiment at any time by selecting a cross icon located at the top left of the screen.
Modeling
We modeled this experiment with the model as described in Figure 3. Object natures are separated between a set of learning natures containing the 10 learning rockets and a set of transfer natures containing the 6 transfer rockets. The set of feature I contains the 8 possible features of the rockets (two shapes for the head, two shapes for the body, two shapes for the fins and two possible type of flames). The two categories denoted and are characterized by a certain characteristic declined in two features and : every object nature o has either feature or feature , and category contains every nature o with whereas category contains every nature o with .
When an input neuron i is presented with a rocket having nature , it starts spiking with intensity with . In other words, input neuron i spikes with firing rate if the object has feature i and stays silent otherwise.
Proposition 4.1
For the set of object natures and input neuron intensities defined above, the sets defined in Proposition 3.3 are and , and the limit family verifies Assumption 3.4: it enables to categorize well the objects and we can choose any constant in for .
Analysis
To analyze the learning behavior of participants, we infer two parameters of our model for each participant: the learning rate which is used to update the synaptic weights as described in (12) and indicates the participant’s learning speed, and the threshold , which reflects their response speed. For this estimation, we employ the Simulation-Based Inference method (Papamakarios et al. 2016) and we use data from both the learning phase and the transfer phase. This approach is tailored for models whose likelihoods are intractable but which can nonetheless be simulated. The process involves providing the model as a probabilistic program that is easy to simulate, along with a prior distribution over the parameters to be estimated. A Bayesian neural network is then trained via maximum likelihood on samples generated by the program, enabling the learning of a posterior distribution from which samples can be drawn. To simulate data for the transfer phase, we freeze the weights at their final update, , as participants have already completed learning to categorize the objects. Because the lengths of participant data and simulated data did not always match, we extended the transfer phase data by appending the mean answer time of the transfer phase. This ensured that the data had the required length for applying the SBI method. We denote by and the median value of samples of the posterior given by the SBI method for each participant. The method is illustrated using both simulated and real data in Figures 5 and 6, respectively. On simulated data, the method accurately recovers the true parameters, although with a positive bias noticeable on the histograms of sample 2.
Fig. 5.
Samples of the posteriors given by the SBI method for two sets of simulated data. The prior used for the parameters tuple is a uniform distribution on . In red, the true values of and used to simulate data. In blue, the histogram of the values and given by the posteriors given by the SBI method
Fig. 6.
Samples of the posteriors given by the SBI method for three sets of real data. The same priors as the ones of Figure 5 are used for the SBI method
Single participant analysis
In Figure 7, the cumulative answer times as a function of the number of answers are compared to simulated cumulative answer times for six participants, using parameters estimated by the SBI method. Here, we used data from both the learning and transfer phase. The results indicate that the method predicts answer times accurately.
Fig. 7.
For each participant, the blue curve represents the cumulated answer times in function of the number of presented objects. The orange curves represent the median of the cumulated answer times of 100 simulations of the model with confidence interval of level , with parameters and being the median value of samples of the posterior given by the SBI method. The same priors as the ones of Figure 5 are used for the SBI method
To see more precisely if one data simulation given by our network is close to real data, we represented the answer times of three participants (on top) and of three sets of simulated data (on the bottom) during the learning phase, using parameters inferred by the SBI method on Figure 8. Each blue tick represents a correct answer, and each red tick represents a wrong answer. The model again predicts answer times similar to those of the participants, albeit with greater regularity. However, it sometimes seems to make fewer errors than the participants, as in the case of participant 5. This can be attributed to the model’s reliance on synaptic weight updates: once sufficient weight has been assigned to relevant feature neurons, the probability to make a mistake diminishes significantly. In contrast, humans may continue to make errors even after grasping the underlying rule because of other cognitive phenomena such as distraction. This difference also explains why the model sometimes underestimate the total number of answers during the learning phase. Each error resets the count of consecutive correct answers to zero, requiring the participant to categorize at least 15 new objects to complete the learning phase. Consequently, each mistake significantly elongates the learning phase.
Fig. 8.
On the top, answer times of three participants during their learning phase. Blue ticks represent correct answers while red ticks represent wrong answers. On the bottom, same plots for simulated data with parameters and being the median value of samples of the posterior given by the SBI method for each participant. The same priors as the ones of Figure 5 are used for the SBI method
Group analysis
Figure 9 presents histograms of the parameters inferred by the SBI method, grouped by participants’ current educational level (middle school or university) and for all participants combined. The learning rate appears to take either low or high values, with middle school students exhibiting more extreme values compared to university students. In contrast, the histograms for the parameter show little variation across the different groups.
Fig. 9.
Histogram of median values of the parameters and given by the SBI method with on the left, every participant, on the middle, middle school students and on the right, undergraduate students. The parameters used for the SBI method are the same as in Figure 5
To conduct a more detailed analysis, we applied k-means clustering to the two-dimensional data consisting of the parameters and estimated by the SBI method for each participant. The optimal number of clusters was determined using the silhouette method (details are provided in Appendix B), which suggested two reasonable options: 2 or 3 clusters. Figure 10 illustrates the results of the k-means algorithm applied to the estimated parameters and for both 2 and 3 clusters.
Fig. 10.
On the left, as a function for every participant, where and are the median values given by the SBI method. On the right, 3-means clustering of the same data. On the bottom, students distribution by cluster. The parameters used for the SBI method are the same as in Figure 5
Clustering with 2 clusters. Cluster 0 is characterized by a low learning rate and threshold. It corresponds to participants who learn at an average or slower pace and require less evidence to make a categorization decision. This cluster includes of middle school students and of undergraduate students. Cluster 1, on the other hand, has a high learning rate and a slightly above-average threshold. It represents fast learners who require a higher accumulation of evidence before categorizing and comprises of middle school students and of undergraduate students.
A chi-square test was conducted to assess whether cluster membership is independent of the participants’ current educational level. The test yielded a p-value of 0.33, which is insufficient to reject the null hypothesis, indicating no significant evidence of dependence.
Clustering with 3 clusters. Clusters 0 and 1 retain approximately the same centers as in the 2-cluster analysis. Cluster 0 includes of middle school students and of undergraduate students, while cluster 1 comprises of middle school students and of undergraduate students. Cluster 2, primarily derived from points in the former cluster 0 along with a few from cluster 1, has a center characterized by a low learning rate and an average threshold. This cluster represents participants who learn at an average or slower pace and require a moderate accumulation of evidence before categorizing, encompassing of middle school students and of undergraduate students.
A chi-square test was conducted to evaluate whether cluster membership is independent of current educational level. The test resulted in a p-value of 0.11, which, while not statistically significant, provides some indication that cluster membership might depend on the current level of study. Specifically, slow-learning participants requiring less evidence to categorize appear more frequently among undergraduate students, while fast-learning participants requiring higher evidence accumulation tend to be more prevalent among middle school students.
Finally, we examined the relationship between the threshold estimated by the SBI method and each participant’s average answer time during the learning phase, as shown in Figure 11. The results indicate that the average answer time appears to increase linearly with , which is consistent with the model predictions.
Fig. 11.

Average answer time of each participant during the learning phase (including the 15 objects to categorize perfectly) as a function of . The parameters used for the SBI method are the same as in Figure 5
Conclusion
This paper outlines key elements that establish a connection between drift diffusion models (DDMs), commonly used in cognitive science to simulate decision-making tasks, and biologically plausible networks of spiking neurons. First, we conducted a mathematical analysis of both the drift diffusion model and the Poisson counter model, specifying explicit conditions under which these models yield accurate decisions. This analysis demonstrated the similarity in their behavior. Subsequently, we established a coupling result between the processes of the two models and derived a bound on their hitting times, confirming that both models produce comparable reaction times and decisions. These findings represent an initial step towards demonstrating that DDMs can be derived from spiking neuron-based models.
To go further and in order to establish that DDMs can be derived from biologically realistic networks of spiking neurons which can learn to make correct decisions, we proposed a novel spiking neural network model tailored for decision-making task which is provably close to the drift diffusion model. Unlike the drift diffusion and Poisson counter models, the model does not assume any prior knowledge of the categories; its accuracy emerges from a learning phase. Additionally, the model is more biologically relevant than the Poisson counter model, as it incorporates interacting spiking neurons that learn to represent complex concepts, rather than individual neurons directly encoding decisions. We conducted an asymptotic analysis of the network’s behavior and identified conditions under which it achieves accurate decisions. Moreover, we established a coupling result between our model and the DDM, providing strong evidence for the biological plausibility of DDMs and validating their widespread use in cognitive science. In the literature, coupling between Poisson and Brownian processes are well-known results. However, coupling between Hawkes and Brownian processes are less known. Recent results have been obtained in one dimension (Besançon et al. 2024) or for mean field limit of systems of interacting neurons (Erny et al. 2023). However, to the best of our knowledge, this is the first time such a result has been established for a network with a “perceptron”-like structure.
Additionally, we developed a cognitive experiment to evaluate our model’s predictions, enabling us to derive meaningful insights into the participant’s cognitive behavior and demonstrating the practical applicability of our model.
This study represents an important advancement in incorporating biologically relevant neural mechanisms into cognitive models, allowing us to better understand how neural dynamics lead to certain behaviors. There are several promising avenues for further improving the model. We showed that the model tends to produce more regular reaction times and make fewer errors compared to humans, highlighting the potential value of exploring ways to make it more realistic. Additionally, applying our model to more complex experiments could provide valuable insights into intricate behaviors. This seems feasible, as we showed in Jaffard et al. (2026) that introducing hidden layers enables the modeling of more complex concepts. Finally, an ambitious direction for future research would be to extend this work to other spiking neural networks, thereby demonstrating that DDMs can be approximated by alternative network types commonly used in neuroscience.
Supplementary information
The code and data used to produce the numerical results can be found at the following link https://github.com/SophieJaffard/MEL.
Acknowledgements
We thank the 3iA institute, and particularly Stéphane Petiot for implementing our experiment. We thank Valérie Lemesle, Sébastien Kerner, Noé Szymczak and Maëva Lossouarn for presenting the experiment to their students, and we also thank all the students who participated. This research was supported by the French government, through CNRS (eXplAIn and Algernon CNRS PRIME labelled teams), the UCAJedi and 3iA Côte d’Azur Investissements d’Avenir managed by the National Research Agency (ANR-15 IDEX-01 and ANR-19-P3IA-0002), directly by the ANR project ChaMaNe (ANR-19-CE40-0024-02), and by the interdisciplinary Institute for Modeling in Neuroscience and Cognition (NeuroMod). This project has received financial support from the CNRS through the MITI interdisciplinary programs.
Appendix A Table of notations
For parameters , we denote by any positive constant depending only on parameters . The value of can change from line to line and it is not necessarily equal on both sides of an inequality.
For , we denote and . Also when quantities have several indices, the dropping of one index corresponds to the sequence on this index. For instance, whereas and . If two sets of indices are available, typically I and J, to avoid confusion, we use the set instead of the index. For instance, . Also is the infinite norm.
For a set E and a quantity indexed by , we denote by its empirical mean. Table 1
Table 1.
Table of notations
| Notation | Description (page of introduction) |
|---|---|
| set of object natures (page 5) | |
| o | nature of an object (page 7) |
| J | set of categories and output neurons (page 14) |
| j | index of an output neuron or a category (page 14) |
| T | maximal duration of an object presentation (page 7) |
| m | index of an object (page 7) |
| threshold (page 7) | |
| -dimensional drifted Brownian motion (page 7) | |
| evidence accumulation in favor of category j at time t of object m for the DDM (page 7) | |
| drift of the process when the nature of object m is o (page 7) | |
| hitting time of process for (pages 7, 9 and 13) | |
| index of the first process to reach threshold (pages 7, 9 and 13) | |
| reaction time of the model for (pages 7, 9 and 13) | |
| -dimensional Poisson process (page 9) | |
| spike count of neuron j on [0, t] for object m in the Poisson counter model, i.e., (page 9) | |
| intensity of output neuron j when the presented object has nature o for the Poisson counter model (page 9) | |
| n | number of neurons coding for each category in the framework of the coupling results (page 10) |
| M | number of objects presented to the network during the learning phase (page 13) |
| I | set of features and input neurons (page 14) |
| i | index of an input neuron or a feature (page 14) |
| intensity of input neuron i when presented with an object having nature o for our model (page 14) | |
| set of input which are the most sensible to category j (page 17) | |
| empirical firing rate of input neuron i on (page 15) | |
| minimum duration of the presentation of an object (page 13) | |
| -dimensional Hawkes process (page 13) | |
| evidence accumulation in favor of category j at time t of object m i.e., spike count of neuron j until time t (page 14) | |
| conditional intensity of output neuron j at time t of object m for our model (page 14) | |
| synaptic weight between input neuron i and output neuron j (page 16) | |
| g | self-exciting function of the Hawkes process (page 15) |
| (page 57) | |
| (page 19) | |
| compensator of the process at time t (page 57) | |
| gain of input neuron i w.r.t. output neuron j after the presentation of the object (page 15) | |
| cumulated gain of input neuron i w.r.t. output neuron j after the presentation of the object (page 16) | |
| learning rate of the learning rule given by EWA ((13) page 16) | |
| algebra generated by every event which happened until the end of the presentation of the object (page 16) | |
| feature discrepancy of input neuron i w.r.t. output neuron j (page 17) | |
| (page 17) | |
| (page 17) | |
| limit synaptic weight between input neuron i and output neuron j (page 17) | |
| discrepancy between the drift of the true category process and the other processes for the DDM (page 8) | |
| discrepancy between the firing rate of the true category process and the other processes for the Poisson counter model (page 10) | |
| discrepancy between the firing rate of the true category process and the other processes for our model (page 19) |
Appendix B details on the clustering analysis
The number of clusters used to perform the means algorithm in Section 4.7 was determined using the silhouette method implemented in scikit-learn. The silhouette plot, available in Figure 12, illustrates how well each point aligns with its assigned cluster compared to neighboring clusters. Silhouette coefficients close to 1 indicate that a sample is well-separated from neighboring clusters, while a coefficient of 0 suggests that the sample lies near the boundary between two clusters. The dotted red line represents the average silhouette score across all samples for a given number of clusters. In order to choose a meaningful number of clusters, two criteria should be respected: each clusters should have points above the average silhouette score, and the several clusters should have comparable sizes. Therefore, and are sensible choices.
Fig. 12.
Silhouette analysis of the data with 2, 3, 4 and 5 clusters
Appendix C proofs
C.1 Preliminary lemmas
Lemma C.1
Let be a Brownian motion with drift and scaling . Let . Then
Proof
The process is a standard Brownian motion. Let . According to Doob’s inequality (see for instance Proposition 1.5 p.53 of Revuz and Yor (1999)), we have with probability more than that
Let us choose z such that , i.e., . Then with probability more than we have
The following Lemma is an adaptation of Corollary 5.2 p. 357 of Ethier and Kurtz (1986).
Lemma C.2
There exists absolute constants and a measurable function , with the Skorohod space such that if is an homogeneous counting Poisson process of rate 1 and V is an independent uniform random variable on [0, 1], then
is a Brownian motion starting at 0, with drift 1 and variance 1 (i.e. such that is a standard centered Brownian motion), and
- for all
Proof
We start with the Komlós-Major-Tusnády inequality (Komlós et al. 1975, 1976) (see Theorem 5.1 p.356 of Ethier and Kurtz (1986) for the same formulation as here) applied to the i.i.d. sequence of Poisson r.v. with parameter . KMT says that there exists such a sequence as well as a Brownian motion such that and and positive constants , and such that for all and all ,
with .
Remark that we can also write for all , where is a standard Brownian (meaning a centered Brownian such that ).
Conditionally to all the ’s, one can construct a Poisson process such that for any k, . Indeed, for each k, conditionally to each , and independently of anything else, we can pick i.i.d. uniform variables on [0, 1] and order them. They constitute the times of the jumps of a Poisson process , such that .
Then, we define for any . The process is therefore a Poisson process of intensity such that for all , .
Let us fix and . Then for all
with
So
But the ’s are iid variables with finite exponential moment of every order. So by union bound and Markov inequality, we have for every
The same holds for the ’s since they also have exponential moment of every order.
Therefore taking and using KMT with x/3, we obtain that with probability larger than ,
In other words, there exist constants such that for all
Now we want to get rid of T. We can decompose the event as follows
But the probability of the first event is bounded, thanks to the previous computations, by
For the other events
But for all , so
so the upper bounds reads
If , with , we get
By taking with , we get that , so that there exists such that
| C1 |
Now to go further, let us quote Lemma 3.12 of the Arxiv version Prodhomme (2020) of Prodhomme (2023).
Lemma C.3
Let and be two complete separable metric spaces and let be a probability on . Let be the first marginal of . Then there exists a measurable function such that if , then
Both and live in the Skorohod space which is separable and complete (polish). So, one can apply the lemma of Prodhomme: for any Poisson process with rate , by adding an extra uniform variable V, independent of anything else, one construct a drifted Brownian , such that and satisfy (C1).
Corollary C.4
Let and a homogeneous Poisson process with intensity . Then there exists a Brownian motion with drift and scaling and absolute positive constants such that
Proof
Let . Let a homogeneous Poisson process with intensity . Then is a standard Poisson process so acccording to Lemma C.2, there exists a standard Brownian motion and absolute constants such that for all
Let . Then
By choosing x such that , i.e., , , and we have the result.
The following Lemma and its proof can be found in Ost and Reynaud-Bouret (2023) (Lemma 7.1).
Lemma C.5
Let X be a Poisson random variable with parameter . For any ,
| C2 |
and for any ,
| C3 |
Corollary C.6
Let . Let X be a Poisson random variable with parameter . Then
- If , we have
C4 - If , we have
C5 - If , we have
C6
Proof
1 Assume , then satisfies . We apply (C3) and deduce
and deduce (C4).
Proof of 2: Thanks to the assumption, . The inequality (C2) can be rewritten as
Proof of 3: We apply (C4) and (C5) with and conclude the proof.
Lemma C.7
Let be a homogeneous Poisson process with parameter . Then for every we have
and for every we have
Proof
The process is a right-continuous martingale. Let . Then is a right-continuous submartingale. Therefore, according to the first submartingale inequality (Theorem 3.8 page 13 of Karatzas and Shreve (1998)), we have
We choose and mimic the proof of Lemma C.5 to obtain:
Similarly, the process is a right-continuous martingale so for , the process is a right-continuous submartingale. Therefore
Again, we can mimic the proof of Lemma C.5 and we get the same bound for :
Corollary C.8
Let and . Let be a homogeneous Poisson process with parameter . Then
Proof
Similarly as in the proof of (C6), by combining the two inequalities given by Lemma C.7, we have that for every
Let us choose x such that , i.e., . The condition becomes .
Lemma C.9
There exist constants such that if a standard centered Brownian motion then for all
This lemma resembles Lemma 6 of Chevallier et al. (2021), which is probably tighter, but is valid only for whereas our version is on all .
Proof
Remark that
because the quantity on which we are taking the supremum is invariant by exchange of t and u.
We start from the article Robbins and Siegmund (1970), where Example 3 page 88 says that for all ,
| C7 |
Let us now look at the event
But for fixed , for every
This leads to
But in each case, with we can apply (C7) to respectively the Brownian and the Brownian with . Hence by union bound, we get that
By taking for instance, the previous sum is finite and we get exactly the result.
C.2 Proof of Theorem 2.3
Let us prove this more precise version of Theorem 2.3.
Theorem C.10
Let and let m be a fixed positive integer. Let and suppose Assumption 2.2 (Margin()) holds. Then if and if the threshold satisfies
and
then with probability larger than we have that for all nature , if we denote by its category (i.e. ), the choice (3) and the reaction time (2) that take place at the presentation of the object of nature o, satisfy
| C8 |
We start from inequality (C7) which says that for all , if is a standard Brownian motion then
Let , , the nature of object m and its category. Let . Indeed, if , then for all t we have and the process will never reach . According to Assumption 2.2, we have necessarily . Up to consider instead of J, let us assume .
For every , the process can be written as (1). By choosing , according to (C7), by union bound, we have with probability more than that for every ,
| C9 |
In particular, for every we have
and for , we get
| C10 |
A sufficient condition for to reach before limit duration T and to be the first to do so is the existence of such that and for every , . It would mean that at time , has already reached and none of the other processes have done so.
Let . The condition is equivalent to
| C11 |
which is implied by
| C12 |
which is equivalent to
| C13 |
Suppose . Then a sufficient condition is
| C14 |
Let us denote . Then (C14) can be rewritten as
| C15 |
Let . Then a sufficient condition is
| C16 |
We can find a constant , independent of everything, such that for every , . Then if and , then (C16) holds.
To summarize, since , if
| C17 |
we have that for all .
By the assumptions of the theorem, we have that
| C18 |
and
| C19 |
So we have that and that . By continuity of , there exists in such that and since , we also have that for all , which concludes the proof.
C.3 Proof of Theorem 2.5
Let us prove the following result from which Theorem 2.5 derives.
Theorem C.11
Let and let m be a fixed positive integer. Let and suppose Assumption 2.4 (Margin()) holds. Then if and if the threshold satisfies
| C20 |
where , then with probability larger than we have that for all nature , if we denote by its category (i.e. ), the choice (6) and the reaction time (5) that take place at the presentation of the object of nature o, satisfy
| C21 |
Let , , the nature of object m, its category and the constant given by Assumption 2.4. Let . According to Assumption 2.4, we have necessarily . Up to consider instead of J, let us assume . For and , let
| C22 |
and
| C23 |
Let and to choose later. Let be the event
| C24 |
Since the processes are Poisson processes with intensity and by lower bounding by , by union bound on the , according to inequality (C6) from Corollary C.6, the event has probability more than . Let us work on . We have
| C25 |
and for every , by bounding by and we have
| C26 |
thanks to Assumption 2.4. Let us study under which condition we have . This is equivalent to the condition
| C27 |
which we assumed. Suppose . By continuity of , there exists such that . Let us choose such . Therefore, at time , we have and for every , . This means that at time , the process has already reached and since the processes are increasing, every other process where has not reached yet. Therefore, on , under the condition , the process reaches before limit duration T and is the first to do so. Since by definition of the function I, sufficient conditions on are
| C28 |
and
| C29 |
In order to get conditions independent of o and , we upper bound by and lower bound it by .
C.4 Proof of Theorem 2.6
Let us prove the following result, from which derives Theorem 2.6.
Theorem C.12
Let , the nature of the object and . Let a family of mutually independent Poisson processes with intensities . Suppose the vector verifies for every . Then there exist absolute constants and a dimensional drifted Brownian motion defined by (1) such that for every ,
| C30 |
For , let us define the hitting times and . Consequently, there exist absolute positive constants C, K and such that for , and , with probability more than , all the following inequalities hold jointly:
- The processes and verify
C31 - The hitting times verify
C32 - The hitting times verify
C33 - The difference between the hitting times and verifies
C34
Let , o the nature of object m and . Then (C30) is a direct consequence of Corollary C.4 by union bound on the and applying the time change .
Let and .
Control of the difference .
For each , let us apply Corollary C.4 to the Poisson process having intensity . By choosing uniform variables independent of everything else, there exist Brownian motions with drift and scaling depending only on and such that the event
| C35 |
has probability more than by union bound, where C, K and are positive constants independent of the parameters of the problem. Let us work on .
Study of the hitting times of and .
We introduce the first hitting times and , and we set if the previous sets are empty. First, let us study under which conditions and .
Let be the event
| C36 |
Then is a Poisson variable with parameter . Let us assume that for every we have . Then according to (C4) of Corollary C.6, by union bound . Let us work on . Then a sufficient condition to have is to have , which is equivalent to the condition
| C37 |
which is fulfilled since we assumed that n verifies
| C38 |
Let be the event
| C39 |
Then according to Lemma C.1, we have . Let us work on . We have then
| C40 |
A sufficient condition to have is to have , which is fulfilled since n verifies (C38). Therefore, on , we have and consequently and . Therefore, for every and , we have , and controlling the trajectory of on [0, U] is sufficient to control it on .
Using this fact, let us study the convergence of and to .
1. Convergence of . According to Corollary C.8, for , which holds for large n, the event
| C41 |
has probability more than . Let us work on . Since is an integer and the process cannot make two jumps at the same time, we have . Therefore, for every we have
| C42 |
since we work on . Hence
and we get the upper bound given by the theorem by lower bounding by and replacing U by its value .
2. Convergence of . Since we work on we have
| C43 |
Since the trajectories of are continuous, by definition of we have so
| C44 |
and we again get the upper bound given by the theorem by lower bounding by and replacing by its value.
3. Study of the difference . Let us begin by bounding . We have
| C45 |
since we are on (C35) and since is bounded by U.
Now, let us apply Lemma C.9 to the standard Brownian motion . By union bound, the event
| C46 |
has probability more than . Let us work on . Since and are bounded by U we have
If then and we have the result. Otherwise we have by definition of
thus
Combining this with (C45), we obtain the following inequality:
| C47 |
with , and . This polynomial has two real roots, the largest one being , so necessarily we have , which implies that , i.e.,
therefore
| C48 |
To conclude, we note that .
C.5 Proof of Proposition 3.3
Let us prove the following proposition from which Proposition 3.3 derives and which is more precise.
Proposition C.13
Let and . Suppose Assumption 3.2 holds and
| C49 |
For , let the weight family such that . Then with probability , at the end of the learning phase, the synaptic weights verify for all
where is defined by (13).
To ensure clarity, we sometimes denote by the nature of object m. We will need the following lemma.
Lemma C.14
Let and . Suppose Assumption 3.2 holds and that the following condition is fulfilled:
| C50 |
Then with probability at least , for every and we have
Proof
Let , , . Then by independence of the processes , the variable follows a Poisson distribution with parameter . Besides, according to Assumption 3.2, we have
Let be the event
| C51 |
If then a.s. and . Let us assume . Then according to inequality (C6) of Corollary C.6, under the condition
| C52 |
we have .
Let us assume (C52) holds for every i, j such that . Then
Let us choose . Then (C52) is implied by the condition
| C53 |
so under this condition and we have the result.
Now let us prove the proposition. Let and suppose (C49) holds. Let us work on the event where the are defined in the proof of Lemma C.14. Then according to Lemma C.14, . Let , and for let
| C54 |
Let and let .
Study of the difference .
According to Assumption 3.2 we have
However, according to Assumption 3.2, for any we have
| C55 |
where is the number of object natures belonging to category j. Therefore we have
and since we work on we have, where o is the nature of object m:
where we bound by 1 to go from the first line to the second, and we bound by to go from the third line to the fourth.
Study of the difference .
According to Gao and Pavel (2018) (Proposition 4), the softmax function defined on with temperature is -Lipschitz, so we have
by replacing by its value .
Study of the difference .
We apply Proposition 30 of Jaffard et al. (2026). For , if then for every
| C56 |
Otherwise if , we have
| C57 |
and
| C58 |
We get the result by combining the error terms.
C.6 Proof of Theorem 3.5
Let us prove the following result from which Theorem 3.5 immediately derives.
Theorem C.15
Let and , and . Let and suppose Assumptions 3.2 and 3.4 (Margin ()) hold. Let the parameters M, , T, and verify
where and ,
and
Then with probability larger than , we have that for all nature of the object presented after the learning phase, that is the object, if we denote by its category, the choice (10) and the reaction time (9) satisfy
| C59 |
We will need several lemmas. Let be the compensator of the process . We denote .
Lemma C.16
Let , , , . Then we have
| C60 |
and
| C61 |
Proof
Let . Let us use the Cramér-Chernoff method. Note that the weights are measurable. Let , . Then according to Fubini-Tonelli theorem, since g is positive and the random measures defined by the processes are -finite we have almost surely
Therefore
| C62 |
and by independence of the processes we have
| C63 |
Besides, according to Proposition 6 of Reynaud-Bouret (2003),
where we exchanged the sum and integral because the series of functions converges uniformly, we bounded by and by (because is bounded by 1).
Suppose . Since we have
By applying Markov’s inequality to the variable conditionally to the -algebra , we get
Then similarly as in section 2.4 of Boucheron et al. (2013), we have
| C64 |
where . Therefore
Besides, f is an increasing function from to with inverse so we have
| C65 |
and by integrating we get (C60). Now, let us prove (C61). Let us consider instead of . Then similarly we have
| C66 |
hence
| C67 |
so the same computations apply to bound , and by applying Markov’s inequality to the variable we get the same bound as in (C60) for (C61).
Now that we proved (C60) and (C61), we can combine them to have the result.
Lemma C.17
Let , , , . Let . Then we have
| C68 |
and
| C69 |
Proof
Let , , . Let us prove (C68). Let us work conditionally to . Let us use inequality (3.3) of Hansen et al. (2015) with , with and if , and . Let to choose later. Then we have
| C70 |
Let us choose which is -measurable. Let be the event
| C71 |
and be the event
| C72 |
Then and according to Lemma C.16 inequality (C60), . Besides,
| C73 |
and by integrating we get
| C74 |
therefore
| C75 |
By replacing by its value we get (C68).
Now, let us prove (C69). Similarly, let us use inequality (3.3) of Hansen et al. (2015) with and if . Let to choose later. Then we get
| C76 |
Let us choose the same as before: . Let be the event
| C77 |
and be the event
| C78 |
Then and according to Lemma (C.16) inequality (C61), . Besides,
| C79 |
and by integrating we have
| C80 |
so we have
| C81 |
By replacing by its value we get (C69).
Lemma C.18
Let , , . Then with probability more than , we have
Proof
By combining inequalities (C68) and (C69) of Lemma C.17, we get
Let us choose , such that by union bound
which concludes the proof.
Lemma C.19
Let , and where . Suppose Assumption 3.2 holds. Let . Then there exists an absolute constant such that with probability more than , for every we have
| C82 |
where
| C83 |
with and .
Proof
Let , , . Then according to Proposition 3.3, there exists an event with probability more than such that on , for every we have
Let us work on . We have
which concludes the proof.
Lemma C.20
Let and where . Then with probability more than , for every we have
where
where is an absolute constant.
Proof
Let , . By combining the results of Lemmas C.18 and C.19 for every with instead of we have the result.
Now we can prove the theorem. Let , to choose later. Let us work on the event defined in the proof of Lemma C.20 for . Let
| C84 |
and for ,
| C85 |
such that
| C86 |
and for every ,
| C87 |
We would like to choose such that for every , and . It would imply that at time , has already reached and for every , has not reached yet. The condition is implied by
| C88 |
which is implied by
Let . Suppose . Then a sufficient condition is
| C89 |
This inequality has the form with , and a, b, c positive constants. The polynomial has two real roots, the largest one being , so a sufficient condition is , i.e.,
| C90 |
Let the minimal satisfying (C90), such that
| C91 |
Since tends to infinity, it is possible to choose such . Since is increasing, a sufficient condition to have is . Then if , by continuity of I there exists such that , and we have the result. Let us now explicit the conditions we had to assume.
We have
A sufficient condition is that both terms of the left side of the inequality are less than half the right term, which reads as
| C92 |
and
| C93 |
Besides,
where . Since and , a sufficient condition is
The other condition on is
and finally, since by definition ,
which concludes the proof.
C.7 Proof of Theorem 3.6
Let and let be the compensator of the process . We still denote .
Let vectors in . We denote by the usual scalar product between two vectors, which we extend to three vectors by .
We will need the following lemmas.
Lemma C.21
Let . With the constants of Lemma C.2, if g has compact support on [0, S], then there exists i.i.d. standard Brownian motions ’s independent of everything else such that with probability larger than , for every and ,
with .
Proof
For all ,
| C94 |
Moreover
| C95 |
The first part is just due to the fact that if then and that for all t and s. The second part is done with exactly the same arguments. So we get for all that
Now we apply Lemma C.2 to all that are dilation of so that they are Poisson processes of rate 1. It means we obtain i.i.d. standard Brownian motions , only depending on and auxiliary i.i.d. uniform random variables such that with probability larger ,
| C96 |
We apply this at time t and in the above equation and this leads to the desired result.
Now, let us choose .
Proposition C.22
Let , , the nature of object m. There are absolute positive constants and a positive depending on and such that there exists independent standard Brownian motions such that with probability larger than
| C97 |
Proof
For all , let us consider independent Poisson processes of rate 1, independent of everything else. By Lemma C.2, we can construct i.i.d. standard Brownian motions such that with probability larger than , we have that
| C98 |
Since the (random) function ’s are non decreasing, we can always define their inverse , conditionally to the inputs ’s, so that one can construct , the Hawkes processes as . Hence we have by change of time, that on the same event of probability larger than
| C99 |
Now we can apply Lemma C.21, so that with probability larger than , both the above equations and the result of Lemma C.21 holds.
Now let us intersect with the event where the results of Lemma C.9 hold for all and .
By a union bound, we get therefore that on an event of probability larger than
- with at time and ,
C100 - still with at time and ,
C101
Hence on the same event,
Besides, by (C94) we also have
| C102 |
so we have
| C103 |
Going back to (C99) and now using Lemma C.9 with at time and , we therefore obtain that
and because (C103) on the same event, we have . Moreover using (C103) again, we get that on the same event,
| C104 |
Injecting this in (C99), we obtain the result.
Now we can prove the theorem. Let us work on the same event as the one of the proof of Proposition C.22, for which the conclusions of Lemma C.21 also apply, which has probability more than . On this event, according to Lemma C.21 we have for every and
Besides, according to (C101) on the same event we have for every
Since we have then for every
Therefore, by combining this with the conclusions of Proposition C.22, we have that on the same event, for every and ,
By construction, the processes are mutually independent. We have then the following equality in distribution:
Therefore, the process is a Gaussian process with mean
| C105 |
and covariance
Furthermore, if then
Let us choose x such that , i.e., . Then for , we have and with probability more than , for every we have
| C106 |
Now let us study the hitting times. Let us work on the same event that we denote . Let . Then for every and we have
| C107 |
where = . Then is a Brownian motion with 0 drift and scaling . According to Lemma C.1, by union bound there exists an event with probability more than such that on ,
| C108 |
Let us work on . We can now control . Furthermore, and by (C94) we have . By combining everything, we get that for every and
| C109 |
Since and , similarly we have
| C110 |
Study of the hitting times of and .
Let and . First, let us study under which conditions and . According to (C109), we have that for all ,
Then a sufficient condition to have is to have
| C111 |
which is implied by
| C112 |
which holds for
| C113 |
by definition of U. By using (C110), we can apply the same reasoning to to find that (C112) is also a sufficient condition to have .
This means that on this event, both processes and have reached before time U, so we have in fact and . Therefore, for every and , we have , and controlling the trajectory of on [0, U] is sufficient to control it on . Using this fact, let us now study the convergence of and to .
1. Convergence of . Since is an integer and cannot make two jumps at the same time, we have . Therefore, for every we have
were the last inequality holds using (C109). So we have
| C114 |
2. Convergence of . According to (C110) we have
so
| C115 |
3. Study of the difference . Let us begin by bounding . We have
so according to (C106) we have
| C116 |
Besides,
Besides, if then
Since and both converge to , so for n verifying (C113) we have and so . Therefore
According to Lemma C.9 and since and are bounded on , by union bound there exists an event of probability more than such that on we have for every
| C117 |
If then and we have the result. Otherwise we have
Combining this with (C116) we have
By writing , and , we can rewrite it as
This polynomial has two real roots, the largest one being , so necessarily we have , which implies that , i.e.,
and finally we get
Since , we get the results of the theorem by choosing instead of .
C.8 Proof of Proposition 4.1
Let and the two categories, the feature characterizing category and the feature characterizing category . Let us compute the feature discrepancies of the features. Since every has feature , for every we have and since there is no having feature , for every we have . Therefore
| C118 |
Similarly, for every we have and for every we have so
| C119 |
Let . Then there are 4 rockets among the 16 having simultaneously features and i. Since contains 5 objects, there is at least one object without feature i in . Therefore and
| C120 |
Thus and by definition of the family , for we have . By symmetry, the same computations are true when exchanging index 1 with index 2 so for we also have and . Now, let us compute the . For ,
| C121 |
and
| C122 |
so
| C123 |
where is any constant in . By symmetry, for we also have
| C124 |
Author Contributions
S. Jaffard did the writing, the proofs, collected the data and analyzed them. G. Mezzadri designed the experiment and participated to the writing. P. Reynaud-Bouret participated to the writing and the proofs, provided some of the initial ideas about the coupling and supervised the work. E. Tanré provided some of the initial ideas about the coupling and a thorough checking of all the mathematical details.
Funding
Open Access funding enabled and organized by Projekt DEAL.
Declarations
Competing interests
The authors have no competing interests to declare that are relevant to the content of this article.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- Brunton BW, Botvinick MM, Brody CD (2013) Rats and humans can optimally accumulate evidence for decision-making. Sci 340(6128):95–98 [DOI] [PubMed] [Google Scholar]
- Besançon E, Coutin L, Decreusefond L, Moyal P (2024) Diffusive limits of Lipschitz functionals of Poisson measures. Ann Appl Probab 34(1A):555–584. 10.1214/23-aap1972 [Google Scholar]
- Bacry E, Delattre S, Hoffmann M, Muzy JF (2013) Some limit theorems for Hawkes processes and application to financial statistics. Stochastic Process Appl 123(7):2475–2499. 10.1016/j.spa.2013.04.007 [Google Scholar]
- Bao Y, Kuang Z, Peissig P, Page D, Willett R (2017) Hawkes process modeling of adverse drug reactions with longitudinal observational data. In: Proceedings of the 2nd Machine Learning for Healthcare Conference, vol. 68, pp 177–190
- Boucheron S, Lugosi G, Massart P (2013) Concentration inequalities. Oxford University Press, Oxford, p 481. 10.1093/acprof:oso/9780199535255.001.0001 (A nonasymptotic theory of independence, With a foreword by Michel Ledoux) [Google Scholar]
- Bretagnolle J, Massart P (1989) Hungarian constructions from the nonasymptotic viewpoint. Ann Probab 17(1):239–256 [Google Scholar]
- Bacry E, Mastromatteo I, Muzy J-F (2015) Hawkes Processes in Finance. Market Microstruct and Liquidity 1(01):1550005 [Google Scholar]
- Brody CD, Romo R, Kepecs A (2003) Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamic representations. Curr Opin Neurobiol 13(2):204–211 [DOI] [PubMed] [Google Scholar]
- Cesa-Bianchi N, Lugosi G (2006) Prediction, learning, and games. Cambridge University Press, Cambridge [Google Scholar]
- Carrillo JA, Cordier S, Mancini S (2011) A decision-making Fokker-Planck model in computational neuroscience. J Math Biol 63(5):801–830. 10.1007/s00285-010-0391-3 [DOI] [PubMed] [Google Scholar]
- Caporale N, Dan Y (2008) Spike timing-dependent plasticity: a Hebbian learning rule. Annu Rev Neurosci 31:25–46 [DOI] [PubMed] [Google Scholar]
- Chevallier J, Melnykova A, Tubikanec I (2021) Diffusion approximation of multi-class Hawkes processes: theoretical and numerical analysis. Adv in Appl Probab 53(3):716–756. 10.1017/apr.2020.73 [Google Scholar]
- Ditterich J (2006) Stochastic models of decisions about motion direction: behavior and physiology. Neural Netw 19(8):981–1012 [DOI] [PubMed] [Google Scholar]
- Deco G, Martí D (2007) Deterministic analysis of stochastic bifurcations in multi-stable neurodynamical systems. Biol Cybernet 96(5):487–496. 10.1007/s00422-007-0144-6 [DOI] [PubMed] [Google Scholar]
- Ethier SN, Kurtz TG (1986) Markov processes. John Wiley & Sons, Inc, New York. 10.1002/9780470316658 (Characterization and convergence) [Google Scholar]
- Erny X, Löcherbach E, Loukianova D (2023) Strong error bounds for the convergence to its mean field limit for systems of interacting neurons in a diffusive scaling. Ann Appl Probab 33(5):3563–3586 [Google Scholar]
- Fudenberg D, Strack P, Strzalecki T (2018) Speed, accuracy, and the optimal timing of choices. Am Econ Rev 108(12):3651–84. 10.1257/aer.20150742 [Google Scholar]
- Gerstein GL, Bedenbaugh P, Aertsen AM (1989) Neuronal assemblies. IEEE Trans Biomed Eng 36(1):4–14 [DOI] [PubMed] [Google Scholar]
- Gao B, Pavel L (2018) On the Properties of the Softmax Function with Application in Game Theory and Reinforcement Learning arXiv:1704.00805
- Gold JI, Shadlen MN (2001) Neural computations that underlie decisions about sensory stimuli. Trends Cogn Sci 5(1):10–16 [DOI] [PubMed] [Google Scholar]
- Hawkes AG (1971) Spectra of some self-exciting and mutually exciting point processes. Biometrika 58(1):83–90 [Google Scholar]
- Hutcherson CA, Bushong B, Rangel A (2015) A neurocomputational model of altruistic choice and its implications. Neuron 87(2):451–462 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hebb DO (2005) The organization of behavior: a neuropsychological theory. Psychology press, New York [Google Scholar]
- Hansen NR, Reynaud-Bouret P, Rivoirard V (2015) Lasso and probabilistic inequalities for multivariate point processes. Bernoulli 21(1):83–143. 10.3150/13-BEJ562 [Google Scholar]
- Hubel DH, Wiesel TN (1962) Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex. J Physiol 160(1):106–154 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Insabato A, Pannunzi M, Rolls ET, Deco G (2010) Confidence-related decision making. J Neurophysiol 104(1):539–547 [DOI] [PubMed] [Google Scholar]
- Jaffard S, Vaiter S, Muzy A, Reynaud-Bouret P (2024) Provable local learning rule by expert aggregation for a Hawkes network. In: International Conference on Artificial Intelligence and Statistics, pp 1837–1845. PMLR
- Jaffard S, Vaiter S, Reynaud-Bouret P (2026) CHANI: correlation-based Hawkes aggregation of neurons with bio-inspiration. J Mach Learn 27(32):1–62 [Google Scholar]
- Komlós J, Major P, Tusnády G (1975) An approximation of partial sums of independent ’s and the sample . I. Z Wahrscheinlichkeitstheorie und Verw Gebiete 32:111–131. 10.1007/BF00533093 [Google Scholar]
- Komlós J, Major P, Tusnády G (1976) An approximation of partial sums of independent RV’s, and the sample DF. II. Z Wahrscheinlichkeitstheorie und Verw Gebiete 34(1):33–58. 10.1007/BF00532688 [Google Scholar]
- Karatzas I, Shreve SE (1998) Brownian motion and stochastic calculus, vol 113, 2nd edn. Springer, New York. 10.1007/978-1-4612-0949-2 [Google Scholar]
- LaBerge D (1994) Quantitative models of attention and response processes in shape identification tasks. J Math Psychol 38(2):198–243 [Google Scholar]
- Le Cun Y, Boser B, Denker J, Henderson D, Howard R, Hubbard W, Jackel L (1989) Handwritten digit recognition with a back-propagation network. In: NeurIPS
- Love B, Medin D, Gureckis T (2004) Sustain: a network model of category learning. Psychol Rev 111:309–332 [DOI] [PubMed] [Google Scholar]
- Lovric M (2025) International Encyclopedia of statistical science. Springer, Berlin, Heidelberg [Google Scholar]
- Machens CK, Romo R, Brody CD (2005) Flexible control of mutual inhibition: a neural model of two-interval discrimination. Sci 307(5712):1121–1124 [DOI] [PubMed] [Google Scholar]
- Nosofsky RM (1986) Attention, similarity, and the identification-categorization relationship. J Exp Psychol Gen 115:39–57 [DOI] [PubMed] [Google Scholar]
- Ost G, Reynaud-Bouret P (2023) Neural coding as a statistical testing problem. Math Neurosci Appl 3:4–33 [Google Scholar]
- Papamakarios G, Murray I (2016) Fast -free inference of simulation models with Bayesian conditional density estimation. In: Lee D, Sugiyama M, Luxburg U, Guyon I, Garnett R (eds) Advances in neural information processing systems, vol 29. Curran Associates Inc [Google Scholar]
- Philiastides MG, Ratcliff R (2013) Influence of branding on preference-based decision making. Psychol Sci 24(7):1208–1215 [DOI] [PubMed] [Google Scholar]
- Prodhomme A (2020) Strong Gaussian approximation of metastable density-dependent Markov chains on large time scales arXiv:2010.06861v3
- Prodhomme A (2023) Strong Gaussian approximation of metastable density-dependent Markov chains on large time scales. Stochastic Process Appl 160:218–264 [Google Scholar]
- Ratcliff R (1978) A theory of memory retrieval. Psychol Rev 85(2):59–108 [Google Scholar]
- Ratcliff R (1981) A theory of order relations in perceptual matching. Psychol Rev 88(6):552–572 [Google Scholar]
- Ratcliff R (1988) Continuous versus discrete information processing: modeling accumulation of partial information. Psychol Rev 95(2):238–255 [DOI] [PubMed] [Google Scholar]
- Reynaud-Bouret P (2003) Adaptive estimation of the intensity of inhomogeneous Poisson processes via concentration inequalities. Probab Theory Related Fields 126(1):103–153 [Google Scholar]
- Ratcliff R, Hasegawa YT, Hasegawa RP, Smith PL, Segraves MA (2007) Dual diffusion model for single-cell recording data from the superior colliculus in a brightness-discrimination task. J Neurophysiol 97(2):1756–1774 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ratcliff R, McKoon G (2008) The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput 20(4):873–922 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rosenblatt F (1957) The perceptron, a perceiving and recognizing automaton project para. Cornell Aeronautical Laboratory, Ithaca, New York [Google Scholar]
- Roxin A (2019) Drift-diffusion models for multiple-alternative forced-choice decision making. J Math Neurosci 9:5–23. 10.1186/s13408-019-0073-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ratcliff R, Rouder JN (1998) Modeling response times for two-choice decisions. Psychol Sci 9(5):347–356 [Google Scholar]
- Robbins H, Siegmund D (1970) Boundary crossing probabilities for the Wiener process and sample sums. Ann Math Statist 41:1410–1429. 10.1214/aoms/1177696787 [Google Scholar]
- Ratcliff R, Smith PL (2004) A comparison of sequential sampling models for two-choice reaction time. Psychol Rev 111(2):333–367 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Revuz D, Yor M (1999) Continuous martingales and Brownian motion, vol 293, 3rd edn. Springer, Berlin, p 602. 10.1007/978-3-662-06400-9 (Grundlehren der mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences]) [Google Scholar]
- Singer W, Engel AK, Kreiter AK, Munk MH, Neuenschwander S, Roelfsema PR (1997) Neuronal assemblies: necessity, signature and detectability. Trends Cogn Sci 1(7):252–261 [DOI] [PubMed] [Google Scholar]
- Shadlen MN, Kiani R (2013) Decision making as a window on cognition. Neuron 80(3):791–806 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shadlen MN, Newsome WT (1996) Motion perception: seeing and deciding. Proc Natl Acad Sci USA 93(2):628–633 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stone JV (2018) Principles of neural information theory. Comput Neurosci and Metabolic Efficiency
- Smith PL, Van Zandt T (2000) Time-dependent Poisson counter models of response latency in simple judgment. Br J Math Stat Psychol 53(2):293–315 [DOI] [PubMed] [Google Scholar]
- Tavanaei A, Ghodrati M, Kheradpisheh SR, Masquelier T, Maida A (2019) Deep learning in spiking neural networks. Neural Netw 111:47–63 [DOI] [PubMed] [Google Scholar]
- Türkyilmaz K, Lieshout MNM, Stein A (2013) Comparing the Hawkes and trigger process models for Aftershock sequences following the 2005 Kashmir earthquake. Math Geosci 45:149–164 [Google Scholar]
- Wagenmakers E-J, Maas HLJ, Grasman RPPP (2007) An EZ-diffusion model for response time and accuracy. Psychonomic Bulletin & Rev 14(1):3–22 [DOI] [PubMed] [Google Scholar]
- Zhou K, Zha H, Song L (2013) Learning social infectivity in sparse low-rank networks using multi-dimensional Hawkes processes. In: Carvalho CM, Ravikumar P (eds) Proceedings of the sixteenth international conference on artificial intelligence and statistics, proceedings of machine learning research, vol 31. PMLR, Scottsdale, Arizona, USA, pp 641–649 [Google Scholar]











