Skip to main content
Springer logoLink to Springer
. 2026 Jun 12;93(1):1. doi: 10.1007/s00285-026-02415-0

Spiking neural models for decision-making tasks with learning

Sophie Jaffard 1,✉, Giulia Mezzadri 2, Patricia Reynaud-Bouret 3, Etienne Tanré 4
PMCID: PMC13263290  PMID: 42283906

Abstract

In cognition, response times and choices in decision-making tasks are commonly modeled using Drift Diffusion Models (DDMs), which describe the accumulation of evidence for a decision as a stochastic process, specifically a Brownian motion, with the drift rate reflecting the strength of the evidence. In the same vein, the Poisson counter model describes the accumulation of evidence as discrete events whose counts over time are modeled as Poisson processes. This model has a spiking neurons interpretation as these processes are used to model neuronal activities. However, these models lack a learning mechanism and are limited to tasks where participants have prior knowledge of the categories. To bridge the gap between cognitive and biological models, we propose a biologically plausible Spiking Neural Network (SNN) model for decision-making that incorporates a learning mechanism and whose neurons activities are modeled by a multivariate Hawkes process. First, we show a coupling result between the DDM and the Poisson counter model, establishing that these two models provide similar categorizations and reaction times and that the DDM can be approximated by spiking Poisson neurons. To go further, we show that a particular DDM with correlated noise can be derived from a Hawkes network of spiking neurons governed by a local learning rule. In addition, we designed an online categorization task to evaluate the model predictions. This work provides a significant step toward integrating biologically relevant neural mechanisms into cognitive models, fostering a deeper understanding of the relationship between neural activity and behavior.

Keywords: Spiking Neural Network, Decision-making, Hawkes process, Local learning rule, Drift diffusion model

Introduction

One of the main challenges of the 21st century is to bridge the gap between brain and behavior, and computational models are a fundamental tool researchers use to address this challenge. In this line, developing biologically realistic models to understand the decision-making processes of humans and animals is a key focus in neuroscience and cognition.

A prominent model in cognition is the Drift Diffusion Model (DDM), introduced by Ratcliff (1978, 1981, 1988) who demonstrated how the DDM could accurately predict outcomes such as accuracy, reaction times, and error latencies across various decision-making tasks. The model achieves this by integrating evidence over time, with a drift rate reflecting evidence strength and decision boundaries representing the thresholds for making a decision. Initially designed for two-choice experiments, it extends to multiple choices by modeling evidence accumulation as a multidimensional drift-diffusion process, with each component competing against the others (Roxin 2019). The reasons for the growing attention to the DDM are multiple. It has been shown to provide accurate descriptions of accuracy and reaction time data across a wide range of psychological tasks, including perceptual tasks (Ratcliff and Rouder 1998; Ditterich 2006; Brunton et al. 2013) and value-based choices (Ratcliff and McKoon 2008; Philiastides and Ratcliff 2013; Hutcherson et al. 2015).

It is also supported by neurobiological evidence: in the 1990s and 2000s, neurobiologists like Shadlen and Newsome provided crucial neurobiological evidence supporting the DDM by showing that neural activity in brain areas such as the lateral intraparietal area (LIP) reflects the accumulation of sensory evidence, consistent with DDM predictions (Shadlen and Newsome 1996; Gold and Shadlen 2001; Ratcliff et al. 2007; Shadlen and Kiani 2013). However, DDMs do not directly include the modeling of neuronal activity.

Biologically relevant decision-making models (Brody et al. 2003; Machens et al. 2005; Deco and Martí 2007) rely on perceptual information to guide the choice between behaviors. A straightforward approach involves two interacting groups of neurons, each defined by its average firing rate. Decision-making in this context is modeled as a transition from a spontaneous state (where both groups have similar firing rates) to a decision state (characterized by a high or low activity ratio between the groups), and this process is often represented as a stochastic dynamical system. Such models effectively approximate reaction times and can be used to compute biologically meaningful information. For example, Carrillo et al. (2011) offer a mathematical analysis of these systems in nonlinear scenarios and computes the probability of reaching specific decisions and the average time required to do so. Other approaches than evidence accumulation can be implemented in such models: for instance, Insabato et al. (2010) propose a decision confidence mechanism. However, none of these models are linked to the DDM nor show such accurate descriptions of real accuracy or reaction times.

Simpler than these models and more similar to the Drift Diffusion Model, the Poisson counter model (LaBerge 1994; Ratcliff and Smith 2004) represents evidence accumulation as discrete events, with their counts over time modeled as homogeneous Poisson processes. This approach aligns with how neuroscientists often use Poisson processes to model neuronal activity based on firing rates, offering a spiking neuron interpretation: evidence accumulation can be seen as the spike counts of neurons coding for potential responses. Smith and Van Zandt (2000) extend the counter model by incorporating inhomogeneous Poisson processes. However, since the Poisson process is not well-suited for modeling the interactions between neurons, this approach is limited to representing individual neurons coding for categories and cannot capture the dynamics of more complex networks of spiking neurons.

A common tool to model spike trains of interacting neurons is the multivariate Hawkes process (Hawkes 1971), which is a self-exciting and mutually exciting point process. Its field of application is not limited to neuroscience: it is well-adapted to model earthquake data (Türkyilmaz et al. 2013), financial transactions (Bacry et al. 2015), health data (Bao et al. 2017), social networks (Zhou et al. 2013), or more generally, any sequences of events such that the occurrence of an event influences the probability of further events to occur.

Poisson and Hawkes processes seem to be promising microscopic processes to explain the power of the DDM prediction. Indeed diffusion approximations of Poisson and Hawkes processes have been investigated in several contexts. For instance, Bacry et al. (2013) provide a functional central limit theorem for multivariate Hawkes processes for finance applications, and Ethier and Kurtz (1986) as well as Bretagnolle and Massart (1989) provide strong approximations of the Poisson process by a Brownian process. Strong approximations by diffusive limits have also been derived to study mean field limits of networks of interacting neurons (Erny et al. 2023), and Besançon et al. (2024) provide coupling results between Poisson and Hawkes processes in one dimension. Additionally, Chevallier et al. (2021) establish strong error bounds and numerical schemes for the diffusion approximation of multi-class Hawkes processes.

However, neither the DDM, the Poisson counter model, nor the other biologically relevant decision-making models discussed here incorporate a learning mechanism. These models are limited to tasks where participants already possess prior knowledge of the possible responses. In the DDM, for instance, this prior knowledge is represented by the value of the drift rate, while in stochastic dynamical systems, it is captured by the (fixed) strength of synaptic connections. For example, Deco and Martí (2007) assume that synaptic connections between neurons are the result of a Hebbian learning mechanism that has taken place before the model they propose.

On the other hand, learning mechanisms are at the heart of artificial neural networks (ANNs), the first of which is the perceptron (Rosenblatt 1957), inspired by the structure and function of biological neurons and their networks. This biological inspiration has continued to influence the development of increasingly advanced machine learning models, such as convolutional neural networks (Le Cun et al. 1989), which draw their inspiration from biological processes observed in the visual cortex by Hubel and Wiesel (1962). Conversely, machine learning algorithms play a central role in implementing spiking neural networks (SNNs) (Tavanaei et al. 2019). These networks, more complex than ANNs, model neuronal activity through sequences of spikes, mimicking the electrical pulses of biological neurons. Particularly relevant for studying the brain’s neural code, SNNs also offer insights into the design of energy-efficient algorithms (Stone 2018). To be realistic, SNNs are typically trained using local learning rules such as Hebbian learning (Hebb 2005) or spike-timing-dependent plasticity (Caporale and Dan 2008). However, spiking neural networks (SNNs) are typically not designed to model decision-making tasks. They do not inherently account for reaction times and are primarily optimized for achieving strong empirical performance by mimicking the functioning of the brain rather than making decisions that closely resemble human behavior.

The focus of the present work is to bridge the gap between decision-making models used in cognition and brain-inspired models of spiking neurons, and to establish that prior knowledge assumed in decision-making models may be the result of a biologically relevant learning mechanism. First, we introduce both a drift diffusion model and a Poisson counter model, outlining conditions under which each produces accurate decisions (Theorems 2.3 and 2.5). As an initial step toward deriving the DDM from spiking neuron-based models, we establish a coupling between the two models, establishing that they provide similar categorizations and reaction times (Theorem 2.6). This approximation holds in the asymptotic case where the number of neurons is large, which is consistent with brain recordings indicating that concepts are often encoded by coordinated groups of neurons, commonly referred to as neuronal assemblies (Singer et al. 1997; Gerstein et al. 1989).

To go further, we introduce a biologically inspired Spiking Neural Network (SNN) model for decision-making. This model integrates a learning mechanism and is provably close to the drift diffusion model. Neuronal activity within the network is represented by a multivariate Hawkes process, which accounts for interactions between neurons. The output neurons encode possible decisions, with their spike counts representing evidence accumulation for respective responses, which makes our model a Hawkes counter model. Synaptic connections are adjusted via a local learning rule provided by the expert aggregation framework (Cesa-Bianchi and Lugosi 2006). In Jaffard et al. (2024), we introduced a simpler version of the network. The focus of this work was to prove theoretically that a biologically plausible neural network could learn using local mechanisms only. Building on this foundation, Jaffard et al. (2026) extended the network by incorporating hidden layers specifically designed to detect neuronal synchronizations. This extension not only advanced the theoretical results from Jaffard et al. (2024) but also demonstrated that our algorithm automatically produces neuronal assemblies in the sense that the network can encode several concepts and that the same neuron in the intermediate layers might be activated by more than one concept. Additionally, we provided an in-depth analysis of the types of concepts the network can encode and numerical results on handwritten digits dataset. However, this initial version was not suited to model decision-making tasks as it was unable to model reaction times.

The model presented in the current work is a refined version of this network, which introduces two key differences from these earlier versions. First, neuronal activities are modeled in continuous time rather than discrete time, which is more realistic and closer to the drift diffusion model and Poisson counter model. Second, we have incorporated dynamic decision durations, allowing the model to account for reaction times alongside decision-making processes, unlike the fixed decision durations used previously. These improvements enable the model to be compared with other models such as the DDM or the Poisson counter model.

We analyze the network’s asymptotic behavior (Proposition 3.3) and provide conditions under which the model delivers accurate decisions (Theorem 3.5). Additionally, we establish a coupling between our model and the DDM (Theorem 3.6) thanks to strong approximations similar to Ethier and Kurtz (1986), demonstrating that a DDM with correlated noise can be approximated by a Hawkes network of spiking neurons capable of learning via local rules.

To evaluate our model, we designed an online categorization task in which participants were asked to classify stimuli – rockets in this case – defined by four characteristics, with one randomly selected feature serving as the basis for learning. Such feature-based tasks have long been central to cognitive science (Nosofsky 1986; Love et al. 2004), providing valuable insights into how individuals learn to group stimuli based on shared characteristics. This well-established paradigm made it a natural starting point for testing our model. By analyzing participants’ reaction times and choices, we demonstrate the utility of the Hawkes counter model in studying learning and decision-making processes. We describe the experiment we designed and detail its implementation within our model. We prove that the network can learn to perform this task successfully (Proposition 4.1). Furthermore, we estimate model parameters for individual participants, enabling a detailed analysis of their learning behaviors.

Section 2 introduces the decision-making task we aim to model, along with the drift diffusion model and the Poisson counter model, including their mathematical analyses and coupling. Section 3 outlines the Hawkes counter model for decision-making tasks with learning and its corresponding mathematical analysis and coupling with the DDM. Section 4 details our experiment and its analysis based on our model. All notations defined in the main text are listed in Appendix A, and any proofs not included in the main text are provided in Appendix C.

Drift diffusion and poisson counter models

Framework

We aim to model first the following decision-making task: a participant sequentially categorizes objects, each having a nature from a set O, into one of several categories belonging to a set J. Each category j∈J is a subset of O, and together the categories form a partition of O. Participants may encounter the same object nature multiple times; for example, the first object presented might be a blue circle, as might the tenth object. See Figure 1 for an illustration of the categorization task studied in Section 4, and Figure 2 for another example.

Fig. 1.

Fig. 1

Illustration of our online experiment available at https://3ia-demos.inria.fr/mel/en/. The participant has to learn to classify rockets into two categories: those that can land on the moon and those that cannot. They are successively presented with rockets for which they have to propose a category (left picture). After each categorization, feedback is provided on their answers (right picture)

Fig. 2.

Fig. 2

Illustrative example of objects natures, categories, presented objects and evidence accumulation for the mth presented object for the DDM. Here, there are 4 object natures, 2 categories and 6 presented objects. The chosen response ȷ^ is the category coded by the first process to reach threshold θ, i.e.,  ȷ^=j1 and the corresponding reaction time is τ(W)

In the present section, we present two models: the drift diffusion model and the Poisson counter model. They provide predictions for both categorizations and reaction times. These models assume that participants already possess prior knowledge about object natures and categories, and do not describe scenarios where participants must learn the categories of the presented objects.

For both models, we give explicit conditions under which they predict correct categorizations with high probability. Then, we prove a coupling result between the models indicating that these two models provide very similar reaction times and categorizations.

For a,b∈R, we denote a∨b:=max(a,b) and a∧b:=min(a,b). Also when quantities have several indices, the dropping of one index corresponds to the sequence on this index. For instance, γ=(γoj)j∈J,o∈O whereas γo=(γoj)j∈J and γj=(γoj)o∈O. If two sets of indices are available, typically I and J, to avoid confusion, we use the set instead of the index. For instance, γI=(γoi)i∈I,o∈O. Also ‖·‖∞ is the infinite norm.

Drift Diffusion model

The model

During the presentation of the mth object, the accumulation of evidence of the categories j∈J is modeled by a |J|-dimensional drifted Brownian motion Wm=(Wmj)j∈J with mean vector defined by ∀j∈J,∀t≥0, E[Wm,tj]=μojt and diagonal covariance matrix defined by ∀j1,j2∈J, ∀t,s≥0, Cov(Wm,t1,Wm,s2)=1{j1=j2}μo1(t∧s) where o is the nature of the mth object and μoj≥0 is the drift. Therefore, the process coding for evidence accumulation in favor of category j can be rewritten as

∀t≥0,Wm,tj:=μojt+μojBm,tj 1

where the (Bm,tj)t≥0 are independent standard Brownian motions. The object is categorized in the category coded by the first process (Wm,tj)t≥0 among the processes of Wm to reach a certain threshold θ>0 before a limit duration T. We denote

τ(Wj):=inf{u≥0;Wm,uj≥θ}. 2
Remark 2.1

The law of τ(Wj) is the inverse Gaussian Distribution with parameters θμoj and θ2μoj (Lovric (2025), p.687).

The winning process is then

ȷ^=argminj∈Jτ(Wj). 3

Note that ȷ^ and τ(Wj) depend on m but we drop the index for simplicity. However, if τ(Wȷ^)≥T, it means that accumulation evidence is not sufficient to reach a decision and the model does not categorize the object. The corresponding reaction time of the whole system is then τ(W):=τ(Wȷ^)∧T. Note that the processes are indexed by time t∈[0,T] which is not a ‘time’, but a ‘present time’ since it is set back to 0 at each presentation of a new object. See Figure 2 for an example of evidence accumulation modeled by the DDM.

Note that in general, in drift diffusion models, the scaling is not necessarily the square root of the drift. We study this specific case because it allows the approximations by spiking neural models that we present further on. Note also that the drift and scaling do not evolve with the number of presented objects m: they represent prior knowledge about the categories and object natures and are fixed. The higher the drift μoj, the higher the average accumulation of evidence in favor of category j.

Theoretical guarantees

Before detailing the specific conditions under which the model predicts the correct category, it is worth recalling that the fundamental relationships between decision time, accuracy, and evidence accumulation parameters are already well-established in the literature. For instance, Wagenmakers et al. (2007) demonstrated through the EZ-diffusion model that there are explicit, closed-form equations directly linking observable accuracy and response times to the underlying drift rate and decision threshold. Furthermore, the joint distribution of choice probabilities and decision times under time constraints has been rigorously analyzed; Fudenberg et al. (2018) mapped the exact conditions and optimal sequential sampling policies required to guarantee accurate choices within specific time windows. While the results establishing the conditions for correct prediction in drift-diffusion processes are known, the following theorem builds upon this theoretical tradition to establish the specific margin conditions required for the present framework.

Let us study under which conditions the model predicts the correct category. We assume that the participant has prior knowledge about the categories, which takes the form of the following assumption. Let Δμ>0.

Assumption 2.2

(Margin(Δμ)) For every category j∗∈J, for every j≠j∗, for every object nature o∈j∗ we have

μo∗>μoj+Δμ.
Theorem 2.3

Let α∈(0,1) and let m be a fixed positive integer. Let Δμ>0 and suppose Assumption 2.2 (Margin(Δμ)) holds. Then there exist positive constants A‖μ‖∞,Δμ,B‖μ‖∞,Δμ and C‖μ‖∞,Δμ depending only on the index parameters such that if T≥A‖μ‖∞,Δμlog|J|α-1 and if the threshold θ satisfies

B‖μ‖∞,Δμlog|J|α-1<θ<ΔμT-C‖μ‖∞,ΔμTlog(T)+log|J|α-1 4

then with probability larger than 1-α we have that for all nature o∈O, if we denote by j∗∈J its category (i.e. o∈j∗), the choice ȷ^ (3) and the reaction time τ(Wȷ^) (2) that take place at the presentation of the mth object of nature o, satisfy

ȷ^=j∗andτ(Wȷ^)<T.

See Appendix C.2 for a version of this result with exact constants.

In other words, this theorem states that for a fixed object m, if the limit duration T is large enough then as soon as the threshold θ verifies (4), object m is correctly classified with probability more than 1-α. The lower bound comes from the condition that the process coding for category j∗ should be the first to reach θ, whereas the upper bound in O(T) comes from the condition that θ should be reached before limit duration T. Note that the exact expressions of the constants provided in Appendix C.2 indicate that as expected, the larger Δμ, i.e., the larger the gap between the drift of the process coding for the true category and the other drifts, the lower the bound on T and the larger the size of the thresholds interval enabling a correct categorization with high probability.

Poisson counter model

The model

For each presented object, the evidence in favor of the categories takes now the form of discrete events whose counts over time are modeled by a |J|-dimensional homogeneous Poisson process Πm=(Πmj)j∈J with intensity vector γo:=(γoj)j∈J depending only on the nature o of the presented object. Similarly as for the DDM, the object is categorized in the category coded by the first process (Πm,tj)t≥0 among the processes of Πm to reach threshold θ>0 before limit duration T. We denote

τ(Πj):=inf{u≥0;Πm,uj≥θ} 5

the hitting time of process Πmj. The winning process is then

ȷ^:=argminj∈Jτ(Πj). 6

However, if τ(Πȷ^)≥T, it means that evidence accumulation is not sufficient to reach a decision and the model does not categorize the object. Note that as before, the hitting time τ(Πȷ^) and choice ȷ^ depend on m but we drop the index for simplicity. The corresponding reaction time is then τ(Π):=τ(Πȷ^)∧T.

Similar to the DDM, here the intensities do not evolve with the number of presented objects m: they represent prior knowledge about the categories and object natures and are fixed. The higher the intensity γoj, the higher the average accumulation of evidence in favor of category j.

The Poisson process is commonly used to model the activities of spiking neurons coding information through their firing rate, and which do not interact as a network. Therefore, the Poisson counter model can have the following interpretation: each category j is coded by a spiking neuron j whose activity when presented with the mth object is (Πm,tj)t≥0. The spike count of neuron j represents the accumulation of evidence in favor of category j.

Theoretical guarantees

Similar to the continuous diffusion framework, the fundamental conditions governing accuracy and response times in discrete Poisson counter models are already well-documented. Analytical solutions for choice probabilities and first-passage times in discrete race architectures have been extensively characterized, notably by Smith and Van Zandt (2000). Furthermore, the mathematical conditions under which one Poisson process reliably reaches a decision threshold before competing processes-as well as the associated bounds on error rates-rely on established combinatorial formulas and large deviation bounds. While these general mechanics of discrete evidence accumulation are known, the following theorem formalizes the specific intensity margin conditions required for correct prediction within the context of our proposed framework.

We can conduct a similar analysis as for the DDM by assuming a similar assumption representing prior knowledge about the categories. Let Δγ>0.

Assumption 2.4

(Margin(Δγ)) For every category j∗∈J, for every j≠j∗, for every object nature o∈j∗ we have

γo∗>γoj+Δγ.
Theorem 2.5

Let α∈(0,1) and let m be a fixed positive integer. Let Δγ>0 and suppose Assumption 2.4 (Margin(Δγ)) holds. Then there exist positive constants A‖γ‖∞,Δγ,γmin, B‖γ‖∞,Δγ,γmin and C‖γ‖∞ depending only on the index parameters such that if T≥A‖γ‖∞,Δγ,γminlog(|J|α-1) and if the threshold θ satisfies

B‖γ‖∞,Δγ,γminlog(|J|α-1)<θ<ΔγT-C‖γ‖∞Tlog(|J|α-1) 7

where γmin:=mino∈O,j∈J{γoi;γoj>0}, then with probability larger than 1-α we have that for all nature o∈O, if we denote by j∗∈J its category (i.e. o∈j∗), the choice ȷ^ (6) and the reaction time τ(Πȷ^) (5) that take place at the presentation of the mth object of nature o, satisfy

ȷ^=j∗andτ(Πȷ^)<T.

See Appendix C.3 for a version of this result with exact constants.

Similarly as Theorem 2.3 about the DDM, this theorem provides conditions on the threshold θ under which the model predicts the correct category with high probability. Regarding the limit duration T, the upper bound has the same order of magnitude in O(T). Here, the lower bound depends on the quantity γmin, which was not the case in Theorem 2.3. Finally, it should be noted that similarly as in Theorem 2.3, the exact constant values provided in Appendix C.3 indicate that the larger the constant Δγ, the larger the size of the possible thresholds interval.

Coupling between drift diffusion model and poisson counter model

In this section, we explain the high similarity between the behaviors of the Poisson model and the Drift Diffusion model by proving that one model can be strongly approximated by the other and that both models provides similar reaction times, up to negligible terms. Indeed, under a certain framework, we can build a coupling between the processes given by the two models. Here, we assume that we dispose of n independent copies of the Poisson counter model: during the presentation of object m, each category j is coded by n independent Poisson processes, all having intensity γoj where o is the nature of object m. The evidence in favor of category j is then the sum of the count of the n processes coding for category j and is denoted by Πmj,n=(Πm,tj,n)t≥0. By independence of the neurons coding for category j, the process Πmj,n is then a homogeneous Poisson process with intensity nγoj. The presented object is classified in the category coded by the first process Πmj,n among the family of processes Πmn:=(Πmj,n)j∈J to reach the threshold nθ (or not classified at all if none of the processes reaches nθ). We chose here the threshold to be proportional to n to allow the coupling to take place. Up to this modification, the decision-making process is identical to (5) and (6).

The consideration of n copies of the Poisson counter model is motivated by both mathematical and biological considerations. From a mathematical point of view, the diffusion approximation requires an increasing number of jumps of the underlying Poisson process. From a biological perspective, empirical evidence from brain recordings indicates that concepts are often encoded by coordinated groups of neurons, commonly referred to as neuronal assemblies (Singer et al. 1997; Gerstein et al. 1989). Accordingly, it is reasonable to model a given feature as being represented by multiple neurons and it seems natural that the transition between the neural scale (Poisson counter model) and behavioral scale (drift diffusion model) occurs through an increasing number of neurons. The assumption that these copies are independent is introduced solely for mathematical tractability.

The following theorem is established by means of a coupling between this model and the drift diffusion model with drift μoj=nγoj.

Theorem 2.6

Let m∈N∗, o∈O the nature of the mth object and n∈N∗. Let Πmn=(Πmj,n)j∈J a family of mutually independent Poisson processes with intensities (nγoj)j∈J. Suppose the vector γo verifies γoj>0 for every j∈J. Then there exist absolute constants a,b,c>0 and a |J|-dimensional drifted Brownian motion Wmn=(Wmj,n)j∈J defined by (1) such that for every x>0,

Psupj∈J,t≥0|Πm,tj,n-Wm,tj,n|log(nγojt∨1+1)≥a+x≤b|J|e-cx. 8

For j∈J, let us define the hitting times τn(Πj):=infu≥0;Πm,uj,n≥nθ and τn(Wj):=infu≥0;Wm,uj,n≥nθ. Let α∈(0,1) and θ>0. Consequently, there exist absolute positive constants d and e and positive constants Aθ,γmin, Bγmin, Cγmin and Dθ,γmin,‖γ‖∞ depending only on the index parameters such that if n≥Aθ,γminlog|J|α-1, then with probability more than 1-α, all the following inequalities hold jointly:

  1. The processes Πmn and Wmn verify
    supj∈J,t≥0|Πm,tj,n-Wm,tj,n|log(nγojt∨1+1)≤d+elog(|J|α-1).
  2. The hitting times (τn(Πj))j∈J verify
    supj∈Jτn(Πj)-θγoj≤Bγminlog(|J|α-1)n.
  3. The hitting times (τn(Wj))j∈J verify
    supj∈Jτn(Wj)-θγoj≤Cγminlog(|J|α-1)n.
  4. The difference between the hitting times (τn(Πj))j∈J and (τn(Wj))j∈J verifies
    supj∈J|τn(Πj)-τn(Wj)|≤Dθ,γmin,‖γ‖∞log|J|α-1log(n)n.

See Appendix C.4 for more precise version of this result.

The proof of the theorem, provided in Appendix C.4, relies on a coupling result between Poisson and Brownian processes established by Ethier and Kurtz (1986), concentration inequalities, and a novel inequality for Brownian processes that we derived.

With this theorem, we establish a coupling between the Poisson counter model and the drift diffusion model by bounding the supremum of their trajectories on all R+. Since E[Πm,tj,n]=E[Wm,tj,n]=nγojt are growing linearly with n, the bound in O(log(n)) of (8) is very strong. Note that the theorem would still hold for dependent processes Πmn=(Πmj,n)j∈J but the coupled processes Wmn=(Wmj,n)j∈J would have inherited from this dependence. Note also that the assumption γoj>0 for every j∈J is easy to satisfy: since the processes with intensity γoj=0 stay equal to zero and never reach θ, we can consider the set of processes with positive intensities instead of J.

Besides, in this framework where the threshold nθ is linear in n, we establish for every j the convergence of the hitting times of both Poisson process (Πm,tj,n)t≥0 and Brownian process (Wm,tj,n)t≥0 to θγoj, which is the hitting time of the deterministic processes (E[Πm,tj,n])t≥0 and (E[Wm,tj,n])t≥0, with rate in n-1/2. Furthermore, we prove that the difference between these two hitting times decreases faster than their convergence rate. This ensures that for large n, both models select the same category ȷ^ (the one with larger γoj), and we can apply the same bound to the difference between the reaction times of the two models: we have

τ(Π)-τ(W)=τn(Πȷ^)∧T-τn(Wȷ^)∧T=Olog(n)n

with high probability. This result explains in particular how reaction times that are modeled by Poisson counter processes, and which are more biologically relevant, might exhibit a behavior like the DDM and have therefore similar adequation to real data.

Hawkes counter model

Framework

In this section, we want to model a different decision-making task: the participant does not have prior knowledge about the categories anymore. Similarly as before, the participant has to categorize objects having natures belonging to a set O into one of several categories belonging to a set J. The participant sees the objects sequentially and is given the true answer after each categorization, which allows for learning the categories. Therefore, unlike in the previous task, after each presentation of an object, the participant knows better the categories: the average strength of the evidence accumulation in favor of the categories will change when presented with a new object. The total number of presented objects which allow the participant to learn the categories is denoted by M, and the sequential presentation of these M objects is called a learning phase. We suppose that at the end of the learning phase, the participant has learned to recognize the object categories, and the average strength of the evidence accumulation in favor of the categories will not change anymore.

The model

We model this new experiment by a spiking neural network inspired by a previous work in discrete time and without reaction times (Jaffard et al. 2024). During the presentation of the mth object, the accumulation of evidence of the categories j∈J is modeled by a |J|-dimensional Hawkes process Nm=(Nmj)j∈J with conditional intensity λm,t=(λm,tj)j∈J defined below. This multivariate process represents the output nodes activity of a spiking neural network.

The mth object is presented for a duration of at least Tmin and until either the spike count of one of the processes of Nm=(Nmj)j∈J reaches the threshold θ, or the maximum allowed duration T>Tmin is reached. This minimal duration Tmin, which was not present in the previous sections, is here to ensure that the network learns the task and that its answers remain accurate once learning is finished. For j∈J, We denote

τ(Nj):=inf{u≥0;Nm,uj≥θ}. 9

The winning process is then

ȷ^=argminj∈Jτ(Nj), 10

and if τ(Nȷ^)<T then object m is categorized in category ȷ^. However, if τ(Nȷ^)≥T it means that accumulation evidence is not sufficient to reach a decision and the model does not categorize the object. The corresponding reaction time of the whole system is τ(N):=(Tmin∨τ(Nȷ^))∧T. Similarly as for the drift diffusion and Poisson counter models, the processes are indexed by time t∈[0,T] which is set back to 0 at each new object.

An illustration of the network is given on Figure 3 for the case of the experiment described in Section 4. The input layer codes for features describing the object natures. The set of input neurons is denoted by I, and an element i∈I denotes both an input neuron and the feature it is encoding. For instance, in the experiment of Section 4, the objects are rockets and the features are the shape of the head, body and fins and the number of flames. The output layer codes for the categories in which the objects are classified: the activity of the output neurons represents the evidence accumulation in favor of each category. Therefore, the set of output neurons is denoted by J, and an element j∈J denotes both an output neuron and the category it is coding for.

Fig. 3.

Fig. 3

Illustrative example of the network used to model the experiment described in section 4. The task is to classify rockets into two categories, j1 and j2. The input neurons code for different shapes of head, body, fins and flames. The presented object excites the input neurons coding for its features, whereas other input neurons stay silent. The output neurons start spiking with a conditional intensity depending on their connection with the input neurons. The spike train of each neuron is represented on top of it. The first spike count to reach the threshold θ is the one of neuron j1: therefore, the rocket is categorized in category j1

Input neurons activity. During the presentation of the mth object, the input neuron i∈I starts spiking as a homogeneous Poisson process (Πm,ti)t≥0 with intensity γoi≥0 depending only on the nature o of the presented object and representing how pronounced feature i is in object nature o. For instance, in the modeling of the experiment described in Section 4, we use a binary code: either the rocket has feature i and the input neuron i starts spiking with a strictly positive fixed intensity, either the object does not have the feature and the corresponding input neuron i stays silent (i.e., its intensity is equal to 0). We assume that the processes ((Πm,ti)t≥0)i∈I,1≤m≤M are mutually independent.

Output neurons activity. During the presentation of the mth object, evidence accumulation in favor of category j is modeled by the activity of the output neuron j∈J, which starts spiking as a Hawkes process (Nm,tj)t≥0, which, in contrast to the Poisson process, allows to take into account interactions with presynaptic neurons. Its conditional intensity at time t of the presentation of the object is given by:

λm,tj:=∑i∈I∫0twmi→jg(t-s)dΠm,si

where g∈L1(R+) is a non negative function and wmi→j≥0 is the synaptic weight between input neuron i and output neuron j: it represents the strength of their connection during the presentation of the mth object. We denote by ‖g‖1:=∫0∞g(s)ds the norm of g. The weights wmj:=(wmi→j)i∈I are in the simplex: for every i∈I, wmi→j≥0 and ∑i∈Iwmi→j=1, and they may be seen as a probability distribution over the set of presynaptic neurons of j. We denote by wm:=(wmj)j∈J the total weight family. Note that here, we are in the special case of a multivariate Hawkes process without self-interactions (but with mutual interactions).

Learning rule. The network learns by updating its synaptic weights after each presented object by using an expert aggregation algorithm (Cesa-Bianchi and Lugosi 2006) thanks to this local paradigm: each presynaptic neuron i can be seen as an expert and the strength of the connection wmi→j between i and the postsynaptic neuron j varies based on gains derived from these connections. After the presentation of the mth object, the postsynaptic neuron j attributes the following gain to the presynaptic neuron i:

gmi→j=γmi^×MMjifo∈j-γmi^×MM′×1|J|-1ifo∈j′≠j

where o is the nature of the presented object, Mj is the total number of presented objects belonging to category j during the learning phase and

γmi^:=Πm,Tmini/Tmin 11

is the empirical firing rate of input neuron i during duration Tmin. This gain can be interpreted as follows: if the presented object belongs to category j, neuron j should spike frequently to be the first to reach the threshold θ. Therefore, it assigns positive gains to its presynaptic neurons, with these gain being proportional to their firing rates, thereby strengthening its connections with the input neurons that encode the most relevant features describing category j. Conversely, if the presented object does not belong to category j, neuron j should spike less to avoid reaching the threshold θ before the neuron coding for the object’s true category. In this case, it assigns negative gains (i.e., losses) to its presynaptic neurons in order to reduce the strength of its connections with the most active neurons when presented with objects it should not encode. Note that neuron j does not need to know what the other neurons j′ are doing to attribute the gains. Also note that the gain depends on the ratio M/Mj, that is roughly speaking the proportion of objects in each category, and the larger Tmin, the better the estimation of the input neurons firing rates.

We denote by Gmi→j:=∑m′=1mg′i→j the cumulated gain of input neuron i w.r.t. output neuron j until the mth object. Then after the presentation of the object, the weights of neuron j are updated using the expert aggregation EWA (Exponentially Weighted Average) (Cesa-Bianchi and Lugosi 2006):

wm+1i→j:=exp(ηGmi→j)∑l∈Iexp(ηGml→j) 12

where the parameter η>0 is called the learning rate and determines how fast the network learns. In what follows, we choose

η=η0Mwhereη0>0. 13

Note that this learning rule is local: the gains used by neuron j and therefore the update of the synaptic weights depend only on the activity of its presynaptic neurons.

We denote by Fm the σ-algebra generated by every event which happened until the end of the presentation of the mth object and F0 the trivial σ-algebra. Note that the weights wm+1i→j are Fm-measurable.

Additions over the previous model. This new version differs from the model that we proposed in Jaffard et al. (2024) by two main features. In this previous work, the neurons activities were defined in discrete time, and every object was presented during a fixed duration: the presented object was classified in the category of the output neuron with the highest spike count at the end of the presentation. Here, the neurons activities are defined in continuous time and the objects are presented for dynamic durations. To model behavior, we introduced a threshold and a limit duration, which allowed to model participant reaction times and the possibility that the participant will not decide between the different categories if not enough evidence has been accumulated.

Comparison with the Poisson counter model and interpretation. Similarly to the Poisson counter model, the evidence accumulation in favor of the different categories are interpreted as spike counts of neurons coding for these categories. However, unlike the Poisson counter model, the intensities of the output neurons are not given arbitrarily as prior knowledge about the categories, but are learned with a local rule as the network sees new objects. Our model can have the following interpretation: the input layer is a Poisson counter model which can recognize simple features, and an output layer is added and trained to recognize more complex concepts. This is biologically relevant since in the brain, elementary concepts can be depicted by the responses of individual neurons, whereas more intricate ones are represented by groups of interconnected neurons that work together (Singer et al. 1997).

Mathematical analysis

In this section, we establish theoretical guarantees for our model. We begin by analyzing the asymptotic behavior of the network weights, which provides insights into the network behavior after the learning phase. Next, we outline the conditions necessary for the network to accurately categorize new objects following the learning process. This successful performance stems not from prior knowledge of the categories but from the learning phase itself. Finally, we demonstrate that the drift diffusion model can be derived from our model, establishing that it can be approximated by complex networks of interacting neurons having a learning mechanism.

Asymptotic behavior

Let us study the network’s asymptotic behavior. We introduce a notation: given a set E and a quantity xe∈R indexed by e∈E, we denote its mean by ⟨xe⟩e∈E:=1|E|∑e∈Exe.

Definition 3.1

(Feature discrepancy) Let i∈I and j∈J. The feature discrepancy of input neuron i w.r.t. output neuron j is

di→j:=⟨γoi⟩o∈j-⟨⟨γoi⟩o∈j′⟩j′∈J\{j}.

The feature discrepancy of input neuron i w.r.t. output neuron j measures how sensible neuron i is to category j by comparing its average firing rate when presented with objects of category j to its average firing rate when presented with objects of other categories. We can now define the set of input neurons which are the most sensible to category j by Ij:=argmaxi∈Idi→j, as well as the gap in discrepancy when Ij⊊I

δj:=maxi∈Idi→j-maxi∈I\Ijdi→j

which measures how sensible the best input neurons are with respect to the others.

Assumption 3.2

During the learning phase, each nature o has been presented the same amount of times to the network, i.e.,  M|O| times.

Proposition 3.3

Let α∈(0,1) and γmin:=mino∈O,i∈I{γoi;γoi>0}. Suppose Assumption 3.2 holds. For j∈J, let w∞j=(w∞i→j)i∈I the weight family such that w∞i→j:=1|Ij|1{i∈Ij}. Then there exist positive constants A|O|,γmin and B|O|,η0,‖γ‖∞ depending only on the index parameters such that if

MTmin≥A|O|,γminlog(|I||J|α-1)

then with probability 1-α, at the end of the learning phase, the synaptic weights verify for all j∈J

wM+1j-w∞j2≤B|O|,η0,‖γ‖∞|I|Tminlog(|I||J|α-1)+1{Ij⊊I}|I|3/2exp(-η0δjM),

where η0 is defined by (13).

See Appendix 1 for a version of this result with exact constants.

In Proposition 3.3, we prove that the network weights converge to a limit family w∞:=(w∞i→j)i∈I,j∈J and we provide rates of convergence. The error is twofold. The first part, in O(1Tmin) where Tmin is the minimum duration for which an object is presented, comes from the randomness of the system and is derived using concentration inequalities to control how good is the estimation of γoi by γmi^ (11). The second part, in exp(O(-δjM)) where M is the number of objects presented during the learning phase, comes from the use of the expert aggregation algorithm EWA: the larger the gap in discrepancy, the faster the convergence. This limit family has the following interpretation: at the limit, output neuron j is connected only and with equal strength to input neurons which are the most sensible to category j.

Note that this asymptotic analysis is feasible because the weight-update rule has a simple form. To our knowledge, no comparable results exist for learning rules such as Spike-timing-dependent plasticity (STDP), for which the update formulas are more complex.

This result can be compared to Theorem 3.4 of Jaffard et al. (2024) which describes the asymptotic behavior of the network in discrete time with fixed object presentation durations. The present error has the same order of magnitude, where the number of time steps of each presented objects is replaced by the minimum duration of each object presentation Tmin.

Theoretical guarantees

At the limit (M and Tmin tend to infinity), the network’s weights are the deterministic family w∞ given by Proposition 3.3. For o∈O, let

λ¯∞,oj:=∑i∈Iw∞i→jγoi

which is the asymptotic average firing rate of neuron j when objects with nature o are presented. Therefore, the average number of spikes of neuron j on [0, t] with weights w∞j when presented with an object of nature o is

λ¯∞,ojG(t)

where G:t↦∫0t∫0sg(s-u)duds. Hence, on average, the first neuron whose spike count reaches threshold θ is the one with highest λ¯∞,oj. This leads to the following new notion of margin. Let Δλ>0.

Assumption 3.4

(Margin(Δλ)) For every category j∗∈J, for every j≠j∗, for every object nature o∈j∗ we have

λ¯∞,o∗>λ¯∞,oj+Δλ.

It means that at least in the limit the same gap as the ones for DDM and Poisson counter model holds. Since we explicitly know the limit family w∞, this assumption can be interpreted as a condition on the categories j∈J and the features represented by the input neurons i∈I. This condition holds when the categories can be described as combinations of relevant features. In Section 4.4, we prove that this assumption is satisfied in the task performed by the participants of the experiment. For a detailed characterization of the categories learnable by the discrete time network, we refer the reader to Section 4.2.4 of Jaffard et al. (2026), where we describe the categories learnable by an extended version of our network that includes hidden layers, but no reaction time.

This assumption can be related to Assumption 2.2 (Margin(Δμ)) on the drift of the DDM and Assumption 2.4 (Margin(Δγ)) on the intensities of the Poisson counter model. Indeed, similarly as in the theoretical studies of these two models, we need an assumption on the average evidence accumulation in favor of the several categories. However, unlike for the DDM and the Poisson counter model, this assumption does not reflect prior knowledge on the categories, but the ability of our network to code for the categories. It is only after the network has learned that it reaches these firing rates.

Under these assumptions, we can formulate the following result.

Theorem 3.5

Let α∈(0,1) and η0>0, and G:t↦∫0t∫0sg(s-u)duds. Let Δλ>0 and suppose Assumptions 3.2 and 3.4 (Margin (Δλ)) hold. There exist positive constants Aη0,δmin,‖γ‖∞,Δλ,Bη0,‖γ‖∞,Δλ,|O|,C‖γ‖∞,Δλ,‖g‖1,D‖γ‖∞,Δλ,‖g‖1,EΔλ and F‖γ‖∞,‖g‖1 depending only on the index parameters such that if the parameters M, Tmin, T, and θ verify

M≥Aη0,δmin,‖γ‖∞,Δλlog(|I|)2 14

where δmin:=minj∈Jδj,

Tmin≥Bη0,‖γ‖∞,Δλ,|O||I|2log|I||J|α-1 15
G(T)>C‖γ‖∞,Δλ,‖g‖1log(|J|α-1) 16
θ≥D‖γ‖∞,Δλ,‖g‖1log(|J|α-1)∨G(Tmin) 17

and

θ<EΔλG(T)-F‖γ‖∞,‖g‖1G(T)log|J|α-1+log|J|α-1, 18

then with probability larger than 1-α, we have that for all nature o∈O of the object presented after the learning phase, that is the M+1 object, if we denote by j∗ its category, the choice ȷ^ (10) and the reaction time τ(Nȷ^) (9) satisfy

ȷ^=j∗andτ(Nȷ^)<T.

See Appendix C.6 for a more precise version of this result.

This theorem provides conditions on the minimal duration Tmin, maximal duration T, number of presented objects during the learning phase M and threshold θ required for the model to correctly categorize objects after learning. Let us start by commenting on these conditions.

  1. Sufficient learning phase duration: The network effectively learns the categories if M verifies (14), ensuring a long enough learning phase.

  2. Sufficient minimal observation time for learning objects: The network has sufficient time to infer the input neurons firing rate to update its synaptic weights if Tmin verifies (15).

  3. Sufficient maximal observation time: The network has sufficient time to detect differences in spike counts between the true category process NM+1∗ and others if T verifies (16).

  4. Sufficient threshold: The spike count difference between the true category process NM+1∗ and others is significant at decision time if θ verifies (17).

  5. Sufficiently low threshold: The network has a sufficiently low threshold to be able to take a decision before limit duration T if θ verifies (18).

Note that we always have G(t)≤‖g‖1t and if the function g has compact support of negligible length with respect to T, as it is assumed in the following section, then G(T)≈‖g‖1T. In this case, the upper bound on θ (18) has the same order of magnitude regarding the limit duration T as those in Theorem 2.3 for the DDM and Theorem 2.5 for the Poisson counter model, i.e., in O(T). It is reasonable to make such an assumption because a participant’s reaction time is typically around a few seconds and in practice we chose T=5s in the experiment described in Section 4, whereas the effect of a presynaptic neuron’s spike on a postsynaptic neuron, represented by the support of the function g, lasts only a few milliseconds.

The same way as for the constant Δμ quantifying the larger drift for the DDM and the constant Δγ quantifying the larger gap in intensity for the Poisson counter model, here, the value of the constants given in Appendix C.6 indicate that the larger Δλ, i.e., the larger the gap between the limit firing rate of the output neuron coding for the true category and the other output neurons, the larger the size of the thresholds interval enabling a correct categorization with high probability. Similarly as in Theorem 2.3, we need the maximal duration T to be sufficiently large (16) and unlike in Theorems 2.3 and 2.5 where there was no learning mechanism, additional assumptions are needed here regarding Tmin and M to ensure a correct learning. Note that all these assumptions become weaker as Δλ increases.

The proof, detailed in Appendix C.6, relies on several key components. First, concentration inequalities are employed to prove that the processes (NM+1,tj)t≥0 are closely approximated by their compensators. Proposition 3.3 is then used to show that these compensators are close to the average spike counts with limit weights. Finally, Assumption 3.4 is applied to derive conditions under which the network correctly categorizes the new object.

Coupling between the Drift Diffusion Model and the Hawkes Counter Model

Similarly as for the Poisson counter model (Section 2.4), we can build a coupling between the processes given by the drift diffusion model and the Hawkes counter model under a certain framework. Here, we work conditionally to what happened until object m, whether it is during learning or post learning: the synaptic weights wmi→j are therefore assumed to be deterministic. For the same reasons as in Section 2.4, we suppose that we dispose of n independent copies of the network, and each independent network is governed by the same weights (wmi→j)i∈I,j∈J. During the presentation of object m, for each feature i, there are n input neurons spiking as a Poisson processes with intensity γoi where o is the nature of object m: we denote by (Πm,ti,n)t≥0 the sum of their count, which is a Poisson process with intensity nγoi by independence. In the same way, there are n output neurons coding for the same category j∈J. The evidence in favor of category j is then the sum of their counts and is denoted (Nm,tj,n)t≥0, which is a Hawkes process with intensity

λm,tj,n=∑i∈I∫0twmi→jg(t-s)dΠm,si,n. 19

Note that two other frameworks lead to the same processes: only one network of size |I|×|J| with input neurons intensities (nγoi)i∈I,o∈O, but also one network with n×|I| input neurons and only |J| output neurons.

During the presentation of the mth object, the average evidence accumulation in favor of category j at present time t of object m is then

E[Nm,tj,n]=nλ¯mjG(t)

where λ¯mj:=∑i∈Iwmi→jγoi with o the nature of the presented object.

Theorem 3.6

Let α∈(0,1), m∈N∗, n∈N∗ and o∈O the nature of the mth object. Let Nmn=(Nmj,n)j∈J be a |J|-dimensional Hawkes process with intensity function defined by (19) and let λ¯min:=minj∈Jλ¯mj. We assume that the function g has compact support included in [0,n-1/2], that its norm ‖g‖1 does not depend on n, and that λ¯min>0. Then there exist positive constants A‖γ‖∞,‖g‖1,λ¯min,θ,B‖g‖1,‖γ‖∞,C‖γ‖∞,‖g‖1,λ¯min,θ,D‖γ‖∞,‖g‖1,λ¯min,θ and E‖γ‖∞,‖g‖1,λ¯min,θ depending only on the index parameters such that if n≥A‖γ‖∞,‖g‖1,λ¯min,θlog(|I|+|J|)α-13/2, then there exists a |J|-dimensional drifted Brownian motion with correlated noise Wmn=(Wmj,n)j∈J with mean vector defined by ∀j∈J,∀t≥0,E[Wm,tj,n]=nλ¯mjG(t), and covariance matrix defined by ∀j1,j2∈J,∀t,s≥0,

Cov(Wm,tj1,n,Wm,sj2,n)=n(t∧s)∑i∈Iwmi→j1wmi→j2γoi+1j1=j2‖g‖1λ¯m1

such that with probability more than 1-α, all the following inequalities hold jointly.

  1. The processes ΠmnNmn and Wmn verify
    supj∈J,t>0Nm,tj,n-Wm,tj,nn1/4(t∨1)1/4log(nt+1)3/4≤B‖g‖1,‖γ‖∞log|I|+|J|α3/4. 20
  2. The hitting times (τn(Nj))j∈J defined for j∈J by τn(Nj):=inf{u≥0;Nm,uj,n≥nθ} verify
    supj∈Jτn(Nj)-θλ¯mj‖g‖1≤C‖γ‖∞,‖g‖1,λ¯min,θlog|I|+|J|α3/4n-1/2.
  3. The hitting times (τn(Wj))j∈J defined for j∈J by τn(Wj):=inf{u≥0;Wm,uj,n≥nθ} verify
    supj∈Jτn(Wj)-θλ¯mj‖g‖1≤D‖γ‖∞,‖g‖1,λ¯min,θlog|J|α-1n-1/2.
  4. The difference between the hitting times (τn(Nj))j∈J and (τn(Wj))j∈J verifies
    supj∈J|τn(Nj)-τn(Wj)|≤E‖γ‖∞,‖g‖1,λ¯min,θlog|I|+|J|α3/4log(n)n3/4. 21

This theorem, established by means of a coupling between the Hawkes counter model and the drift diffusion model, enables to bound the supremum of their trajectories over all R+.

The proof, provided in Appendix C.7, builds on the same coupling result between Poisson and Brownian processes established by Ethier and Kurtz (1986), which we previously used to prove Theorem 2.6 and new inequalities that we derived for Brownian and Hawkes processes.

To achieve this, we had to assume that λ¯min>0, i.e., that λ¯mj>0 for every j∈J. This is easy to satisfy: indeed, if λ¯mj=0, it means that neurons coding for category j are not linked to any input neuron currently active, therefore we are in the non interesting case where the process Nmj,n stays equal to zero and never reach nθ. We can then consider the set of processes such that λ¯mj>0 instead of J with no loss of generality. We also had to assume that g has compact support decreasing at a rate of n-1/2. This implies that the number of spikes influencing a group of n neurons encoding the same category j does not scale linearly with n, as it would if g had a fixed support, but rather grows at a rate of n1/2. This assumption further ensures that G(t)≈‖g‖1t, meaning the mean vector of the drifted Brownian motion given by the theorem closely resembles that of classical diffusion processes. Unlike in the model described in Section 2.2 and in Theorem 2.6, where we established a strong approximation result between the DDM and the Poisson counter model, the drift μmj:=nλ¯mj of process Wmj,n does not depend only on the nature o of the presented object, but also on the presentation number m through its dependency in the weights wmj. The covariance matrix of the process Wmn is also not diagonal: the processes of (Wmj,n)j∈J are correlated, reflecting the natural dependencies within neural networks. They can be expressed as solutions of the |J|-dimensional stochastic differential equation, which is defined for each process j as follows:

dWm,tj,n=nλ¯mjdG(t)+nλ¯mj‖g‖1dBtj+∑i∈Iwmi→jnγoidBti.

Each Btj represents an independent noise source, while the collection (Bti)i∈I introduces correlated noise terms across all processes. This correlation arises from the shared influence of the same input neurons on each output neuron in our model. The obtained bound on the trajectories (20) is in O(n1/4log(n)3/4), which is less tight than the O(log(n)) bound established in Theorem 2.6 for the trajectories of the Poisson counter model and the drift diffusion model. This is due to the greater complexity of the Hawkes counter model.

Besides, similarly as in Theorem 2.6 for Poisson and Brownian processes, we establish for every j the convergence of the hitting times of both Hawkes process (Nm,tj,n)t≥0 and Brownian process (Wm,tj,n)t≥0 to θλ¯mj‖g‖1, which is the hitting time of the deterministic processes (E[Nm,tj,n])t≥0 and (E[Wm,tj,n])t≥0. However, unlike in Theorem 2.6 where the limit hitting time depends on prior knowledge γoj, here the limit hitting time depends on wmj, i.e., on the learning stage of the model. Furthermore, we prove that the difference between these two hitting times decreases faster than n-1/2, which is an upper bound on their respective convergence rate to their common limit. The resulting bound (21) is less tight than the similar bound of Theorem 2.6 due to the fact that the bound on the trajectories (20) is also less tight in this case.

Therefore, this theorem ensures that both models select the same category ȷ^, and we can apply the same bound to the difference between the reaction times of the two models: we have

τ(N)-τ(W)=(Tmin∨τn(Nȷ^))∧T-(Tmin∨τn(Wȷ^))∧T=Olog(n)n3/4

establishing that both models provide similar reaction times and categorizations.

Consequently, this theorem confirms that the dynamics of evidence accumulation for category decisions are similar in both models. Extending beyond the results established in Section 2.4, this finding demonstrates that DDMs can emerge from complex models of interacting spiking neurons with a learning mechanism. This provides new insights into the biological interpretation of DDMs and supports the idea that the prior knowledge assumed in these models can arise through a learning process.

Note that this result is more general than the setting considered in the preceding sections. First, it provides a bound on the difference between the trajectories of the two models over all of R+, and thus does not rely on either the maximal duration T or the minimal duration Tmin introduced in the Hawkes counter model. Second, it applies to any deterministic choice of weights (wmi→j)i∈I,j∈J; in particular, the weights may arise from a different learning rule, such as STDP.

The experiment

To validate our model, we designed a categorization task in the form of an online video game, accessible at https://3ia-demos.inria.fr/mel/en/. The goal of the game was for participants to learn which rockets displayed on the screen were capable of reaching the moon and which were not. We opted for a video game format rather than a classical categorization task to make the activity more engaging, particularly for younger participants. The game was coded to allow flexibility in the difficulty of the categorization task. For this experiment, participants were presented with the easiest level (details provided in the Stimuli and Categories Section 4.2).

Participants

A total of 99 participants, including 45 middle school students and 54 undergraduate students, were recruited for the study. Middle school students (23 male, 22 female) ranged in age from 11 to 15 years (M = 12.13, SD = 1.15), while undergraduate students were all aged between 18 and 25. All participants reported normal or corrected-to-normal vision. The study was approved by the ethics committee of Université Côte d’Azur and was conducted in accordance with relevant guidelines and regulations (ethics approval number 2022-098). All participants provided informed consent prior to participation. Participants were recruited via one of their teachers. Middle school students performed the task at school whereas undergraduate students performed it at home.

Stimuli and categories

The set of stimuli consisted of 16 unique rockets, each defined by four characteristics, with two possible features for each: the shape of the head (sharp or round), the shape of the body (straight or round), the shape of the fins (straight or curved), and the number of flames (one or three). These rockets are illustrated in Figure 4. As mentioned above, participants were administered the easiest level of the categorization task. At this difficulty level, the categories were formed based on a single characteristic selected randomly at the beginning of the task. Rockets were divided into two groups: those with one feature of the chosen characteristic and those with the alternative feature. For example, if the selected characteristic was the shape of the head, rockets with a sharp head were categorized as capable of landing on the moon, while rockets with a round head were categorized as unable to land on the moon. Alternatively, rockets with a round head could also have been assigned to the “capable of landing on the moon" category, as the assignment was made randomly. From these two categories, five rockets from each group were randomly selected, resulting in 10 unique rockets presented during the learning phase. The remaining six rockets were used in the transfer phase.

Fig. 4.

Fig. 4

The 16 objects

Procedure

Participants performed the task on a computer. Middle school students were supervised by their teachers, and undergraduate students performed the task at home. Prior to the experiment, participants completed a series of demographic questions and received detailed instructions on how to perform the task. The experiment consisted of two phases: a learning phase and a transfer phase. In the learning phase, participants were asked to determine which rockets were capable of landing on the moon and received immediate feedback on the correctness of their responses. Stimuli were presented one at a time at the center of the screen for 5 seconds. To help participants track time, a clock icon was displayed. After viewing each stimulus, participants made their decision by selecting one of two buttons labeled ‘Yes’ or ‘No’ to indicate whether the rocket could land on the moon. Upon selecting a button, feedback on the correctness of the response was presented for 2 seconds, including a visual cue in the form of a green checkmark for correct responses or a red cross for incorrect ones. Additionally, an animation briefly depicted whether the rocket was able to land on the moon. If participants did not provide a response within 5 seconds, a ‘time is up’ icon appeared on the screen. To reinforce learning, a progression bar was displayed at the top left of the screen, with a green checkmark appearing each time a correct response was given. Participants were required to correctly classify 15 consecutive rockets to pass the learning phase. The 10 unique rockets were presented in a random order and repeated until the participant reached the learning criterion, with a new random order at each repetition. After the learning phase, participants proceeded to the transfer phase, where they were instructed to classify new rockets that had not been presented in the learning phase. Stimuli were presented in the same manner as in the learning phase. In this phase, six new rockets were presented three times in a random order, resulting in a total of 18 trials. No feedback was provided during the transfer phase. Participants could choose to withdraw from the experiment at any time by selecting a cross icon located at the top left of the screen.

Modeling

We modeled this experiment with the model as described in Figure 3. Object natures are separated between a set of learning natures Ol containing the 10 learning rockets and a set of transfer natures Otr containing the 6 transfer rockets. The set of feature I contains the 8 possible features of the rockets (two shapes for the head, two shapes for the body, two shapes for the fins and two possible type of flames). The two categories denoted j1 and j2 are characterized by a certain characteristic declined in two features i1 and i2∈I: every object nature o has either feature i1 or feature i2, and category j1 contains every nature o with i1 whereas category j2 contains every nature o with i2.

When an input neuron i is presented with a rocket having nature o∈Ol∪Otr, it starts spiking with intensity γoi:=1{object o hasfeaturei}γ with γ>0. In other words, input neuron i spikes with firing rate γ if the object has feature i and stays silent otherwise.

Proposition 4.1

For the set of object natures Ol and input neuron intensities γI defined above, the sets defined in Proposition 3.3 are Ij1={i1} and Ij2={i2}, and the limit family w∞ verifies Assumption 3.4: it enables to categorize well the objects and we can choose any constant in (0,γ) for Δλ.

Analysis

To analyze the learning behavior of participants, we infer two parameters of our model for each participant: the learning rate η which is used to update the synaptic weights as described in (12) and indicates the participant’s learning speed, and the threshold θ, which reflects their response speed. For this estimation, we employ the Simulation-Based Inference method (Papamakarios et al. 2016) and we use data from both the learning phase and the transfer phase. This approach is tailored for models whose likelihoods are intractable but which can nonetheless be simulated. The process involves providing the model as a probabilistic program that is easy to simulate, along with a prior distribution over the parameters to be estimated. A Bayesian neural network is then trained via maximum likelihood on samples generated by the program, enabling the learning of a posterior distribution from which samples can be drawn. To simulate data for the transfer phase, we freeze the weights at their final update, wM+1j, as participants have already completed learning to categorize the objects. Because the lengths of participant data and simulated data did not always match, we extended the transfer phase data by appending the mean answer time of the transfer phase. This ensured that the data had the required length for applying the SBI method. We denote by η^ and θ^ the median value of samples of the posterior given by the SBI method for each participant. The method is illustrated using both simulated and real data in Figures 5 and 6, respectively. On simulated data, the method accurately recovers the true parameters, although with a positive bias noticeable on the histograms of sample 2.

Fig. 5.

Fig. 5

Samples of the posteriors given by the SBI method for two sets of simulated data. The prior used for the parameters tuple (η,θ) is a uniform distribution on [0.09,2]×[0.04,0.2]. In red, the true values of η and θ used to simulate data. In blue, the histogram of the values η^ and θ^ given by the posteriors given by the SBI method

Fig. 6.

Fig. 6

Samples of the posteriors given by the SBI method for three sets of real data. The same priors as the ones of Figure 5 are used for the SBI method

Single participant analysis

In Figure 7, the cumulative answer times as a function of the number of answers are compared to simulated cumulative answer times for six participants, using parameters estimated by the SBI method. Here, we used data from both the learning and transfer phase. The results indicate that the method predicts answer times accurately.

Fig. 7.

Fig. 7

For each participant, the blue curve represents the cumulated answer times in function of the number of presented objects. The orange curves represent the median of the cumulated answer times of 100 simulations of the model with confidence interval of level 10%, with parameters η^ and θ^ being the median value of samples of the posterior given by the SBI method. The same priors as the ones of Figure 5 are used for the SBI method

To see more precisely if one data simulation given by our network is close to real data, we represented the answer times of three participants (on top) and of three sets of simulated data (on the bottom) during the learning phase, using parameters inferred by the SBI method on Figure 8. Each blue tick represents a correct answer, and each red tick represents a wrong answer. The model again predicts answer times similar to those of the participants, albeit with greater regularity. However, it sometimes seems to make fewer errors than the participants, as in the case of participant 5. This can be attributed to the model’s reliance on synaptic weight updates: once sufficient weight has been assigned to relevant feature neurons, the probability to make a mistake diminishes significantly. In contrast, humans may continue to make errors even after grasping the underlying rule because of other cognitive phenomena such as distraction. This difference also explains why the model sometimes underestimate the total number of answers during the learning phase. Each error resets the count of consecutive correct answers to zero, requiring the participant to categorize at least 15 new objects to complete the learning phase. Consequently, each mistake significantly elongates the learning phase.

Fig. 8.

Fig. 8

On the top, answer times of three participants during their learning phase. Blue ticks represent correct answers while red ticks represent wrong answers. On the bottom, same plots for simulated data with parameters η^ and θ^ being the median value of samples of the posterior given by the SBI method for each participant. The same priors as the ones of Figure 5 are used for the SBI method

Group analysis

Figure 9 presents histograms of the parameters inferred by the SBI method, grouped by participants’ current educational level (middle school or university) and for all participants combined. The learning rate η appears to take either low or high values, with middle school students exhibiting more extreme values compared to university students. In contrast, the histograms for the parameter θ show little variation across the different groups.

Fig. 9.

Fig. 9

Histogram of median values of the parameters η^ and θ^ given by the SBI method with on the left, every participant, on the middle, middle school students and on the right, undergraduate students. The parameters used for the SBI method are the same as in Figure 5

To conduct a more detailed analysis, we applied k-means clustering to the two-dimensional data consisting of the parameters η^ and θ^ estimated by the SBI method for each participant. The optimal number of clusters was determined using the silhouette method (details are provided in Appendix B), which suggested two reasonable options: 2 or 3 clusters. Figure 10 illustrates the results of the k-means algorithm applied to the estimated parameters η^ and s^ for both 2 and 3 clusters.

Fig. 10.

Fig. 10

On the left, s^ as a function η^ for every participant, where θ^ and η^ are the median values given by the SBI method. On the right, 3-means clustering of the same data. On the bottom, students distribution by cluster. The parameters used for the SBI method are the same as in Figure 5

Clustering with 2 clusters. Cluster 0 is characterized by a low learning rate and threshold. It corresponds to participants who learn at an average or slower pace and require less evidence to make a categorization decision. This cluster includes 51% of middle school students and 63% of undergraduate students. Cluster 1, on the other hand, has a high learning rate and a slightly above-average threshold. It represents fast learners who require a higher accumulation of evidence before categorizing and comprises 49% of middle school students and 37% of undergraduate students.

A chi-square test was conducted to assess whether cluster membership is independent of the participants’ current educational level. The test yielded a p-value of 0.33, which is insufficient to reject the null hypothesis, indicating no significant evidence of dependence.

Clustering with 3 clusters. Clusters 0 and 1 retain approximately the same centers as in the 2-cluster analysis. Cluster 0 includes 18% of middle school students and 32% of undergraduate students, while cluster 1 comprises 47% of middle school students and 27% of undergraduate students. Cluster 2, primarily derived from points in the former cluster 0 along with a few from cluster 1, has a center characterized by a low learning rate and an average threshold. This cluster represents participants who learn at an average or slower pace and require a moderate accumulation of evidence before categorizing, encompassing 35% of middle school students and 41% of undergraduate students.

A chi-square test was conducted to evaluate whether cluster membership is independent of current educational level. The test resulted in a p-value of 0.11, which, while not statistically significant, provides some indication that cluster membership might depend on the current level of study. Specifically, slow-learning participants requiring less evidence to categorize appear more frequently among undergraduate students, while fast-learning participants requiring higher evidence accumulation tend to be more prevalent among middle school students.

Finally, we examined the relationship between the threshold estimated by the SBI method and each participant’s average answer time during the learning phase, as shown in Figure 11. The results indicate that the average answer time appears to increase linearly with θ^, which is consistent with the model predictions.

Fig. 11.

Fig. 11

Average answer time of each participant during the learning phase (including the 15 objects to categorize perfectly) as a function of θ^. The parameters used for the SBI method are the same as in Figure 5

Conclusion

This paper outlines key elements that establish a connection between drift diffusion models (DDMs), commonly used in cognitive science to simulate decision-making tasks, and biologically plausible networks of spiking neurons. First, we conducted a mathematical analysis of both the drift diffusion model and the Poisson counter model, specifying explicit conditions under which these models yield accurate decisions. This analysis demonstrated the similarity in their behavior. Subsequently, we established a coupling result between the processes of the two models and derived a bound on their hitting times, confirming that both models produce comparable reaction times and decisions. These findings represent an initial step towards demonstrating that DDMs can be derived from spiking neuron-based models.

To go further and in order to establish that DDMs can be derived from biologically realistic networks of spiking neurons which can learn to make correct decisions, we proposed a novel spiking neural network model tailored for decision-making task which is provably close to the drift diffusion model. Unlike the drift diffusion and Poisson counter models, the model does not assume any prior knowledge of the categories; its accuracy emerges from a learning phase. Additionally, the model is more biologically relevant than the Poisson counter model, as it incorporates interacting spiking neurons that learn to represent complex concepts, rather than individual neurons directly encoding decisions. We conducted an asymptotic analysis of the network’s behavior and identified conditions under which it achieves accurate decisions. Moreover, we established a coupling result between our model and the DDM, providing strong evidence for the biological plausibility of DDMs and validating their widespread use in cognitive science. In the literature, coupling between Poisson and Brownian processes are well-known results. However, coupling between Hawkes and Brownian processes are less known. Recent results have been obtained in one dimension (Besançon et al. 2024) or for mean field limit of systems of interacting neurons (Erny et al. 2023). However, to the best of our knowledge, this is the first time such a result has been established for a network with a “perceptron”-like structure.

Additionally, we developed a cognitive experiment to evaluate our model’s predictions, enabling us to derive meaningful insights into the participant’s cognitive behavior and demonstrating the practical applicability of our model.

This study represents an important advancement in incorporating biologically relevant neural mechanisms into cognitive models, allowing us to better understand how neural dynamics lead to certain behaviors. There are several promising avenues for further improving the model. We showed that the model tends to produce more regular reaction times and make fewer errors compared to humans, highlighting the potential value of exploring ways to make it more realistic. Additionally, applying our model to more complex experiments could provide valuable insights into intricate behaviors. This seems feasible, as we showed in Jaffard et al. (2026) that introducing hidden layers enables the modeling of more complex concepts. Finally, an ambitious direction for future research would be to extend this work to other spiking neural networks, thereby demonstrating that DDMs can be approximated by alternative network types commonly used in neuroscience.

Supplementary information

The code and data used to produce the numerical results can be found at the following link https://github.com/SophieJaffard/MEL.

Acknowledgements

We thank the 3iA institute, and particularly Stéphane Petiot for implementing our experiment. We thank Valérie Lemesle, Sébastien Kerner, Noé Szymczak and Maëva Lossouarn for presenting the experiment to their students, and we also thank all the students who participated. This research was supported by the French government, through CNRS (eXplAIn and Algernon CNRS PRIME labelled teams), the UCAJedi and 3iA Côte d’Azur Investissements d’Avenir managed by the National Research Agency (ANR-15 IDEX-01 and ANR-19-P3IA-0002), directly by the ANR project ChaMaNe (ANR-19-CE40-0024-02), and by the interdisciplinary Institute for Modeling in Neuroscience and Cognition (NeuroMod). This project has received financial support from the CNRS through the MITI interdisciplinary programs.

Appendix A Table of notations

For parameters p1,⋯,pk, we denote by □p1,⋯,pk any positive constant depending only on parameters p1,⋯,pk. The value of □p1,⋯,pk can change from line to line and it is not necessarily equal on both sides of an inequality.

For a,b∈R, we denote a∨b:=max(a,b) and a∧b:=min(a,b). Also when quantities have several indices, the dropping of one index corresponds to the sequence on this index. For instance, γ=(γoj)j∈J,o∈O whereas γo=(γoj)j∈J and γj=(γoj)o∈O. If two sets of indices are available, typically I and J, to avoid confusion, we use the set instead of the index. For instance, γI=(γoi)i∈I,o∈O. Also ‖‖∞ is the infinite norm.

For a set E and a quantity xe∈R indexed by e∈E, we denote by ⟨xe⟩e∈E:=1|E|∑e∈Exe its empirical mean. Table  1

Table 1.

Table of notations

Notation Description (page of introduction)
O set of object natures (page 5)
o nature of an object (page 7)
J set of categories and output neurons (page 14)
j index of an output neuron or a category (page 14)
T maximal duration of an object presentation (page 7)
m index of an object (page 7)
θ threshold (page 7)
Wm |J|-dimensional drifted Brownian motion Wm=(Wmj)j∈J (page 7)
Wm,tj evidence accumulation in favor of category j at time t of object m for the DDM (page 7)
μoj drift of the process Wmj when the nature of object m is o (page 7)
τ(Zj) hitting time of process Zmj for Z∈{W,Π,N} (pages 7, 9 and 13)
ȷ^ index of the first process to reach threshold θ (pages 7, 9 and 13)
τ(Z) reaction time of the model for Z∈{W,Π,N} (pages 7, 9 and 13)
Πm |J|-dimensional Poisson process Πm=(Πmj)j∈J (page 9)
Πm,tj spike count of neuron j on [0, t] for object m in the Poisson counter model, i.e., (page 9)
γoj intensity of output neuron j when the presented object has nature o for the Poisson counter model (page 9)
n number of neurons coding for each category in the framework of the coupling results (page 10)
M number of objects presented to the network during the learning phase (page 13)
I set of features and input neurons (page 14)
i index of an input neuron or a feature (page 14)
γoi intensity of input neuron i when presented with an object having nature o for our model (page 14)
Ij set of input which are the most sensible to category j (page 17)
γ^oi empirical firing rate of input neuron i on [0,Tmin](page 15)
Tmin minimum duration of the presentation of an object (page 13)
Nm |J|-dimensional Hawkes process Nm=(Nmj)j∈J (page 13)
Nm,tj evidence accumulation in favor of category j at time t of object m i.e., spike count of neuron j until time t (page 14)
λm,tj conditional intensity of output neuron j at time t of object m for our model (page 14)
wmi→j synaptic weight between input neuron i and output neuron j (page 16)
g self-exciting function of the Hawkes process (page 15)
ht(u) ht(u)=∫utg(s-u)ds (page 57)
G(t) G(t)=∫0t∫0sg(s-u)duds (page 19)
Λm,tj compensator of the process (Nm,sj)s≥0 at time t (page 57)
gmi→j gain of input neuron i w.r.t. output neuron j after the presentation of the mth object (page 15)
Gmi→j cumulated gain of input neuron i w.r.t. output neuron j after the presentation of the mth object ∑m′=1mg′i→j (page 16)
η=η0/M learning rate of the learning rule given by EWA ((13) page 16)
Fm σ-algebra generated by every event which happened until the end of the presentation of the mth object (page 16)
di→j feature discrepancy of input neuron i w.r.t. output neuron j (page 17)
Ij Ij:=argmaxi∈Idi→j (page 17)
δj maxi∈Idi→j-maxi∈I\Ijdi→j(page 17)
w∞i→j limit synaptic weight between input neuron i and output neuron j (page 17)
Δμ discrepancy between the drift of the true category process and the other processes for the DDM (page 8)
Δγ discrepancy between the firing rate of the true category process and the other processes for the Poisson counter model (page 10)
Δλ discrepancy between the firing rate of the true category process and the other processes for our model (page 19)

Appendix B details on the clustering analysis

The number of clusters used to perform the k-means algorithm in Section 4.7 was determined using the silhouette method implemented in scikit-learn. The silhouette plot, available in Figure 12, illustrates how well each point aligns with its assigned cluster compared to neighboring clusters. Silhouette coefficients close to 1 indicate that a sample is well-separated from neighboring clusters, while a coefficient of 0 suggests that the sample lies near the boundary between two clusters. The dotted red line represents the average silhouette score across all samples for a given number of clusters. In order to choose a meaningful number of clusters, two criteria should be respected: each clusters should have points above the average silhouette score, and the several clusters should have comparable sizes. Therefore, k=2 and k=3 are sensible choices.

Fig. 12.

Fig. 12

Silhouette analysis of the data with 2, 3, 4 and 5 clusters

Appendix C proofs

C.1 Preliminary lemmas

Lemma C.1

Let (Wt)t≥0 be a Brownian motion with drift μ and scaling σ. Let T>0,β>0. Then

Psup0≤t≤T|Wt-μt|<2Tσ2log2β≥1-β.
Proof

The process Wt-μtσ is a standard Brownian motion. Let z>0. According to Doob’s inequality (see for instance Proposition 1.5 p.53 of Revuz and Yor (1999)), we have with probability more than 1-2e-z22T that

sup0≤t≤T|Wt-μt|σ<z.

Let us choose z such that 2e-z22T=β, i.e.,  z=2Tlog2β. Then with probability more than 1-β we have

sup0≤t≤T|Wt-μt|<2Tσ2log2β.

□

The following Lemma is an adaptation of Corollary 5.2 p. 357 of Ethier and Kurtz (1986).

Lemma C.2

There exists absolute constants a,b,d>0 and a measurable function G:S(R+)×[0,1]→S(R+), with S(R+) the Skorohod space such that if (Πt)t≥0 is an homogeneous counting Poisson process of rate 1 and V is an independent uniform random variable on [0, 1], then

  • (Wt)t≥0=G((Πt)t≥0,V) is a Brownian motion starting at 0, with drift 1 and variance 1 (i.e. (Bt)t≥0 such that Bt=Wt-t is a standard centered Brownian motion), and

  • for all x>0
    Psupt≥0|Πt-Wt|log(t∨1+1)≥a+x≤be-dx.
Proof

We start with the Komlós-Major-Tusnády inequality (Komlós et al. 1975, 1976) (see Theorem 5.1 p.356 of Ethier and Kurtz (1986) for the same formulation as here) applied to the i.i.d. sequence (ξk)k∈N of Poisson r.v. with parameter 1. KMT says that there exists such a sequence as well as a Brownian motion Wt such that E(W1)=1 and Var(W1)=1 and positive constants a, b and d such that for all x>0 and all n∈N,n≥1,

P(max1≤k≤n|Sk-Wk|>alog(n)+x)≤be-dx,

with Sk=∑i=1kξi.

Remark that we can also write for all t≥0, Wt=t+Bt where (Bt)t≥0 is a standard Brownian (meaning a centered Brownian such that Cov(Bs,Bt)=s∧t).

Conditionally to all the ξk’s, one can construct a Poisson process (Πt)t≥0 such that for any k, Πk=Sk. Indeed, for each k, conditionally to each ξk, and independently of anything else, we can pick ξk i.i.d. uniform variables on [0, 1] and order them. They constitute the times of the jumps of a Poisson process (Π~tk)t∈[0,1], such that Π~1k=ξk.

Then, we define Πt=S⌊t⌋+Π~t-⌊t⌋⌊t⌋ for any t≥0. The process (Πt)t≥0 is therefore a Poisson process of intensity 1 such that for all k∈N, Sk=Πk.

Let us fix T≥0 and n=⌊T⌋. Then for all 0≤t≤T

|Πt-Wt|≤|Π⌊t⌋-W⌊t⌋|+|Πt-Π⌊t⌋|+|Wt-W⌊t⌋|≤|Π⌊t⌋-W⌊t⌋|+ξ⌊t⌋+1+ζ⌊t⌋,

with ζk=sups∈[0,1)|Wk+s-Wk|.

So

supt∈[0,T)|Πt-Wt|≤maxk=1,⋯,n|Sk-Wk|+maxk=1,⋯,n+1ξk+maxk=0,⋯,nζk.

But the ξk’s are iid variables with finite exponential moment of every order. So by union bound and Markov inequality, we have for every y≥0

P(maxk=1,⋯,n+1ξk≥y)=P(maxk=1,⋯,n+1edξk≥edy)≤(n+1)E(edξ1)e-dy.

The same holds for the ζk’s since they also have exponential moment of every order.

Therefore taking y=log(n+1)/d+x/3, and using KMT with x/3, we obtain that with probability larger than 1-(b+E(edξ1)+E(edζ1))e-dx/3,

supt∈[0,T)|Πt-Wt|≤(a+2/d)log(n+1)+x.

In other words, there exist constants a′,b′,d′ such that for all T>0

P(supt∈[0,T)|Πt-Wt|≥a′log(T+1)+x)≤b′e-d′x.

Now we want to get rid of T. We can decompose the event as follows

supt≥0|Πt-Wt|log(t∨1+1)≥y=supt∈[0,2)|Πt-Wt|log(t∨1+1)≥y∪⋃n≥1supt∈[2n,2n+1)|Πt-Wt|log(t∨1+1)≥y.

But the probability of the first event is bounded, thanks to the previous computations, by

P(supt∈[0,2)|Πt-Wt|≥ylog(2))≤b′e-d′(ylog(2)-a′log(3)),

For the other events

P(supt∈[2n,2n+1)|Πt-Wt|≥ylog(2n))≤P(supt∈[0,2n+1)|Πt-Wt|≥ylog(2n))≤b′e-d′(ylog(2n)-a′log(2n+1+1)).

But log(2n+1+1)=log(2n)+log(2+2-n)≤log(2n)+log(3) for all n≥0, so

Psupt≥0|Πt-Wt|log(t∨1+1)≥y≤b′e-d′(y-a′)log(2)+d′a′log(3)+∑n≥1b′e-d′(y-a′)log(2n)+d′a′log(3)

so the upper bounds reads

b′ed′a′log(3)e-d′(y-a′)log(2)+∑n≥12-nd′(y-a′).

If y=a′+u, with u>0, we get

b′ed′a′log(3)2-d′u+2-d′u(1-2-d′u)-1.

By taking u=1/d′+x with x>0, we get that (1-2-d′u)-1≤1/2, so that there exists a",b",d">0 such that

Psupt≥0|Πt-Wt|log(t∨1+1)≥a"+x≤b"e-d"x. C1

Now to go further, let us quote Lemma 3.12 of the Arxiv version Prodhomme (2020) of Prodhomme (2023).

Lemma C.3

Let E1 and E2 be two complete separable metric spaces and let μ be a probability on (E1×E2,B(E1)⊗B(E2)). Let μ1 be the first marginal of μ. Then there exists a measurable function G:E1×[0,1]→E2 such that if (X1,V)∼μ1⊗U([0,1]), then (X1,G(X1,V))∼μ.

Both (Πt)t≥0 and (Wt)t≥0 live in the Skorohod space DR([0,+∞)) which is separable and complete (polish). So, one can apply the lemma of Prodhomme: for any Poisson process (Πt)t≥0 with rate 1, by adding an extra uniform variable V, independent of anything else, one construct a drifted Brownian (Wt)t≥0=G((Πt)t≥0,V), such that (Πt)t≥0 and (Wt)t≥0 satisfy (C1). □

Corollary C.4

Let α>0 and (Πt)t≥0 a homogeneous Poisson process with intensity μ>0. Then there exists a Brownian motion (Wt)t≥0 with drift μ and scaling μ and absolute positive constants C,ζ,K such that

Psupt≥0|Πt-Wt|log(μt∨1+1)≥C+ζlog(Kα-1)≤α.
Proof

Let α>0. Let Πt a homogeneous Poisson process with intensity μ>0. Then Π~t:=Πμ-1t is a standard Poisson process so acccording to Lemma C.2, there exists a standard Brownian motion Bt and absolute constants a,b,d>0 such that for all x>0

Psupt≥0|Π~t-t-Bt|log(t∨1+1)≥a+x≤be-dx.

Let Wt:=Bμt+μt. Then

Psupt≥0|Πt-Wt|log(μt∨1+1)≥a+x≤be-dx.

By choosing x such that be-dx=α, i.e.,  x=1dlog(b/α), C=a, K=b and ζ=d-1 we have the result. □

The following Lemma and its proof can be found in Ost and Reynaud-Bouret (2023) (Lemma 7.1).

Lemma C.5

Let X be a Poisson random variable with parameter γ>0. For any x≥0,

P(X≥γ(1+x))≤exp-γx22(1+x3) C2

and for any 0≤x≤γ,

P(X≤γ-x)≤exp-x22γ. C3
Corollary C.6

Let α>0. Let X be a Poisson random variable with parameter γ>0. Then

  1. If γ≥2log(α-1), we have
    PX≥γ-2γlog(α-1)≥1-α. C4
  2. If γ≥83log(α-1), we have
    PX≤γ+83γlog(α-1)≥1-α. C5
  3. If γ≥83log(2α-1), we have
    P|X-γ|≤83γlog(2α-1)≥1-α. C6
Proof

1 Assume γ≥2log(α-1), then x:=2γlog(α-1) satisfies 0≤x≤γ. We apply (C3) and deduce

PX≤γ-2γlog(α-1)≤α,

and deduce (C4).

Proof of 2: Thanks to the assumption, u:=83γlog(α-1)≤γ. The inequality (C2) can be rewritten as

P(X≥γ+u)≤exp-u22γ+2u3≤exp-3u28γ.

Proof of 3: We apply (C4) and (C5) with α/2 and conclude the proof. □

Lemma C.7

Let Πt be a homogeneous Poisson process with parameter μ>0. Then for every x≥0 we have

Psup0≤t≤T(Πt-μt))≥μTx≤exp-μTx22(1+x/3).

and for every x∈[0,μT] we have

Psup0≤t≤T(μt-Πt)≥x≤exp-x22μT.
Proof

The process (Πt-μt)t≥0 is a right-continuous martingale. Let C>0,ξ>0. Then (exp(ξ(Πt-μt))t≥0 is a right-continuous submartingale. Therefore, according to the first submartingale inequality (Theorem 3.8 page 13 of Karatzas and Shreve (1998)), we have

Psup0≤t≤Texp(ξ(Πt-μt))≥C≤E[eξ(ΠT-μT)]C.

We choose C=exp(ξμTx) and mimic the proof of Lemma C.5 to obtain:

Psup0≤t≤T(Πt-μt))≥μTx≤exp-μTx22(1+x/3).

Similarly, the process (μt-Πt)t≥0 is a right-continuous martingale so for ξ>0, the process (exp(ξ(μt-Πt))t≥0 is a right-continuous submartingale. Therefore

Psup0≤t≤Texp(ξ(μt-Πt))≥C≤E[eξ(μT-ΠT)]C.

Again, we can mimic the proof of Lemma C.5 and we get the same bound for x∈[0,μT]:

Psup0≤t≤T(μt-Πt)≥x≤exp-x22μT.

□

Corollary C.8

Let β>0 and T≥83μlog(2/β). Let Πt be a homogeneous Poisson process with parameter μ>0. Then

Psup0≤t≤T|Πt-μt|)≥83μTlog(2β)≤β.
Proof

Similarly as in the proof of (C6), by combining the two inequalities given by Lemma C.7, we have that for every 0≤x≤μT

Psup0≤t≤T|Πt-μt|)≥x≤2exp-3x28μT.

Let us choose x such that 2exp-3x28μT=β, i.e.,  x=83μTlog(2β). The condition x≤μT becomes T≥83μlog(2/β). □

Lemma C.9

There exist constants c,c′,c">0 such that if (Bt)t≥0 a standard centered Brownian motion then for all x>0

Psupt,u≥0|Bt-Bu|(|t-u|+2)[log(t+1)+log(u+1)+2x]≥c≤c′e-c′′x.

This lemma resembles Lemma 6 of Chevallier et al. (2021), which is probably tighter, but is valid only for t,u≤T whereas our version is on all R+.

Proof

Remark that

supt,u≥0|Bt-Bu|(|t-u|+2)[log(t+1)+log(u+1)+2x]=supt≥u≥0|Bt-Bu|(|t-u|+2)[log(t+1)+log(u+1)+2x],

because the quantity on which we are taking the supremum is invariant by exchange of t and u.

We start from the article Robbins and Siegmund (1970), where Example 3 page 88 says that for all y>0,

Psupt≥0|Bt|(t+1)[log(t+1)+2y]≥1≤e-y. C7

Let us now look at the event

supt≥u≥0|Bt-Bu|(|t-u|+2)[log(t+1)+log(u+1)+2x]≥a=⋃n∈Nsupt≥u≥0,u∈[n,n+1)|Bt-Bu|(|t-u|+2)[log(t+1)+log(u+1)+2x]≥a.

But for fixed n∈N, for every t≥u,u∈[n,n+1)

|Bt-Bu|(|t-u|+2)[log(t+1)+log(u+1)+2x]≤|Bt-Bn|(|t-u|+2)[log(t+1)+log(u+1)+2x]+|Bu-Bn|(|t-u|+2)[log(t+1)+log(u+1)+2x])≤|Bt-Bn|(t-n+1)[log(t+1)+log(n+1)+2x]+|Bu-Bn|(|u-n|+1)[log(n+1)+log(u+1)+2x]).

This leads to

supt≥u≥0,u∈[n,n+1)|Bt-Bu|(|t-u|+2)[log(t+1)+log(u+1)+2x]≥a⊂supt≥n|Bt-Bn|(t-n+1)[log(t+1)+log(n+1)+2x]≥a/2⋃supu≥n|Bu-Bn|(|u-n|+1)[log(n+1)+log(u+1)+2x])≥a/2.

But in each case, with a≥2 we can apply (C7) to respectively the Brownian (Bt-Bn)t≥n and the Brownian (Bu-Bn)t≥n with y=a2(log(n+1)/2+x). Hence by union bound, we get that

Psupt≥u≥0|Bt-Bu|(|t-u|+2)[log(t+1)+log(u+1)+2x]≥a≤∑n=0∞2e-a2(log(n+2)/2+x)≤2∑n=0∞(n+1)-a/4e-ax/2

By taking a=8 for instance, the previous sum is finite and we get exactly the result. □

C.2 Proof of Theorem 2.3

Let us prove this more precise version of Theorem 2.3.

Theorem C.10

Let α∈(0,1) and let m be a fixed positive integer. Let Δμ>0 and suppose Assumption 2.2 (Margin(Δμ)) holds. Then if T≥□max‖μ‖∞Δμ2log‖μ‖∞2Δμ2,‖μ‖∞-1log|J|α and if the threshold θ satisfies

θ>□‖μ‖∞Δμ2maxlog4‖μ‖∞2Δμ2,log(|J|α-1)

and

θ<ΔμT-(‖μ‖∞T+1)(log(‖μ‖∞T+1)+2log(|J|α-1))

then with probability larger than 1-α we have that for all nature o∈O, if we denote by j∗∈J its category (i.e. o∈j∗), the choice ȷ^ (3) and the reaction time τ(Wȷ^) (2) that take place at the presentation of the mth object of nature o, satisfy

ȷ^=j∗andτ(Wȷ^)<T. C8

We start from inequality (C7) which says that for all y>0, if (Bt)t≥0 is a standard Brownian motion then

Psupt≥0|Bt|(t+1)[log(t+1)+2y]≥1≤e-y.

Let α>0, m∈N∗, o∈O the nature of object m and j∗ its category. Let J~:={j∈Jsuch thatμoj>0}. Indeed, if μoj=0, then for all t we have Wm,tj=0 and the process Wmj will never reach θ. According to Assumption 2.2, we have necessarily j∗∈J~. Up to consider J~ instead of J, let us assume J=J~.

For every j∈J, the process Wm,tj can be written as (1). By choosing y=log(|J|α-1), according to (C7), by union bound, we have with probability more than 1-α that for every j∈J,

supt≥0|Btj|(t+1)[log(t+1)+2y]≤1. C9

In particular, for every t≥0 we have

Wm,t∗≥μo∗t-(μo∗t+1)(log(t+1)+2y)=:I(μo∗,t)

and for j≠j∗, we get

Wm,tj≤μojt+(μojt+1)(log(μojt+1)+2y)=:S(μoj,t). C10

A sufficient condition for Wm∗ to reach θ before limit duration T and to be the first to do so is the existence of t0∈[0,T] such that I(μo∗,t0)=θ and for every j≠j∗, S(μoj,t0)<I(μo∗,t0). It would mean that at time t0, Wm∗ has already reached θ and none of the other processes have done so.

Let t0≥0. The condition S(μoj,t0)<I(μo∗,t0) is equivalent to

(μo∗-μoj)t0>(μojt0+1)(log(μojt0+1)+2y)+(μo∗t0+1)(log(μo∗t0+1)+2y) C11

which is implied by

Δμt0>2(‖μ‖∞t0+1)(log(‖μ‖∞t0+1)+2y). C12

which is equivalent to

Δμ2t02>4(‖μ‖∞t0+1)(log(‖μ‖∞t0+1)+2y). C13

Suppose t0>1‖μ‖∞. Then a sufficient condition is

Δμ2t02>4(2‖μ‖∞t0)(log(2‖μ‖∞t0)+2y). C14

Let us denote v:=2‖μ‖∞t0. Then (C14) can be rewritten as

Δμ24‖μ‖∞2v>4log(v)+8y. C15

Let x:=Δμ24‖μ‖∞2v. Then a sufficient condition is

x≥4log(x)+4log4‖μ‖∞2Δμ2+8y. C16

We can find a constant x0, independent of everything, such that for every x≥x0, x2≥4log(x). Then if x>x0 and x/2>4log4‖μ‖∞2Δμ2+8y, then (C16) holds.

To summarize, since y=log(|J|α-1), if

t0≥□1Δμ2max(log(4‖μ‖∞2Δμ2),log(|J|α-1))=:t-, C17

we have that I(μo∗,t0)>S(μoj,t0) for all j≠j∗.

By the assumptions of the theorem, we have that

θ≥‖μ‖∞t-≥I(μo∗,t-) C18

and

θ≤ΔμT-(‖μ‖∞T+1)(log(‖μ‖∞T+1)+2log(|J|α-1))≤I(μo∗,T). C19

So we have that I(μo∗,t-)≤I(μo∗,T) and that θ∈[I(μo∗,t-),I(μo∗,T)]. By continuity of I(μo∗,.), there exists t0 in [t-,T] such that I(μo∗,t0)=θ and since t0≥t-, we also have that S(μoj,t0)<I(μo∗,t0) for all j≠j∗, which concludes the proof.

C.3 Proof of Theorem 2.5

Let us prove the following result from which Theorem 2.5 derives.

Theorem C.11

Let α∈(0,1) and let m be a fixed positive integer. Let Δγ>0 and suppose Assumption 2.4 (Margin(Δγ)) holds. Then if T≥83log2|J|αmaxγmin-1,4‖γ‖∞Δγ-2 and if the threshold θ satisfies

83log2|J|αmax‖γ‖∞γmin,4‖γ‖∞Δγ2≤θ≤ΔγT-83‖γ‖∞Tlog2|J|α C20

where γmin:=mino∈O,j∈J{γoi;γoj>0}, then with probability larger than 1-α we have that for all nature o∈O, if we denote by j∗∈J its category (i.e. o∈j∗), the choice ȷ^ (6) and the reaction time τ(Πȷ^) (5) that take place at the presentation of the mth object of nature o, satisfy

ȷ^=j∗andτ(Πȷ^)<T. C21

Let α>0, m∈N∗, o∈O the nature of object m, j∗ its category and Δγ the constant given by Assumption 2.4. Let J~:={j∈Jsuch thatγoj>0}. According to Assumption 2.4, we have necessarily j∗∈J~. Up to consider J~ instead of J, let us assume J=J~. For t≥0 and x≥0, let

S(t):=(γo∗-Δγ)t+83γo∗tlog2|J|α C22

and

I(t):=γo∗t-83γo∗tlog2|J|α. C23

Let t-:=83log(2|J|α)maxγmin-1,4γo∗Δγ-2 and t0∈t-,T to choose later. Let Ω be the event

Ω:=∀j∈J,|Πm,t0j-γojt0|<83t0γojlog2|J|α. C24

Since the processes (Πm,tj)t≥0 are Poisson processes with intensity γoj>0 and t0≥83γojlog(2|J|α) by lower bounding γoj by γmin, by union bound on the j∈J, according to inequality (C6) from Corollary C.6, the event Ω has probability more than 1-α. Let us work on Ω. We have

Πm,t0∗≥γo∗t0-83γo∗t0log2|J|α=I(t0) C25

and for every j≠j∗, by bounding γoj by γo∗-Δγ and γo∗ we have

Πm,t0j≤γojt0+83γojt0log2|J|α<(γo∗-Δγ)t0+83γo∗t0log2|J|α=S(t0). C26

thanks to Assumption 2.4. Let us study under which condition we have S(t0)<I(t0). This is equivalent to the condition

t0≥323Δγ2γo∗log2|J|α C27

which we assumed. Suppose θ∈[I(t-),I(T)]. By continuity of t↦I(t), there exists t0∈[t-,T] such that I(t0)=θ. Let us choose such t0. Therefore, at time t0, we have Πm,t0∗≥θ and for every j≠j∗, Πm,t0j<θ. This means that at time t0, the process (Πm,t∗)t≥0 has already reached θ and since the processes (Πm,tj)t≥0 are increasing, every other process (Πm,tj)t≥0 where j≠j∗ has not reached θ yet. Therefore, on Ω, under the condition θ∈[I(t-),I(T)], the process (Πm,t∗)t≥0 reaches θ before limit duration T and is the first to do so. Since I(t-)≤γo∗t- by definition of the function I, sufficient conditions on θ are

83log2|J|αmaxγo∗γmin,4γo∗Δγ2≤θ C28

and

θ≤γo∗T-83γo∗Tlog2|J|α. C29

In order to get conditions independent of o and j∗, we upper bound γo∗ by ‖γ‖∞ and lower bound it by Δγ.

C.4 Proof of Theorem 2.6

Let us prove the following result, from which derives Theorem 2.6.

Theorem C.12

Let m∈N∗, o∈O the nature of the mth object and n∈N∗. Let Πmn=(Πmj,n)j∈J a family of mutually independent Poisson processes with intensities (nγoj)j∈J. Suppose the vector γo verifies γoj>0 for every j∈J. Then there exist absolute constants a,b,d>0 and a |J|-dimensional drifted Brownian motion Wmn=(Wmj,n)j∈J defined by (1) such that for every x>0,

Psupj∈J,t≥0|Πm,tj,n-Wm,tj,n|log(nγojt∨1+1)≥a+x≤b|J|e-dx. C30

For j∈J, let us define the hitting times τn(Πj):=infu≥0;Πm,uj,n≥nθ and τn(Wj):=infu≥0;Wm,uj,n≥nθ. Consequently, there exist absolute positive constants C, K and ζ such that for α∈(0,1), θ>0 and n≥2γminθγmin+1log10|J|α, with probability more than 1-α, all the following inequalities hold jointly:

  1. The processes Πmn and Wmn verify
    supj∈J,t≥0|Πm,tj,n-Wm,tj,n|log(nγojt∨1+1)≤C+ζlog(5K|J|α-1). C31
  2. The hitting times (τn(Πj))j∈J verify
    supj∈Jτn(Πj)-θγoj≤83nγminθγmin+1log10|J|α+1nγmin. C32
  3. The hitting times (τn(Wj))j∈J verify
    supj∈Jτn(Wj)-θγoj≤2nγminθγmin+1log10|J|α. C33
  4. The difference between the hitting times (τn(Πj))j∈J and (τn(Wj))j∈J verifies
    supj∈J|τn(Πj)-τn(Wj)|≤□θ,γmin,‖γ‖∞log(n)nlog|J|α. C34

Let m∈N∗, o the nature of object m and n≥1. Then (C30) is a direct consequence of Corollary C.4 by union bound on the j∈J and applying the time change t↦nγojt.

Let α∈(0,1) and U:=maxj∈J{θγoj}+1=θγmin+1.

∙ Control of the difference |Πm,tj,n-Wm,tj,n|.

For each j∈J, let us apply Corollary C.4 to the Poisson process (Πm,tj,n)t≥0 having intensity nγoj. By choosing uniform variables Vj independent of everything else, there exist Brownian motions Wm,tj,n with drift nγoj and scaling nγoj depending only on (Πm,tj,n)t≥0 and Vj such that the event

Ω1:=∀j∈J,supt≥0|Πm,tj,n-Wm,tj,n|log(nγojt∨1+1)≤C+ζlog(5K|J|α-1) C35

has probability more than 1-α5 by union bound, where C, K and ζ are positive constants independent of the parameters of the problem. Let us work on Ω1.

∙ Study of the hitting times of Wm,tj,n and Πm,tj,n.

We introduce the first hitting times τ~n(Πj):=infu∈[0,U]s.t.Πm,uj,n≥nθ and τ~n(Wj)=infu∈[0,U]s.t.Wm,uj,n≥nθ, and we set τ~n(Πj),τ~n(Wj)=∞ if the previous sets are empty. First, let us study under which conditions τ~n(Πj)<∞ and τ~n(Wj)<∞.

Let Ω2 be the event

Ω2:=∀j∈J,Πm,Uj,n≥nγojU-2nγojUlog(5|J|α-1). C36

Then Πm,Uj,n is a Poisson variable with parameter nγojU. Let us assume that for every j∈J we have nγojU≥2log(5|J|α-1). Then according to (C4) of Corollary C.6, by union bound P(Ω2)≥1-α5. Let us work on Ω1∩Ω2. Then a sufficient condition to have τ~n(Πj)<∞ is to have nγojU-2nγojUlog(5|J|α-1)≥nθ, which is equivalent to the condition

θγoj≤U-2Unγojlog(5|J|α-1). C37

which is fulfilled since we assumed that n verifies

n≥2γminθγmin+1log10|J|α. C38

Let Ω3 be the event

Ω3:=∀j∈J,sup0≤t≤U|Wm,tj,n-nγojt|<2Unγojlog(10|J|α-1) C39

Then according to Lemma C.1, we have P(Ω3)≥1-α5. Let us work on Ω1∩Ω2∩Ω3. We have then

Wm,Uj,n≥nγojU-2Unγojlog(10|J|α-1). C40

A sufficient condition to have τ~n(Wj)<∞ is to have nγojU-2Unγojlog(10|J|α-1)≥nθ, which is fulfilled since n verifies (C38). Therefore, on Ω1∩Ω2∩Ω3, we have τ~n(Πj)<∞,τ~n(Πj)<∞ and consequently τn(Πj)=τ~n(Πj) and τn(Wj)=τ~n(Wj). Therefore, for every j∈J and Z∈{Π,W}, we have τn(Zj)≤U, and controlling the trajectory of Zmj,n on [0, U] is sufficient to control it on [0,τn(Zj)].

Using this fact, let us study the convergence of τn(Πj) and τn(Wj) to θγoj.

1. Convergence of τn(Πj). According to Corollary C.8, for U≥83nγojlog(10|J|α-1), which holds for large n, the event

Ω4:=∀j∈J,sup0≤t≤U|Πm,tj,n-nγojt|≤83nγojUlog(10|J|α-1) C41

has probability more than 1-α5. Let us work on Ω1∩Ω2∩Ω3∩Ω4. Since Πm,τn(Πj)j,n is an integer and the process (Πm,tj,n)t≥0 cannot make two jumps at the same time, we have Πm,τn(Πj)j,n=⌈nθ⌉. Therefore, for every j∈J we have

|nθ-nγojτn(Πj)|≤|nθ-⌈nθ⌉|+|Πm,τn(Πj)j,n-nγojτn(Πj)|≤1+83nγojUlog(10|J|α-1) C42

since we work on Ω4. Hence

τn(Πj)-θγoj≤1nγoj+8U3nγojlog(10|J|α-1).

and we get the upper bound given by the theorem by lower bounding γoj by γmin and replacing U by its value θγmin+1.

2. Convergence of τn(Wj). Since we work on Ω3 we have

|Wm,τn(Wj)j,n-nγojτn(Wj)|≤2Unγojlog(10|J|α-1). C43

Since the trajectories of (Wm,tj,n)t≥0 are continuous, by definition of τn(Wj) we have Wm,τn(Wj)j,n=nθ so

τn(Wj)-θγoj≤2Ulog(10|J|α-1)nγoj C44

and we again get the upper bound given by the theorem by lower bounding γoj by γmin and replacing U by its value.

3. Study of the difference |τn(Πj)-τn(Wj)|. Let us begin by bounding Wm,τn(Πj)j,n-Wm,τn(Wj)j,n. We have

Wm,τn(Πj)j,n-Wm,τn(Wj)j,n=Wm,τn(Πj)j,n-nθ≤Wm,τn(Πj)j,n-⌈nθ⌉+|⌈nθ⌉-nθ|≤Wm,τn(Πj)j,n-Πm,τn(Πj)j,n+1≤log(n‖γ‖∞U+1)(C+ζlog(5K|J|α-1)+1≤□‖γ‖∞,θ,γminlog(n)log(|J|α-1) C45

since we are on Ω1 (C35) and since τn(Πj) is bounded by U.

Now, let us apply Lemma C.9 to the standard Brownian motion Btj:=Wm,(nγoj)-1tj,n-t. By union bound, the event

Ω5:=∀j∈J,supt,u≥0|Btj-Buj|(|t-u|+2)[log(t+1)+log(u+1)+2c′′log(5c′|J|α-1)]≤c C46

has probability more than 1-α5. Let us work on Ω1∩Ω2∩Ω3∩Ω4∩Ω5. Since τn(Πj) and τn(Wj) are bounded by U we have

|Bnγojτn(Πj)j-Bnγojτn(Wj)j|≤□θ,γmin,‖γ‖∞((n|τn(Πj)-τn(Wj)|)∨1)log(n|J|α-1).

If ((n|τn(Πj)-τn(Wj)|)∨1)=1 then |τn(Πj)-τn(Wj)|≤1n and we have the result. Otherwise we have by definition of Bj

Wm,τn(Πj)j,n-Wm,τn(Πj)j,n-nγoj(τn(Πj)-τn(Wj))≤□θ,γmin,‖γ‖∞n|τn(Πj)-τn(Wj)|log(n|J|α-1)

thus

Wm,τn(Πj)j,n-Wm,τn(Πj)j,n≥nγoj|τn(Πj)-τn(Wj)|-□θ,γmin,‖γ‖∞n|τn(Πj)-τn(Wj)|log(n|J|α-1).

Combining this with (C45), we obtain the following inequality:

X2-a(n)X-b(n)≤0 C47

with X:=n|τn(Πj)-τn(Wj)|, a(n):=□θ,γmin,‖γ‖∞log(n|J|α-1) and b(n):=□‖γ‖∞,θ,γminlog(n)log(|J|α-1). This polynomial has two real roots, the largest one being x0=a(n)+a(n)2+4b(n)2, so necessarily we have X≤x0, which implies that X≤a(n)+b(n), i.e., 

n|τn(Πj)-τn(Wj)|≤□θ,γmin,‖γ‖∞log(n|J|α-1)+log(n)log(|J|α-1)≤□θ,γmin,‖γ‖∞log(n)log(|J|α-1)

therefore

|τn(Πj)-τn(Wj)|≤□θ,γmin,‖γ‖∞log(n)nlog(|J|α-1). C48

To conclude, we note that P(Ω1∩Ω2∩Ω3∩Ω4∩Ω5)≥1-α.

C.5 Proof of Proposition 3.3

Let us prove the following proposition from which Proposition 3.3 derives and which is more precise.

Proposition C.13

Let α∈(0,1) and γmin:=mino∈O,i∈I{γoi;γoi>0}. Suppose Assumption 3.2 holds and

MTmin≥8|O|3γminlog2|I||J|α. C49

For j∈J, let w∞j=(w∞i→j)i∈I the weight family such that w∞i→j:=1|Ij|1{i∈Ij}. Then with probability 1-α, at the end of the learning phase, the synaptic weights verify for all j∈J

wM+1j-w∞j2≤2|O|η08|I|3Tmin‖γ‖∞log(2|I||J|α-1)+1{Ij⊊I}|I||Ij|max1,|I|-|Ij||Ij|exp(-η0δjM),

where η0 is defined by (13).

To ensure clarity, we sometimes denote by om the nature of object m. We will need the following lemma.

Lemma C.14

Let α>0 and γmin:=mini∈I,o∈O{γoisuch thatγoi>0}. Suppose Assumption 3.2 holds and that the following condition is fulfilled:

MTmin≥83log2|I||J|α|O|γmin. C50

Then with probability at least 1-α, for every i∈I and j∈J we have

∑ms.t.om∈jΠm,Tmini-MTmin|O|∑o∈jγoi≤8MTmin3|O|∑o∈jγoilog(2|I||J|α-1).
Proof

Let β>0, j∈J, i∈I. Then by independence of the processes ((Πm,ti)t≥0)1≤m≤M, the variable ∑ms.t.om∈jΠm,Tmini follows a Poisson distribution with parameter ∑ms.t.om∈jγmiTmin. Besides, according to Assumption 3.2, we have

∑ms.t.om∈jγmi=∑o∈j∑m,om=oγoi=M|O|∑o∈jγoi.

Let Ωi,j be the event

Ωi,j:=∑ms.t.om∈jΠm,Tmini-MTmin|O|∑o∈jγoi≤8MTmin3|O|∑o∈jγoilog(2β-1). C51

If ∑o∈jγoi=0 then ∑ms.t.om∈jΠm,Tmini=0 a.s. and P(Ωi,j)=1. Let us assume ∑o∈jγoi>0. Then according to inequality (C6) of Corollary C.6, under the condition

MTmin|O|∑o∈jγoi≥83log(2β-1) C52

we have P(Ωi,j)≥1-β.

Let us assume (C52) holds for every i, j such that ∑o∈jγoi>0. Then

P(∪i∈I,j∈JΩi,jc)≤|I||J|β.

Let us choose β=α|I||J|. Then (C52) is implied by the condition

MTmin≥83log2|I||J|α|O|γmin C53

so under this condition P∩i∈I,j∈JΩi,j≥1-α and we have the result. □

Now let us prove the proposition. Let α>0 and suppose (C49) holds. Let us work on the event Ω:=∩i∈I,j∈JΩi,j where the Ωi,j are defined in the proof of Lemma C.14. Then according to Lemma C.14, P(Ω)≥1-α. Let i∈I, j∈J and for m∈{1,⋯,M} let

g¯mi→j=γmi×MMjifo∈j-γmi×MM′×1|J|-1ifo∈j′≠j C54

Let G¯Mi→j:=∑m=1Mg¯mi→j and let w¯M+1i→j:=exp(ηG¯Mi→j)∑l∈Iexp(ηG¯Ml→j).

∙ Study of the difference |GMi→j-G¯Mi→j|.

According to Assumption 3.2 we have

G¯Mi→j=MMj∑ms.t.om∈jγmi-1|J|-1∑j′≠jMM′∑ms.t.om∈j′γmi=MMjM|O|∑o∈jγoi-1|J|-1∑j′≠jMM′M|O|∑o∈j′γoi

However, according to Assumption 3.2, for any j∈J we have

Mj=nj×M|O| C55

where nj is the number of object natures belonging to category j. Therefore we have

G¯Mi→j=M1nj∑o∈jγoi-1|J|-1∑j′≠j1n′∑o∈j′γoi=Mdi→j

and since we work on Ωi,j we have, where o is the nature of object m:

|GMi→j-G¯Mi→j|≤2maxj′∈J|O|n′∑ms.t.om∈j′(γoi^-γoi)≤2|O|maxj′∈J∑ms.t.om∈j′Πm,TminiTmin-γoi≤28M|O|3Tmin∑o∈jγoilog(2|I||J|α-1)≤2|O|8M3Tmin‖γ‖∞log(2|I||J|α-1)

where we bound 1n′ by 1 to go from the first line to the second, and we bound ∑o∈jγoi by |O|‖γ‖∞ to go from the third line to the fourth.

∙ Study of the difference ‖w¯M+1j-wM+1j‖2.

According to Gao and Pavel (2018) (Proposition 4), the softmax function defined on Rd with temperature η is η-Lipschitz, so we have

‖wM+1j-w¯M+1j‖2≤η|I|×2|O|8M3Tmin‖γ‖∞log(2|I||J|α-1)=2|O|η08|I|3Tmin‖γ‖∞log(2|I||J|α-1)

by replacing η by its value η0M-1/2.

∙ Study of the difference ‖w¯M+1j-w∞j‖2.

We apply Proposition 30 of Jaffard et al. (2026). For j∈J, if Ij=I then for every i∈I

w¯M+1i→j=w∞i→j. C56

Otherwise if Ij≠I, we have

|w∞i→j-w¯M+1i→j|≤1|Ij|max1,|I|-|Ij||Ij|exp(-η0δjM) C57

and

‖w¯M+1j-w∞j‖2≤|I||Ij|max1,|I|-|Ij||Ij|exp(-η0δjM). C58

We get the result by combining the error terms.

C.6 Proof of Theorem 3.5

Let us prove the following result from which Theorem 3.5 immediately derives.

Theorem C.15

Let α∈(0,1) and η0>0, and G:t↦∫0t∫0sg(s-u)duds. Let Δλ>0 and suppose Assumptions 3.2 and 3.4 (Margin (Δλ)) hold. Let the parameters M, Tmin, T, and θ verify

M≥□1η02δmin2log|I||I|min2+log‖γ‖∞Δλ2

where |I|min:=minj∈J|Ij| and δmin:=minj∈Jδj,

Tmin≥□η02|O|2|I|2‖γ‖∞3Δλ2log|I||J|α,
G(T)>□‖g‖1log|J|α1Δλ∨‖γ‖∞Δλ,
θ≥□‖g‖1log|J|α‖γ‖∞Δλ∨‖γ‖∞2Δλ∨‖γ‖∞G(Tmin)

and

θ<□ΔλG(T)-□‖γ‖∞,‖g‖1G(T)log|J|α+log|J|α.

Then with probability larger than 1-α, we have that for all nature o∈O of the object presented after the learning phase, that is the M+1 object, if we denote by j∗ its category, the choice ȷ^ (10) and the reaction time τ(Nȷ^) (9) satisfy

ȷ^=j∗andτ(Nȷ^)<T. C59

We will need several lemmas. Let Λm,tj:=∫0tλm,sjds be the compensator of the process (Nm,tj)t≥0. We denote Λ¯m,tj:=E[Λm,tj∣Fm-1].

Lemma C.16

Let x>0, m∈{1,⋯,M+1}, j∈J, t≥0. Then we have

PΛm,tj-Λ¯m,tj≥‖g‖1x3+2x‖g‖1Λ¯m,tj∣Fm-1≤e-x C60

and

PΛ¯m,tj-Λm,tj≥‖g‖1x3+2x‖g‖1Λ¯m,tj∣Fm-1≤e-x. C61
Proof

Let x>0. Let us use the Cramér-Chernoff method. Note that the weights wmj are Fm-1-measurable. Let ht(u):=∫utg(s-u)ds, ξ>0. Then according to Fubini-Tonelli theorem, since g is positive and the random measures defined by the processes (Πm,ti)t≥0 are σ-finite we have almost surely

Λm,tj=∑i∈Iwmi→j∫s=0t∫u=0sg(s-u)dΠm,uids=∑i∈Iwmi→j∫u=0t∫s=utg(s-u)dsdΠm,ui=∑i∈Iwmi→j∫u=0tht(u)dΠm,ui.

Therefore

E[eξΛm,tj∣Fm-1]=Eexp∑i∈Iwmi→jξ∫u=0tht(u)dΠm,ui∣Fm-1 C62

and by independence of the processes ((Πm,ti)t≥0)i∈I we have

E[eξΛm,tj∣Fm-1]=∏i∈IEexpwmi→jξ∫u=0tht(u)dΠm,ui∣Fm-1. C63

Besides, according to Proposition 6 of Reynaud-Bouret (2003),

E[eξΛm,tj∣Fm-1]=∏i∈Iexpγoi∫0t(eξwmi→jht(u)-1)du=exp∑i∈Iγoi∫0t(eξwmi→jht(u)-1)du=exp∑i∈Iγoi∫0t∑k=1∞(ξwmi→jht(u))kk!du=exp(ξΛ¯m,tj)exp∑i∈Iγoi∫0t∑k=2∞(ξwmi→jht(u))kk!du≤exp(ξΛ¯m,tj)expλ¯mjG(t)∑k=2∞ξk‖g‖1k-1k!

where we exchanged the sum and integral because the series of functions converges uniformly, we bounded ht(u) by ‖g‖1 and (wmi→j)k by wmi→j (because wmi→j is bounded by 1).

Suppose ξ‖g‖1<1. Since λ¯mjG(t)=Λ¯m,tj we have

E[eξ(Λm,tj-Λ¯m,tj)∣Fm-1]≤expΛ¯m,tjξ2‖g‖12∑k=1∞(ξ‖g‖1)k-23k-2=expΛ¯m,tjξ2‖g‖1211-ξ‖g‖13.

By applying Markov’s inequality to the variable eξ(Λm,tj-Λ¯m,tj) conditionally to the σ-algebra Fm-1, we get

PΛm,tj-Λ¯m,tj≥x∣Fm-1≤e-ξxexpΛ¯m,tjξ2‖g‖1211-ξ‖g‖13=exp-ξx+Λ¯m,tjξ2‖g‖121-ξ‖g‖13.

Then similarly as in section 2.4 of Boucheron et al. (2013), we have

supξ∈(0,3‖g‖1-1)ξx-Λ¯m,tjξ2‖g‖121-ξ‖g‖13=9‖g‖1Λ¯m,tjfx3Λ¯m,tj C64

where f:v↦1+v-1+2v. Therefore

PΛm,tj-Λ¯m,tj≥x∣Fm-1≤exp-9‖g‖1Λ¯m,tjfx3Λ¯m,tj.

Besides, f is an increasing function from R+∗ to R+∗ with inverse f-1:v↦v+2v so we have

PΛm,tj-Λ¯m,tj≥3Λ¯m,tjf-1‖g‖1x9Λ¯m,tj∣Fm-1≤e-x C65

and by integrating we get (C60). Now, let us prove (C61). Let us consider -Λm,tj instead of Λm,tj. Then similarly we have

E[e-ξΛm,tj∣Fm-1]≤exp(-ξΛ¯m,tj)expλ¯mjG(t)∑k=2∞ξk‖g‖1k-1k!du C66

hence

E[eξ(Λ¯m,tj-Λm,tj)∣Fm-1]≤expλ¯mjG(t)∑k=2∞ξk‖g‖1k-1k!du C67

so the same computations apply to bound E[eξ(Λ¯m,tj-Λm,tj)∣Fm-1], and by applying Markov’s inequality to the variable eξ(Λ¯m,tj-Λm,tj) we get the same bound as in (C60) for (C61).

Now that we proved (C60) and (C61), we can combine them to have the result. □

Lemma C.17

Let x>0, m∈{1,⋯,M+1}, j∈J, t≥0. Let e(x,t):=‖g‖1x3+2x‖g‖1Λ¯m,tj. Then we have

PNm,tj-Λ¯m,tj≤2(Λ¯m,tj+e(x,t))x+x3+e(x,t)≥1-2e-x C68

and

PΛ¯m,tj-Nm,tj≤2(Λ¯m,tj+e(x,t))x+x3+e(x,t)≥1-3e-x. C69
Proof

Let x>0, j∈J, t≥0. Let us prove (C68). Let us work conditionally to Fm-1. Let us use inequality (3.3) of Hansen et al. (2015) with N=(Nm,tl)l∈I∪J, H=(Hl)l∈I∪J with Hj≡1 and Hl≡0 if l≠j, and B=1. Let ρ∈R to choose later. Then we have

PNm,tj-Λm,tj≥2ρx+x3andΛm,tj≤ρ∣Fm-1≤e-x. C70

Let us choose ρ:=Λ¯m,tj+e(x,t) which is Fm-1-measurable. Let Ω1 be the event

Ω1:=Nm,tj-Λm,tj≥2ρx+x3 C71

and Ω2 be the event

Ω2:=Λm,tj≤ρ. C72

Then P(Ω1∩Ω2c)≤e-x and according to Lemma C.16 inequality (C60), P(Ω2c)≤e-x. Besides,

Ω1c∩Ω2⊂Nm,tj-Λ¯m,tj≤2ρx+x3+e(x,t) C73

and by integrating we get

P(Ω1∪Ω2c)=P(Ω1∩Ω2)+P(Ω2c)≤2e-x C74

therefore

PNm,tj-Λ¯m,tj≤2ρx+x3+e(x,t)≥P(Ω1c∩Ω2)≥1-2e-x C75

By replacing ρ by its value we get (C68).

Now, let us prove (C69). Similarly, let us use inequality (3.3) of Hansen et al. (2015) with Hj≡-1 and Hl≡0 if l≠j. Let ρ∈R to choose later. Then we get

PΛm,tj-Nm,tj≥2ρx+x3andΛm,tj≤ρ∣Fm-1≤e-x. C76

Let us choose the same ρ as before: ρ:=Λ¯m,tj+e(x,t). Let Ω3 be the event

Ω3:=Λm,tj-Nm,tj≥2ρx+x3 C77

and Ω4 be the event

Ω4:=Λ¯m,tj-Λm,tj≥e(x,t). C78

Then P(Ω3∩Ω2)≤e-x and according to Lemma (C.16) inequality (C61), P(Ω4c)≤e-x. Besides,

Ω3c∩Ω2∩Ω4c⊂Ω3c∩Ω4c⊂Λ¯m,tj-Nm,tj≤2ρx+x3+e(x,t) C79

and by integrating we have

P(Ω3∪Ω2c∪Ω4)≤P(Ω4)+P(Ω3∩Ω2)+P(Ω2c)≤3e-x C80

so we have

PΛ¯m,tj-Nm,tj≤2ρx+x3+e(x,t)≥1-3e-x. C81

By replacing ρ by its value we get (C69). □

Lemma C.18

Let m∈{1,⋯,M+1}, t≥0, α>0. Then with probability more than 1-α, we have

∀j∈J,Nm,tj-Λ¯m,tj≤□Λ¯m,tj(‖g‖1∨1)log|J|α+(‖g‖1∨1)log|J|α.
Proof

By combining inequalities (C68) and (C69) of Lemma C.17, we get

PNm,tj-Λ¯m,tj≤2(Λ¯m,tj+e(x,t))x+x3+e(x,t)≥1-5e-x.

Let us choose xα=log(5|J|α-1), such that by union bound

P∀j∈J,Nm,tj-Λ¯m,tj≤2(Λ¯m,tj+e(xα,t))xα+xα3+e(xα,t)≥1-α

which concludes the proof.

□

Lemma C.19

Let α>0, t∈[Tmin,T] and η=η0M where η0>0. Suppose Assumption 3.2 holds. Let Λ¯∞,tj:=∑i∈Iw∞i→jγoiG(t). Then there exists an absolute constant □>0 such that with probability more than 1-α, for every j∈J we have

Λ¯M+1,tj-Λ¯∞,tj≤□B¯(α)|I|‖γ‖∞G(t) C82

where

B¯(α):=|O|η0|I|Tmin‖γ‖∞log|I||J|α+|I|3/2|I|mine-η0δminM C83

with |I|min:=minj∈J|Ij| and δmin:=minj∈Jδj.

Proof

Let α>0, t∈[Tmin,T], j∈J. Then according to Proposition 3.3, there exists an event Ω with probability more than 1-α such that on Ω, for every j∈J we have

wM+1j-w∞j2≤2|O|η08|I|3Tmin‖γ‖∞log(2|I||J|α-1)+1{Ij⊊I}|I||Ij|max1,|I|-|Ij||Ij|exp(-η0δjM)≤□|O|η0|I|Tmin‖γ‖∞log|I||J|α+|I|3/2|I|mine-η0δminM=□B¯(α)

Let us work on Ω. We have

Λ¯M+1,tj-Λ¯∞,tj=∑i∈I(wM+1i→j-w∞i→j)γoiG(t)≤‖wM+1j-w∞j‖2|I|‖γ‖∞G(t)

which concludes the proof. □

Lemma C.20

Let α>0 and η=η0M where η0>0. Then with probability more than 1-α, for every j∈J we have

NM+1,tj-Λ¯∞,tj≤Θtj

where

Θtj:=DB¯α2|I|‖γ‖∞G(t)+Λ¯m,tj(‖g‖1∨1)log2|J|α+(‖g‖1∨1)log2|J|α

where D>0 is an absolute constant.

Proof

Let α>0, t∈[Tmin,T]. By combining the results of Lemmas C.18 and C.19 for every j∈J with α2 instead of α we have the result. □

Now we can prove the theorem. Let α∈(0,1), t0∈[Tmin,T] to choose later. Let us work on the event defined in the proof of Lemma C.20 for t=t0. Let

I(t0):=Λ¯∞,t0∗-Θ0∗, C84

and for j∈J,

Sj(t0):=Λ¯∞,t0j+Θ0j. C85

such that

NM+1,t0∗>I(t0) C86

and for every j∈J,

NM+1,t0j<Sj(t0). C87

We would like to choose t0 such that for every j≠j∗, Sj(t0)≤I(t0) and I(t0)=θ. It would imply that at time t0, NM+1∗ has already reached θ and for every j≠j∗, NM+1j has not reached θ yet. The condition Sj(t0)≤I(t0) is implied by

Λ¯∞,t0∗-Λ¯∞,t0j≥Θ0∗+Θ0j C88

which is implied by

ΔλG(t0)≥2Θ0∗.

Let R:=Δλ-2DB¯α2|I|‖γ‖∞. Suppose R≥Δλ2. Then a sufficient condition is

RG(t0)≥2Dλ¯M+1∗G(t0)(‖g‖1∨1)log2|J|α+(‖g‖1∨1)log2|J|α. C89

This inequality has the form aX2-bX-c≥0 with X=G(t0), and a, b, c positive constants. The polynomial has two real roots, the largest one being b+b2+4ac2a, so a sufficient condition is X≥ba+ca, i.e., 

G(t0)≥□(‖g‖1∨1)log2|J|αR-1/2+‖γ‖∞R-12. C90

Let t- the minimal t≥Tmin satisfying (C90), such that

G(t-)=□(‖g‖1∨1)log2|J|αR-1/2+‖γ‖∞R-12∨G(Tmin). C91

Since G tends to infinity, it is possible to choose such t-. Since G is increasing, a sufficient condition to have t-<T is G(t-)<G(T). Then if θ∈[I(t-),I(T)), by continuity of I there exists t0∈[t-,T) such that I(t0)=θ, and we have the result. Let us now explicit the conditions we had to assume.

We have

R≥Δλ2⇔Δλ-2DB¯α2|I|‖γ‖∞≥Δλ2⇐B¯α2≤□Δλ|I|‖γ‖∞⇔|O|η0|I|Tmin‖γ‖∞log2|I||J|α+|I|3/2|I|mine-η0δminM≤□Δλ|I|‖γ‖∞

A sufficient condition is that both terms of the left side of the inequality are less than half the right term, which reads as

Tmin≥□Δλ-2|O|2η02|I|2‖γ‖∞3log|I||J|α C92

and

M≥□1η02δmin2log|I||I|min2+log‖γ‖∞Δλ2. C93

Besides,

θ≤I(T)⇔θ≤λ¯∞j-DB¯α2|I|‖γ‖∞G(T)-Dλ¯∞∗G(T)(‖g‖1∨1)log2|J|α-D(‖g‖1∨1)log2|J|α

where λ¯∞∗:=∑i∈Iw∞i→j∗γoi. Since λ¯∞∗≥Δλ and R≥Δλ2, a sufficient condition is

θ≤□ΔλG(T)-□‖γ‖∞,‖g‖1G(T)log(|J|α-1)+log(|J|α-1).

The other condition on θ is

θ≥I(t-)⇐θ≥‖γ‖∞G(t-)⇔θ≥□(‖g‖1∨1)log2|J|αR-1/2+‖γ‖∞R-12∨‖γ‖∞G(Tmin)⇐θ≥□‖g‖1log(|J|α-1)‖γ‖∞Δλ∨‖γ‖∞2Δλ∨‖γ‖∞G(Tmin)

and finally, since by definition T>Tmin,

G(t-)<G(T)⇐□‖g‖1log(|J|α-1)1Δλ∨‖γ‖∞Δλ<G(T)

which concludes the proof.

C.7 Proof of Theorem 3.6

Let G:x↦∫0xg(u)du and let Λm,tj,n:=∫0tλm,sj,nds be the compensator of the process (Nm,tj,n)t≥0. We still denote λ¯mj:=∑i∈Iγoiwmi→j.

Let x=(xl)1≤l≤d,y=(yl)1≤l≤d,z=(zl)1≤l≤d vectors in Rd. We denote by (x,y):=∑l=1dxlyl the usual scalar product between two vectors, which we extend to three vectors by (x,y,z):=∑l=1dxlylzl.

We will need the following lemmas.

Lemma C.21

Let x>0. With the constants of Lemma C.2, if g has compact support on [0, S], then there exists i.i.d. standard Brownian motions (Bti)t≥0’s independent of everything else such that with probability larger than 1-|I|be-dx, for every j∈J and t≥0,

|Λm,tj,n-E[Λm,tj,n]-∑i∈Iwmi→jBnγoiti|≤Snλ¯mj‖g‖1+∑i∈Iwmi→j|Bnγoi(t-S)i-Bnγoiti|+log(n‖γ‖∞t∨1+1)(a+x),

with ‖γ‖∞=maxi∈I,o∈Oγoi.

Proof

For all t≥0,

nλ¯mj‖g‖1(t-S)≤E[Λm,tj,n]≤nλ¯mj‖g‖1t. C94

Moreover

‖g‖1∑i∈Iwmi→jΠm,t-Si,n≤Λm,tj,n≤‖g‖1∑i∈Iwmi→jΠm,ti,n. C95

The first part is just due to the fact that if t-s≥S then G(t-s)=‖g‖1 and that G(t-s)≤‖g‖1 for all t and s. The second part is done with exactly the same arguments. So we get for all t≥0 that

∑i∈Iwmi→j[Πm,t-Si,n-nγoi(t-S)]-Snλ¯mj‖g‖1≤Λm,tj,n-E(Λm,tj,n)≤∑i∈Iwmi→j[Πm,ti,n-nγoit]+Snλ¯mj‖g‖1.

Now we apply Lemma C.2 to all Π~i that are dilation of (Πm,ti,n)t≥0 so that they are Poisson processes of rate 1. It means we obtain i.i.d. standard Brownian motions Bi, only depending on Π~i and auxiliary i.i.d. uniform random variables Vi such that with probability larger 1-|I|be-dx,

∀i∈I,∀t≥0,Πm,ti,n-nγoit-Bnγoiti≤log(n‖γ‖∞t∨1+1)(a+x). C96

We apply this at time t and t-S in the above equation and this leads to the desired result.

□

Now, let us choose S≤n-1/2.

Proposition C.22

Let x>0, m≥1, o∈O the nature of object m. There are absolute positive constants b′,d′ and a positive a′ depending on ‖γ‖∞ and ‖g‖1 such that there exists independent standard Brownian motions (Btj)t≥0 such that with probability larger than 1-(|I|+|J|)b′e-d′x

∀j∈J,∀t≥0,|Nm,tj,n-Λm,tj,n-Bn(wlj,γoI)‖g‖1tj|≤a′n1/4(t∨1)1/4(log(nt+1)(x∨1))3/4. C97
Proof

For all j∈J, let us consider πj independent Poisson processes of rate 1, independent of everything else. By Lemma C.2, we can construct i.i.d. standard Brownian motions (Btj)t≥0 such that with probability larger than 1-|J|be-dx, we have that

∀j∈J,∀t≥0,|πtj-t-Btj|≤log(t∨1+1)(a+x). C98

Since the (random) function Λm,·j,n’s are non decreasing, we can always define their inverse (Λm,·j,n)-1, conditionally to the inputs Πmi,n’s, so that one can construct Nmj,n, the Hawkes processes as πΛm,tj,nj. Hence we have by change of time, that on the same event of probability larger than 1-|J|be-dx,

∀j∈J,∀t≥0,Nm,tj,n-Λm,tj,n-BΛm,tj,nj≤log(Λm,tj,n∨1+1)(a+x). C99

Now we can apply Lemma C.21, so that with probability larger than 1-(|I|+|J|)be-dx, both the above equations and the result of Lemma C.21 holds.

Now let us intersect with the event where the results of Lemma C.9 hold for all i∈I and j∈J.

By a union bound, we get therefore that on an event of probability larger than 1-(|I|+|J|)(a+c′)e-d∧c"x,

  • with Bi at time nγoit and u=0,
    |Bnγoiti|≤c(nγoit+2)(log(nγoit+1)+2x)=□‖γ‖∞nt(log(nt+1)+x) C100
  • still with Bi at time nγoit and nγoi(t-S),
    Bnγoi(t-S)i-Bnγoiti≤c(nγoiS+2)(2log(nγoit+1)+2x)=□‖γ‖∞n1/2(log(nt+1)+x). C101

Hence on the same event,

∀j∈J,∀t≥0,|Λm,tj,n-E[Λm,tj,n]|≤□‖γ‖∞,‖g‖1n(t∨1)log(nt+1)(x∨1).

Besides, by (C94) we also have

∀j∈J,∀t≥0,E[Λm,tj,n]-nλ¯mj‖g‖1t≤□‖γ‖∞,‖g‖1n C102

so we have

∀j∈J,∀t≥0,|Λm,tj,n-nλ¯mj‖g‖1t|≤□‖γ‖∞,‖g‖1n(t∨1)log(nt+1)(x∨1). C103

Going back to (C99) and now using Lemma C.9 with j∈J at time Λm,tj,n and nλ¯mj‖g‖1t, we therefore obtain that

BΛm,tj,nj-Bnλ¯mj‖g‖1tj≤c|nλ¯mj‖g‖1t-Λm,tj,n|+2log(nλ¯mj‖g‖1t+1)+log(Λm,tj,n+1)+2x

and because (C103) on the same event, we have Λm,tj,n≤□γ,‖g‖1nt. Moreover using (C103) again, we get that on the same event,

|BΛm,tj,nj-Bnλ¯mj‖g‖1tj|≤□‖γ‖∞,‖g‖1(n(t∨1))1/4(log(nt+1)(x∨1))3/4. C104

Injecting this in (C99), we obtain the result. □

Now we can prove the theorem. Let us work on the same event as the one of the proof of Proposition C.22, for which the conclusions of Lemma C.21 also apply, which has probability more than 1-(|I|+|J|)b′e-d′x. On this event, according to Lemma C.21 we have for every j∈J and t≥0

Λm,tj,n-E(Λm,tj,n)-∑i∈Iwmi→jBnγoiti≤‖g‖1‖γ‖∞n-1/2+∑i∈Iwmi→j|Bnγoi(t-S)i-Bnγoiti|+□‖γ‖∞log((nt)∨1+1)(x∨1).

Besides, according to (C101) on the same event we have for every i∈I

|Bnγoi(t-S)i-Bnγoiti|≤□‖γ‖∞n1/2(log(nt+1)+x).

Since ∑i∈Iwmi→j=1 we have then for every j∈J

Λm,tj,n-E(Λm,tj,n)-∑i∈Iwmi→jBnγoiti≤□‖g‖1,‖γ‖∞n1/2log(nt+1)(x∨1).

Therefore, by combining this with the conclusions of Proposition C.22, we have that on the same event, for every j∈J and t≥0,

Nm,tj,n-E[Λm,tj,n]-∑i∈Iwmi→jBnγoiti-Bn‖g‖1tλ¯mjj≤□‖g‖1,‖γ‖∞n1/4(t∨1)1/4log(nt+1)(x∨1)3/4.

By construction, the processes ((Bul)u≥0)l∈I∪J are mutually independent. We have then the following equality in distribution:

∑i∈Iwmi→jBnγoiti+Bnλ¯mj‖g‖1tj=D∑i∈Iwmi→jnγoiBti+nλ¯mj‖g‖1Btj

Therefore, the process Wm,tj,n:=E[Λm,tj,n]+∑i∈Iwmi→jBnγoiti+Bnλ¯mj‖g‖1tj is a Gaussian process with mean

E[Wm,tj,n]=E[Λm,tj,n] C105

and covariance

Cov(Wm,tj,n,Wm,sj,n)=∑i∈I(wmi→j)2nγoiCov(Bti,Bsi)+n‖g‖1∑i∈Iwmi→jγoiCov(Btj,Bsj)=nt∧s(wmj,wmj,γoI)+‖g‖1λ¯mj.

Furthermore, if j′≠j then

Cov(Wm,tj,n,Wm,sj′,n)=∑i∈Iwmi→jwmi→j′nγoiCov(Bti,Bsi)=n(t∧s)(wmj,wm′,γoI).

Let us choose x such that (|I|+|J|)b′e-d′x=α, i.e.,  x=1d′log(|I|+|J|)b′α. Then for b′≥□, we have x≥1 and with probability more than 1-α, for every j∈J we have

supt>0Nm,tj,n-Wm,tj,nn1/4(t∨1)1/4log(nt+1)3/4≤□‖g‖1,‖γ‖∞log|I|+|J|α3/4. C106

Now let us study the hitting times. Let us work on the same event that we denote Ω1. Let U:=maxj∈Jθλ¯mj‖g‖1+1. Then for every j∈J and t≥0 we have

Nm,tj,n-E[Nm,tj,n]≤B~m,tj,n+□‖g‖1,‖γ‖∞n1/4(t∨1)1/4log(nt+1)3/4log|I|+|J|α3/4 C107

where B~m,tj,n = ∑i∈Iwmi→jBnγoiti+Bnλ¯mj‖g‖1tj. Then (B~m,tj,n)t≥0 is a Brownian motion with 0 drift and scaling σn:=n(wmj,wmj,γoI)+‖g‖1λ¯mj≤□‖g‖1,‖γ‖∞n. According to Lemma C.1, by union bound there exists an event Ω2 with probability more than 1-α such that on Ω2,

∀j∈J,sup0≤t≤UB~m,tj,n<□‖γ‖∞,‖g‖1nUlog(|J|α-1). C108

Let us work on Ω1∩Ω2. We can now control Nm,tj,n-E[Nm,tj,n]. Furthermore, E[Nm,tj,n]=E[Λm,tj,n] and by (C94) we have E[Λm,tj,n]-nλ¯mj‖g‖1t≤□‖g‖1,‖γ‖∞n. By combining everything, we get that for every j∈J and t∈[0,U]

Nm,tj,n-nλ¯mj‖g‖1t≤□‖γ‖∞,‖g‖1nUlog(|J|α-1)+n1/4U1/4log(nU+1)3/4log|I|+|J|α3/4≤□‖γ‖∞,‖g‖1nUlog|I|+|J|α3/4. C109

Since Wm,tj,n=E[Nm,tj,n]+B~m,tj,n and E[Nm,tj,n]=E[Wm,tj,n], similarly we have

∀j∈J,∀t∈[0,U],Wm,tj,n-nλ¯mj‖g‖1t≤□‖γ‖∞,‖g‖1nUlog(|J|α-1). C110

∙ Study of the hitting times of Wm,tj,n and Nm,tj,n.

Let τ~n(Wj):=inf{u∈[0,U],Wm,uj,n≥nθ} and τ~n(Nj)=inf{u∈[0,U],Nm,uj,n≥nθ}. First, let us study under which conditions τ~n(Nj)<∞ and τ~n(Wj)<∞. According to (C109), we have that for all j∈J,

Nm,Uj,n≥nλ¯mj‖g‖1U-□‖γ‖∞,‖g‖1nUlog|I|+|J|α3/4.

Then a sufficient condition to have τ~n(Nj)<∞ is to have

nλ¯mj‖g‖1U-□‖γ‖∞,‖g‖1nUlog|I|+|J|α3/4>nθ, C111

which is implied by

U>θλ¯mj‖g‖1+□‖γ‖∞,‖g‖1,λ¯min,θn-1/2log|I|+|J|α3/4 C112

which holds for

n≥□‖γ‖∞,‖g‖1,λ¯min,θlog|I|+|J|α3/2 C113

by definition of U. By using (C110), we can apply the same reasoning to Wmj,n to find that (C112) is also a sufficient condition to have τ~n(Wj)<∞.

This means that on this event, both processes Wmj,n and Nmj,n have reached nθ before time U, so we have in fact τn(Nj)=τ~n(Nj) and τn(Wj)=τ~n(Wj). Therefore, for every j∈J and Z∈{N,W}, we have τn(Zj)≤U, and controlling the trajectory of Zmj,n on [0, U] is sufficient to control it on [0,τn(Zj)]. Using this fact, let us now study the convergence of τn(Nj) and τn(Wj) to θλ¯mj‖g‖1.

1. Convergence of τn(Nj). Since Nm,τn(Nj)j,n is an integer and cannot make two jumps at the same time, we have Nm,τn(Nj)j,n=⌈nθ⌉. Therefore, for every j∈J we have

nθ-nλ¯mj‖g‖1τn(Nj)≤nθ-⌈nθ⌉+Nm,τn(Nj)j,n-nλ¯mj‖g‖1τn(Nj)≤1+□‖γ‖∞,‖g‖1nUlog|I|+|J|α3/4

were the last inequality holds using (C109). So we have

τn(Nj)-θλ¯mj‖g‖1≤□‖γ‖∞,‖g‖1,λ¯min,θn-1/2log|I|+|J|α3/4. C114

2. Convergence of τn(Wj). According to (C110) we have

nθ-nλ¯mj‖g‖1τn(Wj)=Wm,τn(Nj)j,n-nλ¯mj‖g‖1τn(Wj)≤□‖γ‖∞,‖g‖1nUlog(|J|α-1)

so

τn(Wj)-θλ¯mj‖g‖1≤□‖γ‖∞,‖g‖1,λ¯min,θ1nlog(|J|α-1) C115

3. Study of the difference τn(Nj)-τn(Wj). Let us begin by bounding Wm,τn(Nj)j,n-Wm,τn(Wj)j,n. We have

Wm,τn(Nj)j,n-Wm,τn(Wj)j,n=Wm,τn(Nj)j,n-nθ≤Wm,τn(Nj)j,n-⌈nθ⌉+|⌈nθ⌉-nθ|≤Wm,τn(Nj)j,n-Πm,τn(Nj)j,n+1

so according to (C106) we have

Wm,τn(Nj)j,n-Wm,τn(Wj)j,n≤□‖γ‖∞,‖g‖1,λ¯min,θn1/4log(n)3/4log|I|+|J|α3/4 C116

Besides,

Wm,τn(Nj)j,n-Wm,τn(Wj)j,n=nλ¯mjG(τn(Nj))-G(τn(Wj))+B~m,τn(Nj)j,n-B~m,τn(Wj)j,n

Besides, if t1≥t2≥n-1/2 then

G(t1)-G(t2)=∫s=t21∫u=0sg(u)duds=∫s=t21‖g‖1ds=‖g‖1(t1-t2).

Since τn(Nj) and τn(Wj) both converge to θλ¯mj‖g‖1>0, so for n verifying (C113) we have τn(Nj)≥n-1/2 and τn(Wj)≥n-1/2 so |G(τn(Nj))-G(τn(Wj))|=|τn(Nj)-τn(Wj)|‖g‖1. Therefore

Wm,τn(Nj)j,n-Wm,τn(Wj)j,n≥nλ¯mj‖g‖1|τn(Nj)-τn(Wj)|-B~m,τn(Nj)j,n-B~m,τn(Wj)j,n

According to Lemma C.9 and since τn(Wj) and τn(Nj) are bounded on Ω1∩Ω2, by union bound there exists an event Ω3 of probability more than 1-α such that on Ω1∩Ω2∩Ω3 we have for every j∈J

B~m,τn(Nj)j,n-B~m,τn(Wj)j,n≤□‖γ‖∞,‖g‖1,λ¯min,θnτn(Nj)-τn(Wj)∨1log(n|J|α-1). C117

If nτn(Nj)-τn(Wj)∨1=1 then τn(Nj)-τn(Wj)≤1/n and we have the result. Otherwise we have

Wm,τn(Nj)j,n-Wm,τn(Wj)j,n≥nλ¯mj|τn(Nj)-τn(Wj)|-□‖γ‖∞,‖g‖1,λ¯min,θnτn(Nj)-τn(Wj)log(n|J|α-1).

Combining this with (C116) we have

□‖γ‖∞,‖g‖1,λ¯min,θn1/4log(n)3/4log|I|+|J|α3/4≥n|τn(Nj)-τn(Wj)|-□‖γ‖∞,‖g‖1,λ¯min,θnτn(Nj)-τn(Wj)log(n|J|α-1).

By writing X:=n|τn(Nj)-τn(Wj)|, a(n):=□‖γ‖∞,‖g‖1,λ¯min,θlog(n|J|α-1) and b(n):=□‖γ‖∞,‖g‖1,λ¯min,θn1/4log(n)3/4log|I|+|J|α3/4, we can rewrite it as

X2-a(n)X-b(n)≤0.

This polynomial has two real roots, the largest one being x0=a(n)+a(n)2+4b(n)2, so necessarily we have X≤x0, which implies that X≤a(n)+b(n), i.e., 

n|τn(Nj)-τn(Wj)|≤□‖γ‖∞,‖g‖1,λ¯min,θlog(n|J|α-1)+n1/8log(n)3/8log|I|+|J|α3/8≤□‖γ‖∞,‖g‖1,λ¯min,θn1/8log(n)3/8log|I|+|J|α3/8

and finally we get

|τn(Nj)-τn(Wj)|≤□‖γ‖∞,‖g‖1,λ¯min,θlog(n)n3/4log|I|+|J|α3/4.

Since P(Ω1∩Ω2∩Ω3)≥1-3α, we get the results of the theorem by choosing α/3 instead of α.

C.8 Proof of Proposition 4.1

Let j1 and j2 the two categories, i1 the feature characterizing category j1 and i2 the feature characterizing category j2. Let us compute the feature discrepancies of the features. Since every o∈j1 has feature i1, for every o∈j1 we have γo1=γ and since there is no o∈j2 having feature i1, for every o∈j2 we have γo1=0. Therefore

di1→j1=γ. C118

Similarly, for every i∈j2 we have γo2=γ and for every o∈j1 we have γo2=0 so

di2→j1=-γ<di1→j1 C119

Let i∈I\{i1,i2}. Then there are 4 rockets among the 16 having simultaneously features i1 and i. Since j1 contains 5 objects, there is at least one object without feature i in j1. Therefore ⟨γoi⟩o∈j1<γ and

di→j1<γ=di1→j1. C120

Thus Ij1=argmaxi∈Idi→j1={i1} and by definition of the family w∞, for i∈I we have wi→j1=1i=i1. By symmetry, the same computations are true when exchanging index 1 with index 2 so for i∈I we also have Ij1={i2} and wi→j2=1i=i2. Now, let us compute the λ¯∞,oj. For o∈j1,

λ¯∞,o1=∑i∈Iw∞i→j1γoi=γo1=γ C121

and

λ¯∞,o2=∑i∈Iw∞i→j2γoi=γo2=0 C122

so

λ¯∞,o1>λ¯∞,o2+Δλ C123

where Δλ is any constant in (0,γ). By symmetry, for o∈j2 we also have

λ¯∞,o2>λ¯∞,o1+Δλ. C124

Author Contributions

S. Jaffard did the writing, the proofs, collected the data and analyzed them. G. Mezzadri designed the experiment and participated to the writing. P. Reynaud-Bouret participated to the writing and the proofs, provided some of the initial ideas about the coupling and supervised the work. E. Tanré provided some of the initial ideas about the coupling and a thorough checking of all the mathematical details.

Funding

Open Access funding enabled and organized by Projekt DEAL.

Declarations

Competing interests

The authors have no competing interests to declare that are relevant to the content of this article.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  1. Brunton BW, Botvinick MM, Brody CD (2013) Rats and humans can optimally accumulate evidence for decision-making. Sci 340(6128):95–98 [DOI] [PubMed] [Google Scholar]
  2. Besançon E, Coutin L, Decreusefond L, Moyal P (2024) Diffusive limits of Lipschitz functionals of Poisson measures. Ann Appl Probab 34(1A):555–584. 10.1214/23-aap1972 [Google Scholar]
  3. Bacry E, Delattre S, Hoffmann M, Muzy JF (2013) Some limit theorems for Hawkes processes and application to financial statistics. Stochastic Process Appl 123(7):2475–2499. 10.1016/j.spa.2013.04.007 [Google Scholar]
  4. Bao Y, Kuang Z, Peissig P, Page D, Willett R (2017) Hawkes process modeling of adverse drug reactions with longitudinal observational data. In: Proceedings of the 2nd Machine Learning for Healthcare Conference, vol. 68, pp 177–190
  5. Boucheron S, Lugosi G, Massart P (2013) Concentration inequalities. Oxford University Press, Oxford, p 481. 10.1093/acprof:oso/9780199535255.001.0001 (A nonasymptotic theory of independence, With a foreword by Michel Ledoux) [Google Scholar]
  6. Bretagnolle J, Massart P (1989) Hungarian constructions from the nonasymptotic viewpoint. Ann Probab 17(1):239–256 [Google Scholar]
  7. Bacry E, Mastromatteo I, Muzy J-F (2015) Hawkes Processes in Finance. Market Microstruct and Liquidity 1(01):1550005 [Google Scholar]
  8. Brody CD, Romo R, Kepecs A (2003) Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamic representations. Curr Opin Neurobiol 13(2):204–211 [DOI] [PubMed] [Google Scholar]
  9. Cesa-Bianchi N, Lugosi G (2006) Prediction, learning, and games. Cambridge University Press, Cambridge [Google Scholar]
  10. Carrillo JA, Cordier S, Mancini S (2011) A decision-making Fokker-Planck model in computational neuroscience. J Math Biol 63(5):801–830. 10.1007/s00285-010-0391-3 [DOI] [PubMed] [Google Scholar]
  11. Caporale N, Dan Y (2008) Spike timing-dependent plasticity: a Hebbian learning rule. Annu Rev Neurosci 31:25–46 [DOI] [PubMed] [Google Scholar]
  12. Chevallier J, Melnykova A, Tubikanec I (2021) Diffusion approximation of multi-class Hawkes processes: theoretical and numerical analysis. Adv in Appl Probab 53(3):716–756. 10.1017/apr.2020.73 [Google Scholar]
  13. Ditterich J (2006) Stochastic models of decisions about motion direction: behavior and physiology. Neural Netw 19(8):981–1012 [DOI] [PubMed] [Google Scholar]
  14. Deco G, Martí D (2007) Deterministic analysis of stochastic bifurcations in multi-stable neurodynamical systems. Biol Cybernet 96(5):487–496. 10.1007/s00422-007-0144-6 [DOI] [PubMed] [Google Scholar]
  15. Ethier SN, Kurtz TG (1986) Markov processes. John Wiley & Sons, Inc, New York. 10.1002/9780470316658 (Characterization and convergence) [Google Scholar]
  16. Erny X, Löcherbach E, Loukianova D (2023) Strong error bounds for the convergence to its mean field limit for systems of interacting neurons in a diffusive scaling. Ann Appl Probab 33(5):3563–3586 [Google Scholar]
  17. Fudenberg D, Strack P, Strzalecki T (2018) Speed, accuracy, and the optimal timing of choices. Am Econ Rev 108(12):3651–84. 10.1257/aer.20150742 [Google Scholar]
  18. Gerstein GL, Bedenbaugh P, Aertsen AM (1989) Neuronal assemblies. IEEE Trans Biomed Eng 36(1):4–14 [DOI] [PubMed] [Google Scholar]
  19. Gao B, Pavel L (2018) On the Properties of the Softmax Function with Application in Game Theory and Reinforcement Learning arXiv:1704.00805
  20. Gold JI, Shadlen MN (2001) Neural computations that underlie decisions about sensory stimuli. Trends Cogn Sci 5(1):10–16 [DOI] [PubMed] [Google Scholar]
  21. Hawkes AG (1971) Spectra of some self-exciting and mutually exciting point processes. Biometrika 58(1):83–90 [Google Scholar]
  22. Hutcherson CA, Bushong B, Rangel A (2015) A neurocomputational model of altruistic choice and its implications. Neuron 87(2):451–462 [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Hebb DO (2005) The organization of behavior: a neuropsychological theory. Psychology press, New York [Google Scholar]
  24. Hansen NR, Reynaud-Bouret P, Rivoirard V (2015) Lasso and probabilistic inequalities for multivariate point processes. Bernoulli 21(1):83–143. 10.3150/13-BEJ562 [Google Scholar]
  25. Hubel DH, Wiesel TN (1962) Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex. J Physiol 160(1):106–154 [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Insabato A, Pannunzi M, Rolls ET, Deco G (2010) Confidence-related decision making. J Neurophysiol 104(1):539–547 [DOI] [PubMed] [Google Scholar]
  27. Jaffard S, Vaiter S, Muzy A, Reynaud-Bouret P (2024) Provable local learning rule by expert aggregation for a Hawkes network. In: International Conference on Artificial Intelligence and Statistics, pp 1837–1845. PMLR
  28. Jaffard S, Vaiter S, Reynaud-Bouret P (2026) CHANI: correlation-based Hawkes aggregation of neurons with bio-inspiration. J Mach Learn 27(32):1–62 [Google Scholar]
  29. Komlós J, Major P, Tusnády G (1975) An approximation of partial sums of independent ’s and the sample . I. Z Wahrscheinlichkeitstheorie und Verw Gebiete 32:111–131. 10.1007/BF00533093 [Google Scholar]
  30. Komlós J, Major P, Tusnády G (1976) An approximation of partial sums of independent RV’s, and the sample DF. II. Z Wahrscheinlichkeitstheorie und Verw Gebiete 34(1):33–58. 10.1007/BF00532688 [Google Scholar]
  31. Karatzas I, Shreve SE (1998) Brownian motion and stochastic calculus, vol 113, 2nd edn. Springer, New York. 10.1007/978-1-4612-0949-2 [Google Scholar]
  32. LaBerge D (1994) Quantitative models of attention and response processes in shape identification tasks. J Math Psychol 38(2):198–243 [Google Scholar]
  33. Le Cun Y, Boser B, Denker J, Henderson D, Howard R, Hubbard W, Jackel L (1989) Handwritten digit recognition with a back-propagation network. In: NeurIPS
  34. Love B, Medin D, Gureckis T (2004) Sustain: a network model of category learning. Psychol Rev 111:309–332 [DOI] [PubMed] [Google Scholar]
  35. Lovric M (2025) International Encyclopedia of statistical science. Springer, Berlin, Heidelberg [Google Scholar]
  36. Machens CK, Romo R, Brody CD (2005) Flexible control of mutual inhibition: a neural model of two-interval discrimination. Sci 307(5712):1121–1124 [DOI] [PubMed] [Google Scholar]
  37. Nosofsky RM (1986) Attention, similarity, and the identification-categorization relationship. J Exp Psychol Gen 115:39–57 [DOI] [PubMed] [Google Scholar]
  38. Ost G, Reynaud-Bouret P (2023) Neural coding as a statistical testing problem. Math Neurosci Appl 3:4–33 [Google Scholar]
  39. Papamakarios G, Murray I (2016) Fast -free inference of simulation models with Bayesian conditional density estimation. In: Lee D, Sugiyama M, Luxburg U, Guyon I, Garnett R (eds) Advances in neural information processing systems, vol 29. Curran Associates Inc [Google Scholar]
  40. Philiastides MG, Ratcliff R (2013) Influence of branding on preference-based decision making. Psychol Sci 24(7):1208–1215 [DOI] [PubMed] [Google Scholar]
  41. Prodhomme A (2020) Strong Gaussian approximation of metastable density-dependent Markov chains on large time scales arXiv:2010.06861v3
  42. Prodhomme A (2023) Strong Gaussian approximation of metastable density-dependent Markov chains on large time scales. Stochastic Process Appl 160:218–264 [Google Scholar]
  43. Ratcliff R (1978) A theory of memory retrieval. Psychol Rev 85(2):59–108 [Google Scholar]
  44. Ratcliff R (1981) A theory of order relations in perceptual matching. Psychol Rev 88(6):552–572 [Google Scholar]
  45. Ratcliff R (1988) Continuous versus discrete information processing: modeling accumulation of partial information. Psychol Rev 95(2):238–255 [DOI] [PubMed] [Google Scholar]
  46. Reynaud-Bouret P (2003) Adaptive estimation of the intensity of inhomogeneous Poisson processes via concentration inequalities. Probab Theory Related Fields 126(1):103–153 [Google Scholar]
  47. Ratcliff R, Hasegawa YT, Hasegawa RP, Smith PL, Segraves MA (2007) Dual diffusion model for single-cell recording data from the superior colliculus in a brightness-discrimination task. J Neurophysiol 97(2):1756–1774 [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Ratcliff R, McKoon G (2008) The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput 20(4):873–922 [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Rosenblatt F (1957) The perceptron, a perceiving and recognizing automaton project para. Cornell Aeronautical Laboratory, Ithaca, New York [Google Scholar]
  50. Roxin A (2019) Drift-diffusion models for multiple-alternative forced-choice decision making. J Math Neurosci 9:5–23. 10.1186/s13408-019-0073-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Ratcliff R, Rouder JN (1998) Modeling response times for two-choice decisions. Psychol Sci 9(5):347–356 [Google Scholar]
  52. Robbins H, Siegmund D (1970) Boundary crossing probabilities for the Wiener process and sample sums. Ann Math Statist 41:1410–1429. 10.1214/aoms/1177696787 [Google Scholar]
  53. Ratcliff R, Smith PL (2004) A comparison of sequential sampling models for two-choice reaction time. Psychol Rev 111(2):333–367 [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Revuz D, Yor M (1999) Continuous martingales and Brownian motion, vol 293, 3rd edn. Springer, Berlin, p 602. 10.1007/978-3-662-06400-9 (Grundlehren der mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences]) [Google Scholar]
  55. Singer W, Engel AK, Kreiter AK, Munk MH, Neuenschwander S, Roelfsema PR (1997) Neuronal assemblies: necessity, signature and detectability. Trends Cogn Sci 1(7):252–261 [DOI] [PubMed] [Google Scholar]
  56. Shadlen MN, Kiani R (2013) Decision making as a window on cognition. Neuron 80(3):791–806 [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Shadlen MN, Newsome WT (1996) Motion perception: seeing and deciding. Proc Natl Acad Sci USA 93(2):628–633 [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Stone JV (2018) Principles of neural information theory. Comput Neurosci and Metabolic Efficiency
  59. Smith PL, Van Zandt T (2000) Time-dependent Poisson counter models of response latency in simple judgment. Br J Math Stat Psychol 53(2):293–315 [DOI] [PubMed] [Google Scholar]
  60. Tavanaei A, Ghodrati M, Kheradpisheh SR, Masquelier T, Maida A (2019) Deep learning in spiking neural networks. Neural Netw 111:47–63 [DOI] [PubMed] [Google Scholar]
  61. Türkyilmaz K, Lieshout MNM, Stein A (2013) Comparing the Hawkes and trigger process models for Aftershock sequences following the 2005 Kashmir earthquake. Math Geosci 45:149–164 [Google Scholar]
  62. Wagenmakers E-J, Maas HLJ, Grasman RPPP (2007) An EZ-diffusion model for response time and accuracy. Psychonomic Bulletin & Rev 14(1):3–22 [DOI] [PubMed] [Google Scholar]
  63. Zhou K, Zha H, Song L (2013) Learning social infectivity in sparse low-rank networks using multi-dimensional Hawkes processes. In: Carvalho CM, Ravikumar P (eds) Proceedings of the sixteenth international conference on artificial intelligence and statistics, proceedings of machine learning research, vol 31. PMLR, Scottsdale, Arizona, USA, pp 641–649 [Google Scholar]

Articles from Journal of Mathematical Biology are provided here courtesy of Springer

RESOURCES