Abstract
Excitable optoelectronic devices represent one of the key building blocks for implementation of artificial spiking neurons in neuromorphic (brain-inspired) photonic systems. This work introduces and experimentally investigates an opto-electro-optical (O/E/O) artificial neuron built with a resonant tunnelling diode (RTD) coupled to a photodetector as a receiver and a vertical cavity surface emitting laser as a transmitter. We demonstrate a well-defined excitability threshold, above which the neuron produces optical spiking responses with characteristic neural-like refractory period. We utilise its fan-in capability to perform in-device coincidence detection (logical AND) and exclusive logical OR (XOR) tasks. These results provide first experimental validation of deterministic triggering and tasks in an RTD-based spiking optoelectronic neuron with both input and output optical (I/O) terminals. Furthermore, we also investigate in simulation the prospects of the proposed system for nanophotonic implementation in a monolithic design combining a nanoscale RTD element and a nanolaser; therefore demonstrating the potential of integrated RTD-based excitable nodes for low footprint, high-speed optoelectronic spiking neurons in future neuromorphic photonic hardware.
Keywords: neuromorphic photonics, optical computing, photonic neuron, RTD, spiking, VCSEL
1. Introduction
Artificial Intelligence (AI) and Machine Learning (ML) algorithms nowadays power a wide range of advanced computational tasks, ranging from natural language processing and realistic image synthesis [1] to solutions solving major challenges such as protein folding [2]. As a general principle, higher computational capability of AI models goes hand in hand with their scale. Hence, further growth in the size of these models is expected as new, more complex tasks are being explored. This can be observed in current models such as GPT-3, whose 175 billion parameters [3] represent over an order of magnitude increase in the number of parameters when compared to its previous iteration. With the growth of scale and increase in resource and requirements of these AI models, the chips on which those algorithms run come more into the spotlight, fuelling the search for alternative, AI-optimised hardware. In particular, approaches beyond the conventional Von-Neumann architecture of digital processors (with distinct memory and logic units) are receiving increasing interest. These alternative computing schemes offer the promise of relieving the stalling chip performance improvements due to CMOS downscaling bottlenecks and architecture limitations. Neuromorphic (brain-inspired) engineering is a prime example of such unconventional computing approach.
Neuromorphic computing systems attempt to harness the vast computational capabilities and power efficiency of the brain by mimicking and abstracting its architecture. These systems rely on high degree of parallelism and concepts such as event-based, asynchronous computation and in-memory computing. Driven both by their utility in the fields of AI and computational neuroscience, neuromorphic computers are being developed by both academic [4, 5] and industrial parties [6, 7] in a variety of technology platforms. In particular, neuromorphic realisations based on photonics offer some highly desirable benefits. The use of light allows for high bandwidth and low-loss, wavelength-division multiplexed (WDM) communication schemes without unwanted inductive crosstalk and resistive heating in wires, while advances in the field of photonic integrated circuits (PICs) allow for high-density chip integration. The field is currently ongoing rapid expansion, with many different classes of photonic devices being investigated for brain-inspired computing and AI acceleration. These include quantum-dot lasers [8, 9], superconducting nanowires [10, 11], integrated photonic components including modulators [12–14], semiconductor optical amplifiers [15, 16], micro-rings [17–19], phase change material-based PICs [20, 21] as well as vertical cavity surface emitting lasers (VCSELs) subject to injection locking [22–24] or with saturable absorber sections [25–29]. Furthermore, VCSELs have been previously demonstrated as a viable technology for spike-based optical computing by utilising their high speed spiking dynamics for tasks such as all-optical convolution [30], pattern classification [31] or rate-coded encoding of image data [32]. Simultaneously, a recent study has demonstrated VCSELs suitability for integration into arrays [33], which is crucial for realisation of larger-scale on-chip integrated circuits.
In this work, we introduce a modular, excitable, optoelectronic spiking neuron based on a resonant tunnelling diode (RTD) electrically coupled to a PD (Thorlabs PDA8GS) serving as a receiver, and to a telecom-wavelength, fiber pigtailed VCSEL serving as a transmitter, together realising an O/E/O system. RTDs are a class of semiconductor devices that typically employ a double barrier quantum well (DBQW) semiconductor heterostructure, allowing for ultrafast quantum tunnelling through the resonant states of the well. This sets RTD-based oscillators among the fastest semiconductor devices operating at room temperature, with currently highest achieved frequency reaching 2 THz [34]. RTDs exhibit a highly nonlinear, N-shaped I–V with a negative differential conductance (NDC) region, which introduces gain and nonlinear dynamical responses. RTDs have been successfully employed for photodetection with very high sensitivity [35, 36], as receiver systems [37], for small-scale THz imaging [38] and in circuits for high-speed data transmission [39, 40]. RTD-based oscillator circuits can also exhibit excitability, yielding these devices as highly-promising elements for use in novel brain-inspired computing paradigms [41] and in so-called cellular neural networks [42, 43]. Previous works have demonstrated spike-shaped oscillations [44] and neuron-like, excitable stochastic (noise-driven) spiking in systems of RTDs connected to either a laser diode (RTD-LD) [41] or a photodetector (RTD-PD) and using electrical noise or modulated optical input [45]. A signal-regenerating spiking memory cell with an optoelectronic RTD circuit has also been reported [46] as well as optically induced stochastic resonance effects [47]. Recently, nanoscale RTD-based LEDs [48] have been proposed as a viable solution for low-power, high-speed and low footprint optical spiking nodes. A detailed numerical analysis on the temporal characteristics and delays in the propagation of spiking signals in nanoscale RTD-based optoelectronic neurons (using RTD-LD to PD-RTD interlinked systems) can be found in [49]. Furthermore, a numerical study of a feed-forward spiking neural network based on RTD-LD/PD master-receiver nodes with spatiotemporal spike pattern detection and information processing functionality was recently proposed in [50].
In Section 2, we introduce the layout of the studied RTD-based optoelectronic node and the experimental setup. While previous studies focused on stochastic, noise-induced spiking [45], our layout enables deterministic, user controlled, optically induced spike triggering of the RTD-based photonic neuron, which is key for practical information processing. Furthermore, our photonic neuron combines for the first time an RTD coupled to a telecom-wavelength operating VCSEL, both systems with proven track record and recognised potential for use in optical neuromorphic systems. In Section 3, we evaluate the excitable responses of the system, including its well-defined spiking threshold and refractory (lethargy) period. In Section 4, we demonstrate in-device coincidence detection (logical AND) and exclusive logical OR (XOR) tasks, two of the key functionalities for practical operation in networked arrangements. Finally, in Section 5, we provide future outlook of a nanoscale RTD artificial photonic neuron based on a monolithic design and demonstrate the coincidence detection task in such low footprint, high speed system.
2. PD-RTD-VCSEL spiking node layout
The RTD artificial spiking neuron circuit combines an O/E receiver (PD), an excitable RTD and an E/O transmitter laser (a VCSEL). Throughout this work, we will refer to this layout as a PRL node (Photodetector-RTD-Laser), with the node circuit layout depicted in Figure 1(a) and experimental layout used to characterise the node shown in Figure 1(d). The RTD device (with a 3 µm radius circular mesa) was fabricated on a layerstack grown by metal-organic vapour phase epitaxy (MOVPE) on a semi-insulating InP substrate, containing a 1.7 nm AlAs/5.7 nm InGaAs/1.7 nm AlAs DBQW structure surrounded by highly doped n-InGaAs contact layers. As previously discussed, the RTD exhibits a highly nonlinear I–V characteristic (shown in Figure 1(b)) with a pronounced NDC region starting around 900 mV and extending beyond 1.25 V as highlighted with orange shading in Figure 1(b). Lumped circuit scheme for the RTD optoelectronic circuit can be found in [49, 50]. For operation as an excitable driving element, the RTD is biased via a 12 GHz bias-tee (Inmet 8800SMF1-12) with a DC voltage U S very close to the peak voltage value (typical operation point highlighted with green dashed line in Figure 1(b)). When biased near the NDC region, any perturbation of sufficient strength can push the system over the boundary of the NDC, causing the RTD to fire an excitable spike alongside a limit cycle. The I–V curve of the RTD exhibits a very high peak-to-valley current ratio (PVCR , Figure 1(b)), which is favourable as it provides spikes with high signal-to-noise amplitude ratio.
Figure 1:
Overview of the spiking optoelectonic neuron layout, components, experimental setup and dynamics. (a) Component layout of the PRL node, including the RTD element with independently tuneable bias U s coupled to a fiber-coupled VCSEL biased at I s . PD, photodetector; DCB, DC blocking element; PS, resistive power splitter; TEE, a bias tee; RTD, resonant tunnelling diode. (b) I–V characteristics of the RTD, with region of negative differential conductance (NDC) highlighted in orange. RTD is operated in region around 860 mV. (c) L–I curve of the output (transmitter) VCSEL. (d) The dual-channel (fan-in) experimental setup with optical timetrace readout on the RT OSC. TL, tuneable laser; VOA, variable optical attenuator; PC, polarisation controller; MZM, Mach–Zehnder modulator; AWG, arbitrary waveform generator; ISO, optical isolator. (e) Example of spike triggering perturbation (waveform from AWG). (f) Trace of optical power on input branch, RF-modulated via MZM and recorded on amplified photodetector (DC component is filtered). (g) An electrical spike, activated in a PD-RTD system. (h) An optical spike at the output VCSEL.
The optical input of the PRL node is realised with a 9 GHz amplified InGaAs photodetector (PD, Thorlabs PDA8GS), which directly converts input light perturbations into RF signals that enter the RTD. Unlike in previous works [46], our setup does not require an EDFA to increase input optical power entering the node. The PD is coupled through a DC blocking element (DCB in Figure 1(a)) since any offset voltage coming from the PD could shift the RTD operational point from U S . The output of the PRL node is realized with an off-the-shelf VCSEL (Raycan) operating at 1550 nm, driven with an RF-enabled laser mount (Thorlabs LDM56) with thermal control via thermistor (R = 12.5 kΩ) and with an 50 Ω RF input that is AC-coupled directly to the VCSEL through a bias-tee. The lasing threshold of the VCSEL is approx. 1.9 mA (Figure 1(c)) at room temperature, and the laser was operated at 2.2 mA. The VCSEL output passes through an optical isolator (to avoid unwanted reflections and increase the S/N ratio) and is read out on a 16 GHz real-time oscilloscope (Rohde & Schwarz RTP) using a second amplified photodetector. The input (PD) and output (RF-IN on the bias-tee driving the VCSEL) terminals of the PRL node are all connected together via a 2-way-0° resistive 50 Ω power splitter (ZFRSC-183-S+, PS in Figure 1(a)). These three main functional blocks constitute the full PRL (O/E/O) photonic spiking neuron. Figure 1(e)–(h) shows how a small optical perturbation (Figure 1(f)) activates a spiking response in the RTD (Figure 1(g)) and subsequently in the VCSEL output (Figure 1(h)). In all the figures, “(opt.p.)” denotes optical power, represented by voltage trace (as produced by the amplified photodetector).
To demonstrate the fan-in functionality and input integration capability for multiple optical upstream signals, we provide two optical inputs (branches) into the PRL node. This showcases that the node can simultaneously process signals at various wavelengths (defined by the sensitivity range of the PD) similarly to other O/E neurons [18]. Each branch includes an optical isolator (ISO) to limit unwanted reflections, a variable optical attenuator (VOA) for power adjustment and a Mach–Zehnder modulator (MZM) controlled by an arbitrary waveform generator (AWG, Keysight M8190 12 GSa s−1) via a 10 dB RF amplifier which provide spike trigger signals. The operational point (bias voltage) of each MZM is set between the quadrature and the maximum of the output power transfer curve to achieve near-linear relation between input amplitudes and output light intensity modulations. The two independent branches are then combined via a 50:50 fibre-optic coupler and fed into the input (PD) of the PRL node. We denote the input branches as: A and B. Branch A utilizes a tunable laser (Santec TSL-210) operating at 1310 nm. The MZM (Thorlabs) in branch A is biased at 7.4 V. Branch B utilizes another tunable laser (Santec WSL-110) operating at 1546 nm and the MZM (JDS Uniphase) is biased at 2.1 V. The average CW power provided from each branch was approx. 350 µW.
We want to emphasise that this off-the-shelf realisation of the PRL neuron is a first proof-of-concept demonstration of an RTD-based O/E/O spiking neuron with deterministic spike triggering. In the future, an optically-sensitive RTD (with an embedded optical input window) would enable for co-integration of the PD-RTD elements into a single (sub)-micron sized structure. In parallel, a fully monolithic layout incorporating all the active components into a single structure is under investigation [51]. These monolithic designs [49, 50] are of significant interest, as they would significantly reduce the footprint of the PRL node down to sub-micrometric dimensions and allow for their chip-scale integration. Furthermore, we also want to highlight that the spiking rates of the proposed O/E/O PRL node are mostly governed by the RTD circuit parameters, and are not limited by the VCSEL (with demonstrated bandwidths reaching 30 GHz [52]) or the RTD whose resonant tunnelling effects persist far beyond GHz rates. Therefore, future optimisation of circuit parameters, in addition to transition towards monolithically-integrated designs, will enable optoelectronic spiking systems yielding high-speed spiking (multiple GHz) rates. The performance of such future monolithic integrated PRL node is investigated numerically at the end of this work in Section 5.
3. PD-RTD-VCSEL spiking node characterisation
For a system to operate as a spiking artificial neuron, multiple functional requirements need to be fulfilled. These include the ability to receive inputs (ideally from multiple upstream nodes), perform input signal summation and thresholding, and finally respond with all-or-nothing responses that are generally independent on the shape of the activating perturbation. The excitable spiking neuron should also act as a filter for perturbations arriving too soon after the firing of a spike event (thus exhibiting refractoriness), and should also integrate (summate) multiple sub-threshold pulses arriving at the same time. We demonstrate experimentally that the PRL node fulfills all these requirements.
First, a spiking artificial neuron should exhibit a clear excitability threshold, upon which an all-or-nothing response (spike) is fired. A single sub-threshold input perturbation (stimulus) should not result in any significant response from the system. Conversely, a super-threshold perturbation should cause the firing of a spiking event, where the shape of the spike is fully governed by the dynamical limit cycle (i.e. the device and circuit, not by input perturbation’s shape).
Figure 2(a)–(d) demonstrates the clear thresholding behaviour in the PRL node, showing how variations of the RTD bias voltage U shift the distance of the threshold from the quiescent state. In this experiment, a sequence of three (t sep = 500 ns) square-shaped, unipolar, 3 ns long pulses of varying amplitudes is used to modulate the optical signal from one of the input branches. The system responds in an all-or-nothing manner, with sub-threshold pulses not causing any observable response at the PRL output trace. It can also be seen that increasing the U value from 860 mV to 880 mV moves the excitable threshold closer to the steady-state, resulting in spike-activation for input pulses with lower amplitudes.
Figure 2:
Threshold and refractoriness characterization in the PRL. (a) Source waveform of stimuli (3 ns square pulses) with varying amplitude. This serves as PRL input via MZM on the input branch to the PRL. Dashed lines show approximate threshold levels for different RTD bias voltages. (b)–(d) Timetraces of VCSEL output as recorded on an amplified photodetector. For the lowest bias voltage value, (b) U = 860 mV, the threshold is further from the steady state and only the strongest perturbation triggers a response (a spike). Response for same signal with RTD bias U = 870 mV, (c) and response with RTD biased closest to the threshold, for U = 870 mV (d); refractory period demonstration with temporal map (n = 20 cycles); refractory period study: (e) the source modulation, consisting of pulse pairs with gradually increasing temporal separation (10 ns increments). (f) The temporal map shows the traces of 20 subsequently recorded measurement cycles of 10 µs length. (g) Example of one response trace of the PRL node.
Another hallmark characteristic of excitable systems is the presence of a refractory (lethargic) time. After a spiking response is elicited within the system, it exhibits a time period in which it is unable to respond with another full response. In certain classes of artificial neuron models, a distinction can be made between an absolute refractory time (period during which the system cannot respond at all) and a relative refractory period [26] (where the probability of spike activation is reduced or amplitude of the spiking response is diminished). Figure 2(e)–(g) demonstrates that the PRL node exhibits a clearly defined refractory period. To test this, we injected input perturbations into the PRL in the form of a sequence of pulse doublets, formed by two 3 ns long super-threshold pulses with gradually increasing temporal separation between the two pulses in each pair (Figure 2(e)). Temporal separation values between Δ t = 0 ns and Δ t = 150 ns have been used with 10 ns increments. To better evaluate the refractory period of the system, 20 subsequent oscilloscope readouts (cycles) have been acquired and processed into a temporal map shown in Figure 2(f). The orange highlight shows the pulse doublet separation for which a second excitable event starts occurring, directly demonstrating the refractory period of the system being T ref ≈ 90 ns. Due to the presence of noise and temporal jitter, the observed spike activation probability per separation is not a strict step-like function, but exhibits an interval (here Δ t = 90 ns) where the likelihood of a follow-up spike is reduced. No significant jittering (at timescales comparable to the duration of the fired spikes) was experimentally observed at the output of the PRL node. Since the upper limit of excitable system’s spiking rate is governed by the refractory time, we can define the maximum spiking frequency for the PRL as 10 MHz. As the temporal map in Figure 2(f) also demonstrates, the spike excitation process via super-threshold pulses offers very high degree of reliability, with no missing spikes observed in the 20 recorded cycles.
4. PD-RTD-VCSEL spiking node functional tasks
Artificial neurons in neural networks rarely process information from a singular upstream source. Therefore, having the many-to-one fan-in functionality (processing multiple simultaneous inputs) is key for realisation of larger-scale neural networks. It is generally assumed that signal coincidences and synchrony play a major role in the brain [53] and in sensory pathways, including the auditory [54] cortex. Among other functionalities, coincidence detection enables for mirror symmetry density detection [55], which is vital for perception procedures based on visual stimuli in image processing algorithms. Furthermore, for propagation of information in larger neural networks, it is also important to have the capability of information subtraction. An example of this is the exclusive OR (XOR) logic task, where each individual input coming from one of the two branches results in a TRUE state, while both pulses coming together result in a FALSE state in the system. Previous works have shown logic gates (AND, OR) in chains of spiking micropillar lasers with saturable absorber [27]. In this section, we experimentally demonstrate these two fundamental tasks, performed with a pair optical inputs entering into a single PRL node: a coincidence detection (logical AND) and an exclusive or (logical XOR) task.
First, we demonstrate pulse coincidence detection performed on two independent optical inputs entering the PRL node (Figure 3(a)–(d)). Both input branches were modulated with 2 ns square pulses with gradually increasing mutual temporal separations, with increments (measured between rising edges of pulses) of Δ incr = 1 ns. As can be seen in Figure 3(a) and (b), only perfectly overlapping pulses Δ incr = 0 ns and partially overlapping pulses Δ incr = 1 ns result on total sum of optical input power exceeding the excitability threshold, leading to the triggering of a single excitable spike in the RTD. For separations Δ ≥ 2 ns, no responses are triggered. This functionality can be considered as a temporal version of the AND logical gate.
Figure 3:

Two-input coincidence detection (logical AND), where the first two rows show the 2 ns square pulses (stimuli) gradually shifting apart in time. For (a) perfect and for (b) partial overlap, the total energy at a given moment surpasses the firing threshold, eliciting a spike. However, as the pulses drift further apart (c, d), the input perturbation energy to the system at any given time is not sufficient for spiking.
Next, we demonstrate the XOR task (Figure 4), with the XOR truth table included for reference. The PRL node can be considered as functionally analogous to a single-layer perceptron. Seminal works [56] have shown that solving linearly inseparable tasks (such as the XOR) in perceptrons requires a multi-layered architecture. Here, we experimentally realize an additional network input layer using two MZMs. The two input branches use equivalent, bipolar, spike-like modulation signals (red trace, 8 ns per bipolar pulse, Figure 4(a) and (d)). These perturbations are converted to optical signals using MZMs (Figure 4(b) and (e)) where each MZM is set in opposing points of the transfer function between quadrature and maximum, resulting in polarity inversion for the pulses in branch B (Figure 4(f)). These bipolar optical pulses are then propagated from the MZM layer to the PD element in the PRL node. Each pulse on its own is capable of eliciting an individual spike, since the positive part of the perturbation exceeds the spike activation threshold of the RTD (Figure 4(g) and (h)). However, when both of these pulses arrive on the PD element of the PRL node simultaneously, they cancel each other out (Figure 4(i)) as they are mutually in anti-phase. As a result, no spike is elicited in the PRL node for active A and B (Figure 4(j)). Therefore, by combining the single PRL node with the MZM-based input layer into a two-layer arrangement, the full set of required states for the XOR task is achieved by the combination of optical pulse polarity inverting, signal summation, thresholding and optical spike firing. Furthermore, we would like to highlight that the RTDs capability to fire spikes with opposite polarity based on their bias point [41] provides a way to directly replace the MZMs and build networks that preserve the functionality as well as cascadability.
Figure 4:
Two-input exclusive OR (XOR) task in the PRL: (a, d) a bipolar RF trigger pulse is processed through a layer of two, (b, e) MZMs with different operation points of their transfer function, providing mutually inverted input perturbations, (c, f) on two optical input branches (denoted as A, B) to the PRL. The input pulses can individually elicit spiking responses from the PRL node (g, h), but when arriving simultaneously, they cancel out (i) and no spike is fired (j). This demonstrates the XOR task operation. The truth table for the task is included for reference.
5. Perspective: towards nanoscale RTD-based optoelectronic spiking nodes
Following the experimental results on the system’s refractoriness (Figure 2), the lower bound on the time-interval between two consecutively fired spiking events is approx. 100 ns. This already allows for spiking rates at up to 10 MHz with this proof-of-concept experimental system demonstration. With further optimizations, we believe higher speeds are attainable since RTD oscillator circuits can operate at much faster frequencies, typically governed by the circuit’s layout and parameters, e.g. (parasitic) inductance of the circuit L and capacitance C, among other factors. Simultaneously, it is of vital importance to explore the prospects of component integration and spatial footprint reduction.
To highlight the feasibility of RTD optoelectronic circuits for high-speed spiking functionalities with highly-reduced footprints, we investigate numerically the operation of a nanoscale monolithic PRL node comprising in its structure an RTD capable of operating at beyond GHz spiking rates. Similarly to the experimental results on the PRL system built with the off-the-shelf components, the numerical model investigating the operation of a nanoscale-PRL node combines three main functional elements: a voltage-coupled photodetector term; a two-dimensional system of ordinary differential equations describing the evolution of I and V in a nanoscale RTD-based circuit; and a two-dimensional nanolaser model with an included stochastic noise term. The dynamics of the nanoscale PRL are modelled using a set of ordinary differential equations:
| (1) |
| (2) |
| (3) |
| (4) |
where V is the voltage along the RTD, I(t) is the total current in the circuit, S(t) is the photon number and N(t) is the carrier number. In difference to previous works [41], the RTD (first two Eqns.) and laser (last two Eqns.) models are coupled through the voltage term to represent same behaviour as observed experimentally, where RF signals are AC-coupled directly to the laser through a bias-tee network. The PD element is coupled as a voltage modulation via the RκS 0(t) term, where κ represents the opto-electrical conversion factor of the PD (sensitivity, in units of current per photon count), hence defining Rκ as the detector conversion gain.
The I–V characteristic (Figure 5(a)) of the RTD is based on a physical model by Schulman [57] with A = −5.5 × 10−5, B = 0.033, C = 0.113, D = −2.8 × 10−6, N1 = 0.185, N2 = 0.045, H = 18 × 10−5, yielding a highly nonlinear I–V curve with NDC region between 609 mV and 720 mV. The circuit parameters used are V 0 = 580 mV, R = 10 Ω, R 0 = 50 Ω, L = 126 × 10−9 H, C = 2 × 10−15 F, κ = 4 × 10−7. The parameters used for the laser model are N t = 5 × 105, α = 2, τ p = 5 × 10−13 s, γ m = 1 × 107 s−1, γ l = 1 × 109 s−1, γ nr = 2 × 109 s−1, η = 0.2. As shown in Figure 5, an incoming optical perturbation in the form of a 20 ps long pulse (Figure 5(b)) is sufficient to trigger an ultrafast (sub-ns) spiking response with amplitude of over 1 V peak-peak (Figure 5(c)). Direct comparison with the traces displayed in Figure 1(e) confirms very good agreement between the dynamics observed experimentally with the macroscopic PRL node (PD-RTD-VCSEL design) and numerically for the modelled nanoscale PRL system. This signal is then fed into the nanolaser within the nano-PRL node’s structure, resulting in high speed optical spikes (Figure 5(d)). In addition to the consistency between the numerical and experimental dynamics, we must note that the nanoscale PRL system allows for significantly improved spiking rates, currently projected as almost three magnitudes faster than those obtained in our experiments with the PD-RTD-VCSEL based PRL system. To obtain the estimate of upper limit on the spiking rate of this nanoscale PRL model, we performed a spiking refractoriness evaluation by using pairs of pulses with gradually increasing temporal separation (the same test that was carried out experimentally in Figure 2). The achieved lowest temporal separation between two input pulses that reliably elicited a pair of spiking responses from the nanoscale PRL node was 300 ps (Figure 5), resulting in a maximum theoretical spiking rate of 3.3 GHz. Ultimately, with RTD bandwidths previously demonstrated up to the THz band, the expected operation speeds in a nano-PRL are expected to be capped ( 100 GHz) by the nanolaser [58]. Since excitable spiking relies upon input signal thresholding, it provides an inherent degree of robustness to noise which is likely to be beneficial in the case of nanoscale, high-speed devices. Furthermore, we validate in theory that the same coincidence detection functionality (as demonstrated experimentally in Figure 3) can be achieved with the nanoscale PRL node, yet again at significantly faster rates. In Figure 6, a pair of 60 ps optical pulses of amplitude S 0 = 1000 is incident on the PD element of the nano-PRL node. For either no temporal shift (Δ = 0 ps, Figure 6(a)) or small temporal shifts preserving some overlap between the input pulses (Δ = 30 ps, Figure 6(b)), the system performs coincidence detection by firing a sub-ns spike. Higher separation times between input pulses do not elicit a spiking response (Figure 6(c) and (d)). Therefore, the model confirms the functionality observed in the experimental PRL node also for the monolithically-integrated nanoscale PRL node and at higher processing speeds.
Figure 5:
Numerical simulation of a PD-RTD-LD system. (a) I–V characteristic of a nano-scale RTD, with highlighted NDC region, voltage bias (fine dashed line) and evolution of the system states during the spiking event, showing the dynamical limit cycle. (b) Example of an electrical trigger signal. (c) Electrical response of the nano-RTD. (d) Optical response of a voltage-coupled nanoscale RTD-LD system. (e) Demonstration of firing of a pair of consecutive optical spikes, elicited in the system when subject to the arrival of a pair of input perturbations with temporal separation of 300 ps.
Figure 6:

Numerical validation of the two-pulse coincidence detection task. Two positive square pulses encoded in the optical input signal trigger an excitable response in the PRL model only when both arrive into the node at the same (Δ = 0 ps, (a)) or nearly the same time (Δ = 30 ps, (b)). Pulse pairs with larger temporal separation (c, d) do not trigger an excitable response in the modelled nanoscale PRL node.
6. Conclusions
This work demonstrates experimentally a RTD-based optoelectronic circuit operating as an excitable, spiking artificial neuron, benefiting from optical I/O ports, allowing its use in prospective optically interlinked spiking photonic neural networks. The system, referred to as PRL node, combines in its layout a micrometric InGaAs/AlAs RTD element with high PVCR coupled to a photodetector and a telecom-wavelength VCSEL, providing respectively the optical input and output of the PRL node. We have demonstrated how such system allows for multiple optical pulsating (spiking) input signals (here n = 2) to be summed up on the photodetector of the node in a wavelength-independent manner, allowing for additional robustness in operation and lower demands on coherence and precise wavelength selection in future interconnected systems based upon interlinked PRL nodes. We have also shown the presence of a well-defined excitability threshold in the system, and a spiking refractory period of T ref ≈ 90 ns in the proof-of-concept system realisation of this work. This allows already, without any additional system optimisation stage, a reliable activation of all-or-nothing spiking responses at up to 10 MHz rates. By further optimization of RTD’s electronic circuit and by progressing towards monolithically-integrated structures with highly reduced dimensions, we believe the operation speed can be significantly increased. We validate this claim numerically, showing that the experimentally achieved spiking functionalities can be also obtained with a nanoscale RTD-based O/E/O system at GHz rates. Finally, we have successfully demonstrated spike-based processing tasks with the proposed PRL node, including a coincidence detection (logical AND) as well as an exclusive OR (XOR) task using an additional pre-processing network layer. These results provide the first investigation and proof-of-concept demonstration of an O/E/O RTD-based, deterministically activated spiking photonic neuron. Future research will focus on system optimisation towards faster spiking rates reaching GHz speeds, as well as on the development of improved RTD devices with embedded optical windows to allow direct photodetection in the RTD structure; thus permitting to eliminate the currently used externally-coupled PD module. Additionally, we will focus on experimental validation of signal propagation between master-receiver PRL nodes, ultimately aiming towards photonic spiking neural networks powered by artificial excitable optoelectronic neurons.
Acknowledgement
The authors would also like to acknowledge J. Iwan Davies from IQE for providing the epitaxial growth for RTD fabrication.
Footnotes
Author contributions: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.
Research funding: The authors acknowledge support by the European Commission (Grant 828841-ChipAI-H2020-FETOPEN-2018-2020) and by the UK Research and Innovation (UKRI) Turing AI Acceleration Fellowships Programme (EP/V025198/1).
Conflict of interest statement: The authors declare no conflicts of interest regarding this article.
Contributor Information
Matěj Hejda, Email: matej.hejda@strath.ac.uk.
Ekaterina Malysheva, Email: e.malysheva@tue.nl.
Dafydd Owen-Newns, Email: dafydd.owen-newns@strath.ac.uk.
Qusay Raghib Ali Al-Taai, Email: qusayraghibali.al-taai@glasgow.ac.uk.
Weikang Zhang, Email: weikang.zhang@strath.ac.uk.
Ignacio Ortega-Piwonka, Email: ignacio.ortega.piwonka@gmail.com.
Julien Javaloyes, Email: Julien.Javaloyes@uib.es.
Edward Wasige, Email: edward.wasige@glasgow.ac.uk.
Victor Dolores-Calzadilla, Email: v.calzadilla@tue.nl.
José M. L. Figueiredo, Email: jmfigueiredo@fc.ul.pt.
Bruno Romeira, Email: bruno.romeira@inl.int.
Antonio Hurtado, Email: antonio.hurtado@strath.ac.uk.
References
- [1].Ramesh A., Pavlov M., Goh G., et al. Zero-shot text-to-image generation. . 2021 arXiv: 2102.12092 [cs] [Google Scholar]
- [2].Jumper J., Evans R., Pritzel A., et al. Highly accurate protein structure prediction with AlphaFold. Nature. 2021;596(7873):583–589. doi: 10.1038/s41586-021-03819-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [3].Brown T. B., Mann B., Ryder N., et al. Language Models Are Few-Shot Learners. 2020. https://arxiv.org/abs/2005.14165 [Google Scholar]
- [4].Neckar A., Fok S., Benjamin B. V., et al. Braindrop: a mixed-signal neuromorphic architecture with a dynamical systems-based programming model. Proc. IEEE. 2019;107(1):144–164. doi: 10.1109/JPROC.2018.2881432. [DOI] [Google Scholar]
- [5].Höppner S., Yan Y., Dixius A., et al. The SpiNNaker 2 Processing Element Architecture for Hybrid Digital Neuromorphic Computing. 2021. [Google Scholar]
- [6].DeBole M. V., Taba B., Amir A., et al. TrueNorth: accelerating from zero to 64 million neurons in 10 years. Computer. 2019;52(5):20–29. doi: 10.1109/MC.2019.2903009. [DOI] [Google Scholar]
- [7].Orchard G., Frady E. P., Rubin D. B. D., et al. 2021 IEEE Workshop on Signal Processing Systems (SiPS) Coimbra, Portugal: IEEE; 2021. Efficient neuromorphic signal processing with loihi 2; pp. 254–259. [Google Scholar]
- [8].Robertson J., Ackemann T., Lester L. F., et al. Externally-triggered activation and inhibition of optical pulsating regimes in quantum- dot mode-locked lasers. Sci. Rep. 2018;8(1):12515. doi: 10.1038/s41598-018-30758-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [9].Sarantoglou G., Skontranis M., Mesaritakis C. All optical integrate and fire neuromorphic node based on single section quantum dot laser. IEEE J. Sel. Top. Quantum Electron. 2020;26(5):1–10. doi: 10.1109/JSTQE.2019.2945549. [DOI] [Google Scholar]
- [10].Schneider M. L., Donnelly C. A., Russek S. E., et al. Ultralow power artificial synapses using nanotextured magnetic josephson junctions. Sci. Adv. 2018;4(1):e1701329. doi: 10.1126/sciadv.1701329. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [11].Toomey E., Segall K., Berggren K. K. Design of a power efficient artificial neuron using supercon- ducting nanowires. Front. Neurosci. . 2019;13:1–12. doi: 10.3389/fnins.2019.00933. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [12].George J. K., Mehrabian A., Amin R., et al. Neuromorphic photonics with electro-absorption modulators. Opt. Express. 2019;27(4):5181. doi: 10.1364/OE.27.005181. [DOI] [PubMed] [Google Scholar]
- [13].Tait A. N., de Lima T. F., Nahmias M. A., et al. Silicon photonic modulator neuron. Phys. Rev. Appl. 2019;11(6):064043. doi: 10.1103/PhysRevApplied.11.064043. [DOI] [Google Scholar]
- [14].Mourgias-Alexandris G., Totović A., Tsakyridis A., et al. Neuromorphic photonics with coherent linear neurons using dual-IQ modula- tion cells. J. Lightwave Technol. 2020;38(4):811–819. doi: 10.1109/JLT.2019.2949133. [DOI] [Google Scholar]
- [15].Mourgias-Alexandris G., Tsakyridis A., Passalis N., et al. An all-optical neuron with sigmoid activation function. Opt. Express. 2019;27(7):9620. doi: 10.1364/OE.27.009620. [DOI] [PubMed] [Google Scholar]
- [16].Shi B., Calabretta N., Stabile R. InP photonic integrated multi-layer neural networks: architecture and performance analysis. APL Photonics . 2021;7:1–12. doi: 10.1063/5.0066350. [DOI] [Google Scholar]
- [17].Coomans W., Gelens L., Beri S., et al. Solitary and coupled semiconductor ring lasers as optical spiking neurons. Phys. Rev. E. 2011;84(3):036209. doi: 10.1103/PhysRevE.84.036209. [DOI] [PubMed] [Google Scholar]
- [18].Tait A. N., Ferreira de Lima T., Zhou E., et al. Neuromorphic photonic networks using silicon photonic weight banks. Sci. Rep. . 2017;7(1):7430. doi: 10.1038/s41598-017-07754-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [19].Xiang J., Torchy A., Guo X., et al. All-optical spiking neuron based on passive microresonator. J. Lightwave Technol. 2020;38(15):4019–4029. doi: 10.1109/JLT.2020.2986233. [DOI] [Google Scholar]
- [20].Feldmann J. et al. All-optical spiking neurosynaptic networks with self-learning capabilities. Nature. 2019;569(7755):208–214. doi: 10.1038/s41586-019-1157-8. N.Youngblood C.D.Wright [DOI] [PMC free article] [PubMed] [Google Scholar]
- [21].Carrillo S. G. C., Gemo E., Li X., et al. Behavioral modeling of integrated phase-change photonic devices for neuromorphic computing applications. APL Mater. 2019;7(9):091113. doi: 10.1063/1.5111840. [DOI] [Google Scholar]
- [22].Turconi M., Garbin B., Feyereisen M., et al. Control of excitable pulses in an injection-locked semiconductor laser. Phys. Rev. E. 2013;88(2):022923. doi: 10.1103/PhysRevE.88.022923. [DOI] [PubMed] [Google Scholar]
- [23].Hejda M., Robertson J., Bueno J., et al. Spike-based information encoding in vertical cavity surface emitting lasers for neuromorphic photonic systems. J. Phys.: Photonics. 2020;2(4):044001. doi: 10.1088/2515-7647/aba670. [DOI] [Google Scholar]
- [24].Robertson J., Wade E., Kopp Y., et al. Toward neuromorphic photonic networks of ultrafast spiking laser neurons. IEEE J. Sel. Top. Quantum Electron. 2020;26(1):1–15. doi: 10.1109/JSTQE.2019.2931215. [DOI] [Google Scholar]
- [25].Nahmias M. A., Shastri B. J., Tait A. N., et al. A leaky integrate-and-fire laser neuron for ultrafast cognitive computing. IEEE J. Sel. Top. Quantum Electron. 2013;19(5):1–12. doi: 10.1109/JSTQE.2013.2257700. [DOI] [Google Scholar]
- [26].Selmi F., Braive R., Beaudoin G., et al. Relative refractory period in an excitable semiconductor laser. Phys. Rev. Lett. 2014;112(18):183902. doi: 10.1103/PhysRevLett.112.183902. [DOI] [PubMed] [Google Scholar]
- [27].Pammi A. V., Alfaro-Bittner K., Clerc M. G., Barbay S. Photonic Computing With Single and Coupled Spiking Micropillar Lasers. IEEE J. Sel. Top. Quantum Electron. . 2020;26(1):1–7. doi: 10.1109/JSTQE.2019.2929187. [DOI] [Google Scholar]
- [28].Xiang S., Ren Z., Song Z., et al. Computing primitive of fully VCSEL-based all-optical spiking neural network for super- vised learning and pattern classification. IEEE Trans. Neural Netw. Learn. Syst. . 2021;32(6):1–12. doi: 10.1109/TNNLS.2020.3006263. [DOI] [PubMed] [Google Scholar]
- [29].Zhang Z., Wu Z., Lu D., et al. Controllable spiking dynamics in cascaded VCSEL-SA photonic neurons. Nonlinear Dyn. . 2019;99:1103–1114. doi: 10.1007/s11071-019-05339-1. [DOI] [Google Scholar]
- [30].Zhang Y., Robertson J., Xiang S., et al. All-optical neuromorphic binary convolution with a spiking VCSEL neuron for image gradient magnitudes. Photonics Res. 2021;9(5):B201. doi: 10.1364/PRJ.412141. [DOI] [Google Scholar]
- [31].Robertson J., Hejda M., Bueno J., et al. Ultrafast optical integration and pattern classification for neuromorphic photonics based on spiking VCSEL neurons. Sci. Rep. 2020;10(1):6098. doi: 10.1038/s41598-020-62945-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [32].Hejda M., Robertson J., Bueno J., Alanis J. A., Hurtado A. Neuromorphic encoding of image pixel data into rate-coded optical spike trains with a photonic VCSEL-neuron. APL Photonics . 2021;6(6):060802. doi: 10.1063/5.0048674. [DOI] [Google Scholar]
- [33].Heuser T., Pflüger M., Fischer I., et al. Developing a photonic hardware platform for brain-inspired computing based on 5 × 5 VCSEL arrays. J. Phys.: Photonics. 2020;2(4):044002. doi: 10.1088/2515-7647/aba671. [DOI] [Google Scholar]
- [34].Izumi R., Suzuki S., Asada M. 2017 42nd International Conference on Infrared, Millimeter, and Terahertz Waves (IRMMW-THz) IEEE; 2017. 1.98 THz resonant-tunneling-diode oscillator with reduced conduction loss by thick antenna electrode; pp. 1–2. [Google Scholar]
- [35].Weng Q., An Z., Zhang B., et al. Quantum dot single-photon switches of resonant tunneling current for discriminating- photon-number detection. Sci. Rep. 2015;5(1):9389. doi: 10.1038/srep09389. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [36].Pfenning A., Hartmann F., Langer F., et al. Sensitivity of resonant tunneling diode photodetectors. Nanotechnology. 2016;27(35):355202. doi: 10.1088/0957-4484/27/35/355202. [DOI] [PubMed] [Google Scholar]
- [37].Nishida Y., Nishigami N., Diebold S., et al. Terahertz coherent receiver using a single resonant tunnelling diode. Sci. Rep. 2019;9(1):18125. doi: 10.1038/s41598-019-54627-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [38].Miyamoto T., Yamaguchi A., Mukai T. Terahertz imaging system with resonant tunneling diodes. Jpn. J. Appl. Phys. 2016;55(3):032201. doi: 10.7567/JJAP.55.032201. [DOI] [Google Scholar]
- [39].Wang J., Al-Khalidi A., Wang L., et al. 15-Gb/s 50-Cm wireless link using a high-power compact III-V 84-GHz transmitter. IEEE Trans. Microw. Theory Tech. . 2018;66(11):1–8. doi: 10.1109/TMTT.2018.2859983. [DOI] [Google Scholar]
- [40].Zhang W., Watson S., Figueiredo J., et al. Optical direct intensity modulation of a 79GHz resonant tunneling diode-photodetector oscillator. Opt. Express. 2019;27(12):16791. doi: 10.1364/OE.27.016791. [DOI] [PubMed] [Google Scholar]
- [41].Romeira B., Javaloyes J., Ironside C. N., et al. Excitability and optical pulse generation in semiconductor lasers driven by resonant tunneling diode photo-detectors. Opt. Express. 2013;21(18):20931. doi: 10.1364/OE.21.020931. [DOI] [PubMed] [Google Scholar]
- [42].Hänggi M., Chua L. O. Cellular neural networks based on resonant tunnelling diodes. Int. J. Circuit Theory Appl. 2001;29(5):487–504. doi: 10.1002/cta.172. [DOI] [Google Scholar]
- [43].Mazumder P., Li S. R., Ebong I. E. Tunneling-based cellular nonlinear network architectures for image processing. IEEE Trans. Very Large Scale Integr. (VLSI) Syst. 2009;17(4):487–495. doi: 10.1109/TVLSI.2009.2014771. [DOI] [Google Scholar]
- [44].Al-Taai Q., Morariu R., Wang J., et al. 2021 16th European Microwave Integrated Circuits Conference (EuMIC) IEEE; 2022. Towards an excitable microwave spike generator for future neuromorphic computing; pp. 386–389. [Google Scholar]
- [45].Zhang W., Al-Khalidi A., Figueiredo J., et al. Analysis of excitability in resonant tunneling diode-photodetectors. Nanomaterials. 2021;11(6):1590. doi: 10.3390/nano11061590. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [46].Romeira B., Avó R., Figueiredo J. M. L., et al. Regenerative memory in time-delayed neuromorphic photonic resonators. Sci. Rep. 2016;6(1):19510. doi: 10.1038/srep19510. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [47].Hartmann F., Gammaitoni L., Höfling S., et al. Light-induced stochastic resonance in a nanoscale resonant-tunneling diode. Appl. Phys. Lett. 2011;98(24):96–99. doi: 10.1063/1.3600329. [DOI] [Google Scholar]
- [48].Romeira B., Figueiredo J. M. L., Javaloyes J. NanoLEDs for energy-efficient and gigahertz-speed spike-based sub-λ neuromorphic nanophotonic computing. Nanophotonics . 2020;9(13):4149–4162. doi: 10.1515/nanoph-2020-0177. [DOI] [Google Scholar]
- [49].Ortega-Piwonka I., Hejda M., Alanis J. A., et al. Spike propagation in a nanolaser-based optoelectronic neuron. Opt. Mater. Express . 2022;12(7):2679–2696. doi: 10.1364/OME.451706. [DOI] [Google Scholar]
- [50].Hejda M., Alanis J. A., Ortega-Piwonka I., et al. Resonant tunneling diode nano-optoelectronic excitable nodes for neuromorphic spike- based information processing. Phys. Rev. Appl. 2022;17(2):024072. doi: 10.1103/PhysRevApplied.17.024072. [DOI] [Google Scholar]
- [51].Bruno R., Nieder J. B., Jacob B., et al. Subwavelength neuromorphic nanophotonic integrated circuits for spike-based computing: challenges and prospects. In: Volpe G., Pereira J. B., Brunner D., Ozcan A., editors. Emerging Topics in Artificial Intelligence (ETAI) 2021. San Diego, United States: SPIE; 2021. p. 11. [Google Scholar]
- [52].Cheng H. T., Yang Y. C., Liu T. H., et al. Recent advances in 850 Nm VCSELs for high-speed interconnects. Photonics. 2022;9(2):107. doi: 10.3390/photonics9020107. [DOI] [Google Scholar]
- [53].Agmon-Snir H., Carr C. E., Rinzel J. The role of dendrites in auditory coincidence detection. Nature. 1998;393(6682):268–272. doi: 10.1038/30505. [DOI] [PubMed] [Google Scholar]
- [54].Stevens C. F., Zador A. M. Input synchrony and the irregular firing of cortical neurons. Nat. Neurosci. 1998;1(3):210–217. doi: 10.1038/659. [DOI] [PubMed] [Google Scholar]
- [55].George J. K., Soci C., Miscuglio M., et al. Symmetry perception with spiking neural networks. Sci. Rep. 2021;11(1):5776. doi: 10.1038/s41598-021-85232-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [56].Minsky M., Papert S. Perceptrons: An Introduction to Computational Geometry. Cambridge, MA, USA: MIT Press; 1988. [Google Scholar]
- [57].Schulman J. N., De Los Santos H. J., Choi D. H. Physics-Based RTD current-voltage equation. IEEE Electron Device Lett. 1996;17(5):220–222. doi: 10.1109/55.491835. [DOI] [Google Scholar]
- [58].Romeira B., Fiore A. Purcell effect in the stimulated and spontaneous emission rates of nanoscale semiconductor lasers. IEEE J. Quantum Electron. 2018;54(2):1–12. doi: 10.1109/JQE.2018.2802464. [DOI] [Google Scholar]




