Skip to main content
Advanced Science logoLink to Advanced Science
. 2022 Jan 14;9(9):2105076. doi: 10.1002/advs.202105076

Self‐Powered Artificial Mechanoreceptor Based on Triboelectrification for a Neuromorphic Tactile System

Joon‐Kyu Han 1, Il‐Woong Tcho 1, Seung‐Bae Jeon 2, Ji‐Man Yu 1, Weon‐Guk Kim 1, Yang‐Kyu Choi 1,
PMCID: PMC8948587  PMID: 35032113

Abstract

A self‐powered artificial mechanoreceptor module is demonstrated with a triboelectric nanogenerator (TENG) as a pressure sensor with sustainable energy harvesting and a biristor as a neuron. By mimicking a biological mechanoreceptor, it simultaneously detects the pressure and encodes spike signals to act as an input neuron of a spiking neural network (SNN). A self‐powered neuromorphic tactile system composed of artificial mechanoreceptor modules with an energy harvester can greatly reduce the power consumption compared to the conventional tactile system based on von Neumann computing, as the artificial mechanoreceptor module itself does not demand an external energy source and information is transmitted with spikes in a SNN. In addition, the system can detect low pressures near 3 kPa due to the high output range of the TENG. It therefore can be advantageously applied to robotics, prosthetics, and medical and healthcare devices, which demand low energy consumption and low‐pressure detection levels. For practical applications of the neuromorphic tactile system, classification of handwritten digits is demonstrated with a software‐based simulation. Furthermore, a fully hardware‐based breath‐monitoring system is implemented using artificial mechanoreceptor modules capable of detecting wind pressure of exhalation in the case of pulmonary respiration and bending pressure in the case of abdominal breathing.

Keywords: biristor neuron, breath monitoring, mechanoreceptors, spiking neural network, triboelectric nanogenerators


A self‐powered artificial mechanoreceptor module is demonstrated for a neuromorphic tactile system. It can greatly reduce the required amount of energy compared to the conventional tactile system based on a von Neumann computer. It can detect low pressures near 3 kPa due to the high output range of the triboelectric nanogenerator. A fully hardware‐based breath‐monitoring system is implemented.

graphic file with name ADVS-9-2105076-g005.jpg

1. Introduction

Artificial tactile perception systems are useful in the development of robotics, prosthetics, and medical and healthcare devices because they are capable of object, pattern, or texture recognition with high accuracy by processing the signals received from sensor arrays through a deep neural network (DNN).[ 1 , 2 , 3 , 4 ] However, most of these systems are based on software that requires an advanced von Neumann computer, which is difficult to integrate into edge devices owing to its high power requirements. Implementation of an artificial tactile perception system on edge devices such as, an IoT sensor, a smartphone, and a smart watch is important because communication failure between edge devices or between an edge device and a server computer can cause significant economic loss and human injury.[ 5 , 6 , 7 ] If the power consumed by edge devices is high due to the use of a von Neumann computer, energy should be repeatedly supplied, which can be difficult to manage by periodically replacing or recharging a battery. Therefore, a different sustainable approach should be developed as opposed to a bulky computer consuming a large amount of power in order to implement a scalable artificial tactile perception system on edge devices.

A biological tactile perception system recognizes objects, patterns, or textures by transmitting sensory information in the form of spikes, and is considered a key approach to realize low energy consumption.[ 8 , 9 , 10 , 11 , 12 , 13 ] The imitation of biological spike transmission is considered a powerful means to build a low‐power tactile perception system, and neuromorphic tactile perception systems based on spiking neural networks (SNNs) have thus attracted considerable attention.[ 14 , 15 , 16 , 17 ] In addition, von Neumann bottlenecks between the central processing unit and the memory for the implementation of software‐based DNNs can also be eliminated. Therefore, neuromorphic tactile perception systems based on SNNs are advantageous when applied to edge devices given their low power consumption. The first step toward neuromorphic tactile perception is to convert the pressure signals into spikes so that they can be used as inputs to SNNs because signals acquired from the environment are in the continuous and analog domain. In biology, mechanoreceptors perform this function, accepting mechanical signals and transmitting electrical spike signals to the cortex for neural processing, as illustrated in Figure  1a.[ 10 , 11 , 12 ] However, general pressure sensors cannot be applied because the outputs are not in the form of spikes.

Figure 1.

Figure 1

Biological and artificial tactile perception system: a) Schematic of the biological tactile perception system. Mechanoreceptors generate spike signals when pressure is detected and send these signals to the cortex for neural processing. The spikes are generated more frequently when the intensity of the stimuli increases. b) Schematic of the artificial tactile perception system. The self‐powered artificial mechanoreceptor module consists of a triboelectric nanogenerator (TENG) sensor with energy harvesting and a biristor neuron; it can generate spike signals that vary depending on the applied pressure. The spike signals are transmitted to the synapses and neurons that compose the spiking neural network (SNN) for neural processing.

In relation to this, Zhang et al. demonstrated an artificial mechanoreceptor module with a piezoelectric nanogenerator and a Mott memristor neuron.[ 14 ] It could generate spikes as a function of the input pressure, which is a desirable characteristic of an artificial mechanoreceptor. The module did not require an extra power supply to generate spikes due to its use of a nanogenerator. Although this work set a milestone in self‐powered artificial sensory systems, further studies should be performed to use them to practical applications such as, robotics, prosthetics, medical, or healthcare devices, because the response to low pressure levels is important for these applications, considering that human can feel gentle touches during daily activities less than 10 kPa.[ 18 , 19 , 20 ] Recently, Li et al. demonstrated an artificial mechanoreceptor module capable of responding to pressures of less than 10 kPa, but an additional power source was necessary because the pressure sensor was a type of resistor.[ 21 ] Another approach that is capable of detecting low pressure levels without a power source therefore should be developed. In addition, further system‐level studies should be performed to utilize an artificial mechanoreceptor in an actual tactile perception system.

In this work, a self‐powered artificial mechanoreceptor module composed of a triboelectric nanogenerator (TENG) for a sensor with sustainable energy and a biristor for a neuron was demonstrated, not as a complex circuit but rather as a single device. The name of the biristor stems from a bi‐stable resistor that can stably make a high‐resistance state (HRS) and a low‐resistance state (LRS), and serve as a single transistor neuron by directly converting input current to output voltage spiking.[ 22 ] When pressure is applied, the output current from the TENG is transmitted to the biristor neuron as an input current. Thereby the characteristic of a mechanoreceptor is realized, where the spiking varies with the applied pressure. Unlike previous work, it can detect low pressures near 3 kPa because the output range of the TENG is much higher than that of other types of nanogenerators.[ 23 , 24 ] It should be noted that the TENG is considered a promising candidate for application to an artificial tactile perception system, as it offers the advantages of high output, flexibility, and light weight.[ 25 , 26 , 27 , 28 , 29 ] The biristor neuron is considered a possible candidate to replace bulky and high‐energy‐consuming CMOS circuit‐based spiking neurons for SNNs.[ 30 , 31 , 32 ] After analyzing the characteristics of the TENG and the biristor neuron, a self‐powered artificial mechanoreceptor module capable of detection near 3 kPa that is able to sense a gentle touch such as, handwriting and breathing is realized by connecting the two abovementioned components. Based on the spiking characteristics according to the pressure, classification of handwritten digits in the Modified National Institute of Standards and Technology (MNIST) dataset is performed with the aid of a software simulation in order to demonstrate that complex pattern recognition is possible with the neuromorphic tactile system composed of an artificial mechanoreceptor module. Furthermore, a fully hardware‐based breath‐monitoring system that can classify exhalation and inhalation is implemented by using wind pressure of exhalation in the case of pulmonary respiration and bending pressure in the case of abdominal breathing. The proposed multi‐way detectability of the artificial mechanoreceptor module that can sense different types of pressure is favorable for various healthcare applications.

2. Results and Discussion

2.1. Structure of an Artificial Mechanoreceptor Module

A self‐powered artificial mechanoreceptor module was implemented by serially connecting a TENG sensor with energy harvesting and a biristor neuron, as shown in Figure 1b. When pressure is applied to the TENG, the generated current is transmitted to the collector (C) of the biristor neuron and spike‐shaped voltage signals are generated from the same C of the biristor neuron. Therefore, a set consisting of a TENG sensor and a biristor neuron can act as an artificial mechanoreceptor module that generates spike signals when pressure is detected. In addition, as the applied pressure to the TENG increases, the spiking frequency (f) of the artificial mechanoreceptor module increases because a greater level of current is transmitted to the biristor neuron from the TENG. Note that an extra power source is unnecessary to implement the artificial mechanoreceptor, which is advantageous for a low‐power tactile perception system. Hybrid integration to combine a TENG and an electronic device such as a transistor and a nonvolatile memory becomes increasingly important for self‐powered electronics.[ 33 , 34 ] The proposed TENG is like a self‐aware sensor that can awaken when an external stimulus is applied. The spike signals will be further transmitted to the next synapses and neurons that compose the SNN.

2.2. Characteristics of a Triboelectric Nanogenerator

In this work, a TENG comprising two aluminum (Al) plates as an electrode and a polytetrafluoroethylene (PTFE) film as a triboelectric layer was utilized, as shown in Figure  2a. It is well known that a TENG is advantageous for adapting its structure according to various mechanical input stimuli with a variety of forms customized to a targeted device. The fabrication details are provided in Figure S1, Supporting Information. The TENG has a length and a width of 4 cm, and the thickness of the PTFE film is 100 µm. In addition, a micro‐nano hierarchical morphological structure was formed on the surface of the PTFE film in order to increase the electrical output and improve the pressure sensitivity by enlarging the effective contact area during the electrification via contact‐separation between the Al electrode and the PTFE. For the formation of the micro‐nano hierarchical morphology, gold nano‐islands, which were served as hard mask during subsequent etching, were evaporated on the surface of the PTFE film. Upon subsequent plasma etching with a mixed gas of O2, Ar, and CF4, a vertical rod‐like micro‐nano morphology was formed on the surface of the PTFE film, as shown in Figure 2b. This TENG is operated by linear force in contact‐separation mode. Alternating current (AC) power is generated by alternating contact and separation of the upper electrode and the PTFE film. The lower electrode is attached onto the rear surface of the PTFE film. The detailed operational mechanism of this TENG is depicted in Figure 2a. The surface of the PTFE film is charged negatively via contact electrification with the upper electrode. When the upper electrode is forced to get close to the PTFE film, current flows from the lower electrode to the upper electrode. Subsequently, when the upper electrode moves away from the PTFE film, current flows from the upper electrode to the lower electrode. As the contact pressure increases, the magnitude of the current of the TENG increases due to a greater amount of surface charge.[ 35 ] With the micro‐nano morphology of the PTFE film, high pressure sensitivity can be achieved.[ 36 ] The measured open‐circuit voltage (V OC) and short‐circuit current (I SC) of the TENG were ≈60 V and 370 nA, respectively, with a contact pressure of 5.3 kPa, as correspondingly shown in Figure 2c,d. When the contact pressure was increased from 3.2 kPa, the I SC of the TENG increased linearly, as presented in Figure 2e. To investigate the output power (P out) of the TENG, the output current (I out) was measured when the load resistance (R) ranged from 1 Ω to 500 MΩ, as shown in Figure 2f. As R increased from 10 MΩ, I out decreased. In addition, P out was calculated using the following equation:

Pout=Iout2R (1)

Figure 2.

Figure 2

Characteristics of the TENG: a) Schematic of the operational mechanism of the fabricated TENG. b) Scanning electron microscopy (SEM) image of the surface of the PTFE film. A micro‐nano morphology was formed on the surface of the PTFE film. c) Open‐circuit voltage (V OC) of the TENG with a pressure level of 5.3 kPa. d) Short‐circuit current (I SC) of the TENG with a pressure level of 5.3 kPa. e) Short‐circuit current (I SC) according to the pressure of the TENG. I SC increased when more pressure was applied. f) Output current (I out) and output power (P out) according to the load resistance (R) of the TENG.

A maximum instantaneous P out of 4 µW was achieved with an R value of 100 MΩ. The output characteristics of this TENG are high even with a small amount of contact pressure. This is attributed to two features. One is that the PTFE is a highly triboelectric negative material and the other is that the effective contact area is enhanced by the micro‐nano morphology.

2.3. Characteristics of a Biristor Neuron

A biristor neuron can mimic a neuronal integrate‐and‐fire (IF) function and spiking operation by means of the single‐transistor latch (STL) phenomenon.[ 30 , 31 , 32 ] In this work, a biristor neuron with a base width (W B) of 250 nm and a base length (L B) of 500 nm was fabricated, as shown in the scanning electron microscope (SEM) image in Figure  3a. The fabrication details are provided in Figure S2, Supporting Information. Starting with p‐type (100) silicon‐on‐insulator (SOI) wafer, an active area was patterned using photo‐lithography and plasma etching. Afterwards, a dummy gate with gate dielectrics was deposited and patterned by another photo‐lithography and plasma etching. Then, doping for an emitter and a collector (E/C) was followed with arsenic implantation and the E/C dopants were activated by subsequent rapid thermal annealing (RTA). After that, base (B) doping was performed by boron implantation and subsequent RTA was followed. Figure 3b shows the current–voltage (IV) characteristics of the fabricated biristor neuron, which was measured with a parameter analyzer. Note that a large current abruptly flowed at a certain latch‐up voltage (V latch) via the STL phenomenon. In detail, increased voltage makes electrons in the E be injected to the B, which trigger impact ionization and e‐h pair generation. Then, the generated holes are stored in the B and reduce the potential barrier between the E and the B. Therefore, more electrons are injected into the B and more proliferated holes are generated by the iterative impact ionization. This is a kind of positive feedback that triggers latch‐up, which is a catastrophic current change. As a result, the device was in a HRS when the applied voltage was lower than V latch, changing to a LRS when the applied voltage exceeded V latch. This allows the instant firing and spiking operation of the neuron.[ 30 , 31 , 32 ]

Figure 3.

Figure 3

Characteristics of the biristor neuron: a) SEM image of the fabricated biristor neuron. b) Current–voltage characteristics (IV) of the fabricated biristor neuron. A large amount of current abruptly flowed at a certain latch‐up voltage (V latch) by the single‐transistor latch (STL) phenomenon, which allows the firing step during the operation of the neuron. c) Spiking characteristics (V outt) of the fabricated biristor neuron, showing the typical spiking properties of a integrate‐and‐fire (IF) neuron. d) Spiking frequency (f) according to the input current (I in) of the fabricated biristor neuron. Here, f increased with an increase in I in because the integration speed increased.

To confirm the neuronal operation, constant input current (I in) that corresponds to the output current (I out) from the aforementioned TENG was applied to the C and the output voltage (V out) was measured at the same C while the E was grounded. An external parasitic capacitor with capacitance (C par) of 10 nF was connected to the biristor in parallel. Figure 3c shows the neuronal spiking characteristics of the biristor neuron, which is represented by V out according to time. When I in was applied to C, positive charges were integrated because the device was initially in the HRS. According to this integration process of the IF neuron, V out measured at C was increased by the integration of the positive charges in the parasitic capacitor. When V out reached the firing threshold voltage (V T,firing), which is identical to V latch, the integrated charges in the parasitic capacitor were suddenly fired because the biristor changed to the LRS via the STL. In this way, neuronal spiking characteristics could be achieved by iterative integration and firing when a constant I in was applied. As shown in Figure 3d, f increased when I in increased because the integration speed was increased, which can be represented by the following equation: =IinCpar×(VT,firingVlow), where V low is the bottom output voltage of the spiking process. Therefore, it can be expected that f of the artificial mechanoreceptor module increases when the I out from the TENG increases due to the higher pressure. It is worth noting that I in should be higher than the lower boundary of the forbidden region (I limit) marked in Figure 3b.[ 30 , 31 , 32 ] Unless I in is larger than I limit, charge integration cannot be enabled. This feature is similar to a biological neuron function where spiking is disabled when the input stimulus does not exceed a threshold value.

2.4. Characteristics of an Artificial Mechanoreceptor Module

Figure  4 shows the spiking characteristics of the artificial mechanoreceptor module obtained by connecting the TENG sensor and the biristor neuron. Detailed configuration of the electrical connection between them is shown in Figure S3, Supporting Information. Pressure was applied with an electrodynamic shaker and V out was measured using a parameter analyzer. As shown in Figure 4a, when the pressure was applied, V out increased until it reached V T,firing because the I out from the TENG flowed into the biristor neuron as the I in. Spiking was then repeated until the Al electrode and the PTFE were separated from each other. V out decreased rapidly when they were far apart because the output current from the TENG flowed out in a direction opposite to that of the biristor neuron. Figure 4b shows f of each spike extracted from Figure 4a, and Figure 4c shows the maximum frequency (f max) as a function of the pressure. It was confirmed that f max increased as the pressure increased because the output current from the TENG was increased due to the greater pressure. As a result, the number of spikes in one touch (N spike) increased as the pressure was increased, which is a desired characteristic of the artificial mechanoreceptor module, as shown in Figure 4d.

Figure 4.

Figure 4

Characteristics of the artificial mechanoreceptor module: a) Spiking characteristics (V outt) of the artificial mechanoreceptor module with various applied pressures. b) Spiking frequency (f) over time extracted from V outt. c) Maximum frequency (f max) as a function of the pressure (P). d) The number of spikes during one touch (N spike) as a function of P. Here, f max and N spike increased as P increased, which is a desired characteristic of the mechanoreceptor.

Note that the mechanoreceptor module can respond to low pressures close to 3 kPa due to the higher output of the TENG compared to other types of nanogenerators.[ 23 , 24 ] Therefore, it can be utilized in robotics, prosthetics, and medical and healthcare devices because the human can feel gentle touches during daily activities less than 10 kPa. As mentioned earlier, I in applied to the biristor neuron should be higher than I limit, as marked in Figure 3b. Therefore, I out generated from the TENG should be higher than I limit in order to generate spikes and act as an artificial mechanoreceptor. Therefore, low pressure detection is possible when the I out generated from the TENG is larger than the I limit of 2 nA in the biristor neuron.

The energy consumption in one spike (E/spike) of the artificial mechanoreceptor can be extracted with following equation:[ 31 , 32 ]

E/spike=01fVoutIindt=01fVoutIoutdt (2)

When the applied pressure was 3.2 kPa, the E/spike was extracted as 0.98 nJ per spike. Demanded energy for driving the biristor was sufficiently supplied by the TENG.

2.5. Pattern Recognition Simulation

Using the measured properties of the artificial mechanoreceptor module, a software simulation was conducted to classify handwritten digits using the MNIST dataset. There are two purposes of this simulation. First, we show that complex pattern recognition can be performed using the artificial mechanoreceptor module as the input neuron of a SNN. Although we show pattern recognition with handwritten digits, various object and bio‐signal patterns can be recognized for robotics, prosthetics, and medical and healthcare applications. Second, we show that the classification accuracy can be enhanced when the artificial mechanoreceptor module can respond to lower pressures, which is one of the main advantages of our device.

As shown in Figure  5a, a three‐layer SNN composed of 784 input artificial mechanoreceptor modules (abbreviated as input mechanoreceptors), 100 hidden neurons, and 10 output neurons was constructed. Here, 784 input mechanoreceptors represent each pixel and 10 output neurons represent ten digits from “0” to “9.” The detailed simulation sequence is presented in Figure 5b. It should be noted that the open‐source code produced by Duan et al. was modified for our purposes.[ 37 ] The measured N spike according to the pressure was reflected in the input mechanoreceptors of the SNN. The pressure during tactile perception corresponded to the pixel intensity of the MNIST dataset. It should be noted that in addition to the measured data of N spike according to the pressure, extra data were created by interpolation, as shown in Figure S4a, Supporting Information. In addition, virtual data that cannot respond to low pressures were created in order to confirm the degradation of the classification accuracy when the artificial mechanoreceptor module cannot respond to low pressures. The maximum applied pressure was fixed as 5 kPa because if the tactile system for the handwriting can respond to the gentle touch (<10 kPa), it can be applied to various devices including touchpads. The spikes from the input mechanoreceptors were propagated to a synaptic crossbar and weighted signals were gathered in hidden neurons. The hidden neurons were composed of IF neurons, and they generated spikes when the membrane potential reached V T,firing. The generated spikes were transmitted to the next synaptic crossbar and the weighted signals were gathered in the output neuron. Finally, the spikes of the output neurons were detected in order to predict the digits. Backpropagation was used to train the SNN by comparing predicted and expected results. Instead of a spiking neuron with a step function, a sigmoid activation function was utilized for weight updating of the synapses in order to obtain the gradient during the backpropagation of errors.[ 38 ] It is worth noting that for the IF neurons composing the hidden neurons and the output neurons, V T,firing was set to 3.7 V and C par was set to 10 nF, reflecting the measured electrical characteristics from the fabricated biristor neuron (Figure 3c). Ideal synapses with linear and symmetric conductance changes with seven bits for their states were used.

Figure 5.

Figure 5

Software simulation for pattern recognition: a) Schematic of a spiking neural network (SNN) constructed for the classification of MNIST handwritten digit patterns. A three‐layer SNN composed of 784 input neurons (artificial mechanoreceptors), 100 hidden neurons, and 10 output neurons is shown. b) Flowchart of the simulation. The measured characteristics of the artificial mechanoreceptor module were reflected in the input layer. c) Recognition rate as a function of the number of epochs. Classification accuracy of 85.8% was achieved. d) Confusion matrix showing the predicted results according to the expected results. The color bar represents the number of data instances.

Figure 5c shows the classification accuracy according to the training epoch when training was performed with 60 000 training data instances and validation was performed with 10 000 test data instances. Classification accuracy of 85.8% was achieved after nine epochs. Figure 5d displays a confusion matrix showing the predicted results according to the expected results for the 10 000 test data instances. The colored bar represents the number of data instances. The clear diagonal pattern shows that the handwritten digits were well classified using the artificial mechanoreceptor modules as input neurons in the SNN. It should be noted that when an artificial mechanoreceptor module cannot respond to a low‐pressure level, the classification accuracy is degraded because the information of the pixels applied via the low pressure was lost in the input layer, as shown in Figure S4b, Supporting Information. Therefore, good low‐pressure detectability of the artificial mechanoreceptor module is crucial for a high‐performance neuromorphic tactile system.

2.6. Hardware Implementation for Breath Monitoring

Human breathing has been monitored as a useful indicator for real‐time health monitoring and for the early diagnosis of heart failure and sleep apnea.[ 39 , 40 ] Specifically, breath‐monitoring systems based on neural networks can be used to learn and recognize complex breathing patterns.[ 41 ] We implemented a fully hardware‐based breath‐monitoring system to demonstrate further applicability of the proposed artificial mechanoreceptor module to the healthcare industry. Proposed artificial mechanoreceptor module that can respond to the small amounts of pressure is promising for the breath‐monitoring system because it can respond to exhaled wind from a nose and small movements in an abdomen. The breath‐monitoring system, capable of classifying exhalation and inhalation, was constructed based on a single‐layer perceptron (SLP). Two different types of artificial mechanoreceptor modules were used for the input neurons: A wind‐type artificial mechanoreceptor module (abbreviated as the wind‐type mechanoreceptor) that detected wind from the nose and a bending‐type artificial mechanoreceptor module (abbreviated as the bending‐type mechanoreceptor) that detected movements of the abdomen. The wind‐type mechanoreceptor mimicked the biological hair follicle receptors that detect wind pressure, while the bending‐type mechanoreceptor mimicked the biological Meissner receptor that detects low‐frequency vibrations.[ 42 ] A TENG that responds to the wind pressure was designed and fabricated to construct a wind‐type mechanoreceptor. The detailed structure, operational mechanism, and output characteristics are explained in Figure S5, Supporting Information. In addition, another TENG that responds to bending pressure was designed and fabricated to construct the bending‐type mechanoreceptor, as described in Figure S6, Supporting Information. A wind‐type TENG and a bending‐type TENG were coupled with each biristor neuron in order to comprise two artificial mechanoreceptor modules. The wind‐type mechanoreceptor was positioned near the nose to detect wind from the nose and the bending‐type mechanoreceptor was positioned on the abdomen to detect the movement of the abdomen, as shown in Figure  6a. The aforementioned various form factors of a TENG that can utilize numerous mechanical energy sources and respond to different types of mechanical stimuli such as wind and bending is attractive to implement diverse mechanoreceptors by the structural modification.

Figure 6.

Figure 6

Hardware implementation for breath monitoring: a) Conceptual schematic illustration of breath monitoring for the classification of exhalation and inhalation. Two types of artificial mechanoreceptor modules were used: A wind‐type that detects wind from the nose and a bending‐type that detects movements of the abdomen. Electrical signals from the artificial mechanoreceptor were transported to SONOS‐synapses. b) Neural network based on a single‐layer spiking neural network (SNN) for the classification of breath. The input layers corresponded to the two artificial mechanoreceptor modules (wind‐type and bending‐type) and the output layers corresponded to the two states (exhale and inhale). c) Synapse current was collected at output layer A (I syn,A) and output layer B (I syn,B). Spiking was observed in output layer A for exhalation and in output layer B for inhalation.

Referring to the circuit diagram shown in Figure 6a, electrical spike signals from the artificial mechanoreceptor modules were transported to the synapses to reflect the synaptic weight. For a synapse, a metal‐oxide‐semiconductor field‐effect transistor (MOSFET) was employed. Note that the biristor neuron does not use a gate electrode electrically even though it harnesses a physical dummy gate. Thus, the biristor neuron and the MOSFET synapse are homotypic to each other. In detail, such synaptic MOSFET encloses a charge trap layer intercalated to gate dielectrics, which has been widely utilized as a commercial flash memory cell. It is based on a SONOS structure that composes a gate poly‐crystalline Si (S), blocking SiO2 (O), charge trap Si3N4 (N), tunneling SiO2 (O), and channel single‐crystalline Si (S). Due to the structural and material homogeneity between the biristor neuron and the SONOS‐based MOSFET synapse (abbreviated as SONOS‐synapse), they can be co‐integrated. Such co‐integration of neuron devices and synaptic devices can enhance the packing density, reduce the chip cost, and simplify the fabrication procedures.[ 32 ] Figure S7a,b, Supporting Information, show a SEM and a transmission electron microscope (TEM) image of the SONOS‐synapse, respectively. By controlling the electron trap density in the charge trap layer of silicon nitride (Si3N4), the threshold voltage (V T) and the conductance can be modulated to determine the synaptic weight, as shown in Figure S7c,d, Supporting Information.[ 43 , 44 ] At a fixed drain voltage of V DD = 1 V, the output current from the SONOS‐synapse (I syn) was measured with a parameter analyzer. Although we used a parameter analyzer for this measurement, the measurement units can be commonly embedded in a chip of a mobile phone for mobile healthcare applications, as conceptually illustrated in Figure 6a.

Figure 6b shows the neural network designed for classification of exhalation and inhalation. It is composed of an input layer corresponding to two artificial mechanoreceptor modules (the wind‐type and the bending‐type) and an output layer corresponding to the two states (exhale and inhale). The wind‐type mechanoreceptor was strongly connected to output layer A, which corresponds to the exhale state, and weakly connected to output layer B, which corresponds to the inhale state. Otherwise, the bending‐type mechanoreceptor was connected strongly only to output layer B. These strong connections and weak connections are represented with the binary weights of the synapses by changing the electron trap density in the charge trap layer of the SONOS‐synapse. In other words, the high‐weight synapse for the strong connections had a low V T and the low‐weight synapse for the weak connections had a high V T. As a result, a simple breath‐monitoring system composed of two artificial mechanoreceptor modules and four SONOS‐synapses, as depicted in the circuit diagram in Figure S8, Supporting Information, was devised. Finally, the synapse current collected at output layer A (I syn,A) and output layer B (I syn,B) was measured, as shown in Figure 6c. It was possible to classify exhalation and inhalation according to where the spike signals were detected among I syn,A and I syn,B. In detail, a breath was classified as exhalation when spiking was observed in I syn1 and was classified as inhalation when spiking was observed in I syn2. As a result, the classification of exhalation and inhalation was accomplished using the fully hardware‐based breath‐monitoring system, which incorporated the proposed artificial mechanoreceptor modules. Although we demonstrated classification of a simple breath pattern in this work, more complex breath patterns can be classified for detecting heart failure and sleep apnea by increasing the number of hidden layers in the neural network instead of the SLP or using synapses with multiple states instead of binary states, as shown in Figure S7d, Supporting Information.

3. Conclusion

In this work, we proposed a self‐powered artificial mechanoreceptor module for a neuromorphic tactile system. A biological mechanoreceptor was imitated using a TENG comprising a self‐powered pressure sensor and a biristor neuron, in which spiking was varied according to the applied pressure. The proposed device can simultaneously perform pressure detection and spike encoding, which is appropriate for the input neuron of a SNN in a neuromorphic tactile system. It can greatly reduce the power consumption compared to a conventional tactile system based on the von Neumann architecture owing to its bio‐inspired neuromorphic architecture, while the artificial mechanoreceptor module itself does not use any external energy with the aid of the TENG as an energy harvester. This could not be accomplished with resistive pressure sensors or ring oscillator neurons (Table S1, Supporting Information). The mechanoreceptor module can detect low pressures near 3 kPa due to the high output range of the TENG compared to other types of nanogenerators. Using the artificial mechanoreceptor modules, classification of MNIST handwritten numbers was successfully performed (85.8%) with the aid of an experimental‐based software simulation. Furthermore, using the artificial mechanoreceptor modules and synaptic devices, a fully hardware‐based breath‐monitoring system to classify exhalation and inhalation during breathing was demonstrated. The self‐powered and low‐pressure detecting characteristics of the proposed artificial mechanoreceptor module will open a new avenue to realize tactile systems for robotics, prosthetics, and medical and healthcare applications.

4. Experimental Section

Fabrication of the Triboelectric Nanogenerator

Details of the fabrication process are provided in Figure S1, Supporting Information.

Fabrication of the Biristor Neuron

A biristor neuron with a base width (W B) of 250 nm and base length (L B) of 500 nm was fabricated on a SOI wafer. Figure S2, Supporting Information, presents the details of the fabrication process.

Measurement Setup

The setup to measure the characteristics of the artificial mechanoreceptor module consists of a vibration generating part and an electrical measurement part. For the vibration generation part, a function generator (33 120, hp) was used to generate and transport an electric signal to a power amplifier (pa‐141, Labworks) connected to an electrodynamic shaker (LW‐140‐110, Labworks). For the electrical measurement part, a semiconductor parameter analyzer (B1500A, Keysight) was used. To measure the electrical properties of only the TENG, an electrometer (6514, Keithley) was used. To measure the electrical properties of only the biristor neuron and the SONOS‐based MOSFET synapse, a semiconductor parameter analyzer (B1500A, Keysight) was used.

Operation of the Wind‐Force Detecting Triboelectric Nanogenerator

The detailed structure, operational mechanism, and output characteristics are presented in Figure S5, Supporting Information.

Operation of the Bending‐Force Detecting Triboelectric Nanogenerator

The detailed structure, operational mechanism, and output characteristics are presented in Figure S6, Supporting Information.

Scanning Electron Microscope Analysis

SEM images were taken using a Magellan 400 field‐emission SEM (FEI Company).

Transmission Electron Microscope Analysis

TEM images were taken using a FE‐STEM (HD‐2300A) device made by Hitachi High‐Technologies Corporation.

Software‐Based Simulation

Software simulations for classification of handwritten digits in the MNIST dataset were performed using Python. The measured number of spikes during one touch (N spike) according to the pressure of an artificial mechanoreceptor module was reflected in the simulation.

Conflict of Interest

The authors declare no conflict of interest.

Supporting information

Supporting Information

Acknowledgements

J.‐K.H. and I.‐W.T. contributed equally to this work. This work was supported by National Research Foundation (NRF) of Korea, under Grant 2018R1A2A3075302, 2019M3F3A1A03079603, and 2020M3F3A2A01082592, in part by the IC Design Education Center (EDA Tool and MPW). This work was also supported by the BK‐21 FOUR program through National Research Foundation of Korea (NRF) under Ministry of Education.

Han J.‐K., Tcho I.‐W., Jeon S.‐B., Yu J.‐M., Kim W.‐G., Choi Y.‐K., Self‐Powered Artificial Mechanoreceptor Based on Triboelectrification for a Neuromorphic Tactile System. Adv. Sci. 2022, 9, 2105076. 10.1002/advs.202105076

Data Availability Statement

The data that support the findings of this study are available from the corresponding author upon reasonable request.

References

  • 1. Chun S., Kim J.‐S., Yoo Y., Choi Y., Jung S. J., Jang D., Lee G., Song K.‐I., Nam K. S., Youn I., Son D., Pang C., Jeong Y., Jung H., Kim Y.‐J., Choi B.‐D., Kim J., Kim S.‐P., Park W., Park S., Nat. Electron. 2021, 4, 429. [Google Scholar]
  • 2. Chun S., Son W., Kim H., Lim S. K., Pang C., Choi C., Nano Lett. 2019, 19, 3305. [DOI] [PubMed] [Google Scholar]
  • 3. Kim S., Lee Y., Kim H. D., Choi S. J., NPG Asia Mater. 2020, 12, 10.1038/s41427-020-00258-9 [DOI] [Google Scholar]
  • 4. Li P., Anwar Ali H. P., Cheng W., Yang J., Tee B. C. K., Adv. Mater. Technol. 2020, 5, 1900856. [Google Scholar]
  • 5. Moin A., Zhou A., Rahimi A., Menon A., Benatti S., Alexandrov G., Tamakloe S., Ting J., Yamamoto N., Khan Y., Burghardt F., Benini L., Arias A. C., Rabaey J. M., Nat. Electron. 2021, 4, 54. [Google Scholar]
  • 6. Benatti S., Casamassima F., Milosevic B., Farella E., Schönle P., Fateh S., Burger T., Huang Q., Benini L., IEEE Trans. Biomed. Circuits Syst. 2015, 9, 620. [DOI] [PubMed] [Google Scholar]
  • 7. Liu X., Zhang M., Richardson A., Lucas T., Van Der Spiegel J., IEEE Trans. Circuits Syst. 2017, 64, 1257. [DOI] [PubMed] [Google Scholar]
  • 8. Chun S., Hwang I., Son W., Chang J. H., Park W., Nanoscale 2018, 10, 10545. [DOI] [PubMed] [Google Scholar]
  • 9. Abraira V. E., Ginty D. D., Neuron 2013, 79, 618. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Chambers M. R., Andres K., Duering M. V., Iggo A., Q. J. Exp. Physiol. Cogn. Med. Sci. 1972, 57, 417. [DOI] [PubMed] [Google Scholar]
  • 11. Knibestöl M., Åke V. B., Acta Physiol. Scand. 1970, 80, 178. [DOI] [PubMed] [Google Scholar]
  • 12. Salimi‐Nezhad N., Amiri M., Falotico E., Laschi C., Front. Neurosci. 2018, 12, 322. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Yu F., Cai J. C., Zhu L. Q., Sheikhi M., Zeng Y. H., Guo W., Ren Z. Y., Xiao H., Ye J. C., Lin C.‐H., Wong A. B., Wu T., ACS Appl. Mater. Interfaces 2020, 12, 26258. [DOI] [PubMed] [Google Scholar]
  • 14. Zhang X., Zhuo Y., Luo Q., Wu Z., Midya R., Wang Z., Song W., Wang R., Upadhyay N. K., Fang Y., Kiani F., Rao M., Yang Y., Xia Q., Liu Q., Liu M., Yang J. J., Nat. Commun. 2020, 11, 51. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Lee Y. R., Trung T. Q., Hwang B.‐U., Lee N.‐E., Nat. Commun. 2020, 11, 2753. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Yu J., Gao G., Huang J., Yang X., Han J., Zhang H., Chen Y., Zhao C., Sun Q., Wang Z. L., Nat. Commun. 2021, 12, 1581. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Kim Y., Chortos A., Xu W., Liu Y., Oh J. Y., Son D., Kang J., Foudeh A. M., Zhu C., Lee Y., Niu S., Liu J., Pfattner R., Bao Z., Lee T. W., Science 2018, 360, 998. [DOI] [PubMed] [Google Scholar]
  • 18. Zhang G., Liao Q., Zhang Z., Liang Q., Zhao Y., Zheng X., Zhang Y., Adv. Sci. 2016, 3, 1500257. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Zang Y., Zhang F., Di C. A., Zhu D., Mater. Horiz. 2015, 2, 140. [Google Scholar]
  • 20. Mannsfeld S. C. B., Tee B. C.‐K., Stoltenberg R. M., Chen C. V. H. H., Barman S., Muir B. V. O., Sokolov A. N., Reese C., Bao Z., Nat. Mater. 2010, 9, 859. [DOI] [PubMed] [Google Scholar]
  • 21. Li F., Wang R., Song C., Zhao M., Ren H., Wang S., Liang K., Li D., Ma X., Zhu B., Wang H., Hao Y., ACS Nano 2021, 15, 16422. [DOI] [PubMed] [Google Scholar]
  • 22. Han J.‐W., Choi Y.‐K., IEEE Electron Device Lett. 2010, 31, 797. [Google Scholar]
  • 23. Fan F. R., Lin L., Zhu G., Wu W. Z., Zhang R., Wang Z. L., Nano Lett. 2012, 12, 3109. [DOI] [PubMed] [Google Scholar]
  • 24. Fan F. R., Tang W., Wang Z. L., Adv. Mater. 2016, 28, 4283. [DOI] [PubMed] [Google Scholar]
  • 25. Chun S., Pang C., Cho S. B., Adv. Mater. 2020, 32, 1905539. [DOI] [PubMed] [Google Scholar]
  • 26. An J., Chen P., Wang Z., Berbille A., Pang H., Jiang Y., Jiang T., Wang Z. L., Adv. Mater. 2021, 33, 2101891. [DOI] [PubMed] [Google Scholar]
  • 27. Zou J., Zhang M., Huang J., Bian J., Jie Y., Willander M., Cao X., Wang N., Wang Z. L., Adv. Energy Mater. 2018, 8, 1702671. [Google Scholar]
  • 28. Chen J., Zhu G., Yang W., Jing Q., Bai P., Yang Y., Hou T. C., Wang Z. L., Adv. Mater. 2013, 25, 6094. [DOI] [PubMed] [Google Scholar]
  • 29. Jeon S.‐B., Park S.‐J., Kim W.‐G., Tcho I.‐W., Jin I.‐K., Han J.‐K., Kim D., Choi Y.‐K., Nano Energy 2018, 53, 596. [Google Scholar]
  • 30. Han J.‐W., Meyyappan M., IEEE Electron Device Lett. 2018, 39, 1457. [Google Scholar]
  • 31. Han J.‐K., Seo M., Kim W.‐K., Kim M.‐S., Kim S.‐Y., Kim M.‐S., Yun G.‐J., Lee G.‐B., Yu J.‐M., Choi Y.‐K., IEEE Electron Device Lett. 2020, 41, 208. [Google Scholar]
  • 32. Han J.‐K., Oh J., Yun G.‐J., Yoo D., Kim M.‐S., Yu J.‐M., Choi S.‐Y., Choi Y.‐K., Sci. Adv. 2021, 7, eabg8836. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Jia M., Yu J., Liu Y., Guo P., Lei Y., Wang W., Yu A., Zhu Y., Sun Q., Zhai J., Wang Z. L., Nano Energy 2021, 83, 105785. [Google Scholar]
  • 34. Jin I. K., Park J.‐Y., Lee B.‐H., Jeon S.‐B., Tcho I.‐W., Park S.‐J., Kim W.‐G., Han J.‐K., Lee S.‐W., Kim S.‐Y., Bae H., Kim D., Choi Y.‐K., Nano Energy 2018, 52, 63. [Google Scholar]
  • 35. Niu S., Wang S., Lin L., Liu Y., Zhou Y. S., Hu Y. F., Wang Z. L., Energy Environ. Sci. 2013, 6, 3576. [Google Scholar]
  • 36. Kim D., Tcho I.‐W., Jin I. K., Park S.‐J., Jeon S.‐B., Kim W.‐G., Cho H.‐S., Lee H.‐S., Jeoung S. C., Choi Y.‐K., Nano Energy 2017, 35, 379. [Google Scholar]
  • 37. Duan Q., Jing Z., Zou X., Wang Y., Yang K., Zhang T., Wu S., Huang R., Yang Y., Nat. Commun. 2020, 11, 3399. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Kwon D., Lim S., Bae J.‐H., Lee S.‐T., Kim H., Seo Y.‐T., Oh S., Kim J., Yeom K., Park B. G., Lee J.‐H., Front. Neurosci. 2020, 14, 423. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Guder F., Ainla A., Redston J., Mosadegh B., Glavan A., Martin T. J., Whitesides G. M., Angew. Chem. 2016, 55, 5727. [DOI] [PubMed] [Google Scholar]
  • 40. Rajabi‐Abhari A., Kim J.‐N., Lee J., Tabassian R., Mahato M., Youn H. J., Lee H., Oh I., ACS Appl. Mater. Interfaces 2021, 13, 219. [DOI] [PubMed] [Google Scholar]
  • 41. McClure K., Erdreich B., Bates J. H., McGinnis R. S., Masquelin A., Wshah S., Sensors 2020, 20, 6481. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42. Johnson K. O., Hsiao S. S., Annu. Rev. Neurosci. 1992, 15, 227. [DOI] [PubMed] [Google Scholar]
  • 43. Himmel N., Ziegler M., Mähne H., Thiem S., Winterfeld H., Kohlstedt H., Semicond. Sci. Technol. 2017, 32, 06LT01. [Google Scholar]
  • 44. Choi H.‐S., Kim H., Lee J.‐H., Park B.‐G., Kim Y., IEEE Electron Device Lett. 2020, 41, 1653. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supporting Information

Data Availability Statement

The data that support the findings of this study are available from the corresponding author upon reasonable request.


Articles from Advanced Science are provided here courtesy of Wiley

RESOURCES