Skip to main content
Science Advances logoLink to Science Advances
. 2022 Aug 5;8(31):eabq2521. doi: 10.1126/sciadv.abq2521

Artificial tactile perception smart finger for material identification based on triboelectric sensing

Xuecheng Qu 1,, Zhuo Liu 1,2,, Puchuan Tan 1,2,, Chan Wang 1, Ying Liu 1,3, Hongqing Feng 1,3, Dan Luo 1,*, Zhou Li 1,3,4,*, Zhong Lin Wang 1,3,5
PMCID: PMC9355359  PMID: 35930645

Abstract

Tactile perception includes the direct response of tactile corpuscles to environmental stimuli and psychological parameters associated with brain recognition. To date, several artificial haptic-based sensing techniques can accurately measure physical stimuli. However, quantifying the psychological parameters of tactile perception to achieve texture and roughness identification remains challenging. Here, we developed a smart finger with surpassed human tactile perception, which enabled accurate identification of material type and roughness through the integration of triboelectric sensing and machine learning. In principle, as each material has different capabilities to gain or lose electrons, a unique triboelectric fingerprint output will be generated when the triboelectric sensor is in contact with the measured object. The construction of a triboelectric sensor array could further eliminate interference from the environment, and the accuracy rate of material identification was as high as 96.8%. The proposed smart finger provides the possibility to impart artificial tactile perception to manipulators or prosthetics.


A triboelectric tactile perception smart finger realizes material identification for intelligent manipulators and prostheses.

INTRODUCTION

As an important sensory function for humans in direct contact with the external environment, tactile perception originates from the response of subcutaneous tactile corpuscles to different stimuli in the environment and the brain’s recognition of signals afferent through nerve fibers. Therefore, the sense of touch not only reflects the tactile response to external physical stimuli (e.g., temperature, humidity, and pressure) but also includes a series of psychological parameters based on extraction and analysis of information by the brain, such as recognition of texture and roughness through tactile sensation. Bionic tactile sensors have attracted a great deal of attention since the 1980s, and high expectations are placed on simulating the tactile function of human skin. With the rapid development of functional materials and micro-nano processing technology, tactile sensors with high flexibility, spatial resolution, and sensitivity have been developed. Up to now, various types of physical information, including pressure (17), humidity (8, 9), and temperature (2, 7, 10), have been successfully identified through the contact of various sensing elements with objects based on piezoresistive (1, 2), capacitive (1), pyroelectric (10), and piezoelectric principles (1114), which have been used in intelligent robots, medical rehabilitation, etc. (1520). However, as psychosensory parameters are difficult to quantify, it remains challenging to simulate human tactile perception to determine the type and roughness of materials, which is crucial for the interaction between intelligent robots and the environment, in the context of both industrial sorting and the daily life of physically challenged people who rely on prosthetics.

Many efforts have been made to develop sensors or devices capable of identifying materials based on various strategies, such as thermal conductivity, ultrasound, computer vision, etc. (10, 2126). As summarized in table S1, despite great progress in material recognition technology, it also has limitations. For example, identifying the material type by thermal conductivity has the advantages of low cost and high accuracy, but it requires long test times. Electromagnetic methods have good response speeds, but identification is limited to metals. Although computer vision has good robustness with respect to external noise, the integration of acquisition modules and algorithms is more complicated, and the types of materials that can be identified are limited. Therefore, there is an urgent need for a low-cost, high-efficiency, and widely applicable technique for tactile-like material identification.

On the basis of the coupling of triboelectrification and electrostatic induction, triboelectric nanogenerators (TENGs), as proposed by Z.L.W., can convert mechanical energy into electrical signals and have been widely used as energy-harvesting and sensing devices (27), such as biosensors (28, 29), implantable medical sensors (3032), ocean energy-harvesting devices (33, 34), and biomechanical energy-harvesting devices (3537), among other applications (3847). The triboelectric effect refers to the contact-induced electrification that occurs at various interfaces. The transformation process from physical contact to electricity prompted us to use TENGs as a powerful tool for tactile perception simulation. Materials differ in their ability to gain and lose electrons, and surface electron transfer occurs when two materials come into contact; thus, materials take opposite charges after physical contact (40). According to the above theory, a triboelectric series can be established in which the unique position of each material determines the capacity and efficiency of charge exchange. Therefore, the fixed detector can effectively identify the type of touched material according to different triboelectric output signals.

In light of these considerations, we designed a triboelectric smart finger that surpassed human tactile perception for use in intelligent robots or artificial prosthetics (Fig. 1A). A sensor array composed of several typical materials in different positions in the triboelectric series was integrated into the smart finger, which could identify the type and roughness of materials based on triboelectric sensing. Moreover, machine learning–based data processing minimized environmental interference, substantially improving the identification accuracy to 96.8%. In addition, the wireless communication and display module integrated in the smart finger allowed the recognition results to be presented more intuitively. When the smart finger touched the material to be tested, the recognition information was directly projected onto the organic light-emitting diode (OLED) screen. This work quantified tactile psychological parameters through the triboelectric effect, which paves the way for a new era in modeling human tactile perception.

Fig. 1. Design and structure of the smart finger.

Fig. 1.

(A) Schematic diagram of the material identification process of the triboelectric tactile perception smart finger. (B) Structure of the triboelectric tactile perception smart finger, consisting of a triboelectric sensor array, data acquisition and transmission module, and display module. (C) Schematic diagram of the output signals of the triboelectric sensor array when the smart finger identifies different materials. a.u., arbitrary units. (D) Typical materials located in different positions in the triboelectric series: Electronegativity increases from right to left; conversely, electropositivity increases from left to right. (E) Flowchart of the interaction between the modules of the smart finger when identifying materials.

RESULTS

Design and integration of the triboelectric tactile perception smart finger

The triboelectric tactile perception smart finger was composed of a triboelectric sensor array, data acquisition and transmission module, and display module (OLED screen), as shown in Fig. 1B. The triboelectric sensor array contained several discrete sensors, the signals from which reflected the characteristic information of the triboelectricity between the sensor and material in contact (Fig. 1C). Representative materials occupying different positions in the triboelectric series, such as polyamide (PA66), polyethylene terephthalate (PET), polystyrene (PS), and polytetrafluoroethylene (PTFE), were used as the friction layer for each sensor (Fig. 1D). Aluminum (Al) film was used as an electrode layer, constituting a single-electrode vertical contact separation mode triboelectric sensor. The portfolio of sensors with differentiated triboelectric properties ensured a distinct fingerprint output signal upon contact with a variety of materials, i.e., when the sensor contacted and separated from the test material, a unique voltage signal will be generated regardless of relative amplitude, voltage direction, or waveform. The acquisition module recorded these signals and then transmitted them to the computer through Bluetooth for machine learning. The recognition results were displayed on the computer screen through software or on the OLED screen of the finger after Bluetooth transmission and microprogrammed control unit (MCU) processing (Fig. 1E).

Mechanism and operating parameters of the triboelectric sensor

In theory, triboelectric sensing is suitable for detecting all types of material. Contact electrification, the scientific term for triboelectricity, is a fundamental phenomenon that exists in various contact interfaces and can be explained by the overlapping electron cloud model. As shown in Fig. 2A, before the two materials come into contact on the atomic scale, their respective electron clouds are independent, without any overlapping regions. The potential well binds electrons tightly to specific orbitals, and no electron transfer occurs. When two atoms are in close contact, their electron clouds overlap to form a bond. If an external force (such as pressure or friction) is applied, the bond length will be shortened, giving rise to a transition from initial single-well potential to asymmetric double-well potential. The strong electron cloud overlap weakens the energy barrier between atoms, allowing electrons to transfer from one atom to another (48). As the electron cloud states vary among different materials, the triboelectric signal between two given materials is unique. On the basis of the contact electrification theory, Wang further expanded the expression of displacement current in Maxwell’s equation by introducing the Pst term to describe the basic theory of nanogenerators, where Ps is the polarization density introduced by surface electrostatic charges caused by contact electrification or the piezoelectric effect (49)

ε·E=ρ·Ps (1)
·B=0 (2)
×E=Bt (3)
×H=J+ε Et+Pst (4)
JD=Dt=ε Et+Pst (5)

Fig. 2. Mechanism of triboelectric sensing and sensor performance characterization.

Fig. 2.

(A) The fundamental principle of triboelectricity (also known as contact electrification) explained by the overlapping electron cloud model. (B) Working mechanism of triboelectric sensing based on a single-electrode vertical contact separation mode TENG. Example use of the triboelectric sensor with PTFE as a friction layer to identify PU. (C) VOC at different contact distances between the triboelectric sensors (PTFE) and test material (PU). (D) Response time of the PTFE triboelectric sensor. (E) Influence of contact and separation frequency between the triboelectric sensor and measured material on VOC. (F) VOC output of the PTFE triboelectric sensor at different operating temperatures. (G) Fatigue testing of triboelectric sensing based on the model of PU detection by the PTFE triboelectric sensor.

Note that E is the electric field, B stands for magnetic induction, H is the magnetic field intensity, ρ is the distribution of free charges in space, J is the density of free conduction current density in space as a result of charge flow, t is time, and D is the electric displacement vector. As the theoretical origin of the TENG, the addition of the Ps term to the electric displacement vector allows the application of Maxwell’s equation in the fields of energy and sensing.

To illustrate the working principle of the triboelectric sensor, a sensor with PTFE as the friction layer was chosen as the research model, and the electropositive material, polyurethane (PU), was used as the test object. The operating mechanism of the sensor is shown schematically in Fig. 2B, which, in principle, involves the combination of triboelectrification and electrostatic induction and could be divided into four steps: (i) In the initial state, as the PU was far away from the triboelectric sensor, both the sensor side and measured object side were charge-balanced without generating any output signals; (ii) when the PU approached the sensor, the positive charges induced on the Al electrode decreased, and the electrons flowed from the reference electrode to the Al electrode; (iii) the potential difference between the Al electrode and PTFE reached a maximum value when the PU was in full contact with the triboelectric sensor; (iv) subsequently, the sensor was gradually separated from the PU test object. As the separation distance between the PU and sensor increased, the negatively charged PTFE induced more positive charges in the Al, driving the flow of free electrons from the Al electrode to the reference electrode, accompanied by the generation of a reverse output signal. The charges on both sides were rebalanced until the PU was completely separated from the PTFE. This constitutes a full cycle based on triboelectric sensing.

The corresponding relationships between the operating parameters of the sensor and its triboelectric output performance were systematically studied on the basis of the recognition of the PU model by the PTFE triboelectric sensor. As the primary factor under consideration, sensor size directly determined the strength of the output signal. Expectedly, the open circuit voltage (VOC), short circuit current (ISC), and transferred charge (QSC) were strongly positively correlated with the sensor size (fig. S1). In addition, the contact/separation distance also affected the triboelectric signal. Within a range of 5 to 20 mm, the VOC gradually increased as the sensor moved away from the surface of the measured object, while it had little effect on VOC when the distance exceeded 20 mm (Fig. 2C). The triboelectric sensor had a fast response speed of 1.23 ms, ensuring accurate material identification even with brief contact (Fig. 2D). Therefore, the normal contact and separation frequency between the sensor and material had little effect on the VOC (Fig. 2E). Although the triboelectric sensing signal was temperature sensitive and the VOC showed a downward trend with increasing temperature (Fig. 2F), the detection signal was almost stable at room temperature (ranging from 20° to 30°C) with only 1.1% output attenuation. The triboelectric sensor retained high detection stability after repeated use under conventional environmental conditions (298 K, 1 atm). After 4000 cycles of testing, the output performance of the sensor showed no obvious attenuation or marked changes (Fig. 2G). Together, these observations showed that triboelectric sensing has the advantages of a simple structure, high applicability, good stability, and a fast response speed, making it ideal for simulating tactile perception.

Triboelectric fingerprint signal characteristics of different materials and surface roughnesses

On the basis of the working mechanism of the triboelectric sensor outlined above, a 2 × 2 triboelectric sensor array of PTFE, together with three other materials (PA66, PET, and PS), was constructed (Fig. 3A). According to the triboelectric series, PTFE has the strongest electronegativity among the four materials, followed by PS and PET, while PA66 is the most electropositive (electronegativity: PTFE > PS > PET > PA66). The combination of different sensors allowed more comprehensive feature information of the measured objects to be obtained, thereby effectively improving recognition accuracy.

Fig. 3. Material type identification via the triboelectric sensor array.

Fig. 3.

(A) Schematic diagram of the triboelectric sensor array on a smart finger. (B to I) The VOC waveforms and amplitudes output when the sensor array (consisting of PA66, PET, PS, and PTFE triboelectric sensors) identified PTFE, PS, PET, and PA66, respectively. Top left: Output of each triboelectric sensor as it identified the material. Top right: Average amplitude of each triboelectric sensor output. Bottom: Amplified VOC output of each triboelectric sensor. (J) VOC output of the triboelectric sensor array when it detected acrylic, EVA, PVC, and glass, respectively.

To investigate the ability of triboelectric sensor arrays to discriminate between different material types even when the physical properties of the test object and sensor are similar, the same four materials used in sensors (PA66, PET, PS, and PTFE) were used as the test objects, and their output characteristics were studied separately. Identification of PTFE by the sensor array was investigated first. When the 2 × 2 triboelectric sensor array was in contact with and detached from the PTFE substrate, PET-, PS-, and PA66-based sensing units all produced similar “dip to peak” VOC waveforms, due to the higher electronegativity of PTFE than PET, PS, and PA66 (Fig. 3B). Notably, the amplitude of the triboelectric output differed among the sensors, which was attributed to the difference among materials in the ability to gain and lose electrons. As shown in Fig. 3C, PA66 had a stronger tendency to lose electrons compared to PTFE; therefore, the PA66 sensor had the largest triboelectric output amplitude, followed by the PET and PS sensors. As PTFE was used as both the sensor and measured object, with the same ability to gain and lose electrons, the output amplitude of the PTFE sensor was the smallest. When PS was used as the test object, the VOC waveforms output by the PET and PA66 sensors (dip to peak) were in the opposite direction to that of the PTFE sensor (peak to dip), because PS is weaker than PTFE but stronger than PET and PA66 in the electronegativity. Similarly, the material characteristic information reflected by the relative amplitude was also consistent with the difference in triboelectric series between materials (Fig. 3, D and E). Figure 3 (F and G) shows the VOC waveform and relative amplitude when the sensor array detected PET, where the PA66 sensor had an inverted output signal waveform (dip to peak) compared to the PS and PTFE sensors (peak to dip). Compared to PTFE, PA66 had stronger electropositivity. When the sensor array detected PA66, the VOC waveform and relative amplitude results were diametrically opposite to those obtained when identifying PTFE (Fig. 3, H and I). The applicability of the sensor array could be further extended to the identification of commonly used materials in daily life, including acrylic, ethylene-vinyl acetate copolymer (EVA), polyvinyl chloride (PVC), glass, PU, silicon, and wood. As shown in Fig. 3J and figs. S2 to S8, the sensor array produced different triboelectric outputs upon contact/separation with each material, with unique waveform and relative amplitude characteristics. Moreover, the construction of the sensor array facilitated to eliminate interference by humidity with the electrical output. Humidity greatly affected the VOC, as water has a certain electrical conductivity. In the sensor array, the relative voltage amplitude of the output signal of each sensor was barely disturbed by humidity, ensuring accurate identification of materials (fig. S9). These results confirmed the rationality of inferring the type of test material based on the triboelectric output characteristics.

In addition to distinguishing material types, the sensor array can also measure the roughness of each material (Fig. 4A). Four Al samples with different standard roughnesses (Ra = 6.3, 3.2, 1.6, and 0.8) were selected for analysis (photographs and micrographs of Al with four different roughnesses are shown in Fig. 4B and fig. S10). The roughness reflects the microtopological features of the material surface consisting of peaks and dips, where a smaller Ra value represents closer peak spacing. During measurement, the sensor array was grounded as a reference, which effectively prevented the accumulation of frictional charges and reduced external interference. The average distance between adjacent grooves for samples with Ra values of 6.3, 3.2, 1.6, and 0.8 are about 1.4, 1.0, 0.8, and 0.5 mm, respectively. As the roughness decreased, the VOC generated by the sensor array increased, which was attributed to the denser microstructure increasing the interface area between the sample and sensor array, enabling it to induce and accumulate more charge. It is worth noting that the increase in VOC caused by roughness would not be erroneously identified as a different material type. Although the absolute VOC values for the Al samples with four roughnesses were different, the electrical signals output by each sensor in the sensor array maintained a consistent relative ratio, indicating that the sensor array was detecting the same material (Fig. 4C and fig. S11).

Fig. 4. Identification of material roughness by the triboelectric sensor array.

Fig. 4.

(A) Schematic diagram of aluminum roughness detection by the triboelectric tactile perception smart finger. (B) Photographs (top) and micrographs (bottom) of aluminum with different roughnesses. (C) The VOC of the triboelectric sensor array when identifying Al with different roughnesses. When the triboelectric sensor array identified samples with different roughness but the same texture, the triboelectric output signals of the four sensors expanded proportionally, thus preventing misidentification as other materials.

The traditional contact stitch roughness detection methods cause great abrasions of the equipment and samples, and errors are likely to occur after multiple measurements. In contrast, fatigue testing confirmed that the performance of the triboelectric sensor array was almost unchanged after multiple uses, fully demonstrating the advantages of triboelectric sensing in contact/separation mode with regard to wear suppression (fig. S12). Compared to commercial probe-based roughness analysis strategies, triboelectric sensing is more convenient and economical and does not damage the sample surface; thus, it can be used for roughness detection in fine industrial manufacturing.

Integrating machine learning enables material recognition accuracy up to 96.8%

Machine learning has been shown to be an effective tool for automatically extracting features from the time-domain data of triboelectric signals and for high-precision identification of different samples (50). On the basis of the processing of these signals, differences between materials are amplified and clearly presented. However, direct learning of time series data will lead to an excessive data volume and huge costs in terms of both calculation time and memory space. Therefore, feature extraction is a prerequisite for machine learning (51). Here, multiple features of the data were learned, and features with the greatest impact on prediction accuracy for machine learning including the maximum value, minimum-maximum, peak-valley interval, number of zero-crossing points, number of inflection points, and absolute square value were lastly selected. Figure 5A presents a flowchart showing the details of the material identification using the smart finger with the assist of machine learning. Initially, the collected data of known materials were preprocessed. After feature extraction and selection, a machine learning model was established between the feature matrix and the labels and then iterated continuously. As the amount of training data increased, the machine learning model gradually approached the ground truth. The material category could be judged after the model was established. The entire material recognition system required a short response time, so the deep learning method with a long calculation time was abandoned, and the linear discriminant analysis (LDA) algorithm, a supervised learning dimensionality reduction technique in machine learning, was chosen. With the LDA algorithm, high-dimensional data for visualization in low-dimensional space (two dimensions) were successfully used, with the aim of minimizing the distances between the projection points of each data category while maximizing those between the centers of different data categories. As shown in Fig. 5B, when the original data were from a single channel, the clustering of samples was less ordered, and the machine learning classification accuracy rate was only 52.7%. As the number of channels (i.e., the number of sensors) increased, the clustering of samples became clearer. With data collection from four channels, several sample points of each object were clustered together to clearly classify the material type with an accuracy rate of up to 96.8%. The confusion matrix of 12 materials is shown in Fig. 5C, and high perceptual accuracy was achieved for all 12 materials. The number of samples also affected the accuracy of machine learning, which increased with increasing sample size (Fig. 5D). In addition, the prediction accuracy rate for material roughnesses can also reach up to 96.5%. The corresponding scatterplots and confusion matrix of test results are shown in fig. S13. The previous strategy strongly relied on increasing the quantity of sensors for a relatively accurate classification, which made data processing more complicated. With the application of machine learning, a good balance between the number of sensors and the accuracy of predictions made by the smart finger could be achieved. In this study, multiple materials could be recognized with a minimal number of triboelectric sensors; this should greatly reduce the difficulty and cost of equipment manufacturing while ensuring the accuracy of identification.

Fig. 5. Machine learning–based data processing for high-accuracy material type identification.

Fig. 5.

(A) Flow diagram of machine learning for material identification. (B) Prediction accuracy for material types differing in channel numbers. (C) Confusion map of the machine learning results for 12 objects with four channels. (D) Prediction accuracy for different sample sizes. ACC, accuracy.

Triboelectric tactile perception smart finger intuitively and accurately identified the type and roughness of various common materials

To demonstrate the real-world feasibility of the integrated triboelectric sensing system for material type and roughness identification, a smart finger with transcended human tactile perception was constructed, which integrated a triboelectric sensor array, data acquisition and transmission module, and display module (fig. S14). The multichannel, high-precision acquisition module could accurately record signals containing detailed information on material characteristics. The signals were then transmitted to the computer via Bluetooth for machine learning, and the results were displayed on the computer monitor or OLED screen of the smart finger in real time after being transmitted to the built-in MCU via Bluetooth. The smart finger can be integrated into intelligent prostheses or manipulators and recognizes various textures such as polymers, metals, and wood. Several materials were selected as test objects, including acrylic, EVA, glass, PU, PVC, silicon, wood, PTFE, Al, PS, PET, and PA66; the recognition accuracies are shown in Fig. 6A.

Fig. 6. Practical application scenarios of material type and roughness identification by the smart finger and the interactive interface.

Fig. 6.

(A) Photographs of several test materials and the corresponding identification accuracy. (B to D) With the aid of machine learning, the smart finger successfully identified the material type, and the results were displayed on the OLED screen. (E to G) The roughness detection process used by the smart finger; the recognition results were displayed on the OLED screen. (H and I) The computer interface for material type and surface roughness identification.

During operation, when the smart finger continuously touched the material twice under suitable conditions (approximately 2 cm away from the object), machine learning was applied to the collected signals, and the final prediction results were intuitively displayed on the computer monitor or OLED screen of the smart finger (Fig. 6, B to D, and fig. S15). The computer terminal display interface for material type identification is shown in Fig. 6H and fig. S16. The left half of the software display interface shows the waveform and peak statistical information, collected in real time, and the right half shows the identification result (e.g., wood in Fig. 6H). The roughness recognition results are shown in Fig. 6 (E to G) and fig. S17. Similarly, Fig. 6I and fig. S18 show the display interface for material roughness analysis (Al, Ra = 0.8). The process of simulating tactile perception is shown in detail in movies S1 to S4.

DISCUSSION

Here, we proposed a strategy to simulate human tactile perception and quantify tactile psychosensory parameters based on triboelectric sensing. As the ability to gain and lose electrons differs among materials, triboelectric fingerprint outputs with unique amplitudes and waveforms could be generated when the triboelectric sensor array was placed in contact with different objects. On the basis of the above principles, we developed a smart finger with transcended human tactile perception for use in prosthetics and manipulators to achieve identification of material type and roughness. With the aid of machine learning, the material recognition accuracy rate was as high as 96.8% under the premise of using only four sensors, and a variety of common materials (such as acrylic, EVA, glass, PU, PVC, silicon, and wood) could be recognized accurately. In addition, integration of the wireless transmission and display modules into the smart finger freed it from the requirement for a data cable, and the recognition results were displayed intuitively on the OLED screen.

The triboelectric tactile perception smart finger has the advantages of simple fabrication, a fast response, high accuracy, wide applicability, and sensing without damaging samples. Going forward, more complex and practical applications could be achieved by building interfaces of smart fingers with robots or even humans. For example, it could help robots to check whether products meet manufacturing standards in terms of composition and surface structure or help physically challenged people who rely on prosthetics to recreate their perception of the external environment. On the other hand, further research is required to improve the flexibility, miniaturization, and multifunctionalities of the sensors. In the future, artificial intelligence chips will be integrated into smart fingers to make them “smarter” and confer the ability to process data independent of the computer. In addition, pressure, temperature, and humidity sensors will be introduced to build a combination of multimodal information. It is believed that the tactile simulation technology based on triboelectric sensing has great potential in the fields of medical rehabilitation and intelligent industry.

MATERIALS AND METHODS

Fabrication of smart finger

The smart finger was integrated with a sensor array, signal acquisition module, processing module, communication module, and OLED screen. The sensor array was composed of four TENGs, each with high-purity materials: PA66, PET, PS, and PTFE film were used as the friction layer, and the Al foil was used as the friction layer attached on the surface of the high-purity materials, respectively. The size of each sensor is 1 cm by 1 cm. The case of the smart finger was printed by a three-dimensional printer. The sensor array was integrated under the fingertip, the acquisition module and the communication module were inside the cavity of the smart finger, and the OLED screen was fixed in the card slot above the finger. OpenBCI multichannel open-source module was used as the acquisition module, the analog front-end chip was Texas Instruments ADS1299 (high-gain, low-noise analog-to-digital converter (ADC), 24-bit channel resolution, and up to 16-kHz sampling rate), the main control chip was Arduino Uno (Atmel Atmega328P), and the communication was wireless (Bluetooth Low Energy) to realize wireless signal transmission. The machine learning part was completed on the computer side, using Python language.

Characterization and measurement

The output performance (open-circuit voltage, short-circuit current, and transferred charge) of the sensor was measured and recorded by an electrometer (6514, Keithley; 344-K, TRKE) and oscilloscope (HD 4096, Teledyne LeCroy). The basic data acquisition used a linear motor (E1100, LinMot, 1-Hz frequency) to simulate the manipulator for contact and separation (contact distance, 20 mm; contact pressure, 5 N). In the fatigue test, the sensor was driven periodically by a linear motor (E1100, LinMot, 1-Hz frequency). The fatigue test was performed for 4000 cycles. In the response time test, the PU film was attached to the force-applying side of the vibrating table, and the sensor (with PTFE as the friction layer) was fixed on the top of the PU film with a shelf, leaving a 2-mm gap between the sensor and the PU film. Then, the sensor was driven periodically by a vibration table (VT-500, YMC Piezotronics, 400-Hz frequency, 2-mm motion amplitude). The photos were taken by a digital camera (Canon EOS, 6D Mark II). Micrographs were taken by an optical microscope (ECLIPSE LV100ND, Nikon). The negative electrodes of the test line were grounded during the test to reduce external interference. All data are obtained after multiple measurements. The ordinate amplitude data are normalized by mathematical transformation.

Acknowledgments

Funding: This work was supported by the National Key Research and Development Program of China (2021YFB3201200), Beijing Natural Science Foundation (JQ20038), Beijing Natural Science Foundation (L212010), the National Natural Science Foundation of China (T2125003), the National Natural Science Foundation of China (2102231), the National Natural Science Foundation of China (61875015), the National Natural Science Foundation of China (51902344), the National Natural Science Foundation of China (81971770), China Postdoctoral Science Foundation (2020M680302), and China Postdoctoral Science Foundation (2021T140041).

Author contributions: Conceptualization: Z. Li and X.Q. Methodology: Z. Li, D.L., and Z.L.W. Software: P.T. Investigation: X.Q., Z. Liu, C.W., and Y.L. Visualization: X.Q., P.T., H.F., and D.L. Funding acquisition: Z. Li, D.L., and Z. Liu. Project administration: Z. Li. Supervision: Z. Li. Writing—original draft: X.Q. and Z. Liu. Writing—review and editing: Z. Li and D.L.

Competing interests: The authors declare that they have no competing interests.

Data and materials availability: All data needed to evaluate the conclusions in the paper are present in the paper and/or the Supplementary Materials.

Supplementary Materials

This PDF file includes:

Figs. S1 to S18

Table S1

Other Supplementary Material for this manuscript includes the following:

Movies S1 to S4

REFERENCES AND NOTES

  • 1.Beker L., Matsuhisa N., You I., Ruth S. R. A., Niu S., Foudeh A., Tok J. B. H., Chen X., Bao Z., A bioinspired stretchable membrane-based compliance sensor. Proc. Natl. Acad. Sci. U.S.A. 117, 11314–11320 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Park J., Kim M., Lee Y., Lee H. S., Ko H., Fingertip skin-inspired microstructured ferroelectric skins discriminate static/dynamic pressure and temperature stimuli. Sci. Adv. 1, e1500661 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Liu Z., Ma Y., Ouyang H., Shi B., Li N., Jiang D., Xie F., Qu D., Zou Y., Huang Y., Li H., Zhao C., Tan P., Yu M., Fan Y., Zhang H., Wang Z. L., Li Z., Transcatheter self-powered ultrasensitive endocardial pressure sensor. Adv. Funct. Mater. 29, 1807560 (2019). [Google Scholar]
  • 4.Pu X., Guo H., Chen J., Wang X., Xi Y., Hu C., Wang Z. L., Eye motion triggered self-powered mechnosensational communication system using triboelectric nanogenerator. Sci. Adv. 3, e1700694 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Wang C., Qu X., Zheng Q., Liu Y., Tan P., Shi B., Ouyang H., Chao S., Zou Y., Zhao C., Liu Z., Li Y., Li Z., Stretchable, self-healing, and skin-mounted active sensor for multipoint muscle function assessment. ACS Nano 15, 10130–10140 (2021). [DOI] [PubMed] [Google Scholar]
  • 6.Yoon H. J., Lee D. M., Kim Y. J., Jeon S., Jung J. H., Kwak S. S., Kim J., Kim S., Kim Y., Kim S. W., Mechanoreceptor-inspired dynamic mechanical stimuli perception based on switchable ionic polarization. Adv. Funct. Mater. 31, 2100649 (2021). [Google Scholar]
  • 7.Zhang F., Zang Y., Huang D., Di C. A., Zhu D., Flexible and self-powered temperature-pressure dual-parameter sensors using microstructure-frame-supported organic thermoelectric materials. Nat. Commun. 6, 8356 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Yang J., Shi R., Lou Z., Chai R., Jiang K., Shen G., Flexible smart noncontact control systems with ultrasensitive humidity sensors. Small 15, 1902801 (2019). [DOI] [PubMed] [Google Scholar]
  • 9.Li T., Li L., Sun H., Xu Y., Wang X., Luo H., Liu Z., Zhang T., Porous ionic membrane based flexible humidity sensor and its multifunctional applications. Adv. Sci. 4, 1600404 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Zhao S., Zhu R., A smart artificial finger with multisensations of matter, temperature, and proximity. Adv. Mater. Technol. 3, 1800056 (2018). [Google Scholar]
  • 11.Liu Z., Zheng Q., Shi Y., Xu L., Zou Y., Jiang D., Shi B., Qu X., Li H., Ouyang H., Liu R., Wu Y., Fan Y., Li Z., Flexible and stretchable dual mode nanogenerator for rehabilitation monitoring and information interaction. J. Mater. Chem. B 8, 3647–3654 (2020). [DOI] [PubMed] [Google Scholar]
  • 12.Guo W., Tan C., Shi K., Li J., Wang X. X., Sun B., Huang X., Long Y. Z., Jiang P., Wireless piezoelectric devices based on electrospun PVDF/BaTiO3 NW nanocomposite fibers for human motion monitoring. Nanoscale 10, 17751–17760 (2018). [DOI] [PubMed] [Google Scholar]
  • 13.Lee B.-Y., Kim D. H., Park J., Park K.-I., Lee K. J., Jeong C. K., Modulation of surface physics and chemistry in triboelectric energy harvesting technologies. Sci. Technol. Adv. Mater. 20, 758–773 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Wang H. S., Hong S. K., Han J. H., Jung Y. H., Jeong H. K., Im T. H., Jeong C. K., Lee B.-Y., Kim G., Yoo C. D., Lee K. J., Biomimetic and flexible piezoelectric mobile acoustic sensors with multiresonant ultrathin structures for machine learning biometrics. Sci. Adv. 7, eabe5683 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Chen T., Shi Q., Zhu M., He T., Sun L., Yang L., Lee C., Triboelectric self-powered wearable flexible patch as 3D motion control interface for robotic manipulator. ACS Nano 12, 11561–11571 (2018). [DOI] [PubMed] [Google Scholar]
  • 16.Jin T., Sun Z., Li L., Zhang Q., Zhu M., Zhang Z., Yuan G., Chen T., Tian Y., Hou X., Lee C., Triboelectric nanogenerator sensors for soft robotics aiming at digital twin applications. Nat. Commun. 11, 5381 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Sun Z., Zhu M., Zhang Z., Chen Z., Shi Q., Shan X., Yeow R. C. H., Lee C., Artificial intelligence of things (AIoT) enabled virtual shop applications using self-powered sensor enhanced soft robotic manipulator. Adv. Sci. 8, e2100230 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Kim J., Lee M., Shim H. J., Ghaffari R., Cho H. R., Son D., Jung Y. H., Soh M., Choi C., Jung S., Chu K., Jeon D., Lee S. T., Kim J. H., Choi S. H., Hyeon T., Kim D. H., Stretchable silicon nanoribbon electronics for skin prosthesis. Nat. Commun. 5, 5747 (2014). [DOI] [PubMed] [Google Scholar]
  • 19.Lee G., Son J. H., Lee S., Kim S. W., Kim D., Nguyen N. N., Lee S. G., Cho K., Fingerpad-inspired multimodal electronic skin for material discrimination and texture recognition. Adv. Sci. 8, 2002606 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Wang S., Xu J., Wang W., Wang G.-J. N., Rastak R., Molina-Lopez F., Chung J. W., Niu S., Feig V. R., Lopez J., Lei T., Kwon S.-K., Kim Y., Foudeh A. M., Ehrlich A., Gasperini A., Yun Y., Murmann B., Tok J. B. H., Bao Z., Skin electronics from scalable fabrication of an intrinsically stretchable transistor array. Nature 555, 83–88 (2018). [DOI] [PubMed] [Google Scholar]
  • 21.Lee H. S., Chung J., Hwang G.-T., Jeong C. K., Jung Y., Kwak J.-H., Kang H., Byun M., Kim W. D., Hur S., Oh S.-H., Lee K. J., Flexible inorganic piezoelectric acoustic nanosensors for biomimetic artificial hair cells. Adv. Funct. Mater. 24, 6914–6921 (2014). [Google Scholar]
  • 22.Ramasubramanian M. K., Venditti R. A., Ammineni C., Mallapragada V., Optical sensor for noncontact measurement of lignin content in high-speed moving paper surfaces. Ieee Sens. J. 5, 1132–1139 (2005). [Google Scholar]
  • 23.Sayil S., Kerns D. V., Kerns S. E., Comparison of contactless measurement and testing techniques to a new all-silicon optical test and characterization method. Ieee T. Instrum. Meas. 54, 2082–2089 (2005). [Google Scholar]
  • 24.Legrand B., Dordet Y., Voyant J. Y., Yonnet J. P., Contactless position sensor using magnetic saturation. Sensor. Actuat. A Phys. 106, 149–154 (2003). [Google Scholar]
  • 25.Smith P. P., Zografos K., Sonar for recognising the texture of pathways. Robot. Auton. Syst. 51, 17–28 (2005). [Google Scholar]
  • 26.Gasulla M., Li X. J., Meijer G. C. M., van der Ham L., Spronck J. W., A contactless capacitive angular-position sensor. Ieee Sens. J. 3, 607–614 (2003). [Google Scholar]
  • 27.Wang Z. L., Triboelectric nanogenerators as new energy technology for self-powered systems and as active mechanical and chemical sensors. ACS Nano 7, 9533–9557 (2013). [DOI] [PubMed] [Google Scholar]
  • 28.Meng K. Y., Chen J., Li X. S., Wu Y. F., Fan W. J., Zhou Z. H., He Q., Wang X., Fan X., Zhang Y. X., Yang J., Wang Z. L., Flexible weaving constructed self-powered pressure sensor enabling continuous diagnosis of cardiovascular disease and measurement of cuffless blood pressure. Adv. Funct. Mater. 29, 1806388 (2019). [Google Scholar]
  • 29.Zhao L. M., Li H., Meng J. P., Wang A. C., Tan P. C., Zou Y., Yuan Z. Q., Lu J. F., Pan C. F., Fan Y. B., Zhang Y. M., Zhang Y., Wang Z. L., Li Z., Reversible conversion between schottky and ohmic contacts for highly sensitive, multifunctional biosensors. Adv. Funct. Mater. 30, 1907999 (2020). [Google Scholar]
  • 30.Ma Y., Zheng Q., Liu Y., Shi B. J., Xue X., Ji W. P., Liu Z., Jin Y. M., Zou Y., An Z., Zhang W., Wang X. X., Jiang W., Xu Z. Y., Wang Z. L., Li Z., Zhang H., Self-powered, one-stop, and multifunctional implantable triboelectric active sensor for real-time biomedical monitoring. Nano Lett. 16, 6042–6051 (2016). [DOI] [PubMed] [Google Scholar]
  • 31.Shi B. J., Li Z., Fan Y. B., Implantable energy-harvesting devices. Adv. Mater. 30, 1801511 (2018). [DOI] [PubMed] [Google Scholar]
  • 32.Sun J. Y., Yang A. P., Zhao C. C., Liu F., Li Z., Recent progress of nanogenerators acting as biomedical sensors in vivo. Sci. Bull. 64, 1336–1347 (2019). [DOI] [PubMed] [Google Scholar]
  • 33.Chen X., Gao L. X., Chen J. F., Lu S., Zhou H., Wang T. T., Wang A. B., Zhang Z. F., Guo S. F., Mu X. J., Wang Z. L., Yang Y., A chaotic pendulum triboelectric-electromagnetic hybridized nanogenerator for wave energy scavenging and self-powered wireless sensing system. Nano Energy 69, 104440 (2020). [Google Scholar]
  • 34.Li X. Y., Tao J., Wang X. D., Zhu J., Pan C. F., Wang Z. L., Networks of high performance triboelectric nanogenerators based on liquid-solid interface contact electrification for harvesting low-frequency blue energy. Adv. Energy Mater. 8, 1800705 (2018). [Google Scholar]
  • 35.Lai Y. C., Deng J. N., Niu S. M., Peng W. B., Wu C. S., Liu R. Y., Wen Z., Wang Z. L., Electric eel-skin-inspired mechanically durable and super-stretchable nanogenerator for deformable power source and fully autonomous conformable electronic-skin applications. Adv. Mater. 28, 10024–10032 (2016). [DOI] [PubMed] [Google Scholar]
  • 36.Ouyang H., Liu Z., Li N., Shi B. J., Zou Y., Xie F., Ma Y., Li Z., Li H., Zheng Q., Qu X. C., Fan Y. B., Wang Z. L., Zhang H., Li Z., Symbiotic cardiac pacemaker. Nat. Commun. 10, 1821 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Zheng Q., Tang Q. Z., Wang Z. L., Li Z., Self-powered cardiovascular electronic devices and systems. Nat. Rev. Cardiol. 18, 7–21 (2021). [DOI] [PubMed] [Google Scholar]
  • 38.Qu X., Ma X., Shi B., Li H., Zheng L., Wang C., Liu Z., Fan Y., Chen X., Li Z., Wang Z. L., Refreshable braille display system based on triboelectric nanogenerator and dielectric elastomer. Adv. Funct. Mater. 31, 2006612 (2020). [Google Scholar]
  • 39.Yao G., Kang L., Li C., Chen S., Wang Q., Yang J., Long Y., Li J., Zhao K., Xu W., Cai W., Lin Y., Wang X., A self-powered implantable and bioresorbable electrostimulation device for biofeedback bone fracture healing. Proc. Natl. Acad. Sci. U.S.A. 118, e2100772118 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Zou H., Zhang Y., Guo L., Wang P., He X., Dai G., Zheng H., Chen C., Wang A. C., Xu C., Wang Z. L., Quantifying the triboelectric series. Nat. Commun. 10, 1427 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Hinchet R., Yoon H. J., Ryu H., Kim M. K., Choi E. K., Kim D. S., Kim S. W., Transcutaneous ultrasound energy harvesting using capacitive triboelectric technology. Science 365, 491–494 (2019). [DOI] [PubMed] [Google Scholar]
  • 42.Guo H., Pu X., Chen J., Meng Y., Yeh M. H., Liu G., Tang Q., Chen B., Liu D., Qi S., Wu C., Hu C., Wang J., Wang Z. L., A highly sensitive, self-powered triboelectric auditory sensor for social robotics and hearing aids. Sci. Robot. 3, eaat2516 (2018). [DOI] [PubMed] [Google Scholar]
  • 43.Wen F., Sun Z., He T., Shi Q., Zhu M., Zhang Z., Li L., Zhang T., Lee C., Machine learning glove using self-powered conductive superhydrophobic triboelectric textile for gesture recognition in VR/AR applications. Adv. Sci. 7, 2000261 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Zhu M., He T., Lee C., Technologies toward next generation human machine interfaces: From machine learning enhanced tactile sensing to neuromorphic sensory systems. Appl. Phys. Rev. 7, 031315 (2020). [Google Scholar]
  • 45.Jung Y. H., Hong S. K., Wang H. S., Han J. H., Pham T. X., Park H., Kim J., Kang S., Yoo C. D., Lee K. J., Flexible piezoelectric acoustic sensors and machine learning for speech processing. Adv. Mater. 32, e1904020 (2020). [DOI] [PubMed] [Google Scholar]
  • 46.Wang H. S., Im T. H., Kim Y. B., Sung S. H., Min S., Park S. H., Lee H. E., Jeong C. K., Park J. H., Lee K. J., Flash-welded ultraflat silver nanowire network for flexible organic light-emitting diode and triboelectric tactile sensor. APL Mater. 9, e061112 (2021). [Google Scholar]
  • 47.Zhu M., Sun Z., Chen T., Lee C., Low cost exoskeleton manipulator using bidirectional triboelectric sensors enhanced multiple degree of freedom sensory system. Nat. Commun. 12, 2692 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Xu C., Zi Y., Wang A. C., Zou H., Dai Y., He X., Wang P., Wang Y.-C., Feng P., Li D., Wang Z. L., On the electron-transfer mechanism in the contact-electrification effect. Adv. Mater. 30, e1706790 (2018). [DOI] [PubMed] [Google Scholar]
  • 49.Wang Z. L., From contact electrification to triboelectric nanogenerators. Rep. Prog. Phys. 84, 096502 (2021). [DOI] [PubMed] [Google Scholar]
  • 50.Zhou Z., Chen K., Li X., Zhang S., Wu Y., Zhou Y., Meng K., Sun C., He Q., Fan W., Fan E., Lin Z., Tan X., Deng W., Yang J., Chen J., Sign-to-speech translation using machine-learning-assisted stretchable sensor arrays. Nat. Electron. 3, 571–578 (2020). [Google Scholar]
  • 51.Englehart K., Hudgins B., A robust, real-time control scheme for multifunction myoelectric control. Ieee T. Bio-med. Eng. 50, 848–854 (2003). [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Figs. S1 to S18

Table S1

Movies S1 to S4


Articles from Science Advances are provided here courtesy of American Association for the Advancement of Science

RESOURCES