Significance
The sense of softness is vital for survival, well-being, and complex social interactions among animals and humans. It guides decisions ranging from food selection in animals to the detection of medical anomalies in humans. Yet, our grasp of this sensation, including its neural pathways and underlying cognitive processes, remains incomplete. This study introduces a haptic display, the softness-rendering interface (SORI), which quantitatively replicates softness sensations. By adapting to the individual properties of fingertips and bridging the gap between actual and perceived softness, SORI offers a leap forward in understanding and accurately simulating this pivotal sense. This advancement not only holds promise for enhancing haptic technology but also paves the way for deeper insights into the neuroscience of softness perception.
Keywords: softness, display, perception, tactile, haptics
Abstract
Tactile perception of softness serves a critical role in the survival, well-being, and social interaction among various species, including humans. This perception informs activities from food selection in animals to medical palpation for disease detection in humans. Despite its fundamental importance, a comprehensive understanding of how softness is neurologically and cognitively processed remains elusive. Previous research has demonstrated that the somatosensory system leverages both cutaneous and kinesthetic cues for the sensation of softness. Factors such as contact area, depth, and force play a particularly critical role in sensations experienced at the fingertips. Yet, existing haptic technologies designed to explore this phenomenon are limited, as they often couple force and contact area, failing to provide a real-world experience of softness perception. Our research introduces the softness-rendering interface (SORI), a haptic softness display designed to bridge this knowledge gap. Unlike its predecessors, SORI has the unique ability to decouple contact area and force, thereby allowing for a quantitative representation of softness sensations at the fingertips. Furthermore, SORI incorporates individual physical fingertip properties and model-based softness cue estimation and mapping to provide a highly personalized experience. Utilizing this method, SORI quantitatively replicates the sensation of softness on stationary, dynamic, homogeneous, and heterogeneous surfaces. We demonstrate that SORI accurately renders the surfaces of both virtual and daily objects, thereby presenting opportunities across a range of fields, from teleoperation to medical technology. Finally, our proposed method and SORI will expedite psychological and neuroscience research to unlock the nature of softness perception.
Tactile perception of softness is integral to survival in nature, well-being, and social interaction among animals and humans (1–4). Information about object softness and compliance informs food selection in Drosophila and howler monkeys (5, 6); grasp and squeeze capabilities in rhesus macaque monkeys (7); and disease detection, such as cancer or tumors, in humans through medical examination or palpation (8, 9).
Previous psychological and neuroscience research confirms the complexity of softness perception that incorporates multiple sensory modalities, cognitive processes, and interaction phases (10–12). Prior studies (13–18) assert that softness is cognitively perceived as a blend of kinesthetic and cutaneous cues. While pressure and skin deformation predominantly influence softness sensing, factors such as vision (19–21), temperature (22), and prior experience or memory (23) also contribute. Despite varying perceptual performance among different fingers in softness discrimination (24), factors such as contact area, indentation depth, and force play a particularly critical role in sensations experienced at the fingertips (14, 18, 25), which are abundant in mechanoreceptors in primates (26). However, a full understanding of softness perception, including its neural representation and the cognitive process behind it, remains elusive (27, 28).
Existing fingertip haptic interfaces predominantly generate either pure kinesthetic (29) or cutaneous tactile feedback (30–34). Despite their ability to render stiffness, shear forces, and vibrotactile stimuli, these devices fail to render softness due to their lack of control over both contact area and force. Consequently, researchers have developed fingertip haptic softness displays, with early versions using metallic telescopic cylinder arrays to cover the fingerpad (15). However, these devices’ rigid and discrete interaction cannot adequately conform to fingertips’ compliance and shape. Subsequent displays, equipped with flexible/stretchable membranes driven by electric motors (35, 36) and soft interfaces driven by pneumatic actuators (16, 37) and DEAs (38), offer improved conformability and continuous contact. However, none of the existing softness displays can decouple the force and contact area control and quantitatively mimic softness cues, due to the challenges in estimating complex softness information and mapping it to a physical display.
In this study, we introduce a haptic softness-rendering interface (SORI) that renders softness cues at the fingertip by independently controlling contact area and force. SORI’s ability to decouple control of these cues enables the rendering of both homogeneous surfaces of varying softness and non-homogeneous surfaces composed of stacked layers (Fig. 1A). SORI consists of two main parts: the stiffness and contact area rendering parts (Fig. 1B, SI Appendix, Fig. S1 and Design and Fabrication of SORI, and Movie S1). The contact area rendering part at the top includes a toroidal soft pneumatic actuator (SPA), which, when inflated, encompasses the fingertip and controls the contact area without triggering the sensation of curvature change (SI Appendix, Contact Area Rendering Part and Fig. S2). This toroidal SPA applies negligible normal force to the fingertip, a key feature in decoupling contact area and force cues. Its design conforms to the fingertip’s contours, enabling a continuous pressure distribution. The stiffness rendering part, located at the bottom, consists of an origami-inspired prismatic joint driven by a pouch motor. This joint restricts movement to the vertical axis and exhibits negligible deformation under off-axis loading. The device incorporates a force sensor and a position-sensing mechanism used in previous work (39). The SORI prototype, excluding the pneumatic control unit, weighs 8 g, generates forces up to 16.3 N at 200 kPa, and has a 5-mm range of motion (RoM), .
Fig. 1.
A haptic SORI. (A) SORI replicates tactile cues on fingertips to simulate both soft and hard homogeneous objects, as well as heterogeneous objects composed of layers with varying hardness. Examples of these objects include a marshmallow, an aluminum block, and a “Puskevit,” which is a biscuit layered on top of Turkish delight. (B) SORI consists of a toroidal SPA and a pouch-motor-driven origami prismatic joint. When inflated, the toroidal SPA envelops the fingertip without applying significant normal force. The joint restricts motion to the vertical axis, while the pouch motor generates force. SORI dynamically alters its contact area (A) and force (F) by controlling the pressure within the toroidal SPA () and pouch motor () in real-time, based on the applied force, indentation depth (δ), physical fingertip parameters (), target contact area spread rate (p), and stiffness (k).
Furthermore, we propose a general method for regenerating the sensation of softness at the fingertips using SORI. Softness perception varies among individuals due to biomechanical properties of their fingertips such as the shape, size, and elastic modulus. Indeed, different indenters are exposed to different forces and contact areas when pressed onto the same surface with exact indentation depth (SI Appendix, Fig. S3B). Consequently, the sensed stiffness and contact area spread rate (CASR) (14, 35) differ for fingers with varying physical properties. Therefore, as the initial step of softness regeneration, we identify the fingertip physical parameters radius (R) and Young’s modulus () to personalize rendered softness cues.
Before reproducing softness cues, it is necessary to estimate them upon contact with the target surface. Thus, we identify Young’s modulus and stiffness of the contact surface as the second step. We employ standardized Shore Hardness durometers to extract Young’s modulus information, aided by the hardness-to-Young’s modulus conversion model (40). To acquire stiffness information, we employ a universal testing machine outfitted with a rigid spherical indenter.
Subsequently, we propose a comprehensive model to estimate the CASR and stiffness for any fingertip with varying properties by considering the identified fingertip and surface properties. We utilize the extended Hertzian contact model for nonrigid indenters on flat surfaces (41). Moreover, we incorporated a nonlinear fingerpad model from ref. 42 into our contact mechanics model.
After estimating the contact area and force on the fingertip, we map these values to the softness display. We adopt a model-based approach to determine the target control inputs through an inverse model of SORI, which calculates two control pressure inputs to render the desired contact area and force. Regarding the stiffness rendering part, we build an empirical model derived from force–displacement experiments conducted at varying pouch pressures (SI Appendix, Fig. S3a and Stiffness Experiments).
In the final step of our softness regeneration method, we transmit the target pressure inputs to SORI. We drive SORI with a custom pneumatic control unit, achieving a pressure control bandwidth of 10 Hz and a stiffness control bandwidth of 4 Hz (SI Appendix, Pneumatic Control Setup, SORI Stiffness Rendering Characteristics and Bandwidth, and Fig. S4). This actuation bandwidth sufficiently stimulates type SA I Merkel cells, densely distributed in the fingertips and sensitive to low-frequency stimuli, 0.4 to 3 Hz (43–45). These receptors respond to light touch, also referred to as discriminative touch, with optimal stimuli being indentation. However, the roles of other mechanoreceptors in softness perception should be further explored and used as reference specifications for future softness display development.
Our proposed approach, summarized in Fig. 2A, quantitatively maps expected softness cues to SORI by providing a comprehensive model for the display and for the estimation of softness cues on the fingertip. Our method takes into account the physical properties of the fingertip to reconstruct personalized contact area spread rate (CASR) and stiffness.
Fig. 2.
Softness regeneration method and model. (A) We propose an all-encompassing strategy to numerically replicate the sensation of softness on distinct fingertips. Initially, we determine the physical parameters of a fingertip, such as its radius and modulus, to accurately estimate the softness cues for that specific fingertip. Subsequently, we extract properties of the target surface, such as stiffness and modulus. Using the identified fingertip and surface parameters, we estimate the softness cues, namely the contact area spread rate (CASR) and stiffness. Following this, we map these estimated values to the control inputs of the softness display. Ultimately, we recreate the softness cues on the actual hardware and feedback sensory readings, such as force and indentation depth, back to the estimation step, thus closing the loop. (B) To estimate the CASR and stiffness, we employ an extended Hertzian contact model that accounts for nonlinear fingertips on both soft and hard surfaces. (C) We present an analytical model that computes the required pressure inputs to generate the desired CASR and stiffness (SI Appendix, Contact Area Model).
Modeling
Softness Cues Estimation.
To estimate the personalized CASR and stiffness, we utilize the extended Hertzian contact model for nonrigid indenters on flat surfaces (41). The model claims that indentation with a soft spherical indenter of radius, R, is equivalent to indentation with a rigid spherical indenter with a larger effective radius, (Fig. 2B). This equivalence allows us to estimate the geometry of the deformed soft indenter and to calculate the corresponding contact area. We further incorporate the nonlinear fingerpad model (42) into our contact mechanics model, where . In this equation, , , β, and F represent the fingerpad’s secant Young’s modulus, effective Young’s modulus, load coefficient, and force, respectively. We ultimately derive the following contact area equation (SI Appendix, Contact Area Model):
| [1] |
where A, R, and are the contact area, the radius of the indenter, and the effective Young’s modulus of the surface, respectively. The effective Young’s modulus is defined by the equation , where E is Young’s modulus, and ν is Poisson’s ratio. Then, we normalize the fingertip parameters, which gives us the following:
| [2] |
This relationship reveals that the ratio depends solely on , which we define as the normalized contact area spread rate. Hence, we conclude that normalized CASR is a quantitative term that depends only on surface properties and is valid for any fingertip.
Finally, we estimate the stiffness that the fingertip perceives by transforming the stiffness measurements taken from a universal testing machine that uses a rigid spherical indenter. By employing the extended Hertzian contact model, we compute the force required by the soft fingertip to produce a specific level of deformation. This computation is based on the force that the rigid indenter applies to achieve an equivalent deformation of the surface (SI Appendix, Stiffness Conversion Model).
| [3] |
where are the force applied by the fingertip and rigid indenter, are the radius of the fingertip and the rigid indenter, and are the effective Young’s modulus of the fingertip and the surface.
Softness Cues Mapping.
As for the contact area rendering part, we present an analytical contact model of the toroidal SPA. We propose that the contact area on SORI consists of two components (Fig. 2C): The represents the contact area when the finger contacts a rigid flat surface, whereas accounts for the bulged up contact area created by the inflated toroidal SPA. We assume that the inflated thin and stretchable membrane conforms to the shape of the fingertip without causing deformation. Consequently, the estimated contact area, , is found: (SI Appendix, SORI Model). The model computes the required pressure input to the toroidal SPA to achieve the desired side contact area.
Results
Identification of Non-linear Fingertip Parameters.
To identify the physical fingertip parameters R, , and β, we conducted a contact area-force experiment (SI Appendix, Contact Area Experiments). In this experiment, participants applied varying levels of force to their fingertips against a flat surface made from hard polylactic acid (PLA), and we recorded the contact area between the fingertip and the surface. Using our contact model (Eq. 1), along with the force–displacement data from the experiment, we calculated the parameters that yielded the best fit. To demonstrate the validity of our approach, we carried out this experiment with two participants (Participants and Protocol in Materials and Methods). The identified fingertip parameters and the comparison of actual and modeled contact area spread rate (CASR) using these parameters are presented in Fig. 3A.
Fig. 3.
Estimation and regeneration of contact area spread rate and stiffness. (A) Identification of physical fingertip parameters: radius R, Young’s modulus , and load coefficient β (SI Appendix, Contact Area Experiments). We compare the actual and modeled CASR of two fingers touching a flat PLA surface using the identified parameters. (B) Comparison of actual, estimated, and recreated CASR for two fingertips touching homogeneous and nonhomogeneous objects. (C) Normalized CASR. We compare the model with normalized actual data for different fingers and materials. (D) Stiffness characterization of the materials and the stiffness range of SORI.
Regeneration of Contact Area Spread Rate and Stiffness.
To validate our proposed method and models for softness regeneration, we designed a series of experiments. In the first experiment, we measured the CASR of fingertips pressing against surfaces composed of various materials (SI Appendix, Contact Area Experiments). We then repeated the same experiment with SORI, varying the pressure of the toroidal SPA in discrete increments. We interpolated the results obtained from SORI to select the specific contact area corresponding to the exact target pressure value determined from the previous mapping step, enhancing the precision of our approach. We subsequently compared the actual, model-predicted, and regenerated CASR (Fig. 3B). The results showed successful regeneration of the CASR by the toroidal SPA for three different surfaces on two fingertips. The discrepancies between the actual and recreated CASR can primarily be attributed to our assumption of a spherical shape for the fingertips and to measurement errors. Furthermore, using Eq. 2, we compared the normalized CASR for different fingertips and materials (Fig. 3C). We confirmed that the normalized CASR depends solely on surface properties and is identical for all primate fingertips, concluding that it is an objective softness coefficient.
Next, we measured the stiffness of SORI and the samples used in the preceding experiments. The data indicated that SORI can render stiffness ranging from a minimum of 0.15 N/mm to a maximum of 6.52 N/mm (SI Appendix, Stiffness Experiments). Additionally, we compared the stiffness of the samples with the range of stiffness renderable by SORI (Fig. 3D). SORI accurately replicated the stiffness of the samples, except for that of DS30, which exceeded SORI’s maximum renderable stiffness. Although it is feasible to further enhance SORI’s stiffness capacity by utilizing a more durable pouch material and increasing pouch dimensions, the current results underscore the importance of rendering both CASR and stiffness cues on the fingertip for realistic softness recreation. Moreover, the outcomes demonstrate the efficacy of our proposed methodology and models in faithfully reproducing tactile softness cues on the fingertip (Movie S2).
Finally, we demonstrated that SORI can reproduce realistic tactile softness for both virtual and actual objects (Movie S3). When tasked with reproducing the tactile sensations of two materials, such as salmon and Turkish delight, SORI accurately mirrored their distinct contact behaviors. Specifically, to emulate the sensation of a salmon fillet, SORI produced a broader contact area but exerted less force compared to the sensation of Turkish delight (Fig. 4 A and B). Uniquely, SORI is capable of rendering both static and dynamic contact interactions. As an illustration, it can mimic the dynamic contact of a heart model with a pulse of 30 beats per minute (Fig. 4C and Movie S4). We touched SORI with a rigid indenter, fixed in space and roughly the size of a fingertip, to record changes in force and contact area. As expected, the contact area and force fluctuated in coordination with the heartbeat cycles.
Fig. 4.
Characterization of SORI performance. (A–C) Real-time regeneration of both static and dynamic surfaces. SORI successfully emulates the tactile sensation of a softer salmon fillet (A), a harder Turkish delight (B), and a heart model (C). In (B), SORI generates a smaller contact area while exerting a significantly higher force compared to (A). In (C), the position of the indenter remains stationary while the contact area and force change dynamically, aligning with the simulated heartbeat. (D) Comparison of SORI with other softness displays. An ideal softness display would possess almost zero volume and an infinite stiffness range, with independent control over the softness cues. SORI surpasses the capabilities of current state-of-the-art softness displays (15–17, 35, 37, 38, 46–50).
Discussion
The presented work demonstrates that a haptic platform quantitatively recreates cutaneous and kinesthetic cues simultaneously on any arbitrary fingertip with high fidelity. SORI with decoupled control over softness cues and embedded multimodal sensing recreates homogeneous, nonhomogeneous, stationary, and dynamic surfaces. Crucially, it generates personalized realistic softness cues on various fingertips by accounting for their physical properties, thus, accounting for the subjectivity in softness sensation. To the best of our knowledge, there is no other platform, method, or model to achieve softness rendering at this level (Fig. 4D and SI Appendix, Table S1).
This comprehensive softness-rendering technology has the potential to catalyze psychophysical and neuroscience studies, helping to unlock the nature of softness perception and the somatotopic representation in the brain. It will enhance our understanding of cognitive processes in both humans and nonhuman primates by enabling controllable and repeatable experiments across different subjects. The insights gained from these findings could inform therapeutic interventions to restore lost softness sensation and stimulate technological developments in fields such as haptics, teleoperation, and telepresence. These technologies hold promise for applications ranging from robot-assisted surgery to remote social interactions. When integrated with virtual and augmented reality technologies, they could train physicians in palpation and cancer detection. Moreover, our work presents exciting challenges and research opportunities in areas like modeling, sensing, actuation, and control for the robotics community, ultimately advancing our understanding of our nature and pushing the boundaries of technological innovation.
Materials and Methods
Design and Fabrication of SORI.
SORI comprises two key components: the contact area rendering and stiffness rendering parts. The contact area rendering section utilizes a toroidal SPA, which includes four layers: a top silicone membrane, a mask, a bottom silicone membrane, and a rigid mesh. The fabrication process involves silicone molding and paper masking techniques, using Dragon Skin 30 (Smooth-On) silicone material and a surface tension diffuser SLIDE-STD (Smooth-On) to minimize stiction. To prevent stiction between the silicone and the mask layer, laser-cut copy paper is chosen as the mask material. The inner radius of the mask is designed based on the minimum detectable force threshold for humans, leading to an inner diameter of 4 mm, which includes a safety margin. The mask’s outer diameter is set at 22 mm to ensure comprehensive contact coverage while maintaining an ergonomic design. The top membrane, with a thickness of 0.75 mm, withstands pressures up to 30 kPa without breaking. This design is strategically aimed at minimizing the thickness of the membrane to reduce the normal force exerted on the fingertip, thereby enhancing conformability and enabling high renderable hardness.
The stiffness rendering component of SORI includes an origami prismatic joint and a pouch motor. This origami structure is crafted using a laminate manufacturing method. It consists of 0.5-mm glass-reinforced epoxy laminate (FR4) for the rigid layers, 50 μm Kapton polyimide film for the flexible hinges, and a Poli-Melt 701 film as the adhesive layer to bond the flexible and rigid layers. The pouch actuator, made from thermoplastic polyurethane (TPU) coated fabric and a Teflon sheet, is precisely laser-cut and positioned between the TPU layers. These layers are then heat-pressed at 180°C for 30 s under a pressure of 200 N.
The toroidal SPA is strategically placed on the origami structure, incorporating a force-resistive sensor (Interlink FSR 402) between them. In alignment with methodologies from previous research (39), a position-sensing mechanism based on a linear potentiometer (Alps Alpine RS08U111Z001) is utilized. To ensure precise positioning of the origami structure and the potentiometer, a custom-designed PCB and a 3D-printed holder are employed. This origami assembly achieves a maximum range of motion of 5 mm. (SI Appendix, Fig. S1 and Design and Fabrication of SORI).
Experiments.
We designed comprehensive experiments to evaluate SORI’s performance and to validate our models. For characterizing the stiffness range of SORI, we performed tests using a universal testing machine (Instron 5965), equipped with a rigid spherical indenter with a radius of 9 mm. The pressure of SORI was varied from 0 to 200 kPa in increments of 40 kPa (SI Appendix, Fig. S3A and Stiffness Experiments). Furthermore, we quantified the normal force exerted by the toroidal SPA on the fingertip. For this, we utilized a soft spherical indenter with a diameter of 18 mm made of Dragon Skin 10, designed to mimic a soft fingertip. It was mounted on the universal testing machine and positioned to tangentially touch the toroidal SPA. The pressure was incrementally increased in steps of 4 kPa up to a maximum of 24 kPa. The force at each pressure level was recorded. This procedure was replicated three times (SI Appendix, Fig. S2 and Contact Area Rendering Part).
To show the validity of our models, contact area experiments were performed. The experimental setup comprised a finger stand with a linear guide, a 3D-printed finger bed set at a 30-degree angle, and a spring to reset the bed. Participants applied forces of varying magnitudes (N) onto surfaces with different softness levels. The fingerprints left on ink-covered surfaces were transferred to copy paper, scanned at high resolution, and analyzed using ImageJ software to determine contact areas. Each material and subject underwent this process three times. The same procedure was applied to SORI, adjusting the toroidal SPA’s pressure from 0 to 24 kPa in 4 kPa increments (SI Appendix, Contact Area Experiments). Additionally, the toroidal SPA inflation-pressure model was validated by measuring the height of its top membrane under varying pressure and force inputs. This was done by mounting the toroidal SPA on a Nano 17 ATI force sensor and employing a OMRON ZW-CE10T high-resolution fiber displacement sensor, which was positioned using an XYZ system with an INNO6 Automatic Precision Stage capable of < ± 1 μm accuracy (SI Appendix, Fig. S3C and Toroidal SPA Characterization).
Participants and Protocol.
Two volunteers, both without any impairments in finger motor skills, participated in the contact area study. The study was approved by the Human Research Ethics Committee at EPFL (No. 081-2023), and participants provided informed consent prior to the procedures.
During the experiments, the participants were seated comfortably in a chair. They placed their index finger on a custom-designed finger stand equipped with a linear guide, a 3D-printed finger bed, and a spring mechanism to reset the bed to its starting position. The finger angle was consistently maintained at 30° to ensure uniformity across trials.
We conducted all contact area experiments using the subjects’ index fingers to ensure reliable data comparison. The participants were instructed to press samples coated with red ink to capture their fingerprints and then transfer their inked fingerprints onto paper. Each subject repeated the process three times for each force level and material tested. In the case of SORI, we performed analogous tests, adjusting the toroidal SPA’s pressure in increments of 4 kPa, ranging from 0 to 24 kPa. After scanning, the contact areas were quantified using the open-source ImageJ software. For data protection, all scanned fingerprints were deleted from our digital media following analysis.
Supplementary Material
Appendix 01 (PDF)
Softness Rendering Interface, SORI. The SORI is composed of two independent parts: the contact area and stiffness rendering parts. The contact area rendering part, constructed from a toroidal soft pneumatic actuator (SPA), manages the contact area with the fingertip upon inflation. Conversely, the stiffness rendering part, designed using an origami prismatic joint combined with a pouch motor, regulates the force applied to the fingertip.
Softness regeneration. SORI replicates tactile cues on the fingertips, simulating both soft and hard homogeneous objects. It also emulates heterogeneous objects composed of layers with varying degrees of hardness.
Softness regeneration of everyday objects. We measured the shore hardness and stiffness of everyday items, such as marshmallows, bread, salmon, and beef. Subsequently, SORI replicated the tactile sensation of softness associated with these objects.
Softness replication of dynamic surfaces. SORI simulates the dynamic contact of a heart model pulsating at 30 beats-per-minute.
SORI non-vertical motion reduction. The movie showcases two SORI prototypes, one with rectangular and the other with castellated folding hinges. The prototype with castellated hinges demonstrates a significant reduction in non-vertical movements during interaction.
Acknowledgments
We extend our gratitude to Dr. H. Chen and Prof. S. Lacour from the Laboratory for Soft Bioelectronic Interfaces at École Polytechnique Fédérale de Lausanne for initial inspirations for the topic, H. Penichou for assisting in the experiments, and Dr. X. Zheng for assisting in the simulations. This research was supported by the Swiss National Center of Competence in Research Robotics and the MOTIE (Ministry of Trade, Industry, and Energy) in Korea, under the Human Resource Development Program for Industrial Innovation (Global) (P0017306, Global Human Resource Development for Innovative Design in Robot and Engineering) supervised by the Korea Institute for Advancement of Technology.
Author contributions
M.M., H.J., and J.P. designed research; M.M. and H.J. performed research; W.D.W supervision; J.P. supervised the project; M.M., H.J., W.D.W, and J.P. analyzed data; and M.M. and H.J. wrote the paper.
Competing interests
The authors declare no competing interest.
Footnotes
This article is a PNAS Direct Submission.
Data, Materials, and Software Availability
Models, control codes, and experimental results are available on GitHub (https://github.com/MeTech/rrl-sori-public and https://doi.org/10.5281/zenodo.10246508) (51, 52).
Supporting Information
References
- 1.Gentsch A., Panagiotopoulou E., Fotopoulou A., Active interpersonal touch gives rise to the social softness illusion. Curr. Biol. 25, 2392–2397 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Pasqualotto A., Ng M., Tan Z. Y., Kitada R., Tactile perception of pleasantness in relation to perceived softness. Sci. Rep. 10, 11189 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Kitada R., Ng M., Tan Z. Y., Lee X. E., Kochiyama T., Physical correlates of human-like softness elicit high tactile pleasantness. Sci. Rep. 11, 16510 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Yu H., et al. , Social touch-like tactile stimulation activates a tachykinin 1-oxytocin pathway to promote social interactions. Neuron 110, 1051–1067.e7 (2022). [DOI] [PubMed] [Google Scholar]
- 5.Zhang Y. V., Aikin T. J., Li Z., Montell C., The basis of food texture sensation in Drosophila. Neuron 91, 863–877 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Sanchez-Solano K. G., et al. , Non-visual senses in fruit selection by the mantled howler monkey (Alouatta palliata). Primates 63, 293–303 (2022). [DOI] [PubMed] [Google Scholar]
- 7.Cu H., Lynch L., Huang K., Truccolo W., Nurmikko A., Grasp-squeeze adaptation to changes in object compliance leads to dynamic beta-band communication between primary somatosensory and motor cortices. Sci. Rep. 12, 6776 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Lalitharatne T. D., et al. , Face mediated human-robot interaction for remote medical examination. Sci. Rep. 12, 12592 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Doria D., Fani S., Giannini A., Simoncini T., Bianchi M., Enhancing the localization of uterine leiomyomas through cutaneous softness rendering for robot-assisted surgical palpation applications. IEEE Trans. Haptics 14, 503–512 (2021). [DOI] [PubMed] [Google Scholar]
- 10.Johansson R. S., Flanagan J. R., Coding and use of tactile signals from the fingertips in object manipulation tasks. Nat. Rev. Neurosci. 10, 345–359 (2009). [DOI] [PubMed] [Google Scholar]
- 11.Willemet L., Kanzari K., Monnoyer J., Birznieks I., Wiertlewski M., Initial contact shapes the perception of friction. Proc. Natl. Acad. Sci. U.S.A. 118, e2109109118 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.V. Vechev et al., “Tactiles: Dual-mode low-power electromagnetic actuators for rendering continuous contact and spatial haptic patterns in VR” in 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (IEEE, 2019), pp. 312–320.
- 13.Srinivasan M. A., LaMotte R. H., Tactual discrimination of softness. J. Neurophysiol. 73, 88–101 (1995). [DOI] [PubMed] [Google Scholar]
- 14.Bicchi A., Scilingo E. P., De Rossi D., Haptic discrimination of softness in teleoperation: The role of the contact area spread rate. IEEE Trans. Robot. Autom. 16, 496–504 (2000). [Google Scholar]
- 15.Scilingo E. P., Bianchi M., Grioli G., Bicchi A., Rendering softness: Integration of kinesthetic and cutaneous information in a haptic device. IEEE Trans. Haptics 3, 109–118 (2010). [DOI] [PubMed] [Google Scholar]
- 16.K. Yoshida et al., “Pneumatic concave deformable device and finger deformation-based evaluation for hardness perception” in 2021 IEEE World Haptics Conference (WHC) (IEEE, 2021), pp. 668–673.
- 17.Park J., Oh Y., Tan H. Z., Effect of cutaneous feedback on the perceived hardness of a virtual object. IEEE Trans. Haptics 11, 518–530 (2018). [DOI] [PubMed] [Google Scholar]
- 18.Dhong C., et al. , Role of indentation depth and contact area on human perception of softness for haptic interfaces. Sci. Adv. 5, eaaw8845 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Goda N., Yokoi I., Tachibana A., Minamimoto T., Komatsu H., Crossmodal association of visual and haptic material properties of objects in the monkey ventral visual cortex. Curr. Biol. 26, 928–934 (2016). [DOI] [PubMed] [Google Scholar]
- 20.Ujitoko Y., Kawabe T., Perceptual judgments for the softness of materials under indentation. Sci. Rep. 12, 1761 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Cavdan M., Drewing K., Doerschner K., The look and feel of soft are similar across different softness dimensions. J. Vision 21, 20 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Tan Z. Y., Choo C. M., Lin Y., Ho H. N., Kitada R., The effect of temperature on tactile softness perception. IEEE Trans. Haptics 15, 638–645 (2022). [DOI] [PubMed] [Google Scholar]
- 23.Metzger A., Drewing K., Memory influences haptic perception of softness. Sci. Rep. 9, 14383 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Zoeller A. C., Drewing K., A systematic comparison of perceptual performance in softness discrimination with different fingers. Atten. Percep. Psychophys. 82, 3696–3709 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Moscatelli A., et al. , The change in fingertip contact area as a novel proprioceptive cue. Curr. Biol. 26, 1159–1163 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Taube Navaraj W., et al. , Nanowire FET based neural element for robotic tactile sensing skin. Front. Neurosci. 11, 501 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Kitada R., et al. , Brain networks underlying tactile softness perception: A functional magnetic resonance imaging study. NeuroImage 197, 156–166 (2019). [DOI] [PubMed] [Google Scholar]
- 28.Kim J. H., et al. , Neural correlates of tactile hardness intensity perception during active grasping. PeerJ 9, e11760 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Mintchev S., Salerno M., Cherpillod A., Scaduto S., Paik J., A portable three-degrees-of-freedom force feedback origami robot for human-robot interactions. Nat. Mach. Intell. 1, 584–593 (2019). [Google Scholar]
- 30.Schorr S. B., Okamura A. M., Three-dimensional skin deformation as force substitution: Wearable device design and performance during haptic exploration of virtual environments. IEEE Trans. Haptics 10, 418–430 (2017). [DOI] [PubMed] [Google Scholar]
- 31.Sonar H. A., Gerratt A. P., Lacour S. P., Paik J., Closed-loop haptic feedback control using a self-sensing soft pneumatic actuator skin. Soft Robot. 7, 22–29 (2020). [DOI] [PubMed] [Google Scholar]
- 32.Yu X., et al. , Skin-integrated wireless haptic interfaces for virtual and augmented reality. Nature 575, 473–479 (2019). [DOI] [PubMed] [Google Scholar]
- 33.Liu Y., et al. , Electronic skin as wireless human-machine interfaces for robotic VR. Sci. Adv. 8, eabl6700 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Giraud F. H., Joshi S., Paik J., Haptigami: A fingertip haptic interface with vibrotactile and 3-DoF cutaneous force feedback. IEEE Trans. Haptics 15, 131–141 (2021). [DOI] [PubMed] [Google Scholar]
- 35.Bianchi M., Serio A., Design and characterization of a fabric-based softness display. IEEE Trans. Haptics 8, 152–163 (2015). [DOI] [PubMed] [Google Scholar]
- 36.F. Kimura, A. Yamamoto, T. Higuchi, “Development of a 2-DoF softness feeling display for tactile tele-presentation of deformable surfaces” in 2010 IEEE International Conference on Robotics and Automation (IEEE, 2010), pp. 1822–1827.
- 37.Frediani G., Carpi F., Tactile display of softness on fingertip. Sci. Rep. 10, 20491 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Frediani G., et al. , A soft touch: Wearable tactile display of softness made of electroactive elastomers. Adv. Mater. Technol. 6, 2100016 (2021). [Google Scholar]
- 39.Mete M., Paik J., Closed-loop position control of a self-sensing 3-DoF origami module with pneumatic actuators. IEEE Robot. Autom. Lett. 6, 8213–8220 (2021). [Google Scholar]
- 40.Qi H. J., Joyce K., Boyce M. C., Durometer hardness and the stress-strain behavior of elastomeric materials. Rubber Chem. Technol. 76, 419–435 (2003). [Google Scholar]
- 41.Fischer-Cripps A., The Hertzian contact surface. J. Mater. Sci. 34, 129–137 (1999). [Google Scholar]
- 42.Dzidek B. M., Adams M. J., Andrews J. W., Zhang Z., Johnson S. A., Contact mechanics of the human finger pad under compressive loads. J. R. Soc. Interface 14, 20160935 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Ankit, et al. , Soft actuator materials for electrically driven haptic interfaces. Adv. Intell. Syst. 4, 2100061 (2022). [Google Scholar]
- 44.Dahiya R. S., Metta G., Valle M., Sandini G., Tactile sensing-from humans to humanoids. IEEE Trans. Robot. 26, 1–20 (2009). [Google Scholar]
- 45.L. Wang, L. Ma, J. Yang, J. Wu, Human somatosensory processing and artificial somatosensation. Cyborg Bionic Syst. (2021). [DOI] [PMC free article] [PubMed]
- 46.F. Kimura, A. Yamamoto, T. Higuchi, “Development of a 2-DoF softness feeling display for tactile tele-presentation of deformable surfaces” in 2010 IEEE International Conference on Robotics and Automation (IEEE, 2010), pp. 1822–1827.
- 47.Kimura F., Yamamoto A., Effect of delays in softness display using contact area control: Rendering of surface viscoelasticity. Adv. Robot. 27, 553–566 (2013). [Google Scholar]
- 48.Endo T., Kusakabe A., Kazama Y., Kawasaki H., Haptic interface for displaying softness at multiple fingers: Combining a side-faced-type multifingered haptic interface robot and improved softness-display devices. IEEE/ASME Trans. Mechatron. 21, 2343–2351 (2016). [Google Scholar]
- 49.Fani S., Ciotti S., Battaglia E., Moscatelli A., Bianchi M., W-FYD: A wearable fabric-based display for haptic multi-cue delivery and tactile augmented reality. IEEE Trans. Haptics 11, 304–316 (2017). [DOI] [PubMed] [Google Scholar]
- 50.K. Fujita, H. Ohmori, “A new softness display interface by dynamic fingertip contact area control” in 5th World Multiconference on Systemics, Cybernetics and Informatics (2001), pp. 78–82.
- 51.M. Mete, H. Jeong, W. D. Wang, J. Paik, Data for “M. Mete et al., SORI: A softness-rendering interface to unravel the nature of softness perception, PNAS, 2024”. Github. https://github.com/MeTech/rrl-sori-public. Deposited 1 December 2023. [DOI] [PMC free article] [PubMed]
- 52.M. Mete, H. Jeong, W. D. Wang, J. Paik, Data for “M. Mete et al., SORI: A softness-rendering interface to unravel the nature of softness perception, PNAS, 2024”. Zenodo. 10.5281/zenodo.10246508. Deposited 1 December 2023. [DOI] [PMC free article] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Appendix 01 (PDF)
Softness Rendering Interface, SORI. The SORI is composed of two independent parts: the contact area and stiffness rendering parts. The contact area rendering part, constructed from a toroidal soft pneumatic actuator (SPA), manages the contact area with the fingertip upon inflation. Conversely, the stiffness rendering part, designed using an origami prismatic joint combined with a pouch motor, regulates the force applied to the fingertip.
Softness regeneration. SORI replicates tactile cues on the fingertips, simulating both soft and hard homogeneous objects. It also emulates heterogeneous objects composed of layers with varying degrees of hardness.
Softness regeneration of everyday objects. We measured the shore hardness and stiffness of everyday items, such as marshmallows, bread, salmon, and beef. Subsequently, SORI replicated the tactile sensation of softness associated with these objects.
Softness replication of dynamic surfaces. SORI simulates the dynamic contact of a heart model pulsating at 30 beats-per-minute.
SORI non-vertical motion reduction. The movie showcases two SORI prototypes, one with rectangular and the other with castellated folding hinges. The prototype with castellated hinges demonstrates a significant reduction in non-vertical movements during interaction.
Data Availability Statement
Models, control codes, and experimental results are available on GitHub (https://github.com/MeTech/rrl-sori-public and https://doi.org/10.5281/zenodo.10246508) (51, 52).




