Abstract
In this work a wearable gesture sensing device consisting of a textile strain sensor, using elastic conductive webbing, was designed for monitoring the flexion angle of elbow and knee movements. The elastic conductive webbing shows a linear response of resistance to the flexion angle. The wearable gesture sensing device was calibrated and then the flexion angle-resistance equation was established using an assembled gesture sensing apparatus with a variable resistor and a protractor. The proposed device successfully monitored the flexion angle during elbow and knee movements.
Keywords: wearable gesture-sensing device, textile strain sensor, elastic conductive webbing, flexion angle monitor, electronic textiles
1. Introduction
Measuring human movements is important before rehabilitation, training or exercises can start. Motion capture systems that use cameras, accelerometers, and flexible electrogoniometers have been studied extensively [1–5]. Although motion capture systems are capable of accurate measurements, they are inconvenient to use. Either the measurements must be set based on the characteristics of the person, or the axis of the coordination system has to be reset [2]. Moreover, the construction of the system requires fairly substantial and heavy equipment. The main drawbacks of the motion capture systems available in today's market are their weight and rigidity. In particular, conventional sensors often require the use of complex and uncomfortable mechanical plug-ins in order to position the sensors on garments [6].
Textile solutions are well suited for constructing a sensing system that is comfortable for the wearer. Several studies have been carried out to show that a textile sensor is a practical and wearable electric device [6–9]. Electronic textiles (e-textiles) are used in the entertainment industry and the fashion industry, as well as for communication, sensing and monitoring, even for position location [10–15]. Due to the rigidity of an alloy strain gauge, the maximum static strain level is limited to low stress measurements. Fatigue is another problem of alloys when making dynamic measurements because of their poor repeatability [16]. Therefore one particularly interesting application for e-textiles is their use as strain-resistance sensors.
Abdessalem reported that plated plain knitted fabric using Lycra yarns exhibited serious tensile hysteresis [17]. The incomplete recovery of a knitted fabric is mainly due to the slippage of the fibers in spun yarn and/or the permanent extension of the fibers. The permanent extension of the fibers depends on the viscoelasticity of the fiber in used. Mattmann developed a strain sensor using a mixture of thermoplastic elastomer and carbon black particles [18]. The strain sensor was proven to have a linear response of resistance to the strain, but with a small electrical hysteresis. The use of carbon coated yarns wrapped with elastic yarn as a strain sensor was studied by Huang [19,20]. However the strain-resistance relationship of the sensor was found to be non-linear, which was mainly due to the irregular characteristic of the yarn structure.
In our previous study we used fabricated elastic conductive webbing using carbon coated fibers and elastic fibers as a strain-resistance sensor [21]. It showed to have high resistance sensitivity, low tensile hysteresis, as well as high linearity and repeatability of the relationship between strain and resistance without resistance hysteresis. In the present study we developed a wearable gesture-sensing device consisting of a strain-resistance textile sensor, based on elastic conductive webbing, for monitoring the flexion angle during elbow and knee movements. We established the flexion angle-resistance equation of the strain-resistance textile sensor and then evaluated the performance of the wearable sensing device for monitoring the flexion angle during elbow and knee movements.
2. Experimental Section
2.1. Materials
We used elastic conductive webbing made with conductive yarns and elastic yarns in this study. Polyamide fiber coated with carbon particles (PAC fiber) and having a diameter of 50 μm was used as the conductive fiber. Fifteen PAC fibers were twisted with a polyester yarn at a rate of 80 twists per meter to form a conductive yarn with a diameter of 420 μm. Then a Lycra fiber was cross-wrapped over two polyester yarns to form an elastic yarn with a diameter of 800 μm. The tensile properties and the resistance of this elastic and conductive yarn were reported in our previous study [21].
The elastic conductive webbing has a plain structure, 8 mm wide by 2 mm thick. The warp is made up of 32 conductive yarns and five elastic yarns, and the weft by one conductive yarn (see Figure 1). The feed ratio of the conductive yarn in the warp direction was 280%. The elastic yarns were positioned between the conductive yarns as stuffer yarns in warp direction.
2.2. The Assembled Gesture Sensing Apparatus and Calibration
A gesture sensing apparatus with a protractor was assembled for measuring the flexion angle-resistance (Figure 2). The protractor was set on the bearing. The distance between the electrodes was fixed at 50 mm, and the measured length of elastic conductive webbing was 100 mm. In order to obtain a stable resistance when measuring the flexion angle-resistance, the elastic conductive webbing was placed on a flat plane on the apparatus. A non-elastic webbing was connected with the elastic conductive webbing to keep the elastic conductive webbing moving in the flat plane and to pull on the elastic conductive webbing during the flexion-recovery movement. The flexion angle of the gesture sensing apparatus was recorded using a protractor and the change in resistance of the elastic conductive webbing between two electrodes was measured during the flexion-recovery movement. The relationship between the flexion angle and the resistance of the elastic conductive webbing in the flexion-recovery cycles can be established using this assembled gesture sensing apparatus with a protractor.
A variable resistor and a protractor were used to calibrate the relationship between the flexion angle and the resistance of the assembled gesture sensing apparatus (see Figure 3). Here the flexion angle is proportional to the length of the flexion arc, l = 2πr × θ/360°, where l is the arc length, r is the radius, and θ is the flexion angle. The resistance and flexion angle of the gesture sensing apparatus using a variable resistor and a protractor were recorded for ten flexion-recovery cycles measurements, respectively. The results are shown in Figure 4. It can be seen that the resistance is proportional to the flexion angle. The linear regression equation of the flexion angle to the resistance of the variable resistor on the gesture sensing apparatus is: y = −0.07x + 16.15 with R2 = 1, where x is the flexion angle, y is the resistance, and R2 is the coefficient of determination.
2.3. Design of Textile Strain Sensor
A textile strain sensor was used on the wearable gesture sensing device to determine the resistance in response to the strain. The textile strain sensor consisted of the elastic conductive webbing, two electrodes, two wires, a substrate, and a non-elastic webbing. The substrate was a thin board coated with polytetrafluoroethylene in order to reduce the abrasion between the webbing and the substrate during dynamic movement. The non-elastic webbing was connected with the elastic conductive webbing in order to pull the elastic conductive webbing during the flexion-recovery movement. A copper tube placed on the substrate was used as one electrode, and a stainless steel yarn was used as the electrode connected with the elastic conductive webbing. The distance between the two electrodes was fixed at 50 mm. The change in resistance of the textile strain sensor during the stretching and recovering movements can thus be measured. Based on the relationship between the flexion angle and the resistance of the elastic conductive webbing in the flexion-recovery cycles, the relationship between the flexion angle and the resistance of the textile strain sensor during the stretching and recovering movements can thus be obtained.
2.4. Design of the Wearable Gesture Sensing Device
The textile strain sensor was placed in the straight position of the limbs for monitoring the flexion angle during elbow or knee movement. In order to ensure the stability of the resistance when measuring the flexion angle-resistance, a woven fabric, referred to as the steady fabric, was used to fix the textile strain sensor. The design of the wearable gesture-sensing devices for measuring the flexion angle during elbow and knee movements is shown in Figure 5.
3. Results and Discussion
3.1. The Flexion Angle-Resistance of the Elastic Conductive Webbing
The resistances to elongation by the elastic conductive webbing during the tensile stretch-recovery cycles within 30% strain are shown in Figure 6. The results show that the resistance of the elastic conductive webbing is proportional to the elongation during the tensile stretch-recovery cycles, in which the coefficient of determination (R2) of the linear regression curve was 0.98. The flexion angle-resistance of the elastic conductive webbing was measured in ten flexion-recovery cycles within 30% strain using the assembled gesture sensing apparatus with a variable resistor and a protractor. The flexion angle-resistance regression curve of the elastic conductive webbing is shown in Figure 7. The coefficient of determination (R2) of the linear regression curve is 0.96. This indicates that the elastic conductive webbing has a good linear relationship between flexion angle and resistance during the flexion-recovery cycles within 30% strain.
3.2. Developing the Flexion Angle-Resistance Equation of the Wearable Gesture Sensing Device
In order to establish the flexion angle-resistance equations of the wearable gesture sensing device for elbow and knee movements, a Data Acquisition/Switch Unit (34972A LXI, Agilent Technologies, Taipei, Taiwan) was used to measure the resistance of textile strain sensor. The wearable gesture sensing device and the gesture sensing apparatus with a variable resistor and a protractor were worn on the elbow or the knee at the same position (Figure 8). Both were synchronously monitoring the flexion angle during elbow or knee movements. The relationship between the flexion angle (°) and resistance (K ohm) of the gesture sensing apparatus with a variable resistor and a protractor was established first. The relationship between flexion angle and resistance of the wearable gesture sensing device was then calibrated using the gesture sensing apparatus with a variable resistor and a protractor. The flexion angle-resistance equations of the wearable gesture sensing device were then established as: y = −37x + 595 (R2 = 0.96) and y = −19x + 280 (R2 = 0.97) for elbow and knee movements, respectively. Where x is resistance, y is flexion angle, and R2 is the coefficient of determination.
3.3. Evaluating the Wearable Gesture Sensing Device
The wearable gesture sensing device was applied to monitor the flexion angle during elbow and knee movements. The flexion angle and resistance of the gesture sensing apparatus with a variable resistor and a protractor worn on the same position were synchronously recorded during elbow and knee movements. Figure 9 shows camera snapshots during elbow and knee movements of the wearable gesture sensing device. The resistance of the wearable gesture sensing device during elbow and knee movements was recorded, and the corresponding flexion angle was calculated using the flexion angle-resistance equation of the wearable gesture sensing device (see Figure 9). Compared with the results of the gesture sensing apparatus with a variable resistor and a protractor (Figure 9), it is evident that the results obtained from the wearable gesture sensing device are consistent with those from the gesture sensing apparatus. This suggests that the wearable gesture sensing device is able to monitor the flexion angles during the elbow and knee movements.
4. Conclusions
In this work an elastic conductive webbing with a plain structure, consisting of 32 conductive yarns and five elastic yarns in the warp and one conductive yarn in the weft, was used as a textile strain sensor. The resistance of the elastic conductive webbing to the flexion angle had a good linear relationship during the stretch-recovery cycles within 30% strain. This webbing can be used as a flexion angle-resistance sensor for a wearable gesture sensing device. We also designed a textile-based wearable gesture sensing device for monitoring the flexion angle during elbow and knee movements. The flexion angle-resistance equations of the wearable gesture sensing device during elbow and knee movements were calibrated and established using a gesture sensing apparatus with a variable resistor and a protractor. The wearable gesture sensing device was used to monitor the flexion angles during elbow and knee movements. The results showed that the wearable gesture sensing device based on a textile strain sensor for monitoring the flexion angles during elbow and knee movements was successfully implemented. The main advantages of the proposed textile-based wearable gesture sensing device are precision of measurement, wearability, and for the ability of monitoring flexion angles during elbow and knee movements without any discomfort.
Acknowledgments
This work was supported by the National Science Council of Taiwan, under grant number NSC 100-2221-E-035-024-MY3 and NSC 103-2218-E-035-004.
Author Contributions
(1) Tien-Wei Shyr makes substantial contributions in the plan, design, data analysis, and paper writing in this work; (2) Jing-Wen Shie makes substantial contributions in the data analysis and draft writing in this work; (3) Chang-Han Jiang and Jung-Jen Li make substantial contributions in the acquisition and analysis of data.
Conflicts of Interest
The authors declare no conflict of interest.
References
- 1.Wang P.T., King C.E., Do A.H., Nenadic Z. A durable, low-cost electrogoniometer for dynamic measurement of joint trajectories. Med. Eng. Phys. 2011;33:546–552. doi: 10.1016/j.medengphy.2010.12.008. [DOI] [PubMed] [Google Scholar]
- 2.Cho G., Jeong K., Paik M.J., Kwun Y., Sung M. Performance evaluation of textile-based electrodes and motion sensors for smart clothing. IEEE Sens. J. 2011;11:3183–3193. [Google Scholar]
- 3.Hoshino R., Arita D., Yonemoto S., Taniguchi R.I. Real-Time Human Motion Analysis Based on Analysis of Silhouette Contour and Color Blob. Proceedings of the 2nd International Workshop on Articulated Motion and Deformable Objects (AMDO′02); Palma de Mallorca, Spain; 21–23 November 2002; pp. 92–103. [Google Scholar]
- 4.Koyanagi M., Shino K., Yoshimoto Y., Inoue S., Sato M., Nakata K. Effects of changes in skiing posture on the kinetics of the knee joint. Knee Surg. Sport Tr. A. 2006;14:88–93. doi: 10.1007/s00167-004-0609-2. [DOI] [PubMed] [Google Scholar]
- 5.Motoi K., Ikeda K., Kuwae Y., Ogata M., Fujita K., Oikawa D., Yuji T., Higashi Y., Fujimoto T., Nogawa M., et al. World Congress on Medical Physics and Biomedical Engineering 2006. Springer; Seoul, Korea: 2006. Development of a Wearable Sensor System for Monitoring Static and Dynamic Posture Together with Walking Speed for Use in Rehabilitation; pp. 2977–2980. [Google Scholar]
- 6.Tognetti A., Lorussi F., Bartalesi R., Quaglini S., Tesconi M., Zupone G., de Rossi D. Wearable kinesthetic system for capturing and classifying upper limb gesture in post-stroke rehabilitation. J. NeuroEng. Rehabil. 2005;2:1–16. doi: 10.1186/1743-0003-2-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Harms H., Amft O., Roggen D., Tröster G. Rapid prototyping of smart garments for activity-aware applications. J. Amb. Intel. Smart En. 2009;1:87–101. [Google Scholar]
- 8.Gregory R.V., Kimbrell W.C., Kuhn H.H. Electrically conductive non-metallic textile coatings. J. Ind. Text. 1991;20:167–175. [Google Scholar]
- 9.Scilingo E.P., Lorussi F., Mazzoldi A., de Rossi D. Strain-sensing fabrics for wearable kinaesthetic-like systems. IEEE Sens. J. 2003;3:460–467. [Google Scholar]
- 10.Carpi F., de Rossi D. Electroactive polymer-based devices for e-textiles in biomedicine. IEEE Trans. Inf. Technol. Biomed. 2005;9:295–318. doi: 10.1109/titb.2005.854514. [DOI] [PubMed] [Google Scholar]
- 11.Cochrane C., Koncar V., Lewandowski M., Dufour C. Design and development of a flexible strain sensor for textile structures based on a conductive polymer composite. Sensors. 2007;7:473–492. [Google Scholar]
- 12.Post E.R., Orth M., Russo P.R., Gershenfeld N. E-broidery: Design and fabrication of textile-based computing. IBM Syst. J. 2000;39:840–860. [Google Scholar]
- 13.Campbell T.E., Munro B.J., Wallace G.G., Steele J.R. Can fabric sensors monitor breast motion. J. Biomech. 2007;40:3056–3059. doi: 10.1016/j.jbiomech.2007.01.020. [DOI] [PubMed] [Google Scholar]
- 14.Martinez F., Obieta G., Uribe I., Sikora T., Ochoteco E. Polymer-based self-standing flexible strain sensor. J. Sens. 2010;2010:1–5. [Google Scholar]
- 15.Cochrane C., Lewandowski M., Koncar V. A flexible strain sensor based on a conductive polymer composite for in situ measurement of parachute canopy deformation. Sensors. 2010;10:8291–8303. doi: 10.3390/s100908291. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Zhang H., Tao X.M., Yu T.X., Wang S.Y. Conductive knitted fabric as large-strain gauge under high temperature. Sens. Actuator A Phys. 2006;126:129–140. [Google Scholar]
- 17.Abdessalem S.B., Abdelkader Y.B., Mokhtar S., Elmarzougui S. Influence of elastane consumption on plated plain knitted fabric characteristics. J. Eng. Fiber Fabr. 2009;4:30–34. [Google Scholar]
- 18.Mattmann C., Clemens F., Tröster G. Sensor for measuring strain in textile. Sensors. 2008;8:3719–3732. doi: 10.3390/s8063719. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Huang C.T., Tang C.F., Lee M.C., Chang S.H. Parametric design of yarn-based piezoresistive sensors for smart textiles. Sens. Actuator A Phys. 2008;148:10–15. [Google Scholar]
- 20.Huang C.T., Shen C.L., Tang C.F., Chang S.H. A wearable yarn-based piezo-resistive sensor. Sens. Actuator A Phys. 2008;141:396–403. [Google Scholar]
- 21.Shyr T.W., Shie J.W., Jhuang Y.E. The effect of tensile hysteresis and contact resistance on the performance of strain-resistant elastic-conductive webbing. Sensors. 2011;11:1693–1705. doi: 10.3390/s110201693. [DOI] [PMC free article] [PubMed] [Google Scholar]