Abstract
The purpose of this study was to evaluate the use of compressible soft robotic sensors (C-SRS) in determining plantar pressure to infer vertical and shear forces in wearable technology: A ground reaction pressure sock (GRPS). To assess pressure relationships between C-SRS, pressure cells on a BodiTrakTM Vector Plate, and KistlerTM Force Plates, thirteen volunteers performed three repetitions of three different movements: squats, shifting center-of-pressure right to left foot, and shifting toes to heels with C-SRS in both anterior–posterior (A/P) and medial–lateral (M/L) sensor orientations. Pearson correlation coefficient of C-SRS to BodiTrakTM Vector Plate resulted in an average R-value greater than 0.70 in 618/780 (79%) of sensor to cell comparisons. An average R-value greater than 0.90 was seen in C-SRS comparison to KistlerTM Force Plates during shifting right to left. An autoregressive integrated moving average (ARIMA) was conducted to identify and estimate future C-SRS data. No significant differences were seen in sensor orientation. Sensors in the A/P orientation reported a mean R2 value of 0.952 and 0.945 in the M/L sensor orientation, reducing the effectiveness to infer shear forces. Given the high R values, the use of C-SRSs to infer normal pressures appears to make the development of the GRPS feasible.
Keywords: wearables, pressure, soft robotic sensors, ground reaction force, root mean square error
1. Introduction
The goal of this study was to develop a wearable solution using compressible soft robotic sensors (C-SRS, Stretchsense™ sensors, Auckland, New Zealand) to accurately collect data “from the ground up” as defined by the needs of the Strength and Conditioning Coach (S&CC) and Athlete Training (AT) practitioners who commonly rely upon wearable solutions in sports [1] for decisions about health and safety [2]. The aim of this research series was to extend the “Closing the Wearable Gap” paper series where the previous studies used stretchable soft robotic sensors or stretchable SRS to capture both static movements [3] and dynamic movements [4] of the foot–ankle complex as well as to fully quantify gait cycles [5] all through the validation of goodness-of-fit as compared to 3D motion capture. To this point in the paper series, only foot–ankle joint angles from common movements, such as plantar flexion (PF), dorsiflexion (DF), inversion (INV), and eversion (EVR), have been evaluated. To fully assess movements occurring in the closed kinetic chain for the lower-body [6], measuring ground reaction forces (GRFs) is critical in determining human performance data “from the ground up” [7].
Research into wearable technology has led to the application of soft sensors applied initially in robotics for use in capturing human movement [1,3,8,9]. Two categories of soft sensors include solid-state and liquid-state sensors, depending on the sensing elements [10]. Regardless of materials, two main types of soft sensors that can be connected to microelectronics include resistive- and capacitive-based sensors [11]. “Resistive sensors convert deformation to change in resistance,” while “capacitive sensors are typically composed of two flat-plate electrodes separated by a dielectric material” [12].
Parameters that soft sensors should be evaluated on include: “sensitivity or gauge factor, stretchability, linearity, hysteresis, response time, drift, dynamic durability, and overshooting behavior” [11]. The importance of sensor linearity and correlation to movement have been reported, and outcomes show that soft sensors can be modeled to measure dynamic human joint kinematics [3]. Resistive sensors have a higher gauge factor but unfortunately show signs of non-linearity as compared to capacitive sensors, which produce high linear outputs [11,12,13,14,15,16,17]. The non-linearity of resistive sensors creates challenges in software design to manage and make sense of data output. The use of deep learning neural networks demonstrates promise in taking advantage of the resistive sensors and minimizing their weaknesses [13].
Assessing both resistive and capacitive sensors under a mechanical force have shown that capacitive sensors exhibit greater uniformity across the entire sensor as compared to a resistive sensor, while resistive sensors reported a higher accuracy than the capacitive sensor [17]. Overall recommendations from Marinelli et al. [17] indicate that decisions to use resistive or capacitive sensors for pressure detection should be based on the magnitude of force, relative importance of accuracy, repeatability, and the substrates’ conformity to non-flat surfaces.
Developing a wearable ground reaction pressure sock (GRPS) will require identifying specific pressure points within the foot–shoe interaction. According to Urry, “an ideal force-sensing device will respond identically to two equal forces regardless of either the area over which the force is applied or the point of application of the force” [18]. Various types of pressure insoles are available for athletes to measure the vertical component of the pressure being applied by the foot [19]. F-scan™ system, pedar® mobile system [20], and Loadsol® [21] are products showing promise in improving the portability of capturing human gait. However, a limitation of pressure sensors is the inability to distinguish between normal and directional shear forces [18]. Refinement in capturing 3D deformation during the gait cycle has been achieved using stereoscopic cameras while walking on a glass plate [22]. Ito et al. identified several plantar pressure points including the heel and the ball of the foot as a relevant pressure and strain points during the gait cycle [22]. Placing sensors in these locations can provide the insight necessary to develop the GRPS to measure ground-based movement patterns.
Human activity recognition (HAR) is one aspect of the software and hardware integration that uses time-series data from sensors to recognize the movement patterns of the individual [23]. For systems to recognize movement patterns, the use of deep learning software has been shown to be effective. Applying deep learning software to wearable soft sensors can be challenging due to the non-linearity of the stretch and strain properties of sensor types and cost of computing power [13]. A potential solution to the non-linearity problem has been suggested by Miodownik et al., in using a long short-term memory neural network (LSTM) after calibration of a wearable stretch sensor. A solution to reduce the cost of computing power has been identified in the use of an auto regressive-integrated moving average (ARIMA) model in wireless sensor networks [24]. Another benefit of using an ARIMA model is the accuracy of immediate future data estimations; however, model prediction accuracy erodes over extended time [25]. Ma et al. proposed a solution for erosion over time by using an integrated sliding window feature within the ARIMA model [26]. The use of the sliding window ARIMA model proved effective when used in a mobile Android app to detect driver drowsiness. The app captured the driver’s electrooculography (EOG) signal 0.5 s ahead of time, notifying the driver of the potential dozing off while driving. This study uses ARIMA models to predict future data from C-SRSs.
2. Materials and Methods
In Parts II, III, and IV of “Closing the Wearable Gap” paper series [3,4,5], the use of stretchable SRS and optical motion capture were used to assess foot–ankle kinematics. Part II captured active range of motion of the four primary foot–ankle joint movements—PF, DF, INV, and EVR—while participants were seated [3]. Part III captured PF and DF during dynamic expected and unexpected slip and trip perturbations [4]. Part IV captured all four foot–ankle joint ranges of motion during multiple gait cycles on flat and tilted surfaces [5]. Given that the primary goal of this continuing research effort is to design a wearable solution that accurately captures data collected at the foot–ankle complex in a non-laboratory environment, developing the GRPS is a continuation of this paper series. This paper, Part V, assesses the use of compressible StretchSense™ sensors to capture foot ground reaction pressures during closed kinetic chain movements in squats, shifting center-of-pressure right-to-left, and toe-to-heel (anterior to posterior). Therefore, there will be shared similarities in layout, wording, and the goal of developing wearable technology that can measure movement and pressure “from the ground up” originating from the previous papers [3,4,5].
2.1. Participants
Thirteen volunteers participated in this study: Eight women (height 165.3 ± 2.2 cm, mass 76.2 ± 13.4 kg, age 32 ± 9.1 yrs.) with a mean U.S. shoe size of 8.6 (SD = 1.12) and five men (height 175.3 ± 6.5 cm, mass 81.1 ± 13.4 kg, age 25.6 ± 4.6 yrs.) with a mean U.S. shoe size of 10 (SD = 1.1). This study was approved and conducted under Mississippi State University’s (MSU’s) Institutional Review Board (IRB; protocol #19-354). Participants reported to the Human Performance Lab (HPL) at the Center for Advanced Vehicular Systems (CAVS). Before performing the test, participants were informed of the testing protocol. They were asked to read and sign an informed consent form, and all of their questions about the study protocol were addressed during the pre-test period. All participants reported no recent history of a lower extremity fracture, surgery, or previous ankle sprain in the last six months via a physical activity readiness questionnaire (PAR-Q) to “determine the safety or possible risk of exercising for an individual based on their health history, and current symptoms and risk factors” [27]. Participant’s anthropometric data, including height, weight, age, and shoe size were recorded.
2.2. Study Design
The study design followed a single-day testing protocol. A familiarization session was conducted before the experimental testing. All participants visited MSU CAVS HPL. During familiarization, all participants were briefed on the procedures and allowed to practice the movements of performing three squats, shifting right to left, and shifting toes to heels prior to testing. Upon completion of familiarization process, the participants performed the experimental testing.
2.3. Instrumentation and Participant Preparation
Figure 1 identifies the testing platform that consisted of ten C-SRSs (32 mm × 19 mm) placed on top of the BoditrakTM Vector Plate (Vista Medical, Winnipeg, MB, Canada), which was on top of a 6.35 mm rubber flooring surface to prevent slipping of the BoditrakTM Vector Plate which was placed on top of the Kistler™ Force Plates (Novi, MI, USA). The testing platform configuration is based on previous studies validating the use of sensors on pressure mats and force plates, with the additional rubber flooring used to reduce slippage between the BodiTrakTM Vector Plate and KistlerTM Force Plates [19,28]. The MotionMonitor™ software (Innovative Sports Training, Inc., Chicago, IL, USA), operated the KistlerTM Force Plates defining the Z-axis as the vertical axis, the Y-axis represents the anterior–posterior direction, and the X-axis represents the medial–lateral direction. Figure 2 shows the top-down view of the anterior–posterior (A/P) sensor layout and medial–lateral (M/L) sensor layout on top of the BodiTrakTM Vector Plate.
2.4. Movements
Figure 3 illustrates the three movements performed. The C-SRSs were placed in the A/P orientation. The participants stepped onto the testing platform and were instructed to perform three squatting motions based on their comfortable range of motion. Once completed the participants were instructed to shift their center-of-pressure to their right foot and onto the left foot three times without losing balance. After completion of shifting right to left, the participants were instructed to shift center-of-pressure towards their toes and then onto heels three times. Upon completion of the three movements, the participants stepped off the platform. After the sensors were realigned in the M/L orientation, the movements were repeated.
2.5. Experimental Procedures
All participants were first instructed to read through a participant consent form and freely agree to the intent of the study and methodology. Upon agreement, each participant signed their approval as per the IRB protocol #19-354. Participants were asked to take their shoes off and wear socks during the trials. To effectively validate the C-SRSs, each participant was asked to stand on two paper soles allowing for identification of the area of the heel and ball of the foot. Based on the individual’s foot size, alignments on the paper soles were then transferred to specific cells on the gridded BoditrakTM Vector Plate (Figure 2). Five C-SRSs were placed upon specific cells in the BodiTrakTM Vector Plate for each foot. Placement of the C-SRSs correlated to bony landmarks of the first metatarsal head, second and third metatarsal head (Mid), fifth metatarsal head, and medial and lateral locations under the calcaneus for both feet. The first trial placed the C-SRSs aligned in the anterior–posterior orientation (A/P, Figure 2).
The participant was asked to step on top of the C-SRSs and testing platform. A validation step was conducted during the first 20 s as a baseline and to ensure proper alignment of the sensors under the feet. Upon the researcher’s visual validation, three dynamic movements were performed with three repetitions of each movement: Squat, shift right to left, and shift toe to heel. The participants were instructed to perform the three squats based on their individual and comfortable range of motion. After completion of the squat movement, the participants were instructed to shift right to left, moving their center of mass to the right as the first movement. Upon completion of the second movement, the participants were instructed to shift center of mass forward to their toes and then back onto their heels without losing balance. Upon completion of the first trial, the participants were asked to step off the testing platform. The researcher then positioned the sensors in the medial–lateral direction within the same BodiTrakTM Vector Plate cell. The participants were then asked to step back onto the C-SRSs and testing platform. After the first 20 s validation, the protocol of the three-movement patterns with three repetitions was repeated. After completion of the second trial, the participants were asked to step off which concluded the study. All participants performed the movements in the same order.
2.6. Data Processing
C-SRS raw capacitance values were measured using the 10 Channel SPI Sensing Circuit in conjunction with the Bluetooth Low Energy (BLE) module, both made by StretchSenseTM. The values were recorded using the proprietary StretchSenseTM BLE iOS application (ver.3.6) on an iPhone X™ (AppleTM Inc., Cupertino, CA, USA) at 25 Hz. BodiTrakTM Vector Plate pressures were recorded at 25 Hz with a maximum threshold of 2068.8 mmHg (276 kPa) on a windows-based laptop operating the BodiTrak™ Pro 6.0 software KistlerTM Force Plates were controlled using The MotionMonitor™ software. To compare data from C-SRSs, BodiTrakTM Vector Plate, and KistlerTM Force Plates several steps were taken. First, KistlerTM Force Plates data were downsampled to 25 Hz matching the output from C-SRSs and BodiTrakTM Vector Plate. C-SRSs output is reported in picoFarads (pF), BodiTrakTM Vector Plate cell output is reported in mmHg (kPa), and KistlerTM Force Plates output is in Newtons (N). Second, using Microsoft™ Excel (Redmond, WA, USA, ver. 365) raw data from C-SRS, BodiTrakTM Vector Plate, and KistlerTM Force Plates were trimmed based on locating minimum and maximum values during the movements. Finally, %Δ in C-SRSs, %Δ BodiTrakTM Vector Plate, and %Δ KistlerTM Force Plates were calculated based on changes from minimum and maximum values [29,30] and imported to SPSS™ for statistical analysis. Figure 4 provides an example of overlaid data between two C-SRSs and two individual BodiTrakTM Vector Plate cells for a participant’s left heel during shifting right to left, toe to heel, and squats. Visual inspection along with high R values assist in validating the use of C-SRSs in developing the GRPS.
2.7. Statistical Analysis
Each data analysis was performed on a per-sensor basis similar to previous studies [3,4,5]. In this approach, correlations were generated for each foot %Δ C-SRSs and corresponding %Δ BodiTrakTM Vector Plate pressure cells, and %Δ GRFs during each type of movement (i.e., left lateral heel C-SRSs compared to D11 BodiTrakTM Vector Plate cell, left medial heel C-SRSs compared to D12 BodiTrakTM Vector Plate cell, left first metatarsal C-SRSs compared to I12 BodiTrak Vector Plate, left mid-metatarsal C-SRSs compared to I11 BodiTrakTM Vector Plate, and fifth metatarsal C-SRSs modeled to H10 BodiTrakTM Vector Plate). Statistical analysis was conducted on %Δ C-SRSs, %Δ BodiTrakTM Vector Plate, and %Δ GRFs using Pearson correlation coefficients, time series expert modeling, and paired-samples t-Test (IBM SPSS™, ver. 27.0). Results of relationships between C-SRSs to BodiTrakTM Vector Plate were identified using (a) the shape of the pressure graphs, (b) Pearson correlation coefficients, and (c) differences in the coefficient of determination (R2) between percentage changes in pressures.
3. Results
The results of the 13 participant’s three movement patterns are summarized in the subsequent subsections. To determine the effectiveness of using C-SRSs in determining ground reaction pressures, validation of the C-SRSs to the BodiTrakTM Vector Plate and KistlerTM Force Plates was established using Pearson correlation coefficient analyses. High R values from the correlation analyses of the C-SRSs to the BodiTrakTM Vector Plate and the KistlerTM Force Plates indicate a positive relationship in C-SRSs to detect ground reaction pressures. Upon validation of the C-SRSs to determine ground reaction pressures, the development of the GRPS can be integrated into the wearable sock from Parts II, III, and IV of “Closing the Wearable Gap” paper series [3,4,5]. Unique orientations of the C-SRSs was evaluated in hope to indicate shear forces, however, based on the deformation characteristics of the current C-SRSs, no significant differences were found.
In addition to the correlation analyses, evaluation of data modeling using an autoregressive integrated moving average (ARIMA) was conducted based on the previous findings in the success of predicting driver drowsiness while wearing a portable electrooculography device [26]. Evidence of the predictable capabilities of the ARIMA in wearable technology supports the goal of the GRPS. High R2 values indicate a positive relationship of using an ARIMA to predict future C-SRS output.
3.1. Comparison of C-SRS to the BodiTrakTM Vector Plate
Table 1 provides a summary of the descriptive statistics of correlated R values from the thirteen participant’s positional C-SRSs and corresponding BodiTrakTM Vector Plate cells during the three movements of squats, shifting right to left, and shifting toe to heel. To obtain an accurate relationship, a Pearson correlation coefficient analysis was conducted to compare percentage changes in pressure in the C-SRSs to the BodiTrakTM Vector Plate cells. A total number of 780 individual sensor evaluations were derived from the 13 participants performing three movement patterns on top of ten C-SRSs in two different sensor orientations. Results indicated that an average R value of greater than 0.70 occurred in 618 out of the 780 sensor comparisons (79%). The relative loading of the C-SRSs and BodiTrakTM Vector Plate varied among participants. The mean correlation for pressure percentage change during the squat was 0.704 (SD = 0.24) for the A/P sensor orientation and 0.682 (SD = 0.222) for the M/L sensor orientation. Trials in the shifting pressure right and left movements resulted in a mean correlation of 0.847 (SD = 0.111) in the A/P sensor position and 0.791 (SD = 0.218) in the M/L sensor orientation. Toe and heel shifting trials resulted in mean correlation of 0.858 (SD = 0.127) for A/P sensor orientation and 0.877 (SD = 0.126) in the M/L sensor orientation.
Table 1.
Left Foot | Right Foot | |||||||
---|---|---|---|---|---|---|---|---|
Squat
C-SRSs in A/P Orientation |
Squat
C-SRSs in M/L Orientation |
Squat
C-SRSs in A/P Orientation |
Squat
C-SRSs in M/L Orientation |
|||||
Mean R | SD | Mean R | SD | Mean R | SD | Mean R | SD | |
Lateral Heel | 0.796 | 0.129 | 0.789 | 0.118 | 0.6839 | 0.312 | 0.526 | 0.468 |
Medial Heel | 0.692 | 0.253 | 0.659 | 0.168 | 0.68 | 0.336 | 0.964 | 0.274 |
Fifth Metatarsal | 0.699 | 0.258 | 0.704 | 0.158 | 0.69 | 0.207 | 0.614 | 0.255 |
Mid-Metatarsal | 0.681 | 0.326 | 0.685 | 0.224 | 0.682 | 0.188 | 0.753 | 0.129 |
First Metatarsal | 0.755 | 0.192 | 0.652 | 0.296 | 0.725 | 0.195 | 0.741 | 0.139 |
Right to Left C-SRSs in A/P Orientation | Right to Left C-SRSs in M/L Orientation | Right to Left C-SRSs in A/P Orientation | Right to Left C-SRSs in M/L Orientation | |||||
Mean R | SD | Mean R | SD | Mean R | SD | Mean R | SD | |
Lateral Heel | 0.922 | 0.076 | 0.892 | 0.785 | 0.785 | 0.247 | 0.854 | 0.252 |
Medial Heel | 0.927 | 0.100 | 0.826 | 0.216 | 0.932 | 0.026 | 0.837 | 0.212 |
Fifth Metatarsal | 0.895 | 0.080 | 0.866 | 0.122 | 0.843 | 0.107 | 0.819 | 0.233 |
Mid-Metatarsal | 0.835 | 0.111 | 0.775 | 0.178 | 0.759 | 0.122 | 682.000 | 0.250 |
First Metatarsal | 0.814 | 0.078 | 0.653 | 0.257 | 0.761 | 0.170 | 0.705 | 0.236 |
Toe to Heel C-SRSs in A/P Orientation | Toe to Heel C-SRSs in M/L Orientation | Toe to Heel C-SRSs in A/P Orientation | Toe to Heel C-SRSs in M/L Orientation | |||||
Mean R | SD | Mean R | SD | Mean R | SD | Mean R | SD | |
Lateral Heel | 0.932 | 0.087 | 0.942 | 0.058 | 0.758 | 0.362 | 0.810 | 0.320 |
Medial Heel | 0.911 | 0.113 | 0.947 | 0.031 | 0.918 | 0.101 | 0.945 | 0.030 |
Fifth Metatarsal | 0.863 | 0.112 | 0.859 | 0.068 | 0.792 | 0.086 | 0.874 | 0.097 |
Mid-Metatarsal | 0.916 | 0.075 | 0.821 | 0.247 | 0.874 | 0.097 | 0.861 | 0.159 |
First Metatarsal | 0.861 | 0.085 | 0.885 | 0.092 | 0.757 | 0.157 | 0.826 | 0.158 |
3.2. Comparison of C-SRS to Force Plates
A Pearson correlation coefficient analysis was conducted to compare the sum of pressures [31] %Δ C-SRSs in capacitance to %Δ GRFs during the three-movement patterns (Table 2). Determination of center-of-pressure changes during movements from C-SRSs was not conducted. Prior to determining center-of-pressure of movement, validation of C-SRSs is required which was accomplished by this study. The complexity of modeling ten different resting values C-SRSs to individual center-of-pressure movement patterns will be conducted in future work. To obtain an accurate understanding of the movement patterns, an absolute value was placed on the correlation values. This is required to recognize that negative values are relating to direction, not decreases in value. The testing platform required the use of rubber flooring to reduce slipping between the BodiTrakTM Vector Plate on the KistlerTM Force Plates. Unfortunately, assessing the relationships during the squat movements and in shifting toes to heels resulted in ambiguous outputs. A dampening effect occurred from the rubber flooring reducing the intensity of GRFs. However, during the shifting in the right to left produced greater translations and magnitudes during the movements resulting in clearer identification of pressure and force changes (Figure 5).
Table 2.
Stretchsense Sensor Correlation to GRFs—Shifting Right to Left | ||||||||
---|---|---|---|---|---|---|---|---|
A/P Sensor Orientation | A/P Sensor Orientation | |||||||
ID | Foot | Left GRF Z | Left GRF X | Left GRF Y | Foot | Right GRF Z | Right GRF X | Right GRF Y |
1 | Left C-SRS | 0.988 ** | 0.894 ** | 0.51 ** | Right C-SRS | 0.986 ** | 0.898 ** | 0.535 ** |
2 | Left C-SRS | 0.968 ** | 0.851 ** | 0.255 ** | Right C-SRS | 0.93 ** | 0.816 ** | 0.298 ** |
3 | Left C-SRS | 0.910 ** | 0.577 ** | 0.894 ** | Right C-SRS | 0.972 ** | 0.663 ** | 0.944 ** |
4 | Left C-SRS | 0.959 ** | 0.944 ** | 0.927 ** | Right C-SRS | 0.947 ** | 0.94 ** | 0.835 ** |
5 | Left C-SRS | 0.910 ** | 0.905 ** | 0.888 ** | Right C-SRS | 0.949 ** | 0.933 ** | 0.429 ** |
6 | Left C-SRS | 0.978 ** | 0.974 ** | 0.954 ** | Right C-SRS | 0.978 ** | 0.974 ** | 0.634 ** |
7 | Left C-SRS | 0.994 ** | 0.989 ** | 0.969 ** | Right C-SRS | 0.952 ** | 0.952 ** | 0.951 ** |
8 | Left C-SRS | 0.940 ** | 0.418 ** | 0.528 ** | Right C-SRS | 0.78 ** | 0.058 | 0.779 ** |
9 | Left C-SRS | 0.918 ** | 0.858 ** | 0.527 ** | Right C-SRS | 0.943 ** | 0.644 ** | 0.872 ** |
10 | Left C-SRS | 0.865 ** | 0.77 ** | 0.545 ** | Right C-SRS | 0.873 ** | 0.638 ** | 0.69 ** |
11 | Left C-SRS | 0.966 ** | 0.886 ** | 0.872 ** | Right C-SRS | 0.967 ** | 0.935 ** | 0.886 ** |
12 | Left C-SRS | 0936 ** | 0.779 ** | 0.122 ** | Right C-SRS | 0.794 ** | 0.544 ** | 0.488 ** |
13 | Left C-SRS | 0.974 ** | 0.644 ** | 0.716 ** | Right C-SRS | 0.936 ** | 0.814 ** | 0.625 ** |
M/L Sensor Orientation | M/L Sensor Orientation | |||||||
ID | Foot | Left GRF Z | Left GRF X | Left GRF Y | Foot | Right GRF Z | Right GRF X | Right GRF Y |
1 | Left C-SRS | 0.966 ** | 0.861 ** | 0.386 ** | Right C-SRS | 0.968 ** | 0.878 ** | 0.396 ** |
2 | Left C-SRS | 0.909 ** | 0.803 ** | 0.391 ** | Right C-SRS | 0.945 ** | 0.909 ** | 0.477 ** |
3 | Left C-SRS | 0.979 ** | 0.644 ** | 0.971 ** | Right C-SRS | 0.977 ** | 0.679 ** | 0.959 ** |
4 | Left C-SRS | 0966 ** | 0.958 ** | 0.944 ** | Right C-SRS | 0.973 ** | 0.968 ** | 0.88 ** |
5 | Left C-SRS | 0.914 ** | 0.923 ** | 0.829 ** | Right C-SRS | 0.93 ** | 0.92 ** | 0.325 ** |
6 | Left C-SRS | 0.989 ** | 0.989 ** | 0.966 ** | Right C-SRS | 0.989 ** | 0.988 ** | 0.828 ** |
7 | Left C-SRS | 0.975 ** | 0.389 ** | 0.759 ** | Right C-SRS | 0.969 ** | 0.157 ** | 0.747 ** |
8 | Left C-SRS | 0.980 ** | 0.452 ** | 0.572 ** | Right C-SRS | 0.971 ** | 0.297 ** | 0.872 ** |
9 | Left C-SRS | 0.926 ** | 0.777 ** | 0.527 ** | Right C-SRS | 0.863 ** | 0.443 ** | 0.772 ** |
10 | Left C-SRS | 0.875 ** | 0.777 ** | 0.533 ** | Right C-SRS | 0.835 ** | 0.765 ** | 0.804 ** |
11 | Left C-SRS | 0.930 ** | 0.831 ** | 0.798 ** | Right C-SRS | 0.983 ** | 0.868 ** | 0.922 ** |
12 | Left C-SRS | 0.900 ** | 0.863 ** | 0.153 ** | Right C-SRS | 0.914 ** | 0.772 ** | 0.705 ** |
13 | Left C-SRS | 0.950 ** | 0.686 ** | 0.486 ** | Right C-SRS | 0.898 ** | 0.754 ** | 0.835 ** |
** Correlation is significant at the 0.01 level (2-tailed).
The relative loading of the C-SRSs and GRFs varied among participants. The correlation of pressure and force percentage change during the shifting of center-of-pressure right to left with sensors in the A/P sensor location resulted in the vertical Z-GRF left foot mean R of 0.947 (SD = 0.038) and the right foot mean R of 0.924 (SD = 0.067). With sensors in the M/L orientation, the shifting of center-of-pressure right and left resulted in the vertical Z-GRF left foot mean R of 0.943 (SD = 0.036) and the right foot mean R of 0.94 (SD = 0.049). Changes in the lateral X-GRF axis and sensors positioned in the A/P orientation resulted in left foot mean R of 0.810 (SD = 0.168) and right foot mean R of 0.755 (SD = 0.255). In the M/L sensor orientation, changes in the lateral X-GRF resulted in left foot mean R of 0.766 (SD = 0.182) and right foot mean R of 0.723 (SD = 0.264). In the toe and heel direction, Y-GRF axis, with sensors positioned in the A/P orientation, resulted in left foot mean R of 0.670 (SD = 0.279) and right foot mean R of 0.690 (SD = 210). With sensors in the M/L orientation, Y-GRF axis reported left foot mean R of 0.640 (SD = 0.258) and right foot mean of 0.732 (SD = 0.204).
3.3. Autoregressive Integrated Moving Average
An ARIMA was conducted on the C-SRSs data for the three types of movements, squats, shifting right to left, and shifting toe to heel. This process included an “expert modeler that attempts to automatically identify and estimate the best-fitting ARIMA or exponential smoothing model” [32]. The mean squat R2 value in the A/P sensor orientation was 0.933 (SD = 0.038) and average root mean square error (RMSE) was 4.87 (SD = 1.071). The mean squat R2 value in the M/L orientation was 0.909 (SD = 0.047) and average RMSE value was 5.86 (SD = 1.433) The mean shifting right and left R2 value in the A/P sensor orientation is 0.956 (SD = 0.043) and average RMSE = 3.61 (SD = 1.151). The mean shifting right and left R2 value in the M/L sensor orientation was 0.963 (SD = 0.034) and average RMSE of 3.75 (SD = 0.974) for M/L sensor orientation. The mean shifting toe and heel R2 value in the A/P sensor orientation was 0.966 (SD = 0.039) and average RMSE = 3.34 (SD = 0.769). The mean shifting toe and heel R2 value in the M/L sensor orientation an average R2 is 0.964 (SD = 0.042) and average RMSE of 3.53 (SE = 0.771) for M/L sensor orientation.
3.4. Sensor Orientation
A paired samples t-Test was conducted to compare C-SRSs orientation on the BodiTrakTM Vector Plate during all three movements, squats, shifting right to left, and shifting toe to heel. The results of the test indicate no significant difference between A/P and M/L sensor orientations in lateral heel sensor t(77) = 0.076, p = 0.939 and medial heel sensor t(77) = 0.974, p = 0.333. In the metatarsal placed sensors, no significant difference existed in the fifth metatarsal sensors t(77) = 0.292, p = 0.771, the mid-metatarsal sensors t(77) = 1.151, p = 0.253, and the first metatarsal sensors t(77) = 1.446, p = 0.152.
A paired samples t-Test was conducted to compare the differences between C-SRSs and GRFs with sensors in the A/P and M/L orientations. The results of the test indicate no significant difference between A/P and M/L sensor orientation in the left foot Z-GRF t(12) = 0.38, p = 0.71, in the X-GRF t(12) = 1.16, p = 0.268, and Y-GRF t(12) = 1.02, p = 0.33. In the right foot, no significant difference existed in the Z-GRF t(12) = −0.8, p = 0.427, X-GRF t(12) = 0.44, p = 0.667, and the Y-GRF t(12) = −1.1, p = 0.301.
4. Discussion
The focus of this study was to validate plantar pressure sensor placement, assess the effectiveness of C-SRSs in changes in ground reaction pressure during movement against a pressure mat and force plates, and establish the groundwork for the development of a ground reaction pressure sock. The results of this study indicate three critical pieces of information: (a) high correlations of R > 0.7 in 79% of the 780 individual cell trials between C-SRSs and BodiTrakTM Vector Plate for all participant movement patterns indicating that CSRSs can be used to capture normal ground reaction pressures, (b) R2 and RMSE values in ARIMA software modeling of C-SRSs are excellent predictors of future sensor data, and (c) that C-SRSs can be integrated into a wearable sock to capture internal foot–shoe interactions. High R positive values in correlating C-SRSs to the BodiTrakTM Vector Plate indicates a positive relationship in reactive changes to pressure. High R2 values in the ARIMA modeling indicate a successful ability for software development to model human 3D foot–shoe interaction pressures in the development of the GRPS. RMSE ARIMA model values indicate the absolute measure of error between present and future sensor data. RMSE ARIMA model values in shifting right to left and toe to heel resulted in values below 4% and during the squatting movement below 5%.
The relationship between C-SRSs and GRFs were inconclusive during the squat movements and shifting from toe to heel. The use of the rubber flooring to improve friction between the BodiTrakTM Vector Plate and KistlerTM Force Plates may have dampened the effect of force transmission during small changes in center-of-pressure during the movements. Greater translational and magnitude changes in center-of-pressure occurred during the shifting of right to left resulting in high R values ranging from 0.865 to 0.988 in the 13 participant trials. In developing the GRPS, adjusting calibrations to match the individual will need to be considered. Resting values of the ten C-SRSs were different from each other, requiring software modeling to establish a static baseline for each user as current C-SRSs used are an off-the-shelf solution.
4.1. Autoregressive Integrated Moving Average Model (ARIMA)
Using a time series analysis, “ARIMA models predict a dependent variable’s present value based on its past values plus values of other explanatory variables” [32]. ARIMA models have shown to be effective with small sample sizes, case studies, and during prevention research in assessing person data monitoring over time [32,33].
4.2. Mean R2
To determine the goodness of fit of the C-SRSs ARIMA time series modeling, mean R2 values were calculated from the thirteen participants’ time series ARIMA models in both A/P and M/L sensor orientations. Combining all three movements of squats, shifting right to left and toe to heel, resulted in overall mean R2 value of 0.952 with sensors in the A/P orientation, while in the M/L sensor orientation, mean R2 value was 0.945. Based on the results, C-SRSs could be aligned in either direction due to the general change in area effect of capacitive sensors [11]. Independently, M/L sensor orientation had a higher average R2 value of 0.963 over the A/P sensor R2 orientation value of 0.956. The relationship of directional forces during the shifting from toe to heel produced an A/P sensor orientation average R2 value of 0.966 versus an M/L R2 value of 0.964. Due to the similar results additional research will need to investigate the relationship between width and length of soft sensors to potentially establish directional pressure and force relationships. To further support the use of C-SRSs in a wearable device, the test reported a strong correlation between the C-SRSs and the GRFs during the shifting of right to left, further evidence that using C-SRSs to detect GRF in a wearable can be accomplished but requires further refinement.
4.3. Mean RMSE
RMSE values provide insight into the accuracy of the ARIMA time series models. Mean RMSE of the thirteen participants ARIMA models in the A/P sensor orientation resulted in value of 3.94%, while M/L resulted in 4.38%, indicating that sensors in the A/P orientation produced a more accurate model for the three movements in squats, shifting from right to left, and shifting from toe to heel. Due to changes in area in capacitive sensors, directional sensor orientation may not provide the most accurate indication of directional pressures as no significant differences were seen between A/P and M/L sensor orientations.
4.4. GRPS Applications and Configurations
The goal of the “Closing the Wearable Gap” paper series is to design a wearable device to replace optical motion capture to measure joint movements and replace pressure mats to capture GRFs. The addition of C-SRSs to the plantar region of the GRPS allows for the measurement of ground reaction pressures providing a solution for the needs of practitioners to accurately capture movement data “from the ground up” [5]. Uses for GRPSs go beyond plantar pressure replacement devices of pressure mats. The development of highly accurate prediction models within the GRPS could also lend itself to potential solutions outside of athletics, such as fall detection in elderly and balance impaired individuals.
In this study, specific plantar pressure regions were identified in the heel and metatarsal heads. Reducing the number of plantar pressure C-SRSs from five to three will reduce the cost of processing and materials in the GRPS. Increasing the size of the plantar pressure sensors will allow for a single heel sensor and two forefoot sensors. To assess lateral and superior shoe pressures, the use of longer and narrower C-SRSs wrapped around the foot can provide specific 3D foot area pressure assessments. Further research will provide specific insight into sensor location and size.
4.5. Limitations
Several limitations existed in this study. One limitation was in the frequency at which the C-SRSs operated (25 Hz). Human movement is generally captured at 200 Hz or greater when using optical motion capture and force plates capture data at 1000 Hz [34]. This study examined relatively slow movement patterns. Use of the GRPS during walking, running, jumping, and cutting will require higher data capture rates. Another limitation that existed was with the BodiTrakTM Vector Plate, which has a 2068.8 mmHg (276 kPa) limit per cell. Several times the BodiTrakTM Vector Plate reached its limit while changes in the C-SRSs were occurring during the movement patterns. To improve upon the study, the C-SRSs could have been placed directly onto the participants’ socks identifying center of mass locations of metatarsal heads. Interestingly, few changes in sensor placement relative to the BodiTrakTM Vector Plate cells were made during the study. This may have been due to the number of participants and closely related foot sizes.
The testing platform required the use of slip-resistant rubber flooring to prevent the BodiTrakTM Vector Plate from sliding on the KistlerTM Force Plates during movement. The flooring ensured the safety of the participants and allowed for freedom of motion. Due to the dampening effects of the rubber flooring, smaller translational changes in center-of-pressure were difficult to measure during the squatting and shifting of toe to heel movements. The dampening effect did not affect the shifting right and left as greater translational GRFs were captured. Conducting separate C-SRSs trials on the BodiTrakTM Vector Plate and KistlerTM Force Plates may have provided additional insight into translational center-of-pressure changes.
4.6. Future Research
Additional research is required for the commercial development of using C-SRSs in a gait wearable. Advancements in both hardware and software are needed to achieve a nearly seamless user experience when integrating sensors into garments during real-time play [2]. Increasing the frequency of data captured, determining the size and placements of sensors, and developing improved user experiences will need to be addressed during the design process. Deep learning techniques can be used to provide individualized assessments of the sensor data to report the wearer’s movements for uses beyond sports, such as rehabilitation and prevention of work-related musculoskeletal disorders.
5. Conclusions
The results from this study highlight the effectiveness in using C-SRSs to evaluate ground reaction pressures. Correlations, mean R2, and mean RMSE were used to compare the changes in pressure of C-SRSs, changes in pressure on the BodiTrakTM Vector Plate, and changes in force on the KistlerTM Force Plates. Positive linear relationships were identified and visualized between the C-SRSs and BodiTrakTM Vector Plate in all three movements of squatting, shifting right to left, and shifting toes to heels. Relationships did exist in the shifting right to left between the C-SRSs and vertical GRFs. However, smaller translational GRFs relationships did not exist possibly due to the dampening effect of the rubber flooring used in the testing platform. Identifying sensor orientation to determine shear pressure changes was inconclusive due to pressure change characteristics of capacitive sensors.
The input of C-SRSs data into an ARIMA model revealed high R2 and low RMSE values (<5%) indicate a high level of accuracy to predict future outcomes. The rationale for the investigation of applying ARIMA to wearable devices was to identify movement patterns and assess the kinetic frequency and intensity to potentially predict injury thresholds of lower limb kinematics. This study, Part V, builds upon Parts II and IV of the “Closing the Wearable Gap” paper series by adding the capability to measure ground reaction pressures to an in-progress solution with significant potential to accurately capture joint angles of the foot-ankle complex [3,5].
Acknowledgments
Thank you to Nicki Luczak for her continued support in this project.
Author Contributions
Conceptualization, T.L., R.F.B.V., B.K.S., D.W.C., J.L. and Y.Y.; methodology, T.L., R.F.B.V., B.K.S., D.W.C. and J.L.; software, T.L. and R.F.B.V.; validation, T.L., R.F.B.V., B.K.S., D.W.C. and J.L.; formal analysis, T.L., R.F.B.V., B.K.S., D.W.C. and J.L.; investigation, T.L.; resources, R.F.B.V.; data curation, T.L.; writing—original draft preparation, T.L.; writing—review and editing, R.F.B.V., B.K.S., D.W.C., J.L., H.C., A.K., J.B. and R.K.P.; visualization, T.L.; supervision, R.F.B.V.; project administration, R.F.B.V. All authors have read and agreed to the published version of the manuscript.
Funding
The research presented in this paper was funded by the National Science Foundation under NSF 18-511—Partnerships for Innovation award number 1827652.
Conflicts of Interest
The authors declare no conflict of interest.
References
- 1.Luczak T., Saucier D., Burch V., Ball J., Chander H., Knight A., Wei P., Iftekhar T. Closing the wearable gap: Mobile systems for kinematic signal monitoring of the foot and ankle. Electronics. 2018;7:117. doi: 10.3390/electronics7070117. [DOI] [Google Scholar]
- 2.Luczak T., Burch R., Lewis E., Chander H., Ball J. State-of-the-art review of athletic wearable technology: What 113 strength and conditioning coaches and athletic trainers from the USA said about technology in sports. Int. J. Sports Sci. Coach. 2019 doi: 10.1177/1747954119885244. [DOI] [Google Scholar]
- 3.Saucier D., Luczak T., Nguyen P., Davarzani S., Peranich P., Ball J.E., Burch R.F., Smith B.K., Chander H., Knight A., et al. Closing the Wearable Gap—Part. II: Sensor Orientation and Placement for Foot and Ankle Joint Kinematic Measurements. Sensors. 2019;19:3509. doi: 10.3390/s19163509. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Chander H., Stewart E., Saucier D., Nguyen P., Luczak T., Ball J.E., Knight A.C., Smith B.K., Prabhu R.K. Closing the Wearable Gap—Part. III: Use of Stretch Sensors in Detecting Ankle Joint Kinematics During Unexpected and Expected Slip and Trip Perturbations. Electronics. 2019;8:1083. doi: 10.3390/electronics8101083. [DOI] [Google Scholar]
- 5.Saucier D., Davarzani S., Turner A., Luczak T., Nguyen P., Carroll W., FBurch V.R., Ball J.E., Smith B.K., Chander H., et al. Closing the Wearable Gap—Part. IV: 3D Motion Capture Cameras Versus Soft Robotic Sensors Comparison of Gait Movement Assessment. Electronics. Electronics. 2019;8:1382. doi: 10.3390/electronics8121382. [DOI] [Google Scholar]
- 6.Bunton E.E., Pitney W.A., Cappaert T.A., Kane A.W. The role of limb torque, muscle action and proprioception during closed kinetic chain rehabilitation of the lower extremity. J. Athl. Train. 1993;28:10. [PMC free article] [PubMed] [Google Scholar]
- 7.Beckham G., Suchomel T., Mizuguchi S. Force plate use in performance monitoring and sport science testing. New Stud. Athl. 2014;3:25–37. [Google Scholar]
- 8.Mengüç Y., Park Y.L., Martinez-Villalpando E., Aubin P., Zisook M., Stirling L., Wood R.J., Walsh C.J. Soft wearable motion sensing suit for lower limb biomechanics measurements; Proceedings of the 2013 IEEE International Conference on. Robotics and Automation (ICRA); Karlsruhe, Germany. 6–10 May 2013; [DOI] [Google Scholar]
- 9.Trung T.Q., Lee N.E. Flexible and Stretchable Physical Sensor Integrated Platforms for Wearable Human-Activity Monitoringand Personal Healthcare. Adv. Mater. 2016;28:4338–4372. doi: 10.1002/adma.201504244. [DOI] [PubMed] [Google Scholar]
- 10.Yeo J.C., Lim C.T. Emerging flexible and wearable physical sensing platforms for healthcare and biomedical applications. Microsyst. Nanoeng. 2016;2 doi: 10.1038/micronano.2016.43. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Atalay A., Sanchez V., Atalay O., Vogt D.M., Haufe F., Wood R.J., Walsh C.J. Batch Fabrication of Customizable Silicone-Textile Composite Capacitive Strain Sensors for Human Motion Tracking. Adv. Mater. Technol. 2017 doi: 10.1002/admt.201700136. [DOI] [Google Scholar]
- 12.Yin J., Aspinall P., Santos V.J., Posner J.D. Measuring Dynamic Shear Force and Vibration With a Bioinspired Tactile Sensor Skin. IEEE Sens. J. 2018;18:3544–3553. doi: 10.1109/JSEN.2018.2811407. [DOI] [Google Scholar]
- 13.Miodownik M., Oldfrey B., Jackson R., Smitham P. A deep learning approach to non-linearity in wearable stretch sensors. Front. Robot. AI. 2019;6:27. doi: 10.3389/frobt.2019.00027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Cai L., Song L., Luan P., Zhang Q., Zhang N., Gao Q., Zhao D., Zhang X., Tu M., Yang F., et al. Super-stretchable, transparent carbon nanotube-based capacitive strain sensors for human motion detection. Sci. Rep. 2013;3:3048. doi: 10.1038/srep03048. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Yao S., Zhu Y. Wearable multifunctional sensors using printed stretchable conductors made of silver nanowires. Nanoscale. 2014;6:2345–2352. doi: 10.1039/c3nr05496a. [DOI] [PubMed] [Google Scholar]
- 16.Amjadi M., Kyung K.U., Park I., Sitti M. Stretchable, skin-mountable, and wearable strain sensors and their potential applications: A review. Adv. Funct. Mater. 2016;26:1678–1698. doi: 10.1002/adfm.201504755. [DOI] [Google Scholar]
- 17.Martinelli L., Hurschler C., Rosenbaum D. Comparison of capacitive versus resistive joint contact stress sensors. Clin. Orthop. Relat. Res. 2006;447:214–220. doi: 10.1097/01.blo.0000218730.59838.6a. [DOI] [PubMed] [Google Scholar]
- 18.Urry S. Plantar pressure-measurement sensors. Meas. Sci. Technol. 1999;10:R16. doi: 10.1088/0957-0233/10/1/017. [DOI] [Google Scholar]
- 19.Chesnin K.J., Selby-Silverstein L., Besser M.P. Comparison of an in-shoe pressure measurement device to a force plate: Concurrent validity of center-of-pressure measurements. Gait Posture. 2000;12:128–133. doi: 10.1016/S0966-6362(00)00071-0. [DOI] [PubMed] [Google Scholar]
- 20.Saito M., Nakajima K., Takano C., Ohta Y., Sugimoto C., Ezoe R., Sasaki K., Hosaka H., Ifukube T., Ino S., et al. An in-shoe device to measure plantar pressure during daily human activity. Med. Eng. Phys. 2011;33:638–645. doi: 10.1016/j.medengphy.2011.01.001. [DOI] [PubMed] [Google Scholar]
- 21.Renner K.E., Williams D.S., Queen R.M. The reliability and validity of the Loadsol® under various walking and running conditions. Sensors. 2019;19:265. doi: 10.3390/s19020265. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Ito K., Maeda K., Fujiwara I., Hosoda K., Nagura T., Lee T., Ogihara N. Dynamic measurement of surface strain distribution on the foot during walking. J. Mech. Behav. Biomed. Mater. 2017;69:249–256. doi: 10.1016/j.jmbbm.2016.12.009. [DOI] [PubMed] [Google Scholar]
- 23.Ravi D., Wong C., Lo B., Yang G.Z. A deep learning approach to on-node sensor data analytics for mobile or wearable devices. IEEE J. Biomed. Health Inf. 2016;21:56–64. doi: 10.1109/JBHI.2016.2633287. [DOI] [PubMed] [Google Scholar]
- 24.Li G., Wang Y. Automatic ARIMA modeling-based data aggregation scheme in wireless sensor networks. EURASIP J. Wirel. Commun. Netw. 2013;2013:85. doi: 10.1186/1687-1499-2013-85. [DOI] [Google Scholar]
- 25.Connor J.T., Martin R.D., Atlas L.E. Atlas, Recurrent neural networks and robust time series prediction. IEEE Trans. Neural Netw. 1994;5:240–254. doi: 10.1109/72.279188. [DOI] [PubMed] [Google Scholar]
- 26.Ma Z., Li B.C., Yan Z. Wearable driver drowsiness detection using electrooculography signal; Proceedings of the 2016 IEEE Topical Conference on Wireless Sensors and Sensor Networks (WiSNet); Austin, TX, USA. 24–27 January 2016; [DOI] [Google Scholar]
- 27.Thomas S., Reading J., Shephard R.J. Revision of the physical activity readiness questionnaire (PAR-Q) Can. J. Sport Sci. 1992;17:338–345. [PubMed] [Google Scholar]
- 28.Cordero A.F., Koopman H.J.F.M., Van Der Helm F.C.T. Use of pressure insoles to calculate the complete ground reaction forces. J. Biomech. 2004;37:1427–1432. doi: 10.1016/j.jbiomech.2003.12.016. [DOI] [PubMed] [Google Scholar]
- 29.EPA . 40 CFR Parts 58-Ambient Air Quality Surveillance (Subchapter C) Environmental Protection Agency; Washington, DC, USA: 2016. [Google Scholar]
- 30.Sousan S., Gray A., Zuidema C., Stebounova L., Thomas G., Koehler K., Peters T. Sensor selection to improve estimates of particulate matter concentration from a low-cost network. Sensors. 2018;18:3008. doi: 10.3390/s18093008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Fong D.T.P., Chan Y.Y., Hong Y., Yung P.S.H., Fung K.Y., Chan K.M. Estimating the complete ground reaction forces with pressure insoles in walking. J. Biomech. 2008;41:2597–2601. doi: 10.1016/j.jbiomech.2008.05.007. [DOI] [PubMed] [Google Scholar]
- 32.Doherty S.T., Greaves S.P. Time-series analysis of continuously monitored blood glucose: The impacts of geographic and daily lifestyle factors. J. Diabetes Res. 2015;2015:804341. doi: 10.1155/2015/804341. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Ridenour T.A., Pineo T.Z., Molina M.M.M., Lich K.H. Toward rigorous idiographic research in prevention science: Comparison between three analytic strategies for testing preventive intervention in very small samples. Prev. Sci. 2013;14:267–278. doi: 10.1007/s11121-012-0311-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Winter D.A. Biomechanics and Motor Control of Human Movement. John Wiley & Sons; Hoboken, NJ, USA: 2009. [Google Scholar]