Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2021 Jun 5.
Published in final edited form as: Comput Methods Biomech Biomed Engin. 2016 Dec 27;20(6):587–597. doi: 10.1080/10255842.2016.1265950

Across-subject calibration of an instrumented glove to measure hand movement for clinical purposes

Verónica Gracia-Ibáñez 1, Margarita Vergara 1, James H Buffi 2, Wendy M Murray 2, Joaquín L Sancho-Bru 1
PMCID: PMC8178967  NIHMSID: NIHMS887677  PMID: 28024426

Abstract

Motion capture of all degrees of freedom of the hand collected during performance of daily living activities remains challenging. Instrumented gloves are an attractive option because of their higher ease of use. However, subject-specific calibration of gloves is lengthy and has limitations for individuals with disabilities. Here, a calibration procedure is presented, consisting in the recording of just a simple hand position so as to allow capture of the kinematics of 16 hand joints during daily life activities even in case of severe injured hands. ‘across-subject gains’ were obtained by averaging the gains obtained from a detailed subject-specific calibration involving 44 registrations that was repeated three times on multiple days to 6 subjects. In additional 4 subjects, joint angles that resulted from applying the ‘across-subject calibration’ or the subject-specific calibration were compared. Global errors associated with the ‘across-subject calibration’ relative to the detailed, subject-specific protocol were small (bias: 0.49°; precision: 4.45°) and comparable to those that resulted from repeating the detailed protocol with the same subject on multiple days (0.36°; 3.50°). Furthermore, in one subject, performance of the ‘across-subject calibration’ was directly compared to another fast calibration method, expressed relative to a videogrammetric protocol as a gold-standard, yielding better results.

Keywords: Instrumented glove, across-subject calibration, fast calibration, hand movement, hand disabilities

INTRODUCTION

The ability of the human hand to grasp and manipulate objects is a key factor determining an individual’s ability to complete a great number of activities of daily living (ADL) as well as of working life (Bullock et al. 2013; Vergara et al. 2014; Zheng, De La Rosa, and Dollar 2011). The versatility of the human hand is possible thanks to the complex kinematics of the system: 25 degrees of freedom (DoFs) controlled by muscles, tendons and ligaments (Brand and Hollister 1999). Measurement of complex hand movements is useful for numerous applications, including functional assessment of the pathological hand and its rehabilitation (Chiu et al. 2000; Nathan, Johnson, and McGuire 2009; Oess, Wanek, and Curt 2012), analysis of sporting techniques and ergonomics of tools, the study of human motor control strategies, and robotics (Griffin et al. 2000; Grinyagin, Biryukova, and Maier 2005; Sanchez-Margallo et al. 2010; Tripp et al. 2006).

Different methods can be used to measure hand movement, but most of them fail when applied to the simultaneous measurement of all hand DoFs while performing functional ADL. Goniometers do not allow for the simultaneous measurement of all DoFs. Electromagnetic systems (Mitobe et al. 2006) are susceptible to magnetic and electrical interference from metallic objects in the environment. Marker-based optical systems provide high accuracy (Joaquin L Sancho-Bru et al. 2014), but they can be used only within the area covered by the cameras, require a substantial amount of time to setup the markers, and markers often become occluded during the recording of tasks. Markerless optical motion capture (Metcalf et al. 2013) and inertial systems (Kortier et al. 2014) are frequently adopted in virtual reality games, but even though great enhancements in accuracy are being done (O’flynn et al. 2015), no commercial devices are currently available according to our knowledge. At this point, instrumented gloves seem to be the most effective method for collecting data from all finger joints continuously, without occluding problems, and with no special environmental constraints (J. Buffi et al. 2014).

Despite the relative strengths described above, the use of instrumented gloves is also problematic, primarily due to difficulties associated with the calibration processes needed to obtain the gains for the individual sensors that record each DoF. On the one hand, gloves include a high number of sensors to be calibrated. Furthermore, although each individual sensor is linear, some of them do not have only a linear relationship with the anatomical angle to be measured (Eccarius, Bour, and Scheidt 2012), because they are affected by other movements of the same joint (e.g. the abduction sensors at metacarpophalangeal joints, affected by the relative flexion between adjacent joints) or because of their placement they do not measure directly the anatomical angle (e.g. abduction and roll of the thumb). In order to correct this effect, a subject-specific calibration obtained by positioning the fingers in specific angles of combined flexion/extension and abduction spanning the entire range of motion has been shown to provide good accuracy (Eccarius, Bour, and Scheidt 2012). However, this method requires subjects to pose in a large number of postures, along with recording controlled movements, limiting its feasibility for use in real, clinical applications and large-scale field studies. This issue is especially problematic when dealing with patients with disabilities that interfere with the capacity to achieve postures needed for the calibration. In contrast, optimization methods have been used in an attempt to minimize the number of postures/movements required for the calibration (Griffin et al. 2000): each finger and the thumb are repeatedly flexed and extended while maintaining digit tip contact (close loop method), and the gains are optimized such that the joint angles obtained from an underlying model best maintained digit tip contact throughout the task. However, when evaluated against a gold-standard, low accuracy was observed (J. Buffi et al. 2014). In a third approach, artificial neural networks (ANN) have been used to estimate sensor gains from an individual subject’s hand segment lengths (Zhou, Malric, and Shirmohammadi 2010). However, this approach requires a large number of previously performed manual calibrations on many subjects, spanning a broad range of different segment lengths. In addition, as no angular errors were reported, it is unclear whether the lengths of hand segments are enough to yield high quality data (Zhou, Malric, and Shirmohammadi 2010).

In brief, subject-specific instrumented glove calibration procedures are lengthy and not applicable to patients with some disabilities. In this work we test whether an ‘across-subject calibration’, defined via detailed, accurate, yet lengthy calibration from a small number of subjects, yields valid data when applied to additional subjects via registration of a single, simple reference posture.

METHODS

The experiment, approved by the University’s Ethical Committee, was developed in three phases. First, a very detailed calibration protocol was applied several times to 6 subjects. The gains obtained through this detailed calibration process were then used to define a ‘across-subject calibration’. In a separate group of an additional 4 subjects, the joint angles that resulted from applying this ‘across-subject calibration’ were compared to those that resulted from transforming the identical set of sensor outputs to joint angles via the detailed, subject-specific calibration method. Finally, in one subject, the errors associated with the across-subject calibration were directly compared to those from another fast calibration method (J. Buffi et al. 2014). In this case, errors were expressed relative to a previously validated videogrammetric protocol (Joaquin L Sancho-Bru et al. 2014). All the errors and comparisons were made on the calculated angles of five different static postures. All the participants were right-handed, free of hand lesions or pathologies and gave informed consent to participate. The instrumented glove used was a right-hand Cyberglove (Cyberglove Systems LLC; San Jose, CA), one sized, with 18 resistive flex sensors and 8-bit digital signal output proportional to the underlying bending angle (Figure 1), technically described with more detail elsewhere (Eccarius, Bour, and Scheidt 2012). Only outputs from 16 sensors were used in this experiment, discarding the two sensors of the wrist.

Fig. 1.

Fig. 1

18-sensor Cyberglove sensor location (the two sensors related to the wrist are not sketched as they are not used)

Calibration Protocols

Detailed calibration protocol

Our protocol combines procedures based on several previous works (J. H. Buffi, Crisco, and Murray 2013; Eccarius, Bour, and Scheidt 2012; Griffin et al. 2000), and consists in registering 44 different poses or guided movements (Figure 2). The first 20 calibration trials correspond to the calibration of 10 individual flexion sensors (two static postures per sensor, F1 to F10, see Fig. 1) to measure flexion at all metacarpophalangeal (MCP1 to MCP5; 1 to 5, thumb to little digit, respectively) and interphalangeal (IP1 and PIP2 to PIP5) joints (Figure 2.a). Gains of these flexion sensors (GF) assume a linear relationship between the flexion angle at these joints and the glove output signals (Eccarius, Bour, and Scheidt 2012; Kessler, Hodges, and Walker 1995; Zhou, Malric, and Shirmohammadi 2010). Each MCP joint of the fingers and all IP joints were calibrated at 0° and 75° by pressing custom-made wood tools against the dorsal aspect of the digit. MCP1 was calibrated at 0° and 35°.

Fig. 2.

Fig. 2

Postures and guided movements used for the calibration protocol: (a) Examples of calibration trials 1 to 20; (b) Trials 21 and 22; (c) Starting postures of trials 23 to 25; (d) Examples of trials 23 to 40; (e) Neutral extension and abduction for trials 41 and 42; (f) Maximal extension during trial 41; (g) Maximal abduction (left) and adduction (right) during trial 42; (h) closed loop movement during trial 43; (i) Measurement of little CMC flexion in trials 21 (left) and 44 (right)

Trials 21 and 22 (Figure 2.b) were used to obtain the gains of A2 to A4 sensors (GA), corresponding to relative abduction of MCP2 to MCP5, also assuming a linear relationship. Both trials correspond to static postures with the hand resting flat on a table, the first with the fingers close together, defined to be 0° for the three abduction angles, and the second with custom-made wedge tools inserted firmly between the fingers that constrained the relative abduction angles to 25°, 16° and 17° for MCP2, MCP4 and MCP5, respectively.

Previous studies have warned about the cross-coupling effect between abduction and flexion MCP angles: due to the physical configuration of the glove, the output signal of abduction sensors varies when the adjacent MCP joints flex, even with no variation of the abduction angle, so that the abduction angle needs a correction (Eccarius, Bour, and Scheidt 2012; Zhou, Malric, and Shirmohammadi 2010). We confirmed that a second order polynomial of the flexion angles of adjacent MCP joints provides a good correction for abduction angles, in accordance with Eccarius et al. (Eccarius, Bour, and Scheidt 2012). The 5 polynomial coefficients of the correction term (C1, C2, C3, C4 and C5) at each sensor were obtained through an optimization process, by minimizing the root mean square error (RMSE) of the abduction angles measured during six motions with 0° of abduction. In the case of index-middle abduction, the subject performed three extension-flexion cycles of the index finger with no abduction, while the others three fingers were kept fixed at different MCP flexion angles: 0°, 40° and 80°, (Figure 2.c, trials 23 to 25) and then three extension-flexion cycles of the middle, ring and little fingers together, while the index finger was fixed at the same three MCP angles (0°, 40° and 80°), with no abduction (trials 26 to 28). Analogous corrections have been considered for the abduction of MCP4 and MCP5, through trials 29 to 34, and 35 to 40, respectively (Figure 2.d).

The positions of A1 and Roll1 sensors do not correspond exactly to either flexion or abduction of the thumb carpometacarpal (CMC1) joint (Kramer 1996), making obtaining these joint angles difficult (Crasborn et al. 2006). For CMC1 flexion, we have considered a linear relationship (gain GF) with Roll1 plus an adjustment factor (AFF) with A1 sensor. The adjustment factor was obtained by minimizing the RMSE of the abduction angles, assumed to be zero, in trial 41, which consists in extending the thumb from neutral (Figure 2.e) to maximal extension (Figure 2.f), and returning to neutral. Analogously, for CMC1 abduction, a linear relationship (gain GA) with A1 plus an adjustment factor (AFA) with Roll1 sensor was considered. The adjustment factor was obtained by minimizing the RMSE of the flexion angles, assumed to be zero, in trial 42, which consists in abducting the thumb from neutral (Figure 2.e) to maximal abduction, then to the maximal adduction (Figure 2.g), and returning to neutral abduction. Once the adjustment factors were calculated, the gains for both linear relationships (GF and GA) were obtained from trial 43, which consists in three consecutive closed loop motions made between index finger and the thumb, repeatedly flexing and extending both digits while maintaining tip contact (Figure 2.h). The gains were calculated so that the joint angles obtained from the underlying kinematic model (Joaquín L. Sancho-Bru et al. 2012) best maintained digit tip contact throughout the task. Index distal interphalangeal (DIP2) flexion angle, not provided by the Cyberglove used in this work, is required for computing the distance between the thumb and index finger tips. This angle was estimated from the PIP2 angle by using the linear regression experimentally obtained with the videogrammetric technique (Joaquin L Sancho-Bru et al. 2014) over 8 subjects performing the same loop movements (DIP2 = 0.87 · PIP2 − 25.27°).

Finally, palmar arch is estimated from Roll2 assuming a linear relationship (gain GF) with two postures: previous trial number 21 (palm extended, 0°) and trial 44 (palm flexed). In this case, the angle between index-middle knuckles and ring-little knuckles was measured for each subject using a manual goniometer (Figure 2.i).

Fast calibration protocol

This protocol, based on a previous one (J. Buffi et al. 2014), consists in registering 12 different poses or guided movements. Four trials consist in closed loop motions made between index, middle, ring and little fingers and the thumb, respectively, repeatedly flexing and extending both digits while maintaining tip contact; and they were used to adjust gains of all flexion angles (all GF) and the abduction of thumb CMC together with both adjustment factors (AF) so that the joint angles obtained from the underlying kinematic model (Joaquín L. Sancho-Bru et al. 2012) best maintained digit tip contact throughout the tasks. Again, DIP flexion angles were estimated from the fingers PIP angles by using linear regressions experimentally obtained as with DIP2 (DIP3 = 0.79 · PIP3 − 18.33°; DIP4 = 0.73 · PIP4 − 20.54°; DIP5 = 0.84 · PIP5 − 12.42°).

For abduction of MCP joints of fingers the same procedure as in the detailed protocol was applied to obtain GA, using analogous postures to trials 21 and 22; but a shortened protocol was applied for the cross-coupling effect, as only the extension-flexion cycles corresponding to 0° in MCP flexion of the fixed digits (two trials per sensor) were used.

Across-subject calibration protocol

The across-subject protocol involved calculating ‘across-subject gains’ by averaging the gains and coefficients that resulted from the Detailed calibration protocol implemented in a group of 6 subjects (see below, Experimental procedure and analysis, Phase 1).

Joint angle calculation

Joint angles were calculated using sensor outputs relative to the outputs of trial 21, which was defined as 0° for all joints. If Ssensor is the relative output signal of sensor, then the angles at the different joints are calculated as follows.

IP1, PIP2 to PIP5, and MCP1f to MCP5f, angles:

Flexion Angle=GF·Ssensor (1)

Palmar arch angle:

palmar arch Angle=GPalmar·Roll2 (2)

MCP2 to MCP5 abduction angles:

MCP2A=GA2·SA2+(C1MCP2·SF3+C2MCP2·SF5+C3MCP2·SF32+C4_MCP2·SF52+C5_MCP2·SF3·SF5) (3)
MCP3A=0 (4)
MCP4A=GA3·SA3+(C1MCP4·SF5+C2MCP4·SF7+C3MCP4·SF52+C4_MCP4·SF72+C5_MCP4·SF5·SF7) (5)
MCP5A=MCP4A+GA4·SA4+(C1MCP5·SF7+C2MCP5·SF9+C3_MCP5·SF72+C4_MCP5·SF92+C5_MCP5·SF7·SF9) (6)

Thumb CMC flexion and abduction angles:

CMC1F=GF_CMC1·(Roll1+AFF·A1) (7)
CMC1A=GA_CMC1·(A1+AFA·Roll1) (8)

Experimental procedure and analysis

Phase 1

The Detailed calibration was applied to 6 subjects, selected to achieve a representative variation in hand size (Table 1, Sample 1, Subjects 1 through 6). After calibration, sensor outputs were recorded while each subject adopted five static postures (Figure 3), selected to represent different postures incorporating both flexion and abduction of fingers. Each subject repeated the entire process, including calibration and static postures, in three different sessions. The gains and coefficients were calculated from the detailed calibration protocol for each subject and session. The joint angles of the five static postures were estimated from the sensor outputs collected during a given session three times: first, using the gains and coefficients from the corresponding calibration (same session in which the posture was measured); then, from the distinct calibrations resulting from the other two repeated sessions. The differences in the angles that result from transforming the same sensor output with gains from the three repeated calibrations serves as an estimate of the error of using a subject-specific, detailed calibration obtained in a different experimental session and has implications for the need to replicate the calibration for a given subject if testing involves multiple sessions. Mean and standard deviation (SD) across postures and subjects of the paired differences were used as bias and precision errors, respectively. Errors were also evaluated by grouping some of the hand joint movements for a broader interpretation: flexion at all MCP joints, flexion at all IP joints, and abduction at all MCP joints.

Table 1.

Descriptive data of all the subjects participating in the experiments

Gender HL (mm)a HB (mm)b
Sample 1 Subject 1 Male 183 88
Subject 2 Female 169 76
Subject 3 Male 176 81
Subject 4 Female 160 69
Subject 5 Male 196 83
Subject 6 Female 179 76

Sample 2 Subject 7 Male 171 86
Subject 8 Female 166 73
Subject 9 Male 204 82
Subject 10 Female 176 74
a

HL: hand length, measured from the proximal palmar crease to the tip of the middle finger)

b

HB: hand breath, measured at the metacarpal heads

Fig. 3.

Fig. 3

Static postures used to evaluate the errors of the method proposed: (a) Maximal abduction of all fingers with hand in a plane; (b) All fingers in 90° MCP flexion while thumb in maximal extension; (c) Grasping a ball; (d) Letter ‘Y’ from American Sign Language (ASL); (e) Letter ‘R’ from ASL

After completion of all testing (6 subjects × 3 sessions) and analysis in Phase 1, the ‘across-subject gains’ for the across-subject calibration protocol were defined as the mean values of all the gains and coefficients.

Phase 2

Four additional subjects (Table 1, Sample 2, Subjects 7 through 10) were tested in a single session, using the detailed calibration protocol and the same five static postures. The joint angles for each posture were calculated from the sensor output two times in Phase 2: first, using the gains and coefficients resulting from the detailed calibration performed for the subject in the testing session; then, from the across-subject calibration that resulted from Phase 1. Differences between these angles (across-subject minus detailed) provide an estimate of the error of using the ‘across-subject calibration’ protocol compared to using a detailed subject-specific protocol. Again, mean and SD across postures and subjects of the differences were considered as bias and precision errors. Errors were also evaluated across the grouped hand movements described in Phase 1.

To evaluate the dependence of errors associated with the across-subject calibration on hand-size, Pearson correlations of the precision errors with hand breadth (HB) and hand length (HL) were calculated for each joint angle. The global postures were also visualized using a kinematic hand model developed in previous work (J. H. Buffi, Crisco, and Murray 2013; Holzbaur, Murray, and Delp 2005) comparing both calibrations for each posture and subject.

Phase 3

For a single subject (Subject 9), the errors resulting from the across-subject calibration and the fast calibration protocol were calculated relative to a reference data set, quantified in a separate protocol, using a videogrammetric technique thoroughly detailed ina previous work (Joaquin L Sancho-Bru et al. 2014). Because the hand could not be effectively instrumented with the markers needed for the videogrammetric method while simultaneously wearing the instrumented glove, two datasets were collected; the first dataset was collected while the subject was wearing the glove, the second dataset was collected without the glove. Each data set consisted of three trials of each of the five static postures described previously. For the across-subject and fast calibration protocols, joint angles were estimated from the first dataset, using the identical sensor output to calculate the joint angles according to the gains resulting from the respective calibration method. In all comparisons, the average joint postures across all three repetitions for a given posture were compared. The accuracies (bias and precision errors) of the across-subject and fast protocols were calculated as the differences between the angles measured using the respective calibration and the videogrammetric dataset. Notice that the ‘R’ American Sign Language (ASL) posture (Figure 3.e) was not included, as it couldn’t be measured with the videogrammetric technique because of markers and fingers overlapping.

Phase 4

Finally the clinical utility of the across-subject calibration was tested on a subject with a severely injured hand (dominant hand) caused by an accident with a circular saw, in an advanced recovering stage (Figure 4). The protocol was used to measure the active range of motion (AROM) of his hand joints. His AROM values were compared to the normal values measured with the same protocol to a sample of 24 healthy subjects.

Fig. 4.

Fig. 4

Right hand of the injured subject.

RESULTS

Phase 1

Global bias and precision errors associated with transforming the same sensor output with gains obtained from three, distinct, detailed subject-specific calibrations obtained in repeated sessions are small (0.36° and 3.50°, respectively; Table 2). Highest bias (3.19°) corresponded to abduction of little MCP joint, and highest precision error (12.66°) to flexion of thumb CMC joint, followed by palmar arch. Very low precision error is observed for IP and MCP flexion angles (2.71° and 1.62°, respectively), and slightly higher for MCP abduction angles (3.52°).

Table 2.

Mean bias and precision errors, in degrees, of using gains and coefficients obtained with the detailed calibration in a different session for subjects of sample 1 (phase 1), and of using the across-subject calibration versus the detailed subject-specific calibration (phase 2)

Phase 1 Phase 2

Joint Bias (°) Precision
(°)
Mean Precision of
group of joints (°)
Bias (°) Precision
(°)
Mean Precision of
group of joints (°)
IP1f 0.01 1.33 2.71 −0.03 1.72 1.74
PIP2f −0.02 2.88 0.04 2.47
PIP3f 0.02 3.76 −0.41 1.34
PIP4f 0.01 4.00 0.72 1.70
PIP5f 1.32 1.59 −0.35 1.48

MCP1f 0.00 0.92 1.62 0.84 4.90 2.67
MCP2f −0.05 2.21 −0.23 2.10
MCP3f 0.00 2.15 2.26 3.00
MCP4f −0.01 1.76 0.19 1.44
MCP5f 0.92 1.04 −1.51 1.91

MCP2a −0.25 4.77 3.52 0.2 5.34 7.90
MCP4a 0.00 3.31 −0.4 8.19
MCP5a 3.19 2.47 4.86 10.16

CMC1f −1.26 12.66 1.78 10.26

CMC1a 0.08 2.88 2.18 10.39

Palmar arch 1.79 8.19 −0.18 4.85

Grand Mean 0.36 3.50 0.49 4.45

Phase 2

Global bias and precision errors associated with using the ‘across-subject calibration’ protocol compared to using a detailed subject-specific protocol are similar to those obtained in Phase 1 (0.49° and 4.45°, respectively; Table 2). Again, highest bias corresponded to abduction of little MCP joint (4.86°), highest precision errors to CMC joint angles and abduction of little MCP joint (about 10°). Precision errors for IP and MCP flexion angles are very small (1.70° and 2.67°, respectively). Precision errors associated with abduction of MCP joints are somewhat larger. The differences for the worst case are graphically visualized in Figure 5.

Fig. 5.

Fig. 5

Visual comparison of the five static postures for the subject 9, the one with the highest differences (detailed subject-specific calibration versus across-subject calibration). (a) Maximal abduction of all fingers; (b) All fingers in 90° MCP flexion while thumb in maximal extension; (c) Grasping a ball; (d) Letter ‘Y’ from American Sign Language (ASL); (e) Letter ‘R’ from ASL

Joint angle errors were significantly correlated with hand size, especially for PIP and MCP flexion angles (cf., Fig. 6, shaded cells indicate significant Pearson correlations). In general, we observed stronger correlations with measures of hand length compared to breadth.

Fig. 6.

Fig. 6

Pearson correlations of the precision errors with hand breadth (HB) and hand length (HL): darker shadowed cells for p < 0.01, lighter shadowed cells for p < 0.05. The sign of the correlations is also shown

Phase 3

When the across-subject calibration protocol developed here was compared to a second “fast” calibration protocol, adapted from a previous method (J. H. Buffi et al. 2014), the mean precision errors from the across-subject calibration were approximately 3.3° smaller than those from the fast calibration (Table 3). More specifically, mean precision errors of IP and MCP joints from the across-subject calibration were smaller than those from the fast calibration. Highest bias and precision errors using the across-subject calibration corresponded to PIP5 flexion (−10.30°) and MCP5 flexion (13.45°), respectively. Highest bias and precision errors using the fast calibration correspond to MCP5 abduction (24.45°) and MCP3 flexion (22.46°), respectively.

Table 3.

Mean values for bias and precision errors of using the across-subject calibration and the subject-specific fast calibration compared to using the videogrammetric technique

Across-subject calibration Subject-specific fast calibration

Joint Bias (°) Precision
(°)
Mean Precision of
group of joints (°)
Bias (°) Precision
(°)
Mean Precision of
group of joints (°)
IP1f −0.65 1.50 6.26 −2.20 9.13 9.13
PIP2f −3.09 5.56 −12.51 11.25
PIP3f −4.86 9.40 −4.56 9.25
PIP4f −3.77 4.68 −5.19 5.87
PIP5f −10.30 10.19 −9.80 10.12

MCP1f 5.62 6.00 7.29 −4.66 2.20 13.32
MCP2f −2.28 6.64 8.31 13.20
MCP3f −0.60 8.20 14.78 22.46
MCP4f −9.87 2.17 5.34 16.93
MCP5f 7.92 13.45 3.95 11.83

MCP2a 1.76 7.26 8.08 1.19 10.29 11.47
MCP4a −0.05 8.18 5.68 10.00
MCP5a 4.01 8.80 24.45 14.11

CMC1f −3.63 5.76 6.62 7.43

CMC1a −1.73 6.81 −4.70 3.18

Palmar arch −0.41 8.69 −2.71 7.66

Grand Mean −1.37 7.08 1.50 10.31

Phase 4

AROM obtained for the pathologic subject were in accordance with the rehabilitation assessment performed by clinicians. The AROM were out of the normal range for CMC1 extension and abduction, IP1 flexion and extension, DIP2 to DIP5 flexion and extension, and in particular for MCP2 to MCP4 flexion the AROM was out of the range of the calibration (70°, 60° and 59° respectively, all of them lower than the 75° required). These limitations would disable the subject for performing the static postures of the Detailed calibration protocol, and obviously the cycles needed to account for the cross-coupling effect.

DISCUSSION

The results of this work demonstrate promising approaches with strong potential to overcome critical problems associated with effective calibration of instrumented gloves. Such potential solutions are needed to advance technical capabilities for quantitative data collection during complex hand motions. First of all, we show that using a single, detailed calibration session for data collection from a single subject over multiple experimental sessions introduces only minimal error (mean precision error 3.50°), enabling data collection from the same subject over multiple days, without repeating a tedious, time-consuming calibration procedure. Furthermore, we propose that the small errors associated with using our across-subject calibration protocol (mean precision error 4.45°) are acceptable for many purposes. In addition to the reduction in time and effort associated with glove calibration, in the scenarios in which the error levels are permissible, this approach also has the potential to improve the accuracy with which hand kinematics can be quantified when the subject has a severe disability that interferes with the capacity to achieve subsets of hand postures essential for completion of the detailed, individualized calibration. Specifically, in this case, the results of our study suggest that the across-subject calibration would give better results than a detailed calibration in which some sensors could not be properly calibrated.

When comparing the difference between the joint angles that resulted when the same sensor outputs were transformed with both the across-subject calibration and the detailed subject-specific calibration, only three degrees of freedom (abduction of the little MCP joint and flexion and abduction of CMC1 joint) yielded errors greater than 10°. Due to the complexity of the base joint of the thumb and the location of the sensors, it is not surprising that errors associated with CMC1 were relatively large. The larger error associated with abduction of the little finger can be explained because it represents an accumulated error. Specifically, flexion of little MCP joint is calculated as the sum of the relative abduction between little and ring fingers and the relative abduction between ring and middle fingers, yielding an accumulated error of a magnitude of approximately twice the error of similar joints.

The results of our correlation analysis suggest that, when using the across-subject calibration, several joint angles are sensitive to hand size. This result is consistent with the motivation of a previous study that used hand segment lengths as an input to ANN as an algorithm to transform sensor output to joint angles (Zhou, Malric, and Shirmohammadi 2010); although the success of this previous technique was not evaluated in terms of joint angle errors. We observed less sensitivity to hand breadth than hand length (e.g., only 4 degrees of freedom yielded significant correlations with hand breadth vs. 7 with hand length, Fig. 5). For MCP flexion, we note that 3 out of 5 MCP joints were negatively correlated to either hand length or breadth. Thus, using the across-subject calibration instead of using the detailed calibration generally yielded greater MCP flexion angles for smaller hands and smaller MCP flexion angles for larger hands. Overall, our correlation analysis suggests that the degree of variability in hand sizes across a group of subjects should be considered when implementing the across-subject calibration approach, especially if the application requires data of high precision.

When a single subject adopted five static postures and the joint angles estimated using the across-subject calibration were compared to the photogrammetric technique, we observed a small, negative bias error across all joints (e.g., on average, the joint angles were smaller for the across-subject data). In contrast, we note a small, positive bias error for the fast calibration. While our interpretation is limited by the fact that the videogrammetric data had to be taken separately, we postulate that the result of a negative bias (e.g., smaller joint excursions from the neutral posture) is consistent with the fact that the individuals were wearing a glove, increasing joint stiffness. In addition, another source of bias in the across-subject approach is that abduction angles of fingers were obtained assuming no abduction for the middle finger, which may affect the recorded values for the other abduction angles.

Given the benefits of instrumented gloves for quantification of complex hand movements discussed previously, our analysis suggests that the across-subject calibration approach is a feasible methodology for many applications in which the measurement of joint angles is required (ranging from clinical diagnosis, rehabilitation or functional assessment, to robotics). Because we observed smaller differences relative to a reference data set (Table 3), we conclude the across-subject calibration methodology performed more effectively than the fast calibration protocol (grand mean precision errors 7.08° and 10.31°, respectively). While this analysis was completed with an 18-sensor Cyberglove, it is extendable to a 22-sensor Cyberglove, which registers also fingers distal IP joint flexion. In order to use it, an analogous procedure to that presented for the rest of IP joints could be used.

Acknowledgments

Funding:

This work was supported by the Spanish Ministry of Economy and Competitiveness under Grant [project DPI2014-52095-P]; Universitat Jaume I under Grant [projects P1-1B2013-33 and P1- 1B2014-10] and also by the NIH Grant NIH R01EB011615.

We thank Marta Mora, PhD, for her collaboration in coding for data glove acquisition, and the graduate student Sheyla Mestre Vicente for her collaboration in data collection.

This research was funded by the Universitat Jaume I through projects P1·1B2013-33 and P1- 1B2014-10, and by the Spanish Ministry of Economy and Competitiveness and the EU (FEDER funds) through project DPI2014-52095-P. This work was also funded by the NIH Grant NIH R01EB011615.

NOMENCLATURE

ADL

Activities of daily living

ANN

Artificial neural networks

AROM

Active range of motion

ASL

American sign language

CMC1

Carpometacarpal joint of thumb

DIP2 to DIP5

Distal interphalangeal joints (2 to 5, index to little digits)

DoF

Degree of freedom

HB

Hand breadth

HL

Hand length

IP

Interphalangeal joint

IP1

Thumb interphalangeal joint

MCP

Metacarpophalangeal joint

MCP1 to MCP5

Metacarpophalangeal joints (1 to 5, thumb to little digits)

PIP2 to PIP5

Proximal interphalangeal joints (2 to 5, index to little digits)

RMSE

Root mean square error

SD

Standard deviation

Footnotes

This article has no relevant Conflict of Interests.

References

  1. Brand PW, Hollister AM. Clinical Mechanics of the Hand. 3. St. Louis: Mosby Publishing; 1999. [Google Scholar]
  2. Buffi James H, Crisco Joseph J, Murray Wendy M. A Method for Defining Carpometacarpal Joint Kinematics from Three-Dimensional Rotations of the Metacarpal Bones Captured in Vivo Using Computed Tomography. Journal of biomechanics. 2013;46(12):2104–8. doi: 10.1016/j.jbiomech.2013.05.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Buffi James H, Sancho Bru Joaquín Luis, Crisco Joseph J, Murray Wendy M. Evaluation of Hand Motion Capture Protocol Using Static Computed Tomography Images: Application to an Instrumented Glove. Journal of biomechanical engineering. 2014;136(12):124501. doi: 10.1115/1.4028521. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Buffi James, Sancho Bru Joaquín Luis, Murray Wendy M, Crisco Joseph J. Evaluation of Hand Motion Capture Protocol Using Computed Tomography: Application to an Instrumented Glove. Journal of biomechanical engineering. 2014 doi: 10.1115/1.4028521. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Bullock Ian M, Zheng Joshua Z, De La Rosa Sara, Guertler Charlotte, Dollar Aaron M. Grasp Frequency and Usage in Daily Household and Machine Shop Tasks. IEEE Transactions on Haptics. 2013;6(3):296–308. doi: 10.1109/TOH.2013.6. [DOI] [PubMed] [Google Scholar]
  6. Chiu HY, Lin SC, Su FC, Wang ST, Hsu HY. The Use of the Motion Analysis System for Evaluation of Loss of Movement in the Finger. Journal of Hand Surgery (British and European Volume) 2000;25(2):195–99. doi: 10.1054/jhsb.1999.0344. [DOI] [PubMed] [Google Scholar]
  7. Crasborn O, Sloetjes H, Auer E, Wittenburg P. Combining Video and Numeric Data in the Analysis of Sign Languages with the ELAN Annotation Software. In: Max Planck Institute for Psycholinguistics, editor. 2nd Workshop on the Representation and Processing of Sign Languages: Lexicographic Matters and Didactic Scenarios. Paris: ELRA; 2006. pp. 82–87. [Google Scholar]
  8. Eccarius Petra, Bour Rebecca, Scheidt Robert A. Dataglove Measurement of Joint Angles in Sign Language Handshapes. Sign language and linguistics. 2012;15(1):39–72. doi: 10.1075/sll.15.1.03ecc. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Griffin Weston B, Findley Ryan P, Turner Michael L, Cutkosky Mark R. Calibration and Mapping of a Human Hand for Dexterous Telemanipulation; ASME IMECE 2000 Symposium on Haptic Interfaces for Virtual Environments and Teleoperator Systems; 2000. pp. 1–8. [Google Scholar]
  10. Grinyagin IV, Biryukova EV, Maier MA. Kinematic and Dynamic Synergies of Human Precision-Grip Movements. Journal of neurophysiology. 2005;94:2284–94. doi: 10.1152/jn.01310.2004. [DOI] [PubMed] [Google Scholar]
  11. Holzbaur Katherine RS, Murray Wendy M, Delp Scott L. A Model of the Upper Extremity for Simulating Musculoskeletal Surgery and Analyzing Neuromuscular Control. Annals of biomedical engineering. 2005;33(6):829–40. doi: 10.1007/s10439-005-3320-7. [DOI] [PubMed] [Google Scholar]
  12. Kessler G Drew, Hodges Larry F, Walker Neff. Evaluation of the CyberGlove as a Whole-Hand Input Device. ACM Transactions on Computer-Human Interaction. 1995;2(4):263–83. [Google Scholar]
  13. Kortier Henk G, Sluiter Victor I, Roetenberg Daniel, Veltink Peter H. Assessment of Hand Kinematics Using Inertial and Magnetic Sensors. Journal of neuroengineering and rehabilitation. 2014;11(1):70. doi: 10.1186/1743-0003-11-70. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Kramer James F. Determination of Thumb Position Using Measurements of Abduction and Rotation 1996 [Google Scholar]
  15. Metcalf Cheryl D, Robinson Rebecca, Malpass Adam J, Bogle Tristan P, Dell Thomas A, Harris Chris, Demain Sara H. Markerless Motion Capture and Measurement of Hand Kinematics: Validation and Application to Home-Based Upper Limb Rehabilitation. IEEE transactions on bio-medical engineering. 2013;60(8):2184–92. doi: 10.1109/TBME.2013.2250286. [DOI] [PubMed] [Google Scholar]
  16. Mitobe Kazutaka, Kaiga Takaaki, Yukawa Takashi, Miura Takeshi, Tamamoto Hideo, Rodgers Al, Yoshimura Noboru. ACM SIGGRAPH 2006 Research Posters on - SIGGRAPH ’06. New York, New York, USA: ACM Press; 2006. Development of a Motion Capture System for a Hand Using a Magnetic Three Dimensional Position Sensor; p. 102. [Google Scholar]
  17. Nathan Dominic E, Johnson Michelle J, McGuire John R. Design and Validation of Low-Cost Assistive Glove for Hand Assessment and Therapy during Activity of Daily Living-Focused Robotic Stroke Therapy. The Journal of Rehabilitation Research and Development. 2009;46(5):587. doi: 10.1682/jrrd.2008.04.0052. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. O’flynn Brendan, Sanchez Javier Torres, Connolly James, Condell Joan, Curran Kevin, Gardiner Philip, Downes Barry, Tssg Barry Downes. Integrated Smart Glove for Hand Motion Monitoring. SENSORDEVICES 2015; The 6th International Conference on Sensor Device Technologies and Applications; Venize, Italy. Aug 23–28 '15.2015. [Google Scholar]
  19. Oess Ninja P, Wanek Johann, Curt Armin. Design and Evaluation of a Low-Cost Instrumented Glove for Hand Function Assessment. Journal of neuroengineering and rehabilitation. 2012;9:2. doi: 10.1186/1743-0003-9-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Sanchez-Margallo FM, Sanchez-Margallo JA, Pagador JB, Moyano JL, Moreno J, Uson J. Ergonomic Assessment of Hand Movements in Laparoscopic Surgery Using the Cyberglove (R) In: Miller Karol, Nielsen Poul MF., editors. Computational Biomechanics for Medicine. New York, NY: Springer New York; 2010. pp. 121–28. [Google Scholar]
  21. Sancho-Bru Joaquin L, Jarque-Bou Nestor J, Vergara Margarita, Perez-Gonzalez Antonio. Validity of a Simple Videogrammetric Method to Measure the Movement of All Hand Segments for Clinical Purposes. Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine. 2014 doi: 10.1177/0954411914522023. [DOI] [PubMed] [Google Scholar]
  22. Sancho-Bru Joaquín L, Mora Marta C, León Beatriz E, Pérez-González Antonio, Iserte José L, Morales Antonio. Grasp Modelling with a Biomechanical Model of the Hand. Computer methods in biomechanics and biomedical engineering. 2012;17(4):297–310. doi: 10.1080/10255842.2012.682156. [DOI] [PubMed] [Google Scholar]
  23. Tripp Brady L, Uhl Tim L, Mattacola Carl G, Srinivasan Cidambi, Shapiro Robert. A Comparison of Individual Joint Contributions to Multijoint Position Reproduction Acuity in Overhead-Throwing Athletes. Clinical biomechanics (Bristol, Avon) 2006;21(5):466–73. doi: 10.1016/j.clinbiomech.2005.12.015. [DOI] [PubMed] [Google Scholar]
  24. Vergara Margarita, Sancho-Bru JL, Gracia-Ibáñez V, Pérez-González A. An Introductory Study of Common Grasps Used by Adults during Performance of Activities of Daily Living. Journal of hand therapy : official journal of the American Society of Hand Therapists. 2014 doi: 10.1016/j.jht.2014.04.002. [DOI] [PubMed] [Google Scholar]
  25. Zheng Joshua Z, De La Rosa Sara, Dollar Aaron M. An Investigation of Grasp Type and Frequency in Daily Household and Machine Shop Tasks; 2011 IEEE International Conference on Robotics and Automation (ICRA); 2011. Affiliation: Department of Mechanical Engineering and Materials Science, School of Engineering and Applied Science, Yale University, New Haven, CT, United States; Correspondence Address: Zheng, J.Z.; Department of Mechanical Engineering and Materials Scie, 4169–75. [Google Scholar]
  26. Zhou Jilin Zhou Jilin, Malric François, Shirmohammadi Shervin. A New Hand-Measurement Method to Simplify Calibration in Cyberglove-Based Virtual Rehabilitation. IEEE Transactions on Instrumentation and Measurement. 2010;59:2496–2504. [Google Scholar]

RESOURCES