Abstract
We have created a model to estimate the corrective changes in muscle activation patterns needed for a person who has had a stroke to walk with an improved gait—nearing that of an unimpaired person. Using this model, we examined how different functional electrical stimulation (FES) protocols would alter gait patterns. The approach is based on an electromyographically (EMG) driven model to estimate joint moments. Different stimulation protocols were examined which generated different corrective muscle activation patterns. These approaches grouped the muscles together into flexor and extensor groups (to simulate FES using surface electrodes) or left each muscle to vary independently (to simulate FES using intramuscular electrodes). In addition, we limited the maximal change in muscle activation (to reduce fatigue). We observed that with the two protocols (grouped and ungrouped muscles), the calculated corrective changes in muscle activation yielded improved joint moments nearly matching those of unimpaired subjects. The protocols yielded different muscle activation patterns, which could be selected based on practical condition. These calculated corrective muscle activation changes can be used in studying FES protocols, to determine the feasibility of gait retraining with FES for a given subject and to determine which protocols are most reasonable.
Index Terms: Functional electrical stimulation (FES), EMG, joint moment, gait, Hill-model, ankle
I. INTRODUCTION
Functional electrical stimulation (FES) has been used in the rehabilitation of post-stroke patients (Peckham and Knutson, 2005). It is important to know how much additional activity should be added during FES. Many control methods have been used to derive the required electrical stimulation patterns (Popovic et al., 2003; Jezernik et al., 2004). These investigators employed different machine learning algorithms to account for the nonlinear relationship between electrical stimulation and patient’s kinematic output. However, these methods did not determine this relationship by directly accounting for the biomechanics of the human neuromuscular system, through which the neurological control strategies of human movement may be characterized more accurately.
We have developed EMG-driven biomechanical models to estimate muscle forces and joint moments (Lloyd and Besier, 2003; Buchanan et al., 2004). Since these models determine muscle forces based on recorded EMG data, they can be used to determine how different muscle activation patterns influence joint moments, and thus can be used to study FES protocols.
In this study, we constructed a biomechanical model to estimate the corrective increases in muscle activation patterns that would enable post-stoke patients to walk with a similar joint kinematics to that of an unimpaired person. Our goal is to provide a platform for studying FES protocols, through which the appropriate stimulation patterns can be determined to achieve the desired normal movement.
II. METHODS
In this study we focused on the ankle joint model. We included the main contributors to plantar/dorsiflexion: tibialis anterior (TA), medial and lateral gastrocnemius (MG and LG), and soleus (Sol). Our model is generic and can be applied to any joint given the necessary anatomical and physiological data.
EMG-driven model to estimate muscle forces and joint moments
The EMG-driven model was developed based on a Hill-type muscle model to calculate individual muscle forces and joint moments (Lloyd and Besier, 2003; Buchanan et al., 2004). The muscle characteristics including insertion points, pennation angle and maximum isometric forces were adapted from literature (Delp et al., 1990). Some of the parameters in our model were subject-specific and difficult to obtain, so a calibration process was used to tune these parameters for each subject (Heine et al., 2003). Once the parameters were tuned, the model could then be used to predict muscle forces and joint moments for new muscle activation patterns.
Optimization model to estimate corrective changes of muscle activation patterns
Using the tuned EMG-driven model, we modeled electrical stimulation by increasing the EMGs, optimally adjusting them using a parallel version of constrained simulated annealing algorithm (Wah and Wang, 1999) (Figure 1). Data from average unimpaired subjects’ gait trials were used to determine the corrected joint angles θ for stroke patients, resembling a normal kinematic pattern. We also determined the desired joint moments, MD, through scaling the joint moment profile of an unimpaired subject by body mass, height and walking speed (Lelas et al., 2003), which would generate the corrected joint angles θ for stroke patients. These data were used as input, and the new EMG pattern was then optimized to produce the desired joint moment. We chose to minimize the sum of ΔEMGs as the cost function, which is related to the muscle fatigue caused by electrical stimulation. (In this context, “EMG” means the normalized, rectified and filtered EMG signal.)
Figure 1.
Theoretical Flow of the optimization model. In this model, corrected joint angles and desired joint moment were the inputs, and we used constrained simulated annealing algorithm to calculate the ΔEMGs, which were required to achieve the desired joint moment profile for the stroke subjects. The new EMG profiles were generated using a cubic spline interpolation algorithm with sixteen control nodes evenly distributed across the time period.
Data collection and model calculations
Data were collected from two post-stroke patients who could walk without assistance (Table 1). EMG, joint position, and force plate data were collected during four walking trials for subject 1 and subject 2. EMGs were collected using surface electrodes from each muscle. Maximum voluntary contraction (MVC) trials were collected for normalization of EMG. The experimental protocol was approved by the Human Subjects Review Board of University of Delaware, and the subjects gave an informed consent before the data collection.
Table 1.
Information of the two subjects
| Subject | Gender | Age | Time since stroke | Hemiplegic side | Modified lower extremity Fugl-Meyer Score |
|---|---|---|---|---|---|
| 1 | M | 77 | 4 years | Right | 32/36 |
| 2 | M | 58 | 5 years | Right | 28/36 |
The parameters in the EMG-driven models were tuned using the initial walking trial for each subject. The calibrated models were then used to predict the other walking trials of the subjects. This paradigm is a good test of the model’s predictability of novel trials, because the EMG data were variable from trial to trial, unlike data for healthy subjects.
The new EMG patterns were then calculated for the initial trials of each subject using the optimization model. Two EMG changing algorithms were implemented. In Algorithm 1, the EMGs of every muscle were altered separately, representing the FES protocol of using epimysial and intramuscular electrodes to stimulate each individual muscle. In Algorithm 2, the EMGs of the muscles were grouped together as either dorsiflexors or plantar flexors and altered simultaneously, representing the FES protocol of using surface electrode to stimulate one muscle group. In addition, a constraint on ΔEMG limit (0≤ΔEMGÃ0.6) was added. This was done to avoid too large of ΔEMG values, which may cause the patient’s discomfort for intense electrical stimulation and induce fatigue. Different upper limit may be used depending on the patient’s comfortable tolerance.
III. RESULTS
The predicted joint moments of our EMG-driven model were close to inverse dynamic joint moments, which verified that the calibrated model could be used to predict novel trials (Tables 2).
Table 2.
Statistical results of calibration and prediction on walking trials of stroke subject 1 and 2. We calculated the R2 value, root mean square (RMS) error, and normalized RMS error (normalized to peak-to-peak joint moment) to compare the calibrated and predicted forward dynamic joint moment profiles with the inverse dynamic joint moment profiles.
| Subject | Trial | R2 value | RMS error (N·m) | Normalized RMS error (%) | |
|---|---|---|---|---|---|
| 1 | Calibration Prediction |
1 2~4 (Mean value (SD)) |
0.973 0.884 (0.041) |
1.53 6.86 (1.05) |
2.48 10.33 (1.83) |
| 2 | Calibration Prediction |
1 2~4 (Mean value (SD)) |
0.971 0.933 (0.016) |
3.32 10.89 (5.41) |
3.03 11.93 (5.67) |
Stroke subjects’ 1 and 2 ankle joint angles in walking trial 1 were different from those of the average unimpaired subject (Winter, 1990) (Figure 2). We compared the original ankle joint moment of each post-stroke patient with the desired unimpaired patterns (Figure 3 for subject 1). It was determined that the ankle joint moment should be altered during stance phase to match the unimpaired profile. We added the late swing phase as a buffering interval to account for the effect of electromechanical delay. Therefore, late swing phase and stance phase were chosen as the data of interest.
Figure 2.
Ankle joint angles during gait of average unimpaired subject and two stroke subjects. The time axis was normalized to one gait cycle, HS denotes heel strike, and TO denotes toe off. Positive joint angle indicates dorsiflexion. Note that the two stroke subjects had drop-foot during swing phase and smaller plantar flexion during late stance phase.
Figure 3.
The results of joint moments using Algorithm 1 for subject 1. The new moment is the moment calculated from the new EMG, the original moment is the original moment for the stroke patient, and the desired moment is derived from the unimpaired subject’s trial. Positive moments indicate dorsiflexion. Note that subject 1 lacked a dorsiflexion peak during early stance phase, which needed to be corrected by adding stimulation. After the ankle dorsiflexion was restored to normal, stronger plantarflexion moment was needed to plantarflex the ankle and finish the push-off by adding stimulation.
The original EMG of TA for subject 1 was small (Figure 4). After adding the calculated ΔEMG (Figure 5), the new moment was close to the desired moment (Figure 3), and the kinematics of the subject would shift from Line “Stroke subject 1” to Line “Average healthy” in Figure 2. The increase of EMG in dorsiflexor (TA) during late swing phase and early stance phase was needed to achieve a normal dorsiflexion moment. We observed similar results on subject 2. The statistical results for subject 1 and 2 demonstrated that both algorithms generated similar results of joint moment profiles (Table 3).
Figure 4.
The original normalized EMG patterns of subject 1. Note the subject had normal TA activity during swing phase, and the activation of TA was small during early stance phase, which supports the demand of using electrical stimulation to activate this weak muscle.
Figure 5.
The results of normalized ΔEMG for subject 1: (a) Algorithm 1; (b) Algorithm 2. The TA needed to be stimulated over the late swing phase and early stance phase for both algorithms. The soleus was chose as the only plantar flexor to be stimulated in Algorithm 1, because it would require a smaller amount of stimulation than the gastrocnemius, and thus reduces fatigue.
Table 3.
Statistical results of different optimization protocols for stroke subject 1 and 2. We calculated the R2 value, root mean square (RMS) error, and normalized RMS error (normalized to peak-to-peak joint moment) to compare the new joint moment profiles after adding stimulation with the desired joint moment profiles. ∑ΔEMG / EMGMVC is the sum of all normalized ΔEMG for all the four muscles and 1080 time steps (our sampling rate of EMG is 1080Hz).
| Subject | Protocol | R2 value | RMS error (N·m) | Normalized RMS error (%) | ∑ΔEMG / EMGMVC |
|---|---|---|---|---|---|
| 1 | Algorithm 1 Algorithm 2 |
0.979 0.980 |
2.09 2.10 |
2.47 2.48 |
332.5 368.8 |
| 2 | Algorithm 1 Algorithm 2 |
0.966 0.948 |
7.10 10.48 |
4.69 6.15 |
718.7 641.9 |
IV. DISCUSSION
This optimization model was developed based on our EMG-driven model, and took advantage of the EMG-driven model’s ability to predict novel trials. We employed this optimization model on two stroke patients’ walking trials and got the corrective changes in EMG patterns. These calculated corrective changes could be used as reference data in both stroke patients’ gait training with FES.
It was observed that the TA needed to be stimulated during late swing phase and stance phase to achieve normal ankle kinematic patterns for our post-stroke subjects. Since the volitional ankle moment during swing phase is close to zero for both stroke and unimpaired subjects, the early swing phase’s kinematic pattern will be restored to a normal pattern automatically, as long as the late swing and stance phase’s kinematic and kinetic patterns have been corrected using stimulation. The TA activity during swing phase in post-stroke subjects was similar to that found in unimpaired subjects, and the patients lacked the normal second peak of TA activity at initial foot contact, which might account for their flat foot walking (Burridge et al., 2001). Our results showed similar results that the TA activity needed to be corrected at heel strike to avoid drop-foot.
Two different optimization protocols were implemented during our calculation, providing different options for different stimulation protocols using surface electrodes and implantable epimysial & intramuscular electrodes. Different optimization protocols may be selected based on clinical judgment and practical condition.
After the corrective muscle activation changes were estimated using our model, the appropriate electrical stimulation patterns could be determined through other developed models to achieve the corrective changes (Riener et al., 1996; Soetanto et al., 2001; O'Keeffe et al., 2003). After the stimulation patterns are determined, they could be used as a baseline in open-loop or hybrid (combined feed-forward and feedback) control during an FES intervention.
There are several assumptions and limitations of this study. First, our model does not attempt to balance the moments at the knee, hip as well as the ankle, and our model can be extended to a multi-joint model combining other joints in future study. Second, a ground contact model may be developed instead of our scaling procedure to directly account for the change of ground reaction force after the kinematics is restored to normal, and it can be used to calculate the desired joint moments. Third, other desired joint moment profiles could also be used for different goals during FES intervention. Fourth, we did not account for the change of muscle force-activation relationship caused by stroke, and used the calibrated subject-specific muscle parameters to account for this impaired musculature. Fifth, we also need to recruit more patients and get results on different groups of patients.
In conclusion, we have developed a method to determine changes in muscle activation patterns needed for stroke subjects to correct their gait patterns so that they match those of unimpaired people, and we have demonstrated this in 2 subjects. The calculated corrective muscle activation changes may provide a baseline reference in open-loop control or hybrid control during FES intervention.
ACKNOWLEDGEMENTS
This work supported, in part, by NIH R01-HD38582. We wish to thank Kurt Manal and Daniel N. Bassett for helping with software development and Daniel Benoit and Wei-Li Hsu for assistance with the data collection.
Footnotes
This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
REFERENCES
- Buchanan TS, Lloyd DG, et al. Neuromusculoskeletal Modeling: Estimation of Muscle Forces and Joint Moments and Movements From Measurements of Neural Command. J Appl Biomech. 2004;20(4):367–395. doi: 10.1123/jab.20.4.367. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burridge JH, Wood DE, et al. Indices to describe different muscle activation patterns, identified during treadmill walking, in people with spastic drop-foot. Med Eng Phys. 2001;23(6):427–434. doi: 10.1016/s1350-4533(01)00061-3. [DOI] [PubMed] [Google Scholar]
- Delp SL, Loan JP, et al. An interactive graphics-based model of the lower extremity to study orthopaedic surgical procedures. IEEE Trans Biomed Eng. 1990;37(8):757–767. doi: 10.1109/10.102791. [DOI] [PubMed] [Google Scholar]
- Heine R, Manal K, et al. Using Hill-type muscle models and EMG data in a forward dynamic analysis of joint moment: Evaluation of critical parameters. Journal of Mechanics in Medicine and Biology. 2003;3:169–186. [Google Scholar]
- Jezernik S, Wassink RG, et al. Sliding mode closed-loop control of FES: controlling the shank movement. IEEE Trans Biomed Eng. 2004;51(2):263–272. doi: 10.1109/TBME.2003.820393. [DOI] [PubMed] [Google Scholar]
- Lelas JL, Merriman GJ, et al. Predicting peak kinematic and kinetic parameters from gait speed. Gait Posture. 2003;17(2):106–112. doi: 10.1016/s0966-6362(02)00060-7. [DOI] [PubMed] [Google Scholar]
- Lloyd DG, Besier TF. An EMG-driven musculoskeletal model to estimate muscle forces and knee joint moments in vivo. J Biomech. 2003;36(6):765–776. doi: 10.1016/s0021-9290(03)00010-1. [DOI] [PubMed] [Google Scholar]
- O'Keeffe DT, Donnelly AE, et al. The development of a potential optimized stimulation intensity envelope for drop foot applications. IEEE Trans Neural Syst Rehabil Eng. 2003;11(3):249–256. doi: 10.1109/TNSRE.2003.817678. [DOI] [PubMed] [Google Scholar]
- Peckham PH, Knutson JS. Functional electrical stimulation for neuromuscular applications. Annu Rev Biomed Eng. 2005;7:327–360. doi: 10.1146/annurev.bioeng.6.040803.140103. [DOI] [PubMed] [Google Scholar]
- Popovic D, Radulovic M, et al. Automatic vs hand-controlled walking of paraplegics. Med Eng Phys. 2003;25(1):63–73. doi: 10.1016/s1350-4533(02)00188-1. [DOI] [PubMed] [Google Scholar]
- Riener R, Quintern J, et al. Biomechanical model of the human knee evaluated by neuromuscular stimulation. J Biomech. 1996;29(9):1157–1167. doi: 10.1016/0021-9290(96)00012-7. [DOI] [PubMed] [Google Scholar]
- Soetanto D, Kuo CY, et al. Stabilization of human standing posture using functional neuromuscular stimulation. J Biomech. 2001;34(12):1589–1597. doi: 10.1016/s0021-9290(01)00144-0. [DOI] [PubMed] [Google Scholar]
- Wah BW, Wang T. Simulated annealing with asymptotic convergence for nonlinear constrained global optimization. Principles and Practice of Constraint Programming-Cp'99. 1999;1713:461–475. [Google Scholar]
- Winter DA. Biomechanics and motor control of human movement. New York: Wiley; 1990. [Google Scholar]





