Abstract
Robotic lower limb prostheses can improve the quality of life for amputees. Development of such devices, currently dominated by long prototyping periods, could be sped up by predictive simulations. In contrast to some amputee simulations which track experimentally determined non-amputee walking kinematics, here, we explicitly model the human-prosthesis interaction to produce a prediction of the user’s walking kinematics. We obtain simulations of an amputee using an ankle-foot prosthesis by simultaneously optimizing human movements and prosthesis actuation, minimizing a weighted sum of human metabolic and prosthesis costs. The resulting Pareto optimal solutions predict that increasing prosthesis energy cost, decreasing prosthesis mass, and allowing asymmetric gaits all decrease human metabolic rate for a given speed and alter human kinematics. The metabolic rates increase monotonically with speed. Remarkably, by performing an analogous optimization for a non-amputee human, we predict that an amputee walking with an appropriately optimized robotic prosthesis can have a lower metabolic cost – even lower than assuming that the non-amputee’s ankle torques are cost-free.
People with trans-tibial (below knee) amputation commonly use passive prostheses providing some stiffness and damping (e.g., SACH-foot, Flex-foot1). However, passive prosthesis users experience reduced mobility2,3 and increased metabolic cost4,5 compared to non-amputees. This reduced performance is partially due to reduced foot control and an inability to produce net positive work with the prosthesis. Robotic ankle-foot prostheses could address these issues6,7. Although many robotic prostheses exist, designing and testing new prostheses takes considerable time: computational simulations could shorten this process. Many previous simulation studies8,9 used human-prosthesis models that tracked non-amputee walking kinematics, thus ignoring human adaptation to the prosthesis10. Here, rather than assume the amputee’s gait, we seek to predict it. Similarly, rather than assume a specific prosthesis actuation strategy, we design prosthesis torque profiles through energy optimization.
Numerous studies suggest that humans move in an approximately energy optimal manner11,12, even with amputation13 or using unpracticed motions14. Here, we use large-scale numerical optimization to compute the energy-optimal walking motions and prosthesis actuations of a human wearing a unilateral robotic prosthesis. We compute optimal trade-offs between human metabolic and prosthesis torque costs. We show how increasing prosthesis mass, using passive prostheses, or forcing left-right symmetry increase human costs for a given walking speed and how increasing speed increases cost. Finally, we predict that optimal prosthesis actuation can reduce the amputee metabolic cost much below normal human metabolic cost.
Methods
Human-prosthesis model
We consider a sagittal plane model of a unilateral amputee using an ankle-foot prosthesis (Fig. 1A) with empirically-based properties15,16. The human component has six rigid-body segments: one head-arms-torso segment, one segment for each thigh, one segment for each shank, and one segment for the biological foot. There are thirteen uni- or bi-articular muscles with constant moment-arms and Hill-type force-velocity relationships: eight muscles on the biological (non-prosthesis) side and five on the prosthesis side. The prosthesis foot is a single rigid-body segment, actuated by an idealized torque motor with no internal dynamics. The prosthetic foot mass and inertia properties are identical to the human foot unless otherwise stated. See Supplementary Information for parameter values. We present all parameters and results in non-dimensional form, normalized by combinations of body mass Mbody, leg length , and gravitational acceleration g.
The feet can contact the ground at their heel and toe. We assume a normal walking motion with a prescribed sequence of eight ‘contact phases’ (Fig. 1B), each denoted by a four-letter code specifying which heels (H) and toes (T) are in contact or not (0): the first two letters refer to the biological foot’s contact points and the last two letters refer to the prosthesis’. e.g., HT0T has biological heel and toe and prosthesis toe in contact. Contact kinematic constraints are imposed using a differential-algebraic formalism, as opposed to modeling contact with springs and dampers16,17,18. By assuming that any point in contact with the ground has a zero velocity, this method of imposing contact constraints removes high frequency and fast time-scale dynamics that can arise due to springs and dampers. Given muscle forces and prosthesis torque as functions of time and initial conditions for body state, we can integrate the equations of motion for each contact phase to simulate the motion of the human-prosthesis system. We model transitions between contact phases as continuous when contact is broken and as perfectly-inelastic collisions, with velocity changing instantaneously when contact is made.
Energy cost functions
We seek a periodic walking motion that minimizes , a weighted sum of the human metabolic cost Cmet and the prosthesis cost Cpros over a stride as follows:
where Tstride is the stride time and 0 ≤ λ ≤ 1 is a fixed weighting factor: λ = 1 makes identical to human cost and λ = 0 gives the prosthesis cost. Optimizing with multiple λ values allows us to determine the trade-offs between human metabolic cost and prosthesis cost by changing the relative importance of the two costs in the optimization.
Our human metabolic cost function is adapted from Alexander and Minetti11,19:
an integral over the whole stride period and a sum over all muscles, depending on activation ai, shortening velocity vi, maximum shortening velocity vmax,i, and maximum isometric force Fiso,i; ψ(ai) is an activation-related cost and is a function11 describing the metabolic dependence on normalized muscle shortening velocity
(see Supplementary Information, Figure S2). The prosthesis cost is modeled as
where τ is the motor torque, is the torque-rate, and r is a scaling constant (equal to typical muscle moment arm); the torque-squared term is a model of motor electrical losses20 and the torque-rate-squared term with a small pre-multiplier (ε = 0.01) is used to model torque production limitations by penalizing rapid activation and deactivation11,21.
Other metabolic cost models
While all the results in the main manuscript are based on the above cost functions for the human and the prosthesis, we also considered two other simple cost functions that have previously been used in biomechanics to model “effort” or metabolic cost: (1) cost rate for each muscle proportional to muscle-force squared16,22, and (2) energy cost for each muscle proportional to a weighted sum of positive and negative work, scaled by the efficiencies of positive and negative work11,23. We did not use other more complex models based on muscle heat generation18,24, as they are often non-smooth; we will consider such functions in future work.
Optimization structure and constraints
We seek an optimal walking gait with the periodic contact phase sequence in Fig. 1B, parameterized using a “multiple-shooting method”. We constrained speed at v = 1.3 m/s or non-dimensional speed , except for one set of calculations that varied speed systematically. The eight contact phases, Nphases = 8, each with unknown time duration, are divided into Nseg = 6 time-segments, each with Nunknowns = 32 unknowns (initial conditions for all body segment positions and velocities and unknown muscle forces and prosthesis motor torque, assumed piecewise linear), producing 1544 unknowns through:
to be determined by optimization. We constrain positions, velocities, forces and torques to be continuous across different time segments. For collisional transitions, the results of the collision equations (applied to the end of the contact phase) are equal to the initial conditions for the next contact phase. Further nonlinear constraints include ground clearance for swing legs, ground contact for stance legs, muscle force-velocity dependence, and range of motion bounds. We solve the constrained optimization problem using sparse nonlinear programming (SNOPT11), with equality constraint satisfaction of 10−7. Since it is possible for the optimization to converge to non-global local minima, we only consider solutions which can be discovered from multiple initial seeds.
Results
Optimizing just the human cost (mostly)
We minimized the composite cost strongly weighted towards human cost (λ = 0.95), to obtain optima when prosthesis cost is mostly neglected. Figure 2A,B and the walking animations (Supplementary Video V1) show the corresponding optimal motion is asymmetric.
Setting λ = 1 caused convergence issues in the numerical optimization; presumably because this limit λ = 1 implies a truly “zero cost prosthesis,” the optimization tended to explore large and erratic prosthesis motor torques and torque rates, resulting in the numerical difficulties.
Comparison with non-amputee gait
We minimized the same human metabolic cost for a non-amputee (able-bodied) human with symmetric legs and musculature, giving a symmetric optimal gait (Fig. 2A,B). Metabolic cost for the amputee with a prosthesis is lower than that for the non-amputee (Fig. 3A). The muscles crossing a single ankle contribute 41% of the optimized non-amputee metabolic cost. Thus, if ideal motor torques replaced all muscles crossing one ankle while maintaining identical kinematics, the human cost could be reduced by 41% by this “muscle replacement strategy”. Remarkably, for λ = 0.95, the human cost with a unilateral prosthesis is 73% lower than the non-amputee cost. This greater cost reduction arises from allowing amputee kinematics to be different from non-amputee kinematics, thus allowing the prosthesis ankle motor to perform much more work than the replaced ankle muscles. This is remarkable because while the replaced ankle muscles provide torques at both ankle and knee (some muscles are biarticular), our prosthesis produces torques only at the ankle. Thus, extrapolating this trend, we speculate that if we made the prosthesis provide torques at the knee (simulating a supplementary knee exoskeleton) as well as at the ankle, perhaps the optimal cost reduction might be even greater.
Optimal trade-offs between human and prosthesis cost
By optimizing with different λ’s between 0.1 and 0.95, we obtain the optimal cost trade-off between human and prosthesis costs (Fig. 3A). This trade-off curve, often called a “Pareto curve”25, shows that increasing prosthesis cost decreases human cost. Here, even though obtained by minimizing a weighted sum of human and prosthesis cost, the Pareto curve (if ‘convex’) also has the following interpretation: this curve gives the lowest human cost for a given prosthesis cost and vice versa. Any other walking strategy will have either a higher human cost or a higher prosthesis cost compared to every point on this Pareto curve. Figure 3B shows that the the optimal prosthesis actuation has most of prosthesis action at the end of stance phase, providing large push-off power; the human cost is reduced through an increase in prosthesis push-off torque and impulse. While the trade-off in Fig. 3A is specific to the assumed human and prosthesis costs, we find that almost identical trade-off curves arise when substantially different cost functions are used (Figure S3, Supplementary Information).
Symmetry is expensive
Every Pareto-optimal gait we found was asymmetric irrespective of λ. However, walking symmetry is said to have physiological and psychological benefits to prosthesis users26, so we repeated the optimizations while requiring approximate left-right symmetric kinematics. Symmetry was enforced as a constraint requiring the left leg joint angles and angular rates during one step be nearly equal to (within 0.05 rad or 0.05 rads−1 of) the right leg joint angles and angular rates one step later. The resulting symmetric optimal gaits had much higher human and prosthesis costs (Fig. 3A) for each λ, a longer push-off phase, and different timing for dorsiflexion torques during swing phase (Fig. 3B). When we compared the cost of the optimal symmetric gait at λ = 0.95 to the non-amputee condition, we found only a 27% reduction in the metabolic cost. This reduction in cost is smaller than the 41% metabolic cost reduction achieved by the replacement strategy. The optimal symmetric gait with the prosthesis is worse than the simple replacement strategy, even though the replacement strategy would also result in a symmetric gait; while we do not know the reason for these relative costs, presumably the optimal symmetric gait with the prosthesis has a higher cost because it is unable to replace the knee torques with the prosthesis (no Gastrocnemius), requiring other muscles to compensate.
Lighter feet are less expensive
We performed optimizations with prosthetic foot masses from 50%–150% that of the intact foot, scaling the prosthesis moments of inertia similarly. Figure 4A shows that by fixing either the human or the prosthesis cost, we can reduce the other by reducing prosthesis mass. Further, we see that cost reductions from reducing foot mass are much smaller than those obtained by increasing the prosthesis cost. Both human and prosthesis costs seem well-approximated by a linear dependence on the prosthesis mass for each λ (Figure S4, Supplementary Information), but the coefficients of the linear fit depends on λ.
Greater human cost reduction at higher speeds
We performed optimizations with five different walking speeds between 0.7 and 1.5 m/s, computing the Pareto curves with λ = 0.1–0.9. As is true for non-amputee walking, the human metabolic rate increases with increasing speed (Fig. 4B). In particular, the whole Pareto curve for a lower speed is below and to the left of that for a higher speed, implying that for a given Prosthesis cost rate, a lower speed implies a lower human metabolic rate and vice versa. Further, we see that for lower speeds, we predict lower percentage and absolute reduction to the human metabolic rate while using an optimal active prosthesis with most human benefit (here λ = 0.9).
Passive prosthesis
We performed optimizations constraining the prosthesis to be a linear torsional spring and damper, simulating a passive prosthesis. We considered four stiffnesses: 0.10, 0.50, 1.00 and 1.50 non-dimensional stiffness normalized by bodyweight, chosen to roughly capture the torque-angle relationship of optima derived earlier. Damping was chosen to make the foot over-damped during swing; we used , where Bpros is the damping, Ipros is the prosthesis moment of inertia, Kpros is the torsional stiffness, and is the critical damping value for a second order linear system. While the metabolic cost decreases as the stiffness increased, all of these passive devices produced asymmetric and metabolically expensive human gaits (Fig. 3A). Human cost with the passive device is comparable to active prosthesis with a symmetry constraint, except for high λ’s. Thus, the symmetry constraint is so detrimental as to make active robotic prostheses have little to no energetic benefit over passive devices.
Discussion
We have obtained the optimal tradeoffs between human and prosthesis costs for a robotic unilateral prosthesis, and have suggested that we can reduce amputee metabolic cost by increasing prosthesis effort, allowing asymmetry and decreasing prosthesis mass. These relationships can inform prosthesis design, e.g., by selecting a desired metabolic cost, we could predict the prosthesis cost at various prosthesis masses; the prosthesis torques and costs along with information on number of steps walked daily will allow us to pick motor and battery specifications for the prosthesis. We have created a design tool that translates a specification of the level of assistance to be provided by the prosthesis (namely, λ) into appropriate prosthesis torque profiles.
We have not compared predicted human kinematics and performance with experiment. Such comparison requires implementing our optimal actuation in a prosthesis; a simpler comparison might involve using a passive prosthesis in experiment and comparing with the corresponding model-derived optimal human kinematics. Highly accurate prediction of even non-amputee walking kinematics in a wide variety of novel situations remains an open problem; recent attempts have fallen short of quantitatively predicting the correct kinematics, kinetics, and/or metabolic costs16,17,18, even though having qualitatively similar kinematics, analogous to our non-amputee optimization here. Improved predictions of human walking with a prosthesis may require more complex human body models, more accurate metabolic cost models, and inclusion of other objectives such as lowered interaction forces between human and prosthesis.
Our optimization predicts asymmetric gaits for both robotic and passive prostheses but the mechanism that causes the asymmetry is likely different in these two settings. When using a passive prosthesis, the gait becomes asymmetric since the prosthesis cannot add positive work to the system and the human is compensating with the intact limb. However, for robotic prostheses, our model suggests asymmetric gaits are energy optimal with symmetric gaits costing vastly more. In these asymmetric optimal gaits, the leg with the prosthesis spends more time on the ground (higher duty factor, Figure S5, Supplementary Information) compared to the biological leg, allowing the robotic prosthesis to provide greater assistance; we predict that optimal prosthesis actuation could reduce the human cost, possibly much below non-amputee levels (by over 70%). This energy reduction prediction is considerably higher than observed in experimental studies, which have at best reduced the users’ metabolic costs to about equal to non-amputee metabolic cost27 (about 14% reduction compared to the subjects’ passive prostheses).
This discrepancy in energy costs is likely because our predictions are based on simultaneous optimization of human and prosthesis control and therefore a best case scenario, whereas the controllers in current robotic prostheses are not generally optimized to the person and the person may also not have had enough time to adapt to the prosthesis. Our optimal prosthesis actuation as a function of time has a large torque impulse near the end of the stance phase; it may be that current robotic prostheses, with their simpler ankle-state-based feedback controllers, are unable to allow the prosthesis to produce a large torque impulse right at the end. Most current prosthesis also have a lower peak torque than allowed in our simulations, as our peak torque was based on a recent physical prosthesis emulator28, reported as having the higher torque output among current prostheses. Further, whereas our prosthesis actuation is specific to walking at a particular speed on level ground, the feedback controllers in current robotic prostheses may have been the result of compromises made for use at different walking speeds, slopes, etc. Producing large energy reductions in experiment may require a prosthesis capable of optimizing its torque output to the person and the environment (perhaps over a training period). Other issues that compound the discrepancy in costs between current prostheses and our predictions include secondary goals sought by the user (e.g. gait symmetry, pain reduction, lateral-stability, etc.), or other un-modeled effects.
Alternatively, it may be that the large energy reduction we predict is due to our specific metabolic cost model. Experimental studies in non-amputees suggest that each ankle contributes about 13% of the metabolic cost of walking29 while our metabolic cost model predicts a total of 41%. Repeating the non-amputee calculation with a work-based metabolic cost, we found that only about 18% of the total work cost is due to one ankle – this is the reduction predicted by a muscle replacement strategy for this work-based cost (Figure S3 and Table S5, Supplementary Information). For this work-based cost, the robotic prosthesis (with λ = 0.95) produced only a 23% reduction in cost, still greater than the 18% from the muscle replacement strategy, but much lower than 73%. On the other hand, for a scaled muscle-force-squared cost, the ankle contribution was about 43% for a non-amputee walk and the reduction from the robotic prosthesis was about 74% (Figure S3 and Table S5, Supplementary Information). Thus, it appears that some of these specific numerical predictions may rely on the metabolic cost model and may be improved with a much more accurate metabolic cost model, which remains an open problem11,18.
Having performed over a hundred different optimization calculations under different parameter conditions (in contrast to other optimization-based studies16,17,18), we have demonstrated feasibility of using such large-scale optimizations in a formal design procedure with user-specific model parameters. Future work could consider the effects of different prosthesis structures (including non-ideal actuators and passive elements) and constraining the prosthesis torque to be a function of system state rather than be allowed to vary arbitrarily in time: for instance, by using existing controller structures found in other prostheses or by parameterizing a torque versus ankle angle relation for a gait and optimizing the controller parameters. Such additions will allow us to compare the results of our simulation to those found through experiment, and improve the model to make accurate quantitative predictions.
Additional Information
How to cite this article: Handford, M. L. and Srinivasan, M. Robotic lower limb prosthesis design through simultaneous computer optimizations of human and prosthesis costs. Sci. Rep. 6, 19983; doi: 10.1038/srep19983 (2016).
Supplementary Material
Acknowledgments
This work was supported by the NSF CMMI grant 1300655. Thanks to Joshua Caputo and Steven Collins (CMU) for extensive conversations informing this work.
Footnotes
Author Contributions M.L.H. created the human-prosthesis model and performed the optimizations, in discussion with M.S., M.L.H. and M.S. wrote the paper together.
References
- Lehmann J. et al. Comprehensive analysis of energy storing prosthetic feet: Flex foot and seattle foot versus standard sach foot. Arch. Phys. Med. Rehabil. 74, 1225–1231 (1993). [PubMed] [Google Scholar]
- Burger H., Marincek C. & Isakov E. Mobility of persons after traumatic lower limb amputation. Disabil. Rehabil. 19, 272–277 (1997). [DOI] [PubMed] [Google Scholar]
- Davies B. & Datta D. Mobility outcome following unilateral lower limb amputation. Prosthet. Orthot. Int. 27, 186–190 (2003). [DOI] [PubMed] [Google Scholar]
- Ganguli S., Datta S., Chatterjee B. & Roy B. Metabolic cost of walking at different speeds with patellar tendon-bearing prosthesis. J. Appl. Physiol. 36, 440–443 (1974). [DOI] [PubMed] [Google Scholar]
- Waters R., Perry J., Antonelli D. & Hislop H. Energy cost of walking of amputees: the influence of level of amputation. J. Bone Joint Surg. Am. 58, 42–46 (1976). [PubMed] [Google Scholar]
- Au S., Weber J. & Herr H. Powered ankle-foot prosthesis improves walking metabolic economy. IEEE Trans. Robot. 25, 51–66 (2009). [Google Scholar]
- Caputo J. & Collins S. Prosthetic ankle push-off work reduces metabolic rate but not collision work in non-amputee walking. Sci. Rep. 4, 51–66, doi: 10.1038/srep07213 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zmitrewicz R., Neptune R. & Sasaki K. Mechanical energetic contributions from individual muscles and elastic prosthetic feet during symmetric unilateral transtibial amputee walking: a theoretical study. J. Biomech. 40, 1824–1831 (2007). [DOI] [PubMed] [Google Scholar]
- LaPre A., Umberger B. & Sup F. Simulation of a powered ankle prosthesis with dynamic joint alignment. In Conf. Proc. IEEE Eng. Med. Biol. Soc. 1618–1621 (2014). [DOI] [PubMed] [Google Scholar]
- Mattes S., Martin P. E. & Royer T. Walking symmetry and energy cost in persons with unilateral transtibial amputations: matching prosthetic and intact limb inertial properties. Arch. Phys. Med. Rehabil. 81, 561–568 (2000). [DOI] [PubMed] [Google Scholar]
- Srinivasan M. Fifteen observations on the structure of energy minimizing gaits in many simple biped models. J. R. Soc. Interface. 8, 74–98 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Alexander R. Optimization and gaits in the locomotion of vertebrates. Physiol. Rev. 69, 1199–1227 (1989). [DOI] [PubMed] [Google Scholar]
- Ralston H. Energy-speed relation and optimal speed during level walking. Int. Z. Angew. Physiol. 17, 277–283 (1958). [DOI] [PubMed] [Google Scholar]
- Handford M. & Srinivasan M. Sideways walking: preferred is slow, slow is optimal, and optimal is expensive. Biol. Lett. 10, 20131006 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gerritsen K., van den Bogert A., Hulliger M. & Zernicke R. Intrinsic muscle properties facilitate locomotor control - a computer simulation study. Motor Control 2, 206–220 (1998). [DOI] [PubMed] [Google Scholar]
- Ackermann M. & van den Bogert A. J. Optimality principles for model-based prediction of human gait. J. Biomech. 43, 1055–1060 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Anderson F. C. & Pandy M. G. Dynamic optimization of human walking. J. Biomech. Eng. 123, 381–390 (2001). [DOI] [PubMed] [Google Scholar]
- Miller R. H. A comparison of muscle energy models for simulating human walking in three dimensions. J. Biomech. 47, 1373–1381 (2014). [DOI] [PubMed] [Google Scholar]
- Minetti A. & Alexander R. A theory of metabolic costs for bipedal gaits. J. Theor. Biol. 186, 467–476 (1997). [DOI] [PubMed] [Google Scholar]
- Bhounsule P. A. et al. Low-bandwidth reflex-based control for lower power walking: 65 km on a single battery charge. Int. J. Robot Res. 33, 1305–1321 (2014). [Google Scholar]
- Rebula J. R. & Kuo A. D. The cost of leg forces in bipedal locomotion: A simple optimization study. PLOS ONE 10, e0117384, doi: 10.1371/journal.pone.0117384 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Martin A. E. & Schmiedeler J. P. Predicting human walking gaits with a simple planar model. J. Biomech. 47, 1416–1421 (2014). [DOI] [PubMed] [Google Scholar]
- Srinivasan M. & Ruina A. Computer optimization of a minimal biped model discovers walking and running. Nature 439, 72–75 (2006). [DOI] [PubMed] [Google Scholar]
- Umberger B. R. Stance and swing phase costs in human walking. J. Roy. Soc. Interface 7, 1329–1340 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marler R. & Arora J. Survey of multi-objective optimization methods for engineering. Struct. Multidiscip. O. 26, 369–395 (2004). [Google Scholar]
- Nolan L. et al. Adjustments in gait symmetry with walking speed in trans-femoral and trans-tibial amputees. Gait Posture 17, 142–151 (2003). [DOI] [PubMed] [Google Scholar]
- Herr H. & Grabowski A. Bionic ankle-foot prosthesis normalizes walking gait for persons with leg amputation. Proc. R. Soc. B. 279, 457–464 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Caputo J. & Collins S. A universal ankle-foot prosthesis emulator for human locomotion experiments’. J. Biomech. Eng. 136, 035002 (2014). [DOI] [PubMed] [Google Scholar]
- Sawicki G. S. & Ferris D. P. Powered ankle exoskeletons reveal the metabolic cost of plantar flexor mechanical work during walking with longer steps at constant step frequency. J. Exp. Biol. 212, 21–31 (2009). [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.