Deep learning for musculoskeletal force prediction

Abstract

Musculoskeletal models permit the determination of internal forces acting during dynamic movement, which is clinically useful, but traditional methods may suffer from slowness and a need for extensive input data. Recently, there has been interest in the use of supervised learning to build approximate models for computationally demanding processes, with benefits in speed and flexibility.

Here, we use a deep neural networks to learn the mapping from movement space to muscle space. Trained on a set of kinematic, kinetic and electromyographic measurements from 156 subjects during gait, the network’s predictions of internal force magnitudes show good concordance with those derived by musculoskeletal modelling. In a separate set of experiments, training on data from the most widely known benchmarks of modelling performance, the international Grand Challenge competitions, generates predictions that better those of the winning submissions in four of the six competitions. Computational speedup facilitates incorporation into a lab-based system permitting real-time estimation of forces, and interrogation of the trained neural networks provides novel insights into population-level relationships between kinematic and kinetic factors.

Introduction

Human movement is a feat of extraordinary skill, requiring the coordinated action of huge numbers of muscle elements, in the face of changing environmental conditions, in real time. Exactly how the central nervous system (CNS) is able to achieve this task is unclear. In particular, the decoding of the neural representation of abstract task-related goals such as movement into specific muscle activation signals has proven difficult to decipher.

An approximation of this mapping is central to attempts at estimating the magnitudes of internal loads during movement, a matter of established clinical relevance for many patient groups²⁵. In the field of biomechanics, musculoskeletal models are used to approximate the mapping from kinematic space to force space by applying a framework rooted in the laws of classical mechanics. Experimentally observed kinematics and external forces can be used to formulate the equations of motion, the solution of which yields intersegmental forces and torques. It is in attributing these torques to individual muscles – the load-sharing problem – that it is necessary to specify the motor strategy used by the CNS. This is usually done by minimisation of an objective function representing some putative overarching goal of the motor system, with numerical optimisation techniques used to arrive at an optimal solution.

The use of these techniques has been validated to produce reasonable estimates of joint contact forces and muscular activation patterns for repetitive motions such as gait^{17, 26} but it is difficult to offer a biologically consistent rationale for the choice of any objective function, given our lack of knowledge about the method used by the CNS. Moreover, for complex models in high-dimensional spaces the computational complexity – and thus slowness - of static optimisation makes it a poor fit given the speed with which humans can accomplish complex movements. This is of practical importance as it limits the utility of modelling for real time applications, where the potential for clinical benefit is great.

In addition, as a technique that deals with separate trials independently, traditional inverse dynamic/static optimisation analysis has no capacity to exploit population-wide patterns in data, standing in contrast to models built upon data from multiple trials.

Supervised models of motor learning

Human motor learning involves adaptation to changing conditions – in both the environment and the plant (such as those due to growth, training or disease), and the modulation of muscle activations to account for such changes. For example, upon exposure to a force field, human subjects demonstrate modification of muscular activation patterns to efficiently compensate for the motor disturbance³⁴, with persistence of learned effects for some time following disengagement from the field. These observations lend weight to the notion of internal models that contain representations of the physics of the external world and of the musculoskeletal system, as put forward by Wolpert et al.⁴⁰. These models must be updated dynamically to reduce errors such that future movements made on the basis of their predictions are more optimal. This framing of motor control as a problem of supervised learning has its roots in the work of Albus and Marr^{2, 23}, where it was applied specifically to the cerebellum. Later, Kawato et al. proposed hierarchical neural networks as a solution to the control problem and showed that an internal inverse dynamics model could be learned by a robotic controller¹⁶.

More recently, supervised learning, manifest as neural networks, has been used to obtain increasingly impressive performances in a number of challenging prediction problems such as object and speech recognition, outperforming traditional modelling devices^{12, 20}. These breakthroughs have been viewed as significant because they represent foundational problems of human intelligence – tasks at which humans naturally excel but which have traditionally proven difficult for machines – much like the motor control problem. In the motor system, hierarchical layering of the type found in neural networks has been proposed as a means of mitigating problems associated with the immense complexity of the control problem⁴², although it remains poorly understood.

Application of supervised learning to musculoskeletal modelling

The replacement of a computationally expensive optimisation process with a fast solution learned under supervision is a well-established use of supervised models. There have been multiple applications of such ‘surrogate’ models both within the domain of biomechanical simulation - with uses in the estimation of implant pressure distribution⁴ and deformable joint contact⁹ – as well as elsewhere¹⁴. A major advantage of these models is speed; training may be lengthy but as inference involves a relatively simple forward pass through the network, it is computationally inexpensive and thus very quick. The potential for computational speedup is important as the slowness of static optimisation can make real time estimation of internal forces with complex models difficult. The problem of modelling complexity has been surmounted by the use of proxies for internal forces, such as the external knee adduction moment³⁹, an important biomarker for patients with osteoarthritis (OA) of the knee. As prevalence rates for this disease soar in the western world (38) novel preventative approaches have been sought, amongst them real time gait retraining, which aims to slow disease progression through the entraining of a walking technique that mitigates joint loading. However, evidence of a significant disparity between the external adduction moment and true internal forces³⁶ emphasises the need for true force estimation. This has been attempted in real time by explicit limitation of model complexity. Van den Bogert et. al.⁵ achieved a real time system that employed static optimisation to produce muscle force estimates at a rate in excess of 100Hz but in order to achieve such speed muscle moment arms were approximated by prescribed polynomials and an iterative optimisation solver was curtailed after a set period of time had elapsed. More recently, EMG-driven models have been run close to real time. One such system was used to provide feedback on kinetic variables to subjects walking on a treadmill, but with a latency of 115ms²⁷, far in excess of the maximum 75ms considered optimal for real time biofeedback(15).

Further benefits stem from the capacity of machine learning techniques to find latent structure in data. This leads to an important possibility: a reduction in the need for input data in the formulation of predictive models. The extensive ensemble of data required for the operation of physics-based musculoskeletal is an important factor limiting the clinical utilisation of such models.

Finally, because networks are imprinted with the training data, which contribute to their final nodal weights, their use allows a probing of population-level causal relationships between inputs and outputs. The trained network may be viewed as a function approximator where the information encoded in population-level relationships has been transferred to its weights, and may be analysed through interrogation of the network.

In addition to the surrogate models described above, previous attempts to apply neural networks within the field of musculoskeletal modelling have involved mappings between EMG and kinematics^{11, 33}, and EMG to force^{21, 33}. However, datasets have been small and the networks employed necessarily simple and shallow, limiting the generalisability of the results obtained. More recently, deep models combining recurrent and convolutional modules have been applied to time series of biological signals, for example in the prediction of kinematic parameters from EMG data⁴¹. There has also been growing interest in the use of deep learning architectures for motion capture-independent pose estimation²⁴.

Inspired by the recent successes of deep learning for prediction problems, the present study aimed to exploit a large corpus of motion data, applying deep neural networks to compute the mapping from kinematic to muscle space. Two sources of labelled data were used: musculoskeletal modelling predictions obtained by inverse dynamic analysis and static optimisation, and EMG sensor data. Validation was performed using holdout data subsets. Further validation of the models thus produced was performed using in-vivo knee prosthetic data previously used for the ‘Grand Challenge’ competitions to predict in-vivo knee loads¹⁹.

Materials and Methods

The dataset comprised synchronously captured kinematic (lower limb marker trajectories obtained by optoelectronic capture - Vicon MX system, Vicon Motion Systems Ltd, Oxford, UK), force plate (ground reaction force and centre of pressure - Kistler Instrumente AG, Winterthur, Switzerland) and EMG (Trigno Wireless EMG system, Delsys, USA) data from 156 subjects during multiple trials of level walking²². Stance phase of both left and right lower limb were represented and treated equivalently. EMG signals were measured for 8 major muscles of each lower limb. The subjects were diverse in body morphology, age, gender and lower limb pathology, with a significant proportion suffering from clinically diagnosed OA of one or both knees.

Table 1.

Subject characteristics

	Mean (Standard deviation)
Age (years)	48.5 (16.4)
Height (m)	1.71 (0.11)
Body mass (kg)	71.5 (13.1)
Percent female	49
Percent with OA	28

Several prediction problems were attempted:

• -Prediction of medial knee joint reaction force
• -Prediction of forces for major muscle groups of the lower limb
• -Prediction of EMG sensor measurements

Input tensors for neural network training

Raw data comprising 3-dimensional marker positions for each of 18 lower limb markers (4 on the pelvis and 14 on the stance limb), and force plate-derived 3-dimensional centre of pressure and ground reaction force were extracted from the duration of stance phase for each trial. The data were used to train neural networks taking the data of a single time step of a single trial as input. Thus, where the entirety of the data were utilised, kinematic and kinetic data at each time step were combined into a single vector of length 60, and then concatenated with equivalent vectors from all time steps, t, of a given trial to produce a matrix of dimensions [t, 60]. Many such matrices from all processed gait trials were concatenated to form a single long matrix representing the whole dataset for the neural network, where each row represented a single input.

In the first instance, both kinematic and kinetic data were used for training. Then, models were built using only partial inputs in order to assess the ability of the trained models to produce accurate predictions without exposure to the full ensemble of input data.

Target tensors for neural network training

Inverse dynamic modelling was used to provide targets for training. Processing of raw motion data was performed using Vicon Nexus® (1.85) and Matlab® (2017a; The MathWorks Inc., Natick, MA, USA). Data filtering was performed in Matlab using a low-pass fourth order Butterworth filter with a cutoff frequency of 10 Hz. Freebody (v2.1)⁶, an open-source segment-based musculoskeletal model was used for subsequent data processing to determine internal forces. The model’s predictions of tibiofemoral JRF during gait have been validated using data from instrumented prostheses⁸, and predicted muscle force waveforms have been shown to demonstrate high levels of concordance with known electromyography envelopes^6,31. Implementation involved the determination of coordinates of internal points in a subject-specific frame of reference. This was achieved by scaling using the measurements of a gender and height-matched subject, chosen from a morphologically diverse cohort of eight subjects, for whom three-dimensional position data of internal points had been obtained using magnetic resonance imaging⁸. Processed data were then taken as input by a Matlab® implementation of interior points optimisation²⁸ using static trial data for model calibration, to determine muscle and joint forces for each sampled frame. The objective function applied was:

$$minimiseJ={{\displaystyle \sum _{i=1}^n\left(\frac{F_i}{F_{imax}}\right)}}^3$$

where F_i is the force output of the i^th muscle element, F_imax defines the i^th muscle element's force at maximum isometric contraction and n is the total number of muscle elements -163²⁶. F_imax was calculated for each element from physiological cross-sectional area, which was determined using subject-specific measurements and anatomical dataset values obtained from the same matched-subject MRI described above.

To formulate the targets for training, the resulting scalar values were combined into individual vectors, for each trial, of dimensions [t, 1]. Again, many such vectors from different trials were concatenated to form a single long target vector corresponding to the input data matrix.

For EMG signal prediction, the raw signal was full-wave rectified, smoothed and resampled to match the length of the input tensor. Root mean square smoothing⁷ was performed using a window size of 50ms. All values were normalised to the observed within-trial maximum, producing activation trajectories that varied between zero and one for each muscle in every trial.

Training/validation/test split

The data were randomly separated into three groups according to an 80/10/10 relative split for the purposes of training, validation and final evaluation. Two types of final testing were performed. First, data obtained from individual subjects were strictly isolated within one group only to allow extrapolation of test evaluation metrics to new subjects (‘subject-naive’ setting). This was achieved by randomisation at the subject level. In this second, ‘subject-exposed’ setting, for every trial in the test set, there was at least one other trial from the same subject included in the training set. This was achieved by active redistribution of trial data following randomisation, where required, from the test set to the training set. The loss function for network training was defined as the root mean square error between predicted and actual target values:

$$\sqrt{\frac{1}{n}{\displaystyle \sum _{i=1}^n{\left(y_i-\varphi x_i\right)}^2}}$$

where y_i represents the target value of the i_th training example, generated by Freebody inverse dynamics for a given trial at time t_i,x_i is the corresponding input tensor at t_i and ϕ represents the transform function applied by the neural network. Training was performed using the backpropagation algorithm³² and network weights optimised using Adam¹⁸. Final training time was roughly one hour (NVIDIA Titan Xp GPU).

Neural network architecture

The validation data were used to optimise network architecture and hyperparameters for the prediction task. Simple feedforward, convolutional and recurrent architectures were tested, and it was established that validation accuracy was greatest using a convolutional neural network with fully connected output layers so hyperparameter searches were henceforth focussed here. In order to facilitate 2-dimensional convolution, the input at each timestep was reshaped to dimensions (x, 3), that is, each row of the input matrix corresponded to the 3-dimensional position vector of a single marker, or the 3-dimensional vectors of the ground reaction force or centre of pressure. Batch normalisation¹³ was found to improve accuracy and speed of convergence, and was used in all tested networks, applied as per convention to all layers bar the output. All networks utilised ReLU activations in their hidden layers, with a single linear output neuron. Manual hyperparameter optimisation was performed incrementally to establish reasonable bounds for subsequent search. Random sweeps within these bounds were then performed to find optimum architecture and hyperparameters. A single network architecture was developed and optimised for all predictions, and validation of the final network was performed in two ways.

Validation 1: Comparison with inverse dynamics and static optimisation/EMG data

Final evaluation was performed for the prediction of major muscle group force magnitudes, EMG activations and the medial knee joint reaction force. Particular emphasis was given to the latter because of the high level of validation accuracy that has been achieved by musculoskeletal models for its prediction, and because of its established clinical relevance as a marker for the risks of onset and progression of OA of the knee^25,35. Quantitative evaluation of accuracy was performed by comparison of the neural network’s predictions with those obtained when the same input data were analysed by inverse dynamic modelling, or with the true EMG signal.

Validation 2: Grand Challenge data

A neural network was trained to predict medial knee contact force in each of the grand challenge competition years. Input data were restricted to include only the three-dimensional ground reaction force vector; this and instrumented prosthesis data were resampled in order to equate lengths. Network architecture was identical to that previously used for the prediction of model force outputs, but potent regularisation techniques were necessary given the relative paucity of data available – these included L2 weight decay and early stopping. A separate model was trained for each year of the competition, by training using the data from all of the other years, a subset of which was withheld for the purposes of validation. Final evaluation was performed on the two trials that made up the evaluation trials in the real Grand Challenge of that particular year. The remainder of that year’s data was discarded from both training and test sets in order to match the data available to Grand challenge competitors as closely as possible, for the purposes of fair comparison. Rotation of the test dataset (leave-one-out cross-validation) yielded accuracy metrics for each of the six competition years.

Table 5.

Accuracy metrics for test set medial knee joint reaction force prediction using Grand Challenge data, together with corresponding winning submission metrics.

Competition year	Winning submission RMSE (N)*	Neural network RMSE (N) / Pearson’s r
2010	230	222 / 0.93
2011	312	227 / 0.89
2012	284	464 / 0.88
2013	194	144 / 0.90
2014	235	283 / 0.90
2015	165	149 / 0.92

^*Where multiple submissions were selected as winners, the lower of the error scores recorded on each trial has been selected for averaging

Real time implementation

For real time streaming of kinematic and kinetic data direct to the gait lab console, the Vicon SDK plugin³⁷ was used and adapted to incorporate the trained neural network. Input kinematic and kinetic data were processed in real time and forward-propagated through the network, returning values for internal force magnitudes. A custom plotting interface was developed in C++ for real time visualisation.

Network interrogation

A neural network was trained to predict the medial knee joint reaction force taking 3-dimensional intersegmental angle data and ground reaction force as input. Following completion of network training, examples were individually forward-propagated through the network and at each time step the partial derivatives of the output with respect to input elements were computed. The gradients thus obtained per trial were resampled from trial length to length 100 to allow for cross comparison and averaging across trials. Average values were multiplied by the standard deviation across trials of each feature at each time step in order to obtain a measure of the relative contribution of each feature to the variance of the medial knee JRF across stance phase.

Figure 6.

Feature importance map for joint angles and ground reaction force components plotted across stance phase

Results

555 trials were successfully processed using Freebody inverse dynamics. A small number of trials were discarded because they failed to yield feasible solutions to optimisation. The data were used to train a number of different neural networks implemented in Python using the Tensorflow library for numerical computation¹.

Network architecture

Optimum architecture and parameters are illustrated in figure 1 for a network taking the full extent of kinematic and kinetic data as input. All convolutional layers were 2-dimensional, applying a kernel size of [1x3] with stride size 1. To ensure equivalence of the first two data dimensions, the input was padded with zeros prior to application of the convolutional operator, as per convention.

Figure 1.

Network architecture (dimensions not to scale). BN = batch normalisation; ReLU=rectified linear unit activation

Validation 1: Accuracy versus inverse dynamics/static optimisation and EMG

The neural network outputs were compared with those of Freebody and EMG sensor data as appropriate. Neural networks that had been exposed to other data of the test subject during training (‘subject-exposed’, below) in the majority of cases outperformed those that had not.

Medial knee JRF prediction

Table 2.

Accuracy metrics for test set prediction of the medial knee joint reaction force. n denotes the number of test trials over which evaluation was performed

Input data	Subject-naïve*: RMSE (std.) / Pearson’s r		Subject-exposed*: RMSE (std.) / Pearson’s r (n=58)
	All test trials (n=63)	OA subject trials (n=28)
Force plate and kinematic data	216 (136) / 0.90	268 (104) / 0.87	186 (207) / 0.90
Force plate data only	291 (132) / 0.82	296 (130) / 0.81	268 (206) / 0.89
Kinematic data only	247 (119) / 0.84	284 (108) / 0.84	212 (213) / 0.87

^*‘Subject-naïve’ denotes testing with models for which all trials of the test subjects were excluded from the training data. ‘Subject-exposed’ models were trained with one or more trials of the test subjects included in the training data. In the subject-naïve condition, separate metrics are provided for patients with OA.

Figure 2.

a, b: Trajectories of the medial knee joint reaction force in two representative trials as predicted by the neural network and Freebody inverse dynamics/static optimisation

Figure 3.

Trajectory of the medial knee joint reaction force in a single representative trial as predicted by the neural network using only force plate data, and that predicted by Freebody inverse dynamics/static optimisation

Figure 4.

Trajectory of the medial knee joint reaction force in a single representative trial as predicted by the neural network using only kinematic data, and that predicted by Freebody inverse dynamics/static optimisation

Muscle force prediction

Table 3.

Accuracy metrics for test set prediction of forces of major muscle groups during stance phase

Muscle (stance side)	Subject-naïve: RMSE (std.) / Pearson’s r		Subject-exposed: RMSE (std.) / Pearson’s r
	All test trials	OA subject trials
Gluteus maximus	127 (52) / 0.69	96 (34) / 0.74	91 (72) / 0.81
Gluteus medius	274 (135) / 0.71	294 (169) / 0.76	196 (186) / 0.86
Quadriceps	214 (114) / 0.62	235 (95) / 0.89	194 (140) / 0.93
Hamstrings	126 (78) / 0.91	135 (66) / 0.85	140 (175) / 0.77

Figure 5.

a, b: Trajectories of muscle force in two representative trials as predicted by the neural network and Freebody inverse dynamics/static optimisation Left: quadriceps; right: gluteus medius

EMG prediction

Table 4.

Accuracy metrics for test set prediction of EMG signals

Muscle (stance side)	Subject-naïve: RMSE (std.)		Subject-exposed: RMSE (std.)
	All test trials	OA subjects trials
Gluteus medius	0.22 (0.07)	0.23 (0.08)	0.22 (0.09)
Rectus femoris	0.27 (0.18)	0.25 (0.07)	0.24 (0.11)
Vastus lateralis	0.21 (0.17)	0.19 (0.15)	0.21 (0.11)
Vastus medialis	0.19 (0.08)	0.20 (0.08)	0.19 (0.08)
Biceps femoris	0.28 (0.12)	0.30 (0.14)	0.23 (0.10)
Semitendinosus	0.34 (0.13)	0.37 (0.17)	0.31 (0.16)
Soleus	0.25 (0.13)	0.33 (0.13)	0.24 (0.12)
Tibialis anterior	0.22 (0.15)	0.26 (0.09)	0.21 (0.10)

Computation time (average per trial)

Average computational time required for inference was 71 milliseconds per trial, compared with 16 minutes for Freebody inverse dynamics and static optimisation (Intel Core i7 6700).

Validation 2: Grand challenge validation

Neural network outputs were compared with ground truth tibiofemoral force data obtained from instrumented prostheses, as in the real Grand challenges. Evaluation metrics bettered those of the winning submissions in 4 of the 6 competitions.

Real time implementation

Real time deployment to the gait lab was successful, with operation speeds in excess of 100Hz for the prediction of internal forces from force plate data.

Network interrogation

Feature importance maps derived by interrogation of a neural network trained on the entirety of the data showed smooth variation over stance phase.

Discussion

Supervised learning was proposed many decades ago as a suitable framework for the posing of the motor control problem. Since then, deep neural networks have enjoyed a resurgence of popularity, driven by a number of impressive performances in difficult problems including computer vision and speech recognition. More recently there have been attempts to fuse the disparate areas of deep learning and neuroscience²⁰.

Here, a novel integration of deep learning with musculoskeletal modelling was used to demonstrate advantages from the use of supervised learning techniques in approximating the mapping from kinematic space to muscle space. Good accuracy in force prediction was achieved across a diverse test cohort, with error metrics falling within the bounds of variability resulting from the application of different anatomical datasets, for example10. Performance in subjects with pathology was, as expected, slightly reduced in most cases relative to the entire test population, likely reflecting a greater variability in kinematic and kinetic features, and EMG signals. Some disparity in accuracy was generally observed between subject-exposed and subject-naïve models, for prediction of both inverse dynamic outputs and the EMG signal. This likely reflects the relatively small size of the training dataset, so that similarity of the train and test distributions was not guaranteed in the subject-naïve case. Until sufficient data are available from a broad range of subjects, the use of subject-specific models will be necessary if the greatest levels of accuracy are required. A major advantage of supervised learning over physics-based modelling is speed; this enabled the development of a real time lab-based system for feedback of internal forces.

Comparison with existing real time methods

Real time feedback is not new^{5, 27} but until now true real time rates have often required a number of compromises in terms of the complexity of the employed modelling. In contrast, the approach used here, by bypassing the computationally demanding explicit execution of inverse kinematics, inverse dynamics and static optimisation, promises the ability to build networks based on the results of models of increasing complexity, including those that so far have failed to achieve widespread use in large part because of their intractability to computation, such as those based on dynamic optimisation³. Though obtaining data using such complex models would be computationally expensive, the costs of network training and inference are not expected to differ significantly from those reported here. In fact, the computational costs of inference are low enough to make the deployment of trained networks to cheap portable hardware, including mobile phones, feasible, raising the prospect of force estimation away from the confines of the gait laboratory.

A further contribution of the work is in the development of means for musculoskeletal force prediction in the absence of the full ensemble of input data required for conventional modelling. Though accuracy was greatest when the neural network was exposed to all of the input data, reasonable performance was attained with only part of it, suggesting a degree of redundancy of information in the inputs. Machine learning techniques should provide a natural means for the exploitation of such redundancy. To test this hypothesis, validation on Grand Challenge data was performed using the three-dimensional ground reaction force only as input, and the resulting models were competitive with and, in most cases, bettered the winning submissions produced using detailed, handcrafted musculoskeletal models that utilised all of the available input data. This lessening of the input data requirement is particularly important in the clinical domain, where time and/ or resource constraints may be limiting. In the same vein, and in stark contrast to physics-based modelling, the network-driven approach requires no input of body segment parameters and no calibration trials, further increasing its attractiveness.

The applications of the technique are broad. True real time operation enables the use of model outputs as biofeedback for the training of movement parameters. For subjects with OA, an important application is gait retraining with the purpose of reducing the medial knee joint reaction force. It has been shown that real time biofeedback can be used to modify important kinetic parameters in healthy subjects³⁹, but as yet the difficulty of true force prediction has meant that this has not been accomplished for the medial knee JRF in patients.

Reasonable accuracy was obtained for prediction of the EMG signal from some muscles of the lower limb, but for others significant variability in the signals recorded from different trials of different subjects meant that error metrics were relatively high. A lack of repeatability is often a problem with the standard use of real EMG signals³⁰, as inter-trial differences, for example in electrode placement, may have major effects on the results obtained. There are other issues with the standard use of EMG, including a requirement for expertise both in the acquisition and the interpretation of sensor data, and, of course, the requirement for the sensors themselves, which may be expensive. For subjects who are sufficiently similar to those upon whose data supervised models have been built, or better yet where models have been exposed to previous trials of a given subject, such models can provide predictions of the EMG signal quickly and without extensive pre-processing of input data.

Calculation of partial derivatives for the joint reaction force with respect to input joint angles allowed for the generation of feature importance maps illustrating a measure of the importance of features in the input for the prediction of the trained objective. To our knowledge, this represents the first application of the technique to motion data. These maps showed smooth variation in importance across stance phase, with several features inverting the sign of their contribution to the medial knee JRF. The contributions of two components, the knee abduction angle and the vertical component of the ground reaction force, fit with the well-established correlation between the external knee adduction moment, with which these two factors are themselves strongly correlated, and the medial knee joint reaction force. Incidentally, recent work supports the reliability of cohort-level modelling over that performed on the basis of measurements from individual subjects²⁹.

It has been demonstrated that neural networks are able to generalise well to subjects of varying body morphology, age and pathology, often with very different gait patterns. However, this was shown only for a single activity; confidence in the model’s ability to provide accurate predictions for other types of movement remains unwarranted. Moreover, in the clinical domain, it is likely that rather than a capacity for accuracy in prediction of absolute force values, the ability to reveal trends in musculoskeletal forces with, for example, gait modification, will be of greater utility. Again, as yet, this ability remains unproven. Greatest accuracy will be achieved with the training of subject specific models, with the inclusion of a wide range of activities in the training set.

The requirement for the use of conventional musculoskeletal models to generate training data stems from a lack of sufficient available data on internal forces from other sources, a consequence of the difficulty of obtaining measures by other means, such as instrumented prostheses. However, the use of these models is predicated on the assumptions that underlie the solution of the muscle redundancy problem, and modelling is also subject to errors arising from experimental techniques such as motion capture. One of the perceived benefits of supervised learning is that it affords the ability to depart from the conventional framework, and, in doing so, leave behind some of these disadvantages. Training using data available from the Grand Challenges showed that, contrary to popular conception, neural networks can compete with and often, in fact, outperform meticulously handcrafted solutions where only limited amounts of training data are available. In future, as more sensor data become available, the potential to use supervised learning to obtain accurate predictions, and the conditions under which it is possible to do so, are expected to grow.

The use of neural networks to compute the mapping from the kinematic space to force space brings several advantages to musculoskeletal force prediction. Ultimately, it is hoped that this new technique will be useful in the clinical domain. A promising application is that of real time gait analysis and feedback, where the benefit of speed is of particular utility.