Abstract
During posture control, reflexive feedback allows humans to efficiently compensate for unpredictable mechanical disturbances. Although reflexes are involuntary, humans can adapt their reflexive settings to the characteristics of the disturbances. Reflex modulation is commonly studied by determining reflex gains: a set of parameters that quantify the contributions of Ia, Ib and II afferents to mechanical joint behavior. Many mechanisms, like presynaptic inhibition and fusimotor drive, can account for reflex gain modulations. The goal of this study was to investigate the effects of underlying neural and sensory mechanisms on mechanical joint behavior. A neuromusculoskeletal model was built, in which a pair of muscles actuated a limb, while being controlled by a model of 2,298 spiking neurons in six pairs of spinal populations. Identical to experiments, the endpoint of the limb was disturbed with force perturbations. System identification was used to quantify the control behavior with reflex gains. A sensitivity analysis was then performed on the neuromusculoskeletal model, determining the influence of the neural, sensory and synaptic parameters on the joint dynamics. The results showed that the lumped reflex gains positively correlate to their most direct neural substrates: the velocity gain with Ia afferent velocity feedback, the positional gain with muscle stretch over II afferents and the force feedback gain with Ib afferent feedback. However, position feedback and force feedback gains show strong interactions with other neural and sensory properties. These results give important insights in the effects of neural properties on joint dynamics and in the identifiability of reflex gains in experiments.
Keywords: Reflexes, Afferent feedback, Reflex gains, Sensitivity analysis, System identification
Introduction
During posture control, humans have two strategies to counteract unexpected disturbances and keep their equilibrium position. Co-contraction of the muscles increases joint viscoelasticity, while maintaining equilibrium. Co-contraction provides instantaneous viscoelasticity at the expense of high metabolic energy consumption. Sensory feedback is energy efficient, although effectiveness is limited due to the inherent neural time delays.
In the presence of fast unpredictable disturbances in the upper extremity, reflexes through afferent feedback provided by muscle spindles and Golgi tendon organs are the major contributors to sensory feedback. Muscle spindles are located in the muscles and provide feedback on stretch and stretch velocity. Golgi tendon organs are located in the junction between muscle and tendon, providing feedback on muscle force. Reflexes are involuntary responses to stimuli, and their strength is known to be modulated. Experiments have shown that different task instructions (Doemges and Rack 1992a, b; Abbink et al. 2004), disturbance properties (de Vlugt et al. 2002) and dynamic properties of the environment (Van der Helm et al. 2002) all elicit adaptation of the reflexive contribution to joint dynamics. Model simulations have indicated that these reflex settings are close to optimal for suppressing the disturbances (Schouten et al. 2001).
Additional to the many studies that quantify reflexive behavior by directly deriving metrics like integrated EMG after the application of a mechanical or electrical stimulus (e.g. Dewald and Schmit 2003; Schuurmans et al. 2009; Kurtzer et al. 2008; Nielsen et al. 2005), other studies use a control engineering approach to parameterize joint dynamics. A combination of system identification and modeling is then used to separate muscular and reflexive contributions (Kearney et al. 1997; Perreault et al. 2000; Van der Helm et al. 2002; Ludvig and Kearney 2007; Schouten et al. 2008a). The dynamic behavior of the joint is estimated by perturbing the joint with a random force disturbance using a robotic manipulandum and recording displacement and interaction force between the subject and the manipulandum. The joint dynamics are expressed in terms of the mechanical admittance, describing the amount of displacement per unit force. To separate reflexive contributions from muscle viscoelasticity, lumped parameters (Schouten et al. 2008b) can be fitted to the mechanical admittance. The resulting set of parameters quantify the joint inertia, the muscle viscoelasticity and the reflexive gains of the force, position and velocity feedback pathways.
There are multiple mechanisms that affect the strength of the reflex pathway. Fusimotor drive (Crowe and Matthews 1964; Ribot-Ciscar et al. 2009) modulates the muscle spindle’s sensitivity to stretch and stretch velocity, therewith altering the gain of the reflex pathway. With presynaptic inhibition (Rudomin and Schmidt 1999; Rudomin 2009; Baudry et al. 2010), the efficacy of transmission between primary afferent fibers and the receiving neurons can be centrally modulated. The strengths of interneuronal connections in the spinal cord affect the net amount of activation of the motoneuron pool due to the sensory feedback. All these mechanisms contribute to the joint dynamics as determined experimentally.
Despite the known neural mechanisms of reflex modulation and the available identification techniques, there are still many unknowns on how exactly neural mechanisms affect the measured joint dynamics. The goal of this study was to investigate how neural and sensory properties could map onto the (limited) set of reflex gains as obtained from joint dynamics, using a neuromusculoskeletal model. In other words: how do the underlying, physical neural and sensory properties effectively link to the lumped reflex gains? We used a neuromusculoskeletal model of a spinal neural network controlling an antagonistic pair of muscles with afferent feedback (Stienen et al. 2007). In a sensitivity analysis, sensory and neural properties in the model were systematically varied and reflex experiments were simulated to determine reflex gains. The results showed that besides the expected mappings, there also exist intricate, counterintuitive relationships between neural and sensory properties and reflex gains that need to be taken into account when interpreting experimental results.
Methods
Approach
Posture control experiments around the shoulder joint (Van der Helm et al. 2002) were mimicked on a neuromusculoskeletal (NMS) model. In these types of experiments, a subject holds the handle of a linear manipulator and minimizes deviations while being perturbed with a random force disturbance. This type of posture control experiment was mimicked by perturbing a joint in a neuromusculoskeletal model with a continuous random force disturbance. The reflexive contributions to the dynamic behavior of the joint were determined using system identification techniques identical to experiments in vivo. The reflexive component was expressed in terms of reflex gains, which gave a quantitative measure for the amount of stretch, stretch velocity and force related reflex action. In the sensitivity analysis the model parameters were systematically varied and the effects on task performance, joint admittance and the reflex gains were determined.
Model description
The NMS model is briefly described here; for full details see Stienen et al. (2007). Posture control of the shoulder was modeled as a one degree of freedom joint (inertia m = 0.18 kg m2), actuated by an antagonistic pair of muscles (moment arm r m = 30 mm). Since the experiment involved only small deviations around a constant level of co-contraction (≈40% of maximal force), a linearized muscle model was used. The viscoelasticity due to muscle co-contraction was set, such that the rotational viscoelasticity of the model was equivalent to the translational viscoelasticity taken from experimental data (Van der Helm et al. 2002): the endpoint stiffness and viscosity of the arm were respectively 800 N/m and 40 Ns/m. Stiffness and viscosity represented cross-bridge viscoelasticity, which is dominant in an experiment with co-contraction and relatively small displacements. The muscle activation dynamics were of first order with a time constant of 30 ms.
Afferent feedback to the spinal network was provided by Golgi tendon organs (force, through Ib afferents) and muscle spindles (stretch velocity and stretch, through Ia and II afferents). Each of the 121 Golgi tendon organs per muscle fired a spike train with a spike rate r Ib that was proportional (Crago et al. 1982) to the muscle force with a constant c Ib in spikes/s (Eq. (1)).
1 |
where F m is the muscle force, F max is the maximal muscle force (800 N) and t denotes time. A Poisson process was used to convert spike rate r Ib to the spike trains of the individual fibers. The afferent time delay of the Ib fibers was 15 ms.
A model of the muscle spindle (Prochazka and Gorassini 1998) was used to determine the firing rates of the 121 Ia and II afferent fibers per muscle as a function of muscle stretch (x m) and stretch velocity (). The Ia afferent firing rate r Ia was the summation of a background firing rate (constant a Ia), a linear length dependent part (c Ia) and an exponential stretch velocity dependent part (constants d Ia, e Ia). For the II afferents (r II), which were assumed to only transmit length-dependent information, the same model was used without the velocity-dependent part.
2 |
3 |
The afferent time delays of the group Ia and II fibers were respectively 15 ms and 30 ms.
The spinal neural network, which integrated the afferent input to generate the efferent control signals to the muscles, was based on Bashor (1998) and presented before in Stienen et al. (2007). The model consisted of six pairs of spinal neuron populations, i.e. motoneurons, Renshaw cells, group Ia and Ib interneurons and inhibitory and excitatory interneurons (see Fig. 1). Each population consisted of either 169 or 196 individual spiking neurons (MacGregor and Oliver 1974). These neurons have four state variables, i.e. membrane potential, variable threshold, potassium conductance and synaptic conductance. Whenever the membrane potential reached threshold, the neuron fired a discrete spike which was transmitted to the connected synapses. The synaptic connections between the neurons were created according to the connection scheme in Fig 1. Tonic, descending excitation (TDE) provided background activity to the motoneurons (resulting in co-contraction) and to some of the other neural populations. Each neuron in a receiving population was connected to 34–232 neurons, afferent fibers or descending fibers. Generally, the afferent input fans out over the populations. The connections with the lower number of synapses are closer to the afferent input than the connections with high number of synapses (the interneuronal connections). A full overview of synapse count can be found in Stienen et al. (2007). The individual projections were randomized. Five pre-set types of synaptic connections were used: single, double and triple strength excitatory synapses, excitatory synapses a with long time constant (to the Renshaw cells), and inhibitory synapses. No network training or any form of neural plasticity was implemented. Since the many motoneurons in a population all activated a single, lumped muscle (no individual muscle fibers and a single neuromuscular junction), the input signal to the muscle activation dynamics was obtained by taking a 20 ms moving average of the summed spike output of the motoneuron populations. Efferent time delay was 10 ms.
Simulation of the neuromuscular model
Similar to posture control experiments a crested multi-sine disturbance signal (Pintelon and Schoukens 2001) with a flat power spectrum between 0.5 Hz and 20 Hz was applied to the joint of the NMS model. The magnitude of the disturbance was chosen such that the root mean square (RMS) of the endpoint displacements was approximately 4 mm, similar to experiments on human subjects (Van der Helm et al. 2002). A single model run simulated a 9 second perturbation experiment. The model was run with a discrete time step of 1 ms. To prevent transient behavior from influencing the results the first 808 ms were rejected, leaving exactly 213 data samples. To account for possible variability due to the random processes involved in the generation of the force disturbance and the Poisson spike trains, each simulation was repeated eight times with a different initial seed of the random generators.
Lumped reflex gain model
After simulation of a perturbation experiment, reflex gains were determined by fitting a lumped reflex gain model onto the joint dynamics. The reflex gain model is illustrated in Fig. 2. The model input was disturbance force d and output was joint position . The intrinsic dynamics were parameterized by the inertia of the arm m and the muscle stiffness k and viscosity b. Reflexive feedback consisted of position feedback (with a gain k p), velocity feedback (gain k v) and force feedback (gain k f). A single reflexive feedback neural time delay τ del is represented by H del. Like in the simulated NMS model, the muscle activation dynamics H act were represented by a first order system with time constant τ act.
The reflex gain model transfer function H mod was described by:
4a |
4b |
4c |
4d |
4e |
For convenience, two intermediate variables and describe the effect of the force feedback loop on the afferent and reflexive velocity and position feedback loops (from intrinsic muscle force F int and reflexive muscle force F ref to net force F net). Using these intermediate variables, the entire model transfer function H mod can be expressed in a form similar to that of a mass-spring-damper system (see also Schouten et al. 2008b).
The eight model parameters m, b, k, k p, k v, k f, τ del and τ act (see also Table 1) were fitted onto the data with a criterion function J which minimized the error between arm position x of the neuromusculoskeletal model and the output of the lumped reflex gain model :
5 |
where i indexes the time vector t. For efficiency, lumped reflex gain model output was first determined in the frequency domain and then inverse Fourier transformed to obtain:
6 |
where D is the Fourier transform of disturbance force d. The criterion J was minimized using the least squares algorithm
lsqnonlin
from the Matlab optimization toolbox.1 The result of the fitting procedure was a set of 8 parameters that describe the joint dynamics, including reflexive contribution, in the same way as done in experiments.
Table 1.
Lumped parameter | Unit | Description |
---|---|---|
m | kg·m 2 | Joint inertia |
b | Nm·s / rad | Muscle viscosity |
k | Nm / rad | Muscle stiffness |
k p | Nm / rad | Position feedback gain |
k v | Nm·s / rad | Velocity feedback gain |
k f | Nm / Nm | Force feedback gain |
τ del | s | Neural time delay |
τ act | s | Muscle activation time constant |
After fitting, the goodness of fit was expressed in variance accounted for (VAF):
7 |
A VAF value of 1 indicates a perfect match between the lumped reflex gain fit and the NMS model output. Besides the parameters of the lumped reflex gain model and the VAF, the RMS value of the joint deviation (in radians) was determined to get a measure of performance in counteracting the disturbance.
Data analysis
A sensitivity analysis was performed where the neural and sensory parameters in the NMS model were systematically varied. The effects on the lumped reflex gains (Table 1) and the performance in terms of disturbance suppression (RMS) were determined. The 36 parameters included in the analysis were: muscle spindle constants (6), the Golgi tendon organ constant (1), synaptic weights between afferents and the neuron populations (8), synaptic weights between the neuron populations (12), synaptic weights between descending excitation and each neuron population separately (4), synaptic weights between descending excitation and all neuron populations simultaneously (1), and afferent and efferent time delays (4). A complete overview of the parameters including their description is listed in Table 2.
Table 2.
Neural model parameter | Description |
---|---|
Sensory constants | |
a Ia | Muscle spindle constant a Ia (Eq. (2)) |
c Ia | Muscle spindle constant c Ia (Eq. (2)) |
d Ia | Muscle spindle constant d Ia (Eq. (2)) |
e Ia | Muscle spindle constant e Ia (Eq. (2)) |
a II | Muscle spindle constant a II (Eq. (3)) |
c II | Muscle spindle constant c II (Eq. (3)) |
c Ib | Golgi tendon organ constant c Ib (Eq. (1)) |
Transport delays | |
τ Ia | Ia afferent transport delay |
τ Ib | Ib afferent transport delay |
τ II | II afferent transport delay |
τ Eff | Efferent transport delay |
Synaptic weights (between neurons) | |
w RC − MN | Synaptic weight Renshaw cell → motoneuron |
w IA − MN | Synaptic weight Ia interneuron → motoneuron |
w IN − MN | Synaptic weight inhibitory interneuron → motoneuron |
w EX − MN | Synaptic weight excitatory interneuron → motoneuron |
w MN − RC(L) | Synaptic weight motoneuron → Renshaw cell (long time constant) |
w MN − RC(S) | Synaptic weight motoneuron → Renshaw cell (short time constant) |
w RC − RC | Synaptic weight Renshaw cell → Renshaw cell (reciprocal) |
w IA − RC | Synaptic weight Ia interneuron → Renshaw cell |
w RC − IA | Synaptic weight Renshaw cell → Ia interneuron |
w IA − IA | Synaptic weight Ia interneuron → Ia interneuron (reciprocal) |
w IB − IN | Synaptic weight Ib interneuron → inhibitory interneuron |
w IB − EX | Synaptic weight Ib interneuron → excitatory interneuron |
Synaptic weights (afferents to neurons) | |
w ia − IB | Synaptic weight Ia afferent → Ib interneuron |
w ia − IN | Synaptic weight Ia afferent → inhibitory interneuron |
w ia − MN | Synaptic weight Ia afferent → motoneuron |
w ia − IA | Synaptic weight Ia afferent → Ia interneuron |
w ib − IN | Synaptic weight Ib afferent → inhibitory interneuron |
w ib − IB | Synaptic weight Ib afferent → Ib interneuron |
w ii − EX | Synaptic weight II afferent → excitatory interneuron |
w ii − IA | Synaptic weight II afferent → Ia interneuron |
Tonic descending excitation | |
w td − MN | Synaptic weight descending excitation → motoneuron |
w td − RC | Synaptic weight descending excitation → Renshaw cell |
w td − IA | Synaptic weight descending excitation → Ia interneuron |
w td − EX | Synaptic weight descending excitation → excitatory interneuron |
w td − ALL | Synaptic weight descending excitation → all receiving neurons |
One by one each parameter was simulated at 0.5, 0.9, 1.0, 1.1, 1.5 and 2.0 times its nominal value, with all other parameters kept to their nominal value. For each value, a single set of reflex gains was fitted onto the data of the eight simulation repetitions. A sensitivity measure was defined by taking the slope of a linear regression through the six resulting reflex gain values (Fig. 4). To allow for comparisons between the different sensitivities the sensitivity measure was normalized with the reflex gain value when all neural parameters had their default, nominal value (relative sensitivity, see Frank 1978). So the sensitivity measure gave the relative amount of change in a fitted lumped reflex gain as the result of a changing neural or sensory parameter. Figure 4 illustrates this process for the three reflex gains k p, k v, k f and the RMS of joint deviation.
Results
Figure 3 illustrates the results of a single model simulation. The top panel shows the multisine disturbance force d(t) acting on the joint. The resulting joint rotation x(t) of the NMS model is illustrated in the bottom panel, together with the reflex gain model fit . Of all reflex gain model fits, one fit with a VAF of 0.48 was rejected. This was the condition in which tonic descending excitation (TDE) was minimal, causing some of the neural populations to completely cease activity. The average VAF of the remaining 215 fits was 0.95 with a standard deviation of 0.014 and a minimum of 0.84.
Table 3 lists the lumped reflex gains resulting from a simulation run with all neural and sensory parameters at their nominal values. The simulation results are generally close to the experimental results (within one SD of the experiments by Schouten et al. 2008a), except for neural time delay τ del, which seems to be underestimated in the model simulation result.
Table 3.
Lumped reflex gain | Value | Unit |
---|---|---|
m | 0.178 | kg·m 2 |
b | 2.99 | Nm·s / rad |
k | 90.5 | Nm / rad |
k p | 19.2 | Nm / rad |
k v | 3.39 | Nm·s / rad |
k f | 0.384 | Nm / Nm |
τ del | 15.0 | ms |
τ act | 47.5 | ms |
As an example, Fig. 4 shows how lumped reflex gains were modulated by varying neural parameter d Ia; the velocity component of the muscle spindles. The sensitivity measure S ij is indicated in the figure. The example shows that when the velocity component d Ia in the output of the muscle spindle increases, velocity feedback gain k v increases as expected. Position and force feedback gains k p and k f both decrease, demonstrating that position feedback gain k p and force feedback gain k f also depend on velocity component d Ia of the muscle spindle. Performance increased with d Ia, indicated by the decreasing RMS value of the joint deviation: as the amount of velocity feedback from the muscle spindles increased, joint deviations decreased. In a position task, small deviations indicate good performance.
The sensitivity of the lumped reflex gains to variations in the neural and sensory parameters of the NMS model is illustrated in Fig. 5. For each of the parameters of the lumped reflex gain model and the RMS of the joint deviation, the eight neural and sensory parameters with the largest effect (per parameter) are shown. The height of the bars shows the magnitude of the sensitivity metric S ij, plus and minus signs above the bars indicate the sign of S ij.
The top row in Fig. 5 shows the sensitivity of the intrinsic parameters: inertia m, joint viscosity b and joint stiffness k. Sensitivity of the inertia estimate is low for all parameters (sensitivity in the order of 0.05) as can be expected, since mass was not varied. Joint viscosity b is mainly affected by tonic descending excitation. Increasing TDE to specifically the motoneurons or to all populations increased viscosity by increasing the tonic muscle activation. Further, viscosity was increased by various excitatory pathways to the motoneurons and decreased by inhibitory pathways via the inhibitory interneuron populations. Sensitivity of stiffness k is remarkably low (in the same order of magnitude as that of inertia m). Because of the linearized muscle model, one might expect similar sensitivity of stiffness and viscosity. The difference is due to the relatively high value of stiffness k in the nominal condition, decreasing the normalized sensitivity.
The middle row in Fig. 5 illustrates the sensitivity of reflex gains k p, k v and k f to the eight parameters that they were most sensitive to. Velocity feedback over the Ia afferent decreased k p. This is indicated by the negative sensitivity to muscle spindle constant d Ia, and also by the positive sensitivity to inhibitory pathways from Ia afferents to motoneurons. Group II afferent feedback increased k p as expected. Renshaw cell activation increases position feedback gain k p, both through the long latency constant synapse (w MN − RC(L)) and the synapse between the Renshaw cells and the IA interneuron (w RC − IA). Velocity reflex gain k v increases with the stretch velocity components in the Ia afferent pathway (d Ia, e Ia) and with increasing strength of the synapse between Ia afferent and motoneuron. TDE to either the motoneurons alone or to all populations decreases k v. Further, k v decreases with the stretch component of the Ia afferent, and the pathway over inhibitory interneurons. Activation by excitatory interneurons decreased k v, which might be caused by these interneurons receiving stretch feedback from the II afferent and no velocity feedback from the Ia afferent. Force feedback gain k f strongly decreased with TDE and Ia afferent feedback and increased with Golgi tendon organ (GTO) feedback over the Ib afferent pathway. The neural time delay of the Ib afferent increased k f as well.
The bottom row in Fig. 5 illustrates the sensitivities of neural time delay τ del, muscle activation time constant τ act and the RMS of joint deviation. Neural time delay estimate τ del was highly sensitive to the Ia afferent and efferent neural time delays as expected, and further to a mixture of neural and sensory parameters. The high sensitivity of the estimated muscle activation time constant τ act to a wide range of neural and sensory parameters is surprising (note that muscle activation was not varied in the simulations).
The bottom-right panel in Fig. 5 shows how the RMS of the joint deviations changed with the neural parameters. TDE had the strongest effect on performance, by increasing motoneuron activity and therewith co-contraction. Further, Ia afferent feedback (both synaptic strength and muscle spindle properties) improved performance while neural time delays decreased performance. Force feedback over Ib afferents and position feedback over II afferents only had a small effect on performance.
Figure 5 demonstrates that most lumped reflex gains were sensitive to a mixture of neural and sensory parameters. To elucidate the relation between the properties of the proprioceptors and the estimated reflex gains, Fig. 6 shows a subset of the data: the sensitivity of k p, k v and k f to only the sensory constants of the muscle spindle and GTO. The velocity components of the muscle spindle (constants d Ia and e Ia) positively correlated with velocity gain k v, with relatively low interaction with the other reflex gains. Position feedback gain k p and force feedback gain k f however did not show such a distinct sensitivity. There was positive sensitivity of k p to the stretch component of the muscle spindle c II, but k p decreased with velocity component d Ia as well. The GTO constant c Ib led to an increase of k f, but the spindle parameters a Ia, c Ia and d Ia have a far stronger negative (decreasing) effect on k f. Summarizing, Fig. 6 demonstrates that k v and k f are mostly influenced by muscle spindle feedback, while k p is influenced by a mixture of afferent feedback pathways.
Discussion
Multiple mechanisms contribute to posture maintenance. Perturbation experiments and system identification are widely used to assess posture maintenance in humans (e.g. Kearney et al. 1997; Perreault et al. 2000; Van der Helm et al. 2002; Ludvig and Kearney 2007). System identification and neuromuscular modeling pose a powerful tool for quantifying posture maintenance with a small set of control parameters. For instance, a position feedback gain expresses force buildup related to muscle stretch. However, many neural and sensory properties contribute to these feedback gains. When posture maintenance is captured in such a small set of reflex parameters, interaction could be expected. For instance, both decreasing presynaptic inhibition of the Ia afferent and increasing fusimotor drive can increase the velocity feedback gain, since the net amount of velocity related feedback in the control action to the muscle increases. These interactions complicate the interpretations of the results from reflex experiments. Neural and sensory mechanisms might affect multiple parameters of the lumped reflex model (see Figs. 5 and 6). Since direct in vivo measurements of neural and sensory properties are unfeasible during posture control experiments in humans, the goal of this study was to investigate how neural and sensory properties could map onto the (limited) set of reflex gains. Or, in the example of presynaptic inhibition and fusimotor drive, investigate how the net synaptic weights between afferents and motoneurons or the parameters of the muscle spindle model affect the lumped reflex gains.
We simulated posture control experiments with a neuromusculoskeletal model. In the NMS model, spinal cord circuitry controlled a joint, while receiving feedback from muscle spindles and Golgi tendon organs in the activated muscles. The joint was perturbed with a random force disturbance. Like in experiments, the posture control behavior of the simulated NMS model was captured by fitting the parameters of a lumped reflex gain model onto the simulated data. The high VAF of the reflex gain model fits onto the output of the NMS model indicated that the linear reflex gain model was able to adequately capture the behavior of the strongly nonlinear NMS model. This was greatly due to the conditions in the simulated experiment (and commonly used in in vivo experiments): during a posture control task (minimize deviations), there is a constant level of muscle co-contraction with small deviations around the equilibrium position of the joint. Therefore, the experimental conditions linearize the behavior of the non-linear neural system. A comparison to actual experimental data showed that the reflex gains fitted from the neuromuscular model closely resembled reflex gains identified in vivo.
The results showed a dominant role of tonic descending excitation (TDE) on the parameters of the lumped reflex gain model. TDE to the motoneurons (parameter w td − MN) increases tonic muscle activation (co-contraction) and therewith the muscle viscoelasticity, expressed in parameters b and k. Parameter w td − ALL simultaneously increased the amount of TDE to both motoneurons and all other populations receiving TDE. Besides viscoelasticity, also reflex gains k v and k f were influenced by these two TDE parameters; these reflex gains decreased with TDE. In the simulations of the NMS model, TDE increased activation of the receiving populations. As a result, the neural network received relatively less afferent input than tonic input, which could explain the decreasing reflex gains with TDE.
The results have shown that each of the lumped reflex gain parameters is positively sensitive to its most direct neural substrate: k v increases with parameters related to Ia afferent stretch velocity feedback pathway, k p with the II afferent stretch feedback pathway, and k f with Ib afferent force feedback pathway. For k v this most direct substrate was also the most dominant and interaction with other pathways was low. In contrast, k p and k f showed stronger sensitivities to other (and less directly related) neural and sensory mechanisms, which makes accurate identification difficult in the given experimental conditions. Both k p and k f decreased with velocity feedback over the Ia afferent pathway. Additionally, force feedback gain k f strongly decreased with TDE. This is in concordance with experimental findings: force feedback modulation in humans was strongest in an experimental condition with low co-contraction and low-frequent (slow) perturbations (Mugge et al. 2010). Position feedback gain k p was remarkably less sensitive to neural and sensory property changes than k v and k f. In the posture control task used in the experiments deviations were small, while high muscle stretch velocities resulted from the disturbance force. Therefore muscle length information played a lesser role during the posture control task than velocity feedback. These results suggest that to effectively identify k p experimentally, stretch velocities need to be kept small to minimize the interactions between velocity and position feedback.
Summarizing, the sensitivity analysis demonstrated dominance of muscle spindle velocity feedback and tonic descending excitation. Velocity feedback gain k v was distinctly influenced by afferent velocity feedback and TDE, while position and force feedback gains k p and k f depended on a wide variety of neural properties. The results of this modeling study contribute to determining experimental conditions suited for studying reflex modulation in vivo. From reflex experiments (de Vlugt et al. 2002; Schouten et al. 2001), we know that experimental conditions like level of co-contraction, perturbation velocities and amplitudes, but also task instruction induce reflex gain modulation. When the relationship between neural properties and reflex gains is better understood, experimental conditions can be adapted to the type of reflex modulation that is being studied. Furthermore, it is important to know if the experimentally estimated reflex gains are the result of the expected neural mechanism or may be a combination of interacting mechanisms. For example, one must be aware that modulation of k v can, besides Ia afferent feedback, be caused by tonic descending excitation to the motoneurons. It could therefore be important to control the level of co-contraction in such an experiment.
Like most models, the model presented here has many simplifications. Starting at the sensory level, a straightforward feline muscle spindle was chosen, together with a linear Golgi tendon organ model. Because of the modeled task (a position task with co-contraction and small, continuous perturbations with fixed frequency content) both sensors operate with small deviations around a relatively steady state. We argue that under these conditions, the simple models capture sufficient detail to describe the afferent feedback triggered by the perturbations, although we are aware of the intricate dynamics that muscle spindles and Golgi tendon organs can demonstrate (Mileusnic et al. 2006; Mileusnic and Loeb 2006). The sensory models used had their output in spikes per second and a Poisson process was used to convert output to spike trains. Halliday and Rosenberg (1999) presented a point-process spectral estimate on a human Ia afferent spike train, that closely matched the spectral properties of recorded spike trains, indicating that a point process could describe the Ia afferent dataset.
The spinal neural model was relatively straightforward. The spinal populations in the neural model were homogeneous, and connections between the individual neurons in the populations were assigned using a random process. The neuron model was a simple point neuron, without spatial representations like a dendrite structure. These are important simplifications, and more detailed models of the individual components of our neural model do exist. Nevertheless, this simplicity serves a purpose. The main goal was to determine how changes in velocity-, position- and force-related neural feedback map onto the limited set of reflex gains that are used in experiments. The main question was: which neural pathways could be contributing when changes in reflex gains are observed in an experiment? Unlike a lumped reflex gain model, where each feedback channel has a distinct pathway, biological afferent feedback fans out in the spinal populations before finally converging at the motoneurons. The multitude of pathways and their interactions are the cause of most lumped reflex gains being sensitive to multiple neural and sensory parameters. Each detail added to the neural model adds one or more parameters and thus might add a new relationship with one of the reflex gains. However, the main phenomenon that was demonstrated here can be captured with a relatively simple model that includes at least the afferent feedback pathways, fan-out and convergence in the spinal populations and output to a musculoskeletal model.
We conclude that with postural control tasks and wide-bandwidth force perturbations, parameters of the Ia afferent feedback pathway largely contribute to the task performance enabling accurate identification of k v. In these conditions of high stretch velocities, but low stretch and fairly constant muscle activation, parameters of the II and Ib afferent feedback pathways hardly contribute to task performance. Because of this low contribution to task performance, the amount of position and force related information in the measured joint deviations is low, resulting in poor identifiability of k p and k f. This is expressed by the high sensitivity to other, seemingly non-related feedback pathways. Identification of k p and k f probably needs an experimental design that decreases the effects of interaction from velocity feedback, like Mugge et al. (2010) suggests for k f.
Acknowledgement
This research was funded by Dutch Government Grant BSIK03016.
Open Access
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
Footnotes
The Mathworks, USA.
The model presented in this article is available on our department’s website: http://nmc.3me.tudelft.nl.
References
- Abbink, D. A., van der Helm, F. C. T., & Boer, E. R. (2004). Admittance measurements of the foot during ‘maintain position’ and ‘relax’ tasks on a gas pedal. In Systems, man and cybernetics, 2004 IEEE international conference on (Vol. 3, pp. 2519–2524).
- Bashor DP. A large-scale model of some spinal reflex circuits. Biological Cybernetics. 1998;78(2):147–157. doi: 10.1007/s004220050421. [DOI] [PubMed] [Google Scholar]
- Baudry S, Maerz AH, Enoka RM. Presynaptic modulation of ia afferents in young and old adults when performing force and position control. Journal of Neurophysiology. 2010;103(2):623–631. doi: 10.1152/jn.00839.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Crago PE, Houk JC, Rymer WZ. Sampling of total muscle force by tendon organs. Journal of Neurophysiology. 1982;47(6):1069–1083. doi: 10.1152/jn.1982.47.6.1069. [DOI] [PubMed] [Google Scholar]
- Crowe A, Matthews PB. The effects of stimulation of static and dynamic fusimotor fibres on the response to stretching of the primary endings of muscle spindles. Journal of Physiology. 1964;174:109–131. doi: 10.1113/jphysiol.1964.sp007476. [DOI] [PMC free article] [PubMed] [Google Scholar]
- de Vlugt E, Schouten AC, van der Helm FC. Adaptation of reflexive feedback during arm posture to different environments. Biological Cybernetics. 2002;87(1):10–26. doi: 10.1007/s00422-002-0311-8. [DOI] [PubMed] [Google Scholar]
- Dewald, J. P. A., & Schmit, B. D. (2003). Stretch reflex gain and threshold changes as a function of elbow stretch velocity in hemiparetic stroke. In Engineering in medicine and biology society, 2003. proceedings of the 25th annual international conference of the IEEE (Vol. 2, pp. 1464–1467).
- Doemges F, Rack PM. Task-dependent changes in the response of human wrist joints to mechanical disturbance. The Journal of Physiology. 1992;447(1):575–585. doi: 10.1113/jphysiol.1992.sp019019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Doemges F, Rack PM. Changes in the stretch reflex of the human first dorsal interosseous muscle during different tasks. The Journal of Physiology. 1992;447(1):563–573. doi: 10.1113/jphysiol.1992.sp019018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Frank PM. Introduction to system sensitivity theory. New York: Academic; 1978. [Google Scholar]
- Halliday, D. M., & Rosenberg, J. R. (1999). Time and frequency domain analysis of spike train and time series data. In U. Windhorst, & H. Johansson (Eds.), Modern techniques in neuroscience research (pp. 503–543). Springer.
- Kearney RE, Stein RB, Parameswaran L. Identification of intrinsic and reflex contributions to human ankle stiffness dynamics. IEEE Transactions on Biomedical Engineering. 1997;44(6):493–504. doi: 10.1109/10.581944. [DOI] [PubMed] [Google Scholar]
- Kurtzer IL, Pruszynski JA, Scott SH. Long-latency reflexes of the human arm reflect an internal model of limb dynamics. Current Biology. 2008;18(6):449–453. doi: 10.1016/j.cub.2008.02.053. [DOI] [PubMed] [Google Scholar]
- Ludvig D, Kearney RE. Real-time estimation of intrinsic and reflex stiffness. IEEE Transactions on Biomedical Engineering. 2007;54(10):1875–1884. doi: 10.1109/TBME.2007.894737. [DOI] [PubMed] [Google Scholar]
- MacGregor RJ, Oliver RM. A model for repetitive firing in neurons. Kybernetik. 1974;16(1):53–64. doi: 10.1007/BF00270295. [DOI] [PubMed] [Google Scholar]
- Mileusnic MP, Brown IE, Lan N, Loeb GE. Mathematical models of proprioceptors. I. Control and transduction in the muscle spindle. Journal of Neurophysiology. 2006;96(4):1772–1788. doi: 10.1152/jn.00868.2005. [DOI] [PubMed] [Google Scholar]
- Mileusnic MP, Loeb GE. Mathematical models of proprioceptors. II. Structure and function of the golgi tendon organ. Journal of Neurophysiology. 2006;96(4):1789–1802. doi: 10.1152/jn.00869.2005. [DOI] [PubMed] [Google Scholar]
- Mugge W, Abbink DA, Schouten AC, Dewald JP, van der Helm FC. A rigorous model of reflex function indicates that position and force feedback are flexibly tuned to position and force tasks. Experimental Brain Research. 2010;200(3–4):325–340. doi: 10.1007/s00221-009-1985-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nielsen JB, Petersen NT, Crone C, Sinkjaer T. Stretch reflex regulation in healthy subjects and patients with spasticity. Neuromodulation. 2005;8(1):49–57. doi: 10.1111/j.1094-7159.2005.05220.x. [DOI] [PubMed] [Google Scholar]
- Perreault EJ, Crago PE, Kirsch RF. Estimation of intrinsic and reflex contributions to muscle dynamics: A modeling study. IEEE Transactions on Biomedical Engineering. 2000;47(11):1413–1421. doi: 10.1109/TBME.2000.880092. [DOI] [PubMed] [Google Scholar]
- Pintelon R, Schoukens J. System identification; a frequency domain approach. New York, USA: IEEE Press; 2001. [Google Scholar]
- Prochazka A, Gorassini M. Models of ensemble firing of muscle spindle afferents recorded during normal locomotion in cats. Journal of Physiology. 1998;507(Pt 1):277–291. doi: 10.1111/j.1469-7793.1998.277bu.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ribot-Ciscar E, Hospod V, Roll JP, Aimonetti JM. Fusimotor drive may adjust muscle spindle feedback to task requirements in humans. Journal of Neurophysiology. 2009;101(2):633–640. doi: 10.1152/jn.91041.2008. [DOI] [PubMed] [Google Scholar]
- Rudomin P. In search of lost presynaptic inhibition. Experimental Brain Research. 2009;196(1):139–151. doi: 10.1007/s00221-009-1758-9. [DOI] [PubMed] [Google Scholar]
- Rudomin P, Schmidt RF. Presynaptic inhibition in the vertebrate spinal cord revisited. Experimental Brain Research. 1999;129(1):1–37. doi: 10.1007/s002210050933. [DOI] [PubMed] [Google Scholar]
- Schouten AC, de Vlugt E, van der Helm FC, Brouwn GG. Optimal posture control of a musculo-skeletal arm model. Biological Cybernetics. 2001;84(2):143–152. doi: 10.1007/s004220000202. [DOI] [PubMed] [Google Scholar]
- Schouten AC, de Vlugt E, van Hilten JJ, van der Helm FC. Quantifying proprioceptive reflexes during position control of the human arm. IEEE Transactions on Biomedical Engineering. 2008;55(1):311–321. doi: 10.1109/TBME.2007.899298. [DOI] [PubMed] [Google Scholar]
- Schouten AC, Mugge W, van der Helm FC. Nmclab, a model to assess the contributions of muscle visco-elasticity and afferent feedback to joint dynamics. Journal of Biomechanics. 2008;41(8):1659–1667. doi: 10.1016/j.jbiomech.2008.03.014. [DOI] [PubMed] [Google Scholar]
- Schuurmans J, de Vlugt E, Schouten AC, Meskers CG, de Groot JH, van der Helm FC. The monosynaptic ia afferent pathway can largely explain the stretch duration effect of the long latency m2 response. Experimental Brain Research. 2009;193(4):491–500. doi: 10.1007/s00221-008-1647-7. [DOI] [PubMed] [Google Scholar]
- Stienen AH, Schouten AC, Schuurmans J, van der Helm FC. Analysis of reflex modulation with a biologically realistic neural network. Journal of Computational Neuroscience. 2007;23(3):333–348. doi: 10.1007/s10827-007-0037-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van der Helm FC, Schouten AC, de Vlugt E, Brouwn GG. Identification of intrinsic and reflexive components of human arm dynamics during postural control. Journal of Neuroscience Methods. 2002;119(1):1–14. doi: 10.1016/S0165-0270(02)00147-4. [DOI] [PubMed] [Google Scholar]