Abstract
Quantitative measures of smoothness play an important role in the assessment of sensorimotor impairment and motor learning. Traditionally, movement smoothness has been computed mainly for discrete movements, in particular arm, reaching and circle drawing, using kinematic data. There are currently very few studies investigating smoothness of rhythmic movements, and there is no systematic way of analysing the smoothness of such movements. There is also very little work on the smoothness of other movement related variables such as force, impedance etc. In this context, this paper presents the first step towards a unified framework for the analysis of smoothness of arbitrary movements and using various data. It starts with a systematic definition of movement smoothness and the different factors that influence smoothness, followed by a review of existing methods for quantifying the smoothness of discrete movements. A method is then introduced to analyse the smoothness of rhythmic movements by generalising the techniques developed for discrete movements. We finally propose recommendations for analysing smoothness of any general sensorimotor behaviour.
Electronic supplementary material
The online version of this article (doi:10.1186/s12984-015-0090-9) contains supplementary material, which is available to authorized users.
Keywords: Smoothness, Sensorimotor assessment, Discrete movements, Rhythmic movements
Introduction
This work was developed as part of the project “State of the Art Robot-Supported assessments (STARS)” in the frame of the COST Action TD1006 “European Network on Robotics for NeuroRehabilitation” [1]. The goal of STARS is to give neurorehabilitation clinical practitioners and scientists recommendations for the development, implementation, and administration of different indices of robotic assessments, grounded on scientific evidence.
A movement is perceived to be smooth, when it happens in a continual fashion without any interruptions. Smooth movements are a characteristic feature of healthy and well-trained motor behaviour [2]. Movement smoothness increases with neural development [3], motor learning [4] and motor recovery after a stroke [5]. Movement smoothness has been identified as an important marker of motor recovery in patients with stroke [5, 6], which correlates with standard scales of motor impairments such as the Fugl-Meyer assessment [7]. Smooth movements are believed to be the result of effort minimisation [8, 9] – an important characteristic of motor learning [10]. Smoothness may also be related to other fundamental determinants of sensorimotor control such as spatio-temporal coordination.
Although smoothness can provide valuable information about sensorimotor control and be used for patient’s assessment during neurorehabilitation, there is little consensus on the best method to quantify smoothness. For instance, at least 8 different measures have been used in various studies [4], which makes it difficult to compare the results from these different studies. The choice of factors to assess sensorimotor control (such as smoothness) is generally based on some observed invariants of healthy/trained sensorimotor behaviour. For any such chosen factor, the conception of a measure for its evaluation is often guided by a model of healthy behaviour. In the case of movement smoothness, nearly all existing measures are motivated by the stereotypical smooth kinematics of discrete arm movements of healthy subjects, i.e. the single peaked bell-shaped speed profile (left trace of Additional file 1: Figure S1) of point-to-point reaching [11–13].
Movements that do not follow this kinematic pattern (e.g. point-to-point movements with several speed peaks shown in the right trace in Additional file 1: Figure S1) are perceived as being less smooth. The family of jerk measures [4, 14] are all based on the minimum jerk model [12], as minimal jerk trajectories correspond well to the reaching movements of healthy subjects. The correlation between a speed profile and the corresponding minimum jerk speed profile has also been used as a smoothness measure [15]. The number of peaks measure [16] relies on the fact that the speed profile of smooth movements are single peaked, while unsmooth movements have higher number of speed peaks. More recently, we have introduced the spectral arc length as a measure of smoothness [4], which relies on changes in the Fourier spectrum of movements to quantify smoothness.
On the other hand, it must be noted that the available smoothness measures have primarily focused on discrete arm movements, such as point-to-point reaching and circle drawing [17]. A few studies have also investigated the smoothness of the kinematics of other body segments, such as the head [18], jaw [19], elbow [20, 21], forearm rotation [22], wrist [23], lower-extremity [24–27] etc. Additionally, some studies have also investigated the smoothness of rhythmic movements [28], including walking [24–26, 29], back-and-forth elbow flexion/extension [21], and rhythmic object manipulation [30].
In the gait literature, the harmonic ratio has been used as a measure of smoothness [24–26, 29]. The harmonic ratio (HR) is defined as the ratio of the sum of the magnitudes of the even harmonics to that of the odd harmonics of the trunk acceleration over a single stride [29]. The smoothness of the entire gait data is analysed by segmenting the data into individual strides. HR exploits the inherent periodicity of gait and is primarily a measure of gait symmetry of the two legs [29]. Although symmetry may be an important component of how one would visually judge the overall smoothness of a person’s gait, it is a very different factor from that of smoothness. For instance, one may walk with perfectly symmetric but unsmooth (very intermittent) gait pattern. Therefore HR does not appear to be an appropriate measure of smoothness.
In the case of the upper-extremity, Nasseroleslami et al. [30] estimated the smoothness of kinematic and force data from a rhythmic object manipulation task. They converted their (almost periodic) rhythmic movements [28] into single averaged cycles, to which the spectral arc length measure [4] was applied. Ao et. al [21] used a similar approach for studying the smoothness of rhythmic elbow flexion/extension movements of stroke subjects. Here also, entire rhythmic movements were segmented into individual flexion and extension movements, to which the dimensionsless jerk measure was applied [4]. The common approach in these studies analysing rhythmic movements is to segment the long rhythmic movement into individual discrete segments to which existing measures are applied. However, currently there is no systematic investigation on the best method to analyse smoothness of the different types of rhythmic movements [28]. It is important to point out that Hogan and Sternard [28] proposed the use of mean squared jerk as a measure of smoothness of entire discrete and rhythmic movements. However, mean squared jerk is not a valid measure of smoothness [4], which was noticed by the same authors in a later paper [14].
In general, smoothness has only been discussed in the context of movement kinematics, with a few exceptions such as [30] which have looked at the smoothness of force profiles. Smoothness in the context of sensorimotor control is merely a measure of intermittency, which can be applied to contexts other than movement kinematics such as isometric force and torque. However, we are not aware of any other studies than [30] investigating the smoothness of force/torque profiles of isometric tasks, or the impedance profiles of impedance modulation tasks.
The present paper yields a first step towards a general approach for analysing movement smoothness, with the goal to enable a systematic analysis of any movement type. The paper first provides a definition of movement smoothness, and the factors that affect a movement’s smoothness. Following this, a brief review of the relevant smoothness measures in the current literature is provided, along with a modified version of the spectral arc length from [4] to address the original measure’s sensitivity to temporal scaling of movement data. This is followed by the presentation of a general approach to estimating movement smoothness, which can be used to analyse any movement type. Finally, the paper presents a set of recommendations for the analysis of smoothness, which we hope will help in the standardisation of this type of movement analysis.
What is movement smoothness?
Movement smoothness is a quality related to the continuality or non-intermittency of a movement, independent of its amplitude and duration. Intermittency in this context refers to movements that alternately decelerate and accelerate, and more intermittency corresponds to un-smooth movements. Movement intermittency is typically observed as dips in a movement’s speed profile or finite non-zero periods of zero speed (i.e. movement arrest) during an ongoing movement. A dip in a speed profile is a point where the second derivative of position goes to zero, and it highlights a period of deceleration followed by acceleration, which is a mark of movement intermittency. On the other hand, a movement arrest period represents an extreme form of intermittency where all derivatives of position go to zero for a finite non-zero duration. The longer the arrest period, the more intermittent the behaviour. It must be noted that this does not mean that a constant state of rest represents an extreme form of intermittency. Movement arrest periods are “unwanted” periods of rest occurring in the context of an ongoing change or movement, and thus are major contributors to movement intermittency.
Movement intermittency can be observed in upper-extremity movements of infants below 6 months [3], in slow movements [20, 31], movements requiring accuracy [32], and in patients with neurological conditions such as stroke [5], multiple sclerosis [33], Parkinson’s disease [34, 35] etc. Reaching arm movements of healthy adult subjects have almost straight line trajectories with bell-shaped speed profiles [11]. However, the same task performed by stroke subjects can be highly intermittent, with the hand accelerating and decelerating several times on its way to the target [5] as shown in the simulated example of Additional file 1: Figure S1.
An important point to note here is that intermittencies can occur in a movement due to two distinct set of factors:
Control level/ability of a performer on a specific task: The current and most important use of smoothness in movement analysis is its use to infer the control ability of a subject. This factor leads to intermittencies caused by poor motor planning/execution due to neurological impairments, lack of familiarity with the task or the environment, and/or injury to the musculoskeletal system. For instance a healthy subject’s movements in a novel task or novel dynamic environment can be intermittent due to poor task/environment familiarity. Intermittent movements of stroke patients are often the result of poor motor control caused by the neurological injury. In patients with stroke, the control ability of a subject would have a direct relationship to the level of injury to the neural tissue. The lack of smoothness in stroke affected movements result from poor temporal blending of submovements [36]. However, the neurophysiological basis of this remains unclear. The segmentation of movements could be a consequence of the disruption of upper-limb coordination, interruptions due to the triggering of spasticity, pathological movement synergies or directly to an impairment of the temporal organisation of the movement. Changes in the cortico-spinal tract excitability following stroke [37] could also be one of the contributors to the observed impairment of movement behaviour. Although the direct relationship between cortico-spinal tract excitability and smoothness is not clear, smoothness could serve as a simple global measure of the cortico-spinal tract integrity.
Nature of the task or task constraints: The nature of a task can lead to intermittencies that are not the result of poor control but are necessitated by its constraints or requirements. For instance, point-to-point reaching movements through a via point performed by healthy subjects can exhibit sharp dips in the speed profile [12]. Task constraints determine the minimum amount of intermittency (or the maximum smoothness) in a movement. Therefore smoothness is strongly task-dependent, and one cannot simply compare the smoothness of two completely different tasks, e.g. point-to-point reaching versus circle drawing. This task-dependence must be considered when analysing and comparing smoothness of any general task type such as discrete and rhythmic tasks. Note that this is never explicitly discussed in the current literature as existing studies usually focus on the analysis of a single type of task.
Given these two distinct factors that can contribute to movement intermittency, smoothness could be used as a criterion for differentiating between (a) control abilities of different subjects when the task is controlled; and (b) different types of tasks when skill is controlled. The former type of analysis is what one typically encounters in motor learning and neurorehabilitation literature. The latter analysis was discussed by Hogan and Sternard in [28] where they propose mean squared jerk as a criterion for differentiating between discrete and rhythmic movements. However, this can be done only if the two movements were performed by the same subject or by two subjects that are equally skilled.
What is a good smoothness measure?
A smoothness measureλs is a function
(1) |
that characterises a movement’s smoothness, where Mm represents some measured information about the given movement, e.g. kinematics; and T represents the task, e.g. point-to-point reaching, target tracking, or some spatio-temporal constraints. The task-dependence of smoothness is indicated by T in Eq. 1.
A good estimate of movement smoothness requires a measure that is valid, sensitive, reliable and practical. Validity is the most important property, which refers to whether or not a given measure estimates the factor it is intended to measure [38]. Sensitivity and reliability deal with how well a given measure is able to quantify a movement related factor. Sensitivity is essential for a measure to resolve real but small differences in a factor. A measure must have good sensitivity, particularly in the physiological range that covers the entire spectrum of healthy and un-healthy movements. Reliability is directly related to the robustness of the measure to measurement noise1, i.e. the amount of variability introduced in the measure by a given level of measurement noise. Practicality refers to issues related to the practical implementation of the measure, which needs to consider factors such as computational complexity of the measure (e.g. how does the computational time increase with increase in data size).
For movement smoothness, a valid measure must be independent of the movement amplitude and duration, i.e. dimensionless. Smoothness is measured through the amount of movement intermittency, which is directly related to the movement’s temporal organization or coordination. Thus, a valid smoothness measure must change monotonically to changes in movement intermittency. For example, if a given movement can be thought of as a superposition of discrete submovements, then an increase in the number of submovements or the interval between two successive submovements must result in decreased movement smoothness. This can be understood from Additional file 1: Figure S1, where the healthy movement has one submovement while the stroke affected movement has three submovements with a finite temporal gap between two successive submovements. A simulated scenario was used to investigate the validity of different existing smooth measures in [4], where simulated movements were generated by systematically varying the number of submovements and the inter-submovement interval.
Smoothness measures - status quo
The current neurorehabilitation and motor control literature reports several different measures for estimating smoothness of a given discrete movement [4, 14–16, 36, 39, 40]; these are are listed in Table 1 along with the details of their different properties. The most common measures are the jerk-based measures [14], most of which are not valid measures of smoothness. The dimensionless jerk (DLJ) and the log dimensionless jerk (LDLJ), defined below, are the only valid jerk-based measures of movement smoothness [4]:
(2) |
Table 1.
Measure | Validity | Sensitivity | Reliability | Practicality | ||
---|---|---|---|---|---|---|
D | M1 | M2 | Measurement noise | |||
Root mean square jerk | × | - | - | - | - | ✓ |
Normalized mean absolute jerk | × | - | - | - | - | ✓ |
Dimensionless jerk | ✓ | ✓ | ✓ | × | × | ✓ |
Log dimensionless jerk | ✓ | ✓ | ✓ | ✓ | × | ✓ |
No. of peaks | ✓ | ✓ | ✓ | × | × | ✓ |
Speed arc length | ✓ | ✓ | ✓ | ✓ | × | ✓ |
Spectral arc length | ||||||
(SAL introduced in [4]) | × | ✓ | ✓ | ✓ | ✓ | ✓ |
Spectral arc length | ||||||
(SPARC introduced in this paper) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
D - Dimensionless; M1 - Monotonic response to changes in submovement interval; M2 - Monotonic response to changes in number of sub-movements. (× means the measure does not satisfy this property, indicates that it does satisfy the property. − indicates that information about this property is not available)
where v(t) is the movement speed, t is time, t1,t2 are the start and end times of the movement, and is the peak speed. DLJ lacks sensitivity in the physiological range [4], which the LDLJ addresses through the natural log function. However, both DLJ and LDLJ are very sensitive to measurement noise and have poor reliability [4].
The other most commonly used smoothness measure is the number of peaks (NP) measure that counts the number of maxima in a given speed profile v(t):
(3) |
where represents the cardinality of a set. NP is a simple measure, but lacks sensitivity and robustness [4].
The spectral arc length measure (SAL) introduced in [4] uses a novel approach to estimate smoothness. It estimates smoothness by calculating the arc length of the Fourier magnitude spectrum within the frequency range 0 to 20 Hz of a given speed profile v(t):
(4) |
where V(ω) is the Fourier magnitude spectrum v(t), is the normalized magnitude spectrum, normalized with respect to the DC magnitude V(0), and ωc is fixed to be 40π (corresponding to 20 Hz).
In this paper, we introduce a slightly modified version of the original SAL, which we call SPARC for SPectral ARC length, by setting
(5) |
The SPARC extends SAL in that ωc is adaptively selected based on a given threshold and is upper-bound by . In contrast to SAL, SPARC is independent of temporal movement scaling, and retains the good sensitivity and reliability of the SAL. A detailed explanation of the SPARC measure and the rationale for its development is given in Appendix A of the Additional file 2. The entire analysis presented in the paper was carried out using iPython [41]. The entire analysis can be found online at https://github.com/siva82kb/SPARC.
A general measure of smoothness - looking beyond discrete movements
A general measure of movement smoothness is one that can be applied to any movement type, e.g. discrete or rhythmic; and on any movement-related data, e.g. kinematics, forces, impedance etc. Let us consider a general measure of movement smoothness λs where T in Eq. (1) is any type of sensorimotor task. Let x(t) represent the measured information associated with a motor action Mm that is generated in response to the given task T:
where x(t) is the measured movement related variable, xi(t) is the ith component of x(t), and t represents time. The information contained in x(t) can be movement kinematics, force or even mechanical impedance, in either task or joint space, depending on the task and the sensing modality used for measuring the motor behaviour. For example, movement kinematics could be simple spatial or joint space location measured through a motion tracking system, or linear accelerations and angular rates measured using an inertial measurement unit. In the case of isometric tasks, it would contain force or torque in the task or joint space.
How does one analyse the smoothness of any type of task? The simplest method would be to apply an existing smoothness measure on x(t) independent of the task type. However, this approach does not work, as we demonstrate through a simple example involving a rhythmic movement. Let us consider a simulated experiment where three subjects (two experts and one novice) were instructed to move back-and-forth 10 times between two spatial targets P and Q. The subjects were asked to move at a comfortable self-selected speed, and rest at the targets for a short duration. The movements Ma, Mb and Mc made by the three subjects are shown in Additional file 3: Figure S2. The smoothness estimates obtained by simply applying the SPARC and LDLJ measures to the entire movement data are also shown in these plots in Additional file 3: Figure S2.
By visual inspection of the position data in Additional file 3: Figure S2, one immediately concludes that the movement Mb is less smooth than Ma and Mc, as Mb is more intermittent during some individual movements between P and Q. The smoothness estimates shown in Additional file 3: Figure S2 agree with this conclusion, as Mb is less smooth than Ma and Mc using both SPARC and LDLJ. The movement time (MT) and dwell-time (DT) of Ma and Mb are exactly the same. Thus, differences between their smoothness estimates is due to differences in intermittency of the individual movement components (movements between P and Q) of Ma and Mb.
Now, by applying the same logic, can we say anything about the smoothness of Ma and Mc? Is one smoother than the other, or are they both equally smooth? Using the same argument as before, we would conclude that Ma and Mc are equally smooth, because in both Ma and Mc, the movements between the targets P and Q appear similar (except in Mc the movements are a little faster, the dwell-time is shorter). The results in Additional file 3: Figure S2, however, do not agree with our intuition in this case; smoothness of Ma and Mc are close but not equal. This difference is due to the sensitivity of SPARC and LDLJ to the temporal organisation of the individual movement components in the entire rhythmic movement (i.e. the relative values of MT and DT). When the SPARC and LDLJ are applied on an entire rhythmic movement, it is seen as one long discrete movement, with the temporal organisation of the individual movement components appearing as intermittencies, which affects the overall smoothness. This implies that changes in the number of components will also result in a change of the smoothness estimate. For example, consider another movement Md (plot not shown) which has the same MT and DT as Ma but has 20 back and forth movements between P and Q instead of 10 in Ma. Here, the smoothness of Ma is higher than that of Md (value shown in the bottom plot in Additional file 3: Figure S2), when in fact the smoothness of Md is no different from that of Ma and Mc. Therefore, the conclusion is that the smoothness measures cannot be used on an entire rhythmic movement to estimate smoothness.
In light of the foregoing discussion, our intuitive judgement of a rhythmic movement’s smoothness appears to be based on the smoothness of the distinct individual components in the movement. It also appears to be independent of the number of such components and their temporal organisation in the overall rhythmic movement. Additionally, we have illustrated how using SPARC or LDLJ to evaluate smoothness on the entire movement does not match this intuitive judgement. Thus, generalising from the above discussion, we can define smoothness of a rhythmic movement as a function of the smoothness of its individual, distinct (non-overlapping) movement components. This way of defining the smoothness of a rhythmic movement agrees with our intuition that the properties of the parts (i.e. the distinct components) must influence the properties of the whole (i.e. the entire rhythmic movement). This implies that existing measures can be used to evaluate smoothness of the individual movement components, and also the overall smoothness of the movement.
Consider a movement represented by x(t), , where ts and te are the start and end times of the movement, respectively. This movement x(t) can be represented as a concatenation of a set of individual distinct (non-overlapping) movement components2xi(t):
(6) |
where the ith distinct movement component xi(t) is the product of the x(t) and the rectangular window Πi(t); N is the number of distinct components in x(t), and ti is the starting time of the ith movement component, where t1=ts and tN+1=te, and . We note that the representation in Eq. (6) is not unique, and one can choose the value of N and the tis arbitrarily. For movements Ma and Mb in Additional file 3: Figure S2, one possible representation in terms of Eq. (6) would consist of N=20 and . This particular choice of values for N and ti for Ma and Mb would segment out the individual discrete movements between the targets P and Q, along with postures at one of the targets. One can come up with a similar model for Mc with the parameters N=20 and . The representation in Eq. (6) is a form of windowing procedure to segment the long movement into meaningful components for which the smoothness can be estimated individually; we call this the event-based segmentation procedure. With this procedure one can estimate the overall smoothness of a given movement by first estimating the smoothness of its individual components, and then combining the individual estimates to obtain a single number representing the “overall” smoothness Λ of the movement x(t):
(7) |
where f(·) is a mathematical function that combines the smoothness estimates of the individual movement components in x(t), λi is the smoothness estimate of the ith movement component obtained using the selected measure e.g. SPARC. The choice of function for f(·) is crucial, and this must be a function that ensures that the overall smoothness Λ satisfies some of the following properties:
If all the segmented components of a movement correspond to the same type of task (e.g. point-to-point reaching like in Additional file 3: Figure S2) and have the same smoothness , then the smoothness of the overall movement must be equal to λ.
f(·) must be independent of the ordering of the individual movement components, i.e. permuting the values of the λis must not affect the overall smoothness Λ.
-
The overall smoothness value Λ of a movement must be no greater than the smoothness of the most smooth component, and no less than that of the least smooth component, i.e.
Note that property 1 is implied by this property.
Based on these properties, a good function for estimating the overall smoothness of a given movement from its components is the weighted average function:
(8) |
where wi≥0 is the weight given to the smoothness of the ith movement component λi, and the denominator in Eq. 8 is a normalising factor ensuring that property 3 is satisfied.
A nice feature of the weighted average scheme is that it can be used to summarise the smoothness of an entire movement or just specific parts of a movement. For example, consider the movement Ma in Additional file 3: Figure S2. Let us decompose this movement using Eq. (6) with parameters N=20, and ti=1.25(i−1). Now, to estimate the overall movement smoothness one could choose . But if we only wanted the overall estimate of all movements from P to Q in Ma (i.e. excluding movement from Q to P), then one could choose wi=1 when i is odd and 0 otherwise. Moreover, the event-based segmentation scheme for smoothness estimation of movements also allows one to track the smoothness over the course of movement, on an event-by-event basis.
An important point to note about the general smoothness measure of Eqs. (6) and (8) is that the results of smoothness analysis strongly depend on the movement segmentation step, the details of which are controlled by the parameters N and ti in Eq. (6). Although, technically they could be chosen arbitrarily, one must ensure that the choice of parametersN andti yields meaningful segmentation of the movement data. That is, the movement components should be clearly identified as specific events in the overall movement, or they could be specific events of interest for the purpose of an analysis. In any analysis, one must first choose the events of interest, which will guide the choice of segmentation parameters and the subsequent smoothness estimation. For example, a meaningful segmentation for movements in Additional file 3: Figure S2 would be to segment out individual movements between P and Q. In general, the segmentation step can be guided by metadata obtained from, (a) knowledge about the task that was being performed (e.g. task type, target locations, via-points, movement reversals etc.); (b) annotations3 of the movement data recorded during data collection; and (c) also from the actual movement data4.
Some form of movement segmentation appears to be the most preferred method, in the current literature, for analysing smoothness of rhythmic movements. Nasseroleslami et al. [30] had segmented (almost periodic) rhythmic movements into individual cycles, which were averaged before estimating the smoothness of averaged cycles. Even though here the approach was similar to the proposed general smoothness measure, the smoothness estimation process was different from that of Eq. (8). On the other hand, Ao et al. [21] and the gait studies [24, 25, 27, 29] can be seen as instances of the general approach described in this section. Ao et al. segmented (almost periodic) rhythmic movements based on the desired trajectory that was displayed to their subjects to follow [21]. While, the gait studies analysing smoothness using the HR, segmented data based on heel strikes detected from foot switch data collected during gait [25, 29]. However, these studies did not evaluate an “overall” estimate of the entire movement, unlike the proposed general measure.
How to measure smoothness?
Systems for measurement
The systems for measurement depend on the tasks and movement variables of interest. Most existing studies have been on discrete movements, using robotic devices [6, 23, 36], motion capture systems [21] or inertial measurement units [42] for measuring kinematics. Table 2 provides a non-exhaustive list of possible sensing systems that can be used. Notwithstanding the modality, sensors for measuring motor actions should not introduce excessive measurement noise. Noise will distort the smoothness estimate, with lower signal-to-noise ratio (SNR) resulting in more distortion. With the LDLJ, even signals with SNR = 100 can severely distort smoothness estimates, while the SPARC appears to be relatively immune up to SNR = 10, and possibly even lower. Please refer to reliability analysis in Appendix B in the Additional file 2 for more details.
Table 2.
Task | Variables of interest | Measurement system |
---|---|---|
Movement task | Position | Robotic devices or camera-based motion capture system to measure position in either task space or joint space. Wearable potentiometers for measuring joint position. |
Acceleration, angular rate | Inertial measurement units. | |
Isometric task | Force/Torque | Robotic devices for both task space and joint space measurements. Multi-axis load cells for measuring force and torque in different directions. |
Movement or isometric task | Impedance | Robotic devices for measuring task or joint space impedance through appropriate perturbation methods. EMG recording of opposing muscle pairs to measure joint stiffness. |
Protocols for assessment
Sensorimotor assessments provide a clinician/therapist an idea about a subject’s overall sensorimotor capability, providing a quantitative basis for tracking a subject’s recovery with time and therapy. Ideally, tasks performed in an assessment should be good global indicators of sensorimotor ability, i.e. performance on these tasks generalizes to a wide range of real-world activities. Movement smoothness is an important marker of recovery [4, 7]. Planar point-to-point reaching [36], and circle drawing [17] tasks have been the most popular choices for assessing movement smoothness in stroke. Improvements in smoothness made in tasks trained during therapy also generalize to movements not explicitly trained as part of therapy [17], indicating that smoothness can provide a general measure of overall control ability. Thus, when designing an assessment protocol one need only use a small set of tasks to assess smoothness. Based on the current literature, point-to-point reaching movements are good candidates for assessing movement smoothness of the upper-extremity. No such suggestions can be made for the lower-extremity given the dearth of information regarding the smoothness of lower-extremity movements.
What smoothness level is normal?
Sensorimotor neurorehabilitation aims at improving movement capability, ideally, targeting a level of performance before the injury. Thus, any sensorimotor assessment requires the range of scores expected from a healthy individual undergoing the assessment. For standard clinical scales, the normative range is defined as part of the scale. Similarly, sensor-based quantitative assessments must define the corresponding normative ranges for the different tasks and measures used in the assessment. For movement smoothness, the normative scores depend on the task being performed. Point-to-point reaching tasks are the only well-studied tasks in the literature, which would have scores around –1.6 for the SPARC and around –6 for the LDLJ [4]. More studies are required to obtain estimates of the normative ranges for the different tasks.
Recommendations for measurement
As a final step in the discussion of movement smoothness analysis, we would like to list recommendations for researchers and clinicians interested in analysing movement smoothness.
Smoothness is task-dependent
The task-dependence of smoothness is an important point to take into consideration. As discussed in an earlier section, movement smoothness is equally affected by both changes in a subject’s control ability and the task constraints. Thus, smoothness analysis to assess a subject’s control ability must account for the task variable to remove its confounding effect. This applies to the smoothness analysis of any movement type, and one must exercise caution particularly in the case of rhythmic movements, where an artificial movement segmentation step is introduced. In the case of discrete movements, one can only compare tasks of similar nature. This obviously leads to a question about the similarity of tasks. Tasks are usually described in qualitative terms, e.g. point-to-point reaching, reaching through a via-point etc. In quantitative terms, tasks could be described as spatiotemporal constraints, which a motor behaviour needs to conform to, in order to achieve a goal. In the context of smoothness, tasks can be considered similar if they can be achieved with the same level of intermittency. For example, all simple point-to-point reaching tasks are similar in nature as they exhibit bell-shaped speed profiles. By the same argument a simple point-to-point reaching task cannot be compared to that of task with a via point, because a via point requires a more intermittent movement than the one without a via point. Similarly, point-to-point tasks with varying number of via points are not similar.
Likewise, in the case of rhythmic movements, comparisons can be made only between rhythmic movements where the underlying tasks are similar. For rhythmic movements in Additional file 3: Figure S2, the individual movements between the targets P and Q, and the overall movement smoothness (estimated using Eqs. 6 and 8) can be compared to each other, but these movements cannot be compared to other rhythmic movements like repetitive figure drawing or walking, where the task constraints are quite different to those in Additional file 3: Figure S2.
Avoid estimating smoothness of unconstrained movements
Given the strong task-dependence of smoothness, one cannot meaningfully interpret the smoothness of unconstrained movements – movements that are not goal-directed, and are completely exploratory in nature. In such cases, without the knowledge of what was attempted one cannot know whether the observed movement intermittency is planned or unplanned. Thus, nothing can be said about the relative contributions of the task and the subject’s skill to the overall smoothness of these movements.
All measurements are not the same
Our objective in this paper was to formulate a general measure of movement smoothness that can be applied to any movement type, using any movement variable (e.g. kinematics, kinetics, impedance etc.). The generalisation of the smoothness measure to any movement type was presented in an earlier section. However, so far we have not explicitly talked about the different types of movement variables or movement-related data.
Analysis of smoothness is most likely to be used with movement kinematic data either in the task or the joint space. However, it is possible to investigate smoothness of any sensorimotor behaviour using e.g. measurements of force, torque or even impedance associated with the behaviour. Most of the current literature on smoothness analysis has been on movement kinematics, where derivatives of position (e.g. speed, jerk etc.) are used to estimate smoothness. The derivative operation is used for two reasons:
smoothness is relevant only in the context of a change. It does not make sense to talk about the smoothness of a fixed posture. A derivative will help get rid of any movement component that does not change over time.
derivatives of position highlight movement intermittencies.
It is not immediately clear how one would use either the SPARC or LDLJ, if the measured variable was either acceleration, angular rate, force or impedance. Given that these variables are of different nature, it is important to treat each of them appropriately to estimate smoothness using these variables. Table 3 provides some suggestions for processing the different movement related variables before estimating smoothness. It must be noted that many of these suggestions are not based on any experimental work, and must be verified for their appropriateness in future studies involving these variables.
Table 3.
Measured movement variable x (t) | Proposed processing for SPARC and LDLJ | Rationale | |
---|---|---|---|
Movement kinematics - position (in either task or joint space) through motion capture system or other position sensors | SPARC: | Use speed, | Speed highlights intermittencies, and does not amplify noise as much as the other higher order derivatives. |
LDLJ: | Use jerk magnitude, | This is by definition. | |
Movement kinematics - acceleration measured by an accelerometer | SPARC: | Use gravity subtracted absolute magnitude of acceleration, | Accelerometers also pick up gravity, and this must be removed to apply the SPARC, otherwise this would lead to a large DC component in the spectrum, which will dominate the other spectral components. This proposed method is based on our unpublished prior work on estimating smoothness from accelerometers. It must be noted that here the SPARC is used on signals from the acceleration space, and not the velocity space, as was done with position information. |
LDLJ: | Use magnitude of jerk, | This is by definition. Simply derive the jerk from the accelerometer data. | |
Force, Torque or impedance | SPARC: | Use the magnitude of first derivative of force/toque, | The proposed method for SPARC and LDLJ are based on the treating these variables like position variables. This suggestion is purely based on intuition, and must be verified through future experiments. |
LDLJ: | Use the magnitude of third derivative of force/torque, |
More noise results in less smoothness for any movement
In general, smoothness measures make use of a derivative operation to quantify the amount of intermittency in a movement; this is the primary reason for their sensitivity to noise. To minimise the effect of noise one should use a reliable smoothness measure more robust to measurement noise. The SPARC measure is more robust to measurement noise than the LDLJ for different signal-to-noise ratios (SNR). Figure S4 and Figure S5 in the Additional file 2 demonstrate this, and the details of the analysis are provided in Appendix B in the Additional file 2. If any post-processing is carried out to suppress high frequency noise (such as using a lowpass filter), one must ensure that the entire data used in the analysis are put through the same noise reduction process. For example, the same movement when filtered differently can result in different smoothness estimates.
Same noise results in less smoothness for slow movements
Smoothness measures are affected by noise, and changes in SNR in movement data can affect smoothness estimates differently (Figure S4 and Figure S5 in Additional file 2); the bias and variability in a smoothness estimate increases with decrease in SNR. The SNR of a given movement data is determined by the amount of signal power and the amount of noise power. In any given movement recording set-up, the measurement noise can be assumed to have a constant power. Under such a condition, slower movements would have a lower SNR than faster movements, which could mean that the smoothness of slower movements might be underestimated compared to that of the faster movements, even when both the (uncorrupted) movements’ speed profiles have the same shape, except for the scaling of the amplitude and duration. This was found to be the case using simulated data (Figure S6 of the Additional file 2. Details of this analysis are provided in Appendix C of the Additional file 2). Figure S6 in the Additional file 2 shows that the SPARC measure is less sensitive to changes in SNR than the LDLJ. This is another important aspect to be aware of when analysing smoothness of movements with very different speeds. Thus, one must always use a reliable measure such as SPARC for estimating smoothness.
Use SPARC over LDLJ
The SPARC has a better reliability than the LDLJ in the face of ubiquitous measurement noise present in all data. The LDLJ is highly sensitive to noise, and even lowpass filtering does not fully address this problem (refer to Appendix B in the Additional file 2). In light of these serious problems with the LDLJ, we recommend the use of SPARC over LDLJ.
Endnotes
1 Measurement noise is the cumulative effect of noise in the measurement system (sensors and instrumentation), changes in assessment protocol, and also other unknown or unaccounted sources.
2 Note that such a model is used purely for the purpose of smoothness analysis, and it does not make any assumptions about the organising principles governing the observed movement.
3 Annotation could be movement metadata recorded during the data collection process. For example, in motor control experiments the computer program recording movement data and presenting audio-visual feedback during the experiment, would need to make decisions on when a subject has reached a target, or when he/she has stopped moving etc. This sort of information could be later used to segment the data for analysis.
4 Let us consider the example of a figure drawing task where a subject was asked to draw a large symbol of infinity on a planar surface using his/her arm, repeatedly N times. Here, the subject could have started from any point on the infinity symbol and drawn the shape repeatedly. This is an example of an almost periodic movement [28]. To segment this data into individual cycles representing a complete drawing of the symbol, one could define the points of segmentation as the times where the actual movement states (e.g. position, velocity, acceleration etc.) almost repeat themselves. In this case the segmentation is entirely based on the actual movement data.
Acknowledgements
This work was funded in part by the COST Action TD1006 “European Network on Robotics for NeuroRehabilitation” [1], by the European projects CONTEST (FP7-PEOPLE-ITN-317488) and COGIMON (ICT-644727) and the UKIERI project (UKUTP201100135).
We would also like to thank Dr Sadhana Yadav, Mr Harish Kumar, and Mr Aravind Nehru for proof reading the manuscript.
Additional files
Footnotes
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
SB and AMC discussed the conception of the SPARC measure, and together with EB the analysis of rhythmic movements. ARB’s work with stroke patients led to identifying the issue of sensitivity to noise. SB carried out the analysis and wrote the manuscript and all the authors edited it and approved its content.
References
- 1.Keller T. COST Action TD1006. 2011. http://www.rehabilitationrobotics.eu/.
- 2.Sejnowski TJ. Neurobiology: making smooth moves. Nature. 1998;394(6695):725–726. doi: 10.1038/29406. [DOI] [PubMed] [Google Scholar]
- 3.Berthier NE, Keen R. Development of reaching in infancy. Exp Brain Res. 2006;169(4):507–18. doi: 10.1007/s00221-005-0169-9. [DOI] [PubMed] [Google Scholar]
- 4.Balasubramanian S, Melendez-Calderon A, Burdet E. A Robust and Sensitive Metric for Quantifying Movement Smoothness. IEEE Trans Biomed Eng. 2012;59(8):2126–136. doi: 10.1109/TBME.2011.2179545. [DOI] [PubMed] [Google Scholar]
- 5.Krebs HI, Hogan N, Aisen ML, Volpe BT. Robot-aided neurorehabilitation. IEEE Trans Rehabil Eng. 1998;6(1):75–87. doi: 10.1109/86.662623. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Bosecker C, Dipietro L, Volpe B, Krebs HI, Volpe L, Krebs HI, et al. Kinematic robot-based evaluation scales and clinical counterparts to measure upper limb motor performance in patients with chronic stroke. Neurorehabil Neural Repair. 2010;24(1):62–9. doi: 10.1177/1545968309343214. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Balasubramanian S, Colombo R, Sterpi I, Sanguineti V, Burdet E. Robotic Assessment of Upper Limb Motor Function After Stroke. Am J Phys Med Rehabil. 2012;91:255–69. doi: 10.1097/PHM.0b013e31826bcdc1. [DOI] [PubMed] [Google Scholar]
- 8.Harris CM, Wolpert DM. No Title. Nature. 1998;394(6695):780–4. doi: 10.1038/29528. [DOI] [PubMed] [Google Scholar]
- 9.Burdet E, Franklin DW, Milner TE. Human Robotics - Neuromechanics and Motor Control: MIT Press; 2013.
- 10.Franklin DW, Burdet E, Tee KP, Osu R, Chew CM, Milner TE, et al. CNS learns stable, accurate, and efficient movements using a simple algorithm. J Neurosci. 2008;28(44):11165–73. doi: 10.1523/JNEUROSCI.3099-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Morasso P. Spatial control of arm movements. Exp Brain Res. 1981;42(2):223–7. doi: 10.1007/BF00236911. [DOI] [PubMed] [Google Scholar]
- 12.Flash T, Hogan N. The coordination of arm movements: an experimentally confirmed mathematical model. J Neurosci. 1985;5(7):1688–703. doi: 10.1523/JNEUROSCI.05-07-01688.1985. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Vaisman L, Dipietro L, Krebs HI. A comparative analysis of speed profile models for wrist pointing movements. IEEE Trans Neural Syst Rehabil Eng. 2013;21(5):756–66. doi: 10.1109/TNSRE.2012.2231943. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Hogan N, Sternad D. Sensitivity of smoothness measures to movement duration, amplitude, and arrests. J Mot Behav. 2009;41(6):529–34. doi: 10.3200/35-09-004-RC. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Daly JJ, Hogan N, Perepezko EM, Krebs HI, Rogers JM, Goyal KS, et al. Response to upper-limb robotics and functional neuromuscular. J Rehabil Res Dev. 2005;42(6):723. doi: 10.1682/JRRD.2005.02.0048. [DOI] [PubMed] [Google Scholar]
- 16.Teo CL, Burdet E, Lim HP. A robotic teacher of Chinese handwriting. In: Proc. 10th Symp. Haptic Interfaces Virtual Environ. Teleoperator Syst. HAPTICS 2002. IEEE: 2002. p. 335–341.
- 17.Dipietro L, Krebs HI, Fasoli SE, Volpe BT, Hogan N. Submovement changes characterize generalization of motor recovery after stroke. Cortex. 2009;45(3):318–24. doi: 10.1016/j.cortex.2008.02.008. [DOI] [PubMed] [Google Scholar]
- 18.Vikne H, Bakke ES, Liestø l K, Sandbæ k G, Vø llestad N. The smoothness of unconstrained head movements is velocity-dependent. Human movement science. 2013;32(4):540–554. doi: 10.1016/j.humov.2012.12.013. [DOI] [PubMed] [Google Scholar]
- 19.Yashiro K, Yamauchi T, Fujii M, Takada K. Smoothness of human jaw movement during chewing. J Dent Res. 1999;78(10):1662–8. doi: 10.1177/00220345990780101201. [DOI] [PubMed] [Google Scholar]
- 20.Doeringer JA, Hogan N. Intermittency in preplanned elbow movements persists in the absence of visual feedback. J Neurophysiol. 1998;80(4):1787–99. doi: 10.1152/jn.1998.80.4.1787. [DOI] [PubMed] [Google Scholar]
- 21.Ao D, Song R, Tong K-y. Sensorimotor Control of Tracking Movements at Various Speeds for Stroke Patients as Well as Age-Matched and Young Healthy Subjects. PLoS One. 2015;10(6):0128328. doi: 10.1371/journal.pone.0128328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Lambercy O, Dovat L, Yun H, Wee SK, Kuah CWK, Chua KSG, et al. Effects of a robot-assisted training of grasp and pronation/supination in chronic stroke: a pilot study. J Neuroeng Rehabil. 2011;8(1):63. doi: 10.1186/1743-0003-8-63. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Celik O, O’Malley MK, Boake C, Levin HS, Yozbatiran N, Reistetter TA. Normalized movement quality measures for therapeutic robots strongly correlate with clinical motor impairment measures. IEEE Trans Neural Syst Rehabil Eng. 2010;18(4):433–44. doi: 10.1109/TNSRE.2010.2047600. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Brach JS, McGurl D, Wert D, VanSwearingen JM, Perera S, Cham R, et al. Validation of a Measure of Smoothness of Walking. Journals Gerontol Ser A Biol Sci Med Sci. 2011;66A(1):136–41. doi: 10.1093/gerona/glq170. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Menz HB, Lord SR, Fitzpatrick RC. Acceleration patterns of the head and pelvis when walking are associated with risk of falling in community-dwelling older people. Journals Gerontol Ser A Biol Sci Med Sci. 2003;58(5):446–52. doi: 10.1093/gerona/58.5.M446. [DOI] [PubMed] [Google Scholar]
- 26.Lowry KA, VanSwearingen JM, Perera S, Studenski SA, Brach JS. Walking smoothness is associated with self-reported function after accounting for gait speed. Journals Gerontol Ser A Biol Sci Med Sci. 2013;:glt034. [DOI] [PMC free article] [PubMed]
- 27.Hreljac A. The relationship between smoothness and performance during the practice of a lower limb obstacle avoidance task. Biol Cybern. 1993;68(4):375–9. doi: 10.1007/BF00201862. [DOI] [PubMed] [Google Scholar]
- 28.Hogan N, Sternad D. On rhythmic and discrete movements: reflections, definitions and implications for motor control. Exp Brain Res. 2007;181(1):13–30. doi: 10.1007/s00221-007-0899-y. [DOI] [PubMed] [Google Scholar]
- 29.Bellanca JL, Lowry KA, VanSwearingen JM, Brach JS, Redfern MS. Harmonic ratios: a quantification of step to step symmetry. J Biomech. 2013;46(4):828–31. doi: 10.1016/j.jbiomech.2012.12.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Nasseroleslami B, Hasson CJ, Sternad D. Rhythmic manipulation of objects with complex dynamics: predictability over chaos. PLoS Comput Biol. 2014;10(10):1003900. doi: 10.1371/journal.pcbi.1003900. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Milner TE. A model for the generation of movements requiring endpoint precision. Neuroscience. 1992;49(2):487–96. doi: 10.1016/0306-4522(92)90113-G. [DOI] [PubMed] [Google Scholar]
- 32.Burdet E, Milner TE. Quantization of human motions and learning of accurate movements. Biol Cybern. 1998;78(4):307–18. doi: 10.1007/s004220050435. [DOI] [PubMed] [Google Scholar]
- 33.Carpinella I, Cattaneo D, Abuarqub S, Ferrarin M. Robot-based rehabilitation of the upper limbs in multiple sclerosis: feasibility and preliminary results. J Rehabil Med. 2009;41(12):966–70. doi: 10.2340/16501977-0401. [DOI] [PubMed] [Google Scholar]
- 34.Tresilian J. Stability of reach-to-grasp movement patterns in Parkinson’s disease. Brain. 1997;120(11):2093–111. doi: 10.1093/brain/120.11.2093. [DOI] [PubMed] [Google Scholar]
- 35.Rand M. Movement accuracy constraints in Parkinson’s disease patients. Neuropsychologia. 2000;38(2):203–12. doi: 10.1016/S0028-3932(99)00059-7. [DOI] [PubMed] [Google Scholar]
- 36.Rohrer B, Fasoli S, Krebs HI, Hughes R, Volpe B, Frontera WR, et al. Movement smoothness changes during stroke recovery. J Neurosci. 2002;22(18):8297–8304. doi: 10.1523/JNEUROSCI.22-18-08297.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Talelli P, Greenwood RJ, Rothwell JC. Arm function after stroke: Neurophysiological correlates and recovery mechanisms assessed by transcranial magnetic stimulation. Clin Neurophysiol. 2006;117(8):1641–59. doi: 10.1016/j.clinph.2006.01.016. [DOI] [PubMed] [Google Scholar]
- 38.Portney LG, Watkins MP. Foundations of clinical research: application to practice. In: Critical Care Medicine, vol. 36. Prentice Hall Upper Saddle River, NJ: 2009. p. 892.
- 39.Rohrer B, Hogan N. Avoiding spurious submovement decompositions: a globally optimal algorithm. Biol Cybern. 2003;89(3):190–9. doi: 10.1007/s00422-003-0428-4. [DOI] [PubMed] [Google Scholar]
- 40.Rohrer B, Hogan N. Avoiding spurious submovement decompositions II: a scattershot algorithm. Biol Cybern. 2006;94(5):409–14. doi: 10.1007/s00422-006-0055-y. [DOI] [PubMed] [Google Scholar]
- 41.Pérez F, Granger BE. IPython: a system for interactive scientific computing. Comput Sci Eng. 2007;9(3):21–9. doi: 10.1109/MCSE.2007.53. [DOI] [Google Scholar]
- 42.Knorr B, Hughes R, Sherrill D, Stein J, Akay M, Bonato P. Quantitative measures of functional upper limb movement in persons after stroke. In: Conf. Proceedings. 2nd Int. IEEE EMBS Conf. Neural Eng. 2005, vol. 2005. IEEE: 2005. p. 252–255.