Abstract
Abstract
Robot-assisted gait training (RAGT) after spinal cord injury (SCI) induces several different neurophysiological mechanisms to restore walking ability, including the activation of central pattern generators, task-specific stepping practice and massed exercise. However, there is no clear evidence for the optimal timing and efficacy of RAGT in people with SCI. The aim of our study was to assess the effects of RAGT on improvement in walking-related functional outcomes in patients with incomplete SCI compared with other rehabilitation modalities according to time elapsed since injury. This review included 10 trials involving 502 participants to meta-analysis. The acute RAGT groups showed significantly greater improvements in gait distance, leg strength, and functional level of mobility and independence than the over-ground training (OGT) groups. The pooled mean difference was 45.05 m (95% CI 13.81 to 76.29, P = 0.005, I2 = 0%; two trials, 122 participants), 2.54 (LEMS, 95% CI 0.11 to 4.96, P = 0.04, I2 = 0%; three trials, 211 participants) and 0.5 (WISCI-II and FIM-L, 95% CI 0.02 to 0.98, P = 0.04, I2 = 67%; three trials, 211 participants), respectively. In the chronic RAGT group, significantly greater improvements in speed (pooled mean difference = 0.07 m/s, 95% CI 0.01 to 0.12, P = 0.01, I2 = 0%; three trials, 124 participants) and balance measured by TUG (pooled mean difference = 9.25, 95% CI 2.76 to 15.73, P = 0.005, I2 = 74%; three trials, 120 participants) were observed than in the group with no intervention. Thus, RAGT improves mobility-related outcomes to a greater degree than conventional OGT for patients with incomplete SCI, particularly during the acute stage. RAGT treatment is a promising technique to restore functional walking and improve locomotor ability, which might enable SCI patients to maintain a healthy lifestyle and increase their level of physical activity.
Trial registration
PROSPERO (CRD 42016037366). Registered 6 April 2016.
Keywords: Spinal Cord Injuries, Gait, Robotics, Locomotion, Physical therapy
Background
A spinal cord injury (SCI) is a lesion of neural elements of the spinal cord, it is a devastating condition with a major impact on a person’s life. Locomotor ability is frequently affected in people with SCI, and decreased mobility after SCI is associated with a heightened risk of a decrease in both life satisfaction and quality of life [1]. Locomotor training focuses on retraining the motor function via plastic change [2], and the neurophysiological mechanism underlying the restoration of human locomotion after SCI involve enhancing the afferent input to the spinal cord and activating central pattern generators (CPG) embedded within the lumbosacral spinal cord. Plastic changes can be induced in both the spinal cord level and sensory motor cortex via intensive locomotor training, but only in incomplete SCI subjects [3]. Motor recovery in SCI patients can be improved with both conventional overground walking training (OGT) and body weight-supported (BWS) treadmill training. BWS treadmill training enables early initiation of gait training, integration of weight-bearing activities, stepping and balance using a task-specific approach and symmetrical gait pattern [4]. To replicate a normal gait pattern during manually facilitated BWS treadmill training, two or three therapists are needed to control and assist with trunk and limb kinematics.
Manual training is strenuous and exhausting for therapists, so sophisticated automated electromechanical devices have been developed [5]. In the late 1990s, robot-assisted gait training (RAGT) was introduced. It offers several advantages, including the ability to increase the intensity and total duration of training while maintaining a physiological gait pattern. Also, the task-specific stepping practice is known to enhance the afferent feedback associated with normal locomotion and can induce plasticity in the involved motor centers [6, 7]. Moreover, locomotor robotic devices can reduce personnel costs involved in manual assistance training, which can require up to three physical therapists.
Several studies have evaluated RAGT in incomplete SCI patients. Although some of the results were encouraging, there is still uncertainty regarding the appropriate timing of RAGT following SCI, and no clear evidence of the efficacy of RAGT in terms of SCI patients’ gait functional outcomes, such as walking ability (i.e., gait speed and distance), body functions (i.e., lower extremity motor score and spasticity), and functional level of mobility and independence has been shown. The aim of the present study was to assess the effects of RAGT on improving walking-related functional outcomes according to time since injury in patients with incomplete SCI, as measured relative to other rehabilitation modalities.
Method
Materials and methods
We used comprehensive databases to find studies comparing RAGT with any other exercise or physiotherapy. This study was performed according to the Cochrane Review Methods and reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement [8].
Data source & literature source
Randomized trials were identified by searching MEDLINE, EMBASE, SCOPUS, Web of Science, Cochrane Central Register of Controlled Trials, the World Health Organization International Clinical Trials Registry Platform, and the clinical trials registry and database of the U.S. National Institutes of Health (ClinicalTrials.gov) on January 17 2016. We put no restrictions on language or year of publication in our search. The following keywords were searched: spinal cord injuries, gait disorders, neurologic, and robotics. See Appendix 1 for a comprehensive list (MEDLINE, EMBASE, CENTRAL Web of Science and Scopus). Search strategies were developed for each database using both free-text terms and the controlled vocabulary (MeSH and Emtree). We also searched the reference lists of included studies and other reviews to identify additional trials. Duplicate records were identified by title, authors and journal citations and removed.
Study selection
Study inclusion was decided independently by two reviewers (ARY and KYN) based on the selection criteria. Studies were selected in two stages, as follows: First, we screened the titles and abstracts of identified studies. Second, we screened the full text. We included randomized controlled trials (RCTs) of parallel-group or cross-over design involving patients with SCI. Studies were included in our meta-analysis if they compared RAGT to a control comprising any other exercise or no treatment; or involved participants with an incomplete, traumatic or nontraumatic, nonprogressive SCI, as defined by AIS grades B, C, or D; [9] participants were a minimum of 16 years of age because most neurologic development is complete once adolescence is reached; [10] training parameters were specified in detail; and locomotor or locomotor-related outcomes were evaluated.
Data extraction
The two reviewers independently extracted data from each study using a predefined data extraction form. Disagreements were resolved through discussion or, if required, adjudication by a third reviewer.
The following variables were extracted from studies: (1) mean and SD of walking speed, walking capacity, walking independence and safety and incidence of adverse events during the trial in the intervention and control groups; (2) demographic, clinical, and treatment characteristics (e.g., number of patients in the intervention and control groups); (3) intervention and control protocol type; and (4) method of assessment. If the above variables were not mentioned in the studies, the data were requested from the authors via email.
Assessment of methodological quality
The quality of included trials was assessed by extracting PEDro Scale scores from the Physiotherapy Evidence Database (www.pedro.org.au). The PEDro Scale has 11 items and is designed to rate the methodological quality (internal validity and statistical information) of randomized trials. Each item, with the exception of item #1, contributes one point to the total PEDro score (range, 0 to 10 points). The PEDro score is a valid measure of the internal validity and completeness of reporting. It has undergone Rasch analysis and showed moderate levels of inter-rater reliability (ICC 0.68, 95% CI 0.57 to 0.76) [11, 12]. Trials scoring < 6 were deemed to be of low quality [13]. Tests for funnel plot asymmetry are generally performed only when at least 10 studies are included in a meta-analysis [14]. Although 10 studies were included in this analysis, when sorted by outcomes, each outcome contained fewer than 9 studies. Thus publication bias in these trials could not be assessed.
Statistical analysis
The main outcome was ambulatory function measured as the speed (m/s) and capacity (2 and 6 min gait distance) of walking. Other frequently investigated outcomes were the lower extremities motor scale (LEMS), functional independence measure – locomotion (FIM-L), walking index for spinal cord injury (WISCI), modified Ashworth scale (MAS), and timed up and go (TUG) test. We used weighted mean differences to estimate the treatment effects for ambulatory function. The weighted mean difference and 95% confidence intervals (CI) were calculated using the inverse variance method with random-effects weighting. We pooled the data as change values for all outcomes, if available. If not, they were estimated from the final and baseline values.
The statistical heterogeneity between the studies was evaluated by Cochran’s Q test and quantified with the I2 statistic (I2 ≥ 50% indicated substantial (moderate, high) heterogeneity) [15]. To identify the sources of heterogeneity, subgroup analyses were conducted according to (1) type of control [no intervention, body weight-supported gait training (BWS), OGT, and strength exercise], (2) time since injury [acute (<6 months), chronic (>12 months), and unknown]. We used RevMan version 5.2 for these analyses.
Results
Identification of studies
Searches of the databases resulted in identification of 653 articles (Fig. 1). Of these, 333 publications were excluded as they did not fulfill the selection criteria. For the remaining 130 articles, we obtained full manuscripts, and following scrutiny of these, we identified 36 potentially relevant studies and 26 publications were excluded as they were:
12 studies were not a RCTs
3 studies investigated physiological or biomechanical measures only
1 study investigated pharmacological treatment
7 studies investigated robotic techniques only (These papers were comparative studies of the operation of RAGT devices.)
3 studies investigated patients with brain injury, stroke, cerebral palsy, or Parkinson’s disease
Therefore, 10 studies were included in the review. Five trials were conducted in the U.S. [16–20], 2 in Spain [21, 22], 1 in Switzerland [23], 1 in China [24], and 1 in Korea. [25] All trials compared parallel intervention groups, and one study [23] used a crossover design. All studies were published in English. Two articles [16, 26] were based on the same trial, so the participants were counted only once. Another one of the reports [17] replaces and completes preliminary study results [27].
Study characteristics and patient populations
Participants
The demographic characteristics of all 502 participants in the 10 studies are shown in Table 2. The number of participants in each study ranged from 9 [8, 23] to 88 [22] and the age of the participants ranged from 16 [22] to 70 years [22, 23]; more males than females participated. All included studies provided information on the level of spinal cord injury (C2 to L3) and baseline severity (AIS grades B to D); i.e., incomplete SCI. Most studies involved upper motor neuron lesions only, but two [22, 24] also included participants with lower motor neuron lesions. Most studies were AIS grade C/D [16, 17, 20–23] or D [24, 25], motor incomplete SCI only, but two studies [18, 19] included AIS grade B/C/D, motor or sensory incomplete SCI. Of the participants, 263 in four studies [18, 21, 22, 25] were assessed at < 6 months post-injury and 209 in five studies [16, 17, 19, 20, 23] were assessed at > 12 months post-injury. The remaining 30 participants in one study (mean 6.3 months post-injury) did not belong to any group [24]. To account for possible spontaneous neurologic recovery, any trials involving participants at an early or acute stage after SCI (<1 year post-injury) [21, 28–31] and those whose participants were at a chronic stage (>1 year post-injury) [17, 27, 31] were analyzed separately [2, 32, 33]. Acute participants in all studies were seen at ≤6 months since injury.
Table 2.
Study | Design | Participants | Intervention | Outcome measures |
---|---|---|---|---|
Alcobendas-Maestro 2012 | RCT |
n = 80 Time since injury (months) = 3 - 6 ASIA scale = C, D Level of injury = C2 to T12 (UMN) |
Exp = RAGT 30 min x 5/wk x 6 wk Con = OGT 60 min x 5/wk x 6 wk Both = Usual PT |
• Speed = 10-m walk test • Distance = 6-min walk test • Functional level = WISCI II, FIM-L • Leg strength = LEMS • Spasticity = MAS • Pain = VAS • Timing: 0, 8 wk |
Duffell 2015 | RCT |
n = 56 Time since injury (months) > 12 ASIA scale = C, D Level of injury = above T10 (UMN) |
Exp = RAGT 30~45 min x 3/wk x 4 wk Con = no intervention |
• Speed = 10-m walk test • Distance = 6-min walk test • Balance = TUG • Timing: 0, 1, 2, 4 wk |
Esclarin-Ruz 2014 | RCT |
n = 88 Time since injury (months) < 6 ASIA scale = C, D Level of injury = C2 to L3 (UMN+LMN) |
Exp = RAGT 30 min x 5/wk x 8 wk Con = OGT 30 min x 5/wk x 8 wk Both = Usual PT 60 min x 5/wk x 8 wk |
• Speed = 10-m walk test • Distance = 6-min walk test • Functional level = WISCI II, FIM-L • Leg strength = LEMS • Timing: 0, 8 wk |
Field-Fote 2011 | RCT |
n = 74 Time since injury (months) > 12 ASIA scale = C, D Level of injury = At or above T10 (UMN) |
Exp = RAGT 60 min x 5/wk x 12 wk Con1 = BWS treadmill-based training with manual assistance 60 min x 5/wk x 12 wk Con2 = BWS treadmill-based training with stimulation 60 min x 5/wk x 12 wk Con3 = OGT with stimulation with BWS 60 min x 5/wk x 12 wk |
• Speed = 10-m walk test • Distance = 2-min walk test • Leg strength = LEMS • Timing: 0, 12 wk |
Hornby 2005 | RCT |
n = 35 Time since injury (months) < 6 (14–180 days) ASIA scale = B, C, D Level of injury = Above T10 (UMN) |
Exp = RAGT 30 min x 3/wk x 8 wk Con1 = BWS treadmill-based training with manual assistance 30 min x 3/wk x 8 wk Con2 = OGT with BWS 30 min x 3/wk x 8 wk |
• Speed = 10-m walk test • Distance = 6-min walk test • Functional level = WISCI II, FIM-L • Leg strength = LEMS • Spasticity = MAS • Balance = TUG • Timing: 0, 8 wk |
Labruyere 2014 | RCT Cross-over |
n = 9 Time since injury (months) > 12 ASIA scale = C, D Level of injury = C4 -T11 (UMN) |
Exp = RAGT 45 min x 4/wk x 4 wk Con = Strength 45 min x 4/wk x 4 wk |
• Speed = 10-m walk test • Functional level = WISCI II • Leg strength = LEMS • Pain = VAS • Balance = BBS • Timing: 0, 1, 2, 3, 4 wk |
Niu 2014 | RCT |
n = 40 Time since injury (yrs) = Exp 8.9±9.9, Con 7.5±5.5 ASIA scale = B, C, D Level of injury = above T10 (UMN) |
Exp = RAGT 60 min x 3/wk x 4 wk Con = no intervention |
• Speed = 10-m walk test • Distance = 6-min walk test • Balance = TUG • Timing: 0, 1, 2, 4 wk |
Shin 2014 | RCT | n = 60 Time since injury (months) < 6 ASIA scale = D Level of injury = UMN |
Exp = RAGT 40 min x 3/wk x 4 wk Con = OGT 30 min x 3/wk x 4 wk Both = Usual PT 30 min x 2/wk x 4 wk |
• Functional level = WISCI II, SCIM3, AMI • Leg strength = LEMS • Timing: 0, 4 wk |
Tang 2014 | RCT |
n = 30 Time since injury (months) = 6.3 ASIA scale = D Level of injury = T8 to L3 (UMN+LMN) |
Exp = RAGT 40 min Con = Bike 40 min |
• Speed = 10-m walk test • Agility = probe reaction time • Timing: before and after the intervention |
Varoqui 2014 | RCT |
n = 30 Time since injury (yrs) = Exp 11.80±2.54, Con 8.09±1.89 ASIA scale = C, D Level of injury = above T10 (UMN) |
Exp = RAGT 60 min x 3/wk x 4 wk Con = no intervention |
• Speed = 10-m walk test • Distance = 6-min walk test • Balance = TUG • Timing: 0, 4 wk |
Exp experimental group, Con control group, RAGT robotic-assisted gait training, OGT over-ground training), Strength, BWS body weight-supported gait training, WISCI walking index for spinal cord injury, LEMS lower extremities motor scale, FIM-L Functional Independence Measure – Lokomotion, MAS modified Ashworth scale, VAS visual analog scale, TUG timed up and go, AMI ambulatory motor index
Quality
The mean PEDro score of the studies was 5.7 (range, 3 to 8) (Table 1). Two trials [21, 22] scored 8 on the PEDro scale, which was the highest possible score given the nature of the intervention since it would not be feasible to blind clinicians or participants. The majority of the studies were randomized (100%), analyzed between-group differences (100%), reported point estimates and variability (90%), had similar groups at baseline (50%), reported < 15% loss to follow-up (90%) and had blinded assessors (50%). The majority of the studies did not conceal the allocation list (70%), carry out an intention-to-treat analysis (60%), or blind participants or therapists (100%).
Table 1.
Study | Random allocation | Concealed allocation | Groups similar at baseline | Participant blinding | Therapist blinding | Assessor blinding | <15% dropouts | Intention-to-treat analysis | Between-group difference reported | Point estimate and variability reported | Total (0 to 10) |
---|---|---|---|---|---|---|---|---|---|---|---|
Alcobendas-Maestro 2012 | Y | Y | Y | N | N | Y | Y | Y | Y | Y | 8 |
Duffell 2015 | Y | N | Y | N | N | N | N | N | Y | Y | 4 |
Esclarin-Ruz 2014 | Y | Y | Y | N | N | Y | Y | Y | Y | Y | 8 |
Field-Fote 2011 | Y | N | Y | N | N | Y | Y | N | Y | Y | 6 |
Hornby 2005 | Y | N | N | N | N | N | Y | N | Y | N | 3 |
Labruyere 2014 | Y | N | N | N | N | Y | Y | Y | Y | Y | 6 |
Niu 2014 | Y | N | N | N | N | N | Y | Y | Y | Y | 5 |
Shin 2014 | Y | N | Y | N | N | N | Y | N | Y | Y | 5 |
Tang 2014 | Y | N | N | N | N | N | Y | Y | Y | Y | 5 |
Varoqui 2014 | Y | Y | N | N | N | Y | Y | Y | Y | Y | 7 |
Interventions
All studies investigated the robotic-assisted device ‘Lokomat’ (Hocoma; Zurich, Switzerland) as the experimental intervention. Among 10 comparisons, 3 investigated RAGT versus conventional OGT [21, 22, 25] and 2 investigated RAGT versus BWS gait training [17, 18]. Two investigated RAGT versus non-gait-specific training (strength [23] or bike [24]). Finally, three trials compared RAGT with no intervention [16, 19, 20].
The frequency of treatment ranged from three [16, 18–20, 25] to four [23] or five [17, 21, 22] times per week. The duration of treatment was 4 weeks [16, 19, 20, 23, 25], 8 weeks [18, 21, 22] or 12 weeks [17]. One study involved only one treatment session [24]. The treatment intensity (in terms of session duration) ranged from 30 to 60 min and the treatment time did not differ between the control and experimental groups [17, 18, 21–25], with the exception of the no-intervention groups [16, 19, 20]. A summary of the interventions is presented in Table 2.
Outcomes
All included studies investigated improvement in ambulatory function measured as speed (m/s, 10 m walk test) [16, 19–24] and capacity of walking (meters walked in 6 min [16, 21, 22] or 2 min [17]) as primary outcomes. Walking aids were allowed in all studies. Other frequently investigated outcomes were: leg strength measured as LEMS (lower extremity motor score of the neurological examination according to the American Spinal Injury Association International Standards [34], range 0 to 50) [17, 18, 21–23, 25], level of functional mobility and independence measured by WISCI-II (assesses the amount of physical assistance needed, as well as devices required) [18, 23, 25],, FIM-L (independence of gait) [18, 21, 22], functional mobility and balance measured by TUG [16, 19, 20], and spasticity measured as MAS [18, 21].
Effects on gait velocity
Gait velocity tended to be higher in the acute RAGT groups than in the OGT groups, albeit not significantly so (pooled mean difference = 0.08 m/s, 95% CI -0.00 to 0.15; P = 0.05; I2 = 0%, two trials, 130 participants) (Fig. 2). In the chronic RAGT groups, significantly greater improvements were observed than in the no intervention groups (pooled mean difference = 0.07 m/s, 95% CI 0.01 to 0.12, P = 0.01, I2 = 0%; three trials, 124 participants).
Effects on gait distance
Significantly greater improvements were observed in the acute RAGT groups than in the OGT groups (pooled mean difference = 45.05 m, 95% CI 13.81 to 76.29; P = 0.005; I2 = 0%, two trials, 122 participants) (Fig. 3). However, there were no significant improvements in the chronic RAGT groups compared to the BWS or no-intervention groups (pooled mean difference = -4.92 m, 95% CI -11.96 to 2.11; P = 0.17; I2 = 0%, two trials, 114 participants).
Effects on leg strength
In the acute RAGT, leg strength measured by LEMS was greater than that in the OGT groups (pooled mean difference = 2.54, 95% CI 0.11 to 4.96, P = 0.04, I2 = 0%; three studies, 211 participants) (Fig. 4). However, there was no significant improvement in the chronic RAGT groups compared to the BWS and strength groups (pooled mean difference = -2.18, 95% CI -4.90 to 0.54; P = 0.12; I2 = 0%, two studies, 73 participants).
Effects on functional level of mobility and independence
Significantly greater improvements on the WISCI-II and FIM-L were observed in the acute RAGT groups compared to the OGT groups (pooled mean difference = 0.5, 95% CI 0.02 to 0.98; P = 0.04; I2 = 67%, three trials, 211 participants) (Fig. 5). There was no significant improvement in the chronic RAGT groups compared to the strength group (mean difference = 0.16, 95% CI -1.15 to 1.48, P = 0.81; one trial, 9 participants).
Effects on balance
Significantly greater improvements in TUG were observed in the chronic RAGT groups compared to the no intervention groups (pooled mean difference = 9.25, 95% CI 2.76 to 15.73, P = 0.005, I2 = 74%; three trials, 120 participants) (Fig. 6). No trial with acute participants measured recovery of balance.
Effects on spasticity
The overall changes in spasticity were similar in the control and acute RAGT groups (pooled mean difference was 0.48, 95% CI -0.50 to 1.46, P = 0.34, I2 = 84%; 2 trials, 105 participants) (Fig. 7). No trial with chronic participants measured changes in spasticity.
Discussion
This systematic review aimed to provide an overview of the current evidence on the RAGT approach to gait rehabilitation after incomplete SCI. There was no superiority of the control group in all outcomes. The RAGT group was superior or equivalent when compared to the control group. The data for participants < 6 months post-injury showed improvements in walking distance, lower limb strength and functional level of mobility and independence for RAGT over conventional OGT. The data for participants > 1 year post-injury showed improvements in gait speed and balance with RAGT compared with no intervention. However, there was no greater improvement in walking speed in the acute RAGT groups compared to OGT, and no greater improvement in gait distance, leg strength or functional level of mobility and independence in the chronic RAGT groups compared to the groups that underwnt other forms of physiotherapy.
Studies in spinalized animals have shown that motor potential can be elicited by reciprocal passive movement of the lower limbs [35]. The suggested mechanism is the activation of gait centers in the spinal cord, the CPG. Indeed, similar locomotor activity can be activated in patients with severe spinal cord injuries via passive activation of the legs on a treadmill [36]. Synchronous reciprocal movements of both legs, simulating normal walking, are required to activate the locomotor centers in the spinal cord. Often, two physiotherapists are required to perform these reciprocal movements, which should be highly symmetrical and physiological to stimulate the locomotor centers effectively. It is important to achieve symmetrical and physiological walking with body weight support to accurately stimulate the locomotor centers and therefore activate paralyzed muscles [37].
To improve over-ground walking ability, locomotor therapies that combine a BWS system with a treadmill have been developed over the past two decades [38]. BWS training has been shown to be effective in improving ambulatory function after SCI, although it is not more effective than equivalent over-ground mobility training [29, 39]. A recent meta-analysis of gait training in SCI revealed that the pooled mean between-group (comparing treadmill training with OGT) difference for gait velocity was−0.01 m/s (95% CI−0.09 to 0.08) [39]. These results are equivalent to those of a 2012 Cochrane review [40]. Another strategy to improve walking after SCI is to administer BWS treadmill training combined with functional electrical stimulation (FES). Its benefits have been noted in terms of CNS regeneration, initiation of stepping, improving foot clearance, knee extension, and strength in both acute and chronic participants [41–43]. However, a recent meta-analysis revealed that people with SCI who used FES did not significantly increase their walking speed and capacity when compared with patients who were treated with other approaches [40].
RAGT has many advantages over conventional BWS treadmill training methods, including early initiation of gait training in severely dependent patients, less effort for physiotherapists, longer duration and higher intensity of gait, more physiological and reproducible gait patterns, and the possibility to measure a patient’s performance [44]. These factors contribute to spinal and central neuroplasticity. RAGT allows wheelchair-bound patients to practice up to 1000 steps during a 30 min session, compared with a maximum of only 50–100 steps during a conventional therapy session [45]. Furthermore, according to recent studies, RAGT has potential aerobic benefits and a positive influence on cardiopulmonary fitness in severely disabled spinal cord and stroke patients [46]. Also, RAGT may have some positive effect on other parameters associated with quality of life in SCI patients, including cardiopulmonary function, regulation of bowel movements, and bone density [47, 48].
Three types of robotic-assisted device have been developed: exoskeleton type, end-effector type and portable powered robotic exoskeletons [49–51]. Examples of end-effector devices are the “G-EO-System” [50], the “Lokohelp” [52], the “Haptic Walker” [53], and the “Gait Trainer GT 1” [54]. The definition of an end-effector principle is that a patient’s feet are placed on footplates whose trajectories simulate the stance and swing phases during treadmill gait training [50]. The two prototypes of the exoskeleton type are the “LOPES” (University of Twente, Netherlands) [53] and “Lokomat” (Hocoma; Zurich, Switzerland) [37], a treadmill-based walking machine comprised of a harness which carries patients in an upright position and robotic arms attached to the patient’s legs and allows physiological and symmetrical reciprocal movement on a treadmill. Compared to treadmill-based gait orthoses, portable powered robotic exoskeletons are compact and wearable, they provide individuals with complete paralysis the ability to walk independently over-ground in a natural reciprocal pattern. Only 10 RCTs of the exoskeleton type (all involving the Lokomat) have been performed to date, and no RCT of the end-effector type or portable powered exoskeletons has been carried out.
Some reviews have assessed the quality of current evidence on the effectiveness of RAGT in spinal cord injury patients, focusing on walking ability and performance, but no evidence that RAGT improves walking function more than other locomotor training strategies has been reported [55]. In particular, Harvey [39] showed that there is nothing intrinsically therapeutic about cyclic walking with robotic devices, although RAGT may provide a convenient and safe way for therapists to provide intensive repetitive practice. Also, Dobkin [56] suggested in a scientifically-conducted efficacy trial that RAGT should not be routinely provided to disabled, vulnerable persons. However, this meta-analysis showed that participants < 6 months post-injury demonstrated improvements in walking distance, functional level of mobility and independence and lower limb strength with RAGT over conventional OGT intervention. The evidence for the mechanisms underlying functional improvements in humans is poor, particularly in terms of neural changes in the spinal cord. However, RAGT has been shown to lead to changes in many spinal reflex pathways behave more like those of healthy controls following robot-mediated training in patients with SCI [57]. Of particular importance is the finding that, among other changes to the spinal reflex circuitries, robotic-assisted step training in SCI patients resulted in the re-emergence of a physiological phase modulation of the soleus H-reflex during walking [58].
The role of RAGT in gait rehabilitation is similar to that in other central nervous system disorders such as stroke, traumatic brain injury, and multiple sclerosis. A recent meta-analysis of 23 trials with a total of 999 stroke patients showed a small additional value of RAGT combined with conventional training compared to conventional training alone, especially for acute patients. In traumatic brain injury patients, a recent systematic review showed that RAGT may have a beneficial effect on the rehabilitation process and is feasible and effective in improving gait function in multiple sclerosis patients [44].
A novel cable-driven robotic gait training system can provide controlled forces to the limb during the swing phase of gait to produce an optimal training paradigm with either assistance or resistance [59]. One pilot RCT study showed that cable-driven robotic resistance training can be used as an adjunct to BWS treadmill training to improve overground walking function in humans with chronic incomplete SCI compared to assistance training [60]. Another pilot RCT study provided evidence that Lokomat-applied resistance training may improve performance in skilled overground walking tasks in patients with chronic motor incomplete SCI compared to conventional Lokomat-assisted gait training [61]. Greater cognitive engagement during training may have elicited greater involvement of cortical regions associated with gait, which are particularly involved in the adjustments of motor output during swing [62], and cable-driven robotic resistance training is promising gait training for chronic incomplete SCI patients.
No study has yet been published that directly compares different types of devices, end-effector, or exoskeleton devices. Furthermore, no data are available regarding the optimal RAGT protocol. Larger controlled studies are required to determine the optimal timing and protocol design that will maximize efficacy and long-term outcomes in neurological patients. Another important issue is the availability and cost of these devices. At present, their usage is limited to highly specialized centers with the required space and resources. Therefore, more compact and affordable devices for home use are needed [44]. In addition, some technical limitations have been identified. The fixed trajectory control strategy used in both types of robotic systems may encourage passive rather than active training and may eliminate the variability in kinematics of the lower limbs, which is thought to be critical for successful motor adaptation. The limited degree of freedom in the exoskeleton type, which allows movement only in the sagittal plane, may limit the natural walking pattern and affect gait dynamics.
The methodologic quality of all included trials was either low or good, and the study designs differed considerably. Moreover, eligibility criteria, randomization processes, timing of treatment, intervention parameters, and their execution, frequency, and intensity were commonly heterogeneous or not clearly stated in the articles [2]. Failure to comply with the high methodologic requirements of RCTs significantly increases the risk of bias within these trials, as represented in the final PEDro scores. The power of the findings and their implication for clinical practice are thereby diminished [63].
Conclusions
This review provides evidence that the acute RAGT group showed significantly greater improvements in gait distance, strength, and functional level of mobility and independence than the OGT group. In the chronic RAGT group, significantly greater improvements in speed and balance were observed than in the group with no intervention.
RAGT treatment in incomplete SCI patients showed promise in restoring functional walking. An improvement in locomotor ability in persons with SCI using RAGT might enable them to maintain a healthy lifestyle and increase their level of physical activity.
Acknowledgements
Not applicable.
Funding
Korea National Rehabilitation Center (NRCTR-EX16010).
Availability of data and material
Not applicable.
Authors’ contributions
HJK, KYN and AY collected data. HJK performed the analysis and interpretation of data and KYN, BSK wrote the manuscript. BSK, JWP and HJL assisted in revising the manuscript. AY designed the study, supervised data collection and analysis, and participated in interpreting and revising the manuscript. All authors read and approved the final manuscript. First Author: Ki Yeun Nam & Hyun Jung Kim (These authors contributed equally to this work.). Correspondence: Aeri Yoo.
Competing interests
The authors declare that they have no competing interests.
Consent for publication
Not applicable.
Ethics approval and consent to participate
Not applicable.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Abbreviations
- BWS
Body weight-supported gait training
- CI
Confidence intervals
- CPG
Central pattern generators
- FES
Functional electrical stimulation
- FIM-L
Functional independence measure – locomotion
- LEMS
Lower extremities motor scale
- MAS
Modified Ashworth scale
- OGT
Over-ground training
- RAGT
Robot-assisted gait training
- RCTs
Randomized controlled trials
- SCI
Spinal cord injury
- TUG
Timed up and go
- WISCI
Walking index for spinal cord injury
Contributor Information
Ki Yeun Nam, Email: rusl98@hanmail.net.
Hyun Jung Kim, Email: moole@korea.ac.kr.
Bum Sun Kwon, Email: bskwon@dumc.or.kr.
Jin-Woo Park, Email: jinwoo.park.md@gmail.com.
Ho Jun Lee, Email: hjrhee1@gmail.com.
Aeri Yoo, Phone: +82-10-5252-0421, Email: ell0623@hanmail.net.
References
- 1.Hu XL, Tong KY, Li R, et al. Effectiveness of functional electrical stimulation (FES)-robot assisted wrist training on persons after stroke. Conf Proc IEEE Eng Med Biol Soc. 2010;2010:5819–5822. doi: 10.1109/IEMBS.2010.5627471. [DOI] [PubMed] [Google Scholar]
- 2.Morawietz C, Moffat F. Effects of locomotor training after incomplete spinal cord injury: a systematic review. Arch Phys Med Rehabil. 2013;94:2297–2308. doi: 10.1016/j.apmr.2013.06.023. [DOI] [PubMed] [Google Scholar]
- 3.Hubli M, Dietz V. The physiological basis of neurorehabilitation--locomotor training after spinal cord injury. J Neuroeng Rehabil. 2013;10:5. doi: 10.1186/1743-0003-10-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Dietz V, Wirz M, Curt A, Colombo G. Locomotor pattern in paraplegic patients: training effects and recovery of spinal cord function. Spinal Cord. 1998;36:380–390. doi: 10.1038/sj.sc.3100590. [DOI] [PubMed] [Google Scholar]
- 5.Tefertiller C, Pharo B, Evans N, Winchester P. Efficacy of rehabilitation robotics for walking training in neurological disorders: a review. J Rehabil Res Dev. 2011;48:387–416. doi: 10.1682/JRRD.2010.04.0055. [DOI] [PubMed] [Google Scholar]
- 6.Dobkin BH. Spinal and supraspinal plasticity after incomplete spinal cord injury: correlations between functional magnetic resonance imaging and engaged locomotor networks. Prog Brain Res. 2000;128:99–111. doi: 10.1016/S0079-6123(00)28010-2. [DOI] [PubMed] [Google Scholar]
- 7.Winchester P, McColl R, Querry R, et al. Changes in supraspinal activation patterns following robotic locomotor therapy in motor-incomplete spinal cord injury. Neurorehabil Neural Repair. 2005;19:313–324. doi: 10.1177/1545968305281515. [DOI] [PubMed] [Google Scholar]
- 8.Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg. 2010;8:336–341. doi: 10.1016/j.ijsu.2010.02.007. [DOI] [PubMed] [Google Scholar]
- 9.Ditunno JF, Jr, Young W, Donovan WH, Creasey G. The international standards booklet for neurological and functional classification of spinal cord injury. American Spinal Injury Association. Paraplegia. 1994;32:70–80. doi: 10.1038/sc.1994.13. [DOI] [PubMed] [Google Scholar]
- 10.Weinberger DREB, Giedd JN. The adolescent brain: a work in progress. Washington (DC): The National Campaign to Prevent Teen Pregnancy; 2005. [Google Scholar]
- 11.Maher CG, Sherrington C, Herbert RD, Moseley AM, Elkins M. Reliability of the PEDro scale for rating quality of randomized controlled trials. Phys Ther. 2003;83:713–721. [PubMed] [Google Scholar]
- 12.de Morton NA. The PEDro scale is a valid measure of the methodological quality of clinical trials: a demographic study. Aust J Physiother. 2009;55:129–133. doi: 10.1016/S0004-9514(09)70043-1. [DOI] [PubMed] [Google Scholar]
- 13.Hahne AJ, Ford JJ, McMeeken JM. Conservative management of lumbar disc herniation with associated radiculopathy: a systematic review. Spine. 2010;35:E488–504. doi: 10.1097/BRS.0b013e3181cc3f56. [DOI] [PubMed] [Google Scholar]
- 14.Sally Green JPH. Cochrane Handbook for Systematic Reviews of Interventions version 5.1.0. 2011. [Google Scholar]
- 15.Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327:557–560. doi: 10.1136/bmj.327.7414.557. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Duffell LD, Brown GL, Mirbagheri MM. Interventions to Reduce Spasticity and Improve Function in People With Chronic Incomplete Spinal Cord Injury: Distinctions Revealed by Different Analytical Methods. Neurorehabil Neural Repair. 2015;29:566–576. doi: 10.1177/1545968314558601. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Field-Fote EC, Roach KE. Influence of a locomotor training approach on walking speed and distance in people with chronic spinal cord injury: a randomized clinical trial. Phys Ther. 2011;91:48–60. doi: 10.2522/ptj.20090359. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Hornby TGCD, Zemon DH, Kahn JH. Clinical and Quantitative Evaluation of Robotic-Assisted Treadmill Walking to Retrain Ambulation After Spinal Cord Injury. Topics in Spinal Cord Injury Rehabilitation. 2005;11:1–17. doi: 10.1310/14Q9-AD7M-FXX9-1G2J. [DOI] [Google Scholar]
- 19.Niu X, Varoqui D, Kindig M, Mirbagheri MM. Prediction of gait recovery in spinal cord injured individuals trained with robotic gait orthosis. J Neuroeng Rehabil. 2014;11:42. doi: 10.1186/1743-0003-11-42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Varoqui D, Niu X, Mirbagheri MM. Ankle voluntary movement enhancement following robotic-assisted locomotor training in spinal cord injury. J Neuroeng Rehabil. 2014;11:46. doi: 10.1186/1743-0003-11-46. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Alcobendas-Maestro M, Esclarin-Ruz A, Casado-Lopez RM, et al. Lokomat robotic-assisted versus overground training within 3 to 6 months of incomplete spinal cord lesion: randomized controlled trial. Neurorehabil Neural Repair. 2012;26:1058–1063. doi: 10.1177/1545968312448232. [DOI] [PubMed] [Google Scholar]
- 22.Esclarin-Ruz A, Alcobendas-Maestro M, Casado-Lopez R, et al. A comparison of robotic walking therapy and conventional walking therapy in individuals with upper versus lower motor neuron lesions: a randomized controlled trial. Arch Phys Med Rehabil. 2014;95:1023–1031. doi: 10.1016/j.apmr.2013.12.017. [DOI] [PubMed] [Google Scholar]
- 23.Labruyere R, van Hedel HJ. Strength training versus robot-assisted gait training after incomplete spinal cord injury: a randomized pilot study in patients depending on walking assistance. J Neuroeng Rehabil. 2014;11:4. doi: 10.1186/1743-0003-11-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Tang Q, Huang Q, Hu C. Research on Design Theory and Compliant Control for Underactuated Lower-extremity Rehabilitation Robotic Systems code: (51175368); 2012.01-2015.12. J Phys Ther Sci. 2014;26:1597–1599. doi: 10.1589/jpts.26.1597. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Shin JC, Kim JY, Park HK, Kim NY. Effect of robotic-assisted gait training in patients with incomplete spinal cord injury. Annals of rehabilitation medicine. 2014;38:719–725. doi: 10.5535/arm.2014.38.6.719. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Duffell LD, Niu X, Brown G, Mirbagheri MM. Variability in responsiveness to interventions in people with spinal cord injury: Do some respond better than others? Conf Proc IEEE Eng Med Biol Soc. 2014;2014:5872–5875. doi: 10.1109/EMBC.2014.6944964. [DOI] [PubMed] [Google Scholar]
- 27.Field-Fote EC, Lindley SD, Sherman AL. Locomotor training approaches for individuals with spinal cord injury: a preliminary report of walking-related outcomes. J Neurol Phys Ther. 2005;29:127–137. doi: 10.1097/01.NPT.0000282245.31158.09. [DOI] [PubMed] [Google Scholar]
- 28.Postans NJ, Hasler JP, Granat MH, Maxwell DJ. Functional electric stimulation to augment partial weight-bearing supported treadmill training for patients with acute incomplete spinal cord injury: A pilot study. Arch Phys Med Rehabil. 2004;85:604–610. doi: 10.1016/j.apmr.2003.08.083. [DOI] [PubMed] [Google Scholar]
- 29.Dobkin B, Apple D, Barbeau H, et al. Weight-supported treadmill vs over-ground training for walking after acute incomplete SCI. Neurology. 2006;66:484–493. doi: 10.1212/01.wnl.0000202600.72018.39. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Dobkin B, Barbeau H, Deforge D, et al. The evolution of walking-related outcomes over the first 12 weeks of rehabilitation for incomplete traumatic spinal cord injury: the multicenter randomized Spinal Cord Injury Locomotor Trial. Neurorehabil Neural Repair. 2007;21:25–35. doi: 10.1177/1545968306295556. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Lucareli PR, Lima MO, Lima FP, de Almeida JG, Brech GC, D’Andrea Greve JM. Gait analysis following treadmill training with body weight support versus conventional physical therapy: a prospective randomized controlled single blind study. Spinal Cord. 2011;49:1001–1007. doi: 10.1038/sc.2011.37. [DOI] [PubMed] [Google Scholar]
- 32.Dobkin BH. Neuroplasticity. Key to recovery after central nervous system injury. West J Med. 1993;159:56–60. [PMC free article] [PubMed] [Google Scholar]
- 33.Blesch A, Tuszynski MH. Spinal cord injury: plasticity, regeneration and the challenge of translational drug development. Trends Neurosci. 2009;32:41–47. doi: 10.1016/j.tins.2008.09.008. [DOI] [PubMed] [Google Scholar]
- 34.Marino RJ, Barros T, Biering-Sorensen F, et al. International standards for neurological classification of spinal cord injury. J Spinal cord Med. 2003;26(Suppl 1):S50–56. doi: 10.1080/10790268.2003.11754575. [DOI] [PubMed] [Google Scholar]
- 35.Barbeau H, Rossignol S. Recovery of locomotion after chronic spinalization in the adult cat. Brain Res. 1987;412:84–95. doi: 10.1016/0006-8993(87)91442-9. [DOI] [PubMed] [Google Scholar]
- 36.Barbeau H, Danakas M, Arsenault B. The effects of locomotor training in spinal cord injured subjects: a preliminary study. Restor Neurol Neurosci. 1993;5:81–84. doi: 10.3233/RNN-1993-5122. [DOI] [PubMed] [Google Scholar]
- 37.Colombo G, Joerg M, Schreier R, Dietz V. Treadmill training of paraplegic patients using a robotic orthosis. J Rehabil Res Dev. 2000;37:693–700. [PubMed] [Google Scholar]
- 38.Wernig A, Muller S. Laufband locomotion with body weight support improved walking in persons with severe spinal cord injuries. Paraplegia. 1992;30:229–238. doi: 10.1038/sc.1992.61. [DOI] [PubMed] [Google Scholar]
- 39.Harvey LA. Physiotherapy rehabilitation for people with spinal cord injuries. J Physiother. 2016;62:4–11. doi: 10.1016/j.jphys.2015.11.004. [DOI] [PubMed] [Google Scholar]
- 40.Mehrholz J, Kugler J, Pohl M. Locomotor training for walking after spinal cord injury. Cochrane Database Syst Rev. 2012;11:Cd006676. doi: 10.1002/14651858.CD006676.pub3. [DOI] [PubMed] [Google Scholar]
- 41.Nightingale EJ, Raymond J, Middleton JW, Crosbie J, Davis GM. Benefits of FES gait in a spinal cord injured population. Spinal Cord. 2007;45:646–657. doi: 10.1038/sj.sc.3102101. [DOI] [PubMed] [Google Scholar]
- 42.Field-Fote EC. Combined use of body weight support, functional electric stimulation, and treadmill training to improve walking ability in individuals with chronic incomplete spinal cord injury. Arch Phys Med Rehabil. 2001;82:818–824. doi: 10.1053/apmr.2001.23752. [DOI] [PubMed] [Google Scholar]
- 43.Hannold EM, Young ME, Rittman MR, Bowden MG, Behrman AL. Locomotor training: experiencing the changing body. J Rehabil Res Dev. 2006;43:905–916. doi: 10.1682/JRRD.2005.07.0122. [DOI] [PubMed] [Google Scholar]
- 44.Schwartz I, Meiner Z. Robotic-assisted gait training in neurological patients: who may benefit? Ann Biomed Eng. 2015;43:1260–1269. doi: 10.1007/s10439-015-1283-x. [DOI] [PubMed] [Google Scholar]
- 45.Hesse S, Malezic M, Schaffrin A, Mauritz KH. Restoration of gait by combined treadmill training and multichannel electrical stimulation in non-ambulatory hemiparetic patients. Scand J Rehabil Med. 1995;27:199–204. [PubMed] [Google Scholar]
- 46.Billinger SA, Arena R, Bernhardt J, et al. Physical activity and exercise recommendations for stroke survivors: a statement for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2014;45:2532–2553. doi: 10.1161/STR.0000000000000022. [DOI] [PubMed] [Google Scholar]
- 47.Hoekstra F, van Nunen MP, Gerrits KH, Stolwijk-Swuste JM, Crins MH, Janssen TW. Effect of robotic gait training on cardiorespiratory system in incomplete spinal cord injury. J Rehabil Res Dev. 2013;50:1411–1422. doi: 10.1682/JRRD.2012.10.0186. [DOI] [PubMed] [Google Scholar]
- 48.Gordon KE, Wald MJ, Schnitzer TJ. Effect of parathyroid hormone combined with gait training on bone density and bone architecture in people with chronic spinal cord injury. PM R. 2013;5:663–671. doi: 10.1016/j.pmrj.2013.03.032. [DOI] [PubMed] [Google Scholar]
- 49.Freivogel S, Mehrholz J, Husak-Sotomayor T, Schmalohr D. Gait training with the newly developed ‘LokoHelp’-system is feasible for non-ambulatory patients after stroke, spinal cord and brain injury. A feasibility study. Brain Inj. 2008;22:625–632. doi: 10.1080/02699050801941771. [DOI] [PubMed] [Google Scholar]
- 50.Hesse S, Waldner A, Tomelleri C. Innovative gait robot for the repetitive practice of floor walking and stair climbing up and down in stroke patients. J Neuroeng Rehabil. 2010;7:30. doi: 10.1186/1743-0003-7-30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Louie DR, Eng JJ, Lam T. Spinal Cord Injury Research Evidence Research T. Gait speed using powered robotic exoskeletons after spinal cord injury: a systematic review and correlational study. J Neuroeng Rehabil. 2015;12:82. doi: 10.1186/s12984-015-0074-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Freivogel S, Schmalohr D, Mehrholz J. Improved walking ability and reduced therapeutic stress with an electromechanical gait device. J Rehabil Med. 2009;41:734–739. doi: 10.2340/16501977-0422. [DOI] [PubMed] [Google Scholar]
- 53.Mehrholz J, Pohl M. Electromechanical-assisted gait training after stroke: a systematic review comparing end-effector and exoskeleton devices. J Rehabil Med. 2012;44:193–199. doi: 10.2340/16501977-0943. [DOI] [PubMed] [Google Scholar]
- 54.Hesse S, Sarkodie-Gyan T, Uhlenbrock D. Development of an advanced mechanised gait trainer, controlling movement of the centre of mass, for restoring gait in non-ambulant subjects. Biomedizinische Technik Biomed Eng. 1999;44:194–201. doi: 10.1515/bmte.1999.44.7-8.194. [DOI] [PubMed] [Google Scholar]
- 55.Yang JF, Musselman KE. Training to achieve over ground walking after spinal cord injury: a review of who, what, when, and how. J Spinal Cord Med. 2012;35:293–304. doi: 10.1179/2045772312Y.0000000036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Dobkin BH, Duncan PW. Should body weight-supported treadmill training and robotic-assistive steppers for locomotor training trot back to the starting gate? Neurorehabil Neural Repair. 2012;26:308–317. doi: 10.1177/1545968312439687. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Stevenson AJ, Mrachacz-Kersting N, van Asseldonk E, Turner DL, Spaich EG. Spinal plasticity in robot-mediated therapy for the lower limbs. J Neuroeng Rehab. 2015;12:81. doi: 10.1186/s12984-015-0073-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Knikou M. Functional reorganization of soleus H-reflex modulation during stepping after robotic-assisted step training in people with complete and incomplete spinal cord injury. Exp Brain Res. 2013;228:279–296. doi: 10.1007/s00221-013-3560-y. [DOI] [PubMed] [Google Scholar]
- 59.Wu M, Hornby TG, Landry JM, Roth H, Schmit BD. A cable-driven locomotor training system for restoration of gait in human SCI. Gait Posture. 2011;33:256–260. doi: 10.1016/j.gaitpost.2010.11.016. [DOI] [PubMed] [Google Scholar]
- 60.Wu M, Landry JM, Schmit BD, Hornby TG, Yen SC. Robotic resistance treadmill training improves locomotor function in human spinal cord injury: a pilot study. Arch Phys Med Rehabil. 2012;93:782–789. doi: 10.1016/j.apmr.2011.12.018. [DOI] [PubMed] [Google Scholar]
- 61.Lam T, Pauhl K, Ferguson A, et al. Training with robot-applied resistance in people with motor-incomplete spinal cord injury: Pilot study. J Rehabil Res Dev. 2015;52:113–129. doi: 10.1682/JRRD.2014.03.0090. [DOI] [PubMed] [Google Scholar]
- 62.Drew T, Jiang W, Widajewicz W. Contributions of the motor cortex to the control of the hindlimbs during locomotion in the cat. Brain Res Brain Res Rev. 2002;40:178–191. doi: 10.1016/S0165-0173(02)00200-X. [DOI] [PubMed] [Google Scholar]
- 63.Evans D. Hierarchy of evidence: a framework for ranking evidence evaluating healthcare interventions. J Clin Nurs. 2003;12:77–84. doi: 10.1046/j.1365-2702.2003.00662.x. [DOI] [PubMed] [Google Scholar]