Abstract
Introduction
Aging and age-associated disorders such as Parkinson’s disease (PD) are often associated with turning difficulties, which can lead to falls and fractures. Valid assessment of turning and turning deficits specifically in non-standardized environments may foster specific treatment and prevention of consequences.
Methods
Relative orientation, obtained from 3D-accelerometer and 3D-gyroscope data of a sensor worn at the lower back, was used to develop an algorithm for turning detection and qualitative analysis in PD patients and controls in non-standardized environments. The algorithm was validated with a total of 2,304 turns ≥90° extracted from an independent dataset of 20 PD patients during medication ON- and OFF-conditions and 13 older adults. Video observation by two independent clinical observers served as gold standard.
Results
In PD patients under medication OFF, the algorithm detected turns with a sensitivity of 0.92, a specificity of 0.89, and an accuracy of 0.92. During medication ON, values were 0.92, 0.78, and 0.83. In older adults, the algorithm reached validation values of 0.94, 0.89, and 0.92. Turning magnitude (difference, 0.06°; SEM, 0.14°) and duration (difference, 0.004 s; SEM, 0.005 s) yielded high correlation values with gold standard. Overall accuracy for direction of turning was 0.995. Intra class correlation of the clinical observers was 0.92.
Conclusion
This wearable sensor- and relative orientation-based algorithm yields very high agreement with clinical observation for the detection and evaluation of ≥90° turns under non-standardized conditions in PD patients and older adults. It can be suggested for the assessment of turning in daily life.
Keywords: six degrees of freedom, accelerometer, daily activities, gyroscope, older adults, Parkinson’s disease, turning
Introduction
Turning is a regularly performed movement relevant for the successful performance of daily life activities. It requires multi-limb coordination and continuous change of center of mass (1) and thus provides information about dynamic balance aspects (2). It is, therefore, not surprising that turning deficits are associated with increased risk of falling (3, 4), with consequences such as fractures (5) and increased risk of mortality (6). Turning deficits are commonly observed in older adults (7) and patients with Parkinson’s disease (PD) (8, 9). For example, older adults with difficulties in turning show more staggering during turns, take more steps, and show a longer duration to complete one turn than do young adults. PD patients turn slower and require more steps to complete one turn, compared to young adults. Therefore, valid assessment of this movement and its deficits, in particular in unobserved environments in these cohorts, may have a large potential for the design of specific treatment approaches and for prevention of severe consequences.
Assessment of turning is not trivial. Optical systems, which have been widely used in previous experiments (7, 10–12), are costly and can only be used in the laboratory. Wearable sensors are a promising alternative (13–16). They are relatively small (therefore minimally obstruct normal behavior), cheap, assess unlimited movement areas as they are worn on the body, collect data independently from other sources, and have the ability to measure over days and even weeks. As a consequence, they are ideal data collectors in non-standardized (i.e., unconstrained, natural, home) environments over long periods of time. Algorithms for the analysis of turning movements for young and older adults (17) and PD patients (9) have already been published. However, they suffer from downsides that may hinder a wide use in clinical routine and large studies. A particularly interesting publication with regard to the results presented here (9) analyzed a circuit, walked by 21 PD patients and 19 older adults in the lab, with short straight walks interspersed with 10 turns of 45°, 90°, 135°, and 180° under slow, self-preferred, and fast speeds. During the assessments, participants wore a sensor at the lower back. An algorithm built on nine degrees of freedom (9DOF, which means using data from accelerometer, gyroscope, and magnetometer) fusion extracted turning frequency, which was then compared against video observation and motion capture analysis. The algorithm yielded a sensitivity of 0.75 (rater 1) and 0.77 (rater 2), and a specificity of 0.60/0.69. This previously published algorithm was validated only in standardized conditions, where the path of walking and the number and magnitude of turns have been pre-defined. Thus, the accuracy under free-living like conditions has not been determined in previous work.
Based on these preliminary but promising results, we set out to develop an improved algorithm for turning detection and analysis for PD patients and older adults in a non-standardized environment based on six degrees of freedom (6DOF, using data from accelerometer and gyroscope) signal information, using data extracted from a sensor worn on the lower back. This method was validated in non-standardized free-living-like conditions, during a reasonably long testing period (90 min for controls and 180 min for PD patients). The method also redefined turn hesitations, to cover more discrete turns. Here, we present details of the algorithm and results on its validation.
Methods
Study Participants and Settings
The study was performed at the University Hospital Tübingen. Twenty-five patients were recruited from the ward and the outpatient clinic. Fourteen spouses of the patients served as controls. Inclusion criteria were age between 50 and 90 years and, for PD patients, a Hoehn and Yahr (H&Y) score between 1 and 3. Exclusion criteria were deep brain stimulation and a Mini-Mental State Examination score <24. Patients were diagnosed by experienced movement disorders specialists. Controls underwent a neurological examination to exclude presence of neurological symptoms indicative of a neurodegenerative process. Details are provided in Ref. (18). The protocol (nr. 399/2012BO2) was approved by the local ethics committee on 27 September 2012 and was in accordance with the Declaration of Helsinki. All participants gave informed written consent before the assessments.
Duration of the assessment was approximately 90 min per participant and medication condition. PD patients were assessed during medication ON and OFF. Comparable to Ref. (19), medication OFF was defined as overnight withdrawal from dopaminergic medication, and medication ON as the study participant’s perception of having a “Good On Phase,” after regular intake of medication. The assessment consisted of daily activity-like procedures, such as walking in the rooms and corridors of the lab environment without restriction, opening and closing doors, climbing stairs, performing transfers such as sit-to-stand, sit-to-walk, stand-to-sit and walk-to-sit, brushing teeth, making coffee, drinking a cup of tea, and ironing (18). During the assessments, the participants wore a sensor on the lower back (OPAL system, APDM, Inc., Portland, OR, USA). One of the coauthors followed and recorded the objects with a video camera. The camera has a resolution of 1,920 × 1,080 pixels, and a sampling frequency of 50 Hz. The synchronization between sensors and videos was guaranteed with an additional inertial measurement unit (IMU) worn on the ankle, when participants performed specific movements [foot tapping during Unified Parkinson’s Disease Rating Scale (UPDRS) performance]. The IMU at the back and the IMU on the ankle were synchronized as described on the homepage of the IMU provider (APDM) (20). These videotapes were evaluated by two independent clinical observers. For both the algorithm and the clinical observers, a turn was defined as a movement around the vertical axis during standing or walking within 0.1 to 10 s. Clinical observers rated every vertical rotation ≥45° as a turn, while the algorithm rated ≥45°, ≥60°, ≥70°, ≥80°, ≥90°, ≥100°, ≥110° as different turn thresholds. All turns detected during the blind-spot periods (i.e., when the hip of the study participants was out of the camera field) were removed (8% of sensor-detected turns). In addition, the motor part of the UPDRS (UPDRS-III) was administered in PD patients during medication ON and OFF separately (21).
The cohort was then split into a training cohort for algorithm development and a test cohort for algorithm validation. For the iterative algorithm development process [phase A according to Ref. (22)], sensor and videotape data of the above-mentioned daily activity-like procedures from five PD (both ON- and OFF-conditions) patients and one control were included. We selected PD patients with relatively “difficult” conditions, such as dyskinesia and tremor, for the detection of turns, to give the algorithm developer (MHP) the opportunity to iteratively train the algorithm under challenging conditions. Turns of this cohort were also used to define the most useful magnitude threshold of a turn to be implemented in the algorithm for further analyses. For the validation phase [phase B according to Ref. (22)], sensor and clinical observer data of the daily activity-like procedures from the remaining 20 PD patients and 13 controls were included. Detailed demographic and clinical information about the training and test cohorts is provided in Table 1.
Table 1.
PD | Older adults | |
---|---|---|
Training cohort | ||
N (females) | 5 (3) | 1 (1) |
Age (years) | 71 (4) | 51 |
UPDRS III (0–132) | 23 (10) | 3 (0) |
H&Y (0–5) | 2 (1) | 0 (0) |
LED (mg) | 713 (640) | (0) |
Test cohort | ||
N (females) | 20 (10) | 13 (6) |
Age (years) | 66 (9) | 60 (10) |
UPDRS III (0–132) | 32 (12) | 2 (4) |
H&Y (0–5) | 3 (1) | 0 (0) |
LED (mg) | 839 (622) | 0 (0) |
Data are shown as mean ± SD, except gender and observed turns.
H&Y, Hoehn & Yahr; LED, Levodopa equivalent dose; PD, Parkinson’s disease; UPDRS, Unified Parkinson’s Disease Rating Scale III, motor part of the revised Unified PD Rating scale.
Algorithm Development and Structure
The development of the algorithm for turning detection and analysis was performed with MATLAB R2015b and consisted of three steps: 6DOF attitude estimation, turning detection, and turning analysis (Figure 1).
6DOF Attitude Estimation Based on Relative Orientation
The basic principle of the 6DOF attitude estimation is built on the relative orientation of the sensor with respect to the reference frame (global frame, G-frame), using a rotation matrix GSR (S stands for sensor frame, S-frame). Each frame is considered by definition a triad of the orthogonal vectors X, Y, Z (Figure 2A). GSR expresses the difference between the G- and S-frame in a 3 × 3 matrix. The definition of GSR will then be , where describe the axes of the G-frame expressed in the S-frame.
The inclination of the sensor is described by the angle ø relative to gravity, which is chosen to be our Z vector (Figure 2B): GZ =[0 0 1]T, and . is calculated from the first phase of the measurement when five samples of the accelerometer data (ax ay az) are stable (in the first 3.9% of a second in case of a sampling rate of 128 Hz, “stable” is defined as peak-to-peak change in accelerometer amplitude ).
Then, was randomly chosen as [1 0 0]T. The cross product between and gives . From this result, the cross product between and was again calculated, to guarantee orthogonality:
The magnitudes of the respective vectors were normalized to assure that they have unit length. Then they constitute the initial relative orientation of the sensor, GSR.
Changes in orientation were then determined from GSR and Gw, where Gw was calculated from the sensor gyroscope output Sw (=[Swx Swy Swz]T), based on the formula
GSR is updated every sample (1/fs) by the following formula (23)
with c is cos(θ), s is sin(θ), t is 1 − cos(θ), and θ is the angle of rotation = Norm(w)/fs. Note that the S before the w is not displayed for readability issues.
In a final step of the 6DOF attitude estimation, GSR was converted to Euler angles (roll–pitch–yaw) for the detection of turning, where roll represents the angle displacements around X, pitch around Y, and yaw around Z. Only yaw (i.e., the angular displacement around the Z axis) was considered for the next step (see Turning Detection). Note that with choosing to be [1 0 0]T, yaw was initially chosen as 0.
Turning Detection
Angular displacement around the Z axis was then plotted as shown in Figure 3A (blue line). This line was then cut into pieces (Figure 3B), where the start of a turn to the right was defined by a change from an increase to a decrease and the end by the change from a decrease to an increase. For the definition of a turn to the left, the situation was defined vice versa. The duration (horizontal component of the line) and magnitude (vertical component of the line) of each turn were determined between the start to end of the turn.
Initially, a threshold of 45° for the magnitude of a turn was introduced, and the training data set was analyzed and compared with data obtained from clinical observation. We learned from this analysis that the algorithm split some turns into two turns, when the clinical observers only saw one turn. When analyzing this issue in more detail, we realized that this phenomenon could be explained by subtle hesitations within turns (Figure 3C), which were detected by the algorithm but not by the clinical eye. To adapt the algorithm to the gold standard, a movement with a duration less than 0.5 s and a magnitude less than 10% of the magnitude of the previous and following turns (each must be greater than 10° and have the same direction) was defined as a hesitation, and two turns separated by such a hesitation were defined as one single turn.
Turning Analysis
Turn magnitude and duration were extracted using flags from the previous turning detection part (Figure 3A). Turn direction was identified by integration of raw data from the gyroscope. A negative integration value was defined as a left turn and a positive integration as a right turn.
Statistical Analysis
The degree of agreement for turn detection between the two clinical observers was calculated using interclass correlation. Turns that were differently classified by the clinical observers (LH and ME) regarding presence (present/absent), were discussed posteriorly until consensus was reached, to provide a gold standard data set with perfect agreement for the validation of the algorithm. In case of doubt, a third clinical observer (WM) was involved in the decision process.
Then, data from the training cohort were used to calculate true positive, true negative, false positive, and false negative values for presence of turns based on increasing magnitude thresholds of turns (45°–110°) implemented in the algorithm (comparing with 45° threshold for turns detected by clinical observers). The threshold for automatic detection was selected, taking into account the occurrence of turns detected in the analysis and the agreement to the clinical-observer-determined turns. Inter-rater agreement to detect turns and also the agreement between the clinical observers and the algorithm to identify these episodes was compared with Cohen’s kappa value.
The turns extracted from the test data by the algorithm and the clinical observers were used to calculate sensitivity, specificity, accuracy, positive predictive value, and negative predictive value for turns above the selected threshold. Agreement on time at which turns were detected by algorithm and by the clinical observers was assessed using Bland–Altman plots.
Turn magnitude, duration, and direction were extracted from videos by LH and ME. These results were compared with results yielded by the algorithm using Bland–Altman plots and Chi square. Analyses were performed using JMP 12.2.0 software.
Results
Cohorts
Demographic and clinical data of PD patients and controls included in the training and test cohorts, respectively, are presented in Table 1. Cohen’s kappa value between the two clinical observers for the detection of turns in the video tapes was 0.92.
Algorithm Development Group
A total number of 1,035 turns ≥45° were detected by the algorithm, and 758 by the clinical observers. Comparison between algorithm and clinical observer data, using ascending turn magnitude thresholds in the algorithm, revealed that the most practical result was obtained using a threshold of 90° (Table 2). This threshold was then implemented in the algorithm and used for further analyses.
Table 2.
Turning angle | Cohen’s kappa | Accuracy | Sens | Spec | PPV | NPV | True positive turns | False positive turns |
---|---|---|---|---|---|---|---|---|
≥45° | 0.15 | 0.66 | 0.92 | 0.21 | 0.67 | 0.59 | 694 | 341 |
≥60° | 0.53 | 0.78 | 0.91 | 0.61 | 0.76 | 0.82 | 627 | 194 |
≥70° | 0.64 | 0.83 | 0.91 | 0.71 | 0.82 | 0.85 | 607 | 148 |
≥80° | 0.68 | 0.84 | 0.90 | 0.77 | 0.83 | 0.87 | 586 | 123 |
≥90° | 0.72 | 0.86 | 0.90 | 0.82 | 0.85 | 0.88 | 565 | 98 |
≥100° | 0.76 | 0.88 | 0.90 | 0.86 | 0.87 | 0.89 | 529 | 82 |
≥110° | 0.77 | 0.89 | 0.89 | 0.88 | 0.88 | 0.90 | 511 | 72 |
758 turns ≥45° defined by video observation were included.
As expected, validation values improved with increasing magnitude of turns, at the expense of number of turns included in the analysis. Based on these values, we decided to use a threshold magnitude of 90° for validation purposes.
NPV, negative predictive value; PPV, positive predictive value, Sens, sensitivity; Spec, specificity.
Algorithm Validation Group
Based on the 90° turn magnitude threshold, the Bland–Altman plots for the detection of a turn showed a mean difference of −0.03 s (SEM, 0.02 s; 95% confidence interval, −2.25 to 2.20 s) for the detection of corresponding turns (Figure 4). Accuracies for detection of turns were 0.91 (overall cohort), 0.92 (PD patients under medication OFF-condition), 0.83 (PD patients under medication ON-condition), and 0.92 (controls). Turn magnitude as calculated by the algorithm was similar to gold standard (155.09° with clinical observers, 155.15° with the algorithm). The mean difference was −0.06° (SEM, 0.14°). Turning duration as calculated by the algorithm was also similar to gold standard (2.44 s with clinical observers, 2.43 s with the algorithm). Turning duration difference between gold standard and algorithm was 0.004 s (SEM, 0.005 s). Turn direction identification reached an accuracy of 0.995. Table 3 presents detailed results about the validation of turn detection and evaluation.
Table 3.
Cohorts | Cohen’s kappa | Acc | Sens | Spec | NPV | PPV | Turns detected by algorithm | Turns detected by clinical observers | True positive turns | False positive turns | True negative turns | False negative turns |
---|---|---|---|---|---|---|---|---|---|---|---|---|
All | 0.82 | 0.91 | 0.93 | 0.89 | 0.90 | 0.92 | 2,393 | 2,304 | 2,150 | 243 | 1,884 | 154 |
PD ON-med. | 0.68 | 0.83 | 0.92 | 0.78 | 0.74 | 0.93 | 681 | 652 | 602 | 79 | 609 | 50 |
PD OFF-med. | 0.84 | 0.92 | 0.94 | 0.89 | 0.92 | 0.93 | 934 | 905 | 843 | 91 | 688 | 62 |
Controls | 0.84 | 0.92 | 0.94 | 0.89 | 0.91 | 0.93 | 778 | 747 | 705 | 73 | 587 | 42 |
Acc, accuracy; NPV, negative predictive value; PD, Parkinson’s disease; OFF, medication off state; ON, medication on state; PPV, positive predictive value; Sens, sensitivity; Spec, specificity.
Validation values on a sample by sample basis are comparable (not shown).
Discussion
In this study, we present an improved method for the analysis of turns in a real-life-like environment based on 6DOF data from a sensor worn on the lower back, with very high sensitivity, specificity and accuracy, and highly accurate turn metrics, compared against video observation. We focused on turning, as this activity is highly relevant for the proper performance of daily activities: on average, this movement is performed about 1,000 times per day [(8) and own observations in PD patients]. It is associated with dynamic balance capacity (2) and risk of falling (3, 4) in both, older adults and PD patients.
The algorithm reached a Cohen’s kappa value of 0.72 with visual observation. This value reflects a substantial agreement (25) of the algorithm with the gold standard and supports the usefulness of the algorithm for unobserved measurements. However, it does not consider possible errors in activities such as driving and cycling. These potential sources of error need further investigation.
The increase of accuracy with increasing magnitude of a turn (as shown in Table 2) is mainly driven by (shortcomings of) the gold standard and not by algorithm limitations. It is difficult to estimate turn magnitude with naked eyes. This explains why the performance improves with increasing thresholds, as larger turns are more evident. Nevertheless, we feel that a validated algorithm collecting turning information with this magnitude or larger in free-living environments should cover most daily relevant aspects of this movement.
The algorithm experienced relatively low specificity for PD patients under medication ON-condition. When going into the video data, we learned that the algorithm had problems in detecting turns with large radius in these patients. The algorithm split the large turns into several little turns below 45° threshold, which led to more false negative turns. When we increased the hesitation values included in the algorithm, it decreased the sensitivity values, accordingly.
When these issues are sufficiently considered, we believe that the algorithm, which can be applied to almost all currently available sensor systems (i.e., with accelerometer and gyroscope) worn at the lower back, is applicable for home-based assessment of turning in the investigated cohorts. The algorithm for turning detection and analysis presented here can be of particular value, as it also provides highly valid parameters for the estimation of the quality of respective turns, such as magnitude, duration, and direction of the turn.
This algorithm has some limitations. First, as illustrated in Figure 3A, the orientation estimates during the periods from 0 to 10, 25 to 30, 43 to 50, and 55 to 60 s, during which the participant was not moving, slightly decrease. The reason is that gyroscopes have small biases, which will be integrated over time and will change yaw. However, this slow tendency has a negligible effect on detection of faster dynamics such as turning. Hence, no further action was taken to eliminate this error, also to keep computational load as low as possible. This yaw integration error could be reduced with a magnetometer (compass), i.e., using a 9DOF sensor. However, we abstained from including magnetometer data in our algorithm, as it could reduce the specificity of results. Magnetometers are influenced by ferromagnetic objects, which are regularly encountered in daily life environments. Another limitation may be the videotaping approach. We followed the study participants with a hand-held camera and missed some turns when they were out of camera range. However, we argue that the number of turns during those periods were only 8% of the total number of turns. A strength of the algorithm is that it takes turn hesitations into consideration, i.e., the algorithm decides, based on an empirically defined threshold, when a no-turning phase is too short to separate one turn from another. This is a relevant addition particularly for PD patients, as hesitations during a turn occur relatively often and would lead to an overestimation of the numbers of turns and to relevant issues when qualitative parameters are extracted from respective turns. Moreover, sensors without magnetometer are readily available and easily accessible.
In conclusion, this study reports about high validity values of an algorithm for the detection and analysis of turns in older adults and PD patients based on 6DOF inertial sensor data worn on the lower back.
Author Contributions
MP and WM were responsible for the conception and design of the study. ME, TH, LH, DS, DB, and WM contributed to acquisition of data. MP, ME, LH, MH, GF, AS-F, DS, JD, and WM were involved in analysis and interpretation of data. MP and WM drafted the first version of the article. MP, ME, LH, MH, JF, AS-F, DS, JD, and WM revised it critically for important intellectual content. All authors gave final approval of the version to be submitted.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The authors thank all individuals who took part in the study. We acknowledge financial support by Land Schleswig-Holstein within the funding programme Open Access Publikationsfonds.
Funding
The study was supported by the EU project SENSE-PARK, funded under the Seventh Framework Programme, Cooperation-ICT, #288557 and by Lundbeck. The funding sources did not have any role in conception and design of the study, acquisition, analysis and interpretation of data, and in writing of the manuscript.
References
- 1.Mellone S, Mancini M, King LA, Horak FB, Chiari L. The quality of turning in Parkinson’s disease: a compensatory strategy to prevent postural instability? J Neuroeng Rehabil (2016) 13:39. 10.1186/s12984-016-0147-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Schoneburg B, Mancini M, Horak F, Nutt JG. Framework for understanding balance dysfunction in Parkinson’s disease. Mov Disord (2013) 28(11):1474–82. 10.1002/mds.25613 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Stack E, Jupp K, Ashburn A. Developing methods to evaluate how people with Parkinson’s disease turn 180 degrees: an activity frequently associated with falls. Disabil Rehabil (2004) 26(8):478–84. 10.1080/09638280410001663085 [DOI] [PubMed] [Google Scholar]
- 4.Stack EL, Ashburn AM, Jupp KE. Strategies used by people with Parkinson’s disease who report difficulty turning. Parkinsonism Relat Disord (2006) 12(2):87–92. 10.1016/j.parkreldis.2005.08.008 [DOI] [PubMed] [Google Scholar]
- 5.Coughlin L, Templeton J. Hip fractures in patients with Parkinson’s disease. Clin Orthop Relat Res (1980) (148):192–5. [PubMed] [Google Scholar]
- 6.Bennett DA, Beckett LA, Murray AM, Shannon KM, Goetz CG, Pilgrim DM, et al. Prevalence of parkinsonian signs and associated mortality in a community population of older people. N Engl J Med (1996) 334(2):71–6. 10.1056/NEJM199601113340202 [DOI] [PubMed] [Google Scholar]
- 7.Thigpen MT, Light KE, Creel GL, Flynn SM. Turning difficulty characteristics of adults aged 65 years or older. Phys Ther (2000) 80(12):1174–87. 10.1093/ptj/80.12.1174 [DOI] [PubMed] [Google Scholar]
- 8.Mancini M, El-Gohary M, Pearson S, McNames J, Schlueter H, Nutt JG, et al. Continuous monitoring of turning in Parkinson’s disease: rehabilitation potential. NeuroRehabilitation (2015) 37:3–10. 10.3233/NRE-151236 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.El-Gohary M, Pearson S, McNames J, Mancini M, Horak F, Mellone S, et al. Continuous monitoring of turning in patients with movement disability. Sensors (Basel) (2013) 14(1):356–69. 10.3390/s140100356 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Davis RB, Õunpuu S, Tyburski D, Gage JR. A gait analysis data collection and reduction technique. Hum Mov Sci (1991) 10(5):575–87. 10.1016/0167-9457(91)90046-Z [DOI] [Google Scholar]
- 11.Stack E, Ashburn A. Dysfunctional turning in Parkinson’s disease. Disabil Rehabil (2008) 30(16):1222–9. 10.1080/09638280701829938 [DOI] [PubMed] [Google Scholar]
- 12.Thigpen MT, Light KE, Creel GL, Flynn SM. Impaired mobility and Parkinson’s disease. Disabil Rehabil (2000) 30:1204. 10.1080/09638280701828898 [DOI] [PubMed] [Google Scholar]
- 13.Maetzler W, Domingos J, Srulijes K, Ferreira JJ, Bloem BR. Quantitative wearable sensors for objective assessment of Parkinson’s disease. Mov Disord (2013) 28(12):1628–37. 10.1002/mds.25628 [DOI] [PubMed] [Google Scholar]
- 14.Hobert MA, Maetzler W, Aminian K, Chiari L. Technical and clinical view on ambulatory assessment in Parkinson’s disease. Acta Neurol Scand (2014) 130(3):139–47. 10.1111/ane.12248 [DOI] [PubMed] [Google Scholar]
- 15.Maetzler W, Rochester L. Body-worn sensors – the brave new world of clinical measurement? Mov Disord (2015) 30(9):1203–5. 10.1002/mds.26317 [DOI] [PubMed] [Google Scholar]
- 16.Sánchez-Ferro Á, Elshehabi M, Godinho C, Salkovic D, Hobert MA, Domingos J, et al. New methods for the assessment of Parkinson’s disease (2005 to 2015): a systematic review. Mov Disord (2016) 31:1283–92. 10.1002/mds.26723 [DOI] [PubMed] [Google Scholar]
- 17.Mancini M, Schlueter H, El-Gohary M, Mattek N, Duncan C, Kaye J, et al. Continuous monitoring of turning mobility and its association to falls and cognitive function: a pilot study. J Gerontol A Biol Sci Med Sci (2016) 71(B):1102–8. 10.1093/gerona/glw019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Ramsperger R, Meckler S, Heger T, van Uem J, Hucker S, Braatz U, et al. Continuous leg dyskinesia assessment in Parkinson’s disease – clinical validity and ecological effect. Parkinsonism Relat Disord (2016) 26:41–6. 10.1016/j.parkreldis.2016.02.007 [DOI] [PubMed] [Google Scholar]
- 19.Elshehabi M, Maier KS, Hasmann SE, Nussbaum S, Herbst H, Heger T, et al. Limited effect of dopaminergic medication on straight walking and turning in early-to-moderate Parkinson’s disease during single and dual tasking. Front Aging Neurosci (2016) 8:4. 10.3389/fnagi.2016.00004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.APDM. Mobility Lab User’s Guide. (2014). Available from: http://share.apdm.com/mobility_lab/docs/MobilityLab_UserGuide.pdf
- 21.Goetz CG, Fahn S, Martinez-Martin P, Poewe W, Sampaio C, Stebbins GT, et al. Movement disorder society-sponsored revision of the unified Parkinson’s disease rating scale (MDS-UPDRS): process, format, and clinimetric testing plan. Mov Disord (2007) 22(1):41–7. 10.1002/mds.21198 [DOI] [PubMed] [Google Scholar]
- 22.Maetzler W, Klucken J, Horne MK. A clinical view on the development of technology-based tools in managing Parkinson’s disease. Mov Disord (2016) 31(9):1263–71. 10.1002/mds.26673 [DOI] [PubMed] [Google Scholar]
- 23.Confuted, Thibault C. Part Three: 3D Rotation About an Arbitrary Axis. Available from: http://www.cprogramming.com/tutorial/3d/rotation.html
- 24.Dunn F, Parberry I, Fallis A. 2nd ed In: Peters AK. editor. 3D Math Primer for Graphics and Game Development. Texas: CRC Press; (2011). [Google Scholar]
- 25.Viera AJ, Garrett JM. Understanding interobserver agreement: the Kappa statistic. Fam Med (2005) 37(5):360–3. [PubMed] [Google Scholar]