Skip to main content
PLOS One logoLink to PLOS One
. 2020 Jul 24;15(7):e0236437. doi: 10.1371/journal.pone.0236437

Reliability of the thumb localizing test and its validity against quantitative measures with a robotic device in patients with hemiparetic stroke

Eri Otaka 1, Yohei Otaka 1,2,*, Shoko Kasuga 3,4, Atsuko Nishimoto 1, Kotaro Yamazaki 1, Michiyuki Kawakami 1, Junichi Ushiba 3,5, Meigen Liu 1
Editor: François Tremblay6
PMCID: PMC7380647  PMID: 32706817

Abstract

Objectives

To examine the inter-rater reliability of the thumb localizing test (TLT) and its validity against quantitative measures of proprioception.

Methods

The TLT was assessed by two raters in a standardized manner in 40 individuals with hemiparetic stroke. Inter-rater reliability was examined with weighted Kappa. For the quantitative measures, a bimanual matching task in a planar robotic device was performed. Without vision, each participant moved the unaffected hand to the perceived mirrored location of the affected hand, which was passively moved by the robot. Three measures were taken after 54 trials: Variability, trial-to-trial variability of the mirrored-matched locations; Area, the ratio of the area enclosed by the active hand relative to the passive hand; and Shift, systematic shifts between the passive and active hands. The correlation between the TLT and each robotic measure was examined with Spearman’s rank correlation coefficient.

Results

The overall weighted kappa of the TLT was 0.84 (P<0.001). The TLT correlated highly with Area (r = -0.71, P<0.001) and moderately with Variability (r = 0.40, P = 0.011). No significant correlation was found between the TLT and Shift.

Conclusions

The TLT had a high inter-rater reliability, and was validated against quantitative measures of proprioception reflecting the perceived area of movement and variability of the limb location.

Introduction

Proprioception is necessary for the control of limb posture, and the coordination of multijoint movements [16]. In stroke patients, proprioceptive deficits are quite common [7, 8] and known to be partly related to motor recovery [9, 10]. As its longitudinal process of recovery has been partly revealed recently [8, 11, 12] and novel rehabilitative approaches are sought more than ever in clinical practice, indispensability for robust assessment tools of proprioception is increasing to accurately evaluate its improvement with progress of time or by any intervention.

Conventionally, the thumb localizing test (TLT) [1315] or similar techniques [9, 16] are widely used for the assessment of proprioception for patients with stroke, both in clinical and research settings. The TLT is a test for “limb localization” and is clinically useful in that it can examine invisible perceptual deficits using a visible motor task and be easily performed at the patient’s bedside, although it is a four-point ordinal scale and thus disadvantageous as a quantification tool in detecting subtle deficits or changes over time compared with continuous scales. In the development of the TLT, Hirayama et al. reported that the TLT showed greater frequency of abnormality than other physical examinations for proprioceptive sensation [15], and the TLT deficits had strong categorical relationship with joint position and movement test, and tactile cutaneous localization test [14]. However, reliability of the TLT has not been precisely shown. Furthermore, validity of the TLT has yet to be revealed because there has been no other conventional assessment of proprioception that is reliable and quantitative enough to be regarded as a reference.

Several groups have designed reliable and objective procedures to quantify proprioception [1719]. Among these, the arm position matching task [20] provided by the KINARM Exoskeleton robotic device (Kinarm, Kingston, ON, Canada) [21] is a robotic assessment which describes kinematic characteristics of the individual’s mirror-matched arm movement, visualizing and quantifying proprioception using a motor task same as the TLT. The measures derived from this robotic task have been shown to be adequately reliable [20] and correlated with the measures of activities of daily living and dexterity in patients with subacute stroke [22], enough to be considered as a reference in a validation study for other assessments. Regarding the TLT, only categorical relationships have been shown with some types of quantitative measures driven by the robotic device [20, 22] in the mixed group of healthy adults and stroke patients. However, no attempt has been made to examine the correlation between the TLT and quantitative measures driven from the device.

To confirm the robustness of the TLT as a clinical measure of proprioception, the present study aimed (1) to examine the inter-rater reliability of the TLT, and (2) to validate the TLT by examining correlation with the quantitative measures derived from the exoskeleton robotic device.

Materials and methods

Participants

The recruited participants included 40 patients with chronic stroke who visited the Department of Rehabilitation Medicine at Keio University Hospital for the rehabilitation of upper extremity paresis from July 2013 to January 2015. Patients with the following criteria were included: more than 150 days since stroke onset; stroke in single cerebral hemisphere; no clinically obvious cognitive deficits; living independently; absence of pain in the paretic upper limb; no impairments in the non-paretic upper limb; ability to maintain sitting position without difficulty; and adequate range of motion in the upper extremity to perform tasks in the KINARM. Patients with history of epilepsy, implants (pacemakers, shunts, or clipping), and those who could not perform the KINARM tasks owing to pain and/or contractures were excluded.

The study protocol was approved by the institutional ethics committee (Keio University School of Medicine Ethics Committee #20120070). All participants gave written informed consent prior to their participation, according to the Declaration of Helsinki.

Clinical assessments

To evaluate the participants’ upper limb impairments, we assessed the affected arm using the Fugl-Meyer Assessment, the part A score of the upper limb section to quantify motor function (0 (worst) - 36 (best)) [23], and the Modified Ashworth Scale for elbow flexors to grade spasticity (0(no spasticity), 1, 1+, 2, 3, 4(rigid)) [24].

Thumb localizing test

In accordance with Hirayama et al. [13, 14], we adhered to the following procedure: an examiner positioned the affected upper limb of the participant at a certain position, and asked participants to pinch the tip of the thumb with the unaffected fingers. For the standardization, three limb positions were defined (Fig 1), and all participants were assessed in the same order. Before each limb position was fixed, the examiner moved the limb multi-directionally to prevent the subject from guessing the limb position based on the starting position. The participants performed the procedure twice, with vision occluded condition (with a blindfold) and with vision restored condition (without a blindfold). This was to analyze the effect of vision, as the importance of visual information in compensating proprioceptive deficit is clinically well known [4, 25].

Fig 1. Procedure of the thumb localizing test (TLT).

Fig 1

A. The reaching limb is on the ipsilateral knee at the start of the test. B. Participants are instructed to pinch the opposite thumb. C. The limb position of the fixed limb: (a) The forearm in the neutral position, with the elbow at 90° of flexion and the shoulder at 0° of flexion. (b) The forearm in the neutral position, with the elbow at 90° of flexion and the shoulder flexed so that the thumb is at the same level as the mouth. (c) The forearm in the neutral position, with the elbow at 90° of flexion and the shoulder internally rotated so that the thumb is over the midline of the trunk. The individuals pictured in this figure have provided written informed consent (as outlined in PLOS consent form) to publish their image alongside the manuscript.

To score the TLT, all performances were recorded on videotape and were independently rated afterwards by two physiatrists; EO, with 6 years of clinical experience and YO, with 18 years of clinical experience. Three physiatrists, EO, YO, KY, with 5 years of clinical experience, and an occupational therapist, AN, with 12 years of clinical experience, served as examiners. As the descriptions of the TLT ratings are slightly different in two papers written by the original authors [13, 15], we adopted the rating of the more recent paper [13]: 0, normal (the reaching limb can go straight and quickly toward the tip of the fixed thumb and pinch it easily); 1, slightly impaired (the fingers are brought several centimeters apart from the fixed thumb and then corrected immediately, or the reaching limb sways on the way); 2, moderately impaired (the reaching limb seeks around the fixed thumb for more than several centimeters, touches the thumb by chance, or reaches the tip of the thumb by tracing from the fixed hand or other fingers); 3, severely impaired (cannot reach the fixed limb at all, or the reaching limb touches the fixed arm by chance and reaches the tip of the thumb by tracing the skin).

Quantitative assessment of proprioception with the robotic device

Robotic device

The KINARM Exoskeleton was used for robotic assessment (Fig 2A). This is a planar robotic device, which has one degree-of-freedom for the shoulder joint (horizontal adduction/abduction) and one for the elbow joint (flexion/extension). It allows free horizontal arm movement, and can monitor shoulder and elbow motion [21]. Participants were initially seated in a modified wheelchair base with each arm set in a trough so that the arms were approximately in the same plane as the shoulder (80–90° abducted), the examiner then slid the whole wheelchair into a planar monitor. Visual feedback or occlusion can be given on the virtual reality display just above the plane of the arms.

Fig 2. The KINARM Exoskeleton robotic device and measures of the arm position matching task.

Fig 2

A. Overview of the robotic apparatus. (a) An overall cartoon depiction (courtesy of Kinarm Ltd., Kingston, Ontario). (b) Frontal view of the wheelchair base and exoskeleton arms. In performing the arm position matching task, the central target, which is the starting position, was set such that the shoulder was at approximately 30º of horizontal abduction and the elbow at 90º of flexion. B. Schema of the arm position matching task. Filled symbols (outlined with solid black lines) represent the positions where the robot moves the passive arm. Open symbols (outlined with solid gray lines) represent where the participants matched the perceived mirrored position with the active arm. The performance of the active arm is mirrored on the passive side using gray dashed lines. Ellipses around targets demonstrate variability of six matching attempts and represent one standard deviation. (a) A typical left-hemiparetic patient with the thumb localization test (TLT) score 0 displays little variability and is relatively accurate in matching the arm position with vision occluded. (b) In the same subject as (a), the matching is more accurate with vision restored. (c) A typical right-hemiparetic participant with the TLT score 3 shows increased variability, contraction of the workspace, and poor performance in overall matching with vision occluded. (d) In the same participant as (c), the accuracy of the matching is improved with vision restored. C. Illustration of the parameters. (a) Variability; trial-to-trial variability of the active hand, (b) Area; the overall spatial area matched by the active hand, (c) Shift; systematic shifts between the active and passive hands. The individual pictured in this figure has provided written informed consent (as outlined in PLOS consent form) to publish his image alongside the manuscript.

Assessment of proprioception

The arm position matching task is a bimanual matching task [20]. The central target, which is the starting position, was set such that the shoulder was at approximately 30º of horizontal abduction and the elbow at 90º of flexion. The subject was instructed to relax the affected arm (passive limb) and allow the robot to move the arm in the horizontal plane to adopt a certain position. The subject was asked to then move the unaffected arm (active limb) to the perceived mirrored location. Starting from the preceding position, each participant performed the matching tasks consecutively for nine spatial targets separated by 10 cm for each block, and six such blocks for a session (total of 54 trials in a session); the order of the target positions in each block was pseudo-randomized. Similar to the TLT, all the participants completed the session twice: first with a shield above the arms so that vision was occluded, and then repeated the task with vision restored (Fig 2B). It took approximately 10–15 minutes per session, and all sessions were usually performed consecutively on the same day. Examiners routinely advised participants to take enough time and rest between the testing sessions to fully concentrate on the task, and most participants needed no rest or only a few minutes. The following robotic measures, calculated using Eqs (1) to (3), were used for the analyses (Fig 2C). These measures have been confirmed as having good inter-rater reliability in patients with stroke [20].

  • Variability: This refers to the trial-to-trial variability of the perceived mirrored location by the active hand. This measure is calculated by calculating the standard deviation of the active hand’s position for each target location, then calculating the mean of the standard deviations for all target locations in the x-coordinate (Variability X) and the y-coordinate (Variability Y). A smaller value for this measure indicates less variability among the repeated attempts.

Variability=(VariabilityX)2+(ValiabilityY)2 (1)
  • Area: This refers to the ratio of the spatial area enclosed by the active hand (representing the perceived workspace of the passive hand) relative to the actual area enclosed by the passive hand. A value of < 1 indicates contraction of the perceived area compared to the actual movement area, while a value of > 1 indicates expansion of the perceived area. A value of 1 indicates a perfect match.

Area=areaactive/areapassive (2)
  • Shift: This indicates the constant bias between the active and passive hands. This measure is calculated by finding the mean error between the active and passive hands for each target location, then calculating the mean of mean errors for all target locations in the x-coordinate (Shift X) and the y-coordinate (Shift Y). A smaller value indicates less bias in the horizontal plane.

Shift=(ShiftX)2+(ShiftY)2 (3)

Analysis

The TLT with vision restored was not considered for the analysis as all participants obtained the normal score (0). The TLT score with vision occluded was adopted for further analysis. Quadratically weighted Kappa [26] was used to examine the inter-rater reliability of the TLT. The strength of agreement with kappa statistics were interpreted as follows: < 0.00, poor; 0–0.20, slight; 0.21–0.40, fair; 0.41–0.60, moderate; 0.61–0.80, substantial; and 0.81–1.00, almost perfect agreement [27]. Any disagreements in the scores were discussed by the two raters and rescored. The median value of the scores in the three positions was selected for the following analysis.

Prior to examining the correlation between the TLT and the robotic measures, each robotic measure with vision occluded and vision restored conditions was compared using the Wilcoxon matched-pairs signed-ranks test to ascertain whether or not the values significantly deteriorated without visual cues in the same manner as the TLT. Then, the correlation between each robot-driven measure with vision occluded and the TLT score was investigated using the Spearman’s rank correlation coefficients. The 95% confidence interval of the Spearman’s rank correlation coefficient was calculated based on Fisher's transformation. The strength of the correlation coefficients was interpreted as described by Guilford [28]: 0.0–0.2, slight; 0.2–0.4, low; 0.4–0.7, moderate; 0.7–0.9, high; and 0.9–1.0, very high correlation. In addition, the values of the robotic measure that correlated best with the TLT were compared between the TLT rating groups (0 to 3) using Kruskal-Wallis rank test with Dunn’s post-hoc test. Statistical analyses were performed with STATA/SE 13.1 (StataCorp., Texas, USA). Any P-value less than 0.05 was considered statistically significant. Through an a priori power analysis for calculating correlation coefficients using G*Power 3.1 [29], we estimated at least a sample size of 29 in total to provide effect size of 0.5, power of 80%, and type 1 error of 0.05.

Results

The clinical characteristics of the participants are presented in Table 1. Participants with a wide range of motor impairments were included. Spasticity of the participants ranged from mild to moderate. Although all the participants obtained the normal score (0) in the vision restored condition, the TLT determined 24 out of 40 participants (60%) as having proprioceptive impairment with vision occluded condition. The overall weighted kappa of the TLT scores between the two raters was 0.84 (P < 0.001), indicating almost perfect agreement (Table 2).

Table 1. Participant characteristics.

Variables (N = 40)
Age, mean ± SD (range) 47.6±12.2 (18–78)
Sex, male/female 25/15
Type of stroke Cerebral infarction 16
Cerebral hemorrhage 23
Subarachnoid hemorrhage 1
Days after the onset of hemiparesis, median (range) 486.5 (164–6456)
Part A score of the Fugl-Meyer Assessment of Upper Extremity on the affected side, median (range) 22 (5–35)
Modified Ashworth scale for elbow flexors in the affected arm, n in [0, 1, 1+, 2, 3, 4] [8, 14, 17, 1, 0, 0]
Thumb localizing test, n in [0, 1, 2, 3] [16, 11, 8, 5]

Table 2. Scores of the thumb localizing test and quadratically weighted kappa.

Scores of rater A, n in [0, 1, 2, 3] Scores of rater B, n in [0, 1, 2, 3] Quadratically weighted kappa P values
Position 1 [15,17,1,7] [15,15,5,5] 0.86 < 0.001
Position 2 [15,12,5,8] [17,7,11,5] 0.86 < 0.001
Position 3 [20,8,9,3] [17,7,11,5] 0.81 < 0.001
Total [50,37,15,18] [49,29,27,15] 0.84 < 0.001

Position 1, the forearm in the neutral position, with the elbow at 90° of flexion, and the shoulder at 0° of flexion; Position 2, the forearm in the neutral position, with the elbow at 90° of flexion, and the shoulder flexed so that the thumb is at the same level as the mouth; Position 3, the forearm in the neutral position, with the elbow at 90° of flexion, and the shoulder internally rotated so that the thumb is over the midline of the trunk.

On comparing each of the robotic measures between the two visual conditions, Variability and Shift were significantly larger with vision occluded than with vision restored (Variability: median value 5.76 cm vs 3.34 cm, P < 0.001; Shift: median value 6.35 cm vs 3.81 cm, P < 0.001). Area was significantly smaller with vision occluded than with vision restored (median value 0.56 vs 0.85, P = 0.010) (Figs 3 and 4).

Fig 3. Comparisons between the measures of arm position matching task with vision occluded and vision restored.

Fig 3

Boxplots of Variability, Area, and Shift are shown with vision occluded (left) and vision restored (right). Error bars indicate standard deviations. ** P < 0.01, * P < 0.05.

Fig 4. Scatterplots of robotic measures with vision occluded and with vision restored in each grade of the thumb localizing test (TLT).

Fig 4

Scatterplots of (A)Variability, (B)Area, and (C)Shift are shown. The dots under the dotted line (y = x) indicate that the value is smaller with vision occluded than with vision restored, and the dots above the dotted line (y = x) indicate that the value is larger with vision occluded than with vision restored. The value of Area < 1 (gray shaded area) implies contraction and > 1 implies expansion of the workspace.

As shown in Table 3, in the correlational analyses between the TLT and the robotic measures, Area correlated most strongly with the TLT with vision occluded condition. This correlation was high and negative. The scatterplot of Area with the two visual conditions (Fig 4) also implies the decrease of Area in the patients with severe impairment (TLT = 2,3). Variability showed moderate correlations with the TLT. The correlation between Shift and the TLT was not significant.

Table 3. Values of the robotic measures with vision occluded and correlations with thumb localizing test.

Measures Median value (range) Spearman’s rho (95% confidence intervals) P values
Variability 5.76 (2.34–18.78) 0.40 (0.10–0.63) 0.011
Area 0.56 (0.01–2.90) -0.71 (-0.84 - -0.51) < 0.001
Shift 6.35 (1.81–18.11) 0.27 (-0.05–0.54) 0.093

On performing the Kruskal-Wallis rank test, the values of Variability (P = 0.049) and Area (P < 0.001) were found to be significantly different across the TLT rating groups, but the values of Shift were not (P = 0.248). Multiple comparisons using Dunn’s post-hoc test revealed that the values for Variability were significantly different between the TLT scores of 0 and 2 (P = 0.039), 0 and 3 (P<0.001), and 1 and 3 (P = 0.017). As for the values for Area, significant differences were seen between the TLT scores of 0 and 1 (P = 0.027), 0 and 2 (P < 0.001), 0 and 3 (P < 0.001), and 1 and 3 (P = 0.015) (Fig 5).

Fig 5. Robotic measures with vision occluded of the arm position matching task in each grade of the thumb localizing test (TLT).

Fig 5

Boxplots of (A)Variability, (B)Area, and (C)Shift are shown. Error bars indicate standard deviations and the lines within the box indicate median values. ** P < 0.01, * P < 0.05 with the Dunn’s test for multiple comparisons.

Discussion

This study examined, for the first time, the reliability of the TLT and its validation against quantitative measure of proprioception derived from the robotic device.

The TLT is the proprioceptive assessment frequently used in both clinical and research settings. Nevertheless, its psychometric properties have not been adequately shown, as was discussed in the Background. Contrary to the previous findings indicating the poor inter-rater reliability of some clinical sensory assessments [30], this study revealed that the TLT had almost perfect inter-rater reliability in the standardized way.

All participants in the present study could successfully reach the opposite thumb in the TLT under vision regardless of their TLT scores in the blindfold condition. Similarly, all three robotic measures were significantly worse in the vision occluded condition, compared to the vision restored condition. The improvement in motor performance when aided by visual information in patients with severely impaired proprioception is known [4, 25]. These findings indicate that clinical measures and robotic assessments have the same characteristics. Although some studies report that vision does not always compensate for kinesthetic impairments in stroke [31, 32], the subjects in these studies were in the relatively early phases (average of less than 2 weeks post stroke). On the contrary, the present study was performed in the chronic phase, in which visuospatial deficits or fatigue were more likely to diminish compared to early or subacute phases post stroke, and thus visual compensation was considered to be more effective than the above-mentioned studies.

The TLT scores were significantly correlated with two of three quantitative measures of proprioception derived from the robotic device. Especially, a high correlation was found with Area in the vision occluded condition; the values of Area decreased as the TLT scores increased. Furthermore, the majority of values for Area in the vision occluded condition were < 1 and smaller than those with vision restored, especially in those with TLT ≥ 2. The findings could be interpreted as showing that, without vision, the participants with worse TLT score might perceive the passive limb movement by the robot to be smaller than the actual movement. This result is quite reasonable considering the procedure of the TLT, in which one judges the thumb position after being moved from the preceding position similar to the robotic task, and it also indicates that the TLT may reflect at least a part of “kinesthetic sensation”, which is generated from muscle spindles in response to limb movement and changes in position [33]. The TLT scores also correlated moderately with Variability. The result seems to be reasonable because Variability is similar to the TLT rating in that it evaluates the gap or sway of the active limb. This measure was also previously reported as having a significant association with the TLT in its ability to discriminate between the normal and abnormal [22, 34], which was confirmed by our study. On the other hand, this study did not show significant correlation between the TLT and Shift. The measure reflects the bias of the expression of the perceived area, and could be influenced by rather other factors such as spatial cognition than proprioception. Therefore, no correlation with Shift may not hamper the validity of the TLT for proprioceptive sensation.

Although no study has examined the correlation between TLT and quantitative measures, i.e. Area, Variability, and Shift, some conflicts were found in a few previous studies [20, 22], where no categorical relationships were demonstrated between the TLT and Area in stroke patients, and significant categorical relationships were found between the TLT and Shift. This difference in the findings may be related to two reasons. First, in our study, an almost perfect inter-rater reliability in the TLT was achieved by standardizing the details of testing and the rating. This is the strong point of the present study, ensuring a robustness of the following analysis. Second, our study investigated chronic patients living independently, which suggests they have mild, if any, cognitive problems. In contrast, the previous studies [20, 22] investigated subacute patients whose functional abilities are various, and thus might have various confounding factors such as disturbance in spatial cognition due to cognitive impairments, including visuospatial neglect [31] or deficits in generalized attention. Our study might successfully focus on sensorimotor impairments with less confounding factors.

In the comparisons between the grades of TLT, Variability and Area were not statistically different and substantially overlapped between grade 1 and 2, and between 2 and 3 of the TLT score. This result suggests that the TLT rating may have some ambiguity in assessing the degree of proprioceptive deficits between these grades. Clinicians should bear in mind that the difference of 1 point in the TLT score between grade 1–3 should not be emphasized. In the context of robotic devices being more objective and quantitative than clinical assessment [3537], the robotic assessment can be considered for further assessment of quantification of proprioception such as research purpose.

This study had a few limitations. First, another study design is needed to study test-retest reliability of the TLT. Second, the generalizability of our findings may be somewhat limited as the present study investigated chronic patients living independently, who were relatively young and high functioning compared to the general stroke population. In addition, further investigation will be needed to generalize our findings to individuals with other pathological conditions. Finally, another study would be required to reveal the relationship between the proprioceptive deficits represented by the TLT and brain lesions that may affect passive kinesthesic sensation or sensorimotor integration, as indicated in recent studies [8, 31].

Conclusions

The present study demonstrated that the TLT had a high inter-rater reliability when the testing procedure was standardized. The TLT correlated highly with the quantitative measures which reflects the perceived area of movement and variability of the limb location. These findings contribute to the robustness of the TLT as a clinical measure. Furthermore, the overlapping of values in quantitative measures between consecutive grades 1–3 of the TLT gave valuable information for interpretation of the TLT score in the clinical settings. In spite of the ordinal nature of the scale, which tends to be a disadvantage when compared with continuous scales, the TLT has proven to be essential as an easily performed and robust tool to detect proprioceptive deficits in clinical scenes.

Supporting information

S1 Data. Data for assessing the inter-rater reliability of the TLT.

Details of the variables are as follows: SubjectNo, an anonymous subject number for the present study only; PareticSide_R1L2, paretic side (1 = right, 2 = left); TL_sv_A1/2/3, the scores of TLT with vision occluded condition by one of the two raters; TL_sv_B1/2/3, the scores of TLT with vision occluded condition by another rater; each number describes three limb positions, as defined in the manuscript (1 = Fig 1C(a), 2 = Fig 1C(b), 3 = Fig 1C(c)).

(XLSX)

S2 Data. Data of participant characteristics, clinical measures, and robotic measures.

Details of the variables are as follows: TYPE_C1_H2_S3, the type of diseases (1 = cerebral infarction, 2 = cerebral hemorrhage, and 3 = subarachnoid hemorrhage); PareticSide_R1L2, paretic side (1 = right, 2 = left); MAS_elbow/wrist/finger, Modified Ashworth scale, originally scaled as 0, 1, 1+, 2, 3, 4, described in the dataset as 0, 1, 2, 3, 4, 5 respectively; Variability_sv, Area_sv, Shift_sv, robotic measures obtained with vision occluded condition; Variability_cv, Area_cv, Shift_cv, robotic measures with vision restored condition; TL_sv_1, TL_sv_2, TL_sv_3, the ultimate TLT scores discussed and rescored by the two raters; TL_sv_median, the median value of the TLT scores in the three limb positions.

(XLSX)

Acknowledgments

We thank Ms. Sawako Ohtaki and Ms. Miho Hiramoto for their technical support.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

This study was supported in part by collaborative research funds from Toyota Tsusho Corporation (https://www.toyota-tsusho.com). The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Rothwell JC, Traub MM, Day BL, Obeso JA, Thomas PK, Marsden CD. Manual motor performance in a deafferented man. Brain: a journal of neurology. 1982;105 (Pt 3):515–42. Epub 1982/09/01. 10.1093/brain/105.3.515 . [DOI] [PubMed] [Google Scholar]
  • 2.Cordo P, Carlton L, Bevan L, Carlton M, Kerr GK. Proprioceptive coordination of movement sequences: role of velocity and position information. Journal of neurophysiology. 1994;71(5):1848–61. Epub 1994/05/01. 10.1152/jn.1994.71.5.1848 . [DOI] [PubMed] [Google Scholar]
  • 3.Gordon J, Ghilardi MF, Ghez C. Impairments of reaching movements in patients without proprioception. I. Spatial errors. Journal of neurophysiology. 1995;73(1):347–60. Epub 1995/01/01. 10.1152/jn.1995.73.1.347 . [DOI] [PubMed] [Google Scholar]
  • 4.Ghez C, Gordon J, Ghilardi MF. Impairments of reaching movements in patients without proprioception. II. Effects of visual information on accuracy. Journal of neurophysiology. 1995;73(1):361–72. Epub 1995/01/01. 10.1152/jn.1995.73.1.361 . [DOI] [PubMed] [Google Scholar]
  • 5.Kita K, Otaka Y, Takeda K, Sakata S, Ushiba J, Kondo K, et al. A pilot study of sensory feedback by transcutaneous electrical nerve stimulation to improve manipulation deficit caused by severe sensory loss after stroke. Journal of neuroengineering and rehabilitation. 2013;10:55 Epub 2013/06/15. 10.1186/1743-0003-10-55 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Carey LM. Somatosensory Loss after Stroke. Crit Rev Phys Rehabil Med. 1995;7(1):51–91. 10.1615/CritRevPhysRehabilMed.v7.i1.40 [DOI] [Google Scholar]
  • 7.Carey LM, Matyas TA. Frequency of discriminative sensory loss in the hand after stroke in a rehabilitation setting. Journal of rehabilitation medicine. 2011;43(3):257–63. Epub 2011/02/10. 10.2340/16501977-0662 . [DOI] [PubMed] [Google Scholar]
  • 8.Kessner SS, Schlemm E, Cheng B, Bingel U, Fiehler J, Gerloff C, et al. Somatosensory Deficits After Ischemic Stroke. Stroke. 2019;50(5):1116–23. Epub 2019/04/05. 10.1161/STROKEAHA.118.023750 . [DOI] [PubMed] [Google Scholar]
  • 9.Kwakkel G, Kollen BJ, van der Grond J, Prevo AJ. Probability of regaining dexterity in the flaccid upper limb: impact of severity of paresis and time since onset in acute stroke. Stroke. 2003;34(9):2181–6. Epub 2003/08/09. 10.1161/01.STR.0000087172.16305.CD . [DOI] [PubMed] [Google Scholar]
  • 10.Winters C, van Wegen EE, Daffertshofer A, Kwakkel G. Generalizability of the Proportional Recovery Model for the Upper Extremity After an Ischemic Stroke. Neurorehabilitation and neural repair. 2015;29(7):614–22. Epub 2014/12/17. 10.1177/1545968314562115 . [DOI] [PubMed] [Google Scholar]
  • 11.Semrau JA, Herter TM, Scott SH, Dukelow SP. Examining Differences in Patterns of Sensory and Motor Recovery After Stroke With Robotics. Stroke. 2015;46(12):3459–69. Epub 2015/11/07. 10.1161/STROKEAHA.115.010750 . [DOI] [PubMed] [Google Scholar]
  • 12.Zandvliet SB, Kwakkel G, Nijland RHM, van Wegen EEH, Meskers CGM. Is Recovery of Somatosensory Impairment Conditional for Upper-Limb Motor Recovery Early After Stroke? Neurorehabilitation and neural repair. 2020;34(5):403–16. Epub 2020/05/12. 10.1177/1545968320907075 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Hirayama K. [Thumb/big-toe localizing test: examination for deficit of proprioception through the posterior column-medial lemniscal system]. Brain and nerve = Shinkei kenkyu no shinpo. 2011;63(8):851–60. Epub 2011/08/06. . [PubMed] [Google Scholar]
  • 14.Hirayama K, Fukutake T, Kawamura M. 'Thumb localizing test' for detecting a lesion in the posterior column-medial lemniscal system. Journal of the neurological sciences. 1999;167(1):45–9. Epub 1999/09/29. 10.1016/s0022-510x(99)00136-7 . [DOI] [PubMed] [Google Scholar]
  • 15.Hirayama K, Fukutake T, Kawamura M. [Thumb localizing test—examination for a disturbance of articular localization]. Rinsho shinkeigaku = Clinical neurology. 1986;26(5):448–54. Epub 1986/05/01. . [PubMed] [Google Scholar]
  • 16.Prescott RJ, Garraway WM, Akhtar AJ. Predicting functional outcome following acute stroke using a standard clinical examination. Stroke. 1982;13(5):641–7. Epub 1982/09/01. 10.1161/01.str.13.5.641 . [DOI] [PubMed] [Google Scholar]
  • 17.Carey LM, Oke LE, Matyas TA. Impaired limb position sense after stroke: a quantitative test for clinical use. Archives of physical medicine and rehabilitation. 1996;77(12):1271–8. Epub 1996/12/01. 10.1016/s0003-9993(96)90192-6 . [DOI] [PubMed] [Google Scholar]
  • 18.Simo L, Botzer L, Ghez C, Scheidt RA. A robotic test of proprioception within the hemiparetic arm post-stroke. Journal of neuroengineering and rehabilitation. 2014;11:77 Epub 2014/06/03. 10.1186/1743-0003-11-77 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Mrotek LA, Bengtson M, Stoeckmann T, Botzer L, Ghez CP, McGuire J, et al. The Arm Movement Detection (AMD) test: a fast robotic test of proprioceptive acuity in the arm. Journal of neuroengineering and rehabilitation. 2017;14(1):64 Epub 2017/07/01. 10.1186/s12984-017-0269-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Dukelow SP, Herter TM, Moore KD, Demers MJ, Glasgow JI, Bagg SD, et al. Quantitative assessment of limb position sense following stroke. Neurorehabilitation and neural repair. 2010;24(2):178–87. Epub 2009/10/02. 10.1177/1545968309345267 . [DOI] [PubMed] [Google Scholar]
  • 21.Scott SH. Apparatus for measuring and perturbing shoulder and elbow joint positions and torques during reaching. Journal of neuroscience methods. 1999;89(2):119–27. Epub 1999/09/24. 10.1016/s0165-0270(99)00053-9 . [DOI] [PubMed] [Google Scholar]
  • 22.Dukelow SP, Herter TM, Bagg SD, Scott SH. The independence of deficits in position sense and visually guided reaching following stroke. Journal of neuroengineering and rehabilitation. 2012;9:72 Epub 2012/10/06. 10.1186/1743-0003-9-72 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Fugl-Meyer AR, Jaasko L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. Scandinavian journal of rehabilitation medicine. 1975;7(1):13–31. Epub 1975/01/01. . [PubMed] [Google Scholar]
  • 24.Bohannon RW, Smith MB. Interrater reliability of a modified Ashworth scale of muscle spasticity. Physical therapy. 1987;67(2):206–7. Epub 1987/02/01. 10.1093/ptj/67.2.206 . [DOI] [PubMed] [Google Scholar]
  • 25.Newport R, Hindle JV, Jackson SR. Links between vision and somatosensation. Vision can improve the felt position of the unseen hand. Curr Biol. 2001;11(12):975–80. Epub 2001/07/13. 10.1016/s0960-9822(01)00266-4 . [DOI] [PubMed] [Google Scholar]
  • 26.Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychological bulletin. 1968;70(4):213–20. Epub 1968/10/01. 10.1037/h0026256 . [DOI] [PubMed] [Google Scholar]
  • 27.Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74. Epub 1977/03/01. . [PubMed] [Google Scholar]
  • 28.Guilford JP, Lyons TC. On determining the reliability and significance of a tetrachoric coefficient of correlation. Psychometrika. 1942;7(4):243–9. 10.1007/BF02288627. [DOI] [Google Scholar]
  • 29.Faul F, Erdfelder E, Buchner A, Lang AG. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behavior research methods. 2009;41(4):1149–60. Epub 2009/11/10. 10.3758/BRM.41.4.1149 . [DOI] [PubMed] [Google Scholar]
  • 30.Lincoln N, Crow J, Jackson J, Waters G, Adams S, Hodgson P. The unreliability of sensory assessments. Clinical Rehabilitation. 1991;5:273–82. [Google Scholar]
  • 31.Semrau JA, Herter TM, Scott SH, Dukelow SP. Vision of the upper limb fails to compensate for kinesthetic impairments in subacute stroke. Cortex; a journal devoted to the study of the nervous system and behavior. 2018;109:245–59. Epub 2018/11/06. 10.1016/j.cortex.2018.09.022 . [DOI] [PubMed] [Google Scholar]
  • 32.Herter TM, Scott SH, Dukelow SP. Vision does not always help stroke survivors compensate for impaired limb position sense. J Neuroeng Rehabil. 2019;16(1):129 Epub 2019/11/02. 10.1186/s12984-019-0596-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Proske U, Gandevia SC. The proprioceptive senses: their roles in signaling body shape, body position and movement, and muscle force. Physiological reviews. 2012;92(4):1651–97. Epub 2012/10/18. 10.1152/physrev.00048.2011 . [DOI] [PubMed] [Google Scholar]
  • 34.Kuczynski AM, Dukelow SP, Semrau JA, Kirton A. Robotic Quantification of Position Sense in Children With Perinatal Stroke. Neurorehabilitation and neural repair. 2016;30(8):762–72. Epub 2016/01/10. 10.1177/1545968315624781 . [DOI] [PubMed] [Google Scholar]
  • 35.Balasubramanian S, Colombo R, Sterpi I, Sanguineti V, Burdet E. Robotic assessment of upper limb motor function after stroke. American journal of physical medicine & rehabilitation. 2012;91(11 Suppl 3):S255–69. Epub 2012/10/25. 10.1097/PHM.0b013e31826bcdc1 . [DOI] [PubMed] [Google Scholar]
  • 36.Scott SH, Dukelow SP. Potential of robots as next-generation technology for clinical assessment of neurological disorders and upper-limb therapy. Journal of rehabilitation research and development. 2011;48(4):335–53. Epub 2011/06/16. 10.1682/jrrd.2010.04.0057 . [DOI] [PubMed] [Google Scholar]
  • 37.Otaka E, Otaka Y, Kasuga S, Nishimoto A, Yamazaki K, Kawakami M, et al. Clinical usefulness and validity of robotic measures of reaching movement in hemiparetic stroke patients. Journal of neuroengineering and rehabilitation. 2015;12:66 Epub 2015/08/13. 10.1186/s12984-015-0059-8 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

François Tremblay

24 Mar 2020

PONE-D-20-06716

Reliability of Thumb Localizing Test and its validity against quantitative measures with a robotic device in patients with hemiparetic stroke

PLOS ONE

Dear Dr. Otaka,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

As you will see below, the two Reviewers point to some issues regarding the methodological approach and the interpretation of the results.  Reviewer#1 asks for clarifications about the methods and more detailed descriptions of the tests used (e.g. Fugl-Meyer). The Reviewer also has several suggestions to improve the Introduction and Discussion. Reviewer#2 has some concerns regarding the TLT scoring scheme and how this might have affected the reliability. Please make sure that all concerns are adequately addressed in the revised version.

We would appreciate receiving your revised manuscript by May 08 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

François Tremblay, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements:

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.plosone.org/attachments/PLOSOne_formatting_sample_main_body.pdf and http://www.plosone.org/attachments/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following in the Competing Interests section:

"M.L., M.K. and J.U. are the founding scientists of Connect Inc., a commercial company for the development of rehabilitation devices since May 2018. They have received a salary from Connect Inc., and have held the shares in Connect Inc. They hold the managerial positions at Connect Inc. Their conditions were disclosed to the Universities, and were approved. Connect Inc. does not have any relationship with the present study. The other authors report no conflict of interest."

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

3. We note that Figure 1 includes an image of a participant in the study.

As per the PLOS ONE policy (http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research) on papers that include identifying, or potentially identifying, information, the individual(s) or parent(s)/guardian(s) must be informed of the terms of the PLOS open-access (CC-BY) license and provide specific permission for publication of these details under the terms of this license. Please download the Consent Form for Publication in a PLOS Journal (http://journals.plos.org/plosone/s/file?id=8ce6/plos-consent-form-english.pdf). The signed consent form should not be submitted with the manuscript, but should be securely filed in the individual's case notes. Please amend the methods section and ethics statement of the manuscript to explicitly state that the patient/participant has provided consent for publication: “The individual in this manuscript has given written informed consent (as outlined in PLOS consent form) to publish these case details”.

If you are unable to obtain consent from the subject of the photograph, you will need to remove the figure and any other textual identifying information or case descriptions for this individual.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dear study authors

Thank you for the opportunity to review your manuscript. You have undertaken a study to determine the inter-rater validity of the thumb localising test in a chronic stroke population, and to examine its correlation with the KINARM exoskeleton device.

Firstly, thank you for the figures. They are very useful in these types of studies. Your study is nicely summarised and clear, however I feel you are currently missing a few important details that would assist readers. I have provided some comments below for your consideration. I hope these are helpful.

Major comments.

Introduction / References: Your background studies and references and all starting to get quite old. There is newer work in this area. Can you please incorporate discussion of more recent findings throughout the manuscript, and further discuss the implications for your methods and results. How does this work fit into other studies in both stroke and proprioception?

Methods: As you are undertaking an inter-rater validity study, please provide details on the raters, including their training, experience, and professional background). Was the person helping the participant a different person to the assessors, and if so please also add details on who they are.

Please explain the Fugl-Meyer and the Ashworth tests in more detail, including how you undertook them, the scoring (max score and how scored) and interpretation of the scores (i.e. a high Fugl-Meyer score is?). Also, please state which side you are reporting the Fugle-Meyer for (ie. More affected, less affected).

What are the time intervals between testing, were they all done on the same day, different days etc. how did you manage fatigue in these participants?

Results: Please put the results for each variable in a table in addition to the figures. Especially for the TLT results which do not appear to be reported at present.

Discussion: There are some terms in your discussion that have not been introduced earlier. Please give a short description of what you mean by these terms (i.e. kinaesthetic sensation, spatial cognition. How do you think the changes that may have occurred in the brain after the stroke has influenced your findings?

Limitations: You could expand on your limitations section, particularly;

You have briefly mentioned it, but you seen to have a fairly young and very high functioning cohort. This does not seem overly typical of a normal stroke population. Similarly, do you think your test would be as accurate in a less high functioning population? Please expand on this limitation.

Are you likely to see these changes with age, or are they purely due to the stroke?

You have mentioned in the introduction the TLT is only an ordinal test, however what does this for interpretation of your results.

Minor comments:

Table 1: You may wish to relabel “types of disease”, as Stroke type, or type of stroke.

Line 330 – typo – “grades” rather than grads.

309 – do you mean the study did “not” show significant correlations?

Reviewer #2: This is a well-written manuscript examining the inter-rater reliability of the Thumb Localizer Task in 40 participants with chronic stroke. Additionally, the authors make comparisons of the TLT results with those obtained from a well validated robotic measure of proprioception called position matching performed in the KINARM robot. The methodologic approach appears quite reasonable. My main suggestions with the paper are fairly minor.

The authors might consider making the point that the TLT is only a 4 point scale, and although it would theoretically be possible to get low reliability when doing such an experiment, not obtaining high inter-rater reliability from two trained observers scoring the same video of a patient would present quite a challenge.

The authors should also take a little more time to explain why they used the “vision restored” conditions.

“though it is a four-point scale and thus unable to quantify the deficits.” Although I agree with the authors a 4 point ordinal scale isn’t exactly the most desirable tool to “quantify” something. However the definition of the word “quantify” basically means you are trying to measure something and the TLT does this. I would suggest rewording the sentence accordingly.

Figures 1, 2 – The image on the PDF file I received was quite pixelated. The authors should consider addressing this prior to publication (I have seen this happen with some of my own manuscripts when the file gets converted by the publisher’s software, sometimes changing the file type can be helpful).

Discussion

Figures 4, 5 - It would have been nice here to also see Variability and Shift plotted in a similar way against TLT. Consider turning these into 3 panel figures to display all the data.

Page 14 – “significantly deteriorated” implies that the vision restored condition was conducted first, then the vision occluded. I suspect the authors meant “was significantly worse” or similar.

The authors may want to consider reviewing/discussing/contrasting a larger study investigating the return of vision (Herter et al. Vision does not always help stroke survivors compensate for impaired limb position sense. J Neuroeng Rehabil 2019.) as it uses the same task and many subjects fail to improve with vision restored.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 1

François Tremblay

23 Jun 2020

PONE-D-20-06716R1

Reliability of the Thumb Localizing Test and its validity against quantitative measures with a robotic device in patients with hemiparetic stroke

PLOS ONE

Dear Dr. Otaka,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

As you will see below, the Reviewers were mostly satisfied with the latest version. Reviewer #2 has some minor points that will require your attention. I urge you to proceed with these corrections with diligence, as there will be no need for another round of review, provided that the minor points are adequately addressed.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

François Tremblay, PhD

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: Thanks to the authors for responding to my previous review. The paper appears much improved. I did catch a few minor details that they authors should likely deal with.

Line 50 – actually the longitudinal process following stroke recovery has been discussed in a few papers, one that uses the same device the authors are using in the present manuscript (see Semrau et al. 2015, Stroke “Examining Differences in Patterns of Sensory and Motor Recovery After Stroke With Robotics”. There are also a few papers that use clinical scales to look at recovery of proprioception and a reasonably sized recent one published in Neurorehabilitation and Neural Repair (“Zandvliet et al. 2020 34(5):403-426 “Is Recovery of Somatosensory Impairment Condition for Upper-limb motor recovery after stroke?”). So the authors may want to soften the existing comment and reference studies that have looked at it. I completely agree there is room for further, more detailed studies here, but they authors should not ignore the efforts of others that have already looked at this issue.

Line 106 – Fugl-Meyer. The upper score should be 66 here (I think the 36 is a typo).

Line 314 – I suspect you mean “quantitative” rather than “qualitative” measure as it is written.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 2

François Tremblay

8 Jul 2020

Reliability of the Thumb Localizing Test and its validity against quantitative measures with a robotic device in patients with hemiparetic stroke

PONE-D-20-06716R2

Dear Dr. Otaka,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

François Tremblay, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

François Tremblay

13 Jul 2020

PONE-D-20-06716R2

Reliability of the Thumb Localizing Test and its validity against quantitative measures with a robotic device in patients with hemiparetic stroke

Dear Dr. Otaka:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. François Tremblay

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Data. Data for assessing the inter-rater reliability of the TLT.

    Details of the variables are as follows: SubjectNo, an anonymous subject number for the present study only; PareticSide_R1L2, paretic side (1 = right, 2 = left); TL_sv_A1/2/3, the scores of TLT with vision occluded condition by one of the two raters; TL_sv_B1/2/3, the scores of TLT with vision occluded condition by another rater; each number describes three limb positions, as defined in the manuscript (1 = Fig 1C(a), 2 = Fig 1C(b), 3 = Fig 1C(c)).

    (XLSX)

    S2 Data. Data of participant characteristics, clinical measures, and robotic measures.

    Details of the variables are as follows: TYPE_C1_H2_S3, the type of diseases (1 = cerebral infarction, 2 = cerebral hemorrhage, and 3 = subarachnoid hemorrhage); PareticSide_R1L2, paretic side (1 = right, 2 = left); MAS_elbow/wrist/finger, Modified Ashworth scale, originally scaled as 0, 1, 1+, 2, 3, 4, described in the dataset as 0, 1, 2, 3, 4, 5 respectively; Variability_sv, Area_sv, Shift_sv, robotic measures obtained with vision occluded condition; Variability_cv, Area_cv, Shift_cv, robotic measures with vision restored condition; TL_sv_1, TL_sv_2, TL_sv_3, the ultimate TLT scores discussed and rescored by the two raters; TL_sv_median, the median value of the TLT scores in the three limb positions.

    (XLSX)

    Attachment

    Submitted filename: Response_to_Reviewers.docx

    Attachment

    Submitted filename: Response_to_Reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES