Skip to main content
International Journal of Sports Physical Therapy logoLink to International Journal of Sports Physical Therapy
. 2023 Aug 1;18(4):969–976. doi: 10.26603/001c.81065

Reliability Analysis of In-person and Virtual Goniometric Measurements of the Upper Extremity

Tracy Spigelman 1,, Leah Simpkins 2, Casey Humphrey 2, Yehor Vitel 3, Aaron Sciascia 4
PMCID: PMC10399114  PMID: 37547842

Abstract

Background

Virtual healthcare has forced clinicians to modify or eliminate parts of the musculoskeletal evaluation such as motion assessment. Although acceptable to excellent levels of in-person goniometric reliability is achievable, reliability of virtual assessments is unknown.

Purpose

To determine if similar upper extremity goniometric measurements could be obtained in-person and virtually.

Study Design

Reliability study; classroom setting

Methods

Publicly recruited sample over 18 years of age with no upper extremity injuries. Each subject was tested in a standing position with dominant arm facing the clinicians to visualize the landmarks for goniometer placement. Flexion and extension of the shoulder, elbow and wrist were measured. Prior to performing in-person goniometric measurements for each joint, an image was captured of each pre-determined joint position using a mobile device with a camera. This image represented the screenshot on a virtual platform. Four clinicians performed in-person measurements twice during the same session on each subject. The following week clinicians measured virtual images using the same techniques. Inter-rater and intra-rater reliability were determined via intraclass correlation coefficients (ICC).

Results

Inter-rater reliability for five of the six in-person (ICC≥0.81) and virtual measurements (ICC≥0.78 ) were classified as excellent. In-person wrist extension (ICC=0.60) and virtual wrist flexion (ICC=0.65) were classified as good. Intra-rater reliability for individual clinicians were between good and excellent for the in-person measurements (ICC:0.61-0.96) and virtual measurements (ICC:0.72-0.97). There were a greater number of excellent ICC values for the virtual measurements (90%) compared to in-person measurements (70%). There were statistically significant differences between in-person and virtual sessions for five of six measurements (p≤0.006). Only elbow extension did not differ between sessions (p=0.966).

Conclusion

Virtual assessment compared to goniometric measurements showed good to excellent inter- and intra-rater reliabilities (ICC > 0.60), which suggests clinicians can utilize goniometry either in person or on a virtual platform.

Level of Evidence

3b

Keywords: goniometer, range of motion, reliability, virtual

INTRODUCTION

One of the primary components of the musculoskeletal physical examination is the assessment of joint and limb motion. Clinicians can obtain the amount of joint motion a person has with a variety of devices including three-dimensional analysis motion tracking systems, manual and digital inclinometers, and most commonly, manual goniometers. Also, clinicians have often been shown to have acceptable to excellent levels of inter-rater and intra-rater reliability when utilizing these devices in-person.1–4

The rise of virtual healthcare visits (often termed telehealth or telemedicine) has forced clinicians to either modify, or in some cases eliminate, components of the physical examination due to the logistics and barriers of administering a virtual visit.5–7 When using a virtual platform to administer a telehealth examination, motion assessments have either been eliminated or reduced to visual qualitative assessments. For example, a patient may be asked to elevate the arm in front of the body to determine how much shoulder flexion is able to be performed. However, without the use of a measuring device, clinicians would be relegated to using visible landmarks or categories to document the motion achieved i.e., patient was able to elevate arm to just below the ear. This raises two concerns: 1) the qualitative nature of the modified assessment is subjective and not exact and 2) previous literature has demonstrated that motion assessment reliability is more consistent with instrumentation compared to only using visual means.8 Furthermore, it has been demonstrated that patients tend to over-estimate the amount of motion they can perform when verbally asked to quantify their joint motion suggesting the elimination of objective motion assessments should not be considered.9 The non-objective assessments could in turn negatively affect clinical decision making for providing an accurate diagnosis, determining proper treatment, and properly monitoring patient progress across treatment.

Although it is possible these types of issues could arise during a telehealth examination, it is also possible that joint motion could be assessed with acceptable reliability in the virtual environments by utilizing a simple image capturing technique such as a screen shot and goniometer during the telehealth session. Therefore, the purpose of this study was to determine if similar goniometric measurements of the upper extremity could be obtained in-person and virtually. It was hypothesized that inter-rater and intra-rater test/re-test reliability for both in-person and virtual measurements would reach an acceptable level of reliability defined as an intraclass correlation coefficient ≥0.60.

METHODS

Subjects

A publicly recruited sample of subjects volunteered to participate in this study. Inclusion criteria included: age between 18-60 years; able to actively elevate the arm to ear level (approximately 150°); actively move the elbow from an extended to flexed position within an approximate range of 0°-90°; and actively move the wrist into a flexed and extended position from a starting position of neutral (0°) to a non-specific range of motion in both directions. Subjects were excluded if age was <18 years and >60 years, could not move the shoulder, elbow, and wrist as noted in the inclusion criteria, had a Disabilities of the Arm, Shoulder, and Hand (DASH)10 disability score ≥40%,11 or had neurological compromise that would prevent joint/limb motion from occurring.

Procedures

After reading and signing the informed consent packet, demographic information including age, sex, height, weight, and arm dominance were obtained. Following completion of the demographic obtainment, subjects completed the DASH.10

In-Person Measurements

Prior to performing the in-person goniometric measurements for each joint, an image was captured of each pre-determined joint position using a mobile device with a camera (iPad Air 2, Apple, Inc, Cupertino, CA). This still shot image represented an image that could be captured via screenshot on a virtual platform. Next, serial in-person measurements were obtained by each of four clinician research team members. The clinicians were comprised of two certified athletic trainers and two occupational therapists. All clinicians had a minimum of 10 years of clinical experience. Each clinician member of the research team performed all six measurements on each subject consecutively. This process continued until all team members performed all measurements twice in the same session. This was necessary for determining the test/re-test reliability for each clinician (intra-rater reliability). The goniometer dial was covered with paper so the team member obtaining the measurement could not see the values. To reduce the potential for recording bias by the team member performing the measurements, a second team member read and recorded the range of motion to the nearest degree mark.

The dominant arm of each subject was utilized for all measurements unless the dominant arm did not meet the inclusion criteria. Each subject was tested in a standing position facing sideways with their dominant arm facing the camera. This was necessary for both the in-person and virtual assessments to clearly visualize the anatomical landmarks for goniometer placement (Table 1). The testing positions for each measurement occurred as follows: Shoulder flexion: humerus at 150° flexion (approximately ear level); Shoulder extension: humerus at maximal extension without altering erect trunk position; Elbow flexion: humerus in line with trunk, elbow at 90° flexion, and forearm in supination; Elbow extension: humerus in line with trunk, elbow at 0° extension, and forearm supinated; Wrist flexion: humerus in line with trunk, elbow at 90° flexion, forearm pronated, and wrist maximally flexed; and Wrist extension: humerus in line with trunk, elbow at 90° flexion, forearm pronated, and wrist maximally flexed.

Table 1. Goniometer Placement Sites.
Axis Stable Arm Moving Arm
Shoulder flexion/extension Center of humeral head Parallel to lateral trunk Midline of humerus
Elbow flexion/extension Lateral joint line Midline of humerus Midline of radius using radial styloid process as reference
Wrist flexion/extension Medial joint line Midline of ulna Parallel to 5th metacarpal

Virtual Measurements

Approximately one week (7-10 days) after the in-person measurements were completed, the research team members measured the captured images using the same goniometric techniques. This step also utilized two team members, with one member performing the in-person measurement for each image and another member reading the goniometer (and vice versa). The images were placed on a cloud-based shared drive, for all team members to be able to access the images at each person’s personal computer. Team members were not permitted to alter the image characteristics (brightness, contrast, resolution, etc) but were permitted to use the zoom function contained within the computer’s image viewing software to enlarge each image for more accurate placement of the goniometer. The average of the two trials was calculated for both in-person and virtual sessions and used for statistical analysis. Intra-rater reliability for each joint measurement was determined for each clinician per each session (i.e. clinician #1 trial 1 versus trial 2, clinician #2 trial 1 versus trial 2, etc.) while inter-rater reliability for each joint measurement was determined by comparing all results for trial 1 versus trial 2 for all four clinicians combined for each session.

Statistical Analysis

Summary statistics for demographic items were calculated and reported as means and standard deviations for continuous variables and frequencies with percentages for categorical variables. The distribution of data for each variable was assessed for normality using the Shapiro-Wilk test. Using a two-way random with absolute agreement design for inter-rater (2, k) and intra-rater (2,1) test/re-test reliability, intraclass correlation coefficients (ICC) were calculated for both in-person and virtual testing sessions. Once the ICCs were determined, standard error of measurement (SEM) and minimal detectable change at the 90% (MDC90) and 95% (MDC95) confidence level were calculated. An ICC greater than 0.75 was interpreted as excellent, 0.74-0.60 was good, 0.59-0.40 was fair, and <0.40 was considered poor.12 Finally, a between session comparison of measurement values was conducted using paired t-tests or Wilcoxon sign rank tests (based on normality results) for the overall comparisons (in-person versus virtual) and one-way analyses of variance with Bonferroni correction for between examiner comparisons.

Using previously established criteria for sample size estimation, it was determined that 20 subjects would be needed to achieve a minimum intraclass correlation coefficient of 0.60 at an alpha level of 0.05 and beta level of 0.90.13

RESULTS

Twenty subjects (Age: 30.8±12.8 years; height: 169.8±10.2 centimeters; weight: 76.8±18.9 kilograms; DASH: 26.0±2.4%; Sex: 85% female) participated in the study.

Inter-Rater Reliability

The ICCs for five of the six in-person measurements were classified as excellent (ICC≥0.81) (Table 2). In-person wrist extension was classified as good (ICC=0.60). Similarly, the ICCs for five of the six virtual measurements were classified as excellent (ICC≥0.78). Virtual wrist flexion was classified as good (ICC=0.65).

Table 2. Inter-rater Reliability.

ICC 95% CI SEM (°) MDC90 (°) MDC95 (°)
IP V IP V IP V IP V IP V
Shoulder Flexion 0.88 0.86 0.78, 0.94 0.75, 0.94 3.01 3.67 7.03 8.56 8.35 10.16
Shoulder
Extension
0.96 0.95 0.93, 0.98 0.92, 0.98 1.86 1.83 4.34 4.28 5.16 5.08
Elbow
Flexion
0.81 0.91 0.66, 0.91 0.83, 0.96 1.70 1.20 3.97 2.80 4.71 3.33
Elbow
Extension
0.96 0.98 0.92, 0.98 0.97, 0.99 1.48 0.96 3.45 2.24 4.10 2.67
Wrist
Flexion
0.89 0.65 0.81, 0.95 0.36, 0.84 2.49 5.62 5.80 13.11 6.89 15.58
Wrist
Extension
0.60 0.78 0.27, 0.82 0.59, 0.90 6.20 3.75 14.46 8.76 17.18 10.40

ICC=intraclass correlation coefficient; 95%CI=95% confidence interval; SEM=standard error of measurement; MDC=minimal detectable change; IP=in-person; V=virtual; °=degrees

Intra-Rater Reliability

Overall, the ICCs for the individual clinicians were between good and excellent for the in-person measurements (range: 0.61-0.96) and virtual measurements (range: 0.72-0.97) (Table 3). When examining the individual measurement results, the ICCs for both in-person (ICC≥0.84) and virtual (ICC≥0.93) shoulder extension and in-person (ICC≥0.89) and virtual (ICC≥0.94) elbow extension were all classified as excellent. There were a greater number of excellent ICC values for the virtual measurements (90%) compared to the in-person measurements (70%).

Table 3. Intra-rater Reliability.

ICC 95% CI SEM (°) MDC90 (°) MDC95 (°)
IP V IP V IP V IP V IP V
Shoulder Flexion
Examiner 1 0.80 0.94 0.49, 0.92 0.84, 0.97 3.13 2.11 7.30 4.92 8.68 5.84
Examiner 2 0.86 0.90 0.65, 0.95 0.74, 0.96 3.07 2.69 7.16 6.27 8.50 7.45
Examiner 3 0.70 0.94 0.22, 0.88 0.85, 0.98 4.60 2.16 10.74 5.03 12.75 5.97
Examiner 4 0.72 0.92 0.30, 0.89 0.80, 0.97 4.13 2.12 9.63 4.95 11.44 5.88
Shoulder Extension
Examiner 1 0.84 0.93 0.56, 0.94 0.83, 0.97 3.52 2.09 8.21 4.88 9.76 5.79
Examiner 2 0.86 0.97 0.65, 0.94 0.89, 0.99 3.29 1.26 7.68 2.95 9.13 3.50
Examiner 3 0.96 0.96 0.89, 0.98 0.90, 0.98 2.16 1.74 5.04 4.06 5.99 4.82
Examiner 4 0.89 0.97 0.73, 0.96 0.93, 0.99 2.79 1.44 6.50 3.35 7.72 3.98
Elbow Flexion
Examiner 1 0.61 0.90 -0.01, 0.85 0.75, 0.96 2.25 1.36 5.25 3.17 6.23 3.77
Examiner 2 0.76 0.74 0.39, 0.91 0.35, 0.90 2.25 2.24 5.26 5.24 6.25 6.22
Examiner 3 0.67 0.75 0.15, 0.87 0.38, 0.90 2.13 1.50 4.96 3.50 5.89 4.16
Examiner 4 0.79 0.86 0.45, 0.92 0.66, 0.95 1.65 1.50 3.85 3.49 4.57 4.15
Elbow Extension
Examiner 1 0.89 0.96 0.73, 0.96 0.89, 0.98 2.22 1.38 5.19 3.22 6.16 3.83
Examiner 2 0.90 0.96 0.74, 0.96 0.91, 0.99 1.80 1.24 4.21 2.89 5.00 3.44
Examiner 3 0.92 0.96 0.80, 0.97 0.91, 0.99 2.60 1.62 6.07 3.78 7.21 4.49
Examiner 4 0.95 0.94 0.88, 0.98 0.77, 0.98 1.72 1.49 4.02 3.49 4.77 4.14
Wrist Flexion
Examiner 1 0.69 0.97 0.24, 0.88 0.93, 0.99 6.85 2.13 15.98 4.97 18.98 5.91
Examiner 2 0.87 0.96 0.67, 0.95 0.89, 0.98 2.42 1.34 5.64 3.13 6.70 3.71
Examiner 3 0.83 0.72 0.57, 0.93 0.28, 0.89 2.47 3.17 5.77 7.41 6.86 8.80
Examiner 4 0.83 0.81 0.54, 0.93 0.53, 0.93 2.96 3.23 6.73 6.92 8.00 8.22
Wrist Extension
Examiner 1 0.95 0.95 0.87, 0.98 0.88, 0.98 2.01 1.83 4.70 4.28 5.58 5.08
Examiner 2 0.90 0.92 0.74, 0.96 0.81, 0.97 1.49 2.12 3.47 4.95 4.12 5.88
Examiner 3 0.80 0.95 0.49, 0.92 0.82, 0.98 2.50 1.68 5.84 3.91 6.94 4.65
Examiner 4 0.73 0.89 0.33, 0.89 0.61, 0.96 2.70 2.42 6.30 5.65 7.49 6.71

ICC=intraclass correlation coefficient; 95%CI=95% confidence interval; SEM=standard error of measurement; MDC=minimal detectable change; IP=in-person; V=virtual; °=degrees

Between Session Comparisons

When combining all clinician measurements, there were statistically significant differences between in-person and virtual sessions for five of the six measurements (p≤0.006) (Table 4). Only the measurement of elbow extension did not differ between sessions (p=0.966).

Table 4. Between Session Comparison of In-Person and Virtual Measurements Reported as Mean (Standard Deviation).

In-Person Virtual p-⁠Value
Shoulder Flexion 146.8° (8.0°) 150.5° (9.6°) <0.001
Shoulder Extension 41.4° (8.9°) 45.5° (8.1°) <0.001
Elbow Flexion 83.4° (3.9°) 85.1° (4.0°) <0.001
Elbow Extension 0.6° (7.2°) -0.2° (6.7°) 0.966
Wrist Flexion 72.8° (7.5°) 68.0° (9.5°) <0.001
Wrist Extension 64.8° (9.8°) 62.1° (8.0°) 0.006

Inter- Rater Reliability

Upon review of the inter-rater reliability, Examiner 1 recorded significantly lower amounts of in-person shoulder flexion compared to Examiner 3 (p=0.010) and Examiner 4 (p<0.001) (Table 5). Similarly, Examiner 1 recorded significantly lower amounts of in-person wrist extension compared to the other three examiners (p<0.001). Regarding the virtual measurements, Examiner 4 recorded significantly greater amounts of shoulder flexion compared to Examiners 1 and 2 (p<0.001). Examiners 3 and 4 recorded significantly greater amounts of wrist flexion compared to Examiner 1 (p≤0.010) while Examiner 3 also recorded significantly greater wrist flexion compared to Examiner 2 (p=0.005). Finally, Examiner 1 recorded significantly lower amounts of wrist extension compared to Examiners 2 (p=0.031) and 3 (p=0.023).

Table 5. Between Examiner Comparisons for In-Person and Virtual Measurements Reported as Mean (Standard Deviation).

Examiner 1 Examiner 2 Examiner 3 Examiner 4 Notes
In-Person
Shoulder Flexion 140.9° (6.5°) 146.4° (7.8°) 148.2° (7.4°) 151.6° (6.9°) 1 < 3 (p=0.01) and 4 (p<0.001)
Shoulder Extension 39.4° (8.3°) 41.3° (8.4°) 43.5° (10.7°) 41.3° (8.1°)
Elbow Flexion 84.5° (3.6°) 81.9° (4.6°) 83.2° (3.7°) 84.2° (3.6°)
Elbow Extension 1.3° (6.5°) 1.7° (5.5°) 0.1° (9.0°) -0.7° (7.6°)
Wrist Flexion 70.7° (7.6°) 71.6° (7.5°) 73.8° (7.7°) 75.2° (6.9°)
Wrist Extension 52.0° (9.0°) 71.5° (4.7°) 67.1° (5.6°) 68.8° (5.2°) 1 < 2-4 (p<0.001)
Virtual
Shoulder Flexion 145.1° (8.4°) 146.4° (8.2°) 152.0° (8.7°) 158.5° (7.3°) 4 > 1 and 2 (p<0.001)
Shoulder Extension 47.7° (7.8°) 46.8° (7.3°) 42.7° (8.7°) 45.0° (8.3°)
Elbow Flexion 85.0° (4.3°) 83.8° (4.4°) 86.6° (3.0°) 85.0° (4.0°)
Elbow Extension 0.1° (6.8°) -0.1° (6.1°) 0.0° (8.0°) -0.8° (6.0°)
Wrist Flexion 61.7° (12.3°) 65.3° (6.7°) 74.5° (6.0°) 70.3° (6.8°) 3 > 1 (p<0.001) and 2 (p=0.005); 4 > 1 (p=0.010)
Wrist Extension 57.2° (8.2°) 64.2° (7.5°) 64.4° (7.5°) 62.7° (7.3°) 1 < 2 (p=0.031) and 3 (p=0.023)

DISCUSSION

Clinicians routinely utilize range of motion measures to predict the development of and to diagnose certain pathologies as well as to determine function of a body part.14–29 Following COVID-19, virtual patient evaluations became more common raising concern about the inclusion of and reliability of motion measurements. This study aimed to determine the reliability of measuring virtual range of motion in the shoulder, elbow and wrist using a goniometer. Virtual assessment compared to in-person goniometric measurements showed good to excellent inter- and intra-rater reliabilities (ICC≥0.60).

Past researchers have attempted to examine range of motion in the shoulder,4,27,30 elbow,1–3,27,31,32 and knee33,34 using methods such as radiographs, visual estimation, inclinometer, smart phone applications and goniometry. Blonna et al. reported excellent to good reliability between surgeons and physician assistants when comparing visual observation of elbow flexion/extension to goniometry but noted the highest ICC’s using a goniometer.31 Similarly, van de Pol et al. found a wide range of inter-rater reliability depending on the method utilized but concluded devices such as goniometers or inclinometers should be utilized over visual observation due to more consistent and higher ICC values.8 The current results agreed with these findings where the reliability metrics for all measurements ranged from good to excellent . When employing visual observation alone, Hickey et al. reported limited agreement to observe and define asymptomatic versus symptomatic scapular motion via video cassette tapes between experienced and novice clinicians. This suggests that more than a trained eye should be used for shoulder evaluations and although their study did not use a goniometer, it does support the need for a more quantitative form of measurement for shoulder evaluation in a virtual medium.

The most important finding of this study is that although both in-person and virtual measurements ranged from good to excellent test/re-test reliability, there were a higher number of excellent ICC’s for the virtual measurements. This is most likely due to the lack of movement between trials for the virtual measurements. These data support using a screen shot and goniometer during a virtual examination for assessing flexion and extension of the shoulder, elbow, and wrist. Recent literature, supporting the virtual examination, has focused on camera positioning and placement in addition to clothing to ensure the most accurate measures.6,35 These variables are causes for possible differences in the measurement values between in-person and virtual sessions of the current study. It is important to set up a consistent space for the clinician to perform the best evaluation of a patient, however, these results point towards using the screen shot and goniometer as a reliable method of upper extremity evaluation. Future testing of virtual range of motion should address motions in the horizontal and transverse planes of motion which should attempt to include more specific instructions regarding clothing and setting up an optimal space for recording the evaluation. Additionally, due to continuing technological advances in software and devices, it is recommended future efforts be expended on establishing psychometrics of digital applications and devices designed for assessing and quantifying motion for various anatomical joints in virtual environments.

Limitations

The findings of this study show virtual range of motion measures had a high level of ICC’s (excellent) which suggests clinicians can obtain quantitative measurements even if the patient is not directly in front of the clinician. However, there are limitations to discuss. First, differences found in the results of this study could be due to a few variables such as clothing differences, patient posture and patient joint position sense. The subjects who volunteered for this study were not instructed about the type of clothing to wear as they were a sample of convenience. Loose fitting blouses or patterns could have hindered the clinicians view of the joint making it difficult to find the same landmarks consistently. Likewise, a tight-fitting shirt could have hindered that patient’s ability to fully achieve range of motion. Second, posture could have played a role in differences of measurement. Subjects were not instructed to stand in anatomically correct (or ideal) posture, nor were any postural differences between subjects corrected for. For instance, a patient with forward rounded shoulders might have less range of motion than a patient whose posture is more anatomically correct or more ideal. However, for shoulder extension, subjects who noticeably altered trunk position to gain more extension were immediately told to remain in each person’s “typical” posture, but no other corrections were applied. Finally, joint position sense could have played into any difference in results. Still photos for all motions (shoulder flexion/extension, elbow flexion/extension and wrist flexion/extension) were all taken prior to range of motion testing. Conversely, subjects were asked to repeat the same motions multiple times for the in-person measurements which could have increased flexibility throughout the testing (or created fatigue due to repeated positioning for four examiners) and therefore changed the end position of motion as the patient progressed through the testing.

CONCLUSION

Measuring range of motion both in-person and virtually had good to excellent test/re-test reliability suggesting either method is acceptable to use clinically. Capturing screenshots during a virtual exam to measure range of motion is recommended and is supported by the higher percentage of ICCs being ranked as excellent for the virtual measurements. Using a goniometer can provide an objective component to assessment and diagnosis of upper extremity injuries in the virtual examination for more thorough and accurate clinical decision making.

Conflicts of interest

The authors report no conflicts of interest.

References

  1. Validity and reliability of the GYKO inertial sensor system for the assessment of the elbow range of motion. Santospagnuolo Adriano, Bruno Andrea A., Pagnoni Andrea, Martello Federico, Santoboni Flavia, Perroni Fabrizio, Vulpiani Maria Chiara, Vetrano Mario. Oct;2019 The Journal of Sports Medicine and Physical Fitness. 59(9):1466–1471. doi: 10.23736/s0022-4707.19.09331-9. doi: 10.23736/s0022-4707.19.09331-9. [DOI] [PubMed] [Google Scholar]
  2. The smartphone inclinometer: A new tool to determine elbow range of motion? Vauclair Frédéric, Aljurayyan Abdulaziz, Abduljabbar Fahad H., Barimani Bardia, Goetti Patrick, Houghton Fiona, Harvey Edward J., Rouleau Dominique M. Oct 19;2017 European Journal of Orthopaedic Surgery & Traumatology. 28(3):415–421. doi: 10.1007/s00590-017-2058-x. doi: 10.1007/s00590-017-2058-x. [DOI] [PubMed] [Google Scholar]
  3. Intrarater agreement of elbow extension range of motion in the upper limb neurodynamic test 1 using a smartphone application. Cruz Joana, Morais Nuno. Nov;2016 Archives of Physical Medicine and Rehabilitation. 97(11):1880–1886. doi: 10.1016/j.apmr.2016.05.001. doi: 10.1016/j.apmr.2016.05.001. [DOI] [PubMed] [Google Scholar]
  4. Accuracy and reliability of observational motion analysis in identifying shoulder symptoms. Hickey Brendan W., Milosavljevic Stephan, Bell Melanie L., Milburn Peter D. Aug;2007 Manual Therapy. 12(3):263–270. doi: 10.1016/j.math.2006.05.005. doi: 10.1016/j.math.2006.05.005. [DOI] [PubMed] [Google Scholar]
  5. Telemedicine experiences of athletic trainers and orthopaedic physicians for patients with musculoskeletal conditions. Winkelmann Zachary K., Eberman Lindsey E., Games Kenneth E. Jul 21;2020 Journal of Athletic Training. 55(8):768–779. doi: 10.4085/1062-6050-388-19. doi: 10.4085/1062-6050-388-19. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Telehealth and eHealth in nurse practitioner training: Current perspectives. Rutledge Carolyn, Kott Karen, Schweickert Patty, Poston Rebecca, Fowler Christianne, Haney Tina. Jun;2017 Advances in Medical Education and Practice. 8:399–409. doi: 10.2147/amep.s116071. doi: 10.2147/amep.s116071. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Perspectives on the evolution of mobile (mHealth) technologies and application to rehabilitation. Dicianno Brad E., Parmanto Bambang, Fairman Andrea D., Crytzer Theresa M., Yu Daihua X., Pramana Gede, Coughenour Derek, Petrazzi Alan A. Mar 1;2015 Physical Therapy. 95(3):397–405. doi: 10.2522/ptj.20130534. doi: 10.2522/ptj.20130534. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Inter-rater reliability for measurement of passive physiological range of motion of upper extremity joints is better if instruments are used: a systematic review. van de Pol Rachel J., van Trijffel Emiel, Lucas Cees. 2010Journal of Physiotherapy. 56(1):7–17. doi: 10.1016/s1836-9553(10)70049-7. doi: 10.1016/s1836-9553(10)70049-7. [DOI] [PubMed] [Google Scholar]
  9. Measurements of shoulder mobility by patient and surgeon correlate poorly: A prospective study. Rüdiger Hannes A., Fuchs Bruno, von Campe Arndt, Gerber Christian. Mar;2008 Journal of Shoulder and Elbow Surgery. 17(2):255–260. doi: 10.1016/j.jse.2007.07.012. doi: 10.1016/j.jse.2007.07.012. [DOI] [PubMed] [Google Scholar]
  10. Development of an upper extremity outcome measure: the DASH (Disabilities of the Arm, Shoulder, and Hand) Hudak Pamela L., Amadio Peter C., Bombardier Claire, Beaton Dorcas, Cole Donald, Davis Aileen, Hawker Gillian, Katz Jeffrey N., Makela Matti, Marx Robert G., Punnett Laura, Wright James. Jun;1996 American Journal of Industrial Medicine. 29(6):602–608. doi: 10.1002/(sici)1097-0274(199606)29:6. doi: 10.1002/(sici)1097-0274(199606)29:6. [DOI] [PubMed] [Google Scholar]
  11. Beaton D. E., Kennedy C.A. Disabilities of the Arm, Shoulder and Hand (DASH) users viewpoint clarifies interpretability of scores. AAHS; Scottsdale, AZ: [Google Scholar]
  12. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Cicchetti Domenic V. Dec;1994 Psychological Assessment. 6(4):284–290. doi: 10.1037/1040-3590.6.4.284. doi: 10.1037/1040-3590.6.4.284. [DOI] [Google Scholar]
  13. A simplified guide to determination of sample size requirements for estimating the value of intraclass correlation coefficient: A review. Bujang M.A., Baharum N. 2017Arch Orofac Sci. 12:1–11. [Google Scholar]
  14. Glenohumeral internal rotation deficits in baseball players with ulnar collateral ligament insufficiency. Dines Joshua S., Frank Joshua B., Akerman Meredith, Yocum Lewis A. 2009The American Journal of Sports Medicine. 37(3):566–570. doi: 10.1177/0363546508326712. doi: 10.1177/0363546508326712. [DOI] [PubMed] [Google Scholar]
  15. Passive ranges of motion of the hips and their relationship with pitching biomechanics and ball velocity in professional baseball pitchers. Robb Andrew J., Fleisig Glenn, Wilk Kevin, Macrina Leonard, Bolt Becky, Pajaczkowski Jason. Aug 31;2010 The American Journal of Sports Medicine. 38(12):2487–2493. doi: 10.1177/0363546510375535. doi: 10.1177/0363546510375535. [DOI] [PubMed] [Google Scholar]
  16. Correlation of glenohumeral internal rotation deficit and total rotational motion to shoulder injuries in professional baseball pitchers. Wilk Kevin E., Macrina Leonard C., Fleisig Glenn S., Porterfield Ronald, Simpson Charles D. II, Harker Paul, Paparesta Nick, Andrews James R. 2011The American Journal of Sports Medicine. 39(2):329–335. doi: 10.1177/0363546510384223. doi: 10.1177/0363546510384223. [DOI] [PubMed] [Google Scholar]
  17. Glenohumeral motion deficits: Friend or foe? Manske R., Wilk K.E., Davies G., Ellenbecker T., Reinold M. 2013Int J Sports Phys Ther. 8:537–553. [PMC free article] [PubMed] [Google Scholar]
  18. Deficits in glenohumeral passive range of motion increase risk of elbow injury in professional baseball pitchers: A prospective study. Wilk Kevin E., Macrina Leonard C., Fleisig Glenn S., Aune Kyle T., Porterfield Ron A., Harker Paul, Evans Timothy J., Andrews James R. Jun 18;2014 The American Journal of Sports Medicine. 42(9):2075–2081. doi: 10.1177/0363546514538391. doi: 10.1177/0363546514538391. [DOI] [PubMed] [Google Scholar]
  19. Deficits in glenohumeral passive range of motion increase risk of shoulder injury in professional baseball pitchers: A prospective study. Wilk Kevin E., Macrina Leonard C., Fleisig Glenn S., Aune Kyle T., Porterfield Ron A., Harker Paul, Evans Timothy J., Andrews James R. Aug 13;2015 The American Journal of Sports Medicine. 43(10):2379–2385. doi: 10.1177/0363546515594380. doi: 10.1177/0363546515594380. [DOI] [PubMed] [Google Scholar]
  20. Shoulder range of motion measures as risk factors for shoulder and elbow injuries in high school softball and baseball players. Shanley Ellen, Rauh Mitchell J., Michener Lori A., Ellenbecker Todd S., Garrison J. Craig, Thigpen Charles A. 2006The American Journal of Sports Medicine. 39(9):1997–2006. doi: 10.1177/0363546511408876. doi: 10.1177/0363546511408876. [DOI] [PubMed] [Google Scholar]
  21. Shoulder range of motion deficits in baseball players with an ulnar collateral ligament tear. Garrison J. Craig, Cole Mollie A., Conway John E., Macko Michael J., Thigpen Charles, Shanley Ellen. Sep 26;2012 The American Journal of Sports Medicine. 40(11):2597–2603. doi: 10.1177/0363546512459175. doi: 10.1177/0363546512459175. [DOI] [PubMed] [Google Scholar]
  22. Mechanisms of shoulder range of motion deficits in asymptomatic baseball players. Bailey Lane B., Shanley Ellen, Hawkins Richard, Beattie Paul F., Fritz Stacy, Kwartowitz David, Thigpen Charles A. Sep 24;2015 The American Journal of Sports Medicine. 43(11):2783–2793. doi: 10.1177/0363546515602446. doi: 10.1177/0363546515602446. [DOI] [PubMed] [Google Scholar]
  23. The relationship between humeral torsion and arm injury in baseball players: A systematic review and meta-analysis. Helmkamp Joshua K., Bullock Garrett S., Rao Allison, Shanley Ellen, Thigpen Charles, Garrigues Grant E. Feb 6;2020 Sports Health: A Multidisciplinary Approach. 12(2):132–138. doi: 10.1177/1941738119900799. doi: 10.1177/1941738119900799. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Preseason shoulder range of motion screening and in-season risk of shoulder and elbow injuries in overhead athletes: Systematic review and meta-analysis. Pozzi Federico, Plummer Hillary A, Shanley Ellen, Thigpen Charles A, Bauer Chase, Wilson Melissa L, Michener Lori A. Jan 14;2020 British Journal of Sports Medicine. 54(17):1019–1027. doi: 10.1136/bjsports-2019-100698. doi: 10.1136/bjsports-2019-100698. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Injury and training history are associated with glenohumeral internal rotation deficit in youth tennis athletes. Kalo Kristin, Vogt Lutz, Sieland Johanna, Banzer Winfried, Niederer Daniel. Aug 15;2020 BMC Musculoskeletal Disorders. 21(1):553. doi: 10.1186/s12891-020-03571-0. doi: 10.1186/s12891-020-03571-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. The relationship between humeral retrotorsion and shoulder range of motion in baseball players with an ulnar collateral ligament tear. Lee Bobby Jean S., Garrison J. Craig, Conway John E., Pollard Kalyssa, Aryal Subhash. Oct 1;2016 Orthopaedic Journal of Sports Medicine. 4(10):232596711666749. doi: 10.1177/2325967116667497. doi: 10.1177/2325967116667497. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Changes in shoulder and elbow passive range of motion after pitching in professional baseball players. Reinold Michael M., Wilk Kevin E., Macrina Leonard C., Sheheane Chris, Dun Shouchen, Fleisig Glenn S., Crenshaw Ken, Andrews James R. 2008The American Journal of Sports Medicine. 36(3):523–527. doi: 10.1177/0363546507308935. doi: 10.1177/0363546507308935. [DOI] [PubMed] [Google Scholar]
  28. Glenohumeral internal rotation deficit: Pathogenesis and response to acute throwing. Kibler W. Ben, Sciascia Aaron, Thomas Stephen J. Mar;2012 Sports Medicine and Arthroscopy Review. 20(1):34–38. doi: 10.1097/jsa.0b013e318244853e. doi: 10.1097/jsa.0b013e318244853e. [DOI] [PubMed] [Google Scholar]
  29. An acute throwing episode decreases shoulder internal rotation. Kibler Ben W., Sciascia Aaron, Moore Stephanie. Jun;2012 Clinical Orthopaedics & Related Research. 470(6):1545–1551. doi: 10.1007/s11999-011-2217-z. doi: 10.1007/s11999-011-2217-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Glenohumeral internal rotation measurements differ depending on stabilization techniques. Wilk Kevin E., Reinold Michael M., Macrina Leonard C., Porterfield Ron, Devine Kathleen M., Suarez Kim, Andrews James R. Jan;2009 Sports Health: A Multidisciplinary Approach. 1(2):131–136. doi: 10.1177/1941738108331201. doi: 10.1177/1941738108331201. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Accuracy and inter-observer reliability of visual estimation compared to clinical goniometry of the elbow. Blonna Davide, Zarkadas Peter C., Fitzsimmons James S., O’Driscoll Shawn W. Nov 17;2011 Knee Surgery, Sports Traumatology, Arthroscopy. 20(7):1378–1385. doi: 10.1007/s00167-011-1720-9. doi: 10.1007/s00167-011-1720-9. [DOI] [PubMed] [Google Scholar]
  32. Range of elbow movement as a predictor of bony injury in children. Baker M., Borland M. Aug 15;2010 Emergency Medicine Journal. 28(8):666–669. doi: 10.1136/emj.2010.091124. doi: 10.1136/emj.2010.091124. [DOI] [PubMed] [Google Scholar]
  33. An electronic clinic for arthroplasty follow-up: A pilot study. Wood Gavin. Dec 1;2011 Canadian Journal of Surgery. 54(6):381–386. doi: 10.1503/cjs.028510. doi: 10.1503/cjs.028510. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Interrater agreement between telerehabilitation and face-to-face clinical outcome measurements for total knee arthroplasty. Cabana Francois, Boissy Patrick, Tousignant Michel, Moffet Hélène, Corriveau Hélène, Dumais Réjean. Apr;2010 Telemedicine and e-Health. 16(3):293–298. doi: 10.1089/tmj.2009.0106. doi: 10.1089/tmj.2009.0106. [DOI] [PubMed] [Google Scholar]
  35. The virtual shoulder physical exam. Pinnamaneni Sridhar, Lamplot Joseph D., Rodeo Scott A., Swensen-Buza Stephanie, Lawton Cort D., Dines Joshua S., Young Warren K., Taylor Samuel A. Feb;2021 HSS Journal®: The Musculoskeletal Journal of Hospital for Special Surgery. 17(1):59–64. doi: 10.1177/1556331620975033. doi: 10.1177/1556331620975033. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from International Journal of Sports Physical Therapy are provided here courtesy of North American Sports Medicine Institute

RESOURCES