Skip to main content
. 2021 Dec 8;21(24):8186. doi: 10.3390/s21248186

Table 2.

Intra-rater and Inter-rater reliability (95% CI) for measurement of shoulder range of motion by device and movement direction.

Device Author Intra-Rater Reliability Inter-Rater Reliability Level of Reliability
Microsoft Kinect
Shoulder
Flexion Da Cuncha Neto et al. (2018)
Hawi et al. (2014)
Huber et al. (2015)
Hwang et al. (2017)
Milgrom et al. (2016)
Çubukçu et al. (2020)
Cai et al. (2019)
ICC 0.97
ICC 0.99
ICC 0.37, 0.85, 0.84, 0.95
ICC 0.96 (0.83–0.98), 0.92 (0.89–0.95)
ICC 0.85
ICC 0.93, 0.99, 0.97. 0.96
ICC 0.91
ICC 0.97 (0.84–1.00)
Good
Good
Poor–Good
Good
Good
Moderate
Good
Extension Da Cuncha Neto et al. (2018)
Hawi et al. (2014)
Hwang et al. (2017)
Çubukçu et al. (2020)
Cai et al. (2019)
ICC 0.97
ICC 0.99
ICC 0.96 (0.83–0.98), 0.92 (0.89–0.95)
ICC 0.62
ICC 0.93, 0.99, 0.97, 0.96
ICC 0.97 Good
Good
Good
Poor
Good
Abduction Bonnechère et al. (2014)
Hawi et al. (2014)
Huber et al. (2015)
Hwang et al. (2017)
Milgrom et al. (2016)
Cai et al. (2019)
ICC 0.73
ICC 0.96
ICC 0.76
ICC 0.92 (0.89–0.93), 0.96 (0.86–0.96)
ICC 0.70, 0.75, 0.84, 0.82
ICC 0.94 (0.72–0.99) Moderate
Good
Moderate
Good
Good
Moderate
Adduction Hawi et al. (2014)
Hwang et al. (2017)
Cai et al. (2019)
ICC 0.99
ICC 0.92 (0.89–0.93), 0.96 (0.86–0.96)
ICC 0.70, 0.75, 0.84, 0.82
Good
Good
Moderate
External rotation Huber et al. (2015)
Çubukçu et al. (2020)
Cai et al. (2019)
ICC 0.98
ICC 0.87
ICC 0.93, 0.75, 0.90, 0.60
Good
Good
Moderate–Good
Internal rotation Çubukçu et al. (2020)
Cai et al. (2019)
ICC 0.97
ICC 0.93, 0.75, 0.90, 0.60
Good
Moderate–Good
Microsoft Kinect & Inertial Sensor
Shoulder
Flexion Beshara et al. (2016) ICC 0.84 (0.45–0.96), 0.93 (0.72–0.98) Moderate–Good
Abduction Beshara et al. (2016) ICC 0.52 (-0.17–0.87, 0.85 (0.47–0.96) Poor–Moderate
Inertial Sensor
Shoulder
Flexion Rigoni et al. (2019)
Chen et al. (2020)
De Baets et al. (2020)
ICC 0.68, 0.87, 0.91 ICC 0.88 (0.80–0.92)
ICC 0.90 (0.83–0.94),
0.95 (0.92–0.97)
ICC 0.74, 0.83, 0.84
Good
Good
Moderate–Good (Intra-rater)
Moderate (Inter-rater)
Extension Chen et al. (2020)
De Baets et al. (2020)
ICC 0.68, 0.87, 0.91 ICC 0.77 (0.64–0.87), 0.80 (0.68–0.89)
ICC 0.74, 0.83, 0.84
Moderate
Moderate–Good (Intra-rater)
Moderate (Inter-rater)
Abduction Cuesta-Vargas et al. (2016)
Picerno et al. (2015)
Rigoni et al. (2019)
Chen et al. (2020)
De Baets et al. (2020)
ICC 0.78 (0.40–0.93), 0.98 (0.94–0.99)
0.99 (0.98–0.99), 0.96 (0.93–0.98)
ICC 0.96 (0.93–0.98)
ICC 0.73, 0.95
ICC 0.49 (0.08–0.82), 0.99 (0.98–1.00),
0.99 (0.99–1.00)
ICC 0.88 (0.81–0.93)
ICC 0.97 (0.95–0.98), 0.98 (0.96–0.99)
ICC 0.74, 0.80, 0.93
Moderate–Good (Intra-rater)
Poor–Good (Inter-rater)
Good
Good
Good
Moderate–Good
Adduction De Baets et al. (2020) ICC 0.73, 0.95 ICC 0.74, 0.80, 0.93 Moderate–Good
External rotation Schiefer et al. (2015)
Rigoni et al. (2019)
Chen et al. (2020)
De Baets et al. (2020)
ICC 0.85, 0.87, 0.89, 0.90 ICC 0.71, 0.76, 0.81, 0.86
ICC 0.84 (0.74–0.90)
ICC 0.95 (0.92–0.97), 0.96 (0.93–0.98)
ICC 0.38, 0.84, 0.73, 0.87
Moderate–Good
Good
Good
Moderate–Good (Intra-rater)
Poor–Good (Inter-rater)
Internal rotation Schiefer et al. (2015)
Rigoni et al. (2019)
Chen et al. (2020)
De Baets et al. (2020)
ICC 0.85, 0.87, 0.89, 0.90 ICC 0.68, 0.78, 0.87, 0.98
ICC 0.71 (0.56–0.82)
ICC 0.91 (0.86–0.95), 0.97 (0.94–0.98)
ICC 0.38, 0.84, 0.73, 0.87
Moderate–Good
Moderate
Good
Moderate–Good (Intra-rater)
Poor–Good (Inter-rater)
Smartphone/Mobile App
Shoulder
Flexion Chan et al. (2010)
Shin et al. (2012)
Werner et al. (2014)
Mejia-Hernandez et al. (2018)
Ramos et al. (2019)
ICC 0.99
ICC 0.97 (0.95–0.99),
0.96 (0.92–0.98)
0.99 (0.98–0.99), 0.99 (0.99–1.00)
ICC −0.21, −0.19, 0.01, 0.16, 0.27, 0.40
0.47, 0.50, 0.53, 0.56, 0.60, 0.71,
0.76, 0.82
ICC 0.99
ICC 0.73 (0.59–0.83), 0.74 (0.61–0.84),
0.83 (0.73–0.90),
0.84 (0.74–0.90)
ICC 0.75 (0.61–0.84), 0.97 (0.90–0.99)
ICC 0.99 (0.98–0.99)
ICC 0.06, 0.18, 0.19, 0.22, 0.25, 0.27,
0.30, 0.36, 0.40, 0.44, 0.47, 0.49,
0.68, 0.69
Good
Good (intra-rater)
Moderate–Good (inter-rater)
Moderate–Good
Good
Poor–Moderate
Abduction Lim et al. (2015)
Shin et al. (2012)
Werner et al. (2014)
Mejia-Hernandez et al. (2018)
ICC 0.72, 0.89, 0.95, 0.97
ICC 0.96, 0.97, 0.99
ICC 0.79, 0.94
ICC 0.70, 0.72, 0.78, 0.79
ICC 0.72 (0.58–0.83), 0.91 (0.68–0.97)
ICC 0.99 (0.99–1.00)
Moderate–Good
Good (intra-rater)
Moderate (inter-rater)
Moderate–Good
Good
Glenohumeral abduction Mejia-Hernandez et al. (2018) ICC 0.98 (0.97–0.99), 0.97 (0.95–0.99) Good
External rotation Chan et al. (2010)
Mitchell et al. (2014)
Shin et al. (2012)
Werner et al. (2014)
Mejia-Hernandez et al. (2018)
ICC 0.94, 0.96
ICC 0.79 (0.70–0.86)
ICC 0.95, 0.97, 0.98
ICC 0.88, 0.98
ICC 0.94 (0.87–0.98)
ICC 0.76, 0.77, 0.78, 0.89, 0.90
ICC 0.85 (0.57–0.95), 0.86 (0.79–0.92),
0.88 (0.66–0.96)
ICC 0.99 (0.98–0.99)
Good
Moderate (intra-rater)
Good (inter-rater)
Good (intra-rater)
Moderate–Good (inter-rater)
Good
Good
Internal rotation Shin et al. (2012)
Werner et al. (2014)
Mejia-Hernandez et al. (2018)
ICC 0.79, 0.97, 0.90, 0.93 0.99 ICC 0.63, 0.66, 0.67, 0.68
ICC 0.81 (0.70–0.88), 0.86 (0.48–0.93)
ICC 0.98 (0.97–0.99), 0.98 (0.96–0.98)
Moderate–Good
Good
Good
Scaption Ramos et al. (2019) ICC −0.04, 0.10, 0.12, 0.31, 0.32, 0.39, 0.40, 0.45, 0.47, 0.52, 0.57, 0.63 ICC −0.17, −0.06, 0.03, 0.07, 0.23, 0.26,
0.27, 0.28, 0.36, 0.45, 0.54, 0.73,
0.75, 0.81
Poor–Moderate (intra-rater)
Poor–Good (inter-rater)
Digital Inclinometer/Goniometer
Shoulder
Flexion Dougherty et al. (2015)
Kolber et al. (2011)
Scibek et al. (2013)
Correll et al. (2018)
ICC 0.77, 0.82
ICC 0.83
ICC 0.67, 0.80, 0.90, 0.92, 0.96
ICC 0.86, 0.88
ICC 0.58
ICC 0.18, 0.33, 0.50, 0.62, 0.68, 0.72,
0.76, 0.78, 0.85
ICC 0.89
Moderate
Moderate (intra-rater)
Poor (inter-rater)
Moderate–Good (intra-rater)
Poor–Moderate (inter-rater)
Good
Elevation Walker et al. (2016) ICC 0.91, 0.92, 0.93, 0.95 Good
Glenohumeral flexion Dougherty et al. (2015)
Scibek et al. (2013)
ICC 0.75, 0.77
ICC 0.75, 0.92, 0.94, 0.96, 0.99
ICC 0.14, 0.35, 0.43, 0.63, 0.65, 0.69,
0.72, 0.83
Moderate
Moderate–Good (intra-rater)
Poor–Good (inter-rater)
Abduction deWinter et al. (2004)
Kolber et al. (2011)
Poser et al. (2015)
Dougherty et al. (2015)
Scibek et al. (2013)
Walker et al. (2016)
Correll et al. (2018)
ICC 0.91
ICC 0.83, 0.92, 0.93, 0.96
ICC 0.73, 0.76
ICC 0.91, 0.94, 0.95, 0.96, 0.97, 0.99
ICC 0.89, 0.90, 0.91, 0.94
ICC 0.86, 0.91
ICC 0.28, 0.78, 0.83
ICC 0.95
ICC 0.27, 0.32, 0.40, 0.60, 0.63, 0.64
ICC 0.48, 0.56, 0.58, 0.62, 0.65, 0.68,
0.70, 0.80, 0.83
ICC 0.93
Poor–Good
Moderate
Moderate–Good (intra-rater)
Poor–Moderate (inter-rater)
Moderate
Good (intra-rater)
Poor–Good (inter-rater)
Good
Good
Glenohumeral abduction Dougherty et al. (2015) ICC 0.60, 0.75 Moderate
Horizontal abduction Poser et al. (2015) ICC 0.66, 0.81, 0.91, 0.94, 0.96 ICC 0.17, 0.18, 0.24, 0.28, 0.31 Moderate–Good (intra-rater)
Poor (inter-rater)
Digital Inclinometer/Goniometer
External rotation
Awan et al. (2002)
Cools et al. (2014)
deWinter et al. (2004)
Kolber et al. (2011)
Poser et al. (2015)
Dougherty et al. (2015)
Walker et al. (2016)
Correll et al. (2018)
ICC 0.58, 0.67
ICC 0.98, 0.95, 0.98
ICC 0.94
ICC 0.93, 0.94, 0.96, 0.97
ICC 0.28, 0.61, 0.66, 0.64, 0.68, 0.71
ICC 0.90, 0.94, 0.95
ICC 0.89, 0.90
ICC 0.41, 0.51
ICC 0.98
ICC 0.56, 0.88, 0.90
ICC 0.88
ICC 0.70, 0.71, 0.72, 0.73, 0.76, 0.77
ICC 0.98
Poor–Moderate (intra-rater)
Poor (inter-rater)
Good
Poor–Good
Good
Good (intra-rater)
Moderate (inter-rater)
Poor–Moderate
Good
Good
Internal rotation Awan et al. (2002)
Cools et al. (2014)
Kolber et al. (2011)
Poser et al. (2015)
Dougherty et al. (2015)
Walker et al. (2016)
Correll et al. (2018)
ICC 0.64, 0.65, 0.72
ICC 0.89, 0.98, 0.99
ICC 0.87
ICC 0.91, 0.92, 0.94, 0.96, 0.97
ICC 0.64, 0.68
ICC 0.85, 0.90, 0.93, 0.96
ICC 0.82, 0.85
ICC 0.50, 0.52, 0.62, 0.66
ICC 0.96, 0.98
ICC 0.93
ICC 0.63, 0.66, 0.73, 0.76, 0.78
ICC 0.96
Poor–Moderate
Good
Good
Good (intra-rater)
Moderate (inter-rater) Poor–Moderate
Moderate–Good
Moderate–Good
Scaption Kolber et al. (2012) ICC 0.88 ICC 0.89 Good

ICC = intra-class correlation coefficient. Level of reliability determined by the criteria identified by Swinkels et al. [87].