Skip to main content
NCBI home page
Annals of the Rheumatic Diseases logoLink to Annals of the Rheumatic Diseases
. 2004 Oct;63(10):1288–1292. doi: 10.1136/ard.2003.014712

Interrater reproducibility of clinical tests for rotator cuff lesions

A Ostor 1, C Richards 1, A Prevost 1, B Hazleman 1, C Speed 1
PMCID: PMC1754743  PMID: 15361389

Abstract

Background: Rotator cuff lesions are common in the community but reproducibility of tests for shoulder assessment has not been adequately appraised and there is no uniform approach to their use.

Objective: To study interrater reproducibility of standard tests for shoulder evaluation among a rheumatology specialist, rheumatology trainee, and research nurse.

Methods: 136 patients were reviewed over 12 months at a major teaching hospital. The three assessors examined each patient in random order and were unaware of each other's evaluation. Each shoulder was examined in a standard manner by recognised tests for specific lesions and a diagnostic algorithm was used. Between-observer agreement was determined by calculating Cohen's κ coefficients (measuring agreement beyond that expected by chance).

Results: Fair to substantial agreement was obtained for the observations of tenderness, painful arc, and external rotation. Tests for supraspinatus and subscapularis also showed at least fair agreement between observers. 40/55 (73%) κ coefficient assessments were rated at >0.2, indicating at least fair concordance between observers; 21/55 (38%) were rated at >0.4, indicating at least moderate concordance between observers.

Conclusion: The reproducibility of certain tests, employed by observers of varying experience, in the assessment of the rotator cuff and general shoulder disease was determined. This has implications for delegation of shoulder assessment to nurse specialists, the development of a simplified evaluation schedule for general practitioners, and uniformity in epidemiological research studies.

Full Text

The Full Text of this article is available as a PDF (126.7 KB).

Figure 1.

Figure 1

Open in a new tab

 Agreement among three clinicians in diagnosis in affected shoulders assessed by κ coefficient.

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Balich S. M., Sheley R. C., Brown T. R., Sauser D. D., Quinn S. F. MR imaging of the rotator cuff tendon: interobserver agreement and analysis of interpretive errors. Radiology. 1997 Jul;204(1):191–194. doi: 10.1148/radiology.204.1.9205245. [DOI] [PubMed] [Google Scholar]
  2. Bamji A. N., Erhardt C. C., Price T. R., Williams P. L. The painful shoulder: can consultants agree? Br J Rheumatol. 1996 Nov;35(11):1172–1174. doi: 10.1093/rheumatology/35.11.1172. [DOI] [PubMed] [Google Scholar]
  3. Bjelle A. Epidemiology of shoulder problems. Baillieres Clin Rheumatol. 1989 Dec;3(3):437–451. doi: 10.1016/s0950-3579(89)80003-2. [DOI] [PubMed] [Google Scholar]
  4. Buchbinder R., Goel V., Bombardier C., Hogg-Johnson S. Classification systems of soft tissue disorders of the neck and upper limb: do they satisfy methodological guidelines? J Clin Epidemiol. 1996 Feb;49(2):141–149. doi: 10.1016/0895-4356(95)00519-6. [DOI] [PubMed] [Google Scholar]
  5. Chard M. D., Hazleman R., Hazleman B. L., King R. H., Reiss B. B. Shoulder disorders in the elderly: a community survey. Arthritis Rheum. 1991 Jun;34(6):766–769. doi: 10.1002/art.1780340619. [DOI] [PubMed] [Google Scholar]
  6. Croft P., Pope D., Boswell R., Rigby A., Silman A. Observer variability in measuring elevation and external rotation of the shoulder. Primary Care Rheumatology Society Shoulder Study Group. Br J Rheumatol. 1994 Oct;33(10):942–946. doi: 10.1093/rheumatology/33.10.942. [DOI] [PubMed] [Google Scholar]
  7. Croft P., Pope D., Silman A. The clinical course of shoulder pain: prospective cohort study in primary care. Primary Care Rheumatology Society Shoulder Study Group. BMJ. 1996 Sep 7;313(7057):601–602. doi: 10.1136/bmj.313.7057.601. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Harrington J. M., Carter J. T., Birrell L., Gompertz D. Surveillance case definitions for work related upper limb pain syndromes. Occup Environ Med. 1998 Apr;55(4):264–271. doi: 10.1136/oem.55.4.264. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Hedtmann A., Fett H. Die sogenannte Periarthropathia humeroscapularis--Klassifizierung und Analyse anhand von 1266 Fällen. Z Orthop Ihre Grenzgeb. 1989 Nov-Dec;127(6):643–649. doi: 10.1055/s-2008-1040306. [DOI] [PubMed] [Google Scholar]
  10. Hoving J. L., Buchbinder R., Green S., Forbes A., Bellamy N., Brand C., Buchanan R., Hall S., Patrick M., Ryan P. How reliably do rheumatologists measure shoulder movement? Ann Rheum Dis. 2002 Jul;61(7):612–616. doi: 10.1136/ard.61.7.612. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Landis J. R., Koch G. G. The measurement of observer agreement for categorical data. Biometrics. 1977 Mar;33(1):159–174. [PubMed] [Google Scholar]
  12. Macfarlane G. J., Hunt I. M., Silman A. J. Predictors of chronic shoulder pain: a population based prospective study. J Rheumatol. 1998 Aug;25(8):1612–1615. [PubMed] [Google Scholar]
  13. Neer C. S., 2nd Impingement lesions. Clin Orthop Relat Res. 1983 Mar;(173):70–77. [PubMed] [Google Scholar]
  14. Nørregaard J., Krogsgaard M. R., Lorenzen T., Jensen E. M. Diagnosing patients with longstanding shoulder joint pain. Ann Rheum Dis. 2002 Jul;61(7):646–649. doi: 10.1136/ard.61.7.646. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Palmer K., Walker-Bone K., Linaker C., Reading I., Kellingray S., Coggon D., Cooper C. The Southampton examination schedule for the diagnosis of musculoskeletal disorders of the upper limb. Ann Rheum Dis. 2000 Jan;59(1):5–11. doi: 10.1136/ard.59.1.5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Pellecchia G. L., Paolino J., Connell J. Intertester reliability of the cyriax evaluation in assessing patients with shoulder pain. J Orthop Sports Phys Ther. 1996 Jan;23(1):34–38. doi: 10.2519/jospt.1996.23.1.34. [DOI] [PubMed] [Google Scholar]
  17. Pope D. P., Croft P. R., Pritchard C. M., Silman A. J. Prevalence of shoulder pain in the community: the influence of case definition. Ann Rheum Dis. 1997 May;56(5):308–312. doi: 10.1136/ard.56.5.308. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Thompson W. D., Walter S. D. A reappraisal of the kappa coefficient. J Clin Epidemiol. 1988;41(10):949–958. doi: 10.1016/0895-4356(88)90031-5. [DOI] [PubMed] [Google Scholar]
  19. Uhthoff H. K., Sarkar K. An algorithm for shoulder pain caused by soft-tissue disorders. Clin Orthop Relat Res. 1990 May;(254):121–127. [PubMed] [Google Scholar]
  20. Walker-Bone K., Byng P., Linaker C., Reading I., Coggon D., Palmer K. T., Cooper C. Reliability of the Southampton examination schedule for the diagnosis of upper limb disorders in the general population. Ann Rheum Dis. 2002 Dec;61(12):1103–1106. doi: 10.1136/ard.61.12.1103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. de Winter A. F., Jans M. P., Scholten R. J., Devillé W., van Schaardenburg D., Bouter L. M. Diagnostic classification of shoulder disorders: interobserver agreement and determinants of disagreement. Ann Rheum Dis. 1999 May;58(5):272–277. doi: 10.1136/ard.58.5.272. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. van der Windt D. A., Koes B. W., Boeke A. J., Devillé W., De Jong B. A., Bouter L. M. Shoulder disorders in general practice: prognostic indicators of outcome. Br J Gen Pract. 1996 Sep;46(410):519–523. [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

[Web-only Appendix]
annrheumd_63_10_1288__index.html (1.7KB, html)
annrheumd_63_10_1288__1.pdf (106.3KB, pdf)

Articles from Annals of the Rheumatic Diseases are provided here courtesy of BMJ Publishing Group

RESOURCES