Skip to main content
PMC home page
Annals of the Rheumatic Diseases logoLink to Annals of the Rheumatic Diseases
. 2004 Apr;63(4):335–341. doi: 10.1136/ard.2003.007724

Clinimetric evaluation of shoulder disability questionnaires: a systematic review of the literature

S Bot 1, C Terwee 1, D A W M van der Windt 1, L Bouter 1, J Dekker 1, H C W de Vet 1
PMCID: PMC1754942  PMID: 15020324

Abstract

Methods: Systematic literature searches were performed to identify self administered shoulder disability questionnaires. A checklist was developed to evaluate and compare the clinimetric quality of the instruments.

Results: Two reviewers identified and evaluated 16 questionnaires by our checklist. Most studies were found for the Disability of the Arm, Shoulder, and Hand scale (DASH), the Shoulder Pain and Disability Index (SPADI), and the American Shoulder and Elbow Surgeons Standardised Shoulder Assessment Form (ASES). None of the questionnaires demonstrated satisfactory results for all properties. Most questionnaires claim to measure several domains (for example, pain, physical, emotional, and social functioning), yet dimensionality was studied in only three instruments. The internal consistency was calculated for seven questionnaires and only one received an adequate rating. Twelve questionnaires received positive ratings for construct validity, although depending on the population studied, four of these questionnaires received poor ratings too. Seven questionnaires were shown to have adequate test-retest reliability (ICC >0.70), but five questionnaires were tested inadequately. In most clinimetric studies only small sample sizes (n<43) were used. Nearly all publications lacked information on the interpretation of scores.

Conclusion: The DASH, SPADI, and ASES have been studied most extensively, and yet even published validation studies of these instruments have limitations in study design, sample sizes, or evidence for dimensionality. Overall, the DASH received the best ratings for its clinimetric properties.

Full Text

The Full Text of this article is available as a PDF (275.0 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Amstutz H. C., Sew Hoy A. L., Clarke I. C. UCLA anatomic total shoulder arthroplasty. Clin Orthop Relat Res. 1981 Mar-Apr;(155):7–20. [PubMed] [Google Scholar]
  2. Beaton D. E., Katz J. N., Fossel A. H., Wright J. G., Tarasuk V., Bombardier C. Measuring the whole or the parts? Validity, reliability, and responsiveness of the Disabilities of the Arm, Shoulder and Hand outcome measure in different regions of the upper extremity. J Hand Ther. 2001 Apr-Jun;14(2):128–146. [PubMed] [Google Scholar]
  3. Beaton D. E., Richards R. R. Measuring function of the shoulder. A cross-sectional comparison of five questionnaires. J Bone Joint Surg Am. 1996 Jun;78(6):882–890. doi: 10.2106/00004623-199606000-00011. [DOI] [PubMed] [Google Scholar]
  4. Beaton D., Richards R. R. Assessing the reliability and responsiveness of 5 shoulder questionnaires. J Shoulder Elbow Surg. 1998 Nov-Dec;7(6):565–572. doi: 10.1016/s1058-2746(98)90002-7. [DOI] [PubMed] [Google Scholar]
  5. Bergner M., Bobbitt R. A., Carter W. B., Gilson B. S. The Sickness Impact Profile: development and final revision of a health status measure. Med Care. 1981 Aug;19(8):787–805. doi: 10.1097/00005650-198108000-00001. [DOI] [PubMed] [Google Scholar]
  6. Bland J. M., Altman D. G. Measurement error and correlation coefficients. BMJ. 1996 Jul 6;313(7048):41–42. doi: 10.1136/bmj.313.7048.41. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Bland J. M., Altman D. G. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986 Feb 8;1(8476):307–310. [PubMed] [Google Scholar]
  8. Bombardier C., Tugwell P. Methodological considerations in functional assessment. J Rheumatol Suppl. 1987 Aug;14 (Suppl 15):6–10. [PubMed] [Google Scholar]
  9. Constant C. R., Murley A. H. A clinical method of functional assessment of the shoulder. Clin Orthop Relat Res. 1987 Jan;(214):160–164. [PubMed] [Google Scholar]
  10. Cook K. F., Gartsman G. M., Roddey T. S., Olson S. L. The measurement level and trait-specific reliability of 4 scales of shoulder functioning: an empiric investigation. Arch Phys Med Rehabil. 2001 Nov;82(11):1558–1565. doi: 10.1053/apmr.2001.26622. [DOI] [PubMed] [Google Scholar]
  11. Cook Karon F., Roddey Toni S., Olson Sharon L., Gartsman Gary M., Valenzuela Franz Felix T., Hanten William P. Reliability by surgical status of self-reported outcomes in patients who have shoulder pathologies. J Orthop Sports Phys Ther. 2002 Jul;32(7):336–346. doi: 10.2519/jospt.2002.32.7.336. [DOI] [PubMed] [Google Scholar]
  12. Croft P. Measuring up to shoulder pain. Ann Rheum Dis. 1998 Feb;57(2):65–66. doi: 10.1136/ard.57.2.65. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Croft P., Pope D., Zonca M., O'Neill T., Silman A. Measurement of shoulder related disability: results of a validation study. Ann Rheum Dis. 1994 Aug;53(8):525–528. doi: 10.1136/ard.53.8.525. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Curtis K. A., Roach K. E., Applegate E. B., Amar T., Benbow C. S., Genecco T. D., Gualano J. Development of the Wheelchair User's Shoulder Pain Index (WUSPI). Paraplegia. 1995 May;33(5):290–293. doi: 10.1038/sc.1995.65. [DOI] [PubMed] [Google Scholar]
  15. Davis A. M., Wright J. G., Williams J. I., Bombardier C., Griffin A., Bell R. S. Development of a measure of physical function for patients with bone and soft tissue sarcoma. Qual Life Res. 1996 Oct;5(5):508–516. doi: 10.1007/BF00540024. [DOI] [PubMed] [Google Scholar]
  16. Dawson J., Fitzpatrick R., Carr A. Questionnaire on the perceptions of patients about shoulder surgery. J Bone Joint Surg Br. 1996 Jul;78(4):593–600. [PubMed] [Google Scholar]
  17. Dawson J., Fitzpatrick R., Carr A. The assessment of shoulder instability. The development and validation of a questionnaire. J Bone Joint Surg Br. 1999 May;81(3):420–426. doi: 10.1302/0301-620x.81b3.9044. [DOI] [PubMed] [Google Scholar]
  18. Ellman H., Hanker G., Bayer M. Repair of the rotator cuff. End-result study of factors influencing reconstruction. J Bone Joint Surg Am. 1986 Oct;68(8):1136–1144. [PubMed] [Google Scholar]
  19. Fitzpatrick R., Davey C., Buxton M. J., Jones D. R. Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998;2(14):i-iv, 1-74. [PubMed] [Google Scholar]
  20. Fries J. F., Spitz P., Kraines R. G., Holman H. R. Measurement of patient outcome in arthritis. Arthritis Rheum. 1980 Feb;23(2):137–145. doi: 10.1002/art.1780230202. [DOI] [PubMed] [Google Scholar]
  21. Garratt Andrew, Schmidt Louise, Mackintosh Anne, Fitzpatrick Ray. Quality of life measurement: bibliographic study of patient assessed health outcome measures. BMJ. 2002 Jun 15;324(7351):1417–1417. doi: 10.1136/bmj.324.7351.1417. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Greenhalgh J., Meadows K. The effectiveness of the use of patient-based measures of health in routine practice in improving the process and outcomes of patient care: a literature review. J Eval Clin Pract. 1999 Nov;5(4):401–416. doi: 10.1046/j.1365-2753.1999.00209.x. [DOI] [PubMed] [Google Scholar]
  23. Guyatt G. H., Feeny D. H., Patrick D. L. Measuring health-related quality of life. Ann Intern Med. 1993 Apr 15;118(8):622–629. doi: 10.7326/0003-4819-118-8-199304150-00009. [DOI] [PubMed] [Google Scholar]
  24. Guyatt G. H. Making sense of quality-of-life data. Med Care. 2000 Sep;38(9 Suppl):II175–II179. doi: 10.1097/00005650-200009002-00027. [DOI] [PubMed] [Google Scholar]
  25. Guyatt G., Walter S., Norman G. Measuring change over time: assessing the usefulness of evaluative instruments. J Chronic Dis. 1987;40(2):171–178. doi: 10.1016/0021-9681(87)90069-5. [DOI] [PubMed] [Google Scholar]
  26. Hays R. D., Anderson R., Revicki D. Psychometric considerations in evaluating health-related quality of life measures. Qual Life Res. 1993 Dec;2(6):441–449. doi: 10.1007/BF00422218. [DOI] [PubMed] [Google Scholar]
  27. Hays R. D., Morales L. S., Reise S. P. Item response theory and health outcomes measurement in the 21st century. Med Care. 2000 Sep;38(9 Suppl):II28–II42. doi: 10.1097/00005650-200009002-00007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Heald S. L., Riddle D. L., Lamb R. L. The shoulder pain and disability index: the construct validity and responsiveness of a region-specific disability measure. Phys Ther. 1997 Oct;77(10):1079–1089. doi: 10.1093/ptj/77.10.1079. [DOI] [PubMed] [Google Scholar]
  29. Higginson I. J., Carr A. J. Measuring quality of life: Using quality of life measures in the clinical setting. BMJ. 2001 May 26;322(7297):1297–1300. doi: 10.1136/bmj.322.7297.1297. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Hollinshead R. M., Mohtadi N. G., Vande Guchte R. A., Wadey V. M. Two 6-year follow-up studies of large and massive rotator cuff tears: comparison of outcome measures. J Shoulder Elbow Surg. 2000 Sep-Oct;9(5):373–381. doi: 10.1067/mse.2000.108389. [DOI] [PubMed] [Google Scholar]
  31. Hudak P. L., Amadio P. C., Bombardier C. Development of an upper extremity outcome measure: the DASH (disabilities of the arm, shoulder and hand) [corrected]. The Upper Extremity Collaborative Group (UECG) Am J Ind Med. 1996 Jun;29(6):602–608. doi: 10.1002/(SICI)1097-0274(199606)29:6<602::AID-AJIM4>3.0.CO;2-L. [DOI] [PubMed] [Google Scholar]
  32. Hyland Michael E. Recommendations from quality of life scales are not simple. BMJ. 2002 Sep 14;325(7364):599–599. doi: 10.1136/bmj.325.7364.599/b. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Kirkley A., Griffin S., McLintock H., Ng L. The development and evaluation of a disease-specific quality of life measurement tool for shoulder instability. The Western Ontario Shoulder Instability Index (WOSI). Am J Sports Med. 1998 Nov-Dec;26(6):764–772. doi: 10.1177/03635465980260060501. [DOI] [PubMed] [Google Scholar]
  34. Kirshner B., Guyatt G. A methodological framework for assessing health indices. J Chronic Dis. 1985;38(1):27–36. doi: 10.1016/0021-9681(85)90005-0. [DOI] [PubMed] [Google Scholar]
  35. Kohn D., Geyer M. The subjective shoulder rating system. Arch Orthop Trauma Surg. 1997;116(6-7):324–328. doi: 10.1007/BF00433982. [DOI] [PubMed] [Google Scholar]
  36. L'Insalata J. C., Warren R. F., Cohen S. B., Altchek D. W., Peterson M. G. A self-administered questionnaire for assessment of symptoms and function of the shoulder. J Bone Joint Surg Am. 1997 May;79(5):738–748. [PubMed] [Google Scholar]
  37. Lo I. K., Griffin S., Kirkley A. The development of a disease-specific quality of life measurement tool for osteoarthritis of the shoulder: The Western Ontario Osteoarthritis of the Shoulder (WOOS) index. Osteoarthritis Cartilage. 2001 Nov;9(8):771–778. doi: 10.1053/joca.2001.0474. [DOI] [PubMed] [Google Scholar]
  38. Lohr K. N., Aaronson N. K., Alonso J., Burnam M. A., Patrick D. L., Perrin E. B., Roberts J. S. Evaluating quality-of-life and health status instruments: development of scientific review criteria. Clin Ther. 1996 Sep-Oct;18(5):979–992. doi: 10.1016/s0149-2918(96)80054-3. [DOI] [PubMed] [Google Scholar]
  39. Lydick E., Epstein R. S. Interpretation of quality of life changes. Qual Life Res. 1993 Jun;2(3):221–226. doi: 10.1007/BF00435226. [DOI] [PubMed] [Google Scholar]
  40. Marino R. J., Shea J. A., Stineman M. G. The Capabilities of Upper Extremity instrument: reliability and validity of a measure of functional limitation in tetraplegia. Arch Phys Med Rehabil. 1998 Dec;79(12):1512–1521. doi: 10.1016/s0003-9993(98)90412-9. [DOI] [PubMed] [Google Scholar]
  41. McHorney C. A., Cohen A. S. Equating health status measures with item response theory: illustrations with functional status items. Med Care. 2000 Sep;38(9 Suppl):II43–II59. doi: 10.1097/00005650-200009002-00008. [DOI] [PubMed] [Google Scholar]
  42. McHorney C. A., Tarlov A. R. Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual Life Res. 1995 Aug;4(4):293–307. doi: 10.1007/BF01593882. [DOI] [PubMed] [Google Scholar]
  43. McHorney C. A., Ware J. E., Jr, Lu J. F., Sherbourne C. D. The MOS 36-item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care. 1994 Jan;32(1):40–66. doi: 10.1097/00005650-199401000-00004. [DOI] [PubMed] [Google Scholar]
  44. Meenan R. F., Mason J. H., Anderson J. J., Guccione A. A., Kazis L. E. AIMS2. The content and properties of a revised and expanded Arthritis Impact Measurement Scales Health Status Questionnaire. Arthritis Rheum. 1992 Jan;35(1):1–10. doi: 10.1002/art.1780350102. [DOI] [PubMed] [Google Scholar]
  45. Pransky G., Feuerstein M., Himmelstein J., Katz J. N., Vickers-Lahti M. Measuring functional outcomes in work-related upper extremity disorders. Development and validation of the Upper Extremity Function Scale. J Occup Environ Med. 1997 Dec;39(12):1195–1202. doi: 10.1097/00043764-199712000-00014. [DOI] [PubMed] [Google Scholar]
  46. Reise S. P., Widaman K. F., Pugh R. H. Confirmatory factor analysis and item response theory: two approaches for exploring measurement invariance. Psychol Bull. 1993 Nov;114(3):552–566. doi: 10.1037/0033-2909.114.3.552. [DOI] [PubMed] [Google Scholar]
  47. Roach K. E., Budiman-Mak E., Songsiridej N., Lertratanakul Y. Development of a shoulder pain and disability index. Arthritis Care Res. 1991 Dec;4(4):143–149. [PubMed] [Google Scholar]
  48. Roddey T. S., Olson S. L., Cook K. F., Gartsman G. M., Hanten W. Comparison of the University of California-Los Angeles Shoulder Scale and the Simple Shoulder Test with the shoulder pain and disability index: single-administration reliability and validity. Phys Ther. 2000 Aug;80(8):759–768. [PubMed] [Google Scholar]
  49. Romeo A. A., Bach B. R., Jr, O'Halloran K. L. Scoring systems for shoulder conditions. Am J Sports Med. 1996 Jul-Aug;24(4):472–476. doi: 10.1177/036354659602400411. [DOI] [PubMed] [Google Scholar]
  50. Rowe C. R., Patel D., Southmayd W. W. The Bankart procedure: a long-term end-result study. J Bone Joint Surg Am. 1978 Jan;60(1):1–16. [PubMed] [Google Scholar]
  51. Salerno D. F., Franzblau A., Armstrong T. J., Werner R. A., Becker M. P. Test-retest reliability of the Upper Extremity Questionnaire among keyboard operators. Am J Ind Med. 2001 Dec;40(6):655–666. doi: 10.1002/ajim.10024. [DOI] [PubMed] [Google Scholar]
  52. Simonsick E. M., Kasper J. D., Guralnik J. M., Bandeen-Roche K., Ferrucci L., Hirsch R., Leveille S., Rantanen T., Fried L. P. Severity of upper and lower extremity functional limitation: scale development and validation with self-report and performance-based measures of physical function. WHAS Research Group. Women's Health and Aging Study. J Gerontol B Psychol Sci Soc Sci. 2001 Jan;56(1):S10–S19. doi: 10.1093/geronb/56.1.s10. [DOI] [PubMed] [Google Scholar]
  53. Skutek M., Fremerey R. W., Zeichen J., Bosch U. Outcome analysis following open rotator cuff repair. Early effectiveness validated using four different shoulder assessment scales. Arch Orthop Trauma Surg. 2000;120(7-8):432–436. doi: 10.1007/s004020000133. [DOI] [PubMed] [Google Scholar]
  54. Soldatis J. J., Moseley J. B., Etminan M. Shoulder symptoms in healthy athletes: a comparison of outcome scoring systems. J Shoulder Elbow Surg. 1997 May-Jun;6(3):265–271. doi: 10.1016/s1058-2746(97)90015-x. [DOI] [PubMed] [Google Scholar]
  55. SooHoo Nelson Fong, McDonald Allen P., Seiler John Gray, 3rd, McGillivary Gary R. Evaluation of the construct validity of the DASH questionnaire by correlation to the SF-36. J Hand Surg Am. 2002 May;27(3):537–541. doi: 10.1053/jhsu.2002.32964. [DOI] [PubMed] [Google Scholar]
  56. Terwee C. B., Dekker F. W., Wiersinga W. M., Prummel M. F., Bossuyt P. M. M. On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res. 2003 Jun;12(4):349–362. doi: 10.1023/a:1023499322593. [DOI] [PubMed] [Google Scholar]
  57. Testa M. A., Simonson D. C. Assesment of quality-of-life outcomes. N Engl J Med. 1996 Mar 28;334(13):835–840. doi: 10.1056/NEJM199603283341306. [DOI] [PubMed] [Google Scholar]
  58. Ware J. E., Jr, Sherbourne C. D. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992 Jun;30(6):473–483. [PubMed] [Google Scholar]
  59. Williams J. W., Jr, Holleman D. R., Jr, Simel D. L. Measuring shoulder function with the Shoulder Pain and Disability Index. J Rheumatol. 1995 Apr;22(4):727–732. [PubMed] [Google Scholar]
  60. Winters J. C., Sobel J. S., Groenier K. H., Arendzen J. H., Meyboom-De Jong B. A shoulder pain score: a comprehensive questionnaire for assessing pain in patients with shoulder complaints. Scand J Rehabil Med. 1996 Sep;28(3):163–167. [PubMed] [Google Scholar]
  61. de Bruin A. F., Diederiks J. P., de Witte L. P., Stevens F. C., Philipsen H. Assessing the responsiveness of a functional status measure: the Sickness Impact Profile versus the SIP68. J Clin Epidemiol. 1997 May;50(5):529–540. doi: 10.1016/s0895-4356(97)00047-4. [DOI] [PubMed] [Google Scholar]
  62. van der Heijden G. J., Leffers P., Bouter L. M. Shoulder disability questionnaire design and responsiveness of a functional status measure. J Clin Epidemiol. 2000 Jan;53(1):29–38. doi: 10.1016/s0895-4356(99)00078-5. [DOI] [PubMed] [Google Scholar]
  63. van der Windt D. A., van der Heijden G. J., de Winter A. F., Koes B. W., Devillé W., Bouter L. M. The responsiveness of the Shoulder Disability Questionnaire. Ann Rheum Dis. 1998 Feb;57(2):82–87. doi: 10.1136/ard.57.2.82. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

[Web-only Appendix and Tables]
annrheumd_63_4_335__index.html (1.6KB, html)
annrheumd_63_4_335__1.pdf (7.8KB, pdf)
annrheumd_63_4_335__2.pdf (27.2KB, pdf)

Articles from Annals of the Rheumatic Diseases are provided here courtesy of BMJ Publishing Group

RESOURCES