Abstract
Objective
To assess the reliability and clinically meaningful thresholds of intermittent and constant osteoarthritis pain (ICOAP) score, the Knee injury and Osteoarthritis Outcome Score Physical function Short-form (KOOS-PS), the Hip disability and Osteoarthritis Outcome Score Physical function Short-form (HOOS-PS), and the Quality of life subscales of HOOS/KOOS (HOOS-QOL/KOOS-QOL) in patients with knee or hip arthritis.
Methods
195 patients (141 knee, 54 hip) seen at two orthopedic outpatient clinics with a diagnosis of knee or hip osteoarthritis completed patient-reported questionnaires (ICOAP pain scale, KOOS-PS, HOOS-PS, KOOS-QOL, HOOS-QOL) at baseline and 2-week follow-up. Reliability was assessed using Intraclass correlation coefficients (ICC). We calculated minimally clinically important difference (MCID) and moderate improvement in the subgroup that reported change in their status of their affected joint.
Results
The reliability as assessed by ICCs was as follows: ICOAP pain scale, 0.63 (0.48, 0.74) in patients with knee arthritis, and 0.86 (0.73, 0.93) for hip arthritis; KOOS-PS, 0.66 (0.52, 0.77); HOOS-PS, 0.82 (0.66, 0.91); KOOS-QOL, 0.79 (0.69, 0.86); HOOS-QOL, 0.67 (0.42, 0.83). MCID and moderate improvement estimates in patients with knee arthritis were: ICOAP pain scale, 18.5 and 26.7; KOOS-PS, 2.2 and 15.0; and KOOS-QOL, 8.0 and 15.6. A smaller sample in hip arthritis patients precluded MCID and moderate improvement estimates.
Conclusions
We found that ICOAP pain, and KOOS-PS/HOOS-PS scales were reasonably reliable in patients with hip osteoarthritis. Reliability of these scales was much lower in knee arthritis patients. Thresholds for clinically meaningful change in pain or function on these scales were estimated for patients with knee arthritis.
Keywords: Reliability, sensitivity to change, clinically important difference, Knee, Hip, arthritis, pain, function
Introduction
Recent efforts by two leading organizations, the Osteoarthritis Research Society International (OARSI) and Outcome Measures in Rheumatology Clinical Trials (OMERACT) (1, 2), have led to the development of new pain and function assessments for osteoarthritis (OA). These include the intermittent and constant osteoarthritis pain (ICOAP) score (3) and short forms of two validated function scales- the Hip disability and Osteoarthritis Outcome Score Physical function Short-form (HOOS-PS) and the Knee injury and Osteoarthritis Outcome Score Physical function Short-form (KOOS-PS) (4–6). These assessments are somewhat similar to Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) (7) and are being used increasing in outcome studies in patients with OA.
Published studies have provided initial validation data for these instruments (4–6). In addition, reliability and sensitivity to change data have recently been published. ICOAP was reliable with an intraclass correlation coefficient (ICC) of 0.85 in patients with knee/hip arthritis (3) and ICC ranging 0.65–0.81 in patients who underwent knee/hip replacement surgery (8). In two studies of patients who underwent knee/hip replacement surgery, ICOAP was responsive to change with standardized response means (SRMs) ranging from 0.54–1.82 (8) and 1.02–2.29 (9), similar to other measures such as WOMAC (9), higher for hip than knee replacement. The SRMs for KOOS-PS and HOOS-PS ranged from 0.54–1.82 (8) in patients who underwent knee or hip replacement surgery. However, none of the prior studies estimated clinically important change thresholds for these instruments. In addition, validation in U.S. cohorts has not been performed.
The primary objective of this study was to examine the test-retest reliability of ICOAP pain, HOOS-PS and KOOS-PS questionnaires and the effect of age, race/ethnicity and gender on reliability in a multicenter U.S. study. We also assessed the thresholds for clinically important differences for these questionnaires in patients with knee or hip arthritis.
Methods
Study Population
This study included patients recruited in two large medical centers (Veterans Affairs Medical Center, Minneapolis, Minnesota and MD Anderson Cancer Center, Houston, Texas). Cohorts consisted of consecutive patients with a diagnosis of knee or hip osteoarthritis (OA), who had radiographic evidence of hip or knee OA and were referred to orthopedic surgeons for consideration of joint replacement surgery. Patients were excluded if they had no knee/hip OA, prior knee or hip replacement, or concomitant inflammatory arthritis, or were unable to complete the questionnaire. These patients were recruited as a part of an international multicenter study of patients with knee or hip pain, details of the original study are described elsewhere (10). As a part of the original study, patients completed pain, function and quality of life assessments at the initial visit only. For this study, each patient who completed the baseline survey at the two U.S. centers also received the same survey by mail at 2-weeks to test reliability and clinically important improvement thresholds. The study was approved by the Institutional review boards (IRBs) at the Minneapolis VA medical center and the MD Anderson Cancer Center.
Validation and Statistical analyses
All patients received a repeat survey at 2-weeks of the first survey with the same instruments as the first survey with two additional questions. The first additional question in the survey was whether they had undergone a joint replacement in the joint for which they were evaluated. The second additional question was “Since the last time you completed the survey 2 weeks ago, would you say your hip (or knee) arthritis is: A great deal better, somewhat better, about the same, somewhat worse or a great deal worse.” Patients were asked to choose one of the response options. Patients were included in the analyses if they had not undergone joint replacement surgery, had answered the second question and returned their survey. Sensitivity analyses were performed in a subset that responded within 20 days of the first survey (extra 6-day window allowed for delay due to mailing time).
Each patient completed the following self-reported validated questionnaires: (1) Knee or hip function assessment -- either the Hip disability and Osteoarthritis Outcome Score Physical function Short-form (HOOS-PS) for hip or the Knee injury and Osteoarthritis Outcome Score Physical function Short-form (KOOS-PS) for knee for function (4–6), developed as short forms for assessments of physical function translated into multiple languages (11) (12); (2) pain assessment with intermittent and constant osteoarthritis pain (ICOAP) score (3)(9) translated into other languages (13) (14) (15); and (3) KOOS knee-related quality of life, KOOS-QOL and HOOS-QOL subscales of the original KOOS and HOOS questionnaires (16, 17). The score range for ICOAP pain, KOOS-PS and HOOS-PS is 0–100, 100 being the worst. The score range for KOOS-QOL and HOOS-QOL is 0–100, 100 being the best. ICOAP pain questionnaire has 11 questions, which are used to calculate the overall ICOAP pain; of these 5 questions related to constant pain and 6 questions to intermittent pain, which are used to calculate ICOAP intermittent pain and ICOAP constant pain scores, all three ICOAP pain scores ranged 0–100. ICOAP, KOOS-PS and HOOS-PS were administered as complete instruments; KOOS-QOL and HOOS-QOL are one of the 5 subscales of the original KOOS and HOOS questionnaires (17–19) that were administered as part of the original study (10), while other four subscales were not administered to reduce patient burden and due to relevance of the original study.
Those 110 patients who reported their hip (or knee) arthritis being “about the same” were included for the reliability/reproducibility analyses. We used intraclass correlation coefficients (ICC) to assess the correlation between baseline and follow-up assessments. 95% confidence intervals and p-values were presented. ICC was also calculated for patient subgroups by age, gender, race/ethnicity as follows: (1) age group: <65 vs. ≥65 year old; (2) gender; (3) race/ethnicity: Caucasian vs. non- Caucasian. We used one-way ANOVA to compute the ICC and determine the between subject variation and within subject variation as a measure of test–retest reliability.
Patients who chose that their knee (or hip) arthritis was great deal better or somewhat better constituted the datasets used for estimating minimal clinically important difference (MCID) for improvement (=somewhat better), as recommended (20–22), similar to previous studies (23, 24) and moderate improvement (=a great deal better), respectively. This was calculated as the mean of the difference between baseline and follow-up score for each patient reporting that their arthritis was better since last survey. We also calculated Minimal Detectable Change (MDC) using a statistical anchor to estimate of meaningful change, i.e.,.(25) All analyses were performed using SAS, the Statistical Analysis System, version 9.3. Statistical significance was set at 0.05.
Results
Study Population
Clinical and demographic characteristics of the source and study populations are summarized in Table 1. Of the 107 patients in Minneapolis and 176 patients in Houston recruited for the original study that included the baseline survey (10), 83 patients from Minneapolis and 112 patients from Houston (total 195 patients) returned follow-up mailed surveys and constituted the analytic dataset (Table 1). Of these, 79 patients from Minneapolis and 71 patients from Houston returned their 2-week surveys within 20-days of the first survey and constituted the dataset for sensitivity analyses. Thus, this study included 195 patients- 141 had knee OA and 54 had hip OA. Four patients did not answer the patient global question, so were not eligible for reliability or sensitivity to change analyses.
Table 1.
All (n=195) n (%) of Mean (SD) | Houston (n=112) n (%) of Mean (SD) | Minneapolis (n=83) n (%) of Mean (SD) | |
---|---|---|---|
Age in Years | 60.8 (±11.4) | 60.1 (±8.9) | 61.8 (±14) |
BMI (kg/m2) | 33.9 (±7.2) | 34.9 (±7.7) | 32.6 (±6.4) |
Duration of symptoms in months | 111.1 (±129.9) | 92.4 (±114.2) | 138.4 (±146.3) |
Gender | |||
Female | 83 (42.6%) | 77 (92.8%) | 6 (7.2%) |
Male | 112 (57.4%) | 35 (31.3%) | 77 (68.8%) |
Marital Status | |||
Married | 129 (66.2%) | 78 (60.5%) | 51 (39.5%) |
Not Married | 66 (33.8%) | 34 (51.5%) | 32 (48.5%) |
Education | |||
Above college | 67 (34.4%) | 44 (65.7%) | 23 (34.3%) |
Some college | 100 (51.3%) | 54 (54%) | 46 (46%) |
High school or below | 27 (13.8%) | 14 (51.9%) | 13 (48.1%) |
Ethnicity | |||
Black | 37 (19%) | 34 (91.9%) | 3 (8.1%) |
Hispanic | 6 (3.1%) | 5 (83.3%) | 1 (16.7%) |
Non-Hispanic white | 144 (73.8%) | 68 (47.2%) | 76 (52.8%) |
Other | 8 (4.1%) | 5 (62.5%) | 3 (37.5%) |
Employment Status | |||
Employed | 85 (43.6%) | 60 (70.6%) | 25 (29.4%) |
Other | 109 (55.9%) | 52 (47.7%) | 57 (52.3%) |
Lives alone | |||
No | 140 (71.8%) | 84 (60%) | 56 (40%) |
Yes | 54 (27.7%) | 28 (51.9%) | 26 (48.1%) |
ICOAP Pain | 53.9 (±22.3) | 54.8 (±22.5) | 52.6 (±22.2) |
ICOAP constant pain | 51.1 (±25.6) | 51.7 (±25.6) | 50.1 (±25.6) |
ICOAP intermittent pain | 56.3 (±22.8) | 57.4 (±23) | 54.7 (±22.6) |
HOOS-PS/KOOS-PS | 55 (±20) | 55.7 (±18.9) | 54 (±21.4) |
HOOS-QOL/ KOOS-QOL | 26.9 (±20.9) | 24 (±20.3) | 30.7 (±21.1) |
The mean age of the patients was 61 years, 43% were female, 74% were Caucasians, 66% were married and the mean BMI was 33.9 kg/m2. The mean (standard deviation) time to second survey completion and receipt was 17.6 days (±6.8).
Compared to responders, non-responders to the follow-up survey were younger (57 versus 61 years; p=0.0065), but had no significant differences in marital status, education level, ethnicity and employment status.
Clinically Important Change for Improvement
For patients reporting change in knee or hip arthritis transition question, we calculated estimates for MCID and moderate improvement. The distribution of patients in these categories is presented in Table 2. The baseline and follow-up scores in patients who improved somewhat, a great deal or were about the same are shown in Table 3. The MCID estimates for improvement in ICOAP pain, ICOAP constant pain and ICOAP intermittent pain were 18.5, 18.7 and 18.4 respectively; respective moderate improvement estimates were 26.7, 29.6 and 24.3. For KOOS-PS, MCID and moderate improvement were 2.2 and 15.0 (Table 4). MCID and moderate improvement estimates for KOOS-QOL were 8.0 and 15.6, respectively (Table 4). Sensitivity analyses with 150 patients showed minimal changes (Appendix 6–7).
Table 2.
Since the last time you completed the survey 2 weeks ago, would you say your hip (or knee) arthritis is: | Combined (n=191a) N (%) |
Houston (n=112) N (%) |
Minneapolis (n=79a) N (%) |
---|---|---|---|
A great deal better | 14 (7%) | 8 (7%) | 6 (8%) |
Somewhat better | 32 (17%) | 21 (19%) | 11 (14%) |
About the same | 110 (58%) | 58 (52%) | 52 (66%) |
Somewhat worse | 27 (14%) | 22 (20%) | 5 (6%) |
Great deal worse | 8 (4%) | 3 (3%) | 5 (6%) |
4 patients from Minneapolis site did not respond to the this transition question at the follow=up survey; p=0.05, comparing Houston to Minneapolis site
Table 3.
Patient global on follow-up | ||||
---|---|---|---|---|
Baseline | Great deal better | Somewhat better | About the same | |
KNEE | N=141 | N=12 | N=26 | N=81 |
ICOAP Pain | 53.3 (±23.0) | 17.4 (±12.2) | 41.3 (±14.1) | 47.4 (±22.0) |
ICOAP constant pain | 50.7 (±26.0) | 13.8 (±13.3) | 38.5 (±19.7) | 43.0 (±24.3) |
ICOAP intermittent pain | 55.5 (±23.3) | 20.5 (±14.9) | 43.6 (±15.5) | 51.1 (±22.1) |
HOOS-PS/KOOS-PS | 54.5 (±19.4) | 31.4 (±12.2) | 52.1 (±17.4) | 51.0 (±18.5) |
HOOS-QOL/KOOS-QOL | 27.4 (±21.1) | 59.4 (±19.9) | 34.8 (±16.5) | 29.5 (±20.2) |
N=141
Only 1 and 5 patients reported feeling great deal better or somewhat better among those with hip symptoms, thereby not allowing us to perform meaningful analyses for patients with hip symptoms
N=20 and N=69 for the respective categories for HOOS-QOL/KOOS-QOL scores; 11 patients reported worse status on patient global question
Table 4.
Improvement in score Mean (SD) | Relative (%) improvement in score | MDC90 | |
---|---|---|---|
ICOAP Pain (scale 0–100) | |||
Moderate Improvement (=“great deal better”) (N=12) | −26.7 (±14.8) | −60.5% | 49.6 |
MCID Improvement (=“somewhat better”) (N=26) | −18.5 (±22.0) | −31.0% | 46.6 |
ICOAP Constant Pain | |||
Moderate Improvement (=“great deal better”) (N=12) | −29.6 (±14.8) | −68.3% | 53.8 |
MCID Improvement (=“somewhat better”) (N=26) | −18.7 (±24.4) | −32.7% | 49.6 |
ICOAP Intermittent Pain | |||
Moderate Improvement (=“great deal better”) (N=12) | −24.3 (±17.9) | −54.3% | 48.7 |
MCID Improvement (=“somewhat better”) (N=26) | −18.4 (±25.4) | −29.7% | 50.8 |
KOOS-PS (scale 0–100) | |||
Moderate Improvement (=“great deal better”) (N=12) | −15.0 (±16.4) | −32.3% | 35.5 |
MCID Improvement (=“somewhat better”) (N=26) | −2.2 (±17.5) | −4.0% | 28.3 |
KOOS-QOL (scale 0–100) | |||
Moderate Improvement (=“great deal better”) (N=12) | 15.6 (±18.8) | 35.7% | 39.0 |
MCID Improvement (=“somewhat better”) (N=25) | 8.0 (±16.1) | 25.7% | 29.0 |
Relative (%) improvement in score was calculated as = 100* (followup score mean−baseline score mean)/baseline score mean
Reproducibility/Reliability
110 patients (81, knee arthritis; 29 hip arthritis) reported that their arthritis was about the same as at the time of baseline survey. They constituted the analytic dataset for the assessment of reproducibility/reliability (Table 5). The ICC was 0.63 for ICOAP pain in knee and 0.86 in hip arthritis patients. Respective ICCs for ICOAP constant pain were 0.57 and 0.81 and for ICOAP intermittent pain were 0.64 and 0.83. ICC was 0.66 for KOOS-PS and 0.82 for HOOS-PS (Table 5). ICC for KOOS-QOL was 0.79 and for HOOS-QOL was 0.67.
Table 5.
Intra-class coefficient (95% confidence interval) | ||
---|---|---|
Knee (n=81) | Hip (n=29) | |
ICOAP pain | 0.63 (0.48, 0.74) | 0.86 (0.73, 0.93) |
ICOAP constant pain | 0.57 (0.40, 0.70) | 0.81 (0.64, 0.90) |
ICOAP intermittent pain | 0.64 (0.49, 0.75) | 0.83 (0.68, 0.91) |
KOOS-PS | 0.66 (0.52, 0.77) | N/A |
HOOS-PS | N/A | 0.82 (0.66, 0.91) |
KOOS-QOL | 0.79 (0.69, 0.86) | N/A |
HOOS-QOL | N/A | 0.67 (0.42, 0.83) |
Variation in reproducibility of ICOAP pain, HOOS/KOOS PS and QOL by age, gender and race/ethnicity is presented in Appendix 1. We noted variation in reproducibility in KOOS-PS by gender and race/ethnicity and by race/ethnicity in KOOS-QOL. In the hip cohort, variations in reproducibility for HOOS-PS and HOOS-QOL were noted by race/ethnicity (Appendix 1). Socio-demographic and clinical characteristics of sensitivity cohort is shown in Appendix 2. Sensitivity analyses with 150 patients showed minimal changes compared to the main analyses of the cohort of 195 patients (Appendix 3–5).
Discussion
In this two-center study of ethnically diverse U.S. cohorts, we found that three assessments of pain and function, i.e., ICOAP, KOOS-PS and HOOS-PS, were reproducible in patients with knee and hip arthritis. Reproducibility/reliability of ICOAP pain, HOOS-PS and KOOS-PS was good in hip OA (0.82–0.88) and moderate in patients with knee OA (0.52–0.66). Reliability varied somewhat with age, gender, and race/ethnicity, as expected. Our study also provided reliability statistics for KOOS-QOL and HOOS-QOL scales. We also present estimates for MCID and moderate improvement for these scales in patients with knee arthritis.
The main finding from our study was that ICOAP, KOOS-PS and HOOS-PS had moderate to good test-retest reproducibility. In a recent single center study in Europe that assessed test-retest reliability at 2-weeks in OA patients that later underwent joint arthroplasty, ICCs for ICOAP, HOOS-PS and KOOS-PS scales ranged 0.80–0.84 in hip and 0.65–0.85 in knee patients, similar to WOMAC (8). Our ICCs were within this previously reported range, thus our multicenter study confirms this earlier finding in a more ethnically diverse population. The study cohorts were assembled similarly in the two studies. However we had a racial/ethnically diverse population compared to the previous study, which might partially explain a ICCs towards the lower end of the range in our knee cohort. Another potential reason for lower ICC in knee cohort may be due to a week-to-week variation in knee pain that is not captured in the global question asking about the worsening of arthritis. The ICCs may also differ due to differences in prevalence of disease, which has been shown to impact ICC (26) or due to random variation, given a small sample size for hip cohort. The studies differed in that we only analyzed patients who reported no change in the status of their knee/hip arthritis between two visits (56.4% of the cohort) versus analyses of all patients in the previous study (since transition question was not asked) for reliability assessment, a more conservative approach. In our study, reliability for KOOS-QOL and HOOS-QOL were 0.79 and 0.67, respectively, lower than the ICC of 0.89 reported for the Persian version of KOOS-QOL (27). This may be due to minor content differences due to translation, difference in study populations.
We noted minimal variation in reproducibility for pain and minimal to moderate variation in reproducibility for QOL assessments by various patient characteristics including age, gender and race/ethnicity. Most 95% confidence intervals were overlapping, signifying that these differences were not statistically significant in this small sample, indicating the lack of difference or the lack of power to detect a small difference. These findings highlight the impact of patient characteristics on patient-reported outcomes. This is not unexpected and has been reported previously with Short-form 36 with reliability ranging 0.65 to 0.94 across patient groups (28). However, reliability variation has not been studied in previous validation studies of most other instruments. Thus, our adds to the existing body of knowledge. One must also not over-interpret these findings that need to be reproduced. These findings also suggest that future studies reporting on validity of instruments should consider performing the statistics by gender, race and age, which could all provide useful guidance to the users of the instruments. This also raises a question, whether various validation characteristics of instruments, such as MCID and validity statistics that are usually reported for overall populations and not for individual subgroups, are more accurate and applicable to some patient subgroups than others. This is likely the case, since the overall average incorporates a range among respondents. This is a broad research agenda, not limited to these instruments, that needs more attention
Our study provides estimates of clinically important improvement by estimating MCID and moderate improvement for these instruments in patients with knee OA, thus adding to the current knowledge; the hip OA sample was not large enough to perform analyses. ICOAP (8) (9), HOOS-PS and KOOS-PS (8) have been shown be sensitive to change in previously published studies in patients who underwent knee or hip arthroplasty, surgeries demonstrated to be associated with significant improvements in pain and function after knee/hip joint replacement, similar to WOMAC. Thus, these measures have desirable psychometric properties.
Estimation of clinically meaningful changes are critical for validated instruments, since these provide guidance for calculating sample sizes for studies aimed at examining patient-relevant outcomes and comparing different interventions in patients with knee/hip OA or those undergoing arthroplasty, such as comparing arthroplasty implants or treatment pathways. Moderate improvement represents really important change for the patients. For knee cohort, moderate improvement was estimated at 27 units for ICOAP pain scale, 30 units for ICOAP constant pain and 24 units for ICOAP intermittent pain. To our knowledge, this is the first study to provide MCID and moderate improvement estimates for these validated scales. We also provided estimates for MCID for KOOS-PS and KOOS-QOL. These thresholds represent meaningful changes that can be appreciated by patients as above and beyond the daily variation. Future studies should estimate MCID and moderate improvement for hip OA patients, since due to only a few patients providing this information we were unable to estimate these.
Our study findings must be interpreted considering study limitations. Patients in this study were recruited from orthopedic offices where they were assessed for potential evaluation for joint replacement surgery and these estimates may be different for populations with milder arthritis or other causes of knee pain and in younger patients. Our study was not powered to examine differences in reliability by patient characteristics (age, gender and race) and therefore we may have missed small differences. Despite reasonable study sample size, we had a small sample for estimating clinically important differences, especially for moderate improvement estimations (standard errors were large) and for assessing reliability in the hip cohort. Although similar sample sizes have been used to derive reliability and validation statistics (29–31), our confidence in these estimates is not high. A small sample also did not allow us to examine MCID and moderate improvement thresholds by categories of baseline scores. More studies are needed to confirm our estimates in larger groups of patients. Study strengths include that this was a multicenter study, recruited a significant number of minority patients and women and assessed instruments that are relevant to patients with OA.
In summary, we found that in the hip cohort ICAOP pain, HOOS-PS, and HOOS-QOL had moderate-high reliability. Reliability was moderate for ICOAP pain and KOOS-PS and high for KOOS-QOL in the knee cohort. Our study provided estimates for clinically meaningful changes for improvement for these assessments, which can be used to calculate sample sizes for future randomized and cohort studies and allow comparison of different treatment modalities/implants. Future studies should assess whether our estimates for clinically meaningful changes in patients with knee or hip arthritis are stable across other populations.
Supplementary Material
Acknowledgments
We thank the patients for participation in the original study.
Grant support: This material is the result of work supported with National Institute of Health (NIH) Clinical Translational Science Award 1 KL2 RR024151-01 (Mayo Clinic Center for Clinical and Translational Research), the resources and the use of facilities at the Birmingham VA Medical Center, Alabama, USA. The original study was supported by unrestricted grants to scientific societies (OARSI and OMERACT) from pharmaceutical companies: Pfizer, Expansciences, Novartis, Negma Lerads, Rottapharm, Fidia and Pierre Fabre Santé laboratories) and a research grant from the European League against Rheumatism (EULAR). Dr. Suarez-Almazor is the recipient of a K24 award from the National Institute for Arthritis, Musculoskeletal and Skin Disorders (AR053593).
Footnotes
The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the United States government
Financial Conflict: There are no financial conflicts related to this work. J.A.S. has received research and travel grants from Takeda and Savient; and consultant fees from Savient, Regeneron, Takeda and Allergan. RL, GL, and MSA have no financial interests related to this work.
Each author certifies that his or her institution has approved the human protocol for this investigation and that all investigations were conducted in conformity with ethical principles of research.
References
- 1.Lingard EA, Katz JN, Wright RJ, Wright EA, Sledge CB. Validity and responsiveness of the Knee Society Clinical Rating System in comparison with the SF-36 and WOMAC. J Bone Joint Surg Am. 2001;83-A(12):1856–64. doi: 10.2106/00004623-200112000-00014. Epub 2001/12/13. [DOI] [PubMed] [Google Scholar]
- 2.Gossec L, Hawker G, Davis AM, Maillefert JF, Lohmander LS, Altman R, et al. OMERACT/OARSI initiative to define states of severity and indication for joint replacement in hip and knee osteoarthritis. J Rheumatol. 2007;34(6):1432–5. Epub 2007/06/07. [PubMed] [Google Scholar]
- 3.Hawker GA, Davis AM, French MR, Cibere J, Jordan JM, March L, et al. Development and preliminary psychometric testing of a new OA pain measure--an OARSI/OMERACT initiative. Osteoarthritis Cartilage. 2008;16(4):409–14. doi: 10.1016/j.joca.2007.12.015. Epub 2008/04/03. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Davis AM, Perruccio AV, Canizares M, Hawker GA, Roos EM, Maillefert JF, et al. Comparative, validity and responsiveness of the HOOS-PS and KOOS-PS to the WOMAC physical function subscale in total joint replacement for osteoarthritis. Osteoarthritis Cartilage. 2009;17(7):843–7. doi: 10.1016/j.joca.2009.01.005. Epub 2009/02/14. [DOI] [PubMed] [Google Scholar]
- 5.Davis AM, Perruccio AV, Canizares M, Tennant A, Hawker GA, Conaghan PG, et al. The development of a short measure of physical function for hip OA HOOS-Physical Function Shortform (HOOS-PS): an OARSI/OMERACT initiative. Osteoarthritis Cartilage. 2008;16(5):551–9. doi: 10.1016/j.joca.2007.12.016. Epub 2008/02/26. [DOI] [PubMed] [Google Scholar]
- 6.Perruccio AV, Stefan Lohmander L, Canizares M, Tennant A, Hawker GA, Conaghan PG, et al. The development of a short measure of physical function for knee OA KOOS-Physical Function Shortform (KOOS-PS) - an OARSI/OMERACT initiative. Osteoarthritis Cartilage. 2008;16(5):542–50. doi: 10.1016/j.joca.2007.12.014. Epub 2008/02/26. [DOI] [PubMed] [Google Scholar]
- 7.Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW. Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988;15(12):1833–40. Epub 1988/12/01. [PubMed] [Google Scholar]
- 8.Ruyssen-Witrand A, Fernandez-Lopez CJ, Gossec L, Anract P, Courpied JP, Dougados M. Psychometric properties of the OARSI/OMERACT osteoarthritis pain and functional impairment scales: ICOAP, KOOS-PS and HOOS-PS. Clin Exp Rheumatol. 2011;29(2):231–7. Epub 2011/04/08. [PubMed] [Google Scholar]
- 9.Davis AM, Lohmander LS, Wong R, Venkataramanan V, Hawker GA. Evaluating the responsiveness of the ICOAP following hip or knee replacement. Osteoarthritis Cartilage. 2010;18(8):1043–5. doi: 10.1016/j.joca.2010.04.013. Epub 2010/05/04. [DOI] [PubMed] [Google Scholar]
- 10.Gossec L, Paternotte S, Maillefert JF, Combescure C, Conaghan PG, Davis AM, et al. The role of pain and functional impairment in the decision to recommend total joint replacement in hip and knee osteoarthritis: an international cross-sectional study of 1909 patients. Report of the OARSI-OMERACT Task Force on total joint replacement. Osteoarthritis Cartilage. 2011;19(2):147–54. doi: 10.1016/j.joca.2010.10.025. Epub 2010/11/04. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Ornetti P, Perruccio AV, Roos EM, Lohmander LS, Davis AM, Maillefert JF. Psychometric properties of the French translation of the reduced KOOS and HOOS (KOOS-PS and HOOS-PS) Osteoarthritis Cartilage. 2009;17(12):1604–8. doi: 10.1016/j.joca.2009.06.007. Epub 2009/07/11. [DOI] [PubMed] [Google Scholar]
- 12.Goncalves RS, Cabri J, Pinheiro JP, Ferreira PL, Gil J. Reliability, validity and responsiveness of the Portuguese version of the Knee injury and Osteoarthritis Outcome Score--Physical Function Short-form (KOOS-PS) Osteoarthritis Cartilage. 2010;18(3):372–6. doi: 10.1016/j.joca.2009.10.012. Epub 2009/11/17. [DOI] [PubMed] [Google Scholar]
- 13.Goncalves RS, Cabri J, Pinheiro JP, Ferreira PL, Gil J. Cross-cultural adaptation and validation of the Portuguese version of the intermittent and constant osteoarthritis pain (ICOAP) measure for the knee. Osteoarthritis Cartilage. 2010;18(8):1058–61. doi: 10.1016/j.joca.2010.05.007. Epub 2010/05/19. [DOI] [PubMed] [Google Scholar]
- 14.Maillefert JF, Kloppenburg M, Fernandes L, Punzi L, Gunther KP, Martin Mola E, et al. Multi-language translation and cross-cultural adaptation of the OARSI/OMERACT measure of intermittent and constant osteoarthritis pain (ICOAP) Osteoarthritis Cartilage. 2009;17(10):1293–6. doi: 10.1016/j.joca.2009.04.003. Epub 2009/05/05. [DOI] [PubMed] [Google Scholar]
- 15.Kessler S, Grammozis A, Gunther KP, Kirschner S. The intermittent and constant pain score (ICOAP) - a questionnaire to assess pain in patients with gonarthritis. Z Orthop Unfall. 2011;149(1):22–6. doi: 10.1055/s-0030-1249967. Epub 2010/06/22. Testtheoretische Uberprufung der deutschen Version des Intermittent and Constant Osteoarthritis Pain Score (ICOAP) - ein Fragebogen zur Schmerzerfassung bei Patienten mit Gonarthrose. [DOI] [PubMed] [Google Scholar]
- 16.Roos EM, Roos HP, Lohmander LS, Ekdahl C, Beynnon BD. Knee Injury and Osteoarthritis Outcome Score (KOOS)--development of a self-administered outcome measure. J Orthop Sports Phys Ther. 1998;28(2):88–96. doi: 10.2519/jospt.1998.28.2.88. Epub 1998/08/12. [DOI] [PubMed] [Google Scholar]
- 17.Klassbo M, Larsson E, Mannevik E. Hip disability and osteoarthritis outcome score. An extension of the Western Ontario and McMaster Universities Osteoarthritis Index. Scand J Rheumatol. 2003;32(1):46–51. doi: 10.1080/03009740310000409. Epub 2003/03/15. [DOI] [PubMed] [Google Scholar]
- 18.Nilsdotter AK, Lohmander LS, Klassbo M, Roos EM. Hip disability and osteoarthritis outcome score (HOOS)--validity and responsiveness in total hip replacement. BMC Musculoskelet Disord. 2003;4:10. doi: 10.1186/1471-2474-4-10. Epub 2003/06/05. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Roos EM, Toksvig-Larsen S. Knee injury and Osteoarthritis Outcome Score (KOOS) - validation and comparison to the WOMAC in total knee replacement. Health Qual Life Outcomes. 2003;1:17. doi: 10.1186/1477-7525-1-17. Epub 2003/06/13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Jaeschke R, Singer J, Guyatt GH. Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials. 1989;10(4):407–15. doi: 10.1016/0197-2456(89)90005-6. Epub 1989/12/01. [DOI] [PubMed] [Google Scholar]
- 21.Deyo RA, Diehr P, Patrick DL. Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation. Control Clin Trials. 1991;12(4 Suppl):142S–58S. doi: 10.1016/s0197-2456(05)80019-4. Epub 1991/08/01. [DOI] [PubMed] [Google Scholar]
- 22.Guyatt G, Walter S, Norman G. Measuring change over time: assessing the usefulness of evaluative instruments. J Chronic Dis. 1987;40(2):171–8. doi: 10.1016/0021-9681(87)90069-5. Epub 1987/01/01. [DOI] [PubMed] [Google Scholar]
- 23.Salaffi F, Stancati A, Silvestri CA, Ciapetti A, Grassi W. Minimal clinically important changes in chronic musculoskeletal pain intensity measured on a numerical rating scale. Eur J Pain. 2004;8(4):283–91. doi: 10.1016/j.ejpain.2003.09.004. Epub 2004/06/23. [DOI] [PubMed] [Google Scholar]
- 24.Fortin PR, Stucki G, Katz JN. Measuring relevant change: an emerging challenge in rheumatologic clinical trials. Arthritis Rheum. 1995;38(8):1027–30. doi: 10.1002/art.1780380802. Epub 1995/08/01. [DOI] [PubMed] [Google Scholar]
- 25.Escobar A, Quintana JM, Bilbao A, Arostegui I, Lafuente I, Vidaurreta I. Responsiveness and clinically important differences for the WOMAC and SF-36 after total knee replacement. Osteoarthritis Cartilage. 2007;15(3):273–80. doi: 10.1016/j.joca.2006.09.001. Epub 2006/10/21. [DOI] [PubMed] [Google Scholar]
- 26.Gulliford MC, Adams G, Ukoumunne OC, Latinovic R, Chinn S, Campbell MJ. Intraclass correlation coefficient and outcome prevalence are associated in clustered binary data. J Clin Epidemiol. 2005;58(3):246–51. doi: 10.1016/j.jclinepi.2004.08.012. Epub 2005/02/19. [DOI] [PubMed] [Google Scholar]
- 27.Salavati M, Akhbari B, Mohammadi F, Mazaheri M, Khorrami M. Knee injury and Osteoarthritis Outcome Score (KOOS); reliability and validity in competitive athletes after anterior cruciate ligament reconstruction. Osteoarthritis Cartilage. 2011;19(4):406–10. doi: 10.1016/j.joca.2011.01.010. Epub 2011/01/25. [DOI] [PubMed] [Google Scholar]
- 28.McHorney CA, Ware JE, Jr, Lu JF, Sherbourne CD. The MOS 36-item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care. 1994;32(1):40–66. doi: 10.1097/00005650-199401000-00004. Epub 1994/01/01. [DOI] [PubMed] [Google Scholar]
- 29.Bohannon RW, Smith MB. Interrater reliability of a modified Ashworth scale of muscle spasticity. Physical therapy. 1987;67(2):206–7. doi: 10.1093/ptj/67.2.206. Epub 1987/02/01. [DOI] [PubMed] [Google Scholar]
- 30.Goodman WK, Price LH, Rasmussen SA, Mazure C, Fleischmann RL, Hill CL, et al. The Yale-Brown Obsessive Compulsive Scale. I. Development, use, and reliability. Archives of general psychiatry. 1989;46(11):1006–11. doi: 10.1001/archpsyc.1989.01810110048007. Epub 1989/11/01. [DOI] [PubMed] [Google Scholar]
- 31.Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, et al. Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): initial reliability and validity data. J Am Acad Child Adolesc Psychiatry. 1997;36(7):980–8. doi: 10.1097/00004583-199707000-00021. Epub 1997/07/01. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.