Abstract
BACKGROUND
The musculoskeletal tumour society score (MSTS) is a well-known questionnaire for measuring functional outcome in patients with neoplasms in the extremities. Standardized guidelines for cross-cultural translation and validation ensure the equivalence of content between the original and translated versions. The translation and validation provide the possibility to compare different sarcoma populations on an international level. This study is based on the hypothesis that the Danish MSTS questionnaire is a valid tool for measuring the end result after surgery for neoplasms in the extremities.
AIM
To validate the Danish version of the upper and lower extremity version of the MSTS.
METHODS
The translation of the MSTS was conducted in accordance with international guidelines. Patients operated for sarcomas and aggressive benign tumors were invited to participate in the study. The psychometric properties of the Danish version of the MSTS were tested in terms of validity and reliability and for the risk of floor or ceiling effect. Spearman’s rank coefficient was used to test the validity by comparing with the Toronto Extremity Salvage Score (TESS). The Intraclass Correlation Coefficient (ICC) was used to evaluate inter-rater reliability. Cronbach’s alpha was used to test for internal consistency. Spearman’s rank coefficient was used to compare the MSTS lower extremity version with the objective test, Timed Up and Go (TUG).
RESULTS
The upper extremity version demonstrated an ICC of 0.95 in the inter-rater reliability test. The lower extremity version had an ICC of 0.88 in the inter-rater reliability test, respectively. Both MSTS versions showed a ceiling effect. The validity of the MSTS was measured by Spearman’s rank correlation coefficient by comparing the MSTS with the TESS and found it to be of 0.80 (P < 0.01) and 0.83 (P < 0.01) for the upper extremity and lower extremity version, respectively. A Spearman’s rank correlation coefficient of - 0.26 (P < 0.01) was found between the TUG and the MSTS questionnaire. A Spearman’s rank correlation coefficient of - 0.38 (P < 0.01) was found between the TUG and the lower extremity version of the TESS questionnaire.
CONCLUSION
The Danish version of the MSTS questionnaires were found to have good reliability and validity, however a substantial ceiling effect was identified.
Keywords: Sarcoma, Patient outcome assessment, Clinical oncology, Surgical oncology, Patient satisfaction
Core tip: The Danish version of the musculoskeletal tumour society score (MSTS) was found to have an overall good reliability and validity, however a substantial ceiling effect as well as a possibility of measurement error in the MSTS score was found. These findings must be taken into consideration when using the MSTS questionnaire.
INTRODUCTION
The Musculoskeletal Tumour Society Score (MSTS) questionnaire was developed in 1985 and revised in 1993 as a physician-completed questionnaire to measure functional outcome in patients with neoplasms[1]. The MSTS has been widely used in sarcoma research[2-6]. However, the English version of the MSTS has never been properly validated[1]. The lower extremity version of the MSTS has been translated and validated into Brazilian Portuguese, Chinese and Japanese[7-9]. To our knowledge, the MSTS has never been properly translated and validated for Danish-speaking patients.
Guillemin et al[10] were some of the first to construct a standardized guideline for cross-cultural translation. The cross-cultural translation is intended to ensure the equivalency of content between the original and translated version. Equivalency is achieved by ensuring not only correct linguistic translation but also cultural adaption. Others have since created recommendations regarding ways of assessing the psychometric properties of such an instrument[11,12].
The Timed Up and Go (TUG) test was introduced in 1991 as measure of dynamic balance and basic mobility skills needed for daily living[13]. It has been shown to have good validity and reliability in lower extremity patients who have undergone unilateral amputation[13]. The TUG has not been properly validated for use in sarcoma patients who have undergone limb-sparing surgery, although Marchese et al[14] have validated the TUG as part of a larger functional outcome assessment method in sarcoma patients.
Only few studies have investigated the correlation between objective measurements and questionnaires, such as the MSTS[14,15]. However, Marchese et al[14] found a fair to moderate correlation between the TUG and the MSTS and TESS questionnaires.
In order to compare Danish sarcoma patients’ functional outcomes internationally, the aims of this study have been: (1) to validate the psychometric properties of the Danish translation of the lower and upper extremity version of the MSTS questionnaire; and (2) to investigate the correlation between functional outcomes as measured by questionnaires, such as the MSTS and the Toronto Extremity Salvage Score (TESS), and the objective measurement, TUG, in patients with lower extremity tumors.
MATERIALS AND METHODS
Study design
The translation of the MSTS questionnaire into Danish was conducted at the Department of Orthopedic Surgery at Aarhus University Hospital between May and August 2015. The validation of the Danish translation was carried out among patients operated for sarcoma or aggressive benign tumors who attended the outpatient clinic at Aarhus University Hospital (Aarhus, Denmark) between August 2015 and June 2016. The study was reported to and approved by the Danish Data Protection Agency (file No. 1-16-02-650-15). Informed consent was obtained from all patients participating in this study. The study was preapproved in accordance with the national ethical guidelines and in accordance with the Helsinki Declaration. The translation method used was based on published international guidelines for the process of cross-cultural translation of an instrument[10,16]. The cross-cultural translation and validation consists of several stages.
Translation
Stage I: Forward-translation: Two independent translators translated the upper and lower extremity version of the MSTS questionnaire (including the instructions to the user) from the original English version. The two independent translators were fluent in English and Danish but had Danish as their native language (both held diplomas in English and one was also a linguist). The two translators had different backgrounds in order to achieve the best possible translation. The first translator was a physician with clinical experience and was therefore considered an “informed” translator. The second translator had no clinical experience or relation to health care and was therefore considered a “naive” translator.
Stage II: Synthesis of a combined translation: The two translations were compared, and any discrepancies were discussed and resolved by the two forward-translators. A combined translation was finally made from the original English version and the two independent translations.
Stage III: Backward-translation: Two new independent translators conducted a backward-translation based upon the combined translation. They were blinded for the initial two forward-translations and the original English version. Both backward-translators were fluent in English (both held diplomas in English) and had Danish as their native language. The first backward-translator was a highly experienced researcher in health care, however with no prior knowledge to the concepts of the MSTS questionnaire. The second translator had no prior clinical experience or relations to health care.
Stage IV: Committee: The authors of this paper reviewed all the translated versions and components of the questionnaire, and the discrepancies were discussed following consensus concerning the final wording and formatting of the Danish version of the MSTS questionnaire.
The validation process
The validation was designed as a cross-sectional design, requiring physicians to complete the MSTS questionnaire and patients to complete the TESS. In case patients had been operated in the lower extremities, they also completed the TUG test.
Study population
All patients, age 18 or above, who had undergone surgical treatment for sarcomas or aggressive benign tumors in the extremities, were consecutively asked to participate in the study when attending the outpatient clinic. All patients were required to read and speak Danish to be able to participate. Patients were excluded if they had competing diseases affecting their physical function. A total of 240 out of 267 were included in the study.
Measurements
The MSTS is based on factors related to the patient as a whole and of those specific to the upper or lower extremity. It consists of six items of which the first three are identical in both MSTS versions: Pain, daily function and emotional acceptance. The upper extremity version also encompasses items measuring hand positioning, dexterity and lifting ability. As for the lower extremity version, this consists of items measuring the use of aids, walking ability and gait[1]. Each of the aforementioned items is assigned a value of 0 to 5 points, and the final score is calculated as a percentage of the maximum obtainable score. The original English version of the MSTS was never tested for psychometric properties. However, the lower extremity version was translated and validated into Brazilian Portuguese, Chinese and Japanese[7-9].
The TESS assesses functional outcome in musculoskeletal tumor patients aged 12-85 years[17]. The TESS consists of upper and lower extremity versions which have 29 items and 30 items, respectively. The final TESS score ranges between 0 and 100. The TUG test measures the time needed to stand up from a chair, walk 3 meters, turn around, walk back and sit back down in the chair[13]. A stopwatch was used to document the time used.
Analysis of the data
Data was analyzed in Stata, version 12.1. Descriptive statistics were used for the patients’ clinical demographic. All variables were examined to ascertain data distribution.
The psychometric properties were evaluated by assessing different domains, such as reliability and validity, as well as the estimate for possible floor and ceiling effects. Furthermore, the patients were stratified into groups according to tumor types.
The domain of reliability could be further divided into subdomains such as internal consistency, reliability and measurement error. The internal consistency was measured by Cronbach’s α. A Cronbach’s α between 0.70 and 0.95 was considered good[18]. The inter-rater test was conducted by having two different physicians independently complete the MSTS questionnaire in the outpatient clinic. The inter-rater reliability was measured by intraclass correlations coefficient (ICC). The measurement error of the MSTS questionnaire was assessed by Bland-Altman plots in the inter-rater test[19].
In this study, the construct validity was assessed by comparing the MSTS score with the TESS score[18]. This was evaluated by either the Pearson’s r or the Spearman’s rank correlation coefficient, depending on the distribution of data. Floor and ceiling effects were considered present if > 15% of the patients received the lowest or highest possible score, respectively[18].
The correlation between functional outcome measured by questionnaires (MSTS and TESS) and an objective measurement (TUG) was found by calculating correlation coefficients between MSTS and TUG as well as TESS and TUG by using either Pearson’s r or Spearman’s rank correlation coefficient, depending on the distribution of data.
RESULTS
Translation
The results showed an overall high consistency between the two forward-translations and the two back-translations when compared with the original English version. Only the item concerning emotional acceptance was found to be slightly different due to the differences in how Danish people express their feelings concerning their health and the treatment. In the original English version words such as “enthusiastic” and “like it” are used for describing the feelings of the surgical treatment, however a Danish patient might find this wording culturally strange for describing the feelings of a cancer diagnosis and the treatment of this. The Danish version does however take this into account, hence the emotional acceptance item was still found appropriate.
Validation
The demographic data concerning the patients is listed in Table 1. The participation rate was 89.9%. Table 2 describes the reasons for the 27 patients not participating in the study. The median MSTS scores for upper and lower extremity versions were 93 (Interquartile range (IQR): 80-100) and 87 (IQR: 73-97), respectively. The median TESS scores for upper and lower extremity versions were 98 (IQR: 83-100) and 93 (IQR: 81-98), respectively. The median TUG time (in seconds) was 6.4 (IQR: 5.4-8.0).
Table 1.
Baseline characteristics of the patients
| Characteristics | Patients (n = 240) |
| Age (mean) | 52.6 ± 18.4 |
| Range in age | 18-89 |
| Years since surgery (median) | 2.2 |
| Range in years | 0.5-8.1 |
| Gender | |
| Male | 125 |
| Female | 115 |
| Location | |
| Upper extremity | 78 |
| Lower extremity | 162 |
| Type | |
| Soft tissue sarcoma | 149 |
| Bone sarcoma | 63 |
| Aggressive benign tumor | 28 |
Table 2.
Reasons for exclusion from the study
| n (%) | |
| Did not wish to participate | 10 (37) |
| Incomplete questionnaire | 9 (33) |
| Could not read Danish | 4 (15) |
| Competing disease affecting function | 3 (11) |
The test for internal consistency resulted in a Cronbach’s α of 0.85 for the upper extremity version and 0.79 for the lower extremity version. The inter-rater reliability was also measured by the ICC and was found to be 0.95 (95%CI: 0.92-0.97) for the upper extremity version and 0.88 (95%CI: 0.84-0.91) for the lower extremity version. Figures 1 and 2 present the limits of agreement in a Bland-Altman plot for the upper extremity versions and the lower extremity versions, respectively.
Figure 1.
A Bland-Altman plot for the upper extremity version between raters.
Figure 2.
A Bland-Altman plot for the lower extremity version between raters.
The analysis for construct validity found a Spearman’s rank correlation coefficient of 0.80 (P < 0.01) and 0.83 (P < 0.01) for the upper and lower extremity versions, respectively, between the MSTS and the TESS.
Table 3 presents the floor and ceiling effects found in the MSTS questionnaire. A Spearman’s rank correlation coefficient of - 0.26 (P < 0.01) was found between the TUG and the lower extremity version of the MSTS questionnaire. Figure 3 illustrates the correlation between the TUG and the MSTS. A Spearman’s rank correlation coefficient of - 0.38 (P < 0.01) was found between the TUG and the lower extremity version of the TESS questionnaire. Figure 4 illustrates the correlation between the TUG and the TESS.
Table 3.
Floor and ceiling effects of the musculoskeletal tumour society score questionnaire
| n | Percent floor | Percent ceiling | |
| All patients | |||
| Upper extremity version | 78 | 0% | 38.5% |
| Lower extremity version | 162 | 0% | 23.5% |
| Bone sarcoma patients | |||
| Upper extremity version | 18 | 0% | 27.8% |
| Lower extremity version | 45 | 0% | 8.9% |
| Soft tissue sarcomas patients | |||
| Upper extremity version | 50 | 0% | 44% |
| Lower extremity version | 99 | 0% | 32.3% |
| Aggressive benign tumor patients | |||
| Upper extremity version | 10 | 0% | 30% |
| Lower extremity version | 18 | 0% | 11.1% |
Figure 3.
Correlation between musculoskeletal tumour society score and Timed Up and Go. MSTS: Musculoskeletal tumour society score; TUG: Timed Up and Go.
Figure 4.
Correlation between Toronto Extremity Salvage Score and Timed Up and Go. TESS: Toronto Extremity Salvage Score; TUG: Timed Up and Go.
DISCUSSION
This Danish translation of the MSTS questionnaire was found to have good internal consistency, reliability and construct validity. However, the MSTS does have limitations as shown by the identification of a ceiling effect and possible measurement error between raters. In addition, poor correlations were found between the MSTS/TESS and the TUG. When using an existing measurement, it is important that it has undergone a proper cross-cultural translation in order to ensure that it measures the same concept as the original measurement[10,16]. We have used well-known standardized guidelines to translate and validate the MSTS questionnaire into Danish[10,16,18]. The lower extremity version of the MSTS questionnaire has also been translated and validated into Brazilian Portuguese, Chinese and Japanese according to these guidelines[7-9]. To our knowledge, it is the first time the upper extremity version of the MSTS questionnaire has been translated into a foreign language following a standardized guideline. In the Japanese upper extremity version of the MSTS questionnaire, Wada et al[20] tested the construct validity, but it was not mentioned whether that version had undergone systematic cross-cultural translation. Lee et al[21] also reported the validity and reliability of both versions of the Korean version of the MSTS questionnaire, but also without reporting if the translation into Korean had been done according to the standardized guidelines.
The original validation of the English version of the MSTS unfortunately did not report a Cronbach’s α[1]. The good internal consistency found in this study is however comparable to those found by Rebolledo et al[7], Xu et al[9] and Iwata et al[8]. The inter-rater reliability also showed excellent results for both versions, and is in accordance with those found by Rebolledo et al[7] and Xu et al[9]. The original validation of the MSTS questionnaire also reported good inter-observer reliability, although no correlation coefficient was reported[1]. Figures 1 and 2 show low mean bias on all plots, however the limits of agreement are wide, which indicates a possible high measurement error. No previous studies have tested the measurement error in the MSTS[1,7,8,20,21]. The test for measurement error is an important part of the validation process, since only a change in the MSTS score larger than the measurement error can be considered a possible ‘real’ change in the functional outcome[22].
The construct validity of the MSTS has been determined as good in this study by comparing the MSTS with the TESS. This can be compared with similar results found by Rebolledo et al[7], Xu et al[9] and Iwata et al[8]. Wada et al[20] found a good correlation between the upper extremity version of the MSTS and the disability of the arm, shoulder and hand questionnaire.
A general ceiling effect was found in both the upper and lower extremity versions of the MSTS. However, when stratified there was no ceiling effect in patients with lower extremity bone sarcoma (8.9%, n = 45) or aggressive benign tumors (11.1%, n = 18) (Table 3). These results are similar to those reported by Rebolledo et al[7] (7.4%, n = 67) in the lower extremity version of the MSTS, while the finding of a substantial ceiling effect in the pooled data is consistent with the results found by Iwata et al[8] (23%, n = 100) and Wada et al[20]. A study by Tanaka et al[15] with the aim of predicting the knee extension strength and post-operative function has also shown a noticeable ceiling effect in the MSTS questionnaire (22.2%, n = 18). These results question the role of the MSTS in evaluating function in all musculoskeletal tumor patients, as a ceiling effect results in difficulties distinguishing between patients with superior function. Against this backdrop, it is important to consider the future role of the MSTS. A possibility could be to further develop this questionnaire to make it more appropriate for measuring physical function, or perhaps abandon this instrument entirely and instead develop a new and more precise one.
The current mainstay treatment of musculoskeletal tumors in the extremities directly influences the musculoskeletal system which accentuates the importance of an instrument that measures functional outcome precisely. We found a poor correlation between the TUG and the lower extremity version of the MSTS and the TESS. Marchese et al[14,23,24] also found a generally poor correlation between the TUG and the MSTS/TESS in three studies, while Tanaka et al[15] found a moderate to good correlation between the MSTS/TESS and the extension strength of the knee. This highlights the importance of choosing the correct instrument for measuring the desired concept of function. The purpose of the TUG is to measure the balance and mobility skills needed for daily living[13], while the purpose of the TESS is to measure the patients’ perception of function[17]. In this way, two various subconstructs of the concept of function are measured. Although both can be of an importance, in exploring a hypothesis they may differ in significance.
A great strength of this study is the number of participating patients. This study included 78 patients with upper extremity tumors and 162 patients with lower extremity tumors. Previous guidelines concerning the validation of instruments have set a minimum of 100 patients as an excellent sample size, while 50 to 99 patients constitutes a good sample size[25].
This study also has a main limitation, i.e., the presence of the possibility of selection bias, as only the patients attending the outpatient clinic were asked to participate in the study. Patients with progressive disease and patients who were not satisfied with their treatment were less likely to attend the outpatient clinic.
In conclusion, the Danish versions of the upper and lower extremity MSTS questionnaires were found to have good reliability and validity. The Danish versions are comparable to the other translated MSTS questionnaires. It is however of concern that a ceiling effect was found in both versions. When using the MSTS questionnaire, it is important to take into account which concept of function is intended to be measured.
ARTICLE HIGHLIGHTS
Research background
The musculoskeletal tumour society score (MSTS) questionnaire is a physician/patient-completed questionnaire designed to assess functional outcome for patients with sarcomas in the extremities. The MSTS questionnaire was originally developed in English. Over the past decades there has been increased focus on the aptness of questionnaires to measure correctly. This also includes the aptness of questionnaires after being translated from one language to another.
Research motivation
To ensure that the Danish version of the MSTS questionnaire measures the same aspects of functional outcome in sarcoma patients as the English version, it is important to validate the measurement properties of the Danish version of the MSTS questionnaire and compare it to other language versions of the questionnaire. Furthermore, cultural differences need to be considered during the translation process, as this is a part of ensuring the original measurement properties. This rigorous process provides the possibility to compare results from national studies with other international studies.
Research objectives
The objectives of this study were: (1) to validate the Danish version of the MSTS questionnaire; and (2) to investigate the correlation between functional outcomes as measured by questionnaires, such as the MSTS, and the objective measurement, Timed Up and Go (TUG).
Research methods
The translation of the MSTS was conducted in accordance with international guidelines. Patients, age 18 or above, operated for sarcomas and aggressive benign tumors were consecutively invited to participate in the study. The psychometric properties of the Danish version of the MSTS were tested in terms of validity and reliability and for the risk of floor or ceiling effects. Spearman’s rank coefficient was used to compare the MSTS lower extremity version with the objective test, TUG.
Research results
The upper extremity version of the MSTS questionnaire demonstrated an excellent intra- and inter-rater reliability. The lower extremity version of the MSTS questionnaire showed an excellent intra- and inter-rater reliability. A ceiling effect, however, was found in both versions. Both versions of MSTS questionnaire were shown to have good validity. The MSTS questionnaire showed a possible presence of a measurement error. A poor correlation was found between the objective measurement, TUG, and the functional outcome measured by questionnaires.
Research conclusions
The Danish version of the MSTS questionnaire was found to have good reliability and validity, however a substantial ceiling effect as well as the possibility of measurement error were identified. The Danish version of the MSTS questionnaire can be used to measure functional outcome in sarcoma patients and to compare these results with other international studies.
Research perspectives
The measurement errors and ceiling effects are concerns which are not to be overlooked. It is highly recommendable to further investigate these issues and the measurement properties of the MSTS questionnaires, such as its aptness in detecting significant clinical changes in the functional outcome.
Footnotes
Institutional review board statement: The study was preapproved in accordance with the national ethical guidelines, since this type of study does not require approval in Denmark, furthermore the study is in accordance with the Helsinki Declaration.
Informed consent statement: All patients gave their verbally informed consent for participating in the study, however signed consent was not required according to Danish guidelines, since the study was based on questionnaires.
Conflict-of-interest statement: All authors declare: no support from any organization for the submitted work; no financial relationships with any organizations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.
STROBE statement: The authors have read the STROBE Statement-checklist of items, and the manuscript was prepared and revised according to the STROBE Statement-checklist of items.
Manuscript source: Unsolicited manuscript
Peer-review started: August 24, 2018
First decision: October 4, 2018
Article in press: December 13, 2018
Specialty type: Orthopedics
Country of origin: Denmark
Peer-review report classification
Grade A (Excellent): A
Grade B (Very good): B, B
Grade C (Good): 0
Grade D (Fair): 0
Grade E (Poor): 0
P- Reviewer: Elgafy H, Farouk O, Pavone V S- Editor: Ji FF L- Editor: A E- Editor: Tan WW
Contributor Information
Casper Kloster Pingel Saebye, Sarcoma Centre of Aarhus University Hospital, Department of Orthopedic Surgery, Aarhus University Hospital, Aarhus N 8200, Denmark. caspersaebye@clin.au.dk.
Johnny Keller, Sarcoma Centre of Aarhus University Hospital, Department of Orthopedic Surgery, Aarhus University Hospital, Aarhus N 8200, Denmark.
Thomas Baad-Hansen, Sarcoma Centre of Aarhus University Hospital, Department of Orthopedic Surgery, Aarhus University Hospital, Aarhus N 8200, Denmark.
References
- 1.Enneking WF, Dunham W, Gebhardt MC, Malawar M, Pritchard DJ. A system for the functional evaluation of reconstructive procedures after surgical treatment of tumors of the musculoskeletal system. Clin Orthop Relat Res. 1993:241–246. [PubMed] [Google Scholar]
- 2.Ginsberg JP, Rai SN, Carlson CA, Meadows AT, Hinds PS, Spearing EM, Zhang L, Callaway L, Neel MD, Rao BN, Marchese VG. A comparative analysis of functional outcomes in adolescents and young adults with lower-extremity bone sarcoma. Pediatr Blood Cancer. 2007;49:964–969. doi: 10.1002/pbc.21018. [DOI] [PubMed] [Google Scholar]
- 3.Jones KB, Ferguson PC, Deheshi B, Riad S, Griffin A, Bell RS, Wunder JS. Complete femoral nerve resection with soft tissue sarcoma: functional outcomes. Ann Surg Oncol. 2010;17:401–406. doi: 10.1245/s10434-009-0745-5. [DOI] [PubMed] [Google Scholar]
- 4.Kumar D, Grimer RJ, Abudu A, Carter SR, Tillman RM. Endoprosthetic replacement of the proximal humerus. Long-term results. J Bone Joint Surg Br. 2003;85:717–722. [PubMed] [Google Scholar]
- 5.Schreiber D, Bell RS, Wunder JS, O’Sullivan B, Turcotte R, Masri BA, Davis AM. Evaluating function and health related quality of life in patients treated for extremity soft tissue sarcoma. Qual Life Res. 2006;15:1439–1446. doi: 10.1007/s11136-006-0001-4. [DOI] [PubMed] [Google Scholar]
- 6.Aksnes LH, Bauer HC, Jebsen NL, Follerås G, Allert C, Haugen GS, Hall KS. Limb-sparing surgery preserves more function than amputation: A Scandinavian sarcoma group study of 118 patients. J Bone Joint Surg Br. 2008;90:786–794. doi: 10.1302/0301-620X.90B6.19805. [DOI] [PubMed] [Google Scholar]
- 7.Rebolledo DC, Vissoci JR, Pietrobon R, de Camargo OP, Baptista AM. Validation of the Brazilian version of the musculoskeletal tumor society rating scale for lower extremity bone sarcoma. Clin Orthop Relat Res. 2013;471:4020–4026. doi: 10.1007/s11999-013-3211-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Iwata S, Uehara K, Ogura K, Akiyama T, Shinoda Y, Yonemoto T, Kawai A. Reliability and Validity of a Japanese-language and Culturally Adapted Version of the Musculoskeletal Tumor Society Scoring System for the Lower Extremity. Clin Orthop Relat Res. 2016;474:2044–2052. doi: 10.1007/s11999-016-4880-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Xu L, Li X, Wang Z, Xiong J, Wang S. Functional evaluation for patients with lower extremity sarcoma: application of the Chinese version of Musculoskeletal Tumor Society scoring system. Health Qual Life Outcomes. 2017;15:107. doi: 10.1186/s12955-017-0685-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46:1417–1432. doi: 10.1016/0895-4356(93)90142-n. [DOI] [PubMed] [Google Scholar]
- 11.Andresen EM. Criteria for assessing the tools of disability outcomes research. Arch Phys Med Rehabil. 2000;81:S15–S20. doi: 10.1053/apmr.2000.20619. [DOI] [PubMed] [Google Scholar]
- 12.Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63:737–745. doi: 10.1016/j.jclinepi.2010.02.006. [DOI] [PubMed] [Google Scholar]
- 13.Schoppen T, Boonstra A, Groothoff JW, de Vries J, Göeken LN, Eisma WH. The Timed ”up and go” test: Reliability and validity in persons with unilateral lower limb amputation. Arch Phys Med Rehabil. 1999;80:825–828. doi: 10.1016/s0003-9993(99)90234-4. [DOI] [PubMed] [Google Scholar]
- 14.Marchese VG, Rai SN, Carlson CA, Hinds PS, Spearing EM, Zhang L, Callaway L, Neel MD, Rao BN, Ginsberg JP. Assessing functional mobility in survivors of lower-extremity sarcoma: reliability and validity of a new assessment tool. Pediatr Blood Cancer. 2007;49:183–189. doi: 10.1002/pbc.20932. [DOI] [PubMed] [Google Scholar]
- 15.Tanaka A, Yoshimura Y, Aoki K, Kito M, Okamoto M, Suzuki S, Momose T, Kato H. Knee extension strength and post-operative functional prediction in quadriceps resection for soft-tissue sarcoma of the thigh. Bone Joint Res. 2016;5:232–238. doi: 10.1302/2046-3758.56.2000631. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976) 2000;25:3186–3191. doi: 10.1097/00007632-200012150-00014. [DOI] [PubMed] [Google Scholar]
- 17.Davis AM, Wright JG, Williams JI, Bombardier C, Griffin A, Bell RS. Development of a measure of physical function for patients with bone and soft tissue sarcoma. Qual Life Res. 1996;5:508–516. doi: 10.1007/BF00540024. [DOI] [PubMed] [Google Scholar]
- 18.Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42. doi: 10.1016/j.jclinepi.2006.03.012. [DOI] [PubMed] [Google Scholar]
- 19.Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–310. [PubMed] [Google Scholar]
- 20.Wada T, Kawai A, Ihara K, Sasaki M, Sonoda T, Imaeda T, Yamashita T. Construct validity of the Enneking score for measuring function in patients with malignant or aggressive benign tumours of the upper limb. J Bone Joint Surg Br. 2007;89:659–663. doi: 10.1302/0301-620X.89B5.18498. [DOI] [PubMed] [Google Scholar]
- 21.Lee SH, Kim DJ, Oh JH, Han HS, Yoo KH, Kim HS. Validation of a functional evaluation system in patients with musculoskeletal tumors. Clin Orthop Relat Res. 2003;411:217–226. doi: 10.1097/01.blo.0000069896.31220.33. [DOI] [PubMed] [Google Scholar]
- 22.Terwee CB, Roorda LD, Knol DL, De Boer MR, De Vet HC. Linking measurement error to minimal important change of patient-reported outcomes. J Clin Epidemiol. 2009;62:1062–1067. doi: 10.1016/j.jclinepi.2008.10.011. [DOI] [PubMed] [Google Scholar]
- 23.Marchese VG, Ogle S, Womer RB, Dormans J, Ginsberg JP. An examination of outcome measures to assess functional mobility in childhood survivors of osteosarcoma. Pediatr Blood Cancer. 2004;42:41–45. doi: 10.1002/pbc.10462. [DOI] [PubMed] [Google Scholar]
- 24.Marchese VG, Spearing E, Callaway L, Rai SN, Zhang L, Hinds PS, Carlson CA, Neel MD, Rao BN, Ginsberg J. Relationships among range of motion, functional mobility, and quality of life in children and adolescents after limb-sparing surgery for lower-extremity sarcoma. Pediatr Phys Ther. 2006;18:238–244. doi: 10.1097/01.pep.0000232620.42407.9f. [DOI] [PubMed] [Google Scholar]
- 25.Terwee CB, Mokkink LB, Knol DL, Ostelo RW, Bouter LM, de Vet HC. Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2012;21:651–657. doi: 10.1007/s11136-011-9960-1. [DOI] [PMC free article] [PubMed] [Google Scholar]