Abstract
Background
The Forgotten Joint Score (FJS) is a 12-question patient-reported outcomes measure created to measure a patient’s awareness of their artificial joint. The FJS has attained wide usage, though it is not without weaknesses. Our patients report that the semantics of the English translation are flawed and that the 5 answer options for each question are poorly differentiated. Additionally, the FJS will result in no score if 3 or more questions are unanswered. This prompted the development of an alternative patient-reported outcomes measure, the Joint Awareness Score (JAS), that builds upon the core concept of joint awareness underlying the FJS, but that is easier to understand and shorter to complete. We completed an exploratory, pilot study to evaluate this outcomes instrument. Our hypothesis is that the JAS will correlate strongly with the FJS and could be used as a substitute.
Methods
Knee arthroplasty patients in a prospective registry were administered the FJS and the JAS. Internal consistency and correlation were calculated with Cronbach’s alpha and Pearson’s correlation coefficient, respectively.
Results
This study included 174 patients. Cronbach’s alpha for FJS was 0.97 for 6 months and 0.97 for 12 months, whereas JAS was 0.89 at 6 months and 0.85 at 12 months. Pearson correlation comparing FJS and JAS at 6 months was 0.88 (95% confidence interval: 0.83, 0.92) and 0.86 (95% confidence interval: 0.78, 0.92) at 12 months.
Conclusions
The Joint Awareness Score is a new patient-reported outcomes measure that is a substitute for the FJS, with half the number of questions, improved semantics, and simplified answers.
Keywords: Forgotten joint score, Joint awareness score, Patient-reported outcome measure, Total knee arthroplasty
Introduction
The incidence of total knee arthroplasty (TKA) grew from 97 procedures per 100,000 to 213 procedures per 100,000 people in the United States from 2000 to 2014, providing relief for a growing population affected by osteoarthritis [1,2]. Current projections of TKA estimate 930,000 primary TKAs and approximately 202,966 knee revisions for a total of 1,132,966 surgeries by 2030 [3]. This projected increase in TKA volume necessitates ongoing evaluation of costs and benefits of this medical intervention. Benefits analysis remains challenging due to the qualitative and limited nature of available data. Patient-reported outcome measures (PROMs) evolved as a means of collecting longitudinal qualitative data for evaluation of the efficacy of surgical intervention [4,5]. Effective PROM data collection requires question specificity and categorical answer choices ensuring dispersion of scores, to determine central tendency in relation to maximum and minimum responses [6,7]. Maximum and minimum responses greater than 15% of the total response indicate potential ceiling and floor effects, respectively, interfering with accuracy of population data [8]. Improvements in arthroplasty implants and surgical technique results in a higher proportion of maximum scores, generating a ceiling effect that degrades outcome measure validity.
Behrend et al [9] developed the Forgotten Joint Score (FJS), a 12-question survey, as an answer for the ceiling effect of other PROMs, proposing that the degree to which a patient “forgets” their joint replacement will correlate with patient satisfaction and outcomes after arthroplasty. Following their initial 2012 report, further studies comparing the FJS with PROMs including the Oxford Knee Score [7], Knee Injury and Osteoarthritis Outcomes Score [10], Knee Society Score [11], and Western Ontario and McMaster Universities Osteoarthritis Index [12] demonstrated a low ceiling effect for the FJS. However, other studies have shown the FJS to have a ceiling effect up to 30% [13,14] along with issues present in the language [[15], [16], [17]].
Over years of administering thousands of FJS instruments to our arthroplasty patients, our clinical research site has identified several challenges with the FJS:
-
1)
We have had many complaints from our patients that the translation of the FJS’ native Norwegian into English is confusing due to the vagueness separating different responses that range from “never,” “almost never,” “seldom,” “sometimes,” “mostly,” and “N/A.”
-
2)
The FJS commonly delivers a “no score” at the preoperative or early postoperative visits, due to the limited function of the patient, when 3 or more answers are “N/A”.
-
3)
The FJS instructions and answer wording does not easily lend itself to use at the preoperative baseline visit.
Material and methods
Background creation of 6-question Joint Awareness Score PROM
Recognizing this confusion regarding interpretation of the FJS within our patient population, we developed our own questionnaire, reviewing the individual questions, and attempting to improve the English semantics (Table 1). We also added additional questions to our survey to address common issues reported by our patient population, missing from the FJS. Additionally, we revised the number of answer choices from 5 to 3 to improve the interpretation of each possible answer option as discrete from the others, and also improving the English semantics. The FJS responses “never,” “almost never,” “seldom,” “sometimes,” and “mostly” translate into a 5-point Likert-response format translated linearly into a summative range from 0 to 100 scale with high values translating to the patient successfully “forgetting” about their joint during activities of daily living [9,18]. While “never” and “almost never” may be distinguished, “almost never,” “seldom,” and “sometimes” are all potentially indistinguishable from each other, and “mostly” is a poor synonym for “frequently,” which would have been a better choice. The Joint Awareness Score (JAS) scaling simplifies responses and improves the ability to distinguish between response options, with the choices limited to “never/rarely,” “sometimes,” and “always/frequently” translating into values of 100, 50, and 0, respectively.
Table 1.
Joint Awareness Score (JAS)/Forgotten Joint Score (FJS) questionnaires.
| Forgotten Joint Score Are you aware of your joint… |
Never | Almost never | Seldom | Sometimes | Mostly | N/A | |
|---|---|---|---|---|---|---|---|
| 1. | In bed at night? | ☐ | ☐ | ☐ | ☐ | ☐ | ☐ |
| 2. | When sitting on a chair for more than an hour? | ☐ | ☐ | ☐ | ☐ | ☐ | ☐ |
| 3. | When walking for more than 15 minutes? | ☐ | ☐ | ☐ | ☐ | ☐ | ☐ |
| 4. | When taking a bath or shower? | ☐ | ☐ | ☐ | ☐ | ☐ | ☐ |
| 5. | When traveling in a car? | ☐ | ☐ | ☐ | ☐ | ☐ | ☐ |
| 6. | When climbing stairs? | ☐ | ☐ | ☐ | ☐ | ☐ | ☐ |
| 7. | When walking on uneven ground? | ☐ | ☐ | ☐ | ☐ | ☐ | ☐ |
| 8. | When standing up from a low-sitting position? | ☐ | ☐ | ☐ | ☐ | ☐ | ☐ |
| 9. | When standing for long periods of time? | ☐ | ☐ | ☐ | ☐ | ☐ | ☐ |
| 10. | When doing housework or gardening? | ☐ | ☐ | ☐ | ☐ | ☐ | ☐ |
| 11. | When taking a walk or hike? | ☐ | ☐ | ☐ | ☐ | ☐ | ☐ |
| 12. | When doing your favorite sport? | ☐ | ☐ | ☐ | ☐ | ☐ | ☐ |
| Joint Awareness Score Do you notice or think about your joint … |
Never/rarely | Occasionally/infrequently | Frequently | N/A. I don’t do this | |
|---|---|---|---|---|---|
| 1. | When taking a bath or shower? | ☐ | ☐ | ☐ | ☐ |
| 2. | When getting in and out of a car? | ☐ | ☐ | ☐ | ☐ |
| 3. | When standing up from a low-sitting position? | ☐ | ☐ | ☐ | ☐ |
| 4. | When walking on uneven ground for more than 15 minutes? | ☐ | ☐ | ☐ | ☐ |
| 5. | When doing gardening, yard work, or snow removal? | ☐ | ☐ | ☐ | ☐ |
| 6. | When taking a longer walk or hike (more than half an hour)? | ☐ | ☐ | ☐ | ☐ |
Additionally, we designed a scoring algorithm producing a score under all circumstances. Any unanswered (“N/A”) responses to individual questions on the survey were counted as the “frequently” response choice for the JAS. As with the FJS, high JAS scores signify the desired goal of patients not thinking about their joint.
We also modified the wording of the answers so that it referred to the joint in general as opposed to referring specifically to the prosthetic joint. This allows use at the preoperative baseline visit. We added instructions that reinforced the ability to use the PROM preoperatively (Appendix A).
This process resulted in a new questionnaire totaling 16 questions, which we administered to a test group of subjects previously enrolled in an ongoing randomized trial [19], for the purposes of question validation and reduction to a smaller number of questions. After analysis of the responses to the 16 questions, we reduced the number of questions to the 6 which provided the best distinction between the 2 randomized groups. Recognizing the FJS and its core concept of joint awareness, we named the new PROM the JAS.
Study design
All patients in our prospective surgical outcomes registry database who underwent primary TKA from April 2020 through April 2022 were included. Patient demographic data including sex, age, body mass index, and TKA side were collected in Table 2. The FJS and the JAS were administered simultaneously at visits scheduled at 6 weeks, 6 months, and 1 year. An orthopaedic surgeon with over 25 years of experience in joint arthroplasty performed the surgical procedure and follow-up appointments. All patients underwent an unrestricted kinematic alignment procedure with a medial-stabilized device.
Table 2.
Validation sample characteristics (N = 174).
| Variables | N% or mean (range) |
|---|---|
| Sex | |
| Male | 81/174 (46.55) |
| Female | 93/174 (53.45) |
| Age at surgery | |
| Mean ± (SD) | 64.9 (10.91) |
| Range | 41-89 |
| Body mass index | |
| Mean ± (SD) | 32.52 (5.81) |
| Range | 17.65-48.4 |
| TKA side | |
| Left | 87/174 (50%) |
| Right | 87/174 (50%) |
SD, standard deviation; TKA, total knee arthroplasty.
Statistical analysis
The statistical analysis was performed in R (R Foundation for Statistical Computing, Vienna, Austria; http://www.R-project.org/). Internal consistency reliability for the FJS and JAS was calculated from Cronbach’s alpha, with literature establishing that an alpha value of 0.70 operates as the acceptable threshold for group comparison, with internal consistency measurement increasing with values closer to 1 [20]. Construct validity was tested with the Pearson correlation coefficient measuring the linear association between FJS-12 and JAS scores [12]. Content validity is assumed as we are basing our analysis on the FJS as the referent, which has been previously validated and widely adopted.
Results
This study included 174 primary TKA patients. The registry sample was 53% (93/174) male and 47% (81/174) females, with 50% (87/174) of the sample undergoing left TKA and 50% (87/174) undergoing right TKA. The average patient age was 64.9 years with standard deviation ±10.9 years, ranging from 41 years at the youngest to 89 years at the oldest. There was no clear trend, or difference from the FJS, when stratifying by age. Average patient body mass index measured 32.5 (± standard deviation 5.81), ranging from 17.65 to 48.4. Cronbach’s alpha for FJS was 0.97 for 6 months and 0.97 for 12 months, while JAS was 0.89 at 6 months and 0.85 at 12 months. Pearson correlation comparing FJS and JAS at 6 months was 0.88 (95% confidence interval: 0.83,0.92) and 0.86 (95% confidence interval: 0.78, 0.92) at 12 months. JAS ceiling effect was at 7% for 6 months and 16.9% at 12 months, floor effect was 14% at 6 months and 3.4% at 12 months. FJS ceiling effect was at 3% for 6 months and 11.7% at 12 months, FJS floor effect was 2% at 6 months and 1.7% at 12 months. All comparative values are summarized in Tables 3 and 4 with a direct comparison of scores plotted in Figure 1a and b. A comparison of the 2 scores stratified by age is plotted in Figure 2.
Table 3.
FJS and JAS ceiling and floor effect comparison.
| Time frame | JAS ceiling | FJS ceiling | JAS floor | FJS floor |
|---|---|---|---|---|
| 6 mo | 7% | 3% | 14% | 2% |
| 12 mo | 16.9% | 11.7% | 3.4% | 1.7% |
JAS, Joint Awareness Score; FJS, Forgotten Joint Score.
Table 4.
FJS-JAS Comparative results at 6 and 12 months.
| Metric | 6 mo | 12 mo |
|---|---|---|
| FJS Cronbach's Alpha | 0.97 | 0.97 |
| JAS Cronbach's Alpha | 0.89 | 0.85 |
| FJS-JAS Pearson Correlation | 0.88 | 0.86 |
JAS, Joint Awareness Score; FJS, Forgotten Joint Score.
Figure 1.
(a) Joint Awareness Score comparison with Forgotten Joint Score at 6 months. (b) Joint Awareness Score comparison with Forgotten Joint Score at 12 months.
Figure 2.
Comparison of the 2 scores stratified by age.
Discussion
Joint replacement of the knee is successful in allowing patients to resume a high level of activity, though limitations persist, such that the patient's perceived performance of the prosthetic joint may not equal that of the original. A review of the literature indicates a rising incidence of TKAs due to increased demand on joints associated with older patients, increased osteoarthritis incidence, obesity, and at times increased physical activity [21]. Traditionally, TKA assessments relied on radiographic comparison, implant survivorship, and clinical assessment through the physical examination [22]. PROMs were implemented to assess the patient's perspective of the performance of their implant. The FJS introduced the concept that the degree to which a patient “forgets” their joint replacement will correlate with patient satisfaction and outcomes after arthroplasty [9,16,23,24].
The high ceiling effect [7,9,11,16,24] seen in the Knee Society Score and other early PROMs can be partially explained by the fact that these measures were designed to evaluate a patient population consisting of elderly, sedentary patients with limited functional demands, yet TKA has subsequently expanded to a younger, more active patient group with higher functional requirements [25]. As TKA indications expanded to younger and more active patients [26,27] with greater physical demands, the measurement scale of these PROMs led to a high ceiling effect. Researchers attempted to find a new PROM standard for TKA evaluation, such as the High Flexion Knee Score developed by Na et al [28]. Noble et al [25] opted for revamping the familiar Knee Society Score, proposing the New Knee Society Score. The adoption of these new PROMs has lagged behind that of the FJS.
While Behrend’s measure of joint awareness represents an improvement over pre-existing PROM outcome measures, it is not without weaknesses. The FJS has been translated into multiple languages, but cultural differences [29] must be considered in addition to linguistic differences with each patient population. Franklin et al [20] found when comparing Swiss and American arthroplasty patients that while Americans were younger with higher BMI and more likely to place greater demand on artificial joints, they reported lower pain than their Swiss counterparts. Hamilton et al [17] proposed validation of the FJS in British English, but there has yet to be the same validation for American English, with our English-speaking patient population regularly reporting confusion about the different questions and answer options of the FJS. Additionally, the FJS results in no score if 3 or more of the 12 questions are left unanswered, which is a distinct possibility in the early postoperative period.
This demonstrates a lack of precision in the pivotal question surrounding any arthroplasty: Is the joint replacement functioning at a level that is satisfactory to the patient? We propose that answering that question relies on careful selection of the specific activities most likely to distinguish between satisfactory performance and perceived limitations in performance. For example, the JAS asks the patient about their awareness of the joint during such pivotal actions as getting in and out of a vehicle, rather than asking about joint awareness while traveling in a vehicle as in the FJS. The JAS question evaluates more specifically a discrete functional activity, while the FJS question is rather vague, in that it could include the higher demand activity involved in getting in and out of the vehicle, though it could also be limited to the relatively lower demand activity of sitting. Additionally, we desire a PROM that will distinguish between a “good” and a “great” result, and so the JAS questions focus on activities of higher functional requirements. This creates an assessment tool that is better suited for the increasingly younger and more physically active total knee patient.
This pilot study revealed a high correlation between the JAS and the FJS, suggesting the possibility that one could substitute for the other. The ceiling effect was higher for the JAS, possibly due to the greater distinction between, and the lower number of, the answer options, primarily the difference between “sometimes” and “always/frequently,” and 3 vs 5 answer options.
This study has limitations. PROM validation relies on sufficient data and accounting for missing values is an area of contention [30]. Chithartha et al [31] and Robinson et al [32] addressed the missing data in their studies by changing the FJS to the Modified FJS, while others like Rombach et al [33] choose reasonable estimated data input to correct the information gaps. At 6 months, 10% of patients presenting for follow up did not meet valid JAS score threshold based on survey response input, and at 12 months, 5% of patient inputs did not meet valid JAS threshold. Missing data are typically classified as missing completely at random, missing at random, or missing not at random, respectively [34]. We attributed our missing data to the missing not at random category, as we assess the missingness of data being related to patient response [35,36]. Our changing of the N/A selection to “frequently” selection for the JAS reflects an missing not at random assumption from observations that incomplete responses came from patients with diminished functional capabilities such that they were not capable of the performing the activity in the unanswered question(s). The validity of Cronbach's alpha for measuring internal consistency relies on our treatment of the joint replacement awareness as a unidimensional scale that the FJS and JAS scoring systems share with t-equivalence.
Another possible limitation is that, in removing 6 of the 12 questions from the FJS, potentially valuable information may be lost, and the JAS may be less comprehensive than the FJS. Additionally, it is possible that our choice of the remaining 6 questions may discriminate against patients who could be more active but are not due to their social and living circumstances.
Additionally, the data come from a single institution with 1 surgeon and a registry patient population with the potential for environmental bias. Additionally, our surgical volume was greatly reduced during the time of this data collection (April 2020-April 2022) due to hospital lockdowns and then reduced staffing and biased toward surgeries performed in our ambulatory surgery center. The potential for survey fatigue exists resulting from patients having to fill out both the FJS and the JAS scores at each visit. As our center first began collecting the FJS and JAS concurrently in 2020, we do not yet have a sufficient sample with follow-up beyond 1 year, though there is precedent in the current literature of validity in 1-year TKA PROM evaluation [37,38]. Additionally, it is possible that the surgical technique (kinematic alignment) and the TKA device utilized (medial-stabilized) may produce scores that are not directly comparable to other alignment techniques and implant designs. However, improved outcomes have been reported for this device [19,[39], [40], [41], [42], [43], [44], [45]] and procedure [[46], [47], [48], [49], [50], [51]], therefore this could prove to be a worst-case scenario, likely to produce a substantial percentage of scores at the ceiling, yet this problem was not encountered.
To address these, and other, potential limitations, we hope to follow-up on this limited pilot study with a large multi-center trial to evaluate further the validity and reproducibility of the JAS, before we would encourage or expect wider adoption.
Conclusions
The JAS is a new PROM that may be a substitute for the JFS, with half the number of questions, improved semantics, simplified answers, and a score for every questionnaire. As total knee arthroplasty volume continues to grow, patients become younger, and functional expectations higher, there is an increasing need for a simple and reliable outcome measure to monitor the effectiveness of surgical intervention.
Conflicts of interest
David F. Scott received royalties from Innomed; is a paid consultant for Medacta USA, Microport Orthopedics, and NextStep; received research support from Medacta USA; is a reviewer and a part of the editorial Board for Journal of Arthroplasty and Journal of Knee Surgery. All other authors declare no potential conflicts of interest.
For full disclosure statements refer to https://doi.org/10.1016/j.artd.2023.101239.
Acknowledgments
The only funding or acknowledgment by the authors of this study is the $2000 awarded from the Washington State University Elson S. Floyd College of Medicine Founding Dean Fund.
Appendix A
The following questions refer to how much you notice or think about your joint during everyday life, while you are performing common activities.
These questions refer to either your arthritic joint before joint replacement surgery, or to your new joint after surgery, depending upon whether you have already had surgery.
The following are some things that can make you aware of your joint:
Pain, stiffness, instability, a mechanical sensation like popping or clicking, hearing any sounds from your joint, any other sensation that makes you aware of your joint.
Please note that if you are “aware” of your joint with any of the activities listed below, that this does not necessarily mean that you are dissatisfied, but simply that your joint may not feel totally normal under all circumstances.
Please be as forthcoming as possible with your observations.
Appendix A. Supplementary data
References
- 1.Lan R.H., Bell J.W., Samuel L.T., Kamath A.F. Evolving outcome measures in total knee arthroplasty: trends and utilization rates over the past 15 years. J Arthroplasty. 2020;35:3375–3382. doi: 10.1016/j.arth.2020.06.036. [DOI] [PubMed] [Google Scholar]
- 2.Hamood R., Tirosh M., Fallach N., Chodick G., Eisenberg E., Lubovsky O. Prevalence and incidence of osteoarthritis: a population-based retrospective cohort study. J Clin Med. 2021;10:4282. doi: 10.3390/jcm10184282. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Inacio M.C.S., Paxton E.W., Graves S.E., Namba R.S., Nemes S. Projected increase in total knee arthroplasty in the United States - an alternative projection model. Osteoarthritis Cartilage. 2017;25:1797–1803. doi: 10.1016/j.joca.2017.07.022. [DOI] [PubMed] [Google Scholar]
- 4.Baker P.N., van der Meulen J.H., Lewsey J., Gregg P.J., National Joint Registry for England and Wales The role of pain and function in determining patient satisfaction after total knee replacement. Data from the National Joint Registry for England and Wales. J Bone Joint Surg Br. 2007;89:893–900. doi: 10.1302/0301-620X.89B7.19091. [DOI] [PubMed] [Google Scholar]
- 5.Wang Y., Yin M., Zhu S., Chen X., Zhou H., Qian W. Patient-reported outcome measures used in patients undergoing total knee arthroplasty. Bone Joint Res. 2021;10:203–217. doi: 10.1302/2046-3758.103.BJR-2020-0268.R1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Browning R.B., Alter T.D., Clapp I.M., Mehta N., Nho S.J. Patients require less time to complete preoperative patient-reported outcomes measurement information system (PROMIS) than legacy patient-reported outcome measures. Arthrosc Sports Med Rehabil. 2021;3:e1413–e1419. doi: 10.1016/j.asmr.2021.06.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Eckhard L., Munir S., Wood D., Talbot S., Brighton R., Walter B., et al. The ceiling effects of patient reported outcome measures for total knee arthroplasty. Orthop Traumatol Surg Res. 2021;107 doi: 10.1016/j.otsr.2020.102758. [DOI] [PubMed] [Google Scholar]
- 8.Clement N.D., Weir D., Holland J.P., Gerrand C.H., Deehan D.J. An overview and predictors of achieving the postoperative ceiling effect of the WOMAC score following total knee arthroplasty. J Arthroplasty. 2019;34:273–280. doi: 10.1016/j.arth.2018.10.004. [DOI] [PubMed] [Google Scholar]
- 9.Behrend H., Giesinger K., Giesinger J.M., Kuster M.S. The “forgotten joint” as the ultimate goal in joint arthroplasty: validation of a new patient-reported outcome measure. J Arthroplasty. 2012;27:430–436.e1. doi: 10.1016/j.arth.2011.06.035. [DOI] [PubMed] [Google Scholar]
- 10.Itoh M., Itou J., Kuwashima U., Okazaki K. Good validity and high internal consistency of the Forgotten Joint Score-12 in patients after medial opening wedge high tibial osteotomy. J Arthroplasty. 2021;36:2691–2697. doi: 10.1016/j.arth.2021.03.028. [DOI] [PubMed] [Google Scholar]
- 11.Tachibana S., Muratsu H., Tsubosaka M., Maruo A., Miya H., Kuroda R., et al. Evaluation of consistency of patient-satisfaction score in the 2011 knee society score to other patient-reported outcome measures. J Orthop Sci. 2022;27:652–657. doi: 10.1016/j.jos.2021.02.007. [DOI] [PubMed] [Google Scholar]
- 12.Lee Q.J., Chang W.Y.E., Wong Y.C. Forgotten Joint Score for early outcome assessment after total knee arthroplasty: is it really useful? Knee Surg Relat Res. 2020;32:37. doi: 10.1186/s43019-020-00049-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Larsson A., Rolfson O., Karrholm J. Evaluation of Forgotten Joint Score in total hip arthroplasty with Oxford hip score as reference standard. Acta Orthop. 2019;90:253–257. doi: 10.1080/17453674.2019.1599252. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Puliero B., Blakeney W.G., Beaulieu Y., Vendittoli P.A. Joint perception after total hip arthroplasty and the forgotten joint. J Arthroplasty. 2019;34:65–70. doi: 10.1016/j.arth.2018.09.086. [DOI] [PubMed] [Google Scholar]
- 15.Giesinger J.M., Behrend H., Hamilton D.F., Kuster M.S., Giesinger K. Normative values for the Forgotten Joint Score-12 for the US general population. J Arthroplasty. 2019;34:650–655. doi: 10.1016/j.arth.2018.12.011. [DOI] [PubMed] [Google Scholar]
- 16.Behrend H., Zdravkovic V., Bosch M., Hochreiter B. No difference in joint awareness after TKA: a matched-pair analysis of a classic implant and its evolutional design. Knee Surg Sports Traumatol Arthrosc. 2019;27:2124–2129. doi: 10.1007/s00167-019-05407-4. [DOI] [PubMed] [Google Scholar]
- 17.Hamilton D.F., Loth F.L., Giesinger J.M., Giesinger K., MacDonald D.J., Patton J.T., et al. Validation of the English language Forgotten Joint Score-12 as an outcome measure for total hip and knee arthroplasty in a British population. Bone Joint J. 2017;99-B:218–224. doi: 10.1302/0301-620X.99B2.BJJ-2016-0606.R1. [DOI] [PubMed] [Google Scholar]
- 18.Clement N.D., Scott C.E.H., Hamilton D.F., MacDonald D., Howie C.R. Meaningful values in the Forgotten Joint Score after total knee arthroplasty. Bone Joint J. 2021;103-B:846–854. doi: 10.1302/0301-620X.103B5.BJJ-2020-0396.R1. [DOI] [PubMed] [Google Scholar]
- 19.Scott D.F., Gray C.G. Outcomes are better with a medial-stabilized vs a posterior-stablized total knee implanted with kinematic alignment. J Arthroplasty. 2022;37(8S):S852–S858. doi: 10.1016/j.arth.2022.02.059. [DOI] [PubMed] [Google Scholar]
- 20.Gandek B., Roos E.M., Franklin P.D., Ware J.E., Jr. A 12-item short form of the Knee injury and Osteoarthritis Outcome Score (KOOS-12): tests of reliability, validity and responsiveness. Osteoarthritis Cartilage. 2019;27:762–770. doi: 10.1016/j.joca.2019.01.011. [DOI] [PubMed] [Google Scholar]
- 21.Buttner M., Mayer A.M., Buchler B., Betz U., Drees P., Susanne S. Economic analyses of fast-track total hip and knee arthroplasty: a systematic review. Eur J Orthop Surg Traumatol. 2020;30:67–74. doi: 10.1007/s00590-019-02540-1. [DOI] [PubMed] [Google Scholar]
- 22.Adriani M., Malahias M.A., Gu A., Kahlenberg C.A., Ast M.P., Sculco P.K. Determining the validity, reliability, and utility of the Forgotten Joint Score: a systematic review. J Arthroplasty. 2020;35:1137–1144. doi: 10.1016/j.arth.2019.10.058. [DOI] [PubMed] [Google Scholar]
- 23.Matsumoto M., Baba T., Homma Y., Kobayashi H., Ochi H., Yuasa T., et al. Validation study of the Forgotten Joint Score-12 as a universal patient-reported outcome measure. Eur J Orthop Surg Traumatol. 2015;25:1141–1145. doi: 10.1007/s00590-015-1660-z. [DOI] [PubMed] [Google Scholar]
- 24.Behrend H., Zdravkovic V., Giesinger J., Giesinger K. Factors predicting the Forgotten Joint Score after total knee arthroplasty. J Arthroplasty. 2016;31:1927–1932. doi: 10.1016/j.arth.2016.02.035. [DOI] [PubMed] [Google Scholar]
- 25.Noble P.C., Scuderi G.R., Brekke A.C., Sikorskii A., Benjamin J.B., Lonner J.H., et al. Development of a new knee society scoring system. Clin Orthop Relat Res. 2012;470:20–32. doi: 10.1007/s11999-011-2152-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Karas V., Calkins T.E., Bryan A.J., Culvern C., Nam D., Berger R.A., et al. Total knee arthroplasty in patients less than 50 years of age: results at a mean of 13 years. J Arthroplasty. 2019;34:2392–2397. doi: 10.1016/j.arth.2019.05.018. [DOI] [PubMed] [Google Scholar]
- 27.Witjes S., van Geenen R.C., Koenraadt K.L., van der Hart C.P., Blankevoort L., Kerkhoffs G.M., et al. Expectations of younger patients concerning activities after knee arthroplasty: are we asking the right questions? Qual Life Res. 2017;26:403–417. doi: 10.1007/s11136-016-1380-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Na S.E., Ha C.W., Lee C.H. A new high-flexion knee scoring system to eliminate the ceiling effect. Clin Orthop Relat Res. 2012;470:584–593. doi: 10.1007/s11999-011-2203-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Goyal T., Sethy S.S., Paul S., Choudhury A.K., Das S.L. Good validity and reliability of Forgotten Joint Score-12 in total knee arthroplasty in Hindi language for Indian population. Knee Surg Sports Traumatol Arthrosc. 2021;29:1150–1156. doi: 10.1007/s00167-020-06124-z. [DOI] [PubMed] [Google Scholar]
- 30.Gomes M., Gutacker N., Bojke C., Street A. Addressing missing data in patient-reported outcome measures (PROMS): Implications for the use of PROMS for comparing provider performance. Health Econ. 2016;25:515–528. doi: 10.1002/hec.3173. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Chithartha K., Nair A.S., Thilak J. A long-term cross-sectional study with modified Forgotten Joint Score to assess the perception of artificial joint after total knee arthroplasty. SICOT J. 2021;7:14. doi: 10.1051/sicotj/2021013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Robinson P.G., Rankin C.S., Lavery J., Anthony I., Blyth M., Jones B. The validity and reliability of the modified Forgotten Joint Score. J Orthop. 2018;15:480–485. doi: 10.1016/j.jor.2018.03.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Rombach I., Gray A.M., Jenkinson C., Murray D.W., Rivero-Arias O. Multiple imputation for patient reported outcome measures in randomised controlled trials: advantages and disadvantages of imputing at the item, subscale or composite score level. BMC Med Res Methodol. 2018;18:87. doi: 10.1186/s12874-018-0542-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Carreras G., Miccinesi G., Wilcock A., Preston N., Nieboer D., Deliens L., et al. Missing not at random in end of life care studies: multiple imputation and sensitivity analysis on data from the ACTION study. BMC Med Res Methodol. 2021;21:13. doi: 10.1186/s12874-020-01180-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Heymans M.W., Twisk J.W.R. Handling missing data in clinical research. J Clin Epidemiol. 2022;151:185–188. doi: 10.1016/j.jclinepi.2022.08.016. [DOI] [PubMed] [Google Scholar]
- 36.Ayilara O.F., Zhang L., Sajobi T.T., Sawatzky R., Bohm E., Lix L.M. Impact of missing data on bias and precision when estimating change in patient-reported outcomes from a clinical registry. Health Qual Life Outcomes. 2019;17:106. doi: 10.1186/s12955-019-1181-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Heijbel S., W-Dahl A., Nilsson K.G., Hedstrom M. Substantial clinical benefit and patient acceptable symptom states of the Forgotten Joint Score 12 after primary knee arthroplasty. Acta Orthop. 2022;93:158–163. doi: 10.2340/17453674.2021.887. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Klemt C., Uzosike A.C., Esposito J.G., Harvey M.J., Yeo I., Subih M., et al. The utility of machine learning algorithms for the prediction of patient-reported outcome measures following primary hip and knee total joint arthroplasty. Arch Orthop Trauma Surg. 2023;143:2235–2245. doi: 10.1007/s00402-022-04526-x. [DOI] [PubMed] [Google Scholar]
- 39.Scott D.F., Hellie A.A. Mid-flexion, anteroposterior stability of total knee replacement implanted with kinematic alignment: a randomized, quantitative radiographic laxity study with posterior-stabilized and medial-stabilized implants. J Bone Joint Surg Am. 2022;105:9–19. doi: 10.2106/JBJS.22.00549. [DOI] [PubMed] [Google Scholar]
- 40.French S.R., Munir S., Brighton R. A single surgeon series comparing the outcomes of a cruciate retaining and medially stabilized total knee arthroplasty using kinematic alignment principles. J Arthroplasty. 2020;35:422–428. doi: 10.1016/j.arth.2019.09.021. [DOI] [PubMed] [Google Scholar]
- 41.Cassar-Gheiti A.J., Jamieson P.S., Radi M., Wolfstadt J.I., Backstein D.J. Evaluation of the medial stabilized knee design using data from national joint registries and current literature. J Arthroplasty. 2020;35:1950–1955. doi: 10.1016/j.arth.2020.02.026. [DOI] [PubMed] [Google Scholar]
- 42.Fitch D.A., Sedacki K., Yang Y. Mid- to long-term outcomes of a medial-pivot system for primary total knee replacement: a systematic review and meta-analysis. Bone Joint Res. 2014;3:297–304. doi: 10.1302/2046-3758.310.2000290. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Karachalios T., Varitimidis S., Bargiotas K., Hantes M., Roidis N., Malizos K.N. An 11- to 15-year clinical outcome study of the Advance Medial Pivot total knee arthroplasty: pivot knee arthroplasty. Bone Joint J. 2016;98-b:1050–1055. doi: 10.1302/0301-620X.98B8.36208. [DOI] [PubMed] [Google Scholar]
- 44.Macheras G.A., Galanakos S.P., Lepetsos P., Anastasopoulos P.P., Papadakis S.A. A long term clinical outcome of the medial pivot knee arthroplasty system. Knee. 2017;24:447–453. doi: 10.1016/j.knee.2017.01.008. [DOI] [PubMed] [Google Scholar]
- 45.Tso R., Smith J., Doma K., Grant A., McEwen P. Clinical and patient-reported outcomes of medial stabilized versus non-medial stabilized prostheses in total knee arthroplasty: a systematic review and meta-analysis. J Arthroplasty. 2021;36:767–776.e2. doi: 10.1016/j.arth.2020.07.086. [DOI] [PubMed] [Google Scholar]
- 46.Elbuluk A.M., Jerabek S.A., Suhardi V.J., Sculco P.K., Ast M.P., Vigdorchik J.M. Head-to-head comparison of kinematic alignment versus mechanical alignment for total knee arthroplasty. J Arthroplasty. 2022;37:S849–S851. doi: 10.1016/j.arth.2022.01.052. [DOI] [PubMed] [Google Scholar]
- 47.Risitano S., Sabatini L., Barberis L., Fusini F., Malavolta M., Indelli P.F. Combining kinematic alignment and medial stabilized design in total knee arthroplasty: basic rationale and preliminary clinical evidences. J Orthop. 2020;21:427–431. doi: 10.1016/j.jor.2020.08.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.McEwen P.J., Dlaska C.E., Jovanovic I.A., Doma K., Brandon B.J. Computer-assisted kinematic and mechanical axis total knee arthroplasty: a prospective randomized controlled trial of bilateral simultaneous surgery. J Arthroplasty. 2020;35:443–450. doi: 10.1016/j.arth.2019.08.064. [DOI] [PubMed] [Google Scholar]
- 49.Gao Z.X., Long N.J., Zhang S.Y., Yu W., Dai Y.X., Xiao C. Comparison of kinematic alignment and mechanical alignment in total knee arthroplasty: a meta-analysis of randomized controlled clinical trials. Orthop Surg. 2020;12:1567–1578. doi: 10.1111/os.12826. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Howell S.M., Papadopoulos S., Kuznik K., Ghaly L.R., Hull M.L. Does varus alignment adversely affect implant survival and function six years after kinematically aligned total knee arthroplasty? Int Orthop. 2015;39:2117–2124. doi: 10.1007/s00264-015-2743-5. [DOI] [PubMed] [Google Scholar]
- 51.Dossett H.G., Estrada N.A., Swartz G.J., LeFevre G.W., Kwasman B.G. A randomised controlled trial of kinematically and mechanically aligned total knee replacements: two-year clinical results. Bone Joint J. 2014;96-b:907–913. doi: 10.1302/0301-620X.96B7.32812. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.


