Skip to main content
UKPMC Funders Author Manuscripts logoLink to UKPMC Funders Author Manuscripts
. Author manuscript; available in PMC: 2020 Apr 1.
Published in final edited form as: Arthritis Care Res (Hoboken). 2019 May 25;72(1):88–97. doi: 10.1002/acr.23932

Predicting incident radiographic knee osteoarthritis in middle-aged women within 4 years: the importance of knee-level prognostic factors

Cesar Garriga 1,2, Maria T Sánchez-Santos 1,2,3, Andrew Judge 1,2,4,5, Deborah Hart 6, Tim Spector 6, Cyrus Cooper 1,4, Nigel K Arden 1,3
PMCID: PMC6935374  EMSID: EMS84849  PMID: 31127870

Abstract

Objective

Develop and internally validate risk models and a clinical risk score tool to predict incident radiographic knee osteoarthritis (RKOA) in middle-aged women.

Methods

We analysed 649 women in the Chingford 1000 Women study. The outcome was incident RKOA, defined as Kellgren/Lawrence grade 0-1 at baseline and ≥2 at year 5. We estimated predictors’ effects on the outcome using logistic regression models. Two models were generated. The clinical model considered patient characteristics, medication, biomarkers, and knee symptoms. The radiographic model considered the same factors, plus radiographic factors (e.g., angle between the acetabular roof and ilium’s vertical cortex (hip α-angle)). The models were internally validated. Model performance was assessed using calibration and discrimination (area under the receiver characteristic curve, AUC).

Results

The clinical model contained age, quadriceps circumference, and a cartilage degradation marker (CTX-II) as predictors (AUC = 0.692). The radiographic model contained older age, greater quadriceps circumference, knee pain, knee baseline Kellgren/Lawrence 1 (versus 0), greater hip α-angle, greater spinal bone mineral density, and contralateral RKOA at baseline as predictors (AUC = 0.797). Calibration tests showed good agreement between the observed and predicted incident RKOA. A clinical risk score tool was developed from the clinical model.

Conclusion

Two models predicting incident RKOA within 4 years were developed; including radiographic variables improved model performance. First-time predictor hip α-angle and contralateral RKOA suggest osteoarthritis origins beyond the knee. The clinical tool has the potential to help physicians identify patients at risk of RKOA in routine practice, but should be externally validated.


Knee osteoarthritis is one of the greatest contributors to global disability and a major global public health burden (1). It was the indication for surgery in 96% of the 98,147 primary knee joint replacements conducted in the United Kingdom in 2016 (2). The current treatment for knee osteoarthritis pain is limited to symptom relief with analgesics and/or physiotherapy. Preventing knee osteoarthritis is thus an increased focus of public health.

Previous studies have identified risk factors for the incidence and progression of radiographic knee osteoarthritis (RKOA), such as older age, female gender, and higher body mass index (BMI) (36). However, only three prognostic models have been developed for incident RKOA (79). Two of these models were developed using 9 and 12 years of participant follow-up data (7, 9). The most recent study followed participants for 5 years to identify rapid progression and considered radiographic tibiofemoral osteoarthritis as the outcome (8).

As the rate at which knee osteoarthritis progresses varies considerably between patients (10), a model for short-term incident RKOA is needed to identify homogeneous phenotypes of patients, to facilitate forecasting and target potential treatments (11). Many of the known risk factors for RKOA have only been studied in isolation (12, 13). Their combined effects and any other risk factors for the onset of short-term RKOA are needed to better identify those at risk.

This is the first study to asses a wide range of potential predictors that includes physical assessment, sociodemographic characteristics, medication, biomarkers, medical history (family history, knee pain, activity associated with a painful knee, and occupation), spine and hip radiographs and densitometries, and lifestyle. Incorporating new predictors in clinical prediction models adds value, improving the information available to clinicians and patients when deciding on preventive strategies to reduce rapid disease incidence. A description of patients at risk of rapid progression to RKOA will also help in selecting participants for randomised controlled trials of new interventions.

We aimed to develop and internally validate a prognostic model for short-term incidence of RKOA in a population-based cohort of women, focusing on knee-level risk factors. We also aimed to develop a clinical risk prediction tool to help clinicians to identify women who are most likely to develop RKOA within 4 years.

Materials and Methods

Data source and sample size

This study was carried out retrospectively using data from the Chingford 1000 Women study. This is a well-described prospective population-based cohort of 1003 women seen annually for osteoporosis and osteoarthritis over 23 years (3). Women were selected from the age/sex register of a large general practice in Chingford, North London, UK. They lived in a middle-class area and were mostly white (98%) and middle-aged (44-67 years). For the purpose of this analysis, women were recruited at baseline between 1988 and 1989, and seen again 4 years later.

Participants

The unit of analysis was the knee. Each woman participated with one or both knees, which were radiographed at baseline (year 1) and follow-up (year 5). Exclusion criteria for participants were any indication of inflammatory arthritis (rheumatoid arthritis or lupus) or a neurological medical condition (poliomyelitis, Parkinson’s disease, stroke, multiple sclerosis, or cerebral palsy) at baseline or year 10, as this information was not available for year 5. Fifty participants were excluded using these criteria. Individual knees were also excluded if they had a Kellgren and Lawrence (K/L) grade of 2 or more (14), an osteophyte (lateral or medial), or joint space narrowing (JSN) of grade 1 or more at baseline (10).

The ethics committee approved the Chingford study (reference number: LREC R & WF 96), and written informed consent was obtained from each participant.

Outcome

The outcome was incident RKOA, defined as a knee with a K/L grade of 0 or 1 at baseline and of grade 2 or more at year 5. The K/L classification progresses from grade 0 to 4, based on X-rays, where 0 = normal; 1 = no JSN and possible osteophyte; 2 = possible JSN and definite osteophyte; 3 = definite JSN and multiple osteophytes, sclerosis, and possible bony deformity; and 4 = marked JSN, large osteophytes, severe sclerosis, and definite bony deformity (15, 16). The Chingford study collected weight-bearing anteroposterior-view radiographs of the knee for all participants at baseline and follow-up. These X-rays were used to assign each knee a K/L grade, using previously described protocols (3, 17).

Predictor variables

The Chingford investigators collected around 700 variables at baseline. A panel of experts in osteoarthritis research selected candidate predictors for RKOA from these variables in a three-round Delphi process. Categorical variables with under five values in at least one category and variables with a poor association with the outcome (P-value > 0.2) were excluded. The remaining potential predictors were used to develop the model. Supplementary Tables S1-S6 list the potential predictors and Supplementary Text S1 describes how the predictors were assessed.

Statistics

We developed the prediction model as follows (18, 19):

Step 1: To address the issue of missing data, we generated 50 imputed datasets (20). The linearity of continuous variables with incident RKOA was assessed using fractional polynomials.

Step 2: We evaluated the independent associations between the potential predictor variables and RKOA incidence with logistic regression, using clustered standard errors at the person-level. Two hundred bootstrap samples with replacement were combined with the 50 imputed datasets. Within each bootstrap sample, automatic backward selection was applied using a significance level of 0.157 (21), corresponding to the Akaike information criterion.

Step 3: Variables that appeared in at least 70% of the bootstrap samples were retained in the final models (22). We developed two models. The first only considered variables that clinicians routinely have access to: patient characteristics, medications, biomarker risk factors, and knee symptoms (clinical model). The second also considered radiographic variables (radiographic model).

Internal validation

We used 200 bootstrap samples with replacement combined with multiple imputations to assess bias-corrected estimates of predictive ability.

Further details of the multiple imputation, bootstrapping, and internal validation methods are described in Supplementary Text S1.

Model performance

We assessed the models’ predictive performance using calibration and discrimination measures (21). The area under the receiver characteristic curve (AUC) was used to assess discrimination. Calibration – how closely predicted risk corresponds with observed risk – was assessed visually using calibration plots.

Clinical scoring tool

We created a points-based risk-scoring tool from the clinical model for easy clinical use, using previously described methods (23, 24). The tool estimates the short-term risk of incident RKOA.

All analyses were conducted using Stata version 13.1. We followed the TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) guideline to properly report this study (25).

Results

Study characteristics

We analysed 1184 knees from 649 women for whom radiographic data were available at baseline (year 1) and year 5. The participants’ mean age (±standard deviation) was 54 (±6) years. Figure 1 shows the selection criteria for the included knees and that 109 knees (9.2%, 95 women) had developed RKOA by year 5.

Figure 1. Flowchart showing selection criteria and numbers excluded at each stage of knees from women who developed knee osteoarthritis within 4 years.

Figure 1

We excluded 20 categorical variables for having less than 5 observations in at least 1 category. Following univariable analysis, we excluded 53 of the possible variables (see Supplementary Tables S1-S6 for univariable analysis results). Missing data for the variables included in this study are shown in Supplementary Table S7.

The remaining 30 potential predictors were used to develop the model, of which 24 are routinely available to clinicians and 6 are radiographic variables. Table 1 compare the 30 candidate risk factors between knees that developed RKOA within 4 years (by year 5) and those that did not. Supplementary Table S8 describes the 30 potential risk factors in greater detail.

Table 1. Baseline features of knees that do and do not develop radiographic knee osteoarthritis in 4 years.

Patient features No RKOA (1075) RKOA (109) P-value
Age, years 53 (48, 58) 56 (51, 60) <0.001a
Age at menopause 0.024
      No menopause 278 (25.9) 21 (19.3)
      <48 years old 401 (37.3) 32 (29.4)
      49-51 years old 258 (24.0) 34 (31.2)
      >51 years old 138 (12.8) 22 (20.2)
BMI (kg/m2) 24.2 (22.5, 27.0) 26.4 (23.7, 28.9) <0.001
Waist-hip ratio 0.76 (0.73, 0.80) 0.78 (0.75, 0.81) 0.005
Weight at 20 years old (kg) 54 (50, 60) 57 (53, 63) 0.002
Quadriceps circumference (cm)* 42 (39, 45) 44 (41, 47) <0.001
Medication
Oral contraceptive pill 363 (33.8) 29 (26.6) 0.130
Pain killers 79 (7.4) 13(11.9) 0.089
Biomarkers
CTX-II tertiles (corrected for creatinine) <0.001
      52.7 – 133.1 ng/mL 294 (34.5) 14 (18.9)
      133.2 – 229.8 ng/mL 290 (34.0) 19 (25.7)
      ≥229.9 ng/mL 268 (31.5) 41 (55.4)
Oestradiol (E2) (picomol/L) 21 (20, 239) 20 (20, 153) 0.134b
Knee symptoms and height loss, stoop, or hump
Duration (months)* 0 (0-1) 0 (0-12) 0.051c
Presence of stiffness* 247 (23.0) 34 (31.2) 0.055
Presence of pain* 238 (22.1) 37 (33.9) 0.005
Presence of swelling* 93 (8.6) 14 (12.8) 0.146
Injured knees for a week 81 (8.7) 19 (19.2) 0.001
Pain while walking 177 (19.1) 27 (27.3) 0.051
Pain while descending stairs 188 (20.2) 30 (30.3) 0.020
Pain while bending 188 (20.4) 28 (28.9) 0.051
Pain while sitting 112 (12.1) 19 (19.2) 0.043
Unstable knees 165 (17.8) 32 (33.0) <0.001
Morning stiffness 233 (25.1) 33 (33.3) 0.077
Weather affects knees 157 (16.9) 28 (28.0) 0.006
Job/daily activities involved knee bending 10 years agoǂ 0.020
None/little/moderate 699 (71.8) 58 (60.4)
A lot/always 275 (28.2) 38 (39.6)
Loss of height, stoop, or hump 119 (11.1) 17 (15.6) 0.160
Radiology factors
Baseline knee K/L grade* <0.001
0 grade 1029 (95.7) 75 (68.8)
1 grade 46 (4.3) 34 (31.2)
Contralateral knee with RKOA at baseline* 83 (7.7) 31 (28.4) <0.001
Hip α-angle (degrees)* 55.4 (±18.3) 61.8 (±22.7) 0.004d
Spine – osteophytes (n) 0.080
0-3 676 (66.3) 57 (57.6)
>3 343 (33.7) 42 (42.4)
Spine discs - narrowing space (n) 0.027
0 900 (87.6) 79 (79.8)
>3 127 (12.4) 20 (20.2)
BMD Z-score at the spine L1-L4 0.32 (±1.25) 0.86 (±1.41) 0.002

These factors were considered potential prognostic factors in both the clinical and radiographic models. The data were collected in London, 1989/91.

*

Side level.

ǂ

collected at year 3.

a

Significant F-statistic.

b

Analysis of variance. Variances between groups were not equal.

c

Significant F-statistics (0.53) when there were no symptoms on the knee (values=0) were excluded.

d

Analysis of variance. Bartlett’s test for equal variances (P = 0.006). Median and interquartile range (IQR) were used for continuous variables. Number and percentage (%) were used for categorical variables. Body mass index, BMI; crosslinked C-telopeptide of type II collagen, CTX-II; radiographic knee osteoarthritis (Kellgren/Lawrence grade≥2), RKOA. Bone mineral density, BMD.

Almost half of the 30 potential factors have been described previously (9, 11, 1820). Sixteen were evaluated for the first time in the development of a model of RKOA incidence: age at menopause, waist-to-circumference ratio, weight at 20 years old, knee-level quadriceps circumference, painkiller use, duration of knee symptoms in months, stiffness during joint examination, pain during joint examination, swelling during joint examination, knees injured enough to rest them for a week, unstable knees (knees that give way), weather affecting knees, loss of height or a stoop or hump, number of thoracic and lumbar vertebrae with osteophytes or discs with narrowing space (26), and hip α-angle (the angle between the acetabular roof and ilium’s vertical cortex).

Multivariable models predicting RKOA

The 24 of the 30 candidate predictors that are routinely available to clinicians (excluding the radiographic variables) were used to build the clinical multivariable model. Three candidates were identified as predictors (P<0.157): older age, greater quadriceps circumference, and higher urine concentration of C-terminal telopeptide of type II collagen (CTX-II) corrected for creatinine at baseline (Table 2).

Table 2. Multivariable logistic regression models identifying the predictors of RKOA in women after 4 years of follow-up.

Intercept and predictors (reference category) Clinical model ─ % retained; OR (95% CI) Radiographic model ─ % retained; OR (95% CI)
Intercept 2.64x10-5 8.79x10-6
Age, years 91%; 1.06 (1.02, 1.10) 78%; 1.07 (1.02, 1.12)
Quadriceps circumference, cm* 94%; 1.11 (1.06, 1.17) 91%; 1.09 (1.03, 1.15)
CTX-II tertilesǂ, ng/mL
(52.7−133.1)
       ≥229.9 ng/mL 85%; 1.89 (1.13, 3.14)
Presence of pain* (No)
       Yes 73%; 1.70 (0.99, 2.90)
Baseline knee K/L grade* (grade 0)
       Grade 1 100%; 6.54 (3.62, 11.83)
Contralateral knee with RKOA at baseline* (No)
       Yes 95%; 2.97 (1.65, 5.33)
Hip α-angle, degrees* 95%; 1.02 (1.01, 1.03)
Z score BMD at the spine L1-L4 93%; 1.32 (1.06, 1.64)
AUC 0.699 0.809
Optimism 0.7 1.2
Bias-corrected AUC 0.692 0.797

“Retained” indicates how often, as a percentage, a variable was retained in the final model after 200 bootstrapping attempts.

*

Side level.

ǂ

133.2 ‒ 229.8 ng/mL of urine CTX-II was retained only 3% of the time and was not considered for prediction. Body mass index, BMI; crosslinked C-telopeptide of type II collagen, CTX-II; odds ratio, OR; confidence interval, CI; Kellgren/Lawrence, K/L; radiographic knee osteoarthritis (K/L grade≥2), RKOA; bone mineral density, BMD; area under the receiver characteristic curve, AUC.

The model is described by:

Predicted probability of incident RKOA at year 5 = 1/(1+exp(-(-10.54 + 0.06 x age + 0.11 x quadriceps circumference + 0.63 x CTX-II (≥229.9 ng/mL category))).

All 30 candidate predictors, including the radiographic variables, were used to build the radiographic multivariable model. Seven candidate variables were identified as predictors (P<0.157): older age, greater quadriceps circumference, presence of knee pain, K/L grade 1, contralateral RKOA at baseline, greater hip α-angle (28), and greater bone mineral density (BMD) Z-score at the spine (Table 2).

The model is described by:

Predicted probability of incident RKOA at year 5 = 1/(1+exp(-11.64 + 0.07 x age + 0.09 x quadriceps circumference + 0.53 x knee pain (same side) + 1.88 x knee K/L grade 1 + 1.09 x contralateral knee with K/L grade≥2 + 0.02 x hip α-angle + 0.28 x BMD Z-score at the spine L1-L4)).

Model performance

The upper panels of Figure 2 show the models’ discrimination. The radiographic model (right upper panel) showed better discrimination (AUC = 0.809, optimism = 0.012, bias-corrected AUC = 0.797) than the more limited clinical model (left upper panel, AUC = 0.699, optimism = 0.007, bias-corrected AUC = 0.692).

Figure 2. Discrimination and calibration plots with bias-corrected AUC.

Figure 2

The upper panels show discrimination when using age, quadriceps circumference, and CTX-II as predictors of incident RKOA (clinical model; left panel), and when using age, quadriceps, painful knee, and radiologic factors as predictors (radiographic model; right panel). The area under the solid line and above the dotted line (line of no-discrimination) indicates the ability of the model to predict whether patients will develop RKOA within 4 years. The lower panels show the calibration of the imputed development dataset for the clinical (left) and radiographic model (right) models. The sample used for validation was divided into ten equal parts, according to their predicted risk. For each decile, the mean predicted risk is shown on the x-axis and the mean observed cases on the y-axis. The bars indicate 95% Agresti–Coull confidence intervals. The red straight line indicates perfect agreement between the observed and predicted values.

Area under the receiver characteristic curve, AUC; urine crosslinked C-telopeptide of type II collagen, CTX-II; radiographic knee osteoarthritis (Kellgren/Lawrence grade≥2), RKOA.

The agreement between the predicted and observed values of incident RKOA at year 5 is shown in the lower panels of Figure 2 and was assessed visually. Both models showed good calibration: all of the 95% confidence interval (CI) bars and some of the mean values (data points) intersect with the 45° line that indicates perfect agreement between the predicted and observed RKOA at year 5. However, both models slightly overestimated some of the lowest values. Our models therefore estimated that fewer patients would develop RKOA than was observed in our sample for those patients that had a low probability of developing RKOA.

Clinical scoring tool

The clinical model with routinely available variables (age, quadriceps circumference, and urine CTX-II) was developed into a clinical scoring tool (Table 3). The tool gives scores from 0 (lowest risk) to 17 (greatest risk). A woman will reach the highest score if she is 52-66 years old, has a quadriceps with a circumference of 44-63 cm, and has a concentration of urine CTX-II of 0.23-1.34 mcg/mL.

Table 3. Risk score points system for identifying women at risk of developing RKOA in the next 4 years, created using predictor variables identified in the clinical model.

Baseline risk factor Regression coefficient Reference value Risk score Final risk score
Age, years 1.06
       44 to 48 46 4 0
       49 to 51 50 5 1
       52 to 66 59 6 2
Quadriceps circumference, cm* 1.11
       32 to 39 35.5 3 0
       40 to 43 41.5 4 1
       44 to 63 53.5 5 2
CTX-II tertiles (mcg/mL)ǂ 1.9
       0.0527 to 0.1331 0.09 1 0
       0.1332 to 0.2298 0.18 3 2
       0.2299 to 1.3381 0.78 14 13

Score of 0 indicates lowest risk and score of 17 indicates greatest risk (column “final risk score”). To work out your patient’s risk 1. Find their measurement for each characteristic. 2. Circle the appropriate final risk score for each characteristic. 3. Add up the scores to give a total risk score. 4. Convert the risk score to a % probability by dividing the score by the maximum possible (17) and multiplying by 100.

*

Side level.

ǂ

Original values in nanograms/mL transformed to micrograms/mL, i.e. divided by 1000. CTX-II, crosslinked C-telopeptide of type II collagen; Radiographic knee osteoarthritis (K/L grade≥2), RKOA.

We also generated a tool that adds the four radiographic variables to the three routinely available variables, for those physicians with access to radiographs (Supplementary Table S9).

Discussion

We developed and internally validated two prediction models for incident RKOA in middle-aged women, one using information readily available to clinicians (clinical model) and the other supplementing this information with radiographic features (radiographic model). Both models showed good predictive validity, with bias-corrected AUCs of 0.692 (clinical model) and 0.797 (radiographic model). Calibration tests showed good agreement between the observed and predicted incident RKOA.

We also developed a clinical risk score tool to identify women at short-term risk of RKOA, using the predictors identified in the clinical model so that it can easily be used in clinical practice. A participant with a score of 5 would have a 30% ((5/17) x 100 = 29.4) probability of developing RKOA within 4 years. Higher risk is driven by the urine CTX-II marker. Patients with no risk from age (44–48 years) or quadriceps circumference (32–39 cm) but with high urine CTX-II (0.2–1.3 µg/mL) would have a 77% ((13/17) x 100 = 76.5) probability of developing RKOA within 4 years.

Older age, bigger quadriceps circumference, and elevated urine CTX-II were predictors of incident RKOA in the clinical model. When radiographic features, hip α-angle, and bone density were added to form the radiographic model, the predictive ability improved considerably, increasing from 69% to 80%. The radiographic model selected age and quadriceps circumference like the clinical model, but did not select urine CTX-II. The radiographic model also selected knee pain, baseline K/L grade, contralateral knee with RKOA at baseline, hip α-angle, and Z score BMD at the spine L1-L4. The principal predictors (those with the highest odds ratios and strongest predictive ability) in the radiographic model were RKOA in the contralateral knee (3 times more associated with incidence RKOA than a contralateral knee free of RKOA, Table 2) and K/L grade 1 in the index knee (6.5 times more related to incidence RKOA than the index knee with K/L grade 0, Table 2), at baseline.

Within the National Institute for Health and Care Excellence (NICE) recommendations (29), patients with no pain or symptoms of knee osteoarthritis who are 45 years old or older and have an activity associated with knee pain could be assessed using our clinical predictive tool to predict their risk of developing RKOA in the next 4 years. The radiographic predictive tool that includes radiographic variables could be useful in clinical practice if further investigation is undertaken when diagnosis is in doubt or in preparation for referral to a rheumatologist.

Age (selected in both models) and knee pain (selected in the radiographic model) are both well-known risk factors for the incidence of RKOA (4, 10, 3032).

Our models showed that a greater quadriceps circumference was associated with incidence RKOA. A larger circumference may reflect more subcutaneous fat around the knee. Individuals who are overweight may have added issues with load and muscle imbalance, which can lead to quadriceps inflammation (33, 34). It is easy to measure the quadriceps circumference in clinical practice, making this a useful predictor (35).

As urine CTX-II is a by-product of the degradation of knee components such as matrix and cartilage, its presence has been associated with osteoarthritis and osteoporosis (36). A meta-analysis that included the Chingford cohort used here found that a higher likelihood of incident knee osteoarthritis was associated with higher levels of urine CTX-II (37). Although urine CTX-II was a significant predictor in our clinical model, it was not selected in our radiographic model. Urine CTX-II may therefore be a surrogate for radiographic factors, which could be useful in clinical practice when X-rays are unavailable.

A K/L grade of 1 and contralateral RKOA were strong predictors of RKOA in our radiographic model. These associations are already well-known (7, 8) and an existing person-level prediction model also includes K/L grade of 1 as a predictor (7).

This is the first time that hip α-angle has been identified as a predictor of incident RKOA. The α-angle is a radiological measure used to diagnose femoroacetabular impingement at the hip, which causes hip pain and dysfunction (38). The most common threshold for diagnosis is an angle greater than 50° (28). The mean of α-angles in the group with RKOA at year 5 exceeded this threshold in our study. A larger hip α-angle may thus reflect serious biomechanical changes and point to an osteoarthritis origin beyond the knee that leads to an increased risk of knee RKOA. For example, a greater hip α-angle might indicate abnormal rotation of the tibia with respect to the femur, leading to knee osteoarthritis (39). It may also be related to hip osteoarthritis. Hip osteoarthritis flexes, externally rotates, and adducts the hip. These changes may lead to apparent limb shortening.

We found higher BMD at the spine in women with short-term incident RKOA than in those without RKOA. A lumbar spine with a higher BMD has previously been associated with knee osteoarthritis (40, 41). A recent population-based study found a correlation between the spine BMD and knee osteophyte score, and a negative correlation between the spine BMD and JSN (42). High systemic BMD has also been associated with incident RKOA (43, 44), and an estimated 45% of the association between high bone mass and knee osteoarthritis may be mediated by BMI (45). However, this is the first time that higher spine BMD has been shown to be useful in a predictive model of RKOA.

Clinical practice needs predictive tools for identifying those at risk of developing RKOA in the short term (6, 46). Identifying those at short-term risk will allow new interventions targeting this population to be developed. However, two of the three previously developed models for incidence of RKOA followed people for 9 (7) and 12 (9) years. They therefore selected prognostic factors that could predict RKOA in the medium- to long-term. Riddle et al. investigated short-term risk by following participants for 5 years, but focused on older people with a higher BMI who were at high risk for developing osteoarthritis, and only considered those with radiographic tibiofemoral osteoarthritis (8). Our model bridges this gap by predicting the short-term incidence of all RKOA.

Unlike our study, none of the three previous studies (79) included any form of internal validation to account for optimism in the predictive performance of the developed models (25, 47). The AUC values presented in these published studies would have been lower if internal validation were used.

Kerkhof et al. also produced a clinical model that excluded radiographic variables but included age, CTX-II, and BMI (7). This model had reasonable discriminatory power (AUC = 0.66). Our clinical model used knee-level quadriceps circumference instead of BMI and had better slightly discriminatory power (AUC = 0.69) than Kerkhof’s clinical model. Both clinical models included urine CTX-II. It added little to the predictive value of their model, whereas higher urine CTX-II levels doubled the probability of short-term RKOA in our clinical model (48). Our clinical model was also better at predicting incidence RKOA than alternative models assessed by Kerkhof et al. that considered ambulation, disability, and genetic risk factors.

Our clinical model performed similarly (AUC = 0.69) to the model of Zhang et al. (9) when developed on the Nottingham knee osteoarthritis retrospective cohort (AUC = 0.70). However, our clinical model is simpler to implement because it only considers three predictors (age, knee-level quadriceps circumference, and urine CTX-II), in comparison with their six-predictor model (age, sex, BMI, occupational risk, family history of osteoarthritis, and previous serious knee injury).

None of the existing models used calibration plots to check agreement between predicted and observed probabilities (79). Instead, they used the Hosmer-Lemeshow test. The TRIPOD guideline discourages its use because it has limited statistical power when assessing poor calibration and tends to give a significant result if a large enough sample is used (25). We presented calibration plots showing that the CIs for most of our models’ predictions overlapped with the 45° line, showing agreement with the observed RKOA incidence. The probability of developing incident RKOA in the next 4 years in our general population of middle-aged women varied between 3 out of 100 women and 20 out of 100 women. As this model was developed using data from a healthy, urban population of white middle-aged women, it cannot be assumed that the model will make accurate predictions in other populations. We suggest testing and validation before use in, for example, hospital inpatient, rural, younger female, older female, and male populations.

Strengths and limitations

This study has several strengths. Our knee-level approach allows to identify risk factors whose effects are connected to which side of the body they are in, in relation to the knee that developed RKOA: quadriceps circumference, knee pain evaluated by the physician, specific knee K/L grade, contralateral knee with RKOA, and ipsilateral hip α-angle.

The reproducibility of the model was ensured by using multiple imputation and bootstrapping (49), so that only significant predictors were selected. We grouped the risk factors together into those that clinicians readily have access to and those that require radiography. The resulting two risk models support clinical decision-making between the physician and patient in two common scenarios, before and after radiography. We created a risk prediction tool to assess the short-term risk of incident RKOA, which will help physicians to inform their patients about their risk for incident RKOA and support the physician in addressing preventive measures to avoid the outcome.

The study also has potential limitations. As uncontrolled parameters such as lifestyle factors may have changed since this study started in 1988-1989, the results may not be generalisable to individuals in 2018. However, our findings are consistent with recent studies (4, 12, 13, 37), which support that these potential differences may not have any impact on the relationship between the selected predictors and RKOA.

External validation was beyond the scope of this study, as an existing cohort of sufficient sample size containing the required predictors could not be found. Before the models are used in clinical practice, they should be externally validated using participant data from other than the Chingford study to test whether the model performance is overly optimistic. The models’ generalisability in men, mixed-gender, and non-white populations should also be tested. It is possible that the predictive capacity identified here only applies to individuals with existing radiographic changes, which could limit the clinical utility of the tool. This requires further investigation.

K/L grade≥2 does not account for knee symptoms. However, K/L ≥2 is strongly associated with knee pain and closely linked to knee replacement (32). We instead tested knee pain as a potential predictor, which was selected in the radiographic model.

Conclusions

We developed two predictive models for short-term incidence of RKOA in middle-aged, predominantly white women, a simple clinical model and a more complete radiographic model. The clinical model uses three variables that clinicians can easily measure and use to identify and inform women who have knees at higher risk of RKOA in the clinical setting: age, quadriceps circumference, and urine CTX-II level. The radiographic predictive model uses seven variables and includes radiographic factors such as hip α-angle to increase the predictive capacity of the clinical model of short-term incidence of RKOA.

This is the first time that ipsilateral hip α-angle has been identified as a predictor of RKOA. The selection of hip α-angle, BMD at the lumbar spine, and contralateral knee osteoarthritis as predictors of RKOA suggest osteoarthritis origins beyond the knee area, although further research is needed before a mechanism for how these cause RKOA can be suggested. We also developed a risk score tool to help clinicians use the clinical model. Identifying women with knees at high risk of developing RKOA will enable preventive measures to be tested. Once externally validated, both models and the risk score tool could be useful in identifying participants for clinical trials.

Supplementary Material

Tables
Text

Significance and Innovations.

  • Identifying women with knees at high risk of developing radiographic knee osteoarthritis (RKOA) will enable preventive measures to be tested. To do so, we have developed clinical and radiological predictive models for short-term incidence of RKOA.

  • We have generated a risk score tool to help clinicians use the clinical model and inform their patients about their risk of developing osteoarthritis.

  • Both models and the risk score tool could be useful in identifying participants at risk of developing osteoarthritis in the short-term for clinical trials.

  • The radiographic model selected hip α-angle, bone mineral density at the spine lumbar, and contralateral knee osteoarthritis as predictors of RKOA, suggesting osteoarthritis origins beyond the knee area.

Acknowledgements

We would like to thank the patients and professionals who participated in data collection in the Chingford 1000 Women study. We acknowledge the data management system developed by Alison Turner. We acknowledge the selection of candidate predictors for RKOA in a Delphi process carried out by Dr Kirsten M Leyland, Prof Daniel Prieto Alhambra, and Dr Kassim Javaid. We also thank RN Batra for the former development of the validation code. We thank Dr Anjali Shah and Dr Thomas Perry for proofreading the manuscript. We acknowledge English language editing by Dr Jennifer A de Beyer of the Centre for Statistics in Medicine, University of Oxford. We acknowledge Katherine Edwards of the Botnar Research Centre (University of Oxford) for providing her expertise in how the hip α-angle could affect the development of incident RKOA. We acknowledge the registered pharmacist Marta Rodriguez-Alarcon for contributing to the categorisation of medication types. We acknowledge the Senior Research Fellow/Statistician Dr Millie Parsons (PhD) for providing the dataset and support for external validation using the Hertfordshire cohort (MRC Lifecourse Epidemiology Unit, University of Southampton, Southampton General Hospital, UK). We also acknowledge to the research teams of the “Osteoarthritis initiative” for providing the dataset with the biomarker CTX-II for the external validation of our clinical model: University of Maryland School of Medicine, Baltimore: Marc Hochberg, M.D., M.P.H.; The Ohio State University, Columbus: Rebecca Jackson, M.D.; University of Pittsburgh: C. Kent Kwoh, M.D.; Memorial Hospital of Rhode Island, Pawtucket: Charles Eaton, M.D.; and University of California, San Francisco (data coordinating centre): Michael Nevitt, Ph.D. A steering committee, comprised of representatives from these centres, the NIH, and the pharmaceutical partners advised on the scientific aspects of the study. A representative from the U.S. Food and Drug Administration advised the steering committee.

Funding: This study was supported financially by the Arthritis Research UK Centre for Sport, Exercise and Osteoarthritis (Grant reference 21595).

Footnotes

Conflict of interest declaration: CG, MTSS, DH, and TS have no conflicts of interest. AJ has received consultancy fees from Anthera Pharmaceuticals, Inc., Servier, the UK Renal Registry, and the Oxford Craniofacial Unit, and has received a research grant from Roche. CC has received personal fees from Alliance for Better Bone Health, Amgen, Eli Lilly, GSK, Medtronic, Merck, Novartis, Pfizer, Roche, Servier, Takeda, and UCB outside the submitted work. NKA has received honorariums from Novartis, Alliance for Better Health, and Lilly; held advisory board positions (which involved receipt of fees) at Merck, Merck Sharp and Dohme, Roche, Novartis, Smith and Nephew, Q-MED, Nicox, Servier, GlaxoSmithKline, Schering-Plough, Pfizer, and Rottapharm; and received consortium research grants from Alliance for Better Bone Health, Amgen, Novartis, Merck Sharp and Dohme, Servier, Eli Lilly, and GlaxoSmithKline; he has no other relationships or activities that could appear to have influenced the submitted work.

Contributor Information

Maria T. Sánchez-Santos, Email: maria.sanchez@ndorms.ox.ac.uk.

Prof Andrew Judge, Email: andrew.judge@ndorms.ox.ac.uk.

Deborah Hart, Email: deborah.hart@kcl.ac.uk.

Prof Tim Spector, Email: tim.spector@kcl.ac.uk.

Prof Cyrus Cooper, Email: cc@mrc.soton.ac.uk.

Prof Nigel K. Arden, Email: nigel.arden@ndorms.ox.ac.uk.

References

  • 1.Cross M, Smith E, Hoy D, Nolte S, Ackerman I, Fransen M, et al. The global burden of hip and knee osteoarthritis: estimates from the global burden of disease 2010 study. Annals of the rheumatic diseases. 2014;73(7):1323–30. doi: 10.1136/annrheumdis-2013-204763. [DOI] [PubMed] [Google Scholar]
  • 2.National Joint Registry. 14th Annual Report of the UK NJR. London: National Joint Registry for England, Wales and Northern Ireland, 2017; 2017. [Google Scholar]
  • 3.Hart DJ, Doyle DV, Spector TD. Incidence and risk factors for radiographic knee osteoarthritis in middle-aged women: the Chingford Study. Arthritis and rheumatism. 1999;42(1):17–24. doi: 10.1002/1529-0131(199901)42:1<17::AID-ANR2>3.0.CO;2-E. [DOI] [PubMed] [Google Scholar]
  • 4.Jiang L, Tian W, Wang Y, Rong J, Bao C, Liu Y, et al. Body mass index and susceptibility to knee osteoarthritis: a systematic review and meta-analysis. Joint, bone, spine : revue du rhumatisme. 2012;79(3):291–7. doi: 10.1016/j.jbspin.2011.05.015. [DOI] [PubMed] [Google Scholar]
  • 5.Prieto-Alhambra D, Judge A, Javaid MK, Cooper C, Diez-Perez A, Arden NK. Incidence and risk factors for clinically diagnosed knee, hip and hand osteoarthritis: influences of age, gender and osteoarthritis affecting other joints. Annals of the rheumatic diseases. 2014;73(9):1659–64. doi: 10.1136/annrheumdis-2013-203355. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Conaghan PG, Kloppenburg M, Schett G, Bijlsma JWJ, committee oboaEoah Osteoarthritis research priorities: a report from a EULAR ad hoc expert committee. Annals of the rheumatic diseases. 2014;73(8):1442–5. doi: 10.1136/annrheumdis-2013-204660. [DOI] [PubMed] [Google Scholar]
  • 7.Kerkhof HJ, Bierma-Zeinstra SM, Arden NK, Metrustry S, Castano-Betancourt M, Hart DJ, et al. Prediction model for knee osteoarthritis incidence, including clinical, genetic and biochemical risk factors. Annals of the rheumatic diseases. 2014;73(12):2116–21. doi: 10.1136/annrheumdis-2013-203620. [DOI] [PubMed] [Google Scholar]
  • 8.Riddle DL, Stratford PW, Perera RA. The incident tibiofemoral osteoarthritis with rapid progression phenotype: development and validation of a prognostic prediction rule. Osteoarthritis and Cartilage. 2016 doi: 10.1016/j.joca.2016.06.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Zhang W, McWilliams DF, Ingham SL, Doherty SA, Muthuri S, Muir KR, et al. Nottingham knee osteoarthritis risk prediction models. Annals of the rheumatic diseases. 2011;70(9):1599–604. doi: 10.1136/ard.2011.149807. [DOI] [PubMed] [Google Scholar]
  • 10.Leyland KM, Hart DJ, Javaid MK, Judge A, Kiran A, Soni A, et al. The natural history of radiographic knee osteoarthritis: a fourteen-year population-based cohort study. Arthritis and rheumatism. 2012;64(7):2243–51. doi: 10.1002/art.34415. [DOI] [PubMed] [Google Scholar]
  • 11.Felson DT. Identifying different osteoarthritis phenotypes through epidemiology. Osteoarthritis and Cartilage. 2010;18(5):601–4. doi: 10.1016/j.joca.2010.01.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Blagojevic M, Jinks C, Jeffery A, Jordan KP. Risk factors for onset of osteoarthritis of the knee in older adults: a systematic review and meta-analysis. Osteoarthritis and cartilage / OARS, Osteoarthritis Research Society. 2010;18(1):24–33. doi: 10.1016/j.joca.2009.08.010. [DOI] [PubMed] [Google Scholar]
  • 13.Silverwood V, Blagojevic-Bucknall M, Jinks C, Jordan JL, Protheroe J, Jordan KP. Current evidence on risk factors for knee osteoarthritis in older adults: a systematic review and meta-analysis. Osteoarthritis and cartilage / OARS, Osteoarthritis Research Society. 2015;23(4):507–15. doi: 10.1016/j.joca.2014.11.019. [DOI] [PubMed] [Google Scholar]
  • 14.Kellgren J, Lawrence J. Osteoarthritis and disk degeneration in an urban population. AnnRheum Dis. 1958;17:388–97. doi: 10.1136/ard.17.4.388. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Kellgren JH, Lawrence JS. Radiological assessment of osteo-arthrosis. Annals of the rheumatic diseases. 1957;16(4):494–502. doi: 10.1136/ard.16.4.494. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Kellgren JH. Atlas of Standard Radiographs of Arthritis. 2nd ed. Philadelphia: 1963. The epidemiology of chronic rheumatism. [Google Scholar]
  • 17.Spector TD, Hart DJ, Byrne J, Harris PA, Dacre JE, Doyle DV. Definition of osteoarthritis of the knee for epidemiological studies. Annals of the rheumatic diseases. 1993;52(11):790–4. doi: 10.1136/ard.52.11.790. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Austin PC, Tu JV. Bootstrap Methods for Developing Predictive Models. The American Statistician. 2004;58(2):131–7. [Google Scholar]
  • 19.Heymans MW, van Buuren S, Knol DL, van Mechelen W, de Vet HC. Variable selection under multiple imputation using the bootstrap in a prognostic study. BMC Med Res Methodol. 2007;7:33. doi: 10.1186/1471-2288-7-33. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Royston P, White IR. Multiple Imputation by Chained Equations (MICE): Implementation in Stata. Journal of Statistical Software. 2011;45(4) [Google Scholar]
  • 21.Harrell FE., Jr . Regression modeling strategies with applications to linear models, logistic regression, and survival analysis. New York: Springer; 2001. [Google Scholar]
  • 22.Judge A, Arden NK, Batra RN, Thomas G, Beard D, Javaid MK, et al. The association of patient characteristics and surgical variables on symptoms of pain and function over 5 years following primary hip-replacement surgery: a prospective cohort study. BMJ Open. 2013;3(3) doi: 10.1136/bmjopen-2012-002453. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Judge A, Javaid MK, Arden NK, Cushnaghan J, Reading I, Croft P, et al. Clinical tool to identify patients who are most likely to achieve long-term improvement in physical function after total hip arthroplasty. Arthritis care & research. 2012;64(6):881–9. doi: 10.1002/acr.21594. [DOI] [PubMed] [Google Scholar]
  • 24.van Staa TP, Geusens P, Kanis JA, Leufkens HGM, Gehlbach S, Cooper C. A simple clinical score for estimating the long-term risk of fracture in post-menopausal women. QJM: An International Journal of Medicine. 2006;99(10):673–82. doi: 10.1093/qjmed/hcl094. [DOI] [PubMed] [Google Scholar]
  • 25.Moons KG, Altman DG, Reitsma JB, Ioannidis JP, Macaskill P, Steyerberg EW, et al. Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration. Annals of internal medicine. 2015;162(1):W1–73. doi: 10.7326/M14-0698. [DOI] [PubMed] [Google Scholar]
  • 26.Hassett G, Hart DJ, Manek NJ, Doyle DV, Spector TD. Risk factors for progression of lumbar spine disc degeneration: The Chingford Study. Arthritis & Rheumatism. 2003;48(11):3112–7. doi: 10.1002/art.11321. [DOI] [PubMed] [Google Scholar]
  • 27.Nicholls AS, Kiran A, Pollard TCB, Hart DJ, Arden CPA, Spector T, et al. The association between hip morphology parameters and nineteen-year risk of end-stage osteoarthritis of the hip: a nested case-control study. Arthritis and rheumatism. 2011;63(11):3392–400. doi: 10.1002/art.30523. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Wright AA, Naze GS, Kavchak AE, Paul D, Kenison B, Hegedus EJ. Radiological variables associated with progression of femoroacetabular impingement of the hip: A systematic review. Journal of Science and Medicine in Sport. 2015;18(2):122–7. doi: 10.1016/j.jsams.2014.03.004. [DOI] [PubMed] [Google Scholar]
  • 29.NICE-guidelines. Osteoarthritis: Care and Management in Adults. London: National Institute for Health and Care Excellence (UK); 2014. National Institute for Health and Clinical Excellence: Guidance. [PubMed] [Google Scholar]
  • 30.Cooper C, Snow S, McAlindon TE, Kellingray S, Stuart B, Coggon D, et al. Risk factors for the incidence and progression of radiographic knee osteoarthritis. Arthritis and rheumatism. 2000;43(5):995–1000. doi: 10.1002/1529-0131(200005)43:5<995::AID-ANR6>3.0.CO;2-1. [DOI] [PubMed] [Google Scholar]
  • 31.Oliveria SA, Felson DT, Reed JI, Cirillo PA, Walker AM. Incidence of symptomatic hand, hip, and knee osteoarthritis among patients in a health maintenance organization. Arthritis and rheumatism. 1995;38(8):1134–41. doi: 10.1002/art.1780380817. [DOI] [PubMed] [Google Scholar]
  • 32.Rogers MW, Wilder FV. The association of BMI and knee pain among persons with radiographic knee osteoarthritis: A cross-sectional study. BMC Musculoskeletal Disorders. 2008;9:163. doi: 10.1186/1471-2474-9-163. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Andriacchi TP, Favre J. The Nature of In Vivo Mechanical Signals That Influence Cartilage Health and Progression to Knee Osteoarthritis. Current Rheumatology Reports. 2014;16(11):463. doi: 10.1007/s11926-014-0463-2. [DOI] [PubMed] [Google Scholar]
  • 34.Wluka AE, Lombard CB, Cicuttini FM. Tackling obesity in knee osteoarthritis. Nature Reviews Rheumatology. 2012;9:225. doi: 10.1038/nrrheum.2012.224. [DOI] [PubMed] [Google Scholar]
  • 35.Man GS, Mologhianu G. Osteoarthritis pathogenesis – a complex process that involves the entire joint. Journal of Medicine and Life. 2014;7(1):37–41. [PMC free article] [PubMed] [Google Scholar]
  • 36.Garnero P, Ayral X, Rousseau JC, Christgau S, Sandell LJ, Dougados M, et al. Uncoupling of type II collagen synthesis and degradation predicts progression of joint damage in patients with knee osteoarthritis. Arthritis and rheumatism. 2002;46(10):2613–24. doi: 10.1002/art.10576. [DOI] [PubMed] [Google Scholar]
  • 37.Valdes AM, Meulenbelt I, Chassaing E, Arden NK, Bierma-Zeinstra S, Hart D, et al. Large scale meta-analysis of urinary C-terminal telopeptide, serum cartilage oligomeric protein and matrix metalloprotease degraded type II collagen and their role in prevalence, incidence and progression of osteoarthritis. Osteoarthritis and Cartilage. 2014;22(5):683–9. doi: 10.1016/j.joca.2014.02.007. [DOI] [PubMed] [Google Scholar]
  • 38.Hack K, Di Primio G, Rakhra K, Beaulé PE. Prevalence of Cam-Type Femoroacetabular Impingement Morphology in Asymptomatic Volunteers. The Journal of Bone & Joint Surgery. 2010;92(14):2436–44. doi: 10.2106/JBJS.J.01280. [DOI] [PubMed] [Google Scholar]
  • 39.Sharma L, Lou C, Felson DT, Dunlop DD, Kirwan-Mellis G, Hayes KW, et al. Laxity in healthy and osteoarthritic knees. Arthritis and rheumatism. 1999;42(5):861–70. doi: 10.1002/1529-0131(199905)42:5<861::AID-ANR4>3.0.CO;2-N. [DOI] [PubMed] [Google Scholar]
  • 40.Burger H, van Daele PL, Odding E, Valkenburg HA, Hofman A, Grobbee DE, et al. Association of radiographically evident osteoarthritis with higher bone mineral density and increased bone loss with age. The Rotterdam Study. Arthritis and rheumatism. 1996;39(1):81–6. doi: 10.1002/art.1780390111. [DOI] [PubMed] [Google Scholar]
  • 41.Hart DJ, Cronin C, Daniels M, Worthy T, Doyle DV, Spector TD. The relationship of bone density and fracture to incident and progressive radiographic osteoarthritis of the knee: the Chingford Study. Arthritis and rheumatism. 2002;46(1):92–9. doi: 10.1002/1529-0131(200201)46:1<92::AID-ART10057>3.0.CO;2-#. [DOI] [PubMed] [Google Scholar]
  • 42.Wen L, Shin MH, Kang JH, Yim YR, Kim JE, Lee JW, et al. The relationships between bone mineral density and radiographic features of hand or knee osteoarthritis in older adults: data from the Dong-gu Study. Rheumatology (Oxford, England) 2016;55(3):495–503. doi: 10.1093/rheumatology/kev377. [DOI] [PubMed] [Google Scholar]
  • 43.Bergink AP, Uitterlinden AG, Van Leeuwen JP, Hofman A, Verhaar JA, Pols HA. Bone mineral density and vertebral fracture history are associated with incident and progressive radiographic knee osteoarthritis in elderly men and women: the Rotterdam Study. Bone. 2005;37(4):446–56. doi: 10.1016/j.bone.2005.05.001. [DOI] [PubMed] [Google Scholar]
  • 44.Nevitt MC, Zhang Y, Javaid MK, Neogi T, Curtis JR, Niu J, et al. High systemic bone mineral density increases the risk of incident knee OA and joint space narrowing, but not radiographic progression of existing knee OA: the MOST study. Annals of the rheumatic diseases. 2010;69(1):163–8. doi: 10.1136/ard.2008.099531. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Hardcastle SA, Dieppe P, Gregson CL, Arden NK, Spector TD, Hart DJ, et al. Individuals with high bone mass have an increased prevalence of radiographic knee osteoarthritis. Bone. 2015;71:171–9. doi: 10.1016/j.bone.2014.10.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Felson DT, Zhang Y, Hannan MT, Naimark A, Weissman B, Aliabadi P, et al. Risk factors for incident radiographic knee osteoarthritis in the elderly: the Framingham Study. Arthritis and rheumatism. 1997;40(4):728–33. doi: 10.1002/art.1780400420. [DOI] [PubMed] [Google Scholar]
  • 47.Steyerberg EW. Clinical prediction models: a practical approach to development, validation, and updating. Springer Science & Business Media; 2008. [Google Scholar]
  • 48.Odding E, Valkenburg HA, Algra D, Vandenouweland FA, Grobbee DE, Hofman A. Association of locomotor complaints and disability in the Rotterdam study. Annals of the rheumatic diseases. 1995;54(9):721–5. doi: 10.1136/ard.54.9.721. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Vergouwe Y, Royston P, Moons KG, Altman DG. Development and validation of a prediction model with missing predictor data: a practical approach. J Clin Epidemiol. 2010;63(2):205–14. doi: 10.1016/j.jclinepi.2009.03.017. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Tables
Text

RESOURCES