Abstract
Background
Doubts have been expressed about the performance of the American College of Rheumatology (ACR) clinical classification criteria for osteoarthritis when applied in the general population.
Objective
To investigate whether the distribution of population subgroups and underlying disease severity might explain the performance of these criteria in the population setting.
Methods
Population‐based cross‐sectional study. 819 adults aged ⩾50 years reporting knee pain in the last 12 months were clinically assessed by research therapists using standardised protocols and blinded to radiographic status. All participants underwent plain radiography of the knees, scored by a single reader blinded to clinical status. The relationship between fulfilling the ACR clinical classification criteria for knee osteoarthritis and the presence of symptomatic radiographic knee osteoarthritis was summarised for the sample as a whole and within subgroups.
Results
Radiographic osteoarthritis was present in 539 participants (68%) and symptomatic radiographic knee osteoarthritis in 259 (33%). 238 participants (30%) fulfilled the ACR clinical criteria for knee osteoarthritis. Agreement between the ACR clinical criteria and symptomatic radiographic knee osteoarthritis was low (sensitivity 41%; specificity 75%; positive predictive value 44%; negative predictive value 72%). Sensitivity and specificity did not vary markedly between population subgroups, although they were influenced by the underlying severity of radiographic osteoarthritis.
Conclusion
The ACR clinical criteria seem to reflect later signs in advanced disease. Other approaches may be needed to identify early, mild osteoarthritis in the general population and primary care.
The clinical classification criteria developed by the American College of Rheumatology (ACR)1 remain a popular method of classifying knee osteoarthritis, recommended for clinical and epidemiological studies2 and the practice of primary care.3
However, caution is needed when applying classification criteria in circumstances different from those in which they were derived. Summary statistics like positive and negative predictive values change from one setting to another as a function of disease prevalence and so do the sensitivity, specificity and likelihood ratios, which were once believed to be invariant across settings and subgroups.4 These parameters are often conditional on other factors in the patient profile in addition to being related to the underlying spectrum of disease severity in any given population.
Doubts have been expressed about the validity of the ACR clinical criteria in the general population and primary care.5,6 In a population‐based sample of symptomatic adults aged ⩾50 years, we examined how often the ACR clinical criteria (tree method) are satisfied in those with and without symptomatic radiographic knee osteoarthritis. We aimed to understand why the performance of these clinical classification criteria may be poorer in the general population. Specifically, we investigated the extent to which parameters such as sensitivity and specificity, used for summarising the “diagnostic accuracy” of the ACR clinical criteria, change between population subgroups and as a function of the underlying spectrum of disease severity.
Methods
The clinical assessment study of the knee
The clinical assessment study of the knee (CAS(K)) is a population‐based prospective observational cohort study of 819 symptomatic patients, aged ⩾50 years, registered with three general practices (irrespective of their actual consultation pattern). The North Staffordshire local research ethics committee approved the study. Full details of the study design and methods have been previously presented.7,8 Between August 2002 and September 2003, respondents to two postal questionnaires who reported knee pain in the past 12 months were invited to attend a research clinic that included a standardised clinical interview and examination, and plain radiographs of both knees. Participants with “red flags” (recent trauma likely to be associated with considerable tissue damage: acute, hot, swollen joint) were excluded. Participants were asked for permission to review their general practice medical records. From this review, it was determined whether participants had consulted their general practitioner as a consequence of knee pain or osteoarthritis in the 18 months before attending the clinical assessment.
Radiography
Three views of the knees were obtained for each participant at clinic; the weight‐bearing posteroanterior semiflexed/metatarsophalangeal view according to the Buckland–Wright protocol,9 a skyline view and a lateral view. The skyline and lateral views were obtained in the supine position, with the knee flexed to 45°.
A single reader (RD) scored all films and was blinded to all questionnaire and clinical data. The tibiofemoral joint was assessed using a posteroanterior view and, for the posterior compartment, a lateral view. The patellofemoral joint was assessed using a skyline and a lateral view. A Kellgren and Lawrence (K&L) score was assigned to the posteroanterior and skyline views using the original written description.10 For the lateral view a standard atlas11 was used to score superior and inferior osteophytes. Posterior tibial osteophytes do not appear in this atlas, but were judged on the same basis of severity as those osteophytes shown in the lateral view.
Defining participants with “symptomatic radiographic knee osteoarthritis”
The presence of any radiographic osteoarthritis in the knee joint was defined as: K&L score ⩾2 in the posteroanterior or K&L score ⩾2 in the skyline or the presence of superior or inferior patella osteophytes in the lateral view or the presence of posterior tibial osteophytes in the lateral view. The definition of moderate or severe radiographic osteoarthritis was based on the worst score at any location within each knee—for example, if a participant scored posteroanterior K&L = 3, skyline K&L = 2, lateral osteophytes = 0 and posterior osteophytes = 2, he or she was assigned to the moderate or severe group. Table 1 shows the definitions of radiographic severity used for the whole knee joint.
Table 1 Definition of radiographic knee osteoarthritis.
| None | Mild | Moderate/severe |
|---|---|---|
| PA K&L = 0 or 1 | PA K&L = 2 | PA K&L ⩾3 |
| and | or | or |
| Skyline K&L = 0 or 1 | Skyline K&L = 2 | Skyline K&L ⩾3 |
| and | or | or |
| Posterior osteophytes = 0 | Posterior osteophytes = 1 or 2 | Posterior osteophytes = 3 |
| and | or | or |
| Lateral osteophytes = 0 | Lateral osteophytes = 1 or 2 | Lateral osteophytes = 3 |
PA, posteroanterior view; K&L, Kellgren and Lawrence score.
All the participants recruited to this study had knee pain during the past year, but they were also asked to report whether they had experienced knee pain, aching or stiffness on most days in the past month. A positive response to this question and the presence of radiographic osteoarthritis in their index knee defined the participant as having “symptomatic radiographic OA”. The combination of symptoms and pathology has been proposed as the most compelling clinical definition of osteoarthritis12 and an operational definition similar to that applied in this study has been used as a reference standard in other population‐based studies.13 In the current analysis, this definition of symptomatic radiographic knee osteoarthritis was treated as the “reference standard” for comparing with the ACR clinical classification.
Clinical assessment
The clinical interview included a question about the presence and duration of morning stiffness. The presence of definite palpable bony enlargement at the knee and definite palpable coarse crepitus on transferring from sitting to standing were rated by the assessor on examination. Assessments were conducted by one of the six research therapists blinded to the findings from radiography, postal questionnaires and medical records. Training of the assessors took place before the study and was updated throughout the study period after every 100 participants were recruited. This took the form of comparisons against rheumatologists, open and blinded comparisons against each other using “expert patients” and peer observation. Assessors were issued a manual of detailed protocols for assessing each sign and symptom.
Defining participants with clinical knee osteoarthritis using the ACR criteria
The decision tree format of the ACR classification criteria for clinical knee osteoarthritis was applied to the collected examination data.1 Although the traditional “3 out of 6” format has been the more widely promulgated version, the decision tree format was recommended by the authors in their original publication. As all participants in our study satisfied the age criterion, the ACR clinical criteria for knee osteoarthritis were fulfilled in the following circumstances:
crepitus + and morning stiffness >30 min and bony enlargement +; or
crepitus + and morning stiffness ⩽30 min; or
crepitus − and bony enlargement + (where + = present, − = absent).
Weight and height data were measured to calculate body mass index (BMI), which was classified according to the World Health Organization criteria.
Statistical analysis
In this study only one knee per participant was analysed, the “index knee”. In patients with unilateral knee pain the “index” was the single painful knee; in those with bilateral knee pain it was the most painful knee. In situations where participants felt both knees were similarly painful, the index knee was selected at random. The prevalence of symptomatic radiographic knee osteoarthritis along with the positive predictive value (PPV), negative predictive value (NPV), sensitivity, specificity, and positive and negative likelihood ratios (LR+ and LR−) of the ACR clinical classification criteria were calculated (with 95% confidence intervals (CIs)) for the whole sample and then for each subgroup (age, sex, BMI and consulting status). To determine whether the performance of the ACR clinical criteria was dependent on the underlying spectrum of radiographic disease, we compared the sensitivity of the ACR criteria in those with isolated patellofemoral joint disease versus those with involvement of the tibiofemoral joint, and in those with mild versus severe disease. Both of these comparisons were restricted to those with knee symptoms on most days in the previous month.
Results
Descriptive characteristics
Complete radiographs and clinical data were available for 788 of 819 participants. Table 2 shows their descriptive characteristics.
Table 2 Descriptive characteristics of the 788 participants with complete data.
| Age (years), n (%) | |
| 50–59 | 233 (30) |
| 60–69 | 303 (39) |
| 70–79 | 204 (26) |
| 80+ | 48 (6) |
| Female sex, n (%) | 428 (54) |
| Higher education, n (%) | 114 (15) |
| Currently employed, n (%) | 164 (21) |
| Occupational class—manual, n (%) | 408 (55) |
| Body mass index (kg/m2), mean (SD) | 29.6 (5.2) |
| WOMAC pain (0–20), mean (SD) | 6.4 (4.4) |
| WOMAC stiffness (0–8), mean (SD) | 2.7 (1.9) |
| WOMAC physical function (0–68), mean (SD) | 20.8 (15.2) |
| Knee symptoms on most days in the past month, n (%) | 352 (45) |
| Radiographic knee OA (index knee), n (%) | |
| Any compartment | 537 (68) |
| Patellofemoral | 505 (64) |
| Tibiofemoral | 348 (44) |
| “Symptomatic radiographic knee OA”, n (%) | 259 (33) |
| Morning stiffness ⩽30 min, n (%) | 740 (94) |
| Bony enlargement (index knee), n (%) | 129 (16) |
| Coarse crepitus (index knee), n (%) | 169 (21) |
| ACR clinical criteria for knee OA (index knee), n (%) | 238 (30) |
ACR, American College of Rheumatology; OA, osteoarthritis; WOMAC, Western Ontario and MacMaster Osteoarthritis Index.
ACR clinical criteria versus symptomatic radiographic knee osteoarthritis
In all, 105 (41%) of the 259 participants classified as having symptomatic radiographic knee osteoarthrtits (symptoms on most days in the past month and radiographic evidence of definite osteoarthritis) fulfilled the ACR clinical criteria for knee osteoarthritis. This proportion was slightly lower among those with radiographic osteoarthritis but less frequent symptoms (90/278; 32%). In those participants with no radiographic osteoarthritis the proportion fulfilling the ACR criteria was even lower (43/251; 17%). Fulfilling the ACR clinical criteria was related more to the presence of radiographic osteoarthrits than to the frequency of symptoms in the past month.
Performance of the ACR clinical criteria in population subgroups
Table 3 presents the correspondence between symptomatic radiographic knee osteoarthritis (dichotomised as present or absent) and the ACR clinical criteria (fulfilled or not fulfilled).
Table 3 Performance of ACR clinical criteria by population subgroups.
| Symptomatic radiographic knee OA present* | Symptomatic radiographic knee OA absent | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| ACR clinical criteria fulfilled* | ACR clinical criteria not fulfilled | ACR clinical criteria fulfilled† | ACR clinical criteria not fulfilled | Prevalence of symptomatic OA % (95% CI) | PPV% (95% CI) | NPV% (95% CI) | Sn% (95% CI) | Sp% (95% CI) | LR+ | LR− | |
| All subjects | 105 | 154 | 133 | 396 | 33 (30 to 36) | 44 (38 to 51) | 72 (68 to 76) | 41 (35 to 47) | 75 (71 to 78) | 1.6 | 0.8 |
| Men, 50–64 years | 16 | 36 | 22 | 89 | 32 (25 to 39) | 42 (28 to 58) | 71 (63 to 78) | 31 (20 to 45) | 80 (72 to 87) | 1.6 | 0.9 |
| Men, ⩾65 years | 42 | 40 | 39 | 76 | 42 (35 to 49) | 52 (41 to 62) | 66 (57 to 74) | 51 (41 to 62) | 66 (57 to 74) | 1.5 | 0.7 |
| Women, 50–64 years | 16 | 28 | 33 | 131 | 21 (16 to 27) | 33 (21 to 47) | 82 (76 to 88) | 36 (24 to 51) | 80 (73 to 85) | 1.8 | 0.8 |
| Women, ⩾65 years | 31 | 50 | 39 | 100 | 37 (31 to 43) | 44 (33 to 56) | 67 (59 to 74) | 38 (28 to 49) | 72 (64 to 79) | 1.4 | 0.9 |
| BMI <25 kg/m2 | 13 | 17 | 24 | 77 | 23 (17 to 31) | 35 (22 to 51) | 82 (73 to 88) | 43 (27 to 61) | 76 (67 to 84) | 1.8 | 0.7 |
| BMI 25–29.9 kg/m2 | 40 | 56 | 67 | 182 | 28 (23 to 33) | 37 (29 to 47) | 76 (71 to 81) | 42 (32 to 52) | 73 (67 to 78) | 1.6 | 0.8 |
| BMI ⩾30 kg /m2 | 52 | 81 | 41 | 136 | 43 (38 to 49) | 56 (46 to 66) | 63 (56 to 69) | 39 (32 to 48) | 77 (70 to 83) | 1.7 | 0.8 |
| Non‐consulter | 63 | 100 | 104 | 319 | 28 (24 to 32) | 38 (31 to 45) | 76 (72 to 80) | 39 (32 to 47) | 75 (71 to 79) | 1.6 | 0.8 |
| Consulter | 42 | 54 | 29 | 77 | 48 (41 to 54) | 59 (48 to 70) | 59 (50 to 67) | 44 (34 to 54) | 73 (64 to 80) | 1.6 | 0.8 |
ACR, American College of Rheumatology; LR+, likelihood ratio (positive); LR−, likelihood ratio (negative) (calculated using “symptomatic radiographic knee OA” as the disease and the “ACR criteria” as the test); NPV, negative predictive value; OA, osteoarthritis; PPV, positive predictive value; Sn, sensitivity; Sp, specificity.
*Knee pain, aching or stiffness on most days in the past month and definite radiographic osteoarthritis in the index knee.
†Tree‐based criteria.
The first line of the table shows that for the whole sample, 259 (33%) of the 788 had symptomatic radiographic knee osteoarthritis. The PPV for ACR clinical criteria was 44% and NPV was 72%. Sensitivity was 41% and specificity was 71%—that is, applying the ACR clinical criteria results in a high proportion of “false negatives”. The positive and negative likelihood ratios were small (ie applying the ACR clinical criteria did little to change the pre‐test probability of symptomatic radiographic knee osteoarthritis). When the sample was divided into subgroups according to sex, age, BMI and consultation, the PPV and NPV varied in a predictable fashion: in groups with higher prevalence of symptomatic osteoarthritis (eg, obese), PPV increased and NPV decreased. Sensitivity, specificity and likelihood ratios were largely invariant across each of the subgroups.
Performance of the ACR clinical criteria by disease severity and compartmental distribution
The sensitivity of the ACR criteria was noticeably higher in those with involvement of the tibiofemoral joint and in those with more severe radiographic knee osteoarthritis (table 4). However, the likelihood ratios even in symptomatic severe radiographic knee osteoarthritis were still small.
Table 4 Performance of American College of Rheumatology clinical criteria by compartmental distribution and severity of radiographic osteoarthritis.
| ACR clinical criteria fulfilled* | ACR clinical criteria not fulfilled | LR+ | LR− | |
|---|---|---|---|---|
| Symptomatic radiographic knee OA absent (n = 529) | 133 (25%) | 396 (75%) | ||
| Symptomatic radiographic knee OA present† (n = 259) | ||||
| Compartmental distribution | ||||
| Isolated PFJ involvement (n = 78) | 23 (29%) | 55 (71%) | 1.2 | 0.9 |
| TFJ (with or without PFJ) involvement (n = 181) | 82 (45%) | 99 (55%) | 1.8 | 0.7 |
| Severity | ||||
| Mild radiographic disease (n = 84) | 20 (24%) | 64 (76%) | 0.9 | 1.0 |
| Moderate/severe radiographic disease (n = 175) | 85 (49%) | 90 (51%) | 1.9 | 0.7 |
ACR, American College of Rheumatology; LR+, likelihood ratio (positive); LR−, likelihood ratio (negative) (calculated using “symptomatic radiographic knee OA” as the disease and the “ACR criteria” as the test); OA, osteoarthritis; PFJ, patellofemoral joint; TFJ, tibiofemoral joint.
*Knee pain, aching or stiffness on most days in the past month and definite radiographic osteoarthritis in the index knee.
†Tree‐based criteria.
Discussion
In developing the ACR classification criteria for knee osteoarthritis, we recognised that classification criteria are often criticised for their imperfections.1 We sought to understand why caution is needed in their application in different settings and populations and to explore some of the reasons underlying this.
Our findings suggest that much of what might be classified as symptomatic radiographic knee osteoarthritis (frequent symptoms and radiographic evidence of disease) in the general population and primary care does not fulfil the ACR clinical criteria. Conversely, fulfilling the ACR clinical criteria does little to help rule out the presence of symptomatic osteoarthritis in older adults with knee pain. Interestingly, both approaches yielded essentially the same prevalence estimate of knee osteoarthritis in this sample (33% and 30%, respectively), although clearly they did not pick up the same participants.
Contrary to what we had expected from studies of other conditions, we found little variation in the relationship between the ACR clinical criteria and the presence of symptomatic radiographic knee osteoarthritis across different population subgroups. The performance of the ACR clinical criteria was, however, linked to the underlying disease severity. Crepitus, morning stiffness and bony enlargement were found more often in those with more advanced disease. Our finding of increased sensitivity with more severe disease is consistent with findings from other diagnostic studies.14
The estimate of sensitivity for the whole sample in the current study (41%) is markedly lower than that reported in the original development of the criteria (89%). A direct comparison of the two estimates is difficult as the reference standard used in the original study was clinical diagnosis of knee osteoarthritis verified by three independent expert panel members. Our study used the combination of frequent knee symptoms and radiographic evidence of definite osteoarthritis. Our definition of radiographic osteoarthritis applied the same principle as earlier studies (ie, definite osteophyte15), but extended this to all three views of the knee.16 Although some previous definitions have also included cases with joint space narrowing in the presence of doubtful osteophytes,13 there were few people in our study who satisfied this definition (only 10/245 people with no definite osteophyte had evidence of joint space narrowing). We therefore did not incorporate this additional group. In the original study by Altman et al,1 108 of 115 cases with knee pain and radiographic evidence of an osteophyte received a clinical diagnosis of knee osteoarthritis (22/122 who did not have an osteophyte received the clinical diagnosis of knee osteoarthritis). Given the high agreement between these two reference standards, it seems unlikely that the poorer performance of the clinical classification criteria in our study is explained by the use of a different reference standard. However, the possibility remains that the selection of patients in the original ACR study was influenced by unmeasured clinician perceptions related to the criteria. These would not have applied to the sample described here.
Observer variability either in assessing the ACR clinical criteria or in the reference standard (ie, scoring radiographs and reporting the frequency of knee symptoms in the previous month) would be expected to reduce our ability to observe any true association between these two. Intra‐reader and inter‐reader reliability for posteroanterior K&L score, skyline K&L score and lateral osteophytes were both good (κ 0.81–0.98 and 0.49–0.76, respectively). In our earlier pilot studies, with three of the assessors, interobserver and intraobserver reliability for applying the ACR clinical classification criteria were lower (observed agreement 78% and 87%; κ 0.30 and 0.66, respectively).17 The component with lowest reliability was palpation of coarse crepitus (observed agreement 61% and 77%; κ 0.22 and 0.53).18 When we re‐analysed our results separately for each of the six assessors, the sensitivitities (and specificities) of the ACR clinical criteria were 6.7% (95.6%), 41.4% (64.3%), 43.3% (63.1%), 47.2% (76.1%), 54.0% (72.0%) and 57.1% (74.1%). We found evidence of a gradual improvement over the course of the study period (first quarter sensitivity = 0.36 and last quarter sensitivity = 0.50), but at the expense of a reduction in specificity (0.81 and 0.72, respectively). Observer variability in assessing the ACR clinical criteria is thus a contributing factor to our findings. However, rather than being viewed as a major limitation, this may actually give a better indication of what happens when these criteria are applied in non‐specialist settings by clinicians with average capabilities.19
Throughout, we have used traditional diagnostic terminology (sensitivity, specificity and so forth) although it should be recognised that our analysis is more a comparison of two available alternatives for classifying knee osteoarthritis than a diagnostic study in which we have a clear gold standard (hence we use the term “reference standard” to describe the combination of frequent symptoms with definite radiographic osteoarthritis). Both approaches have their weaknesses in identifying mild, early osteoarthritis in the general population and primary care. The ACR clinical classification criteria seem to reflect later signs in advanced disease, and, in our experience, may be difficult to assess reliably. The co‐occurrence of frequent symptoms with definite osteophyte may be coincidental in many cases. Restricting the definition of symptomatic radiographic osteoarthritis to those with frequent symptoms also excludes people with obvious structural disease but intermittent symptoms. We have argued, as have others, that after excluding red flags, specific inflammatory disease and other non‐articular and extra‐articular causes, the more important distinctions may be on the basis of the persistence and severity of pain and associated disability and on the basis of the presence or absence of modifiable risk factors for symptom and disease progression.20 Descriptive studies aimed at characterising “early stages” in both clinical and disease terms should complement classifications used for case definition in osteoarthritis research.
Acknowledgements
We acknowledge the contributions of Krysia Dziedzic, June Handy, Jonathan Hill, Helen Myers and Ross Wilkie to data collection and study design and thank the administrative and health informatics staff at Keele University's Primary Care Sciences Research Centre, and the staff of the participating general practices and Haywood Hospital, especially Dr Jackie Saklatvala, Carole Jackson and the radiographers at the Department of Radiology.
Abbreviations
ACR - American College of Rheumatology
BMI - body mass index
CAS(K) - clinical assessment study of the knee
K&L - Kellgren and Lawrence
NPV - negative predictive value
PPV - positive predictive value
Footnotes
Ethical approval: The study was approved by the North Staffordshire Local Research Ethics Committee (Project No 1430).
Funding: This study is supported financially by a Programme Grant awarded by the Medical Research Council, UK (grant code: G9900220) and Support for Science funding secured by the North Staffordshire Primary Care Research Consortium for NHS service support costs. The funding sources for this study had no involvement in the study design, collection, analysis and interpretation of data, the writing of this report or the decision to submit this paper for publication.
Competing interests: None.
References
- 1.Altman R, Asch E, Bloch D, Bole G, Borenstein D, Brandt K.et al Development of criteria for the classification and reporting of osteoarthritis: classification of osteoarthritis of the knee. Arthritis Rheum 1986291039–1049. [DOI] [PubMed] [Google Scholar]
- 2.Brooks P, Hochberg M, for I L A R, OMERACT Outcome measures and classification criteria for the rheumatic diseases. A compilation of data from OMERACT (Outcome Measures for Arthritis Clinical Trials), ILAR (International League of Associations for Rheumatology), regional leagues and other groups. Rheumatology 200140896–906. [DOI] [PubMed] [Google Scholar]
- 3.Jackson J L, O'Malley P G, Kroenke K. Evaluation of acute knee pain in primary care. Ann Intern Med 2003139575–588. [DOI] [PubMed] [Google Scholar]
- 4.Moons K G, Harrell F E. Sensitivity and specificity should be de‐emphasized in diagnostic accuracy studies. Acad Radiol 200310670–672. [DOI] [PubMed] [Google Scholar]
- 5.Schouten J S, Valkenburg H A. Classification criteria: methodological considerations and results from a 12 year following study in the general population. J Rheumatol Suppl 19954344–45. [PubMed] [Google Scholar]
- 6.Bierma‐Zeinstra S, Bohnen A, Ginai A, Prins A, Verhaar J. Validity of American College of Rheumatology criteria for diagnosing hip osteoarthritis in primary care research. J Rheumatol 1999261129–1133. [PubMed] [Google Scholar]
- 7.Peat G, Thomas E, Handy J, Wood L, Dziedzic K, Myers H.et al The Knee Clinical Assessment Study—CAS(K). A prospective study of knee pain and knee osteoarthritis in the general population. BMC Musculoskelet Disord 200454. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Thomas E, Wilkie R, Peat G, Hill S, Dziedzic K, Croft P. The North Staffordshire Osteoarthritis Project—NorStOP: prospective, 3‐year study of the epidemiology and management of clinical osteoarthritis in a general population of older adults. BMC Musculoskelet Disord 200452. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Buckland‐Wright J C, Wolfe F, Ward R J, Flowers N, Hayne C. Substantial superiority of semiflexed (MTP) views in knee osteoarthritis: a comparative radiographic study, without fluoroscopy, of standing extended, semiflexed (MTP), and Schuss views. J Rheumatol 1999262664–2674. [PubMed] [Google Scholar]
- 10.Kellgren J H, Lawrence J S. Radiological assessment of osteo‐arthrosis. Ann Rheum Dis 195716494–501. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Burnett S, Hart D, Cooper C, Spector T.A radiographic atlas of osteoarthritis. London: Springer Verlag, 1994
- 12.Felson D T, Lawrence R C, Dieppe P A, Hirsch R, Helmick C G. Osteoarthritis: the disease and its prevalence and impact. In: Felson DT, conference chairman. Osteoarthritis: new insights. Part 1: the disease and its risk factors. Ann Intern Med 2000133635–636. [DOI] [PubMed] [Google Scholar]
- 13.Felson D T, McAlindon T E, Anderson J J, Naimark A, Weissman B W, Aliabadi P.et al Defining radiographic osteoarthritis for the whole knee. Osteoarthritis Cartilage 19975241–250. [DOI] [PubMed] [Google Scholar]
- 14.Whiting P, Rutjes A W S, Reitsma J B, Glas A S, Bossuyt P M M, Kleijnen J. Sources of variation and bias in studies of diagnostic accuracy. A systematic review. Ann Intern Med 2004140189–202. [DOI] [PubMed] [Google Scholar]
- 15.Spector T D, Hart D J, Byrne J, Harris P A, Dacre J E, Doyle D V. Definition of osteoarthritis of the knee for epidemiological studies. Ann Rheum Dis 199352790–794. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Duncan R C, Hay E M, Saklatvala J, Croft P R. Prevalence of radiographic osteoarthritis – it all depends on your point of view. Rheumatology 200645757–760. [DOI] [PubMed] [Google Scholar]
- 17.Peat G, Wood L, Wilkie R, Thomas E, for the KNE‐SCI Study Group How reliable is structured clinical history‐taking in older adults with knee problems? Inter‐ and intraobserver variability of the KNE‐SCI. J Clin Epidemiol 2003561030–1037. [DOI] [PubMed] [Google Scholar]
- 18.Wood L, Peat G, Wilkie R, Hay E, Thomas E, Sim J. A study of the noninstrumented physical examination of the knee found high observer variability. J Clin Epidemiol 200659512–520. [DOI] [PubMed] [Google Scholar]
- 19.Grobbee D. Epidemiology in the right direction: the importance of descriptive research. Eur J Epidemiol 200419741–744. [DOI] [PubMed] [Google Scholar]
- 20.Peat G, Croft P, Hay E. Clinical assessment of the osteoarthritis patient. Balliere's Best Pract Res Clin Rheumatol 200115527–544. [DOI] [PubMed] [Google Scholar]