Table 6.
Diagnostic Agreement Associated with the Criterion Examinations: Kappa and Percent Agreement
| Intersite Criterion Calibrations n = 26 | Intrasite Monitoring n = 724 | ||||||
|---|---|---|---|---|---|---|---|
| RDC/TMD Diagnosis | Percent of Study Sample with Diagnosis | Inter-CE Agreement (kappa) | Inter-CE Agreement (PA) | Overall CE Agreement with Consensus (kappa) | Overall CE Agreement with Consensus (PA) | CE Agreement with Consensus (kappa) | CE Agreement with Consensus (PA) |
| Group Ia: MFP | 51 | 0.85 (0.68) | 92 | 0.82 (0.64) | 91 | 0.98 (0.91) | 99 |
| Group Ib: MFP with limited opening | 27 | 0.81 (0.45) | 92 | 0.87 (0.50) | 95 | 0.98 (0.95) | 99 |
| Group IIa: DD with reduction | 31 | 0.83 (0.58) | 92 | 0.86 (0.64) | 94 | 0.96 (0.92) | 98 |
| Group IIb: DD without reduction, with limited opening | 10 | 0.84 (−0.04) | 97 | 0.86 (0.10) | 97 | 0.97 (0.75) | 99 |
| Group IIc: DD without reduction, without limited opening | 33 | 0.86 (0.66) | 94 | 0.88 (0.65) | 95 | 0.98 (0.88) | 99 |
| Group IIIa: Arthralgia | 29 | 0.91 (0.57) | 96 | 0.94 (0.64) | 97 | 0.95 (0.91) | 98 |
| Group IIIb: Osteoarthritis | 32 | 0.82 (0.55) | 92 | 0.90 (0.65) | 96 | 0.95 (0.84) | 99 |
| Group IIIc: Osteoarthrosis | 14 | 0.59 (0.11) | 88 | 0.53 (−0.01) | 90 | 0.96 (0.79) | 99 |
| Average PA | NA | NA | 93.5 | NA | 94.4 | NA | 98.9 |
| Absolute error | NA | NA | < 7% | NA | < 6% | NA | < 2% |
With multiple diagnoses present in some participants, the percent of study participants with any given diagnosis is indicated in the second column. CE = criterion examiner; PA = the computation of percent agreement shown in columns 4, 6 and 8; Absolute error is the complement of percent agreement (100 - PA); MPD = myofascial pain disorder; DD = disc displacement. (…) = Lower 95% confidence interval for the kappa estimate. All upper confidence intervals were ≥ 0.994.