Table 1:
Inter-rater agreement and Kappa values
| Qualitative variables | Tele-dental Examiner Vs Tele-dental Reviewer | Tele-dental Examiner Vs ED Provider | Tele-dental Reviewer Vs ED Provider | |||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Observed Agreement | Kappa | PABAK | Observed Agreement | Sensitivity Value | Specificity Value | Observed Agreement | Sensitivity Value | Specificity Value | ||
| Presence of a Dental (or an Oral) condition (TD-GS) | 100% | * | 1.00 | 92% | 92% | 0% | 92% | 92% | 0% | |
| Presence of a Medical condition (ED-GS) | 83% | 0.43 | 0.67 | 100% | 100% | 100% | 83% | 33% | 100% | |
| Tooth # (TD-GS) | 100% | 1.00 | 1.00 | 17% | 9% | 100% | 18% | 10% | 100% | |
| Soft tissue involvement (TD-GS) | 100% | 1.00 | 1.00 | 42% | 13% | 100% | 45% | 14% | 100% | |
| Hard tissue involvement (TD-GS) | 100% | 1.00 | 1.00 | 42% | 40% | 50% | 45% | 44% | 50% | |
| Presence of a Dental Infection (TD-GS) | 83% | 0.43 | 0.67 | 92% | 90% | 100% | 82% | 80% | 100% | |
| Definitive Dental Diagnosis (TD-GS) | 91% | ** | ** | 39% | ** | ** | 33% | ** | ** | |
| Seeing a Dentist (TD-GS) | 100% | * | 1.00 | 92% | 92% | 0% | 91% | 91% | 0% | |
| Seeing Medical Specialist/Physician (ED-GS) | 83% | 0.43 | 0.67 | 100% | 100% | 100% | 83% | 33% | 100% | |
| Antibiotic Rx (TD-GS) | 58% | -0.15 | 0.17 | 92% | 92% | 0% | 73% | 100% | 25% | |
| Narcotics Rx (TD-GS) | 83% | 0.64 | 0.67 | 75% | 67% | 78% | 64% | 40% | 83% | |
| Treatment at the ED (ED-GS) | 100% | 1.00 | 1.00 | 92% | 100% | 91% | 100% | 100% | 100% | |
| Antibiotic Administration at the ED (ED-GS) | 100% | 1.00 | 1.00 | 100% | 100% | 100% | 100% | 100% | 100% | |
| Rx Pain medication Administration at the ED (ED-GS) | 100% | * | 1.00 | 92% | 0% | 100% | 91% | 0% | 100% | |
| Discharge (ED-GS) | 100% | * | 1.00 | 100% | 100% | 0% | 100% | 100% | 0% | |
| TeleDentist Gold Standard (TD-GS) |
Mean | 91% | 0.65 | 0.83 | 65% | 55% | 59% | 60% | 52% | 62% |
| Standard Deviation | 14 | 0.46 | 0.30 | 33 | 36 | 47 | 30 | 36 | 44 | |
| ED provider Gold Standard (ED-GS) |
Mean | 94% | 0.71 | 0.89 | 97% | 83% | 82% | 93% | 61% | 83% |
| Standard Deviation | 9 | 0.33 | 0.17 | 4 | 41 | 40 | 8 | 44 | 41 | |
| Total | Mean | 93% | 0.68 | 0.85 | ||||||
| Standard Deviation | 12 | 0.39 | 0.25 | |||||||
*
Unable to calculate Kappa (due to kappa limitation)
**
Unable to calculate Kappa, PABAK, the Sensitivity and the Specificity (too many variables)
Sensitivity was defined as: The ability to accurately detect presence/describe/recommend a qualitative variable
Specificity was defined as: The ability to accurately exclude presence/not recommend a qualitative variable