Table 2:
TOS | KOD | Setting | Role | SMD | |
---|---|---|---|---|---|
A. Rating (FHS=no shading; FAHC=grey shading) | |||||
Adequate | 54% | 99% | 68% | 4% | 50% |
93% | 100% | 68% | - | 92% | |
Too Broad | 33% | - | 2% | 1% | 21% |
3% | - | <1% | - | 6% | |
Too Specific | 1% | - | - | - | - |
1% | - | 5% | - | - | |
Not Covered | 2% | <1% | <1% | <1% | 7% |
- | - | - | <1% | ||
Not Specified | 10% | <1% | 29% | 95% | 21% |
3% | - | 27% | 100% | 3% | |
B. Inter-Rater Reliability | |||||
Proportion Agreement | 92% | 100% | 90% | 90% | 100% |
100% | 100% | 94% | N/A | 98% | |
Cohen’s Kappa | 0.95 | 1.00 | 0.84 | 1.00 | 0.82 |
1.00 | 1.00 | 0.88 | N/A | 0.91 | |
C. Coverage of DO Values | |||||
FHS | 28% | 21% | 28% | 30% | 42% |
FAHC | 10% | 11% | 33% | - | 35% |
LOINC | 71% | 11% | 50%* | 22%* | 34% |
TOS=Type of Service, KOD=Kind of Document, SMD=Subject Matter Domain,
*=excludes unspecified Setting and Role values