Table 4.
Subcategory intra-assessor and interassessor reliability (n=4) using 134 healthcare claim letters
| Intrareliability | Inter-reliability | |||||
| Agreement | Gwet’s AC | 95% CI | Agreement | Gwet’s AC | 95% CI | |
| Quality | ||||||
| Neglect—hygiene and personal care | No ratings | No ratings | ||||
| Neglect—nourishment and hydration | No ratings | No ratings | ||||
| Neglect—general | 0.75 | 0.66 | 0.54 to 0.78 | 0.84 | 0.81 | 0.75 to 0.87 |
| Rough handling and discomfort | 0.99 | 0.99 | 0.98 to 1.00 | 0.99 | 0.99 | 0.97 to 1.00 |
| Examination and monitoring | 0.85 | 0.74 | 0.63 to 0.85 | 0.69 | 0.41 | 0.30 to 0.51 |
| Making and following care plans | 0.99 | 0.98 | 0.96 to 1.00 | 0.98 | 0.98 | 0.96 to 1.00 |
| Outcomes and side effects | 0.45 | −0.08 | −0.26 to 0.09 | 0.59 | 0.33 | 0.22 to 0.43 |
| Other | No ratings | 1.00 | 1.00 | 0.99 to 1.00 | ||
| Safety | ||||||
| Error—diagnosis | 0.83 | 0.67 | 0.54 to 0.80 | 0.76 | 0.53 | 0.44 to 0.63 |
| Error—medication | 0.99 | 0.99 | 0.98 to 1.00 | 0.99 | 0.99 | 0.97 to 1.00 |
| Error—general | 0.85 | 0.82 | 0.73 to 0.90 | 0.74 | 0.63 | 0.54 to 0.72 |
| Failure to respond | No ratings | No ratings | ||||
| Clinician skills | 0.88 | 0.84 | 0.76 to 0.92 | 0.86 | 0.83 | 0.77 to 0.89 |
| Teamwork | 0.98 | 0.98 | 0.95 to 1.00 | 0.98 | 0.98 | 0.95 to 1.00 |
| Other | No ratings | 0.97 | 0.97 | 0.95 to 0.99 | ||
| Environment | ||||||
| Accommodation | 0.99 | 0.99 | 0.98 to 1.00 | 1.00 | 1.00 | 0.99 to 1.00 |
| Preparedness | No ratings | No ratings | ||||
| Ward cleanliness | No ratings | No ratings | ||||
| Equipment | 1.00 | 1.00 | 1.00 to 1.00 | 0.98 | 0.98 | 0.97 to 1.00 |
| Staffing | No ratings | 0.95 | 0.95 | 0.92 to 0.98 | ||
| Security | No ratings | No ratings | ||||
| Other | No ratings | 1.00 | 1.00 | 0.99 to 1.00 | ||
| Institutional p rocesses | ||||||
| Delay—access | 0.96 | 0.96 | 0.93 to 1.00 | 0.90 | 0.88 | 0.84 to 0.93 |
| Delay—procedure | 0.94 | 0.94 | 0.89 to 0.98 | 0.87 | 0.85 | 0.80 to 0.90 |
| Delay—general | 0.99 | 0.99 | 0.98 to 1.00 | 0.98 | 0.98 | 0.96 to 1.00 |
| Bureaucracy | 0.99 | 0.98 | 0.96 to 1.00 | 0.96 | 0.95 | 0.93 to 0.98 |
| Visiting | No ratings | 0.99 | 0.99 | 0.98 to 1.00 | ||
| Documentation | 0.99 | 0.98 | 0.96 to 1.00 | 0.99 | 0.99 | 0.98 to 1.00 |
| Other | No ratings | 0.99 | 0.99 | 0.98 to 1.00 | ||
| Listening | ||||||
| Ignoring patients | 0.95 | 0.94 | 0.90 to 0.99 | 0.90 | 0.89 | 0.85 to 0.94 |
| Dismissing patients | 0.92 | 0.91 | 0.85 to 0.97 | 0.88 | 0.86 | 0.80 to 0.92 |
| Token listening | No ratings | 0.99 | 0.99 | 0.98 to 1.00 | ||
| Other | No ratings | No ratings | ||||
| Communication | ||||||
| Delayed communication | 1.00 | 1.00 | 1.00 to 1.00 | 0.99 | 0.99 | 0.98 to 1.00 |
| Incorrect communication | No ratings | 0.95 | 0.95 | 0.92 to 0.98 | ||
| Absent communication | 0.98 | 0.98 | 0.95 to 1.00 | 0.96 | 0.95 | 0.92 to 0.98 |
| Other | No ratings | No ratings | ||||
| Respect and patient rights | ||||||
| Disrespect | 0.97 | 0.97 | 0.94 to 1.00 | 0.97 | 0.97 | 0.95 to 0.99 |
| Confidentiality | No ratings | No ratings | ||||
| Rights | No ratings | 0.99 | 0.99 | 0.98 to 1.00 | ||
| Consent | No ratings | No ratings | ||||
| Privacy | No ratings | No ratings | ||||
| Other | No ratings | No ratings | ||||