Table 3.

Case severity: domain and problem intra-assessor and interassessor reliability (n=4) using 134 healthcare claim letters

HCAT problem categories	Intrareliability			Inter-reliability
	Agreement	Gwet’s AC1	95% CI	Agreement	Gwet’s AC	95% CI
Clinical problems	0.94	0.86	0.80 to 0.92	0.87	0.75	0.68 to 0.82
Quality	0.78	0.38	0.21 to 0.55	0.74	0.48	0.37 to 0.59
Safety	0.92	0.83	0.77 to 0.90	0.86	0.71	0.63 to 0.78
Management problems	0.99	0.99	0.99 to 1.00	0.98	0.97	0.96 to 0.98
Environment	1.00	1.00	1.00 to 1.00	0.96	0.96	0.93 to 0.98
Institutional processes	0.96	0.96	0.93 to 0.99	0.87	0.82	0.77 to 0.88
Relationship problems	0.99	0.99	0.98 to 1.00	0.98	0.97	0.96 to 0.98
Listening	0.97	0.97	0.95 to 0.99	0.92	0.89	0.85 to 0.93
Communication	0.99	0.99	0.98 to 1.00	0.97	0.96	0.94 to 0.98
Respect and patients’ rights	1.00	1.00	0.99 to 1.00	0.99	0.99	0.98 to 1.00

HCAT, Healthcare Complaints Analysis Tool.