Table 4.

Category-specific and overall inter-rater reliability coefficients, sensitivity and specificity

	Percentage agreement		Kappa		Sensitivity§	Specificity§
Category (number of items)	Category %	% range across items	Category κ (95% CI)	κ range across items	Estimate (95% CI)	Estimate (95% CI)
1. Physical assessment (8)	95	79–100	0.88 (0.87–0.90)	0.00–1.00	0.95 (0.92–0.97)	0.95 (0.91–0.98)
2. Asthma control (7)	84	76–93	0.68 (0.65–0.70)	0.05–0.71	0.89 (0.84–0.92)	0.85 (0.80–0.88)
3. Spirometry (6)	100	100	nc	nc	nc	0.99 (0.98–1.00)
4. Asthma education (8)	76	54–95	0.49 (0.46–0.52)	0.04–0.67	0.87 (0.80–0.92)	0.77 (0.73–0.81)
5. Asthma referrals (3)	90	88–93	0.77 (0.73–0.81)	0.02–0.84	0.88 (0.77–0.95)	0.95 (0.90–0.98)
6. Medications (1)	90	90	nc	nc	nc	0.94 (0.85–0.98)
Overall	88		0.75* (0.75–0.77)		0.91 (0.89–0.93)	0.89 (0.88–0.91)

* Chi-square test statistic for homogeneity = 737, df = 4, p < 0.0001

§ Sensitivity and specificity are calculated to compare assessments of all raters against the gold standard.

Abbreviations: κ kappa statistic, CI confidence interval, nc not calculable