Table 3.
Inter-rater reliability
Fleiss’ kappa (95% CI) | Weighted Kappa (95% CI) | |||||||
---|---|---|---|---|---|---|---|---|
Overall | MD vs Nurse | MD vs RT | Nurse vs RT | |||||
Before treatment (overall p = 0.3957 |
After treatme nt (overall p = 0.8143) |
Before treatment (overall p = 0.9115) |
After treatment (overall p = 0.6976) |
Before treatment (overall p = 0.6106) |
After treatment (overall p = 0.1016) |
Before treatment (overall p = 0.7904) |
After treatment (overall p =) 0.4649 |
|
PRA M | 0.3452 (0.2291, 0.4613) | 0.4026 (0.2657, 0.5394) | 0.5507 (0.4084, 0.6931) | 0.5155 (0.3532, 0.6778) | 0.4060 (0.2241, 0.5879) | 0.4511 (0.2712, 0.6310) | 0.3538 (0.1771, 0.5305) | 0.4807 (0.2713, 0.6901) |
PI | 0.3451 (0.2146, 0.4756) | 0.3976 (0.2545, 0.5407) | 0.5391 (0.3834, 0.6949) | 0.4279 (0.1854, 0.6704) | 0.3487 (0.1908, 0.5066) | 0.5046 (0.3150, 0.6942) | 0.4300 (0.2655, 0.5945) | 0.4500 (0.2363, 0.6637) |
PASS | 0.4157 (0.2808, 0.5507) | 0.4523 (0.2381, 0.6664) | 0.5023 (0.294, 0.7106) | 0.3632 (−0.0288, 0.7551) | 0.2956 (0.1004, 0.4908) | 0.2757 (0.0088, 0.5425) | 0.3681 (0.1384, 0.5978) | 0.5941 (0.2867, 0.9015) |
Including CAS and AAIRS | Including CAS and AAIRS | Including CAS and AAIRS | Including CAS and AAIRS | |||||
(overall p = 0.6074) | (overall p = 0.1505) | (overall p = 0.9923) | (overall p = 0.4945) | (overall p = 0.6192) | (overall p = 0.2173) | (overall p = 0.9570) | (overall p = 0.3781) | |
CAS | 0.3355 (0.2020, 0.4691) | 0.2604 (0.1284, 0.3924) | 0.5168 (0.3531, 0.6806) | 0.2551 (0.0461, 0.4640) | 0.4459 (0.2444, 0.6474) | 0.3850 (0.2153, 0.5546) | 0.3991 (0.2172, 0.5809) | 0.3733 (0.1575, 0.5892) |
AAIRS | 0.3885 (0.2694, 0.5077) | 0.3356 (0.2055, 0.4658) | 0.5359 (0.3591, 0.7127) | 0.4358 (0.2419, 0.6297) | 0.4123 (0.2184, 0.6063) | 0.4654 (0.2476, 0.6831) | 0.4234 (0.2237, 0.6231) | 0.5143 (0.3451, 0.6836) |
PRAM = Pediatric Respiratory Assessment Measure; AAIRS = Acute Asthma Intensity Research Score; PASS = Pediatric Asthma Severity Score, PI = Pulmonary Index (PI); CAS = Clinical Asthma Score