Table 3. Agreement between measurements and categorical judgments*.
All videos | Categorical | Video 3 (22/min) |
Categorical | ||||||||
Low | Normal | High | Low | Normal | High | ||||||
Continuous | <12 | 29 | 21 | 1 | Continuous | <12 | 0 | 2 | 0 | ||
12–20 | 40 | 617 | 194 | 12–20 | 1 | 20 | 24 | ||||
>20 | 4 | 64 | 1270 | >20 | 0 | 21 | 380 | ||||
Inconsistent answers: n = 324 (14.5%) Consistent answers: n = 1916 (85.5%) Cohen’s Kappa: 0.71 |
Inconsistent answers: n = 48 (10.7%) Consistent answers: n = 400 (89.3%) Cohen’s Kappa: 0.42 |
||||||||||
Video 1 (28/min) |
Categorical | Video 4 (19/min) |
Categorical | ||||||||
Low | Normal | High | Low | Normal | High | ||||||
Continuous | <12 | 0 | 0 | 0 | Continuous | <12 | 1 | 1 | 1 | ||
12–20 | 0 | 7 | 22 | 12–20 | 1 | 250 | 126 | ||||
>20 | 2 | 6 | 411 | >20 | 0 | 15 | 53 | ||||
Inconsistent answers: n = 30 (6.7%) Consistent answers: n = 418 (93.3%) Cohen’s Kappa: 0.29 |
Inconsistent answers: n = 144 (32.1%) Consistent answers: n = 304 (67.9%) Cohen’s Kappa: 0.27 |
||||||||||
Video 2 (13/min) |
Categorical | Video 5 (25/min) |
Categorical | ||||||||
Low | Normal | High | Low | Normal | High | ||||||
Continuous | <12 | 27 | 18 | 0 | Continuous | <12 | 1 | 0 | 0 | ||
12–20 | 38 | 327 | 11 | 12–20 | 0 | 13 | 11 | ||||
>20 | 2 | 15 | 10 | >20 | 0 | 7 | 416 | ||||
Inconsistent answers: n = 84 (18.8%) Consistent answers: n = 364 (81.3%) Cohen’s Kappa: 0.39 |
Inconsistent answers: n = 18 (4.0%) Consistent answers: n = 430 (96.0%) Cohen’s Kappa: 0.59 |
* Respondents’ measurements are compared with their categorical judgments. Inconsistencies (e.g. a respondent measured a “normal” respiratory rate (12 through 20/min), and incorrectly judged this to be “high”) are presented in red. Consistent answers are presented in green.