TABLE 2.
Factors associated with agreement with the reference standard assessment of checklist items.
| Factor | Unadjusted percent agreement with reference standard | Adjusted P Value from GLMM model |
|---|---|---|
| Scenario type | < 0.0001 | |
| Anaphylaxis | 87.9 | |
| Hyperkalemia | 84.9 | |
| LAST | 84.6 | |
| SVT | 87.5 | |
| Categories of items | < 0.0001 | |
| General assessment | 82.2 | |
| Crisis management | 86.3 | |
| ROSC management | 81.7 | |
| Management errors | 91.1 | |
| Perioperative events | ||
| Anaphylactic-specific management | 92.3 | |
| Hyperkalemia-specific management | 87.1 | |
| LAST-specific management | 85.4 | |
| SVT-specific management | 95.8 | |
| PALS | ||
| PEA management | 80.5 | |
| Asystole management | 75.2 | |
| VFib management | 88.2 | |
| VTach management | 88.6 | |
| Scoring method | ||
| Pauses allowed | 86.4 | 0.53 |
| Pauses not allowed | 85.9 | |
| Performance of team | ||
| Good performance | 91.6 | < 0.0001 |
| Poor performance | 80.7 | |
| Actions | ||
| Correct action | 84.0 | < 0.0001 |
| Incorrect action | 90.2 | |
| Action performed (as assessed by reference standard) | 86.2 | < 0.0001 |
| Action not performed (as assessed by reference standard) | 86.1 | |
| Raters | < 0.0001 | |
| Rater 1 | 83.5 | |
| Rater 2 | 88.7 | |
| Rater 3 | 86.9 | |
| Rater 4 | 85.6 |
GLMM, generalized linear mixed models; LAST, local anesthetic systemic toxicity; SVT, supraventricular tachycardia; ROSC, return of spontaneous circulation; PALS, pediatric advanced life support; PEA, pulseless electrical activity; VFib, ventricular fibrillation; VTach, ventricular tachycardia.