Table 6:
F1-scores (in percentages) for activities and activity stages using the context-aware model with three designs (last three columns). Boldfaced numbers highlight significantly improved performance compared to the context-independent model (first column).
| Model Configuration | Context-independent | RNN | Attention | Context-aware |
|---|---|---|---|---|
| Weigted F1-scores for All Activities | 66.7±0.9 | 70.9±1.0 | 71.1±1.0 | 71.5±1.2 |
| No activity performed (None) | 67.8±2.5 | 70.0±2.0 | 69.5±2.5 | 70.0±2.6 |
| Head, eye, ear, nose, throat assessment (HEENT) | 71.1±3.6 | 76.1±2.9 | 75.3±2.7 | 76.2±3.1 |
| Pre-arrival activities (PR) | 56.0±3.8 | 65.4±3.1 | 67.5±4.1 | 68.6±3.5 |
| Extremity examination (E) | 66.1±5.4 | 76.1±3.0 | 75.1±3.7 | 75.9±2.8 |
| Medications (MEDS) | 71.6±4.7 | 72.7±5.7 | 74.9±4.5 | 74.5±6.7 |
| Back examination (BK) | 51.9±2.3 | 71.3±4.1 | 70.1±4.2 | 71.4±3.6 |
| Adjunctive procedures (ADJ) | 68.4±2.6 | 70.7±2.9 | 69.7±4.3 | 70.5±3.1 |
| Glasgow coma scale (GCS) evaluation (GCS) | 66.8±2.3 | 72.3±2.9 | 71.5±2.7 | 72.6±2.5 |
| Intravenous (IV) catheter placement (IVPLAC) | 69.6±4.3 | 74.5±3.4 | 74.4±2.7 | 74.6±2.6 |
| Blood pressure and vital sign measurment (BP) | 75.7±3.6 | 76.8±3.2 | 76.8±3.4 | 77.8±2.8 |
| Cervical collar activities (CS) | 60.3±4.7 | 63.6±5.7 | 62.9±3.7 | 63.5±3.7 |
| Log roll of patient (LOG) | 69.8±5.4 | 76.3±4.3 | 76.5±4.0 | 76.4±4.0 |
| Circulatory status assessment (CC) | 75.5±4.3 | 76.0±3.3 | 76.5±3.1 | 76.1±3.5 |
| Temperature managmenet (exposure control) (EC) | 74.7±1.5 | 77.3±2.6 | 77.3±0.7 | 77.4±1.0 |
| Airway management (AM) | 53.3±5.4 | 57.4±7.7 | 57.9±6.9 | 57.9±7.5 |
| Summary of reports (SUM) | 44.2±4.7 | 46.6±6.4 | 49.0±8.3 | 50.5±5.5 |
| Airway assessment (AA) | 77.7±3.6 | 77.7±4.0 | 78.2±3.6 | 77.7±4.3 |
| Respiratory assessment (breathing assessment) (BA) | 67.1±4.1 | 68.9±3.5 | 66.3±3.0 | 70.0±4.1 |
| Abdomen examination (A) | 66.6±5.9 | 71.8±7.4 | 73.1±3.5 | 73.6±5.0 |
| Chest palpation (CP) | 71.9±5.3 | 72.2±6.1 | 74.4±2.9 | 73.9±5.4 |
| Cardiopulmonary resuscitation-related activities (CPR) | 58.2±2.2 | 61.0±4.3 | 61.3±2.5 | 62.2±1.9 |
| Pelvic examintation (PE) | 67.1±3.2 | 71.4±3.8 | 71.2±2.6 | 71.8±3.0 |
| Respiratory support (breathing control) (BC) | 48.7±6.8 | 49.9±6.1 | 50.0±6.4 | 50.1±6.6 |
| Weigted Fŝcores for All Activity Stages | 76.3±1.2 | 77.6±1.2 | 77.5±1.0 | 77.6±1.0 |
| Before | 68.9±2.3 | 69.2±2.3 | 69.4±2.2 | 69.2±2.1 |
| During | 77.5±2.5 | 81.7±3.0 | 81.4±2.7 | 81.8±2.9 |
| After | 80.6±2.2 | 81.7±2.1 | 81.6±2.0 | 81.7±2.0 |
| Other | 73.9±2.0 | 75.6±1.5 | 75.5±1.5 | 75.8±1.6 |