Table 10:
Multisite 70B evaluation on N=2935 encounter-derived scenarios from three hospital sites (Emory, Grady, Colorado) under both handoff-on and handoff-off protocols. Under handoff-on, all supervised configurations reach 0.0% deploy VR. Under handoff-off, C2 achieves the lowest autonomous VR (2.4%), slightly above Gemma 4 and Sonnet 4.5 on the N=200 matrix but far below the 8B-tier models.
| Handoff-on | Handoff-off | |||||
|---|---|---|---|---|---|---|
| Config | Deploy VR | Allow | Strict VR | Deploy VR [95% CI] | Allow | Δ (pp) |
| C0 (baseline) | 24.9% | 100% | 24.9% | 24.9 [23.4, 26.5] | 100.0% | 0.0 |
| C1 (detect-block) | 0.0% | 91.3% | 8.7% | 8.7 [7.7, 9.8] | 91.3% | +8.7 |
| C2 (detect-repair) | 0.0% | 98.0% | 2.0% | 2.4 [1.9, 3.0] | 97.6% | +2.4 |
| C2+SRP | 0.0% | 96.0% | 4.0% | 4.1 [3.4, 4.9] | 95.9% | +4.1 |
Δ = VRhandoff-off − VRhandoff-on in percentage points. Wilson 95% CIs for handoff-off VR.