Table 3:
Multi-model safety evaluation on OCA-ClinHarm B200 with escalation-handoff enabled. Deploy violation rate (VRa) with Wilson 95% CI and verdict distribution for N=200 scenarios per model per configuration.
| Model | Config | Deploy VR (%) [95% CI] | Allow (%) | Block (%) | Escalate (%) | Strict VR (%) [95% CI] |
|---|---|---|---|---|---|---|
| Qwen 7B | C0 | 65.0 [58.2, 71.3] | 100.0 | 0.0 | 0.0 | 65.0 [58.2, 71.3] |
| Qwen 7B | C1 | 3.0 [1.4, 6.4] | 19.0 | 81.0 | 0.0 | 82.0 [76.1, 86.7] |
| Qwen 7B | C2 | 3.0 [1.4, 6.4] | 21.5 | 30.0 | 48.5 | 79.5 [73.4, 84.5] |
| Qwen 7B | C2+SRP | 2.5 [1.1, 5.7] | 51.5 | 30.0 | 18.5 | 49.5 [42.6, 56.4] |
| Llama 8B | C0 | 62.5 [55.6, 68.9] | 100.0 | 0.0 | 0.0 | 62.5 [55.6, 68.9] |
| Llama 8B | C1 | 1.5 [0.5, 4.3] | 55.0 | 45.0 | 0.0 | 45.5 [38.7, 52.4] |
| Llama 8B | C2 | 1.0 [0.3, 3.6] | 65.5 | 34.5 | 0.0 | 34.5 [28.3, 41.3] |
| Llama 8B | C2+SRP | 1.0 [0.3, 3.6] | 65.0 | 34.5 | 0.5 | 35.0 [28.7, 41.8] |
| Meditron 7B | C0 | 24.0 [18.6, 30.4] | 100.0 | 0.0 | 0.0 | 24.0 [18.6, 30.4] |
| Meditron 7B | C1 | 4.0 [2.0, 7.7] | 78.0 | 22.0 | 0.0 | 24.0 [18.6, 30.4] |
| Meditron 7B | C2 | 3.0 [1.4, 6.4] | 88.5 | 0.0 | 11.5 | 13.0 [9.0, 18.4] |
| Meditron 7B | C2+SRP | 3.5 [1.7, 7.0] | 81.0 | 0.0 | 19.0 | 20.5 [15.5, 26.6] |
| Sonnet 4.5 | C0 | 11.0 [7.4, 16.1] | 100.0 | 0.0 | 0.0 | 11.0 [7.4, 16.1] |
| Sonnet 4.5 | C1 | 0.5 [0.1, 2.8] | 89.5 | 10.5 | 0.0 | 10.5 [7.0, 15.5] |
| Sonnet 4.5 | C2 | 0.0 [0.0, 1.9] | 99.5 | 0.0 | 0.5 | 0.5 [0.1, 2.8] |
| Sonnet 4.5 | C2+SRP | 0.0 [0.0, 1.9] | 98.5 | 0.0 | 1.5 | 1.5 [0.5, 4.3] |
| Gemma 4 E4B | C0 | 6.5 [3.8, 10.8] | 100.0 | 0.0 | 0.0 | 6.5 [3.8, 10.8] |
| Gemma 4 E4B | C1 | 0.0 [0.0, 1.9] | 88.5 | 11.5 | 0.0 | 12.5 [8.6, 17.8] |
| Gemma 4 E4B | C2 | 1.0 [0.3, 3.6] | 99.0 | 0.0 | 1.0 | 2.0 [0.8, 5.0] |
| Gemma 4 E4B | C2+SRP | 1.0 [0.3, 3.6] | 99.5 | 0.0 | 0.5 | 1.5 [0.5, 4.3] |
VR = deploy violation rate (violations reaching the user); Strict VR also counts blocked/escalated cases. Wilson 95% CIs for N=200.