Table 8:
C2 repair attempts and conversion ratesa across models on the N=200 datasets.
| Model | Dataset | Repairs | Conv.a (%) [95% CI] | Verdictsb | Deploy VR (%) [95% CI] |
|---|---|---|---|---|---|
| Qwen 7B | B200 | 103 | 4.9 [2.1, 10.9] | 43A/60B/97E | 3.0 [1.4, 6.4] |
| Qwen 7B | MIMICEXT200 | 64 | 9.4 [4.4, 19.0] | 78A/64B/58E | 3.5 [1.7, 7.0] |
| Llama 8B | B200 | 22 | 95.5 [78.3, 99.2] | 131A/69B/0E | 1.0 [0.3, 3.6] |
| Llama 8B | MIMICEXT200 | 16 | 75.0 [50.5, 89.8] | 130A/70B/0E | 1.0 [0.3, 3.6] |
| Meditron 7B | B200 | 48 | 43.8 [30.7, 57.8] | 177A/0B/23E | 3.0 [1.4, 6.4] |
| Meditron 7B | MIMICEXT200 | 39 | 17.9 [8.9, 32.6] | 168A/0B/32E | 0.0 [0.0, 1.9] |
| Sonnet 4.5 | B200 | 22 | 95.5 [78.2, 99.2] | 199A/0B/1E | 0.0 [0.0, 1.9] |
| Sonnet 4.5 | MIMICEXT200 | 17 | 82.4 [59.0, 93.8] | 197A/0B/3E | 0.0 [0.0, 1.9] |
| Gemma 4 E4B | B200 | 24 | 87.5 [69.0, 95.7] | 198A/0B/2E | 1.0 [0.3, 3.6] |
| Gemma 4 E4B | MIMICEXT200 | 8 | 87.5 [52.9, 97.8] | 199A/0B/1E | 0.0 [0.0, 1.9] |
Conv. = conversion rate; fraction of repair attempts yielding a safe response. Wilson 95% CIs computed on the repair count n per cell.
A = allow, B = block, E = escalate.