Table 8:
Slack in the upper-bound preserves modeling ordering with respect to exact d-calibration
| λ | Batch Size | Exact D-Cal | Upper-bound |
|---|---|---|---|
| 0 | 500 | 0.05883 | 0.0605 |
| 10000 | ” | 0.0589 | |
| 1 | 500 | 0.02204 | 0.0238 |
| 10000 | ” | 0.0221 | |
| 5 | 500 | 0.00963 | 0.0114 |
| 10000 | ” | 0.0097 | |
| 10 | 500 | 0.00482 | 0.0066 |
| 10000 | ” | 0.0048 | |
| 50 | 500 | 0.00040 | 0.0021 |
| 10000 | ” | 0.0004 | |
| 100 | 500 | 0.00022 | 0.0021 |
| 10000 | ” | 0.0003 | |
| 500 | 500 | 0.00015 | 0.0020 |
| 10000 | ” | 0.0002 | |
| 1000 | 500 | 0.00006 | 0.0019 |
| 10000 | ” | 0.0001 | |