Table 3. Number of mistaken models on the Pistachio test set. Number of times each model belongs to a given error-overlap class.
| Mistaken models | ALBERT orig. | ALBERT repr. | ALBERT pistachio | LocalMapper | Error set |
|---|---|---|---|---|---|
| 1 | 284 | 139 | 127 | 1′090 | 1′640 |
| 2 | 433 | 291 | 279 | 409 | 706 |
| 3 | 525 | 513 | 439 | 368 | 615 |
| 4 | 824 | 824 | 824 | 824 | 824 |
| Total | 2′066 | 1′767 | 1′669 | 2′691 | 3′785 |