Table 6.
Results on TerraInc-MLT.
| Algorithm | F1-Score (by domain) | Accuracy (by domain) | Accuracy (by shot) | |||||
|---|---|---|---|---|---|---|---|---|
| Average | Worst | Average | Worst | Many | Medium | Few | Zero | |
| IRM | 0.486 | 0.421 | 0.586 | 0.530 | 0.752 | 0.237 | 0.183 | 0.073 |
| DANN | 0.434 | 0.379 | 0.527 | 0.464 | 0.646 | 0.275 | 0.133 | 0.227 |
| CDANN | 0.367 | 0.326 | 0.472 | 0.414 | 0.616 | 0.037 | 0.217 | 0.086 |
| CORAL | 0.682 | 0.587 | 0.776 | 0.685 | 0.872 | 0.738 | 0.717 | 0.136 |
| MMD | 0.698 | 0.562 | 0.792 | 0.696 | 0.878 | 0.875 | 0.750 | 0.156 |
| Focal | 0.672 | 0.587 | 0.778 | 0.707 | 0.870 | 0.863 | 0.667 | 0.073 |
| CBLoss | 0.696 | 0.559 | 0.776 | 0.657 | 0.852 | 0.812 | 0.750 | 0.254 |
| LDAM | 0.690 | 0.583 | 0.786 | 0.680 | 0.880 | 0.800 | 0.700 | 0.131 |
| Bsoftmax | 0.761 | 0.687 | 0.823 | 0.762 | 0.862 | 0.913 | 0.933 | 0.343 |
| CRT (2-stage training) | 0.737 | 0.622 | 0.841 | 0.724 | 0.910 | 0.950 | 0.900 | 0.122 |
| BoDA | 0.695 | 0.597 | 0.792 | 0.696 | 0.888 | 0.762 | 0.767 | 0.104 |
| BoDA (2-stage training) | 0.729 | 0.626 | 0.824 | 0.735 | 0.892 | 0.887 | 0.900 | 0.151 |
| ERM | 0.675 | 0.593 | 0.778 | 0.696 | 0.884 | 0.800 | 0.600 | 0.098 |
| GroupDRO | 0.602 | 0.551 | 0.705 | 0.596 | 0.820 | 0.700 | 0.367 | 0.104 |
| Mixup | 0.656 | 0.561 | 0.737 | 0.669 | 0.860 | 0.650 | 0.500 | 0.167 |
| SagNet | 0.682 | 0.586 | 0.780 | 0.707 | 0.888 | 0.775 | 0.533 | 0.135 |
| MLDG | 0.687 | 0.567 | 0.790 | 0.680 | 0.886 | 0.800 | 0.733 | 0.089 |
| MTL | 0.674 | 0.583 | 0.780 | 0.696 | 0.880 | 0.775 | 0.700 | 0.080 |
| Fish | 0.691 | 0.583 | 0.802 | 0.696 | 0.888 | 0.863 | 0.800 | 0.064 |
| BRL (ours) | 0.780 | 0.712 | 0.824 | 0.768 | 0.872 | 0.862 | 0.817 | 0.430 |
| BRL (2-stage training) | 0.802 | 0.713 | 0.849 | 0.773 | 0.892 | 0.913 | 0.900 | 0.423 |