Table 3.
Impact of 70% missingness on multimodality information for UR-FUNNY (Hasan et al., 2019) and Hateful Memes (Kiela et al., 2020). Parentheses denote standard deviation across batches.
| AUROC | Information Decomposition | |||||||
|---|---|---|---|---|---|---|---|---|
| Text | Image/Video | Image + Text | Uniquetext | Uniqueimage | Shared | Complementary | ||
| UR-FU. | Oracle | 0.68 (0.01) | 0.60 (0.02) | 0.69 (0.02) | 0.10 (0.00) | 0.02 (0.00) | 0.00 (0.00) | 0.00 (0.00) |
| Observed | 0.61 (0.03) | 0.54 (0.04) | 0.63 (0.03) | 0.05 (0.00) | 0.00 (0.00) | 0.03 (0.00) | 0.00 (0.00) | |
| ICYM2I | 0.66 (0.03) | 0.57 (0.04) | 0.62 (0.04) | 0.07 (0.00) | 0.00 (0.00) | 0.00 (0.00) | 0.00 (0.00) | |
| Memes | Oracle | 0.71 (0.01) | 0.57 (0.01) | 0.72 (0.01) | 0.09 (0.01) | 0.00 (0.00) | 0.04 (0.00) | 0.05 (0.01) |
| Observed | 0.68 (0.02) | 0.61 (0.02) | 0.71 (0.02) | 0.13 (0.00) | 0.04 (0.00) | 0.01 (0.00) | 0.00 (0.00) | |
| ICYM2I | 0.67 (0.02) | 0.61 (0.02) | 0.71 (0.02) | 0.10 (0.00) | 0.01 (0.00) | 0.02 (0.03) | 0.03 (0.01) | |