Table 7.
Method | GFLOPs | Time (ms) |
---|---|---|
DeiT-S + Tr. Dec. | 4.9 | 142 |
DeiT-M + Tr. Dec. | 8.5 | 146 |
DeiT-B + Tr. Dec. | 18.7 | 183 |
CaiT-S + Tr. Dec. | 9.6 | 164 |
DeiT-S + FA | 4.6 | 17 |
DeiT-M + FA | 8.0 | 17 |
DeiT-B + FA | 17.5 | 20 |
CaiT-S + FA | 9.4 | 38 |
DeiT-S + M (Ours) | 4.6 | 14 |
DeiT-M + M (Ours) | 8.0 | 14 |
DeiT-B + M (Ours) | 17.5 | 15 |
CaiT-S + M (Ours) | 9.4 | 36 |