Table 3.
Scores of attention mechanisms based on the evaluations above.
| Ref. | Attention model | BLEU-4 | METEOR | ROUGE-L | CIDEr |
|---|---|---|---|---|---|
| [69] | Soft attention | 24.3 | 23.9 | — | — |
| [69] | Hard attention | 25.0 | 23.0 | 51.6 | 86.5 |
| [70] | Multihead/scaled dot-product | 28.4 | — | — | — |
| [71] | Global/local attention | 25.9 | — | — | — |
| [75] | Adaptive attention | 33.2 | 26.6 | 55.0 | 108.5 |
| [76] | Semantic attention | 30.4 | 24.3 | 53.5 | 94.3 |
| [77] | Spatial and channel-wise | 31.1 | 25.4 | 53.0 | 94.3 |
| [4] | Areas of attention | 31.9 | 25.2 | — | 98.1 |
| [79] | Deliberate attention | 37.5 | 28.5 | 58.2 | 125.6 |