TABLE V.
Average BLEU Scores and Standard Deviation in Parentheses for Five Experiments
| Experiment | Input Data | Validity Check | Knowledge Constraint | LSTM General Attention | BRNN General Attention | Transformer |
|---|---|---|---|---|---|---|
|
| ||||||
| 1 | ICD-9 | Not checked | Non-constrained | 17.62 (1.03) | 17.61 (0.74) | 17.77 (0.55) |
| 2 | Checked | Non-constrained | 17.85 (1.18) | 18.26 (1.10) | 15.32 (0.37) | |
| 3 | Not checked | Constrained | 12.61 (6.33) | 12.46 (6.26) | 14.76 (0.51) | |
| 4 | Checked | Constrained | 12.95 (6.50) | 13.16 (6.61) | 14.99 (0.42) | |
|
| ||||||
| 5 | ICD-10 | Not checked | Non-constrained | 17.86 (0.50) | 17.89 (1.06) | 16.31 (0.61) |