Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
ROUGE-F1 metrics for top-ranked GPT-3.5 summaries on a random 1k subset of the CNN/DailyMail test set. Single represents a single candidate baseline (similarly to Top Beam in Table 2). The others produce 16 candidates, which are then re-ranked with BRIO.
| Candidate Method | R1 | R2 | RL |
|---|---|---|---|
| Single | 40.84 | 17.30 | 37.07 |
| Temperature Sampling | 42.51 | 19.17 | 38.73 |
| Nucleus Sampling | 42.43 | 19.06 | 38.65 |
| PGA (ours) | 43.56 | 20.11 | 39.95 |
