Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Breakdown of first-place votes for CoD summaries by step. Based on aggregate preferences, the modal CoD step is 2, median is 3, and expected is 3.06.
| CoD | % Share of First Place Votes | ||||
|---|---|---|---|---|---|
| Step | Individual Annotators | Aggregate | |||
| 1 | 3.0 | 2.0 | 13.0 | 17.4 | 8.3 |
| 2 | 25.0 | 28.0 | 43.0 | 31.4 | 30.8 |
| 3 | 22.0 | 28.0 | 21.0 | 24.4 | 23.0 |
| 4 | 29.0 | 25.0 | 13.0 | 26.7 | 22.5 |
| 5 | 21.0 | 17.0 | 10.0 | 16.3 | 15.5 |
