Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Annotator agreements from the second pilot task
Cohen’s kappa score for the DS step annotation task. (0-0.2: Poor, 0.2-0.4: Fair, 0.4-0.6: Moderate, 0.6-0.8: Good, 0.8-1: Very good). Bold numbers in the table indicate the top score, and numbers in coloured background cells indicate poor/fair scorers
