Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Evaluation measures for the “exact” answers in Phase B of Task 1b
| Question | Participant | Evaluation measures |
|---|---|---|
| type | response | |
| yes/no | yes or no | accuracy |
| factoid | up to 5 entity names | strict and lenient accuracy, MRR |
| list | a list of entity names | mean precision, recall, F -measure |
