Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
A,B,C,and D are mental healthcare providers as annotators. The annotations provided by MHP “B” showed the highest pairwise agreement and were used to measure incremental groupwise agreement for the robustness in the annotation task.
| B | C | D | A | A&C | A&C&D | ||
|---|---|---|---|---|---|---|---|
| A | 0.82 | 0.79 | 0.80 | ||||
| B | - | 0.85 | 0.88 | B | 0.82 | 0.78 | 0.76 |
| C | - | - | 0.83 | ||||
| (a) Pairwise reliability agreement | (b) Groupwise reliability agreement | ||||||
