Table 7. IAA and agreement between network and humans on the arguments.
Children’s opinions (CHILD_OPIN) | Psychosocial report (PSY_REP) | Previous dedication to the children (PAR_DED) | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Annotator 1 | 75% | 75% | 88% | ||||||||||
Annotator 2 | 5% | 4% | 3% | ||||||||||
Neural network | Precision | Recall | F1 Score | Kappa | Precision | Recall | F1 Score | Kappa | Precision | Recall | F1 Score | Kappa | |
0.77 | 0.76 | 0.77 | 0.70 | 0.75 | 0.63 | 0.65 | 0.59 | 0.74 | 0.55 | 0.62 | 0.60 | ||
Annotator 1 | 83% | 81% | 66% | ||||||||||
Annotator 2 | 7% | 4% | 8% | ||||||||||
Neural network | Precision | Recall | F1 Score | Kappa | Precision | Recall | F1 Score | Kappa | Precision | Recall | F1 Score | Kappa | |
0.57 | 0.91 | 0.70 | 0.63 | 0.71 | 0.76 | 0.74 | 0.70 | 0.57 | 0.76 | 0.66 | 0.60 |