Skip to main content
. 2024 Oct 22;10:e2293. doi: 10.7717/peerj-cs.2293

Table 7. IAA and agreement between network and humans on the arguments.

Children’s opinions (CHILD_OPIN) Psychosocial report (PSY_REP) Previous dedication to the children (PAR_DED)
Annotator 1 75% 75% 88%
Annotator 2 5% 4% 3%
Neural network Precision Recall F1 Score Kappa Precision Recall F1 Score Kappa Precision Recall F1 Score Kappa
0.77 0.76 0.77 0.70 0.75 0.63 0.65 0.59 0.74 0.55 0.62 0.60
Annotator 1 83% 81% 66%
Annotator 2 7% 4% 8%
Neural network Precision Recall F1 Score Kappa Precision Recall F1 Score Kappa Precision Recall F1 Score Kappa
0.57 0.91 0.70 0.63 0.71 0.76 0.74 0.70 0.57 0.76 0.66 0.60