TABLE 4.

Validation of the qualitative method used to assign the occurrences of mental anchorpoints and mental representations (Cohen’s kappa test).

Participant	Mental			Mental
	anchorpoints (MA)			representations (MR)
	R1 – R2	R1 – R12	R2 – R12	R1 – R2	R1 – R12	R2 – R12
P101	0.420	0.657	0.734	1	1	1
P110	0.655	0.868	0.770	0.443	0.780	0.620
P112	0.781	0.914	0.847	0.671	0.928	0.744
P123	0.661	0.314	0.346	0.277	1	0.277
P126	0.804	0.967	0.835	0.810	0.865	0.873
P132	0.607	0.759	0.824	0.794	0.794	1
P136	0.524	1	0.524	1	1	1
P144	0.530	0.845	0.653	0.465	0.867	0.596
P148	0.685	0.875	0.723	1	1	1
P163	0.829	0.928	0.865	0.769	0.769	1
All	0.723	0.819	0.753	0.591	0.913	0.663

R₁, annotator AL; R₂, annotator PL; R₁₂, final annotation after discussion and agreement between AL and PL. In this test, a score of 1 indicates a perfect match, a score between 0.81 and 1 corresponds to an almost perfect agreement, a score between 0.61 and 0.80 indicates a substantial agreement, a score between 0.41 and 0.60 corresponds to a moderate agreement, a score between 0.21 and 0.40 indicates none to slight agreement, and a score below 0.21 indicates a result consistent with a random annotation (McHugh, 2012).