. 2014 Jan;5(1):16–27. doi: 10.1177/1947603513514436

Table 3.

Results of Interobserver Agreement and Agreement With Reference Standards.

Feature	Reader 1 Scores, Score (Number of Samples, %)	Reader 2 Scores, Score (Number of Samples, %)	Interobserver Agreement	Reference Standard Scores, Score (Number of Samples, %)	Agreement With Reference Standard (Reader A)	Agreement With Reference Standard (Reader B)	Average κ for Readers A and B
1. Cartilage signal of graft	0 (14, 50%)	0 (14, 50%)	0.94	Mean modified Mankin 7.2 (SD 3.9, range 1-15)	N/A^a	N/A^a	N/A^a
	1 (10, 36%)	1 (9, 32%)
	2 (4, 14%)	2 (5, 18%)
2. Cartilage “fill” of graft (percentage of volume)	0 (17, 61%)	0 (18, 64%)	0.93	0 (18, 64%)	0.93	1	0.97
	1 (4, 14%)	1 (3, 11%)		1 (3, 11%)
	2 (7, 25%)	2 (7, 25%)		2 (7, 25%)
3. Cartilage edge integration at host-graft junction	0 (4, 14%)	0 (3, 11%)	0.71	0 (3, 11%)	0.58	0.62	0.6
	1 (20, 71%)	1 (18, 64%)		1 (21, 75%)
	2 (4, 14%)	2 (7, 25%)		2 (4, 14%)
4. Cartilage surface congruity of graft and host-graft junction	0 (12, 43%)	0 (12, 43%)	0.94	0 (11, 39%)	0.88	0.94	0.91
	1 (12, 43%)	1 (13, 46%)		1 (14, 50%)
	2 (4, 14%)	2 (3, 11%)		2 (3, 11%)
5. Calcified cartilage integrity of graft	0 (11, 39%)	0 (13, 46%)	0.86	0 (13, 46%)	0.71	0.86	0.79
5. Calcified cartilage integrity of graft	1 (17, 61%)	1 (15, 54%)	0.86	1 (15, 54%)	0.71	0.86	0.79
6. Subchondral bone plate congruity of graft and host-graft junction	0 (13, 46%)	0 (14, 50%)	0.93	0 (13, 46%)	1.00	0.93	0.96
	1 (15, 54%)	1 (14, 50%)	0.93	1 (15, 54%)	1.00	0.93	0.96
7. Subchondral bone marrow signal intensity of graft relative to epiphyseal bone	0 (15, 54%)	0 (14, 50%)	0.93	0 (18, 64%)	0.64	0.57	0.61
	1 (13, 46%)	1 (14, 50%)	0.93	1 (10, 36%)	0.64	0.57	0.61
8. Osseous integration at host-graft junction	0 (28, 100%)	0 (28, 100%)	Perfect agreement^b	0 (28, 100%)	Perfect agreement^b	Perfect agreement^b	Perfect agreement^b
8. Osseous integration at host-graft junction	1 (0, 0%)	1 (0, 0%)	Perfect agreement^b	1 (0, 0%)	Perfect agreement^b	Perfect agreement^b	Perfect agreement^b
9. Presence of cystic changes of graft and host-graft junction	0 (7, 25%)	0 (9, 32%)	0.83	0 (7, 25%)	1.00	0.83	0.91
	1 (21, 75%)	1 (19, 68%)	0.83	1 (21, 75%)	1.00	0.83	0.91
10. Opposing cartilage	0 (20, 71%)	0 (20, 71%)	1		N/A^c	N/A^c	N/A^c
10. Opposing cartilage	1 (8, 29%)	1 (8, 29%)	1		N/A^c	N/A^c	N/A^c
11. Meniscal tears	0 (20, 71%)	0 (20, 71%)	1		N/A^c	N/A^c	N/A^c
11. Meniscal tears	1 (8, 29%)	1 (8, 29%)	1		N/A^c	N/A^c	N/A^c
12. Synovitis	0 (26, 93%)	0 (26, 93%)	1		N/A^c	N/A^c	N/A^c
12. Synovitis	1 (2, 7%)	1 (2, 7%)	1		N/A^c	N/A^c	N/A^c
13. Fat pad scarring	0 (26, 93%)	0 (26, 93%)	1		N/A^c	N/A^c	N/A^c
13. Fat pad scarring	1 (2, 7%)	1 (2, 7%)	1		N/A^c	N/A^c	N/A^c

Spearman’s correlation was used instead (refer to text).

Kappa could not be calculated because of lack of variability (refer to text).

Reference standards for features 10 to 13 were not available.