Table 5.

Interobserver agreement studies of tumour response scoring systems for pancreatic cancer

Reference	No. of patients	No. of graders	Sampling	% of patients for whom assessment reached consensus	Interobserver measure outcomes
Kalimuthu et al.19	14	4	7–20 slides	CAP: 57.1 MDACC: 85.7	CAP: KCC 0.18–0.40 MDACC: KCC 0.00–0.67
Cacciato Insilla et al.20	29	2	Complete submission of surgical specimen and overall evaluation of all slides	CAP: 72.4 MDACC: 89.7	CAP: KCC 0.64 MDACC: KCC 0.52
Matsuda et al.21	97	2	All histology sections	CAP: 71.1 MDACC: 94.8	CAP: Cohen’s κ 0.50 MDACC: Cohen’s κ 0.65
Kameyama et al.16	30	8	Not specified	CAP: 13.3 MDACC: 83.3	CAP: KCC 0.48 MDACC: KCC 0.53
Chou et al.22	147	2	Two sections of tumour containing the most malignant tissue	CAP: 66* MDACC: 92*	CAP: Cohen’s κ 0.43 MDACC: Cohen’s κ 0.69
Present study	50	23	Three randomly selected slides from tumour bed	CAP: 0 MDACC: 58	CAP: ICC 0.66 MDACC: ICC 0.71

^*From review of original data sets (data not presented in original paper). CAP, College of American Pathologists; MDACC, MD Anderson Cancer Center; KCC, Kendall’s coefficient of concordance; ICC, intraclass correlation coefficient.