Table 5. Inter-rater reliability of PCOC SAS: Types and levels of agreement between patient and proxy ratings by phase and PCOC SAS items.

Palliative care phase	PCOC SAS item	N	Exact agreement %	Tolerance Agreement+ %	Weighted kappa	95% CI	Level of agreement
Stable, unstable and deteriorating	Pain	544	52.4	70.2	0.55	0.39–0.52	Moderate
	Fatigue	537	67.0	77.7	0.5	0.46–0.60	Moderate
	Breathing	536	79.9	89.6	0.6	0.56–0.71	Substantial
	Bowel problems	533	73.4	84.2	0.4	0.32–0.49	Moderate
	Nausea	535	86.7	91.4	0.5	0.39–0.61	Moderate
	Appetite problems	534	85.6	89.0	0.5	0.33–0.56	Moderate
	Insomnia	390	83.3	88.2	0.4	0.26–0.53	Moderate
Stable	Pain	370	55.7	73.2	0.4	0.35–0.51	Moderate
	Fatigue	368	69.0	79.6	0.5	0.38–0.56	Moderate
	Breathing	368	82.1	91.8	0.6	0.53–0.73	Substantial
	Bowel problems	367	76.8	85.0	0.3	0.22–0.44	Fair
	Nausea	367	91.0	94.6	0.4	0.23–0.58	Moderate
	Appetite problems	366	89.9	92.9	0.5	0.30–0.62	Moderate
	Insomnia	282	87.9	92.9	0.5	0.30–0.64	Moderate
Unstable and deteriorating	Pain	174	45.4	63.8	0.4	0.33–0.53	Moderate
	Fatigue	169	62.7	73.4	0.6	0.46–0.67	Moderate
	Breathing	168	75.0	84.5	0.6	0.52–0.75	Moderate
	Bowel problems	166	65.7	82.5	0.5	0.36–0.62	Moderate
	Nausea	168	77.4	84.5	0.5	0.40–0.67	Moderate
	Appetite problems	168	76.2	80.4	0.4	0.24–0.57	Moderate
	Insomnia	100	71.3	75.9	0.3	0.08–0.48	Fair

⁺ Tolerance agreement reflects the proportion of cases where proxy and patient ratings were equal to or within +1 or −1 of each other.