Table 6. Intra-rater reliability of PCOC SAS: Types and levels of agreement in repeat patient-reported assessments.

Palliative care phase	PCOC SAS item	N	Exact agreement %	Tolerance agreement %	Weighted kappa	95% CI	Level of agreement
Stable, Unstable and deteriorating	Pain	1,135	63.3	78.0	0.6	0.54–0.63	Moderate
	Fatigue	1,123	64.6	78.5	0.6	0.57–0.65	Moderate
	Breathing	1,121	84.7	90.9	0.7	0.65–0.75	Substantial
	Bowel problems	1,121	80.5	87.2	0.6	0.50–0.62	Moderate
	Nausea	1,128	86.4	91.2	0.6	0.49–0.63	Moderate
	Appetite problems	1,121	86.6	93.0	0.7	0.63–0.74	Substantial
	Insomnia	1,067	86.6	90.5	0.6	0.53–0.67	Substantial
Stable	Pain	1,010	66.0	80.5	0.6	0.52–0.62	Moderate
	Fatigue	1,005	65.6	78.7	0.6	0.54–0.64	Substantial
	Breathing	1,004	85.5	91.4	0.7	0.64–0.75	Substantial
	Bowel problems	1,005	82.0	88.6	0.6	0.52–0.65	Moderate
	Nausea	1,008	88.2	92.8	0.6	0.48–0.65	Moderate
	Appetite problems	1,004	88.8	94.9	0.7	0.66–0.78	Substantial
	Insomnia	967	87.7	91.5	0.6	0.54–0.69	Substantial
Unstable and deteriorating	Pain	125	41.6	57.6	0.5	0.38–0.61	Moderate
	Fatigue	118	55.9	77.1	0.6	0.54–0.75	Substantial
	Breathing	117	76.1	86.3	0.7	0.62–0.82	Substantial
	Bowel problems	116	67.2	75.9	0.4	0.27–0.58	Moderate
	Nausea	120	71.7	78.3	0.5	0.35–0.65	Moderate
	Appetite problems	117	67.5	76.9	0.5	0.35–0.64	Moderate
	Insomnia	100	76.0	81.0	0.5	0.33–0.73	Moderate

1 Tolerance agreement reflects the proportion of cases where a subsequent patient ratings was the same as or within +1 or −1 of an immediately following score.