Table 3.

ICC within patients and staff for test-retest reliability (T1 and T2) and inter-rater agreement between patient and staff ratings (T1)

	Test-Retest						Inter-Rater
	Mean (SD)		p-valuea	Proportion Agreement (%)c	ICC	95% CI	Mean (SD)		p-valuec	Proportion Agreement (%)d	ICC	95% CI
	Patient T1 (N = 67)	Patient T2 (N = 67)					By Patient (N = 111)	By Staffb (N = 111)
IPOS Total	29.78 (9.56)	28.67 (9.18)	0.305	-	0.722	0.549–0.829	29.66 (8.83)	25.99 (9.11)	0.003	-	0.343	0.050–0.547
IPOS Physical Symptoms	18.05 (9.56)	17.36 (6.05)	0.347	-	0.717	0.541–0.826	18.15 (5.99)	13.21 (6.39)	< 0.001	-	0.290	− 0.112–0.539
IPOS Emotional Symptoms	7.22 (3.82)	6.91 (3.70)	0.505	-	0.653	0.435–0.787	7.25 (3.49)	7.95 (3.16)	0.122	-	0.151	− 0.229–0.414
IPOS Communication/ Practical Issues	4.51 (2.47)	4.40 (2.51)	0.711	-	0.732	0.563–0.835	4.25 (2.47)	4.84 (2.25)	0.066	-	0.415	0.154–0.596
Items
Pain	2.19 (1.29)	1.99 (1.19)	0.114	86.6	0.770	0.626–0.858	2.12 (1.24)	2.13 (1.07)	0.954	75.7	0.595	0.410–0.722
Shortness of Breath	1.37 (1.19)	1.33 (1.26)	0.742	83.6	0.747	0.587–0.844	1.40 (1.16)	0.94 (1.15)	0.003	73.9	0.458	0.200–0.632
Weakness	2.39 (1.31)	2.49 (1.09)	0.429	79.1	0.754	0.601–0.849	2.45 (1.23)	2.11 (1.06)	0.027	69.4	0.465	0.223–0.632
Nausea	0.84 (1.05)	0.73 (1.16)	0.472	88.1	0.605	0.357–0.757	0.84 (1.05)	0.53 (0.86)	0.018	84.7	0.563	0.355–-0.703
Vomiting	0.70 (1.13)	0.67 (1.16)	0.831	88.1	0.672	0.465–0.799	0.67 (1.11)	0.33 (0.77)	0.010	87.4	0.689	0.510–0.797
Poor Appetite	2.13 (1.24)	2.08 (1.27)	0.754	67.2	0.382	− 0.011–0.621	2.23 (1.27)	1.77 (1.29)	0.007	62.2	0.256	− 0.065–-0.483
Constipation	2.03 (1.47)	1.97 (1.40)	0.670	85.1	0.815	0.698–0.886	1.93 (1.32)	1.38 (1.33)	0.003	67.6	0.536	0.293–0.691
Sore Mouth	1.88 (1.29)	1.64 (1.24)	0.088	80.6	0.744	0.585–0.843	1.92 (1.32)	0.93 (1.03)	< 0.001	57.7	0.278	− 0.133–0.533
Drowsiness	1.97 (1.15)	1.93 (1.05)	0.732	86.6	0.699	0.509–0.815	2.05 (1.17)	1.04 (1.03)	< 0.001	58.6	0.190	− 0.180–0.447
Poor Mobility	2.54 (1.09)	2.54 (1.12)	0.999	80.6	0.628	0.393–0.772	2.55 (1.08)	2.06 (1.35)	0.003	70.3	0.159	− 0.193–0.412
Anxiety	1.46 (1.32)	1.51 (1.31)	0.787	76.1	0.641	0.415–0.780	1.38 (1.28)	1.94 (1.01)	< 0.001	60.4	0.090	-0.271–0.356
Family Anxiety	2.64 (1.30)	2.45 (1.20)	0.207	80.6	0.667	0.460–0.795	2.77 (1.21)	2.56 (1.07)	0.018	64.9	0.007	− 0.440–0.317
Depression	1.46 (1.22)	1.42 (1.14)	0.784	82.1	0.542	0.251–0.719	1.45 (1.22)	1.51 (1.03)	0.678	75.7	0.317	− 0.003–0.532
Feeling at Peace	1.66 (1.14)	1.54 (1.12)	0.454	77.6	0.507	0.197–0.697	1.66 (1.08)	1.94 (0.89)	0.037	74.8	0.325	0.027–0.533
Share Feelings	1.87 (1.28)	1.78 (1.18)	0.581	80.6	0.595	0.340–0.751	1.81 (1.22)	2.02 (1.12)	0.188	64.0	0.296	− 0.020–0.515
Information	0.97 (0.85)	0.94 (0.92)	0.760	94.0	0.749	0.591–0.846	0.92 (0.94)	1.05 (0.80)	0.248	82.0	0.313	0.003–0.527
Practical Problems	1.67 (1.20)	1.69 (1.25)	0.925	79.1	0.622	0.382–0.768	1.52 (1.13)	1.77 (1.14)	0.111	78.4	0.530	0.317–0.676

IPOS: Integrated Palliative Care Outcome Scale; ICC: Intraclass Correlation Coefficient

^aPaired t-test

^bA total of 28 staff members assessed 111 patients

^cIndependent samples t-test

^dLevel of agreement within one score