Table 2.

Agreement between patient self-report, manual medical record audit and automatic NLP System for the Validation Cohort (n=200)

Domain	Comparison	Kappa	% agreement
mobility	SS vs PH*	0.4872	77.0
	Patient vs SS	0.2144	63.1
	Patient vs PH	0.2285	62.1
	Patient vs NLP-ML	0.0935	59.2
	SS vs NLP-ML	0.3655	79.0
	PH vs NLP-ML	0.2282	67.0
self-care	SS vs PH	0.5159	96.5
	Patient vs SS	0.0000	94.2
	Patient vs PH	0.1908	93.2
	Patient vs NLP-ML	0.1351	78.6
	SS vs NLP-ML	0.0927	81.5
	PH vs NLP-ML	0.1563	82.0
usual activity	SS vs PH	0.3337	75.5
	Patient vs SS	0.2127	65.0
	Patient vs PH	0.1825	65.0
	Patient vs NLP-ML	0.2485	66.0
	SS vs NLP-ML	0.3498	74.5
	PH vs NLP-ML	0.3179	74.0
pain/discomfort	SS vs PH	0.5714	80.5
	Patient vs SS	0.1328	66.0
	Patient vs PH	0.1027	64.1
	Patient vs NLP-ML	0.1746	63.1
	SS vs NLP-ML	0.3050	67.0
	PH vs NLP-ML	0.3886	70.5
anxiety/depression	SS vs PH	0.5552	81.0
	Patient vs SS	0.2969	70.6
	Patient vs PH	0.1654	63.7
	Patient vs NLP-ML	0.1081	56.9
	SS vs NLP-ML	0.3184	68.0
	PH vs NLP-ML	0.3748	70.0

^*SS, PH= auditors completing manual medical record audit for functional status

Patient= patient self report of functional status determined by EQ5D

NLP= automatic NLP System for functional status