Table 4.

Inter-rater agreement

Item	Full ordered adjectival scale	Dichotomized response (Acceptable vs Unacceptable)	Intra-Class Correlation
	Spearman rank correlation	Percent exact agreement	Coefficient
Initial data gathering by physician about acute problems	0.24	85.4	0.48
Physician integration of information and development of appropriate diagnoses	0.37	79.8	0.57
Physician initial treatment plan and initial orders	0.35	70.2	0.57
Physician plan for disposition and follow-up	0.39	83.7	0.59
Assess the overall quality of care provided to the patient	0.39	75.3	0.60
Total summed score	0.46	86.5	0.65