Table 2.

Results of Pilot Testing Comparing a Study Team Rater and Outside Institution Raters

ANAT Item	% agreement, 4 raters*	% agreement, 3 raters†
CC	100%	100%
HPI	99%	98%
ROS	92%	94%
PFSH 1	99%	98%
PFSH 2	99%	98%
PFSH 3	96%	94%
PFSH 4	96%	96%
PFSH 5	96%	96%
Exam	83%	83%
DD 1	76%	70%
DD 2	57%	72%
DD 3	90%	93%
DD 4	100%	100%
A&P 1	82%	87%
A&P 2	76%	80%
A&P 3	83%	91%
Global Assessment 1	65%	65%
Global Assessment 2	67%	70%

^*Study team rater compared to outside institution raters

^†Outside institution raters only