Table 5.

Evidence of validity and reliability of surveys and student MCQ examination

What is the evidence that the student and faculty feedback surveys used to evaluate the MSK course were valid and reliable?
Data sources	Strengths	Weaknesses	Exemplar Quotes
Student and faculty evaluation feedback data.	Student feedback evaluation was very reliable (α >.92). Faculty feedback was reliable (α >.76). The data from the evaluations was aligned with the data produced through the interviews with key informants.
What is the evidence that the student examination was valid and reliable?
Data sources	Strengths	Weaknesses	Exemplar Quotes
Student examination data for MSK course and for courses preceding and following MSK.	Examination reliable (Cronbachs α r = 0.76). High correlation between students who scored well on MSK and earlier/later courses r > .638	MSK underrepresented on the exam relative to other content in course (special senses and dermatology). Topics on exam were not always aligned with content of course.	"Integrating ophthalmology and ENT into the MSK course before doing neuro made learning the subject matter very difficult."