Table 3.

Messick framework: sources of evidence, definitions and procedure

Source of evidence	Definition	Procedure
Content	“the relationship between a test's content and the construct it is intended to measure [26].”	Assessed as a part of development
Internal structure	"The relationship among data items within the assessment and how these relate to the overarching construct [24]"	Interrater reliability
		Internal consistency
		Observability
Relationships with other variables	“The degree to which these relationships are consistent with the construct underlying the proposed test score interpretations [26]”	Planned in further validations
Response process	“The fit between the construct and the detailed nature of performance... actually engaged in [26]”	Raters respond in questionnaire
Consequences	“The impact, beneficial or harmful and intended or unintended, of assessment [27]”	Evaluation of the possibility of minimal rater training