Table 2.

Summary of validity evidence

Source of validity evidence	Questions related to each source of evidence	Validity evidence for TABLT
Content	Does the content reflect the underlying construct?	Tasks are aligned with the construct
Response process	Are sources of bias reduced?	Assessment can be done blinded, and calculation of the score automated
Internal structure	Is the test score reliable?	A high level of reliability shown: ICC = 0·99 (P < 0·001)
Relation to other variables	Does the test score correlate with a known measure of competence?	Novices, intermediates and experts score significantly differently (P ≤ 0·003, ANOVA with Bonferroni correction) Test score correlates with operative experience: Pearson correlation r = 0·73 (P < 0·001).
Consequences of testing	What are the consequences of the pass–fail score?	Two of 20 of experts failed and two of 20 of novices passed the test

TABLT, Training and Assessment of Basic Laparoscopic Techniques; ICC, intraclass correlation coefficient.