Table 4.

Data describing the validation process of assessment tools

	Tool	Partici-pants	Cases†	Procedure evaluated	Validation setting	Live / video	Assessor per case	Assessors in total
Global Rating Scale
1	Sidhu et al. [17] Self-assessment scale	22 (T)	22	Lap sigmoid colectomy	Laboratory (animal)	video	2	2
2	Wohaibi et al. [18] OpRate	29 (T)	579†	Lap colon resections †	Workplace	live	1	33
3	Niitsu et al. [32] OSATS	10 (T)	757†	Lap colon resections †	Workplace	live	1	12
4	Jenkins et al. [19] GMAS/DOPS	8 (C)	750	Lap colon and rectum resections	Workplace	video, live	1	2
5	Watanabe et. al [20] IRT-GOALS	396 (T + C)	396†	Lap colon and rectum resections †	Workplace	live	1	NR
Error-based rating scale
6	Miskovic et al. [8] OCHRA	21 (C)	33	Lap colon resections (right and left colectomies)	Workplace	video	1–3 (2 for sum-mative feedback)	16
Procedure-specific tool
7	Dath. et al. [33] OCRS	29 (T)	58†	Lap low anterior resections	Laboratory (animal)	video	2	10
8	Sarker et al. [21, 22]* Technical skills assessment tool for laparoscopic colectomy	14 (T + C)	84	Lap colon and rectum resections (right hemicolectomies, sigmoid resections and anterior resections)	Workplace	video	2	2
9	Palter et al. [7, 23]* Procedure-specific evaluation tools	37 (T + C)	37	Lap right colectomies and lap sigmoid colectomies	Workplace	video	2	2
10	Miskovic et al. [24–26, 34]* GAS-tool	52 (C)	333	Lap colon and rectum resections (right hemicolectomies, sigmoid resections, anterior resections, low anterior resection, total and subtotal colectomies and assisted abdominoperineal resections)	Workplace	live	1–2 (self-evaluation by subject)	30
11	Miskovic et al. [1, 27, 28]* CAT-tool	31 (C)	54	Lap right and left colectomies	Workplace	video	2–3	27
12	Glarner et al. [29] Comprehensive assessment Tool	16 (T)	63	Lap segmental colon resections	Workplace	live	1	4
13	Champagne et al. [2, 30]* ASCRS Tool	24 (T + C)	24	Lap right hemicolectomies	Workplace,	video	5	20
14	Nakayama et al. [31] ASLAC score	NR	NR	NR	NR	NR	NR	NR

Participants: number of participating trainees (T) and consultants (C) Trainees: doctors purchasing a career in surgery who have not completed their residency as post-graduate year surgeons Consultants: surgeons who have completed their post-graduate residency and those who are specialised in operating on colon and rectum Cases: number of live or video recorded operations included in the analysis Lap: laparoscopic Assessors pr. case: number of assessor on each procedure Assessors in total: assessors contributing to the scoring process NR: not reported

^†Other surgical procedures also reported

^*Only number from the first validation paper has been reported