Table 2.

Summary of assessment tools.

Author	Aim study	Participants		Context		Content			Observation		Validation
		Individual	Team	Simulation	Clinical care	ABCDE-items (N)	Assess-ment	Action	Video	Live	Protocol based	Published tools	Reliability ((ICC/κ/r/ρ)*)	Expert consensus
Auerbach64	Measure impact of a quality improvement simulation program		✓	✓		11	✓			✓
Aukstakalnis17	Performance analysis and feedback		✓		✓	11	✓		✓		✓ATLS
Berg22	Non-inferiority of individual VR versus traditional equipment	✓		✓		8	✓		✓
Berg21	Non-inferiority of multiplayer VR versus traditional equipment	✓		✓		8	✓		✓
Botelho24	Assess adherence after checklist introduction	✓			✓	11	✓			✓	✓ATLS
Botelho25	Evaluate of adherence	✓			✓	12	✓	✓		✓	✓ATLS		✓⁰
Carter26	Identify factors related to delayed and omitted primary survey tasks		✓		✓	8	✓		✓		✓ATLS		✓inter-rater (r = 0.99, κ = 0.89)
Civantos Fuentes27	Detect areas of improvement in simulation setting	✓		✓		11	✓	✓	✓			✓30
Drost-de Klerck29	Evaluate performance regarding skills and competences during and after course	✓		✓		22	✓		✓				✓inter-rater T1, T2, T3 (ρ = 0.81, 0.61, 0.83)
Falcone30	Evaluate effectiveness of multidisciplinary trauma team training		✓		✓	18	✓	✓	✓			✓36		✓
Gala31	Describe current performance of primary survey	✓			✓	11	✓		✓			✓71		✓
Gillman32	Course evaluation		✓	✓		14	✓	✓		✓	✓ATLS
Glanville33	Evaluate the effectiveness of a learning program	✓			✓	19	✓	✓
Gyedu34	Determine the achievement of key performance indicators during the initial assessment and management	✓			✓	18	✓	✓		✓	✓WHO			✓
Holcomb36	Validate advanced simulation as an evaluation tool for trauma team resuscitation skills		✓	✓		26	✓	✓	✓					✓
Hulfish38	Determine if cognitive aid checklist reduces omissions and speeds assessment time		✓	✓		14	✓	✓		✓		✓69
Hultin39	Assess interrater reliability	✓		✓		10	✓	✓	✓			✓36	✓inter-rater (ICCs = 0.55 and 0.83)
Hunt65	Characterize quality of resuscitation efforts and identify problem areas for educational interventions		✓	✓		16	✓	✓		✓	✓PALS, ATLS, TNCC		✓inter-rater (ICC=0.77, 95% CI+ 0.74–0.79)	✓
Innocenti40	Evaluate effectiveness of training program	✓		✓		23	✓	✓			✓Emergency Medicine Manual Oxford
Jonsson41	Evaluate situational awareness training program on performance		✓	✓		10	✓		✓			✓39	✓39
Kelleher43	Evaluate the effect of checklist on completion and timeliness of ATLS tasks		✓		✓	16	✓		✓			✓69
Kelleher44	Evaluate effect checklist on deviations	✓			✓	6	✓		✓		✓ATLS
Kelleher45	Analyse impact of team size on resuscitation task completion		✓		✓	24	✓		✓			✓26
Kliem47	Investigate adherence	✓		✓		12	✓		✓				✓inter-rater (κ = 0.94)
Koko48	Investigate adherence		✓	✓		17		✓		✓		✓5
Linders4	Investigate adherence between video-based instruction versus conventional lecture	✓		✓		24	✓		✓		✓APLS		✓intra-rater (ICC=0.87, 95% CI 0.74–0.94)
Lubbert66	Analyse team functioning and protocol deviations		✓		✓	26	✓	✓	✓		✓ATLS
Maluso51	Determine the optimal number of team members in the initial evaluation		✓		✓	20	✓	✓	✓		✓ATLS
Merriman67	Compare the use of teaching in clinical simulation or classroom	✓		✓		21	✓			✓	✓ALERT & ERC
Nadel52	Evaluate effectiveness of an educational intervention on knowledge, technical skills and confidence	✓		✓		5	✓		✓		✓PALS
O’Connell53	Evaluate effect of family presence on ATLS task performance		✓		✓	7	✓		✓			✓26	✓26
Oakley68	Determine the ability of video review to identify management errors		✓		✓	12	✓		✓		✓ATLS		✓⁰
Olgers5	Study completeness	✓			✓	26	✓
Parsons69	Test checklist effectiveness		✓	✓		15	✓	✓	✓			✓26		✓
Peran54	Validate cognitive aid tool	✓		✓		36	✓	✓					✓⁰	✓
Pringle55	Assess effectiveness of a trauma course	✓		✓		11	✓		✓	✓
Ritchie57	Assess utility of video review in assessing trauma team performance		✓		✓	20	✓	✓	✓			✓72
Spanjers- Berg59	Analyse protocol compliance		✓		✓	29	✓	✓	✓
Stayt70	Compare the use of teaching in clinical simulation or classroom	✓		✓		21	✓					✓67
Tsang61	Assess protocol compliance		✓		✓	11	✓	✓			✓ATLS
Wurster62	Evaluate competency of assessment physician		✓		✓	14	✓		✓				✓inter-rater (κ = 0.84, 95% CI 0.79–0.90)	✓
Yan63	Investigate the impact of rapid cycle deliberate practice on skill retention	✓			✓	8	✓					✓31

*ICC: Intraclass Correlation Coefficient, κ: Kappa, r: Pearson’s correlation coefficient, ρ: Spearman’s Rho. ⁺95%-CI: 95% Confidence Interval was only provided if reported in the study.

⁰The study indicated that interrater was performed, but results were not reported.