Table 4.

Decision study of a p × i × r and r:(p × i) design for assessment of the integration of simulation-based learning into clinically correlated electrocardiogram interpretation and ACLS course

Effect	Estimate variance components in D-study
	nr′	1	1	1	1	2	2	2	2	3	3	3	3
	ni′	5	8	10	15	5	8	10	15	5	8	10	15
p × i × r design
Ep2		0.44	0.49	0.51	0.54	0.59	0.64	0.66	0.69	0.66	0.72	0.74	0.76
Φ		0.43	0.49	0.51	0.54	0.58	0.64	0.66	0.69	0.66	0.71	0.73	0.76
r:(p × i) design
Ep2		0.62	0.72	0.77	0.83	0.75	0.83	0.86	0.90	0.81	0.87	0.89	0.93
Φ		0.62	0.72	0.76	0.83	0.74	0.82	0.85	0.90	0.80	0.86	0.89	0.92

Ep² G-coefficient, Φ Phi-coefficient, n_r′ Number of raters, n_i′ Number of items, Bold Reliable assessment of ≥ 0.70