Appendix 2:

Review and sampling stratification

Alert Override Category		Phase 2			Phase 3			Findings				Final determination
					Sampling Frame		Sample Size	Round 1		Round 2
	n	working definition	Strata	n total = 162	working definition (revised)	quartiles (percent overdose)	n	agreement	disagreement	agreement	disagreement	error	non-error
Dose	17,618	non-error	< 20% overdose	1240	non-erro	Q1 (6 to 8)	26	16	10	26	0	2	24
						Q2 (9 to 13)	27	15	12	27	0	7	20
						Q3 (14 to 18)	12	2	10	11	1	0	12
						Q4 (19 to 20)	6	1	5	5	1	0	6
		error	≥20% overdose	10,420	error	Q1 (21 to 49)	21	12	9	21	0	8	13
						Q2 (50 to 99)	16	8	8	16	0	7	9
						Q3 (100 to 220)	36	13	23	35	1	10	26
						Q4 (220 to 100,000+)	18	9	9	18	0	5	13
	n	working definition	Strata	n	working definition (revised)	categories	n total = 43	agreement	disagreement	agreement	disagreement	error	non-error	could not be determined
Dmg-Drug Interaction	36,680	error	Duplicate Anticoagulant	3221	error	Duplicate Anticoagulant	21	12	9	19	2	11	8	2
			Duplicate Other	684		Duplicate Other	22	11	11	20	1	15	6	1
			QT prolongation	1272	non-error	QT prolongation	0	0	0	0	0	0	0	0
			Seritonin Syndrome	898		Seritonin Syndrome	0	0	0	0	0	0	0	0
			Statin/myopathy	2878		Statin/myopathy	0	0	0	0	0	0	0	0
			Changes INR	20,759		Changes INR	0	0	0	0	0	0	0	0
			Metabolism modulator	1813	Metabolism	NOS	0	0	0	0	0	0	0	0
			NOS		modulator
			CNS depression from	861		CNS depression from	0	0	0	0	0	0	0	0
			Opioid or Benzo			Opioid or Benzo
			Other/uncategorizable	4294		Other/uncategorizable	0	0	0	0	0	0	0	0
	n	working definition	Strata	n	working definition (revised)	categories	n total = 159	agreement	disagreement	agreement	disagreement	error	non-error
Allergy	108,476	error	severe | no justification	997	error	severe | no justification	70	68	2	70	0	0	70
			severe | with justification	2364		severe | with justification	69	68	1	69	0	0	69
			minor | no justification	13,724	non-error	minor | no justification	0		0	***	***	***	***
		S	minor | justification	19,890		minor | justification	20	20	0	***	***	0	20
			Opioid	2572		Opioid	0	0	0	***	***	***	***
			Benzodiapene	56		Benzodiapene	0	***	***	***	***	***	***
			Duplicate reactions	25,484		***	0	***	***	***	***	***
												*_
												*_
												*