Table 3.

Rapid strategies recommendations analysis

	Rapid strategies versus ‘Gold Standard’ (n=200)	Kappa
Potentially misleading recommendations	6.5% (3%–9.9%)	–
Inappropriate	3.5% (0.95%–6%)	–
Overconfident	3% (0.64%–5.3%)	–
Reasonable recommendations	93.5% (90%–96.9%)	–
Concordant	62.5% (55.7%–69.2%)	0.59 (0.36–0.82)
Reasonable disagreement	31% (24.5%–37.4%)	–
Same direction recommendations	74% (67.5%–79.5%)	–
Strong (rapid strategies) (n=26)	96.1% (82.2%–99.3%)	–
Weak (rapid strategies) (n=174)	70.6% (64.5%–76.9%)	–
Potentially misleading quality of evidence judgement	20% (14.4%–25.5%)	–
Inappropriate moderate or high	5% (1.9%–8%)	–
Inappropriate low or very low	15% (10%–19.9%)	–
Quality of evidence agreement	55.5% (48.6%–62.3%)	0.59 (0.46–0.72)
Coincidence in information use*	60% (50.4–69.6)	–

*The same publication/s were used to answer the question.