Table 1.
Summary of the Instruments Used in This Study
| Items | EBP outcomes | Scoring | Psychometric properties | ||
|---|---|---|---|---|---|
| K-REC14 | Clinical scenario and 9 items relating to the scenario (short answer, multiple choice, and true–false questions) | Actual EBP knowledge (PICO questions, search strategies, research designs, critical appraisal, evidence hierarchies, and statistics) | Set scoring template with highest possible mark of 12 |
Test–retest reliability: moderate to excellent (Cohen's κ 0.62–1.0 for items, ICC 0.88 for total score; n=24 physiotherapy students)14 Inter-rater reliability: very good to excellent (Cohen's κ 0.83–1.0 for items, ICC 0.97 for total score; n=24 physiotherapy students)14 |
Discriminative validity: significant difference (p<0.0001) in total scores between novice and experts (n=24 physiotherapy students exposed, n=76 human movement students non-exposed)14 Responsive validity: able to detect impact of EBP training (p<0.001, ES 1.13; n=77 physiotherapy students)6 |
| EBP2,15 | 58 5-point Likert-scale items in 5 self-reported outcomes (domains) and 13 demographic items | Relevance (values, emphasis, and importance of EBP) Sympathy (compatibility of EBP with professional work) Terminology (understanding of common research terms) Practice (use of EBP) Confidence (perception of ability) |
Minimum–maximum item score of 1–5. Outcome scores (aggregate item scores) calculated for each outcome. |
Test–retest reliability: moderate to good (ICC 0.53–0.86 for items; ICC 0.77–0.94 for outcomes; n=106 allied health students and professionals*)15 Internal consistency: very good (Cronbach's α 0.96; n=106 allied health students and professionals*)15 |
Convergent validity: good for the 3 outcomes (Pearson's rs: confidence, 0.80; practice, 0.66; sympathy, 0.54; n=106 allied health students and professionals*)15 Discriminative validity: significant difference (p≤0.004) for relevance, terminology, and confidence for levels of EBP training (n=106 allied health students and professionals*)15 Response validity: able to detect impact of EBP training (relevance, p<0.001, ES 0.49; sympathy, p=0.005, ES 0.30; terminology, p<0.001, ES 1.07; practice, p<0.001, ES 1.34; confidence, p<0.001, ES 0.89; n=77 physiotherapy students)6 |
*
Physiotherapy, podiatry, occupational therapy, medical radiation, human movement, nursing and commerce students, and professionals.
EBP=evidence-based practice; PICO=population intervention comparison outcomes; ICC=intra-class correlation coefficient; ES=effect size.