Table 2.
Outcome domains and psychometric properties of instruments used in studies of EBP educational interventions (n = 85)
| Reaction to EBP Teaching Delivery | Attitude | Self-efficacy | Knowledge | Skills | Behaviors | Patient Benefit | |
|---|---|---|---|---|---|---|---|
| Of 85 included studies, number measuring this outcome domain | 7 | 35 | 15 | 39 | 52 | 19 | 0 |
| Studies using previously developed instruments | 0/7 (0) | 24/35 (69) | 5/15 (33) | 24/39 (62) | 20/52 (38) | 7/19 (37) | 0/0 (0) |
| Participant self-reported measure | 7/7 (100) | 35/35 (100) | 15/15 (100) | 0/39 (0) | 0/52 (0) | 18/19 (95) | 0/0 (0) |
| Published/reported psychometric properties | |||||||
| Inter-rater reliabilitya | 0/7 (0) | 0/35 (0) | 0/15 (0) | 8/39 (21) | 15/52 (38) | 2/19 (11) | 0/0 (0) |
| Content validitya | 0/7 (0) | 12/35 (34) | 2/15 (13) | 19/39 (49) | 15/52 (38) | 2/19 (11) | 0/0 (0) |
| Internal validitya | 0/7 (0) | 20/35 (57) | 5/15 (33) | 26/39 (67) | 17/52 (44) | 8/19 (42) | 0/0 (0) |
| Responsive validitya | 0/7 (0) | 8/35 (23) | 1/15 (7) | 11/39 (28) | 10/52 (26) | 1/19 (5) | 0/0 (0) |
| Discriminative validitya | 0/7 (0) | 9/35 (26) | 4/15 (27) | 15/39 (38) | 16/52 (41) | 0/19 (0) | 0/0 (0) |
| Criterion validitya | 0/7 (0) | 4/35 (11) | 1/15 (7) | 2/39 (5) | 1/52 (3) | 2/19 (11) | 0/0 (0) |
| Instrument ≥3 types of established validitya | 0/7 (0) | 8/35 (23) | 0/15 (0) | 14/39 (36) | 14/52 (27) | 0/19 (0) | 0/0 (0) |
aconsidered ‘established’ and counted if the corresponding statistical test was significant. Abbreviation: EBP Evidence-based practice
Definitions: inter-rater reliability, the degree to which the measurement is free from measurement error; content validity, external review of the instrument by EBP experts; internal validity, includes both internal consistency (i.e. the degree of the interrelatedness among the items) and dimensionality (i.e. factor analysis to determine if the instrument measured a unified latent construct); responsive validity, ability to detect the impact of EBP; discriminative validity, ability to discriminate between participants with different levels of EBP; criterion validity, the relationship between the instrument scores and participants’ scores on another instrument with established psychometric properties
Presented as number (%) of included studies within each measured outcome domain