Table 2.
Domain | Item | Studies N (%) |
Score | Mean (SD) | ||
---|---|---|---|---|---|---|
Item | Maximum Domain | Item | Domain | |||
Study Design | 3 | 1.13 (0.29) | 1.13 (0.29) | |||
1.Study Design | ||||||
Single group cross-sectional or single group post-test only | 13 (81.3) | 1 | ||||
Single group pre and post-test | 2 (12.5) | 1.5 | ||||
Non-randomized, 2 group | 1 (6.3) | 2 | ||||
Randomized controlled experiment | 3 | |||||
Sampling | ||||||
2. Institutions | 3 | 0.81 (0.48) | 2.06 (0.92) | |||
Single institution | 11 (68.8) | 0.5 | ||||
Two institutions | 1 | |||||
More than 2 institutions | 5 (31.2) | 1.5 | ||||
3. Response Rate | 1.25 (0.50) | |||||
Not applicable | 10 (62.5) | n/a | ||||
Response rate < 50% or not reported | 1 (6.3) | 0.5 | ||||
Response rate 50–74% | 1 | |||||
Response rate ≥ 75% | 3 (18.8) | 1.5 | ||||
Type of Data | ||||||
4. Type of Data | 3 | 2.69 (0.75) | 2.69 (0.75) | |||
Assessment by study subject | 2 (12.5) | 1 | ||||
Objective measurement | 14 (87.5) | 3 | ||||
Validity of Evaluation Instruments’ Scores | ||||||
Not applicable | 9 (56.3) | n/a | ||||
5. Internal Structure | 3 | 0.50 (0.55) | 1.17 (1.33) | |||
Not reported | 3 (18.8) | 0 | ||||
Reported | 3 (18.8) | 1 | ||||
6. Content | ||||||
Not reported | 3 (18.8) | 0 | 0.50 (0.55) | |||
Reported | 3 (18.8) | 1 | ||||
7. Relationships to other variables | ||||||
Not reported | 5 (31.2) | 0 | 0.17 (0.41) | |||
Reported | 1 (6.3) | 1 | ||||
Data Analysis | ||||||
8. Appropriateness of analysis | 3 | 1.0 (0.0) | 2.19 (0.40) | |||
Data analysis inappropriate for study design or type of data | 0 | |||||
Data analysis appropriate for study design and type of data | 16 (100) | 1 | ||||
9. Sophistication of analysis | 1.19 (0.40) | |||||
Descriptive analysis only | 13 (81.2) | 1 | ||||
Beyond descriptive analysis | 3 (18.8) | 2 | ||||
Outcome | ||||||
10. Outcome | 3 | 1.37 (0.23) | 1.37 (0.23) | |||
Satisfaction, attitudes, perceptions, opinions, general facts | 4 (26.7) | 1 | ||||
Knowledge, skills | 11 (68.8) | 1.5 | ||||
Behaviors | 2 | |||||
Patient/health care outcome | 3 | |||||
TOTAL | 18 | 10.6 (1.65) |
aMedical Education Research Study Quality Instrument