TABLE 3.
Number of studies meeting criteria for generalizability markers [adapted from reference (23) with permission of the publisher (copyright 2018 Wiley Periodicals, Inc)]
| Generalizability marker | Criteria | Response | Number of studies meeting criteria |
|---|---|---|---|
| Sampling robustness | What was the institutional setting? | Statewide or multiple institutions | 3 |
| One institution | 59 | ||
| What was the sample size? | Sample size equal or above 300 participants | 18 | |
| Sample size below 300 participants | 44 | ||
| Was there a comparison group? | Comparison group | 49 | |
| No comparison group | 13 | ||
| Was the study a longitudinal design (i.e., data at multiple times for at least one cohort of students)? | Yes, it was a longitudinal study | 59 | |
| No, it was not a longitudinal study | 3 | ||
| Was the study multiple cohorts? | Yes, it was multiple cohorts | 51 | |
| No, it was not multiple cohorts | 11 | ||
| Modeling technique | What method(s) were used to test relationship(s) between learning outcomes and independent variables? | Regression | 4 |
| Correlation | 2 | ||
| t-Test, ANOVA, or chi-square analysis | 47 | ||
| Descriptive analysis | 9 | ||
| Limitations stated | Did author describe the limitations of the study’s findings or methods? | Yes | 30 |
| No | 32 |