Table 1.
Methodological Quality Characteristic | Scoring Options (Maximum total score = 21 points) | Distribution of characteristics among (28) reviewed studies |
|
---|---|---|---|
Frequency (n) | Percent (%) | ||
Conceptual | |||
Does a theoretical framework drive the study? | Explicit use of theory = 2 points Implicit use of theory = 1 point Not reported = 0 points |
17 1 10 |
60.7 3.6 35.7 |
Research Design | |||
What is the research paradigm? | Experimental = 3 points [e.g., RCT] Quasi-experimental = 2 points [e.g., observational, comparison pre-test/post-test] Non-experimental = 1 point [e.g., exploratory and/or qualitative] |
4 4 20 |
14.3 14.3 71.4 |
What is the study’s design? |
Longitudinal = 2 points Cross-sectional = 1 point |
5 23 |
17.9 82.1 |
Does the study exclusively focus on African American men? | Yes = 1 point No = 0 points |
0 28 |
0 100 |
Sampling | |||
What is the sample design? | Random/Nationally Representative = 3 points Random/Not Nationally Representative = 2 points Convenience/Nonprobability = 1 point |
1 9 18 |
3.6 32.1 64.3 |
What is the sample size? | Large (n >300) = 2 points Medium (100 ≥ n ≥ 300) = 1 points Small (n < 100) = 0 points |
3 10 3 |
10.7 35.7 10.7 |
Data Analyses | |||
What were the most advanced statistical techniques utilized? | Multivariate statistics = 4 points (e.g., Structural Equation Modeling) Multiple/Logistic Regression = 3 points ANOVA/Bivariate statistics = 2 points Descriptive/Univariate statistics = 1 point Qualitative analyses = 0 points (e.g., Grounded Theory, Content Analysis) |
9 8 4 5 2 |
32.1 28.6 14.3 17.9 7.1 |
Was any validity reported? | Yes = 1 point No = 0 points |
8 20 |
28.6 71.4 |
Was any reliability reported? | Yes = 1 point No = 0 points |
8 20 |
28.6 71.4 |
Were appropriate conclusions inferred? | Yes = 1 point No = 0 points |
28 0 |
100 0 |