Table 2.
Outcome measures for evaluation studies and quality assessment
| Outcome measure | Mixed methods appraisal tool score | |||||
|---|---|---|---|---|---|---|
| Quantitative (and time point) | Qualitative | Qualitative | Quantitative | Mixed methods | TOTAL score (out of maximum) | |
| Participant interviews | ||||||
| 5.1 – Y | 8/11 | |||||
| Janssen et al., 2013 [15] | Edmonton Research Orientation Survey (EROS) | 1.1-Y | 3.1-Y | 5.2- Y | ||
| (pre, post,12 months follow up) | 1.2- Y | 3.2-Y | 5.3- Y | |||
| VAS-Confidence & motivation towards research | 1.3-Y | 3.3- N | ||||
| 1.4-Unclear | 3.4- Unclear | |||||
| Perry et al., 2008 [14] | Service user survey (post) | Senior manager interviews | 5.1 –Y | 7/11 | ||
| Audit of requests for support | 1.1-Y | 4.1- Unclear | 5.2- Y | |||
| 1.2- Y | 4.2-Unclear | 5.3- Y | ||||
| 1.3-Y | 4.3- Y | |||||
| 1.4-Unclear | 4.4- N | |||||
| Ried et al., 2007 [9, 16] | Research Spider (pre-post) | Participant interviews | 1.1-Y | 4.1- Y | 5.1 – Y | 8/11 |
| 1.2- Unclear | 4.2 –Y | 5.2- Y | ||||
| publications, personal higher degree enrolment | 1.3-Unclear | 4.3-Y | 5.3- Unclear | |||
| 1.4- Y | 4.4-Y | |||||
| Williams et al., 2015 [18] | Research Capacity and Cultlure questionnaire | n/a | 4.1-Y | 3/4 | ||
| Self-report of research activity undertaken | 4.2- Y | |||||
| 4.3- Y | ||||||
| 4.4-Unclear | ||||||
N.B. Qualitative 1.1. Are the sources of qualitative data relevant to address the research question?1.2. Is the process for analyzing qualitative data relevant to address the research question? 1.3. Is appropriate consideration given to how findings relate to the context1.4. Is appropriate consideration given to how findings relate to researchers’ influence, ? 3. Quantitative nonrandomized 3.1. Are participants recruited in a way that minimizes selection bias? 3.2. Are measurements appropriate (clear origin, or validity known, or standard instrument; and absence of contamination between groups when appropriate) regarding the exposure/intervention and outcomes? 3.3. In the groups being compared are the participants comparable, or do researchers take into account the difference between these groups? 3.4. Are there complete outcome data (80 % or above), Quantitative descriptive 4.1. Is the sampling strategy relevant to address the quantitative research question? 4.2. Is the sample representative of the population understudy? 4.3. Are measurements appropriate (clear origin, or validity known, or standard instrument)?4.4. Is there an acceptable response rate (60 % or above)? 5. Mixed methods 5.1. Is the mixed methods research design relevant to address the research questions? 5.2. Is the integration of qualitative and quantitative data (or results*) relevant to address the research question (objective)? 5.3. Is appropriate consideration given to the limitations associated with this integration, e.g., the divergence of qualitative and quantitative