Skip to main content
. Author manuscript; available in PMC: 2020 Jan 1.
Published in final edited form as: Am J Hosp Palliat Care. 2018 Jun 20;36(1):76–88. doi: 10.1177/1049909118783688

Quality Appraisal of All Included Studies

Author
 Year
Components Quality Criteria Yes No Cannot
 tell
Benton et al20 Quantitative non-
 randomized
3.1. Are participants (organizations) recruited in a way that minimizes selection
 bias?
x
3.2. Are measurements appropriate (clear origin, or validity known, or standard
 instrument; and absence of contamination between groups when appropriate)
 regarding the exposure/intervention and outcomes?
x
3.3. In the groups being compared (exposed vs. non-exposed; with intervention
 vs. without; cases vs. controls), are the participants comparable, or do
 researchers take into account (control for) the difference between these
 groups?
x
3.4. Are there complete outcome data (80% or above), and, when applicable, an
 acceptable response rate (60% or above), or an acceptable follow-up rate for
 cohort studies (depending on the duration of follow-up)?
x
Einterz et al12 Quantitative non-
 randomized
3.1. Are participants (organizations) recruited in a way that minimizes selection
 bias?
x
3.2. Are measurements appropriate (clear origin, or validity known, or standard
 instrument; and absence of contamination between groups when appropriate)
 regarding the exposure/intervention and outcomes?
x
3.3. In the groups being compared (exposed vs. non-exposed; with intervention
 vs. without; cases vs. controls), are the participants comparable, or do
 researchers take into account (control for) the difference between these
 groups?
x
3.4. Are there complete outcome data (80% or above), and, when applicable, an
 acceptable response rate (60% or above), or an acceptable follow-up rate for
 cohort studies (depending on the duration of follow-up)?
x
El-Jawahri
 et al13
Quantitative
 randomized
 controlled (trials)
2.1. Is there a clear description of the randomization (or an appropriate sequence
 generation)?
x
2.2. Is there a clear description of the allocation concealment (or blinding when
 applicable)?
x
2.3. Are there complete outcome data (80% or above)? x
2.4. Is there low withdrawal/drop-out (below 20%)? x
Green et al14 Quantitative
 randomized
 controlled (trials)
2.1. Is there a clear description of the randomization (or an appropriate sequence
 generation)?
x
2.2. Is there a clear description of the allocation concealment (or blinding when
 applicable)?
x
2.3. Are there complete outcome data (80% or above)? x
2.4. Is there low withdrawal/drop-out (below 20%)? x
Hanson et al15 Quantitative
 randomized
 controlled (trials)
2.1. Is there a clear description of the randomization (or an appropriate sequence
 generation)?
x
2.2. Is there a clear description of the allocation concealment (or blinding when
 applicable)?
x
2.3. Are there complete outcome data (80% or above)? x
2.4. Is there low withdrawal/drop-out (below 20%)? x
Hing Wong
 et al19
Quantitative non-
 randomized
3.1. Are participants (organizations) recruited in a way that minimizes selection
 bias?
x
3.2. Are measurements appropriate (clear origin, or validity known, or standard
 instrument; and absence of contamination between groups when appropriate)
 regarding the exposure/intervention and outcomes?
x
3.3. In the groups being compared (exposed vs. non-exposed; with intervention
 vs. without; cases vs. controls), are the participants comparable, or do
 researchers take into account (control for) the difference between these
 groups?
x
3.4. Are there complete outcome data (80% or above), and, when applicable, an
 acceptable response rate (60% or above), or an acceptable follow-up rate for
 cohort studies (depending on the duration of follow-up)?
x
Machare Delgado
 et al23
Quantitative non-
 randomized
3.1. Are participants (organizations) recruited in a way that minimizes selection
 bias?
x
3.2. Are measurements appropriate (clear origin, or validity known, or standard
 instrument; and absence of contamination between groups when appropriate)
 regarding the exposure/intervention and outcomes?
x
3.3. In the groups being compared (exposed vs. non-exposed; with intervention
 vs. without; cases vs. controls), are the participants comparable, or do
 researchers take into account (control for) the difference between these
 groups?
x
3.4. Are there complete outcome data (80% or above), and, when applicable, an
 acceptable response rate (60% or above), or an acceptable follow-up rate for
 cohort studies (depending on the duration of follow-up)?
x
Matlock
 et al16
Qualitative 1.1. Are the sources of qualitative data (archives, documents, informants,
 observations) relevant to address the research question (objective)?
x
1.2. Is the process for analyzing qualitative data relevant to address the research
 question (objective)?
x
1.3. Is appropriate consideration given to how findings relate to the context, e.g.
 the setting, in which the data were collected?
x
1.4. Is appropriate consideration given to how findings relate to researchers’
 influence, e.g. through their interactions with participants?
x
Quantitative randomized controlled (trials) 2.1. Is there a clear description of the randomization (or an appropriate sequence
 generation)?
x
2.2. Is there a clear description of the allocation concealment (or blinding when
 applicable)?
x
2.3. Are there complete outcome data (80% or above)? x
2.4. Is there low withdrawal/drop-out (below 20%)? x
Mixed methods 5.1. Is the mixed methods research design relevant to address the qualitative and
 quantitative research questions (or objectives), or the qualitative and
 quantitative aspects of the mixed methods question (or objective)?
x
5.2. Is the integration of qualitative and quantitative data (or results) relevant to
 address the research question (objective)?
x
5.3. Is appropriate consideration given to the limitations associated with this
 integration, e.g. the divergence of qualitative and quantitative data (or results)?
x
Nakagawa
 et al21
Quantitative non-randomized 3.1. Are participants (organizations) recruited in a way that minimizes selection
 bias?
x
3.2. Are measurements appropriate (clear origin, or validity known, or standard
 instrument; and absence of contamination between groups when appropriate)
 regarding the exposure/intervention and outcomes?
x
3.3. In the groups being compared (exposed vs. non-exposed; with intervention
 vs. without; cases vs. controls), are the participants comparable, or do
 researchers take into account (control for) the difference between these groups?
x
3.4. Are there complete outcome data (80% or above), and, when applicable, an
 acceptable response rate (60% or above), or an acceptable follow-up rate for
 cohort studies (depending on the duration of follow-up)?
x
Radwany
 et al22
Quantitative
 randomized
 controlled (trials)
2.1. Is there a clear description of the randomization (or an appropriate sequence
 generation)?
x
2.2. Is there a clear description of the allocation concealment (or blinding when
 applicable)?
x
2.3. Are there complete outcome data (80% or above)? x
2.4. Is there low withdrawal/drop-out (below 20%)? x
Van Scony
 et al17
Quantitative non-
 randomized
3.1. Are participants (organizations) recruited in a way that minimizes selection
 bias?
x
3.2. Are measurements appropriate (clear origin, or validity known, or standard
 instrument; and absence of contamination between groups when appropriate)
 regarding the exposure/intervention and outcomes?
x
3.3. In the groups being compared (exposed vs. non-exposed; with intervention
 vs. without; cases vs. controls), are the participants comparable, or do
 researchers take into account (control for) the difference between these
 groups?
x
3.4. Are there complete outcome data (80% or above), and, when applicable, an
 acceptable response rate (60% or above), or an acceptable follow-up rate for
 cohort studies (depending on the duration of follow-up)?
x
Vogel et al18 Quantitative
 randomized
 controlled (trials)
2.1. Is there a clear description of the randomization (or an appropriate sequence
 generation)?
x
2.2. Is there a clear description of the allocation concealment (or blinding when
 applicable)?
x
2.3. Are there complete outcome data (80% or above)? x
2.4. Is there low withdrawal/drop-out (below 20%)? x