Skip to main content
. 2020 May 31;9:122. doi: 10.1186/s13643-020-01390-x

Table 2.

Criteria and coding used during Risk of Bias assessment following CASP checklist [27]

Design Criteria to assess risk of bias Coding
Section A
Are the results of the study valid? 1. Aims of the research Clarity on every statement of which the research project was based on

Yes—it is clear what was the aim of the study and relevance

Cannot tell—insufficient data

No—lack of data on the aims of the study, importance and/or relevance on the studied topic

2. Appropriate methodology Adopted methodology to Conduct the study was well chosen according to the research question

Yes—research seeks to interpret the actions and/or subjective experiences of participants; qualitative Methodology is the central used to address research aims.

Cannot tell—insufficient data

No—inadequate interpretation on the actions and/or subjective experiences of participants; qualitative is not the right methodology to address research goal

Is it worth continuing? 3. Appropriate design Selection of proper study design

Yes—researcher justifies and reveals the reason behind the choice of determined research design

Cannot tell—insufficient data

No—no information upon research design decision-making available

4. Appropriate recruitment strategy Description on the selection of patients’ procedure and explanation on eligibility criteria

Yes—clear explanation on how patients were selected and why this procedure was the most suitable to provide answers sought by the research; justification in case exclusion criteria

Cannot tell—insufficient data

No—lack of information upon eligibility criteria; unclear information regarding selection procedure

5. Appropriate data collection Data collection was done adequately to address the research issue

Yes—clear justification on data collection (e.g., focal group, semi-structured interview); clear explanation on methods used during interviews; documentation in case of changes in methods along the study (if yes: how and why); clear form of data (e.g., tape, video, notes); discussion upon saturation of data

Cannot tell—insufficient data

No—gaps or missing information on regarding setting, script, interview guide, implemented methods, form of data, sample size characteristics

6. Consideration of relationship between researcher and participants Consideration on influences faced along the development of the research and its potential consequences

Yes—critical examination on potential bias during formulation of research question, data collection, recruitment procedure and setting; clear explanation on how was the response to certain events during the study and implications for research design

Cannot tell—insufficient data

No—lack of discussion upon potential limitations and bias present in the study

Section B
What are the results? 7. Ethical issues Adherence to ethical standards

Yes—research successfully explained details for included patients; data upon informed consent, confidentiality or management of information during and after the study; consultation to ethical committee

Cannot tell—insufficient data

No—lack or poor information regarding actions taken according to ethical standards (informed consent, explanation on research aims to patients)

8. Rigorous data analysis Data analysis reporting is complete and detailed

Yes—clear in-depth description of analysis process, with explanation on how categories/themes were created from data analysis; sufficient data to support findings; accountability of contradictory data; critical examination on potential bias and influence during analysis and selection of data for presentation

Cannot tell—insufficient data

No—presented data is not supported by relevant information on how it was analyzed; gaps regarding development of themes/subthemes or/and missing explanation on the reason behind selection of certain data and potential bias

9. Statement of findings Clarity and adequate explanation on the findings

Yes—findings of the studies are explicit an there is proper discussion using evidence both for and against studies argument; findings are analyzed and checked regarding credibility; findings suits research main question

Cannot tell—insufficient data

No—findings are poorly explicit and there is a lack of discussion using evidence both agreeing and disagreeing with the findings; no credibility regarding findings was clearly stated; findings do not answer main research question

Section C
Will the results help locally? 10. Relevance Contribution research findings brings to communities

Yes—discussion is made upon impact of research on existing knowledge, policies, practices or relevant literature; study discuss new areas for future research are; researches discuss how the findings could be transferred to different populations or suggest different approaches for similar investigations

Cannot tell—insufficient data

No—no information regarding impact of research on existing literature, policies, and practices; study does not present any suggestion for future research directions; research does not discuss about how to transfer findings to different population