The values of qualitative research in health policy planning and development, health services organisation and delivery, and enhancing the understanding of comprehensive health interventions have been increasingly recognised over the past two decades.1, 2, 3 Qualitative research seeks to, in its nature, explore and/or explain the phenomena in the real world, which shape or are shaped by human perspectives, experiences, and wider political, social, and cultural contexts. For health system strengthening, this is an appropriate method to understand “how” norms and stakeholders influence the design and function of health systems, “why” intended outcomes are achieved or are not achieved, and “what” the unintended outcomes are.
In 2016, an open letter from Trisha Greenhalgh and other 75 senior academics from 11 countries to the editors of The BMJ4 triggered a wide debate on the value of and publication bias in qualitative research.2,5 The bibliometric analysis suggested the low proportion of original qualitative research in healthcare published in health journals,6,7 and the publication was significantly associated with journals’ policies expressed through the specific instructions for authors and editorial/methodological papers on the subject.6 The analysis also revealed that UK journals had a higher proportion of published qualitative studies, and that authors from English-speaking countries cited qualitative studies more frequently.6,7 This phenomenon may imply the disparity in research tradition, culture, and training system across different countries.
The arguments for infrequently publishing qualitative studies may center on less familiar qualitative research methods, challenges in appraising the quality of qualitative research, and inadequate reporting quality. Qualitative research allows for theoretical and methodological flexibility, which is its strength to deeply explore and understand the context specificity of the study questions. Standardised randomised controlled trials may examine the effectiveness of comprehensive health intervention, while qualitative research can be the most suitable approach to exploring health needs, understanding the complexity of intervention implementation, and supporting knowledge translation and adaptation in specific settings. There is guidance for qualitative research, but no “recipes”. The quality and rigor of qualitative studies demands inter- and multi-disciplinary assessment of the rationale for a qualitative design, sampling details, data collection and analysis, research team and reflexivity (refers to researchers self-conscious of their own influence on the research process and interpretation) as well as ethical considerations.8,9 Unsurprisingly, some scholars and health professionals may find it difficult to distinguish good from poor qualitative research given the epistemological diversity. In addition, qualitative research training is not to the same extent as the long tradition of quantitative studies in the area of health services research. Over the past decades, leading medical journals, like The BMJ and The Lancet, and the health services research society published educational series, methodological papers, and appraisal standards (in terms of diverse theoretical orientations and approaches) on qualitative research aiming to improve qualitative research literacy in the community. Based on the 22 existing checklists and guidelines for reviewing and reporting qualitative studies, Allison Tong and colleagues developed a 32-item checklist, Consolidated Criteria for Reporting Qualitative Studies (COREQ) to support transparency in qualitative research methods.10 Nevertheless, the low priority of disseminating qualitative studies may prolong the efforts of recognising its value and undermine interest in funding and conducting qualitative research, particularly in low- and middle-income countries due to insufficient training and capacity to carry out this type of research.
To promote the dissemination of meaningful and impactful qualitative evidence for health, continued efforts for education and capacity building of conducting, reporting, and appraising high-quality qualitative studies are needed. The application of the qualitative approach in health-related research should be considered to integrate into medical and public health training curricula. The areas of health services research, health policy, and system research often encourage multi-disciplinary collaboration. The research team could ensure qualitative expertise throughout the lifespan of the study (from the study design to results dissemination) to enhance validity, reliability, and transparency in implementing and reporting qualitative study. This also provides the training opportunity to strengthen the research capacity in qualitative and mixed-methods studies through research cooperation, especially for young researchers in low- and middle-income countries. Similarly, the academic community may assist the journal editors to invite guest editors and reviewers with qualitative expertise. Increased openness to scientifically sound qualitative studies in prominent medical and public health journals will serve as a significant signal of progress and provide learning platforms for advancing the understanding of the strength of qualitative evidence in health.
Contributors
QL conceived and drafted the manuscript. HJ commented and edited the manuscript.
Declaration of interests
The authors declare that they have no competing interests.
Acknowledgements
Funding: None.
References
- 1.Williams V., Boylan A., Nunan D. Qualitative research as evidence: expanding the paradigm for evidence-based healthcare. BMJ Evid Based Med. 2019;24:168–169. doi: 10.1136/bmjebm-2018-111131. [DOI] [PubMed] [Google Scholar]
- 2.Daniels K., Loewenson R., George A., et al. Fair publication of qualitative research in health systems: a call by health policy and systems researchers. Int J Equity Health. 2016;15(1):1–9. doi: 10.1186/s12939-016-0368-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Jones R. Strength of evidence in qualitative research. J Clin Epidemiol. 2007;60(4):321–323. doi: 10.1016/j.jclinepi.2006.06.001. [DOI] [PubMed] [Google Scholar]
- 4.Greenhalgh T., Annandale E., Ashcroft R., et al. An open letter to the BMJ editors on qualitative research. BMJ. 2016:352. doi: 10.1136/bmj.i563. [DOI] [PubMed] [Google Scholar]
- 5.Toews I., Glenton C., Lewin S., et al. Extent, awareness and perception of dissemination bias in qualitative research: an explorative survey. PLoS One. 2016;11(8) doi: 10.1371/journal.pone.0159290. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Mori H., Nakayama T. Academic impact of qualitative studies in healthcare: bibliometric analysis. PLoS One. 2013;8(3) doi: 10.1371/journal.pone.0057371. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Shuval K., Harker K., Roudsari B., et al. Is qualitative research second class science? A quantitative longitudinal examination of qualitative research in medical journals. PLoS One. 2011;6(2) doi: 10.1371/journal.pone.0016937. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Kuper A., Reeves S., Levinson W. An introduction to reading and appraising qualitative research. BMJ. 2008;337 doi: 10.1136/bmj.a288. [DOI] [PubMed] [Google Scholar]
- 9.Rendle K.A., Abramson C.M., Garrett S.B., Halley M.C., Dohan D. Beyond exploratory: a tailored framework for designing and assessing qualitative health research. BMJ Open. 2019;9(8) doi: 10.1136/bmjopen-2019-030123. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Tong A., Sainsbury P., Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–357. doi: 10.1093/intqhc/mzm042. [DOI] [PubMed] [Google Scholar]