Abstract
Introduction
Breast cancer is the most prevalent cancer and the second leading cause of cancer-related deaths among women in low and middle-income countries (LMICs), including sub-Saharan Africa. Mammography screening is the most effective screening method for the early detection of breast cancers in asymptomatic individuals and the only screening test that decreases the risk of breast cancer mortality. Despite the perceived benefits, it has a low utilisation rate in comparison with breast self-examination and clinical breast examination. Several interventions to increase the uptake of mammography have been assessed as well as systematic reviews on mammography uptake. Nonetheless, none of the published systematic reviews focused on women living in LMICs. The review aims to identify interventions that increase mammography screening uptake among women living in LMICs.
Methods and analysis
Relevant electronic databases will be systematically searched from 1 January 1990 to 30 June 2021 for published and grey literature, including citation and reference list tracking, on studies focusing on interventions to increase mammography screening uptake carried out in LMICs and written in the English language. The search will incorporate the key terms: mammography, interventions, low- and middle-income countries and their associated synonyms. Randomised controlled trials, observational studies and qualitative and mixed methods studies of interventions (carried out with and without comparison groups) reporting interventions to increase mammography screening uptake in LMICs will be identified, data extracted and assessed for methodological quality by two independent reviewers with disagreements to be resolved by consensus or by a third author. We will use narrative synthesis and/or meta-analysis depending on the characteristics of the data.
Ethics and dissemination
Ethical approval is not required as it is a protocol for a systematic review. Findings will be disseminated through peer-reviewed publications and conference presentations.
PROSPERO registration number
CRD42021269556.
Keywords: Breast tumours, PUBLIC HEALTH, HEALTH ECONOMICS
Strengths and limitations of this study.
This systematic review focuses on mammography screening uptake studies conducted in women living in low-income and middle-income countries.
There are no restrictions on the types of study.
Findings can highlight the need to implement existing strategies or further develop strategies aimed at increasing mammography screening uptake.
Non-English electronic databases will not be searched.
Introduction
Cancer, a leading cause of death, is an important hurdle to increasing life expectancy globally. With the rapidly growing incidence and mortality of cancers, female breast cancer is presently the most commonly diagnosed cancer globally, with an estimated 2.3 million cases (11.7%) as well as responsible for 6.9% of cancer-related deaths.1 2 In low and middle-income countries (LMICs) including sub-Saharan Africa (SSA), breast cancer is the most prevalent cancer and the second leading cause of cancer-related deaths among women after cervical cancer.3 The incidence of breast cancer remains high in high-income countries (HICs) in comparison with LMICs.4 5 Notwithstanding, there is a rise in both the number of incident cases and age-specific incident rates in LMICs.5 Regardless of the difficulty in estimating the exact incidence of cancer, including breast cancer in SSA, available data provided strong evidence suggestive of increased incidence of breast cancer in SSA with an average incidence of 33.8 per 1 00 000 women per year.6 The mortality rates of breast cancer in LMICs are marginally higher than in HICs,4 7 8 likewise, the case fatality rates from breast cancer seems to be significantly higher in LMICs than in HICs.5 9 LMICs have low 5-year survival rates of breast cancer, ranging from 12% to 53%, compared with over 85% in HICs.10 11
Stage distribution at breast cancer diagnosis defines the prognosis of cancer and its treatment.3 7–12 Breast self-examination (BSE), clinical breast examination (CBE) and mammography are the most commonly used breast cancer screening methods globally.13 14 Mammography screening is the most effective screening method for the early detection of breast cancers in asymptomatic individuals15 and significantly decreases the risk of breast cancer mortality by 15%–56%.16 Adherence to regular mammography examinations cannot be overemphasised, as it has been shown to cause a reduction in risk of breast cancer mortality.17 CBE is also important particularly for low resource settings as it has been shown to cause a 15% non-significant reduction in mortality.18 While developed countries have implemented population-based mammography screening programmes,19 it is not yet available in most LMICs, including SSA due to very limited resources.3 5 Mammography screening obtainable in few countries of SSA is frequently only accessible by women in urban centres. There are prohibitive out-of-pocket expenses associated with travel and accommodation for women living in semiurban or rural settings.20 In general, mammography has a low utilisation rate in comparison to BSE and CBE20 21; this might be as a result of the unaffordable cost of mammography screening among other factors.7
There are various intervention strategies to increase breast cancer screening. The Community Preventive Services Task Forces (CPSTF) categorised intervention strategies into the following: client-oriented interventions, provider-oriented interventions and informed decision-making.22 23 Client-oriented interventions such as client reminders,24 group education,25 one-on-one education,26 reducing clients’ out-of-pocket costs,27 reducing structural barriers28 and small media29 are recommended by CPSTF as strategies to increase breast cancer screening. Provider-oriented interventions such as provider assessment and feedback30 and provider reminder and recall system31 are interventions that increase screening for breast cancer. Meanwhile, there is insufficient evidence to determine the effectiveness of using client incentives,32 mass media33 as well as provider incentives34 to increase screening for breast cancer. Also, there is insufficient evidence to determine the effectiveness of informed decision-making interventions, targeted at individuals in healthcare settings, community members outside of healthcare settings or healthcare systems and providers, in increasing screening for breast cancer.35 The CPSTF recommends interventions that engage community health workers36 and multicomponent interventions37 to increase screening for breast cancer based on strong evidence of their effectiveness.
Systematic reviews summarising the impact of different interventions to increase uptake of mammography screening have been published.38–45 A previous systematic review39 established that access-enhancing interventions, interventions which improve access to and utilisation of mammography such as transportation to appointments, facilitated scheduling, mobile vans, vouchers and reduced mammogram cost, were most effective in increasing mammography screening. Another systematic review40 concluded that interventions that used peer educators, incorporated multiple intervention strategies (ie, more than one intervention in a study) or provided easy access via vans, cost vouchers or home visits were effective in increasing screenings in low-income women. Different systematic reviews concluded that multiple interventions were the most effective strategy in increasing mammography uptake in women.41 42 A review of trials43 found that letter of invitation, mailed educational material, a phone call and some combined actions (such as a letter of invitation plus phone call and training activities plus reminders) seemed to increase uptake of mammography screening. A meta-analysis44 and a systematic review45 found that access-enhancing strategies followed by individually directed approaches such as individual counselling or education, client reminders and small media were effective in improving mammography uptake among ethnic minority women.
The studies included in the systematic review41 of interventions to increase the uptake of mammography among low-income women were all conducted in HICs. In all published systematic reviews on interventions to increase uptake of mammography screening, we found none focused on women living inLMICs. Therefore, we aim to identify the interventions that increase mammography screening uptake in women living in LMICs.
Methods and analysis
This protocol has been developed following the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) guidelines,46 as shown in the PRISMA-P checklist. The systematic review is prospectively registered with PROSPERO.47 Reporting of the systematic review will be informed by PRISMA guidance.48
Eligibility criteria
The inclusion and exclusion criteria will be guided by the Problem or population, Interventions, Comparisons or Control, Outcome, Time frame, and Study design framework.
Population
Studies whose population included asymptomatic women eligible for mammography screening will be included. We will exclude studies involving women with a prior diagnosis of breast cancer, women who have had a mastectomy and women living outside LMICs.
Interventions
Studies on client-oriented interventions such as client reminders, group education, one-on-one education, small media, mass media and client incentives will be included. Studies on provider-oriented interventions such as provider reminder and recall systems, provider assessment and feedback, and provider incentives will also be included.
Comparison
Studies with or without a comparator group will be included. The comparator group will be women who receive no active intervention or usual care (routine standard screening services such as BSE or CBE).
Outcomes
We will include studies with reported uptake of mammography screening as a result of the interventions.
Time frame
Studies on interventions to increase mammography screening uptake published between 1 January 1990 and 30 June 2021 from LMICs will be included.
Study design
Studies performed in LMICs are eligible for inclusion. We will include studies that employed quantitative, qualitative or mixed-method study design. Furthermore, only studies published in the English language will be considered.
Information sources/search strategy
Published, unpublished and grey literature in the English language will be searched. The search strategy will be developed in collaboration with a medical librarian (online supplemental file). Medical subject heading and free-text terms will be developed and combined to identify published studies on MEDLINE via the OVID interface. The search strategy will then be adapted for EMBASE, Global Health, CINAHL, ASSIA, PsycINFO, Web of Science, Cochrane Central Register of Controlled Trials (CENTRAL) and Google Scholar. Truncation commands (using root words to capture alternative word endings), proximity operators (for words within a chosen distance of each other) and Boolean logic operators (OR and AND) will be used, and to ensure maximum yield, a preliminary trial with search terms will be conducted and refined. We will search African regional databases, including African Index Medicus, African journal online and African Organisation for research and training in cancer, Open Grey and ProQuest Dissertations and Theses Global databases will be searched for more published, unpublished and grey literature. Additional papers will be located through hand searching of citations and reference list tracking and contacts with authors and experts in the field for further information.
bmjopen-2021-056901supp001.pdf (73KB, pdf)
Selection process
The searched studies identified by electronic database searches will be saved in the EndNote library. After deduplication, the titles and abstracts of the studies will be screened independently by two reviewers with disagreements to be resolved by consensus or by a third author. Full text of articles will be retrieved and two reviewers will independently assess the studies for eligibility of inclusion into the review. Disagreements will be resolved by discussion, 10% of the selected studies will be checked by a third reviewer for consistency. The reasons for the exclusion of those studies screened in the full text will be documented.
Data extraction
Two independent reviewers will perform data extraction using a predefined data extraction form, and differences between reviewers will be resolved by discussion and mutual agreement. Key characteristics of the studies of the review to be extracted include:
Author, publication year and funding source.
Journal citation.
Period of study (by year).
Country of study/study setting.
Study population (characteristics and total number enrolled).
Intervention details (types of intervention, the role of intervention, duration of intervention, duration of follow-up), primary outcomes including descriptive statistics, OR or risk ratio.
Quality assessment and risk of bias within studies
We will adapt and use the quality assessment tools listed in table 1. The results of methodological assessments of each study will be reported in narrative forms and tables. The overall quality of the entire set of included studies cannot be merged due to variations in tools and assessment methods. Disagreements that arise between the reviewers will be resolved through discussion.
Table 1.
Quality assessment tools for various study designs
| Tools | Study design |
| Cochrane risk of bias tool EPHPP tools50 |
Randomised controlled trials Cohort studies (one group pre +post (before and after)) Case–control studies Controlled clinical trials Cross-sectional studies Other non-randomised studies of intervention |
| CASP checklist51 | Qualitative studies (eg, focused group discussions, interviews) |
| MMAT tools52 | Mixed method studies |
CASP, Critical Appraisal Skills Programme; EPHPP, Effective Public Health Practice Project; MMAT, Mixed Methods Appraisal Tool.
Data synthesis
Due to the expected heterogeneity in the studies, we will first conduct a narrative synthesis of data from included studies according to Popay et al.49 We will conduct a meta-analysis of data from included studies, if possible. Our primary analyses will pool overall summary effects by intervention type to determine the effectiveness of different interventions for increasing uptake of mammography screening. Heterogeneity will be assessed by Cochrane Q statistics and the I2 statistics. A p<0.05 will be considered to be significant for the Q statistical test and I2 >75% will represent substantial heterogeneity. Depending on the data collected, OR or any other suitable summary statistics will be used as the outcome measure. The choice of a random-effects model or a fixed-effects model for a meta-analysis will depend on the level of heterogeneity. We will conduct exploratory subgroup analyses by intervention type, if possible. A persistent high degree of heterogeneity (I2 >75%) after exploring the subgroups will prevent a meta-analysis. Meta-bias assessment will be performed using Egger’s test and visualised with a funnel plot. We will also conduct a sensitivity analysis. The Review Manager Software V.5.4 will be used for analysis.
Patient and public involvement
No patient involved
Supplementary Material
Footnotes
Contributors: IJN and OIE conceived this systematic review. IJN drafted the protocol. CEO developed the search strategy. OIE, ILE, CEO and GUE reviewed the protocol and provided extensive feedback. IJN registered the protocol with PROSPERO. All authors read and approved the final manuscript.
Funding: The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests: None declared.
Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Provenance and peer review: Not commissioned; externally peer reviewed.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
Ethics statements
Patient consent for publication
Not applicable.
References
- 1.Sung H, Ferlay J, Siegel RL. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CACancer J Clin 2021;0:1–41. [DOI] [PubMed] [Google Scholar]
- 2.World Health Organization|International Agency for Research on Cancer- Global Cancer Observatory . Age standardized (world) incidence rates, breast, all ages. International agency for research on cancer. WHO, 2018: 1–2. [Google Scholar]
- 3.Ba DM, Ssentongo P, Agbese E, et al. Prevalence and determinants of breast cancer screening in four sub-Saharan African countries: a population-based study. BMJ Open 2020;10:1–8. 10.1136/bmjopen-2020-039464 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Francies FZ, Hull R, Khanyile R, et al. Breast cancer in low-middle income countries: abnormality in splicing and lack of targeted treatment options. Am J Cancer Res 2020;10:1568–91. [PMC free article] [PubMed] [Google Scholar]
- 5.Pace LE, Shulman LN. Breast cancer in sub-Saharan Africa: challenges and opportunities to reduce mortality. Oncologist 2016;21:739–44. 10.1634/theoncologist.2015-0429 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Azubuike SO, Muirhead C, Hayes L, et al. Rising global burden of breast cancer: the case of sub-Saharan Africa (with emphasis on Nigeria) and implications for regional development: a review. World J Surg Oncol 2018;16:1–13. 10.1186/s12957-018-1345-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Tsu D, Jeronimo J, Anderson BO. Why the time is right to tackle breast and cervical cancer in low-resource settings. Bull World Heal Organ 2013. 10.2471/BLT.12.116020 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Anderson BO, Ilbawi AM, El Saghir NS. Breast cancer in low and middle income countries (LMICs): a shifting tide in global health. Breast J 2015;21:111–8. 10.1111/tbj.12357 [DOI] [PubMed] [Google Scholar]
- 9.Shulman LN, Willett W, Sievers A, et al. Breast cancer in developing countries: opportunities for improved survival. J Oncol 2010;2010:1–6. 10.1155/2010/595167 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Sankaranarayanan R, Swaminathan R, Brenner H, et al. Cancer survival in Africa, Asia, and central America: a population-based study. Lancet Oncol 2010;11:165–73. 10.1016/S1470-2045(09)70335-3 [DOI] [PubMed] [Google Scholar]
- 11.Ssentongo P, Lewcun JA, Candela X, et al. Regional, racial, gender, and tumor biology disparities in breast cancer survival rates in Africa: a systematic review and meta-analysis. PLoS One 2019;14:e0225039. 10.1371/journal.pone.0225039 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.da Costa Vieira RA, Biller G, Uemura G, et al. Breast cancer screening in developing countries. Clinics 2017;72:244–53. 10.6061/clinics/2017(04)09 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Shah TA, Guraya SS. Breast cancer screening programs: review of merits, demerits, and recent recommendations practiced across the world. J Microsc Ultrastruct 2017;5:59. 10.1016/j.jmau.2016.10.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Coleman C. Early detection and screening for breast cancer. Semin Oncol Nurs 2017;33:141–55. 10.1016/j.soncn.2017.02.009 [DOI] [PubMed] [Google Scholar]
- 15.Islam SR, Aziz SM. Mammography is the most effective method of breast cancer screening. Mymensingh Med J 2012;21:366. [PubMed] [Google Scholar]
- 16.Mandrik O, Zielonke N, Meheus F, et al. Systematic reviews as a 'lens of evidence': Determinants of benefits and harms of breast cancer screening. Int J Cancer 2019;145:994–1006. 10.1002/ijc.32211 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Mittra I, Mishra GA, Dikshit RP, et al. Effect of screening by clinical breast examination on breast cancer incidence and mortality after 20 years: prospective, cluster randomised controlled trial in Mumbai. BMJ 2021;372:n256. 10.1136/bmj.n256 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Duffy SW, Tabár L, Yen AM-F, et al. Beneficial effect of consecutive screening mammography examinations on mortality from breast cancer: a prospective study. Radiology 2021;299:541–7. 10.1148/radiol.2021203935 [DOI] [PubMed] [Google Scholar]
- 19.Klabunde CN, Ballard-Barbash R, for the International Breast Cancer Screening Network . Evaluating population-based screening mammography programs internationally. Semin Breast Dis 2007;10:102–7. 10.1053/j.sembd.2007.09.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Black E, Richmond R. Improving early detection of breast cancer in sub-Saharan Africa: why mammography may not be the way forward. Global Health 2019;15:1–11. 10.1186/s12992-018-0446-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Li J, Shao Z. Mammography screening in less developed countries. Springerplus 2015;4:615. 10.1186/s40064-015-1394-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Baron RC, Rimer BK, Coates RJ, et al. Methods for conducting systematic reviews of evidence on effectiveness and economic efficiency of interventions to increase screening for breast, cervical, and colorectal cancers. Am J Prev Med 2008;35:S26–33. 10.1016/j.amepre.2008.04.003 [DOI] [PubMed] [Google Scholar]
- 23.Atere-Roberts J, Smith JL, Hall IJ. Interventions to increase breast and cervical cancer screening uptake among rural women: a scoping review. Cancer Causes Control 2020;31:965–77. 10.1007/s10552-020-01340-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Community Preventive Services Task Force T . Increasing cancer screening: client reminders Task force finding and rationale statement intervention definition; 2013.
- 25.Community Preventive Services Task Force T . Increasing cancer screening: group education for clients Task force finding and rationale statement intervention definition; 2013.
- 26.Community Preventive Services Task Force T . Increasing cancer screening: One-on-One education for clients Task force finding and rationale statement intervention definition; 2013.
- 27.Sa S, LB S, Km W. Increasing cancer screening: reducing client out-of-pocket costs Task force finding and rationale statement intervention definition publications, 2013. [Google Scholar]
- 28.Community Preventive Services Task Force T . Increasing cancer screening: reducing structural barriers for clients Task force finding and rationale statement intervention definition; 2013.
- 29.Community Preventive Services Task Force T . Increasing cancer screening: small media targeting clients Task force finding intervention definition Task force finding; 2005.
- 30.Sa S, LB S, Km W. Increasing cancer screening: provider assessment and feedback Task force finding and rationale statement intervention definition publications, 2013. [Google Scholar]
- 31.Community Preventive Services Task Force T . Increasing cancer screening: provider reminder and recall systems Task force finding intervention definition; 2013.
- 32.Sa S, LB S, Km W. Increasing cancer screening: client incentives Task force finding and rationale statement intervention definition publications, 2013. [Google Scholar]
- 33.Sa S, LB S, Km W. Increasing cancer screening: mass media targeting clients Task force finding and rationale statement intervention definition publications, 2013. [Google Scholar]
- 34.Sa S, LB S, Km W. Increasing cancer screening: provider incentives Task force finding and rationale statement intervention definition publications, 2013. [Google Scholar]
- 35.Community Preventive Services Task Force T . Cancer Prevention and Control, Promoting Informed Decision Making for Cancer Screening Task Force Finding Intervention Definition; 2010.
- 36.Community Preventive Services Task Force T . Cancer Screening: Interventions Engaging Community Health Workers-Breast Cancer Community Preventive Services Task Force Finding and Rationale Statement Ratified., 2019. Available: www.thecommunityguide.org/findings/cancer-screening-small-media-targeting-clients-breast-cancer [Accessed 21 Mar 2021].
- 37.Community Preventive Services Task Force T . CPSTF Finding and Rationale Statement - Increasing Breast Cancer Screening: Multicomponent Interventions; 2019.
- 38.Sin JP, St Leger AS. Interventions to increase breast screening uptake: do they make any difference? J Med Screen 1999;6:170–81. 10.1136/jms.6.4.170 [DOI] [PubMed] [Google Scholar]
- 39.Legler J, Meissner HI, Coyne C, et al. The effectiveness of interventions to promote mammography among women with historically lower rates of screening. Cancer Epidemiol Biomarkers Prev 2002;11:59–71. [PubMed] [Google Scholar]
- 40.Bailey TM, Delva J, Gretebeck K, et al. A systematic review of mammography educational interventions for low-income women. Am J Health Promot 2005;20:96–107. 10.4278/0890-1171-20.2.96 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Gardner MP, Adams A, Jeffreys M. Interventions to increase the uptake of mammography amongst low income women: a systematic review and meta-analysis. PLoS One 2013;8:e55574. 10.1371/journal.pone.0055574 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Lu M, Moritz S, Lorenzetti D, et al. A systematic review of interventions to increase breast and cervical cancer screening uptake among Asian women. BMC Public Health 2012;12:1. 10.1186/1471-2458-12-413 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Bonfill X, Marzo M, Pladevall M, et al. Strategies for increasing women participation in community breast cancer screening. Cochrane Database Syst Rev 2001:CD002943. 10.1002/14651858.CD002943 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Han H-R, Lee J-E, Kim J, et al. A meta-analysis of interventions to promote mammography among ethnic minority women. Nurs Res 2009;58:246–54. 10.1097/NNR.0b013e3181ac0f7f [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Baron RC, Rimer BK, Breslow RA, et al. Client-directed interventions to increase community demand for breast, cervical, and colorectal cancer screening a systematic review. Am J Prev Med 2008;35:SUPPL. 10.1016/j.amepre.2008.04.002 [DOI] [PubMed] [Google Scholar]
- 46.Moher D, Shamseer L, Clarke M. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Rev Esp Nutr Humana y Diet 2016;20:148–60. 10.1186/2046-4053-4-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Nduka I, Ejie I, Okafor E. Interventions to increase mammography screening uptake among women living in low and middle-income countries: a protocol for a systematic review. prospero 2021 CRD42021269556 2021:1–5 https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021269556
- 48.Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009;6:e1000097. 10.1371/journal.pmed.1000097 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Popay J, Roberts H, Sowden A. Guidance on the conduct of narrative synthesis in systematic reviews a product from the ESRC methods programme Peninsula medical school. Universities of Exeter and Plymouth., 2006. [Google Scholar]
- 50.EHPP . Quality assessment tool for quantitative studies.
- 51.Critical Appraisal Skills Programme . CASP Qualitative Checklist. CASP Online; 2018: 1. https://casp-uk.net/%0Ahttp://www.casp-uk.net/casp-tools-checklists
- 52.Hong Q, Pluye P, bregues S F. Mixed methods appraisal tool (MMAT), version 2018. User guide. McGill, 2018: 1–11. http://mixedmethodsappraisaltoolpublic.pbworks.com/w/file/fetch/127916259/MMAT_2018_criteria-manual_2018-08-01_ENG.pdf%0Ahttp://mixedmethodsappraisaltoolpublic.pbworks.com/ [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjopen-2021-056901supp001.pdf (73KB, pdf)
