Berry bush, a source of nutrition and health, by Dreamtime Publications, commissioned by the Australian National Medical and Health Research Council.
This editorial accompanies a series of Cochrane Library Special Collections on the health of Indigenous peoples in Australia, Canada, and New Zealand, focusing on diabetes, fetal alcohol syndrome disorders, and suicide prevention. Another editorial provides an overview: Improving health outcomes for Indigenous peoples: what are the challenges?
Cochrane Reviews can provide valuable evidence to support an accountable decision‐making process to improve Indigenous people's health. Such a process needs to consider community values, preferences, local needs, and resource use, as well as provide opportunities for feedback and debate.
In this editorial, we highlight strengths and limitations of systematic reviews in the context of Indigenous health, and we propose key steps to ensure systematic reviews are able to meet this challenge. We use the collective term ‘Indigenous’ when referring to first peoples, respectfully acknowledging the diversity and autonomy of different communities included in this broad term.
The Campbell and Cochrane Equity Methods Group (equity.cochrane.org) promotes the need to consider health equity in the design, conduct, and reporting of systematic reviews. Using the term ‘health equity’ reflects our commitment to redress avoidable and unfair health inequalities. We promote the use of a holistic approach built on the social determinants of health to consistently and explicitly consider whether effects of interventions are unfairly distributed across socially stratifying characteristics. These include the components of the PROGRESS‐Plus framework: place of residence, race/ethnicity/culture/language, occupation, gender/sex, religion, education, socioeconomic status, and social capital, plus three other axes of time‐dependence (e.g. discharge from hospital), personal characteristics (e.g. age), and relationships.
The health inequities seen and consistently reported among Indigenous peoples in affluent countries worldwide are unacceptable. These inequities are strongly related to a severe disadvantage in access to the social determinants of health–a result of colonisation, which stripped cultural identity, misappropriated land through coercion, and disempowered and persecuted Indigenous peoples. Improving health equity for Indigenous people is an international priority, and high‐quality, appropriate systematic reviews are a particularly important tool to assist decision‐makers. The need for effective interventions is urgent, health issues are often complex, and resources may be limited relative to need. High‐quality reviews, such as Cochrane Reviews, have overall been remarkably successful in influencing practice and policy, helping to improve funding sustainability of effective programs but also leading to better health status for Indigenous people.
Systematic reviews enable learning from available research by transparently collating and synthesising all evidence available for a particular question, with careful critical appraisal to assess the influence of study quality and risk of bias. Despite these potential benefits, there are several challenges to the effective use of evidence from systematic reviews in Indigenous health. Foremost, the relationships between Indigenous communities and predominantly non‐Indigenous researchers have historically been poor, limiting the quantity and quality of relevant primary research available for synthesis. Research conducted with and by Indigenous peoples is critical, to ensure correct processes and community values are respected and to ensure questions are framed and prioritised appropriately.
What does this mean for systematic review authors? Combining the impact across different populations and settings has been the main focus of Cochrane Reviews, but if we want to inform health equity, we must also interrogate and use the invaluable diversity of data from different populations, settings, and processes of both research and implementation. Mixing this diversity into a single estimate will hide important differences. The PRISMA‐Equity statement provides reporting guidelines to improve the applicability of systematic reviews to health equity questions, including relevance to Indigenous peoples. Addressing health inequities is complex, particularly in the context of Indigenous health, and sophisticated evidence synthesis methods are required to illuminate these complexities.
The PRISMA‐Equity reporting guideline recommends 20 items for equity‐focused systematic reviews. These include describing the underlying program theory (including a visual logic model, if used), the rationale for eligible study designs that are fit for purpose (including non‐randomised studies, which are likely to be particularly relevant for research addressing social determinants of health), selection of outcomes (and their importance for improving health equity), population characteristics across PROGRESS‐Plus, reporting of additional analyses (such as subgroup analysis, meta‐regression, process evaluation or mixed methods synthesis including qualitative data), and discussion of limits of applicability.
How good are systematic reviews currently at reporting these items? PROGRESS‐Plus details are reported in less than 50% of systematic reviews, with sex and age being the most commonly reported. One limitation to reporting PROGRESS‐Plus characteristics is the extent to which they are reported in primary research studies, but up to half of the information on PROGRESS‐Plus characteristics described in primary studies is not reported in systematic reviews. Lack of reporting is a major barrier to considering external validity of findings to populations and settings beyond those included in the primary studies. Randomised controlled trials and other primary studies may be intentionally restrictive, either explicitly excluding people with certain characteristics (e.g. older age, multiple comorbidities) or implicitly excluding people by their recruitment strategies. In evaluating the utility of existing research, consideration needs to be given to the acceptability of different study designs to Indigenous peoples. In particular, an important consideration when interpreting applicability is the use of flexible research designs conducted with and by Indigenous peoples. Systematic reviews have the opportunity to report and highlight these research design choices and their implications on applicability. Importantly, Cochrane has always emphasised that systematic reviews do not make recommendations: rather, they provide a synthesis of available evidence that can be used in deliberative processes.
Systematic review authors can maximize the value of reviews by reporting at a minimum the characteristics of populations included in eligible studies. There are also opportunities to explore questions about why, how, and under what circumstances interventions are effective (or not) by taking advantage of mixed methods, meta‐regression, and emerging synthesis methods. A further step to enrich our understanding of complex issues and interventions to improve health equity is to actively include Indigenous peoples in systematic review processes. These steps are not only something useful we can do, they are also the right thing to do.
Acknowledgements
The authors would like to thank Peter Tugwell and Jordi Pardo Pardo for invaluable comments on earlier drafts.
Feedback on this editorial and proposals for future editorials are welcome.
Contributor Information
Vivian Welch, Email: vivian.welch@uottawa.ca.
Yvonne Boyer, Email: boyery@brandonu.ca.
Catherine Chamberlain, Email: catherine.chamberlain@unimelb.edu.au.
End Notes
Declarations of interest
The authors have completed the Unified Competing Interest form (www.icmje.org/coi_disclosure.pdf). VW is funded by a Government of Ontario Early Researcher Award (2014), and is a convenor of the Cochrane Equity Methods Group (equity.methods.org). YB is funded by the Canada Research Chair program and declares no other conflicts. CC is funded by a National Health and Medical Research Council (Australia) Early Career Fellowship (1088813) and declares no other conflicts.
Provenance and peer review
This editorial was commissioned and was not externally peer reviewed.
References
- Martin DK, Giacomini M, Singer PA. Fairness, accountability for reasonableness, and the views of priority setting decision‐makers. Health Policy 2002;61(3):279–90. doi.org/10.1016/S0168‐8510(01)00237‐8 [DOI] [PubMed] [Google Scholar]
- Whitehead M. The concepts and principles of equity and health. International Journal of Health Services 1992;22(3):429–45. doi.org/10.2190/986L‐LHQ6‐2VTE‐YRRN [DOI] [PubMed] [Google Scholar]
- O'Neill J, Tabish H, Welch V, Petticrew M, Pottie K, Clarke M, et al. Applying an equity lens to interventions: using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in health. Journal of Clinical Epidemiology 2014;67(1):56–64. doi.org/10.1016/j.jclinepi.2013.08.005 [DOI] [PubMed] [Google Scholar]
- Chalmers I, Bracken MB, Djulbegovic B, Garattini S, Grant J, Gulmezoglu AM, et al. How to increase value and reduce waste when research priorities are set. Lancet 2014;383(9912):156–65. doi.org/10.1016/S0140‐6736(13)62229‐1 [DOI] [PubMed] [Google Scholar]
- Welch V, Petticrew M, Tugwell P, Moher D, O'Neill J, Waters E, et al. PRISMA‐Equity 2012 extension: reporting guidelines for systematic reviews with a focus on health equity. PLOS Medicine 2012;9(10):e1001333. doi.org/10.1371/journal.pmed.1001333 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Welch V, Tugwell P, Petticrew M, de Montigny J, Ueffing E, Kristjansson B, et al. How effects on health equity are assessed in systematic reviews of interventions. Cochrane Database of Systematic Reviews 2010(12):MR000028. doi.org/10.1002/14651858.MR000028.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jepson RG, Harris FM, Platt S, Tannahill C. The effectiveness of interventions to change six health behaviours: a review of reviews. BMC Public Health 2010;10:538. doi.org/10.1186/1471‐2458‐10‐538 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Humphreys DK, Ogilvie D. Synthesising evidence for equity impacts of population‐based physical activity interventions: a pilot study. International Journal of Behavioral Nutrition and Physical Activity 2013;10:76. doi.org/10.1186/1479‐5868‐10‐76 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dekkers OM, von Elm E, Algra A, Romijn JA, Vandenbroucke JP. How to assess the external validity of therapeutic trials: a conceptual approach. International Journal of Epidemiology 2010;39(1):89–94. doi.org/10.1093/ije/dyp174 [DOI] [PubMed] [Google Scholar]
- Shea B, Nahwegahbow A, Andersson N. Reduction of family violence in Aboriginal communities: a systematic review of interventions and approaches. Pimatisiwin 2010;8(2):35–60. www.pimatisiwin.com/online/?page_id=759 [PMC free article] [PubMed] [Google Scholar]
- Jull J, Crispo J, Welch V, MacDonald H, Brascoupe S, Boyer Y, et al. Interventions for Indigenous peoples making health decisions: a systematic review. Pimatisiwin 2013;11(3):539–54. www.pimatisiwin.com/online/?page_id=1288 [Google Scholar]