Abstract
Introduction
People from Black African Diaspora Communities (BAFDC) experience poorer health outcomes, have many long-term conditions and are persistently under-represented in health and care research. There is limited focus on programmes, or interventions that support inclusion and participation of people from BAFDC in research. Through coproduction, this realist review seeks to provide a programme theory explaining what context and mechanisms may be required, to produce outcomes that facilitate inclusion and participation for people from BAFDC in health and care research, in the UK.
Methods and analysis
A group of people from BAFDC with lived and professional experience, representing all levels of the health and care research system, will coproduce a realist review with a team of African-Caribbean, white British and white British of Polish origin health and care researchers. They will follow Pawson’s five steps: (1) shaping the scope of the review; (2) searching for evidence; (3) document selection and appraisal; (4) data extraction and (5) data synthesis. The coproduction group will help to map the current landscape, identifying key issues that may inhibit or facilitate inclusion. Data will be extracted, analysed and synthesised following realist logic analysis, identifying and explaining how context and mechanisms are conceptualised in the literature and the types of contextual factors that exist and impact on inclusion and participation. Findings will be reported in accordance with Realist and Meta-narrative Evidence Synthesis Evolving Standards .
Ethics and dissemination
The coproduction group will agree an ethical approach considering accountability, responsibility and power dynamics, by establishing a terms of reference, taking a reflexive approach and coproducing an ethical framework. Findings will be disseminated to BAFDC and the research community through arts-based methods, peer-reviewed publications and conference presentations, agreeing a coproduced strategy for dissemination. Ethical review is not required.
PROSPERO registration number
CRD42024517124.
Keywords: clinical trial, health equity, health services, health services accessibility, health policy, patient participation
STRENGTHS AND LIMITATIONS OF THIS STUDY.
To our knowledge, this will be the first realist review undertaken exploring the contextual factors that influence inclusion and participation and identification of the mechanisms that facilitate inclusion and participation of people from Black African Diaspora Communities (BAFDC) in health and care research, internationally.
Coproducing the review with people from BAFDC with lived and professional experience, will facilitate a deeper understanding of current barriers and facilitators affecting the inclusion and participation of people from BAFDC in health and care research, acting as content experts, drawing on their experiential knowledge which is rarely reported in formal literature.
This study will help to inform the development of an intervention reflected in the methods that enable greater participation of people from BAFDC in health and care research in the UK and may also be applicable to other health and care research systems.
A limitation of the review is that the lead researcher (EH) is white British and does not have lived experience of being black. Thus, she will reflect on her positionality throughout with support of a diverse research team and patient public mentor who is from a BAFDC.
Introduction
Research aims to enhance the health outcomes of the whole population.1 2 However, the lack of participation (Participation in health and care research as defined by the UK’s largest funder of research, the National Institute for Health and Care Research (NIHR), is when people take part in a research study.3 This includes experiences of being recruited into a study, such as a clinical trial, or participating in focus groups, or completing a survey, for example.4 This differs from patient and public involvement engagement (PPIE) in health and care research, where patients and members of the public are actively involved as partners in the research process across a range of activities in, such as commenting on research materials, or being part of a steering group or contributing to the synthesis of results.3) in health and care research studies by underserved groups may contribute to these groups not reaping the benefits of scientific discoveries.5–14 One of the most affected underserved groups is black and ethnic minority groups.15
Studies suggest that black and ethnic minority populations are most affected by health inequities and have historically been ignored, marginalised and forgotten in health and care research.15–17 In the UK, Black African Diaspora Communities (BAFDC) are a minoritised group that includes black, black British, black Welsh, Caribbean or African, and individuals with dual/multiple heritage and other groups who have black African lineage.18 19 Minoritised groups are defined as having their ‘cultural, political and social power’ destroyed because of their identity, by structures and processes that uphold power and domination.19 For the purposes of this review, people from BAFDC refer to adults aged ≥18 years, as children and youths from BAFDC, warrant a separate review. Little progress has been made in improving health outcomes for individuals from BAFDC.20–24
In the UK, black women are four times more likely to die during pregnancy, or up to 1 year after giving birth, than white women,25type 2 diabetes prevalence is up to three times greater in BAFDC,26one in four black men will develop prostate cancer,27 and the prevalence of hypertension and stroke are also higher in this population.26 28 29 Such avoidable and unwarranted differences in health are the culmination of social, economic, environmental and structural disparities caused by the unequal distribution of power and resources, underpinned by structural inequalities and racism.16 30 However, it remains unclear as to how genetic determinants may contribute to the higher incidence of certain diseases among people from BAFDC, primarily due to a lack of representation of these populations in genomics research which may have potentially serious consequences on treatment decisions.31 32 For example, doses for the drug warfarin, a blood-thinning drug, have been reported as being prescribed based on an individual’s race and ethnicity, despite genetic studies mainly being conducted on European and white Americans.31 There is also evidence to suggest that there is some misunderstanding among biomedical researchers around the differences between sociopolitical constructs like race and ethnicity and biological factors such as genetic ancestry, which can lead to estimates of genetic heredity being biased if environmental and social determinants of health are taken into consideration during analysis.33 Enabling representation of people from BAFDC in health and care research is critical for innovation and new discoveries; data science; ensuring access to specific therapeutic drugs, or treatments; building trust in science and medicine; addressing health disparities and ensuring provision of evidence-based healthcare.14 34 Without this, there is a risk of perpetuating health inequalities and social injustice with data producing algorithms used to guide treatment decisions based on White populations.34 Furthermore, the potential benefits of personalised medicine and access to new treatments such as in cancer trials may not be realised if people from BAFDC are excluded from research.35
The responsibility to improve participation has often been directed at individuals who are under-represented. Terms such as ‘hard-to-reach’ have been frequently used to describe individuals who are marginalised or disadvantaged, creating an unhelpful narrative that places the blame on individuals, as opposed to services being inaccessible due to a number of barriers such as studies not routinely reflecting the needs of underserved groups.36 37 Health and care research is crucial for reducing health disparities and improving health and well-being globally, but without diverse participation and the representation of all groups, especially those who have some of the poorest health outcomes, social equity cannot be reached, creating an enduring challenge for some of the wealthiest, research-active countries.2 14 23
The science of inclusion
In comparison to the UK, the USA has had a lengthy history of policies implemented to improve diversity within health and care research; consequently, the evidence base around inclusion and participation of black and ethnic minority populations is largely from the USA.14 24 38–45 A report by The National Academies of Sciences Engineering and Medicine (2022) suggests that these policies have failed to reduce exclusion of underserved populations.14 After the implementation of the National Institute of Health (NIH) Revitalisation Act of 1993, there was some reported increase in previously excluded groups, such as women, taking part in health and care research, though individuals from black and ethnic minority populations remained under-represented.44–47 Guidance around improving inclusion is problematic when attempting to operationalise, reproduce or measure it.48 49 Adoption of NIH policies has not adequately encouraged researchers to widen their eligibility criteria, with the Federal Drugs Agency lacking the power to enforce recommendations, resulting in exclusion of the very groups the Act was developed.14 Exclusion has been related to the lack of reporting of outcomes in research studies by race and ethnicity, impacting on the evidence base for clinical decision-making.14 Exclusion is reported to have been observed in commercial cancer trials, where eligibility criteria can be very restrictive.50–52 These trials often exclude individuals with comorbidities, which are more prevalent in black and ethnic minority populations, preventing access to new treatments, such as immunotherapy.51 52 The impact of eligibility criteria on inclusion requires further investigation to find solutions. Consequently, a move to develop a stronger body of knowledge about the science of inclusion is emerging, focusing on theory and empirical evidence related to the process of health and care research from initial engagement with individuals from black and ethnic minority populations to participation in studies.14
In the UK, the NIHR defines research inclusion as ‘taking a whole systems approach to what we do and how we do it; identifying and removing longstanding, structural barriers to success across our people, policies, processes and practices’.53Robust evidence is needed to inform how the deficits in the infrastructure of health and care research systems should be addressed in order to focus on inclusion and participation.54 There is a need to understand the contextual and causal factors that influence inclusion and participation and to develop the science of inclusion based on theory; clear explanations about theories of inclusion and participation of black and ethnic minority populations are lacking.14 54
The importance of inclusion
In the UK, there has been less focus on policy measures around inclusion in health and care research (eg, there is a lack of practice and policy in regards to reporting of inclusion and assessments of quality of data collection), and more focus on recognising the importance of inclusion, and working to identify and address barriers to inclusion.26 53 This contrast may reflect fundamental differences in the values and politics of the UK and USA and the long history of race and ethnicity data collection policies and standards in the USA.48 55 56 The UK’s NIHR has acknowledged the importance of inclusion in health and care research by developing and implementing a Research Inclusion Strategy 2022–2027 demonstrating commitment to a long-term inclusivity agenda.53 A focus on widening access and participation for greater diversity and inclusion is a critical aspect of the strategy, indicating that ‘work is required to initiate more inclusive recruitment strategies that promote participation from underserved groups nationwide’.53 Creating a more equitable health and care research system is crucial to ensuring disadvantaged groups most affected by health inequities benefit from participating in research and feel that research is relevant to them.26 39
Lack of progress
Globally, little progress has been made on participation of black populations in research studies.14 There is strong evidence in the USA to suggest that African Americans are willing to participate in research, and the decision to participate may be influenced by mechanisms situated at other levels of the health and care research system (such as the intrapersonal and structural levels, rather than at an individual level).14 49 There are reports that willingness to participate has been misrepresented due to biases held by researchers, though the mechanisms that cause bias to function at the intrapersonal and structural levels of health and care systems are poorly understood.14 49 It has been suggested that the responsibility for developing interventions that will improve inclusion and participation of people from BAFDC lies with researchers, institutions, decision-makers, policy-makers and funders of research.14 57 Such interventions are required at multiple levels of the health and care research system including policy-making and funding to provide resources to a specific population with the aim of creating progressive change.40 The way in which an intervention is developed and implemented is dependent on the power of individuals and institutions and how they manage its implementation, which is pertinent when considering the architecture required for an intervention, for a marginalised population such as BAFDC.58 For example, if an intervention is designed and implemented by individuals from a perceived dominant population, it may lack the perspectives of a diverse population which may impact on the success of its design.15 For an intervention to have the best chance of success, it is crucial to understand the context within which it will be implemented, as well as the mechanisms by which it works. Consequently, a realist approach provides the most suitable method for developing new thinking through offering a deeper, more pragmatic explanation than a systematic review.59 While systematic reviews offer an assessment of the effectiveness of interventions, they often lack explanations as to how and why an intervention may, or may not have worked, which is particularly valuable in complex systems, such as the health and care research system.59 The learning from this realist review will be a timely addition to existing efforts. We are at a pivotal point in addressing the structural, racial injustices that have been brought to the fore by critical events over recent years, such as the murder of George Floyd and the COVID-19 pandemic that disproportionately impacted black and ethnic minority communities.16 60 61
Methods and analysis
Our positionality statement can be found in online supplemental file 1.
bmjopen-2023-082564supp001.pdf (38.4KB, pdf)
Aims
This realist review will broadly explore secondary data to provide insights that will contribute to the development of a realist theory of inclusion and participation in health and care research by people from BAFDC in the UK. The theory may be applicable to other health and care research systems internationally. It will be undertaken with a coproduction group composed of people from BAFDC who have the lived experience of being Black as well as experience as patients, members of the public, healthcare professionals, community leaders, health and care researchers, research delivery staff, policy-makers and funders of health and care research. Thus, they are aware of the challenges related to inclusion and participation in health and care research for people from BAFDC.62 A realist review benefits from ‘content experts’ such as the coproduction group, improving the efficiency of the review through helping to focus the scope of the review, development of the initial programme theory and refining the search process and accurate interpretation of the results.63 The review will help to explain the context of the health and care research system, identifying underlying causal factors that influence inclusion and participation of people from BAFDC in health and care research. We will develop a programme theory through following five key steps as recommended by Pawson et al that explains how inclusion and participation may be facilitated with people from BAFDC in health and care research.64 65 This programme theory is intended to inform the development of an intervention to improve inclusion and ultimately outcomes for people from BAFDC.
Review questions
What are the contextual and/or causal factors that influence inclusion and participation in health and care research by people from BAFDC?
How and where do mechanisms occur that underly implicit and complicit bias that affects the inclusion and participation of people from BAFDC in health and care research?
What barriers and facilitators do people from BAFDC feel affect their experiences of participation in health and care research?
What might the components of an intervention(s) look like that foster inclusion and participation of people from BAFDC in health and care research?
Study design
The design will be guided by Pawson et al’s five steps and in accordance with Realist and Meta-narrative Evidence Synthesis Evolving Standards for quality and reporting.66 Figure 1 shows a diagram of the review process as adapted from Duddy and Wong.67 Due to the complexity of context, the focus of the review will be steered by a unique theoretical framework developed with the coproduction group from pre-existing mid-range theories deemed pertinent to this research. Theories will be identified through analysis of resources from the review team, as well as comprehensive evaluation of the literature.59 A realist review is a theory-driven method for investigating complex interventions or programmes.65 Evidence is produced in the form of theories that are best understood by analysing the contexts, mechanisms and outcomes of a programme.59 Understanding context can help to create an optimal condition for the successful implementation of a programme or intervention.68 The interaction between context (C) and mechanism (M) results in an outcome (O).69 This formula is known as a CMO configuration (CMOC) and is a way of explaining theory in realist research.59 69
Figure 1.
Realist review project plan.
Patient and public involvement
Stakeholder involvement is key to realist research and will be achieved by using a coproduction approach to PPI.69 Stakeholders are people who may have an interest in the research being carried out, may be involved in shaping it and could be affected by the outcomes.70 Coproduction is a way of sharing power, taking into account the skills and many perspectives within a group of people—it involves respecting and valuing the knowledge of others as well as providing reciprocity and focusing on building and maintaining relationships.71
Recruitment
A coproduction group of eight individuals (VE, TK, DG, LH, EM, TO, IS and SW) from BAFDC will meet to share knowledge and identify training needs, around the realist approach, prior to the review. Individuals were approached by the lead author (EH) through her existing networks (some had already been involved in PPIE during the development phase of the research proposal): directly approaching black community organisations and individuals, providing written information about coproduction and the research project, with 1:1 meetings held virtually with all who were interested, to provide an opportunity to ask questions and meet EH. The coproduction group includes experts by experience, as well as stakeholders from the health and care research system who self-identify as belonging to BAFDC. In this review, experts by experience are regarded as patients and members of the public with lived experience of the health and care research system.72
Work schedule
We will map out the review process and draw on expertise from within the group, through creative methods and discussion, to understand how the health and care research system currently serves people from BAFDC in the UK. The coproduction group will be consulted in alignment with the principles of coproduction throughout, as key ‘experts’ with additional stakeholders sought for expertise, if required.70 The group will be consulted throughout the review via virtual meetings on Microsoft Teams and email, allowing for wider geographical inclusion as the group is based in the West Midlands and London regions, improving accessibility, with sessions kept to a maximum of 1.5 hours to avoid digital fatigue.73 There will also be at least one face-to-face meeting, held at a central location convenient to the group, to allow for longer discussion and to help build relationships.
Sequence of steps
The review will be conducted following five steps: (1) shaping the scope of the review, (2) searching for the evidence, (3) document selection and appraisal, which will be based on relevance and rigour, (4) data extraction and organisation of evidence will be conducted iteratively and (5) data synthesis will be used to explain deficits in context and how they impact on inclusion and participation and development of programme theory.
Step 1: shaping the scope of the review: key concepts and construction of a theoretical framework
Programme theories create a scaffolding to explore how, why, for whom and under what circumstances complex programmes or interventions work.74 In realist terms, an intervention is a theory.74 This stage will focus on the development of a theoretical framework that will shape the focus of the review, support data extraction, appraisal and synthesis, and identify concepts around inclusion and participation of people from BAFDC in health and care research.71 Evidence suggests that a small number of theories can be developed into a framework that will support the development of initial programme theory that incorporates the multiple levels of a system.75 To identify relevant theories, concepts critical to inclusion and participation of people from BAFDC will be identified through creative discussion with the coproduction group using Lego Serious Play (LSP) as a method for facilitating their input.76 A small pilot with NIHR Research Champions, or members of the public who have experience of being involved and engaged in health and care research will take place prior to using the approach with the coproduction group.
Outputs
We will produce a simple, research participant pathway representing the health and care research process that will be used as an artefact, to consult with the coproduction group to stimulate discussion during LSP, to support the facilitation of individual’s thoughts and reasoning (see figure 2).77
Figure 2.
Pathway of experience of participation.
The coproduction group will use LSP to map the existing health and care research system. Concepts from other programmes in related areas can also be drawn on. Existing mid-range theories will then be identified through an initial scoping search based on key concepts that arise following the LSP activity. A list of these mid-range theories will be presented to the coproduction group to decide whether they should be included in the theoretical framework, based on their importance to the research aim and relevance to people from BAFDC. Theories deemed pertinent by the group will be merged into a framework to guide data extraction and appraisal. Evidence will be collected to theorise how an intervention may work, facilitating identification of CMOCs through matching to existing theories, while considering information that may be missing from existing mid-range theories.59 78
Step 2: searching for evidence
A search for evidence will be conducted, including international literature, collecting a wide range of secondary data sources and grey literature including: all types of studies, peer-reviewed articles, opinion pieces, commentaries, conference papers/proceedings, reports and social media excerpts.62 65 In discussion with an information specialist, a pilot search of the evidence was conducted. The review will be conducted over a 6-month period including all literature that covers research that addresses the issues of inclusion and participation in health and care research in the period post World War II. There are no language restrictions. We expect further adjustments to the search strategy to be required. Discussions and decision-making with the coproduction group will be held around relevance of international literature to a UK context. A data extraction form will be informed by the theoretical framework as a way of combing the evidence and appraising it through scoring it as high, moderate, low based on its usefulness and relevance.79 The data extraction form will include standard information including full reference, item type, country where source was published, quality and the group being researched, though will be developed iteratively to meet the needs of the review.79
Data sources and search strategy
An initial search will be developed based on the theoretical framework, with key search terms identified in box 1. An example of the search strategy for Medline can be found in online supplemental file 2. EndNote will be used for storing all identified sources.80 Search terms will be discussed with the research team and coproduction group and modified as required for each database or website.
Box 1. Search terms.
Health Services Research
Clinical Trials
Biomedical Research
Black
Afro-Caribbean
BME
BAME
African American
Black British
Participation, or Patient Participation, or Community Participation, or Stakeholder Participation, or Social Participation
Inclusion
Recruitment
Underrepresentation
bmjopen-2023-082564supp002.pdf (24.9KB, pdf)
Using the strategy, a search for the evidence will be conducted using the following databases: Medline, EMBASE, PsycINFO, Web of Science, Race Relations Abstracts, Sociological Abstracts, University of the West Indies and Patient-Centred Outcomes Research Institute. A search of grey literature will be conducted (box 2), although recommendations from the coproduction group may also evolve as the review progresses. Literature sources will be prioritised by the coproduction group where relevant.
Box 2. Grey literature sources.
Initial grey literature sources
NHS Race and Health Observatory
Runnymede Trust
BRAP
The Health Foundation
The King’s Fund
Operation Black Vote
The Voice newspaper
African Voice newspaper
West Bromwich African Caribbean Resource Centre
Enfield Caribbean Association
Caribbean and African Health Network
Vanderbilt University Medical Centre, Office of Health Equity Anti-racism hub
CARE (Community, Access, Recruitment and Engagement) Centre, Massachusetts General Hospital
Open Access Theses and Dissertations
Caribbean-studies@jiscmail.ac.uk
Caribbeanintelligence
Twitter, Facebook and YouTube
Coproduction group recommendations
Once the initial search has been completed, we will decide if further iterative searching will be conducted which will be determined by the extent of literature identified and discussed with the research team and coproduction group. Search terms will be expanded in this instance with the information specialist.
Screening of abstracts will be carried out according to inclusion and exclusion criteria developed, based on the theoretical framework, with no date limit initially. This will be reviewed following the database search and a limit set, should the return of documents be excessive.
Screening process
EH will undertake screening based on title and abstract and a second reviewer will screen a random sample of 10% of the identified citations, setting a kappa measure of k>0.8 to measure inter-rater reliability.66 This will be calculated using the formula for Cohen’s kappa.81 Reviewers will discuss disagreements with the coproduction group and research team. If k<0.8 a further 10% sample will be screened, and the outcome discussed with the research team. Should an abstract not be available (eg, in some grey literature), documents will be included and full screening of each will be carried out at second level screening. Rayyan referencing software will be used for screening as it enables blinding of screening decisions, collaboration functions and presentation of screening decisions in a simple format which can be exported onto a spreadsheet.82 Papers that are excluded by one reviewer and included by another will be brought to the wider research team for further discussion, as well as those where one, or both reviewers are unsure.
Iterative searching
As realist reviews are iterative, searching for additional data to support theory development is likely.59 For each additional search, the research team will develop further inclusion/exclusion criteria, with each search tested and refined through support from an Information Specialist and screening conducted as summarised above.
Step 3: selection and appraisal
After initial screening in step 2, documents will be selected based on relevance and rigour after the full text has been read by EH and inclusion/exclusion criteria applied83 (see box 3). Relevant documents are those which are deemed helpful and valuable for building theory while rigour ascertains the trustworthiness and credibility of methods used to produce data.84 Although, methodological quality of papers is not so important in realist research, relevance and robustness is.85 Evidence may include a wide range of sources, for example, opinion pieces that may capture important evidence based on experiences.83Pawson asserts that even poor evidence, which may be methodologically weak, can provide rich insights and thus following a hierarchical approach to selecting documents should not pertain to realist reviews.64 83 84 Realist research is informed by evidence, as opposed to evidence-based and therefore a diverse range of literature sources are needed to develop programme theories with sources selected according to relevance and rigour.85
Box 3. Inclusion and exclusion criteria.
Inclusion
No initial date parameter.
All study designs (qualitative, mixed methods, quantitative, systematic reviews, etc) and grey literature.
All international sources will be included.
Document has relevance to development of programme theory, either the full text, or a section.
Population must be related to Black African Diaspora Communities (BAFDC), black British, African American, African or African-Caribbean people, though this may include sources that include information about other ethnic minority groups as well.
Must concern factors that affect inclusion and participation in health and care research with health and social care research.
Exclusion
Relates to BAFDC, black British, African American, African, African-Caribbean people <18 years old.
Step 4: extracting and organising data
Databases will be developed to extract and organise data, tailored for this review. Data will be extracted by EH with a 10% subsample of included papers, also completed by the second reviewer. Disagreements will be discussed with the research team and coproduction group. If kappa is <0.8 then a further subsample of 10% will be reviewed by the second reviewer. We will pilot the use of NVivo software as an alternative to Excel to assist data coding and organisation; we will code 3–5 documents in both databases to determine which is the most pragmatic tool for this review.86 Extracted data will be centred on dialogue that helps to build programme theory.87 Codes will be developed both inductively from documents, and deductively from the theoretical framework.88 Data will be organised into broad, conceptual categories, through grouping the codes together and prioritising coding for causal insight in regard to the architecture of the health and care research system.89 This will support identifying patterns in the data and configuring data into CMOCs.88
Step 5: analysis and synthesis
Data analysis and synthesis will be led by EH with reflections and discussion among the research team and coproduction group to support interpretation of CMOCs using retroduction.90 Retroduction allows the researcher to incorporate intuitions and insights, as well as inductive and deductive logic, considering the causal forces that may be producing what is observed.90 This theorising is based on the researchers’ interpretations and may not be testable in the first instance, particularly if only part of a theory is developed.90 The coproduction group will be involved in coproducing this, to ensure that the developing programme theory, is true to their lived and professional experiences. The group will decide meeting frequency, location and length.
Strengths and limitations
A key strength of this realist review lies with the coproduction group that will be involved throughout.62 The combined skills and expertise of a group of stakeholders from BAFDC, with both lived and professional experience in the health and care research system will place people from BAFDC at the centre of this review. The group’s lived experience of being black, or having a shared history of ‘colonialism and enslavement in the past and continuing to experience racism and diminished opportunities’ makes them experts in their own right and will ensure that their reality cannot be denied.91 A limitation is that the lead researcher (EH) is white British and has not experienced racism. Therefore, she will reflect on her positionality throughout, with a willingness to engage, learn, and take on board the complex issues that may present. The coproduction group feel that Tuckman’s model of ‘forming, storming, norming and performing’ is a useful pathway for reflecting on how the group may develop to ensure the aims and objectives of this project are met and to create a progressive group culture.92 This review will be undertaken as a realist review, in order to answer timely research questions for which there is limited published evidence on interventions or programmes that effectively foster inclusion and participation in health and care research with people from BAFDC.58 63 Limitations may include not being able to access or include all sources identified in searches as well as a limit on the number of iterative searches conducted due to timescales of the research. However, together as a research team and coproduction group, we will agree on the priorities of the programme theory with a view to conducting future research on additional aspects that we are unable to address in this project.
Ethics and dissemination
This review does not require ethical approval due to the use of secondary data that already exists, for example, in databases and PPI in the form of coproduction. The review is registered with PROSPERO. However, ethical considerations around accountability, responsibility and power dynamics will be discussed and reflected on, with the coproduction group and research team. This review will lead to a programme theory that begins to explain what may work, for supporting inclusion and participation of people from BAFDC in health and care research internationally. This theory will continue to be built through qualitative data collection methods, with stakeholders from each level of the health and care research system, in a realist evaluation. Further outputs will include a set of principles, recommendations and a conceptual framework that will inform the development of an intervention suitable for implementation, to support a UK research system focused on equity and social justice.14 An early prototype for an intervention, based on the findings, will be developed with the coproduction group. Outputs for people from BAFDC will be coproduced and will focus on a series of community engagement events, dissemination of findings via radio, in newspapers such as The Voice, a well-established British African Caribbean newspaper since 1982 and via social media.
Supplementary Material
Footnotes
Twitter: @ejhoverd, @None
Contributors: EH conceived the study with input from SS, DE, JD, RS and TK. EH was responsible for the design and drafting of the protocol. SS, DE, JD, RS, TK, SW, EM, IS, VE, TO, LH and DG contributed to protocol development and SS, DE, JD and RS also provided methodological advice. SS, DE, JD, RS, TK, SW, EM, IS, VE, TO, LH and DG provided criticism and refinement of the manuscript. SS, DE, JD, RS, TK, SW, EM, IS, VE, TO, LH and DG approved the final version.
Funding: EH is funded by the NIHR (Health Education England/National Institute for Health and Care Research Clinical Doctoral Research Fellowships programme, grant number 302121). SS is part funded by the NIHR Applied Research Collaboration (ARC) West Midlands (grant number NIHR200165)], the NIHR Health Protection Research Unit (HPRU) Gastrointestinal Infections (grant number NIHR200910), the NIHR HPRU Genomics and Enabling data (grant number NIHR200892), the NIHR West Midlands Evidence Synthesis Group (grant number NIHR153453) and the NIHR Health Determinants Research Collaboration Coventry (not yet awarded).
Competing interests: None declared.
Patient and public involvement: Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.
Provenance and peer review: Not commissioned; externally peer reviewed.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
Ethics statements
Patient consent for publication
Not applicable.
References
- 1. Gov.uk . Saving and improving lives: the future of UK clinical research delivery. 2021. Available: https://www.gov.uk/government/publications/the-future-of-uk-clinical-research-delivery/saving-and-improving-lives-the-future-of-uk-clinical-research-delivery
- 2. WHO . WHO’s goal: forward looking and Prioritised global health research. 2023. Available: https://www.who.int/our-work/science-division/research-for-health
- 3. NIHR . Glossary. 2023. Available: https://www.nihr.ac.uk/about-us/glossary.htm?letter=P&postcategory=-1
- 4. NIHR . Briefing notes for researchers - public involvement in NHS, health and social care research 2021, Available: https://www.nihr.ac.uk/documents/briefing-notes-for-researchers-public-involvement-in-nhs-health-and-social-care-research/27371
- 5. Iyizoba-Ebozue Z, Fleming JC, Prestwich RJD, et al. Management of Sinonasal cancers: survey of UK practice and literature overview. Eur J Surg Oncol 2022;48:32–43. 10.1016/j.ejso.2021.11.124 [DOI] [PubMed] [Google Scholar]
- 6. Smart A, Harrison E. The under-representation of minority ethnic groups in UK medical research. Ethn Health 2017;22:65–82. 10.1080/13557858.2016.1182126 [DOI] [PubMed] [Google Scholar]
- 7. Treweek S, Forouhi NG, Narayan KMV, et al. Narayan K et al COVID-19 and Ethnicity: who will research results apply to. Lancet 2020;395:1955–7. 10.1016/S0140-6736(20)31380-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Sheppard VB, Sutton A, Holmes E, et al. Holmes E et al recruitment of African Americans into cancer clinical research: strategies and outcomes. J Urban Health 2021;98:149–54. 10.1007/s11524-021-00565-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Lau YH, Podlewska A, Ocloo J, et al. Ocloo J et al does Ethnicity influence recruitment into clinical trials of Parkinson’s disease JPD 2022;12:975–81. 10.3233/JPD-213113 [DOI] [PubMed] [Google Scholar]
- 10. Iqbal H, West J, Haith-Cooper M, et al. A systematic review to identify research priority setting in black and minority ethnic health and evaluate their processes. PLoS ONE 2021;16:e0251685. 10.1371/journal.pone.0251685 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Cunningham-Erves J, Mayo-Gamble TL, Hull PC, et al. A pilot study of a culturally-appropriate, educational intervention to increase participation in cancer clinical trials among African Americans and Latinos. Cancer Causes Control 2021;32:953–63. 10.1007/s10552-021-01449-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. De las Nueces D, Hacker K, DiGirolamo A, et al. Digirolamo A et al A systematic review of community-based Participatory research to enhance clinical trials in racial and ethnic minority groups. Health Serv Res 2012;47:1363–86. 10.1111/j.1475-6773.2012.01386.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Julian McFarlane S, Occa A, Peng W, et al. Awonuga O et al community-based Participatory research (CBPR) to enhance participation of racial/ethnic minorities in clinical trials: A 10-year systematic review. Health Communication 2022;37:1075–92. 10.1080/10410236.2021.1943978 [DOI] [PubMed] [Google Scholar]
- 14. National Academies of Sciences, Engineering, and Medicine (NASEM . Improving Representation in Clinical Trials and Research: Building Research Equity for Women and Underreprsented Groups, ed. K.B.-D.A.A. Helman. Washington DC: National Academies Press, 2022. [PubMed] [Google Scholar]
- 15. Williams DR, Lawrence JA, Davis BA. Davis B et al racism and health: evidence and needed research. Annu Rev Public Health 2019;40:105–25. 10.1146/annurev-publhealth-040218-043750 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Nobles M, Womack C, Wonkham A. RACISM overcoming science’s toxic legacy. 2022 nature overcoming racism in science: A nature special issue. 2022;606:225–7. 10.1038/d41586-022-01527-z [DOI] [PubMed] [Google Scholar]
- 17. Lewis T, Buck D, Wenzel L. Equity and endurance: how can we tackle health inequalities this time? the king’s Fund (Kingsfund.org.UK). 2022. Available: https://www.kingsfund.org.uk/insight-and-analysis/long-reads/how-can-we-tackle-health-inequalities
- 18. Knight HE, Deeny SR, Dreyer K, et al. K et al challenging racism in the use of health data. Lancet Digit Health 2021;3:e144–6. 10.1016/S2589-7500(21)00019-4 [DOI] [PubMed] [Google Scholar]
- 19. Selvarajah S, Deivanayagam TA, Lasco G, et al. Categorisation and Minoritisation. BMJ Glob Health 2020;5:e004508. 10.1136/bmjgh-2020-004508 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Birmingham City Council . Birmingham and Lewisham African Caribbean health inequalities review (BLACHIR). 2022. Available: https://www.birmingham.gov.uk/downloads/file/23111/blachir_report
- 21. Petersen J, Kandt J, Longley PA. Ethnic inequalities in hospital admissions in england: an observational study. BMC Public Health 2021;21:862. 10.1186/s12889-021-10923-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Mukadam N, Marston L, Lewis G, et al. Incidence, age at diagnosis and survival with dementia across ethnic groups in England: A longitudinal study using electronic health records. Alzheimers Dement 2023;19:1300–7. 10.1002/alz.12774 Available: https://alz-journals.onlinelibrary.wiley.com/toc/15525279/19/4 [DOI] [PubMed] [Google Scholar]
- 23. Kapadia D, Salway S, Nazroo J. Ethnic inequalities in Healthcare: A rapid evidence review. 2022. Available: https://www.nhsrho.org/wp-content/uploads/2023/05/RHO-Rapid-Review-Final-Report_.pdf
- 24. Awidi M, Al Hadidi S. Awidi M and S Hadidi participation of black Americans in cancer clinical trials: Current challenges and proposed solutions. JCO Oncol Pract 2021;17:265–71. 10.1200/OP.21.00001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. MBRRACE-UK . MBRRACE-UK perinatal mortality surveillance: UK perinatal deaths for births from January to December 2021. 2021. Available: https://www.npeu.ox.ac.uk/mbrrace-uk/reports/perinatal-mortality-surveillance
- 26. Raleigh V The King’s Fund . The health of people from ethnic minority groups in England 2023. The Health Of People From Ethnic Minority Groups In England, Available: https://www.kingsfund.org.uk/insight-and-analysis/long-reads/health-people-ethnic-minority-groups-england [Google Scholar]
- 27. Prostate Cancer UK . Prostate cancer and other prostate problems: Information for black men 2023, Available: https://shop.prostatecanceruk.org//our-publications/all-publications/prostate-cancer-and-other-prostate-problems-information-for-black-men?limit=100
- 28. Su D, Yang H, Chen Z, et al. Chen Z et al Ethnicity-specific blood pressure thresholds based on cardiovascular and renal complications: a prospective study in the UK Biobank. BMC Med 2024;22:54. 10.1186/s12916-024-03259-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Ali R, Chowdhury A. Forouhi N et al Ethnic disparities in the major causes of mortality and their risk factors - a rapid review 2021,.Commission on race and ethnic disparities, Available: https://www.gov.uk/government/publications/the-report-of-the-commission-on-race-and-ethnic-disparities-supporting-research/ethnic-disparities-in-the-major-causes-of-mortality-and-their-risk-factors-by-dr-raghib-ali-et-al
- 30. Rai T, Hinton L, McManus RJ, et al. Mcmanus et al what would it take to meaningfully attend to Ethnicity and race in health research? learning from a trial intervention development study. Sociology Health &Amp; Illness 2022;44:57–72. 10.1111/1467-9566.13431 Available: https://onlinelibrary.wiley.com/toc/14679566/44/S1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Cerdeña JP, Grubbs V, Non AL. Racialising genetic risk: assumptions, realities, and recommendations. Lancet 2022;400:2147–54. 10.1016/S0140-6736(22)02040-2 [DOI] [PubMed] [Google Scholar]
- 32. Fatumo S, Chikowore T, Choudhury A, et al. A roadmap to increase diversity in Genomic studies. Nat Med 2022;28:243–50. 10.1038/s41591-021-01672-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Phuong J, Riches NO, Madlock-Brown C, et al. Social determinants of health factors for gene–environment COVID-19 research: challenges and opportunities. Adv Genet (Hoboken) 2022;3:2100056. 10.1002/ggn2.202100056 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Knight HE, Deeny SR, Dreyer K, et al. Dreyer K et al challenging racism in the use of health data. Lancet Digit Health 2021;3:e144–6. 10.1016/S2589-7500(21)00019-4 [DOI] [PubMed] [Google Scholar]
- 35. The Lancet . Personalised medicine in the UK. Lancet 2018;391:S0140-6736(17)33261-0. 10.1016/S0140-6736(17)33261-0 [DOI] [PubMed] [Google Scholar]
- 36. NSPCC . Why language matters: Reframing responsibility for Accessing services. 2022. Available: https://learning.nspcc.org.uk/news/why-language-matters/not-hard-to-reach-reframing-responsibility-for-accessing-services
- 37. Flanagan SM, Hancock B. Reaching the hard to reach - lessons learned from the VCS (voluntary and community sector). A qualitative study. BMC Health Serv Res 2010;10:92. 10.1186/1472-6963-10-92 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Rosen CJ, Cook NL, Wilkins CH. Wilkins C et al diversity in clinical trials — next steps. N Engl J Med 2022;387:e34. 10.1056/NEJMp2201379 [DOI] [PubMed] [Google Scholar]
- 39. Dawson S, Campbell SM, Giles SJ, et al. Giles set al black and minority ethnic group involvement in health and social care research: A systematic review. Health Expect 2018;21:3–22. 10.1111/hex.12597 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. George S, Duran N, Norris K. Norris K et al A systematic review of barriers and Facilitators to minority research participation among African Americans, Latinos, Asian Americans, and Pacific Islanders. Am J Public Health 2014;104:e16–31. 10.2105/AJPH.2013.301706 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Camidge DR, Park H, Smoyer KE, et al. Smoyer K et al race and Ethnicity representation in clinical trials: findings from a literature review of phase I oncology trials. Future Oncol 2021;17:3271–80. 10.2217/fon-2020-1262 [DOI] [PubMed] [Google Scholar]
- 42. Kwiatkowski K, Coe K, Bailar JC, et al. Bailar J et al inclusion of minorities and women in cancer clinical trials, a decade later: have we improved Cancer 2013;119:2956–63. 10.1002/cncr.28168 [DOI] [PubMed] [Google Scholar]
- 43. Rodríguez-Torres E, González-Pérez MM, Díaz-Pérez C. Diaz-Perez C et al barriers and Facilitators to the participation of subjects in clinical trials: an overview of reviews. Contemp Clin Trials Commun 2021;23:100829. 10.1016/j.conctc.2021.100829 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. National Institutes of Health . National Institutes of Health Revitatlization Act of 19931993, Available: https://orwh.od.nih.gov/sites/orwh/files/docs/NIH-Revitalization-Act-1993.pdf
- 45. Mays VM. Mays V research challenges and Bioethics responsibilities in the aftermath of the Presidential apology to the survivors of the U. S. public health services Syphilis study at Tuskegee. Ethics Behav 2012;22:419–30. 10.1080/10508422.2012.730787 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46. Meinert JA, Blehar MC, Peindl KS, et al. Peindl K et al bridging the gap: recruitment of African-American women into mental health research studies. Acad Psychiatry 2003;27:21–8. 10.1176/appi.ap.27.1.21 [DOI] [PubMed] [Google Scholar]
- 47. Topp R, Newman JL, Jones VF. Jones V et al including African Americans in health care research. West J Nurs Res 2008;30:197–203. 10.1177/0193945907303063 [DOI] [PubMed] [Google Scholar]
- 48. NIH . Health report of the advisory committee on research on women’s health: fiscal years 2017–2018. 2019. Available: https://orwh.od.nih.gov/our-work/fiscal-years-2019-2020-full-report-on-research-on-womens-health
- 49. Gilmore-Bykovskyi A, Croff R, Glover CM, et al. Glover C et al traversing the aging research and health equity divide: toward Intersectional frameworks of research justice and participation. Gerontologist 2022;62:711–20. 10.1093/geront/gnab107 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50. Reihl SJ, Patil N, Morshed RA, et al. Morshed R et al A population study of clinical trial accrual for women and minorities in neuro-oncology following the NIH. Neuro-Oncology 2022;24:1341–9. 10.1093/neuonc/noac011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51. Nazha B, Mishra M, Pentz R, et al. Enrollment of racial minorities in clinical trials: old problem assumes new urgency in the age of Immunotherapy. Am Soc Clin Oncol Educ Book 2019;39:3–10. 10.1200/EDBK_100021 [DOI] [PubMed] [Google Scholar]
- 52. Jiagge EM, Kaljee L, Dankerlui D, et al. Dankerlui D et al Participatory action for access to clinical trials (PAACT): increasing participation of blacks in southeastern Michigan in cancer clinical trails. JCO 2022;40:e18527. 10.1200/JCO.2022.40.16_suppl.e18527 [DOI] [Google Scholar]
- 53. NIHR Equality . Diversity and inclusion strategy 2022-2027. 2022. Available: https://www.nihr.ac.uk/documents/equality-diversity-and-inclusion-strategy-2022-2027/31295
- 54. Jackson J. The Challenge of Health Equity in Clinical Research Towards a Quantifiable Science of Inclusion 2020, Available: https://www.nia.nih.gov/research/alzheimers-dementia-outreach-recruitment-engagement-resources/challenge-health-equity
- 55. Ham C. Ham C money can't buy you satisfaction. BMJ 2005;330:597–9. 10.1136/bmj.330.7491.597 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56. Díaz Rios LK, Stage VC, Leak TM, et al. Collecting, using, and reporting race and Ethnicity information: implications for research in nutrition education, practice, and policy to promote health equity. J Nutr Educ Behav 2022;54:582–93. 10.1016/j.jneb.2022.01.006 [DOI] [PubMed] [Google Scholar]
- 57. National Academies of Sciences, Engineering, and Medicine (NASEM); Health and Medicine Division; Board on Population Health and Public Health Practice; Baciu A . In: Communities in Action: Pathways to Health Equity. Washington (DC): National Academies Press (US), 2017. 10.17226/24624 [DOI] [PubMed] [Google Scholar]
- 58. von Thiele Schwarz U, Nielsen K, Edwards K, et al. Edwards K et al how to design, implement and evaluate organizational interventions for maximum impact: the Sigtuna principles. Eur J Work Organ Psychol 2021;30:415–27. 10.1080/1359432X.2020.1803960 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59. Pawson R, Greenhalgh T, Harvey G, et al. Realist review--a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy 2005;10:21–34. 10.1258/1355819054308530 [DOI] [PubMed] [Google Scholar]
- 60. Hearst MO, Ekwonye A, Munala L, et al. COVID-19 and systemic racism Pandemics impact daily life for immigrant/refugees, Minneapolis, USA. Ann Glob Health 2021;87:107. 10.5334/aogh.3411 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61. Devakumar D, Selvarajah S, Shannon G, et al. The lancet series on racism, xenophobia, discrimination, and health. Lancet 2022;395:e112–3. 10.1016/S0140-6736(20)31371-4 [DOI] [PubMed] [Google Scholar]
- 62. Griffiths S, Weston L, Morgan-Trimmer S, et al. Engaging Stakeholders in realist programme theory building: insights from the prospective phase of a primary care dementia support study. Int J Qualit Method 2022;21:160940692210775. 10.1177/16094069221077521 [DOI] [Google Scholar]
- 63. Saul JE, Willis CD, Bitz J, et al. A time-responsive tool for informing policy making: rapid realist review. Implementation Sci 2013;8:103. 10.1186/1748-5908-8-103 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64. Pawson R, Matutes E, Brito-Babapulle V, et al. Sezary cell leukaemia: a distinct t cell disorder or a variant form of t prolymphocytic leukaemia? Leukemia 1997;11:1009–13. 10.1038/sj.leu.2400710 [DOI] [PubMed] [Google Scholar]
- 65. Pawson R, Greenhalgh T, Harvey G, et al. Harvey G et al realist review--a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy 2005;10 Suppl 1:21–34. 10.1258/1355819054308530 [DOI] [PubMed] [Google Scholar]
- 66. Wong G, Greenhalgh T, Westhorp G, et al. Buckingham J et al RAMESES publication standards: realist syntheses. BMC Med 2013;11:21. 10.1186/1741-7015-11-21 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67. Duddy C, Wong G. Explaining variations in test ordering in primary care: protocol for a realist review. BMJ Open 2018;8:e023117. 10.1136/bmjopen-2018-023117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68. Greenhalgh J, Manzano A. Manzano A understanding ‘context’ in realist evaluation and synthesis. Int J Soc Res Methodol 2022;25:583–95. 10.1080/13645579.2021.1918484 [DOI] [Google Scholar]
- 69. Emmel N, Greenhalgh J, Manzano A, et al. Doing realist research. 1 Oliver’s Yard, 55 City Road London EC1Y 1SP, 10.4135/9781526451729 [DOI] [Google Scholar]
- 70. Vitae . n.d. Research project Stakeholders 2022. Available: https://www.vitae.ac.uk/doing-research/leadership-development-for-principal-investigators-pis/leading-a-research-project/applying-for-research-funding/research-project-stakeholders
- 71. NIHR . NIHR guidance on Co-producing a research project 2021. n.d. Available: https://www.learningforinvolvement.org.uk/content/resource/nihr-guidance-on-co-producing-a-research-project/
- 72. NIHR Policy Research Unit Older People and Frailty . Experts by experience. 2023. Available: https://www.opfpru.nihr.ac.uk/our-people/experts-by-experience/#:~:text=We%20consider%20experts%20by%20experience,patients
- 73. Williams O, Tembo D, Ocloo J. COVID-19 and Co-production in Health and Social Care. Vol 2: Volume 2: Co-production Methods and Working Together at a Distance, Available: https://research-portal.uea.ac.uk/en/publications/covid-19-and-co-production-in-health-and-social-care-vol-2-volume
- 74. Flynn R, Schick-Makaroff K, Levay A, et al. Developing an initial program theory to explain how patient-reported outcomes are used in health care settings: methodological process and lessons learned. Int J Qualit Method 2020;19:160940692091629. 10.1177/1609406920916299 [DOI] [Google Scholar]
- 75. Rycroft-Malone J, McCormack B, Hutchinson AM, et al. Hutchinson A et al realist synthesis: illustrating the method for implementation research. Implement Sci 2012;7:33. 10.1186/1748-5908-7-33 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76. Garden CLP. Garden C Lego serious play: building engagement with cell biology. Biochem Molecular Bio Educ 2022;50:216–28. 10.1002/bmb.21608 Available: https://iubmb.onlinelibrary.wiley.com/toc/15393429/50/2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77. Nielsen MF. Using artifacts in Brainstorming sessions to secure participation and Decouple Sequentiality. Discourse Studies 2012;14:87–109. 10.1177/1461445611427211 [DOI] [Google Scholar]
- 78. Wong G, Greenhalgh T, Pawson R. Pawson R et al Internet-based medical education: a realist review of what works, for whom and in what circumstances. BMC Med Educ 2010;10:12. 10.1186/1472-6920-10-12 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79. Jagosh J. CARES realist methodology training. 2022. Available: https://realistmethodology-cares.org/dec2023realistsynthesismasterclass
- 80. Team EndNote . Endnote. 2013. Available: https://support.clarivate.com/Endnote/s/article/Citing-the-EndNote-program-as-a-reference?language=en_US
- 81. Tacconelli E. Systematic reviews: CRD's guidance for undertaking reviews in health care. Lancet Infect Dis 2010;10:226. 10.1016/S1473-3099(10)70065-7 [DOI] [Google Scholar]
- 82. Rayyan . Faster Systematic Reviews 2022, Available: https://www.rayyan.ai
- 83. Pawson R. Evidence-based policy. In: Evidence-based Policy: A Realist Perspective. 1 Oliver’s Yard, 55 City Road, London England EC1Y 1SP United Kingdom: : Sage, 2006. 10.4135/9781849209120 [DOI] [Google Scholar]
- 84. Pollitt C, Pawson R. The science of evaluation: A realist manifesto. Int Rev Admin Sci 2013;79:580–2. 10.1177/0020852313497455 [DOI] [Google Scholar]
- 85. Wong G, Westhorp G, Manzano A, et al. RAMESES II reporting standards for realist evaluations. BMC Med Educ 2016;14. 10.1186/s12916-016-0643-187 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86. Dalkin S, Forster N, Hodgson P, et al. Using computer assisted qualitative data analysis software (CAQDAS; Nvivo) to assist in the complex process of realist theory generation, refinement and testing. Int J Soc Res Methodol 2021;24:123–34. 10.1080/13645579.2020.1803528 [DOI] [Google Scholar]
- 87. Hunter R, Gorely T, Beattie M, et al. Realist review. Int Rev Sport Exercise Psychol 2022;15:242–65. 10.1080/1750984X.2021.1969674 [DOI] [Google Scholar]
- 88. Gilmore B, McAuliffe E, Power J, et al. Vallieres F et al data analysis and synthesis within a realist evaluation: toward more transparent methodological approaches. Int J Qualitative Method 2019;18:160940691985975. 10.1177/1609406919859754 [DOI] [Google Scholar]
- 89. Jagosh J, Pluye P, Wong G, et al. Critical reflections on realist review: insights from Customizing the methodology to the needs of Participatory research assessment. Res Synth Methods 2014;5:131–41. 10.1002/jrsm.1099 [DOI] [PubMed] [Google Scholar]
- 90. Greenhalgh T, Pawson R. Wong G et al Retroduction in realist evaluation. The RAMESES II Project 2017, Available: http://www.ramesesproject.org/media/RAMESES_II_Retroduction.pdf
- 91. UNISON . Defining black. 2023. Available: https://www.unison.org.uk/about/what-we-do/fairness-equality/black-members/defining-black/
- 92. Tuckman BW. Tuckman B developmental sequence in small groups. Psychological Bulletin 1965;63:384–99. 10.1037/h0022100 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjopen-2023-082564supp001.pdf (38.4KB, pdf)
bmjopen-2023-082564supp002.pdf (24.9KB, pdf)


