Abstract
Background
In conflict settings, research capacities have often been de-prioritized as resources are diverted to emergency needs, such as addressing elevated morbidity, mortality and health system challenges directly and/or indirectly associated to war. This has had an adverse long-term impact in such protracted conflicts such as those found in the Middle East and North Africa region (MENA), where research knowledge and skills have often been compromised. In this paper, we propose a conceptual framework for health research capacity strengthening that adapts existing models and frameworks in low- and middle-income countries and uses our knowledge of the MENA context to contextualise them for conflict settings.
Methods
The framework was synthesized using “best fit” framework synthesis methodology. Relevant literature, available in English and Arabic, was collected through PubMed, Google Scholar and Google using the keywords: capacity building; capacity strengthening; health research; framework and conflict. Grey literature was also assessed.
Results
The framework is composed of eight principal themes: “structural levels”, “the influence of the external environment”, “funding, community needs and policy environment”, “assessing existing capacity and needs”, “infrastructure and communication”, “training, leadership and partnership”, “adaptability and sustainability”, and “monitoring and evaluation”; with each theme being supported by examples from the MENA region. Our proposed framework takes into consideration safety, infrastructure, communication and adaptability as key factors that affect research capacity strengthening in conflict. As it is the case more generally, funding, permissible political environments and sustainability are major determinants of success for capacity strengthening for health research programmes, though these are significantly more challenging in conflict settings. Nonetheless, health research capacity strengthening should remain a priority.
Conclusion
The model presented is the first framework that focuses on strengthening health research capacity in conflict with a focus on the MENA region. It should be viewed as a non-prescriptive reference tool for health researchers and practitioners, from various disciplines, involved in research capacity strengthening to evaluate, use, adapt and improve. It can be further extended to include representative indicators and can be later evaluated by assessing its efficacy for interventions in conflict settings.
Keywords: Capacity strengthening, Conceptual framework, Research, Health, MENA, Conflict
Key messages
Health research capacity strengthening is vital, especially in conflict areas.
Frameworks for health research capacity strengthening in conflict settings are almost non-existent.
The MENA region is in urgent need of capacity strengthening of health research given that it only contributes to 1.5% of annual global publications.
The model developed here will be useful for interdisciplinary health and development researchers and practitioners in academia and humanitarian and development NGOs.
Background
Recent reports have estimated that almost two billion people currently live in areas of conflict and fragility and the world is experiencing the largest refugee crisis since the Second World War, with a new record high of 70.8 million forcibly displaced people worldwide in 2019 [1].
The Middle East and North Africa (MENA) region, which is the focus of this paper, is witnessing an unprecedented scale of multiple and complex emergency situations with protracted conflict being a pervasive reality in the region (see Table 1 for definition). For example, the Syrian, Yemeni and Libyan crises that started in 2011, the earlier Iraqi (since 2003) and Palestinian (since 1948) conflicts along with other emerging conflicts such as in Sudan (in 2019) continue to affect the whole region [6–9]. Moreover, following the Syrian crisis, some 6.6 million Syrians have been internally displaced and another 5.6 million are registered as refugees in the surrounding countries [10]. As for Yemen, more than 2 million people have been displaced and 14 million are currently facing pre-famine conditions [11]. The situation in both Iraq and Libya is also still unstable with continued insecurity [12]. The region is thus facing various health problems, such as the re-emergence of communicable diseases like polio and malaria, a rise in malnutrition, post-traumatic stress disorder (PTSD), the changing patterns of multidrug resistant pathogens, and the burden of various already existing communicable and non-communicable diseases; all of which need to be urgently addressed [13].
Table 1.
Protracted Conflict: Hostile interactions which extend over long periods of time with sporadic outbreaks of open warfare fluctuating in frequency and intensity [2]. | |
MENA (Middle East and North Africa) Region: Covers 24 countries, namely the 21 members of the Arab League (Algeria, Bahrain, Djibouti, Egypt, Iraq, Jordan, Kuwait, Lebanon, Libya, Mauritania, Morocco, Oman, Palestine, Qatar, Saudi Arabia, Somalia, Sudan, Syria, Tunisia, the United Arab Emirates and Yemen), as well as Iran, Israel and Turkey [3, 4]. | |
Capacity strengthening: As a working definition, capacity strengthening can be understood as a process of developing, upgrading and/or expanding pre-existing capabilities at the individual, organisational, and institutional levels to plan, conduct, and disseminate evidence-based knowledge [5]. |
While research capacity strengthening might seem counterintuitive in these conflict settings, where the immediate pressures of survival and relief from conflict become the dominant paradigm, we argue that as crises are increasingly protracted, a different response paradigm is needed, that includes research capacity strengthening. Doing so could aid in collecting evidence of the highest standard, assessing actual health needs of affected populations, bridging the gap between research and practice and eventually informing advocacy and policy change [14]. Additionally, strengthening research capacity could help address major endemic diseases in their epidemiological context, evaluate and improve relief work, and support social changes to improve the accountability and quality of assistance provided in these settings and thus enhance the wellbeing of affected communities. This would also help influence post-conflict policies and perhaps even promote efforts for peace [15]. It is with this understanding that this paper seeks to develop a framework for capacity strengthening for health research in conflict, with a specific focus on the MENA region.
The challenges of research capacity strengthening in MENA and beyond
Research capacity strengthening has become a growing priority for both local and regional institutions in low- and middle-income countries (LMICs), as well as for international organisations and research funding agencies [16, 17]. This has been due, in part, to the need to implement evidence-based interventions in LMICs, where health research is limited [18, 19], as evidence-based research is vital for improving health outcomes, systems, and policies [20]. While there is widespread acknowledgment of the need to improve research outputs from LMICs, defining what capacity strengthening for health research entails is both conceptually complex and context-sensitive [21–24] (see Table 1 for our definition).
One of the major challenges of research capacity strengthening interventions in LMICs and MENA is funding and investment [18]. Despite becoming subject to new health, social care and development challenges, the MENA region’s health research is fragmented and inadequate due to the lack of national policies or strategic plans that favour the investment in such projects [25]. Though the region is rich in oil and includes high-income economies, investment in research in the MENA region is lagging behind at the global scale. For example, despite having 5% of the world’s population, the region contributes only 1.5% of the scientific papers published globally every year [26, 27]. This deficit is further evidenced when considering the expenditure on research and development, as percentage of Gross Domestic Product (GDP), where the whole MENA region allocates an average of 0.93% of its GDP compared to the global average of 2.23% GDP [28]. Meanwhile, a recent narrative review found that among reported health research capacity strengthening interventions in LMICs between 1992 and 2017, only four studies (9% of interventions) were in the MENA region, and focusing only on the United Arab Emirates, Qatar, Iran and Turkey [24].
When it comes to conflict-specific areas, however, conducting research and capacity strengthening faces serious challenges and constraints. The priorities of international, national and local interventions shift between security, conflict resolution, acute humanitarian response and refugee and migration management. In the context of prolonged conflict, such as that experienced by some MENA countries, institutions partially resume their pre-conflict activities in the context of continuing and emerging challenges, which include lack of security, collapse of infrastructure, and the need to cultivate trust among stakeholders involved in research. These challenges are usually prioritised over research investments, funding and related activities [29–31].
Despite the constraints, there is a growing interest in research capacity strengthening interventions in the region [7]. Health researchers from the MENA have begun to explore solutions for research capacity deficits in the context of crisis in collaboration with international partners. There are some leading examples of such interventions: such as the European Union funded Research Capacity for Public Health in the Mediterranean (RESCAP-MED) collaboration which focused on capacity building for non-communicable disease research in the MENA region since the Arab revolutions unfolded in 2010 [32, 33]. A similar partnership is the RECAP project that brings together the London School of Tropical Medicine (LSHTM), the American University of Beirut, the University of Sierra Leone, as well as non-governmental organizations (NGOs), with the aim of strengthening research capacity and the preparedness for humanitarian crises and epidemics [34]. Research for Health in Conflict MENA (R4HC-MENA) – the project that this research forms a part of – is another partnership between UK-based and MENA academic institutions, that aims to develop sustainable research capacity in the region to address major health challenges arising from conflict, with a focus on Jordan, the Occupied Palestinian Territories, Lebanon and Turkey, as well as conflict-affected populations in Syria, Iraq, Libya and Yemen [35].
Much of the literature on research capacity strengthening explores practical ways of strengthening the translation of research into policy and practice [36–39]. While this is fundamental for research capacity strengthening, here we are interested in exploring conceptual frameworks that focus on strengthening research capacity itself as well as implications for evidence-based policy and practice [5, 40–45]. Most conceptual frameworks thus far have been developed by international and academic institutions to define and assess capacity strengthening for health research in general settings. They often provide guidance and structure on evaluation, sustainability, administration, and data sharing and communication [46–48] but never target the specificities of conflict settings.
Thus, building on the work of Marjanovic et al. which highlighted the importance of research capacity building in protracted conflicts [49], the aim of this paper is to synthesise a framework for health research capacity strengthening in conflict in the MENA region that provides a better understanding of contextualized capacity strengthening interventions. The framework builds on the analysis of existing models and frameworks for health research capacity strengthening in LMICs and contextualises them into an operational framework for capacity strengthening for the region and beyond. More specifically, the paper seeks to reformulate the existing frameworks where security and functional policy environments have been taken for granted. The framework is intended to be a stimulus (and a working tool) for further strengthening of infrastructures for empirical research in conflict, where evidence-based service provision and quality of care research are often lacking.
Results
Our search found very limited English-language literature on capacity strengthening of health research in conflict settings, despite its importance in bringing innovative health research findings to humanitarian and frontline practitioners [14]. DeJong and colleagues [50] have highlighted the capacity strengthening implications of building research networks that elevate the voice of internationally underrepresented regions from conflict settings and their contributions to setting research priorities. Meanwhile, the context-specific requirement for capacity strengthening priorities in emergency settings has been addressed in reviews on capacity strengthening by Eade [51] and by Woodward et al. [30]. For the most part, operational research has mainly been conducted by non-governmental organizations [24, 52, 53]. Moreover, related literature in Arabic was almost non-existent, with most of what was found focusing on the lack of research culture in the region despite its substantive financial and human resources [54–56].
In terms of frameworks, we found 17 research capacity building/strengthening frameworks. The frameworks are diverse in terms of both region/country of intervention and of the themes targeted. A summary of the major, but not all, themes targeted in these frameworks is represented in Table 2.
Table 2.
Reference | Themes | Location |
---|---|---|
[57–60] | Partnership, training, leadership, mentorship | USA [57], Canada [58], African continent [60] |
[61] [62] [39] | Policy | LMICs [39], Bangladesh, Fiji, India, Lebanon, Moldova, Pakistan, South Africa, Zambia [61], Bangladesh, Gambia, India and Nigeria [62] |
[63] | Funding | Bangladesh |
[64, 65] | Bridging with practice | Australia |
[20, 40, 41, 44, 66–70] | Multiple themes: financing, sustainability, political environment, mentorship, training … | Multiple |
However, all of these frameworks were applied for interventions taking place in various places like the UK, Europe, Bangladesh, Australia, and Canada but did not target the MENA region or any conflict-affected setting specifically. Websites of organisations working in conflict-affected areas in the MENA region, such as Oxfam, Médecins Sans Frontières (MSF), International Development Research Centre (IDRC), Norwegian Refugee Council (NRC) and Danish Refugee Council (DRC) were also assessed. Although they provide operational research, training and capacity strengthening initiatives, we could not find comprehensive research strengthening frameworks which they adopt or use on their websites.
Based on the aims of our work, we found two frameworks to be particularly relevant, especially as they provide indicators for the evaluation of each theme within their frameworks which can be re-evaluated during the lifetime of the R4HC-MENA project. For instance, Cooke’s [40] framework was used for interventions in complex settings by Marjanovic et al. [49]. Meanwhile, DFID’s [41] model provides a detailed “how to note” that describes the major steps needed to be taken to build research capacity at the individual, institutional and organisational levels while including the main criteria that should be taken into account for the evaluation of the progress at each of these levels. The model does not address the specificities of conflict nor that of the MENA region but is rather more generic. A summary of both frameworks is presented below. However, this is not to discount the importance of the other selected frameworks (cited above) which were also taken into consideration in guiding us in the synthesis of the proposed framework.
Cooke’s framework focuses on the implementation and evaluation of capacity strengthening of health research (Fig. 1). One of the important factors it addresses is that capacity strengthening can be considered as both “an end” and as a “process to an end.” The framework has two dimensions: four structural levels of development and six principles of capacity strengthening that cut across the four structural levels. The structural levels include individuals, teams, institutions and networks. The six principles are: building skills and confidence, developing linkages and partnerships, ensuring the research is ‘close to practice’, developing appropriate dissemination, investments in infrastructure and building elements of sustainability and continuity [40]. Cooke’s framework aims to bridge the gap between research and practice by involving practitioners in primary research. Moreover, Cooke highlights the impact of policy on research capacity strengthening and how it can strongly influence opportunities to develop, support and sponsor research and researchers. Nonetheless, when exploring published journal articles that focus on health research capacity strengthening, Cooke’s framework was highly cited between 2005 and 2019 (254 times), in a field which is not widely studied.
DFID’s framework sets out a step-by-step approach to how capacity strengthening can be addressed, implemented and evaluated (Fig. 2). It provides definitions of concepts and includes good practice examples of capacity strengthening, such as the partnership between DFID and the Southern African Federation of the Disabled (SAFOD) in implementing the SAFOD Research Programme (SRP) that aims to strengthen the capacity of researchers with disabilities by training them to be fully involved in research [71]. The major aspects included in this framework are performance, change and adaptation, and capabilities and resources. DFID also adopts the European Centre for Development Policy Management’s core capabilities: empowerment, management of relationships, implementation of goals, resource mobilisation, managing change, encouraging motivation and managing complexity. Based on these capabilities, capacity strengths and weaknesses can be diagnosed in order to be improved over time.
However, the available frameworks have been the subject of critique from many researchers in this field. Bates et al. [18], Cole et al. [72] and Marjanovic et al. [49] have analysed the different aspects of the available conceptual frameworks for capacity strengthening and concluded that these frameworks and their corresponding indicators do not focus on interlinking the different activities with resulting outputs and outcomes at the different structural levels, and thus lack cohesion and consistency [73]. Cooke’s framework – like many others – is not able to fully cover the challenges of research capacity strengthening in conflict-affected settings. Moreover, and as indicated by Cooke herself, the framework’s indicators are not exhaustive as most of them focus on capacity strengthening as an end; other indicators should be included that take into account that the desired outcomes of research capacity strengthening should be directly related to social impact.
Despite its detailed description and being the most comprehensible among the non-academic frameworks, DFID’s framework also needs to be tailored to conflict settings, along with a stronger outcome-oriented approach. Indeed, Marjanovic et al. [49] highlight the limited literature on using frameworks for capacity strengthening in settings of prolonged conflict. All told, there is a clear need to develop new frameworks for capacity strengthening of health research.
A conceptual model for capacity strengthening of health research in conflict
Our analysis of the available research capacity strengthening frameworks has highlighted a significant gap in targeting conflict-affected areas, including the MENA region. Thus, as a start, the proposed framework seeks to address this gap, and tries to account for the factors and levels we believe are elemental to research capacity strengthening in the MENA region more broadly, and in conflict-affected areas specifically. As such, the proposed framework recognises major factors that contribute to enhancing research capacity strengthening in conflict settings, at the institutional, organisational and individual levels with a view to producing research that has social impact. Moreover, highlighting factors like communication, infrastructure and adaptability, which are problematic in conflict, contextualises the framework to conflict-affected areas. The proposed conceptual model for health research capacity strengthening in conflict-affected areas in the MENA region is presented in Fig. 3 below. This is followed by a more detailed explanation, with reference to the literature and the specificities of conflict-affected areas in the region, of each of the eight major elements within this framework which are: structural levels, external environment, funding, community needs and policy environment, assessing existing capacity and needs, infrastructure and communication, partnership, training and leadership including gender equity, adaptability and sustainability, and monitoring and evaluation.
Discussion
Structural levels
One of the main areas of disagreement in the capacity strengthening literature is the classification of the structural levels involved in research capacity strengthening. How these levels are structured and the interconnections between them determine how strategies for capacity strengthening are designed [74, 75]. The framework of Levels and Dimensions that emerged in the mid-1990s indicated that any capacity strengthening initiative should be examined from all of the proposed structural levels [76]. This framework is extensively applied; however, the specific structural levels used vary widely based on the organisation. For instance, the most commonly used structural levels of capacity strengthening, adopted by the United Nations Development Program (UNDP) and DFID, are the individual, institutional and organisational levels [41, 74]. The individual level includes researchers and research teams; the organisational level is composed of university research departments, think tanks and similar organisations; and the institutional level encompasses the regulatory environment and includes governmental bodies and policy makers [74]. Minor modifications to the classification of the structural levels listed above also exist in the literature. For example, LaFond and Brown [43] call these levels personnel, organisation and system, and in Cooke’s [40] framework, the individual level is divided into individuals and teams, and the institutional level is synonymous with the term networks [77, 78]. Meanwhile, Lansang and Dennis [69] add two additional levels: national and supranational, to address investments in capacity strengthening at the national and international levels. Bates, Boyd [18] combine the organisational and institutional levels together under the term “institutional” and add a societal level – similar to the “national” level of Lansang and Dennis’ work – while keeping the individual level that included researchers and research groups. The WHO, however, adopts a framework that has five structural levels that take into account the complexity of the public sector: individual, organisational, networks, institutional context of the public sector and action environment are differentiated from each other [76, 79].
Higher levels of categorisation can lead to unnecessary complexity in conflict settings. In our framework, we decided to adopt the three major levels used by DFID and UNDP: individual, organisational and institutional. However, we mainly focused on exploring the major themes and sub-themes that are related to research capacity strengthening at the individual and organisational levels since, as mentioned earlier, in times of conflict it is more than challenging to have interventions at the institutional level (off-white in Fig. 3) as defence, security and immediate humanitarian response are prioritised over research [30, 80].
External environment
In contexts of prolonged conflict, the external environment is an overarching factor in successful health research capacity strengthening, and should be the point of departure in thinking about the health research capacity strengthening process. Drawing on LaFond and Brown [43], we have used the following six factors: cultural, social, economic, political, legal, and environmental as issues to consider in the overall environment. This conceptualisation of the external environment is also seen in the DFID framework, which places external context and external intervention in the outermost sphere of influence [41]. Similarly, White’s framework also considers the social and cultural environment as the major determinants of research on health [44]. While the external environment certainly plays a role in any capacity strengthening project, it is particularly important in conflict settings, as each of the aspects of the external environment is affected by conflict.
Furthermore, the political and legal situation may be in a state of flux due to conflict that also makes the cultural and social aspects hard to identify due to the complexity and the variability in these determinants among affected populations. Therefore, the environmental situation with regards to the six factors above can greatly advance or delay health research capacity strengthening, especially in conflict [14, 80]. For instance, a recent study conducted by Al-Hamadani et al. [81] stated that the historical, ethical, cultural, political and institutional factors impede the development of health research and systems in Kurdistan, Iraq, with the ongoing conflict in the surrounding area and inter-dependence of these factors accounting for the failure or unsustainability of any efforts.
Funding, community needs and policy environment
Emerging from the external environment are a number of conditions that are critical to successful health research capacity strengthening, namely: the availability of funding, meeting community needs and an enabling policy environment. Many frameworks, especially those targeting LMICs, do not take funding into consideration at the early stage of capacity strengthening but rather consider it as a factor that might later influence the sustainability of the intervention [19]. However, in the MENA region, particularly in conflict settings, the availability of funds to strengthen research is highly limited [82], given the above-mentioned shift in priorities to defence and national security along with the lack of research culture. Finding funding opportunities is also problematic knowing that sources of funding for health research is often separate from funding for humanitarian programs and services. Thus, researchers tend to “tailor” their research to be suitable to funding by external agencies regardless of its social impact, thus rendering both funding and donors’ interests the major driving forces of research [83]. Though this is also common in non-conflict settings, its implications are much more significant in conflict where “useful” research that fits with the community needs is urgently needed, especially on the frontline.
Many frameworks consider policy as a key factor for research capacity strengthening. For instance, Bowen and Zwi [38] present a framework of action which is entirely influenced, if not driven, by policy; but they argue that the latter is mainly determined by evidence and thus can be considered in accordance with community needs. Similarly, Cooke [40] highlights the impact of policy on capacity strengthening on all levels of her framework.
Despite the important role that policy plays in driving research in stable settings, it has a secondary role in research capacity strengthening in conflict compared to other factors like funding, partnership with international institutions and the willingness of local populations to participate, all of which contributes to initiatives that have direct impact on research on health. Thus, we argue that while policy is often paralysed in conflict settings, community needs become a contributing factor to research. This is not to exclude the role that governments can play in promoting/hindering research and its capacity strengthening. For instance, health interventions in Lebanon are not strongly monitored by the government where international agencies have established parallel systems in response to the Syrian refugee crisis [84]. Similarly in Iraq, there are limited regulations on the private healthcare sector [85]. On the other hand, research is strongly regulated and monitored in Egypt [86] and Yemen, where any health intervention is highly controlled by armies or militias, depending on the site of the intervention, and is politically instrumentalised [87, 88].
Assessing existing capacity and needs
The immediate response to most emergency situations is a humanitarian impulse to act, and urgently. However, it is important to identify actual needs and priorities, especially in conflict where human and physical resources are already stretched [89, 90]. Thus, a comprehensive needs assessment to determine the actual gaps in research in conflict settings is crucial and should be considered as part of the planning process for research capacity strengthening [91]. Since such an assessment provides more upfront knowledge regarding research needs, especially on the frontlines, it can also be considered as a tool for evaluating ongoing interventions. As a result, our framework includes a feedback loop from this section to the one above (funding and community needs) so that interventions that meet community needs are prioritised for funding in an attempt to bridge the gap between evidence and practice, a problematic issue even in non-conflict settings [37, 92]. While the quality and quantity of data in conflict is usually limited, recent reports indicate improved data quality in conflict due to, to a large extent, needs assessments and research conducted as part of the humanitarian response [82, 93–95].
Infrastructure and communication
In spite of its importance, communication is rarely mentioned in the literature as a stand-alone factor for research capacity strengthening as it is mainly considered as one of the core concepts of partnership [96]. However, in conflict settings, communication – even on the local level – is challenging. So, providing access to reliable internet and other communication tools is crucial to conduct rapid and high-quality community-based research and to have effective capacity strengthening on both institutional and individual levels [97–99].
Infrastructure is a basic pillar in any health research capacity strengthening framework. For instance, Baillie, Bjarnholt [36] place resourcing, including infrastructure, at the very bottom of the pillars for research capacity strengthening for public health. In Cooke’s framework, principle number six focuses on “investing in infrastructure” as a specific intervention for successful research capacity strengthening. That said, physical infrastructure is not given much attention compared to other components like project management and annual appraisal [40]. In frameworks focusing on research capacity strengthening in the global North, much emphasis is placed on improving individual skills and governance over physical infrastructure that, despite its importance, is counted as an antecedent [43, 45, 65].
However, infrastructure is a main consideration and often a limiting factor in health research capacity strengthening in conflict settings. The availability of safe and accessible buildings to conduct primary research and training is crucial [49, 84]. Yet, we have seen ample evidence of how healthcare infrastructure has been a target of attacks during conflicts in Syria, Yemen and Iraq in recent years [100]. Hence, considering the challenges of providing safe physical surroundings, distance learning capabilities and communication with other locations is critical. This has been shown to be useful in conflict settings like Yemen where SMS text messaging was used for education and health promotion in a project conducted by UNICEF [101]. Similarly, tele-medicine was successfully used for mentoring medical doctors and providing clinical decision support in intensive care units in different parts of Syria and in operation rooms in Gaza [102, 103].
Similarly, a major entity that should be established and continuously monitored is the Institutional Review Board (IRB) for ethical review of research protocols. IRBs are often not well-prepared to provide rigorous and rapid reviews of health research protocols in conflict settings and with conflict-affected populations. As for the MENA region, there is a large disparity when it comes to the presence of regulatory bodies for ethics and their adherence to international guidelines. For instance, in Lebanon, a unified system of research governance does not exist, and hence research regulation is greatly influenced by the policies of individual institutions and their IRBs [104]. Syria and Iraq also do not have specific guidelines for research ethics but refer to international guidelines like the Helsinki Declaration, and International Ethical Guidelines for Biomedical Research Involving Human Subjects (CIOMS). Palestine and Yemen, however, have no documents that refer to any national or international guidelines for research ethics [105]. Thus there is an urgent need to strengthen the research ethics capacity at both the institutional and individual level in the region by having programs which are similar to Middle East Research Ethics Training Initiative (MERETI) and Salim El-Hoss Bioethics and Professionalism Program (SHBPP) [106].
Language can also be a barrier to conducting research in conflict, especially in the MENA region where along with Arabic fus’ha there are 16 other Arabic dialects which differ significantly from each other [107]; not to mention other languages that are widely spoken in MENA like Farsi, Turkish, Hebrew, Kurdish, along with several minority languages [108]. The interaction of local researchers with international partners and the dissemination of research findings also necessitates a knowledge of the English language by local researchers. As a result, infrastructure to mitigate language barriers like translators and presence of adequate language facilities in conflict are indispensable [109]. Despite being a common feature in both general and conflict settings, language barriers can have drastic consequences in conflict as the timely critical local narratives and qualitative data require rapid and accurate accurate interpretation.
In conflict-affected regions, funding, communication, and infrastructure are thus the main limiting factors for capacity strengthening and tend to be cross-cutting and interdependent. Consequently, infrastructure was incorporated into our model in a triangular shape that shows the additive nature of the factors included: physical infrastructure and a safe location is the top requirement for research capacity strengthening which can then feed into more advanced infrastructure building (labs, IT, etc.). The investments needed in infrastructure are usually larger than any single capacity strengthening activity or program, often needing large financial and technological investment, not to mention additional safety and security measures which could be challenging in conflict [49, 110, 111].
Training, leadership and partnership
Another framework that emerged in the mid-1990s with the Framework of Levels is the Framework of Partnership that focuses on the need for equitable and effective partnership between donors and beneficiaries or local and international bodies when strengthening capacity, so that sustainable development would eventually be locally owned [76, 112, 113]. Building partnerships is widely adopted in most of the health interventions in LMICs [75, 76, 114, 115], however the level of collaboration between researchers and relief agencies is still underdeveloped and challenging [116, 117]. To overcome this aspect, ELRHA’s Research for Health in Humanitarian Crises (R2HC) programme provides funding for partnerships between academic institutions and humanitarian NGOs. Between 2013 and 2019, seven funding calls have resulted in more than 50 studies being funded. A recent report by ELRHA highlighted the importance of strong collaboration between the different stakeholders involved in a project in a humanitarian setting as it facilitates data collection and thus leads to well-designed and contextualised interventions [118].
For Baillie, Bjarnholt [36], ‘leadership’ and ‘resourcing’ lie at the heart of the capacity strengthening process. In our model, training, leadership, and partnership are major research capacity strengthening activities. Training is part of the individual capacity strengthening process while partnerships takes place at the organisational and institutional levels. Leadership fits in the middle of these two categories. Similar to the research capacity strengthening levels, we modelled training, leadership, and partnerships as a Euler diagram, due to the overlap between these categories.
Farmer and Weston [45] discuss disciplinary diversity in partnerships, something we captured in the model in two ways: partnerships between researchers of different disciplines and those between different academic institutions and practitioner groups (e.g. from NGOs). This is critical to health research capacity strengthening in conflict-affected contexts since knowledge of different disciplines in sciences, social sciences, and medicine are required. Partnerships with practitioners are key in conflict settings as they will often have better access to affected populations [52]. Partnerships therefore help to bridge the gap between research and practice by involving practitioners in primary research.
We also included North/South partnerships in our model, as these can be crucial in many ways, such as providing distance learning, increased lab capacity, training, mentorship, and so on [69]. However, despite the potential benefits of such partnerships, there is a risk of inequality between local and international partners where research topics are specified by the Northern partners and the external funders, along with inequality in the distribution of the benefits of research [96, 119–123]. Endeavouring to overcome these inequities should be at the heart of any partnership.
For leadership, we focused on governance and mentorship. Governance or management is more of an organizational aspect and is necessary to build strong research projects, strengthen partnerships, and manage funding. Mentorship focuses more on the individual side of capacity strengthening and is crucial for increasing the number of young researchers in the pipeline. It can take multiple forms, but primarily serves early career researchers and students. Mentorship is often local, but can take place in North/South partnerships as well. We also note the overlap between mentorship and training: while mentors certainly provide training, there is some training needed for mentors/leaders to be effective [124]. This is an often overlooked aspect of capacity strengthening but can improve relationships between mentors and mentees and increase the number of researchers focusing on health in conflict and establish sustainable working groups [124]. Equally overlooked is reverse mentoring where early career researchers provide new skills and ideas to more established researchers. A great example of the establishment of such a working group is the International Working Group on Reproductive Health, which contributed to capacity strengthening in the MENA region by supporting and creating a research community that included early career researchers and seniors with multidisciplinary backgrounds [50].
Training, meanwhile, is important for expanding the number of researchers and improving their research and language skills. For health research capacity strengthening, it is aimed at two groups: students (undergraduate and postgraduate) and practitioners [125]. This is important in conflict settings where we primarily look to involve practitioners. These individuals may not have prior research training or experience so courses and workshops can be very effective at increasing the prospects and potential of joint projects. The trainings for both students and practitioners should include topics like qualitative and quantitative research skills, research ethics, and data analysis, all of which help in mentoring individuals who wish to conduct research during humanitarian crises [126].
Gender equity in academia is already a challenge even in the most developed countries [127]. As for the MENA region, gender gap is normalized but varies from country to country depending on culture, social norms, policies, and stability [128]. Ongoing conflicts and patriarchy have restricted the progress in women rights and their political roles. Yet following the Arab spring many countries are in a transition state, and deeply-embedded institutional and cultural barriers to gender equity are being questioned and reconsidered. Positive developments regarding gender equity in general, and women in academia in specific, can thus be achieved in the near future [129]. Capacity building interventions should promote gender equity, especially in conflict settings, by training, mentoring and empowering local female researchers to become leaders in the field of health research. Hence, “Gender Equity” as a theme in the framework is expanded to cover all aspects of capacity strengthening at the individual and institutional levels.
However, the extent to which training, partnerships and leadership can be implemented depends highly on the availability of infrastructure and communication which, as mentioned before, can be hindered in conflict unless advanced technology and innovative approaches are used to overcome these challenges.
Adaptability and sustainability
Sustainability is a crucial component of capacity strengthening, yet is a major challenge. Consequently, it is an essential part of frameworks for health research capacity strengthening, and is considered as part of the feedback loop within these frameworks [5, 37, 40, 41, 43, 130]. Sustainability is usually attained when the newly acquired skills and facilities following a certain intervention are well maintained and put to use, i.e. individual researchers and teams continue to conduct health research with improved quality [131, 132]. However, “uncertainty is the only certainty there is” in conflict and thus sustainability is challenged by many factors like funding, scarcity of resources, political and economic instability, the downward spiral of fragility including the collapse of educational and health systems. In conflict, the flight of health workers, researchers and skilled administrators is one of the key barriers to sustainability [133]. For example, thousands of health practitioners have left Syria since 2011, which has led to a severe shortage in health workers, especially in the most severely affected areas of the country, such as Aleppo where 96% of medical doctors had fled by 2014 [134, 135].
In our model, adaptability is purposefully placed before sustainability. In conflict, the whole setting is fragile and subject to changing dynamics. Capacity strengthening should thus align with humanitarian work with respect to preparedness and adaptability to changes, such as through the use of tools that can be set up and dismantled easily, data collection tools that could be used in emergencies like District Health Information Software (DHIS)1 and KoBo,2 and modifying the content of training to be more suitable to the current situation [136]. One example is MSF’s application that was launched in 2017 and is used by MSF fieldworkers and by organizations like WHO and UNICEF. The application is seen as a tool for training the fieldworkers as it provides the latest medical guidelines [137]. Another example is the MENA Youth Capacity Building in Humanitarian Action (MYCHA) programme, which conducts training to youth from the MENA region. It aims to empower youth in conflict settings by preparing them to be involved in response and conflict resolution and by providing six-month mentorship and support for their own humanitarian projects that they implement within their local contexts. The content of such trainings are regularly refined in order to address the realities faced in the field [138] This element is also the beginning of a feedback loop in our model. Capacity strengthening is a continuous process, and our feedback loop relates back to both the external environment and assessment of needs and priorities.
Monitoring and Evaluation
Another factor that feeds into the feedback loop is monitoring and evaluation [67]. The targets in our model are aimed at health research in conflict settings including evidence-based practice, auditing, and effective dissemination. Long-term impacts like changing institutional and policy norms to support conducting research with a social impact are also included within the monitoring and evaluation process. Such long-term objectives are in accordance with the strategies addressed in the DFID and Cooke frameworks that consider changing the rules of the game as desired long-term ends for capacity strengthening [40, 41].
In an unstable and high-risk setting, where even daily activities have to be negotiated and adapted, it is difficult to implement monitoring and evaluation activities, and to predict both long-term and short-term impact. Thus, in such settings, real-time evaluation for capacity strengthening, as a tool of continuous improvement and development, is more beneficial compared to the conventional thematic evaluation approach for frameworks of capacity strengthening due to the lack of knowledge and stability [49].
Another question that also arises is whether capacity strengthening in conflict should be considered as an end or as a process to an end [40]. Since long-term objectives are less likely to be achieved in fragile settings, it would be more realistic to consider capacity strengthening, with its standard indicators of dissemination and number of trainings conducted, as an end in the context of conflict when evaluating the intervention.
Limitations
The search in the literature for frameworks was based on systematic search using key words that align with our definition of capacity strengthening, in a field with inconsistent terminology [139]. Thus, it was challenging to form a search strategy that would uncover all relevant articles and frameworks. This limitation was not unique to this paper, as other recent reviews of capacity building/strengthening literature have noted similar challenges [140, 141]. Similarly, we faced the same challenge when looking for references in Arabic. Therefore, we cannot claim that we identified all of the frameworks available in the literature that focus on capacity strengthening for health research. Another limitation is that the search only included reports and journal articles that are written in English and Arabic and not in other languages of the MENA region, such as French or Turkish.
Conclusion
The model presented in this work synthesises the different evaluation frameworks for health research capacity strengthening, while paying specific attention to the challenges presented by conflict settings, particularly in the MENA region. It expands on the existing frameworks and connects the broad overview framework used in the literature with more detailed structures. Though any progress achieved in any structural level would influence overall research capacity strengthening, sustained effort at all levels is needed. The model can also be considered as a non-prescriptive reference tool for people involved in research capacity strengthening to evaluate, use, adapt and improve. We have invested our efforts in developing this comprehensive model with an operational focus, developed for a wide audience of stakeholders in mind, from healthcare practitioners and researchers to funding agencies, and across disciplinary divides, encompassing both the medical sciences and the social sciences. It can be further extended to include representative indicators and can be later evaluated by assessing its efficacy for interventions in conflict settings.
Methods
The framework was synthesized in accordance with the methodology provided by Carroll et al. [142] on “best fit” framework synthesis which provides the ability to design a context-specific model by building on existing models and theories and testing their feasibility, applicability and their fit to evidence from a certain context. Relevant literature written in both Arabic and English, including frameworks and conceptual models, were collected and reviewed through PubMed and the internet search engines Google Scholar and Google. Examples of keywords included are: capacity building; capacity strengthening; health research; framework and conflict. Frameworks, policy papers and reports publicly available on the websites of key funders and international and bilateral organisations were also screened. We only selected documents which described frameworks that meet our definition for capacity strengthening (see Table 1), are widely applicable, and are not intervention specific.
A structured qualitative approach was used to analyse the selected documents to be reduced to their key elements and variables, such as levels, sublevels, external environment, evaluation, and applicability in conflict settings; all of which form the major themes of the proposed framework [143]. Evidence from included studies was also used to feed into existing themes or to form new themes within this framework. The proposed framework, and its themes, are therefore the result of the thematic analysis and contextualized interpretation of evidence from the various frameworks reported in published and grey literature.
Acknowledgements
We would like to thank Mrs. Mireille El Haber, the communication officer at the Global Health Institute-American University of Beirut, for working on the graphics of the model.
Abbreviations
- DFID
Department for International Development
- DHIS
District Health Information Software
- DRC
Danish Refugee Council
- GDP
Gross Domestic Product
- IDRC
International Development Research Centre
- LMIC
Low and Middle-Income Country
- LPHA
Lancet Palestinian Health Alliance
- LSHTM
London School of Hygiene & Tropical Medicine
- MENA
Middle East and North Africa
- MSF
Médecins Sans Frontières
- MYCH MENA
Youth Capacity Building in Humanitarian Action
- NGO
Non-Governmental Organization
- NRC
Norwegian Refugee Council
- PTSD
Post-Traumatic Stress Disorder
- R2HC
Research for Health in Humanitarian Crises
- R4HC
Research for Health in Conflict MENA
- RECAP
Research Capacity Building and Knowledge
- REDCAP-MED
Research Capacity for Public Health in the Mediterranean
- SAFOD
Southern African Federation of the Disabled
- SRP
SAFOD Research Programme
- UN OCHA
United Nations Office for the Coordination of Humanitarian Affairs
- UN
United Nations
- UNDP
United Nations Development Programme
- UNHCR
United Nations High Commissioner for Refugees
- UNICEF
United Nations International Children’s Emergency Fund
- WHO
World Health Organization
Authors’ contributions
NE contributed substantially to the conception, took the lead in writing the manuscript, and revised several draft versions to reflect feedback from other authors. OD conceptualised the research study and contributed to writing the first draft of the paper. AP substantively revised and edited the paper. HL designed the model that was continuously revised and updated by AR, MM, and NE. AR helped in writing the first draft of the paper. AP, AR, MM, RA and AK provided critical feedback and helped shape the manuscript. PP oversaw the project, contributed with literature, authored sections of the article and provided analytical feedback for the discussion of the paper. All authors read, edited and approved the final manuscript.
Funding
This research was funded through UK Research and Innovation as part of the Global Challenges Research Fund; Research for Health in Conflict in the Middle East and North Africa (R4HC-MENA) project, grant number ES/P010962/1.
Availability of data and materials
All data generated or analysed during this study are included in this published article.
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
DHIS is an open source software platform for reporting, analysis and dissemination of data for all health programs.
The KoBoToolbox is a set of tools for building forms and collecting interview responses built by the Harvard Humanitarian Initiative for use in difficult field settings, such as humanitarian emergencies or post-conflict environments. It is currently hosted and supported by United Nations Office for the Coordination of Humanitarian Affairs (UN OCHA)
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Nassim El Achi, Email: ne88@aub.edu.lb.
Andreas Papamichail, Email: a.papamichail@qmul.ac.uk.
Anthony Rizk, Email: anthony.rizk@outlook.com.
Helen Lindsay, Email: hlinds18@bu.edu.
Marilyne Menassa, Email: mm205@aub.edu.lb.
Rima A. Abdul-Khalek, Email: ra271@aub.edu.lb
Abdulkarim Ekzayez, Email: abdulkarim.ekzayez@kcl.ac.uk.
Omar Dewachi, Email: omar.dewachi@rutgers.edu.
Preeti Patel, Email: preeti.patel@kcl.ac.uk.
References
- 1.UNHCR. Worldwide displacement tops 70 million, UN Refugee Chief urges greater solidarity in response. [Updated June 19, 2019. Available from: https://www.unhcr.org/news/press/2019/6/5d03b22b4/worldwide-displacement-tops-70-million-un-refugee-chief-urges-greater-solidarity.html. Accessed 13 Oct 2019].
- 2.Azar EE, Jureidini P, McLaurin R. Protracted social conflict; theory and practice in the Middle East. J Palest Stud. 1978;8(1):41–60. doi: 10.2307/2536101. [DOI] [Google Scholar]
- 3.El-Erian Mohamed A., Fischer Stanley. Economic and Political Impediments to Middle East Peace. London: Palgrave Macmillan UK; 2000. Is MENA a Region? The Scope for Regional Integration; pp. 70–86. [Google Scholar]
- 4.Gasiorowski M. The government and politics of the Middle East and North Africa. London: Hachette; 2016.
- 5.Bates I, Akoto AYO, Ansong D, Karikari P, Bedu-Addo G, Critchley J, et al. Evaluating health research capacity building: an evidence-based tool. PLoS Med. 2006;3(8):e299. doi: 10.1371/journal.pmed.0030299. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.UNHCR. Syria Emergency 2018. [Updated April 19, 2018. Available from: http://www.unhcr.org/syria-emergency.html. Accessed 15 Dec 2018].
- 7.Horton R. Offline: global health has forgotten the Arab world. Lancet. 2019;393(10179):1398. doi: 10.1016/S0140-6736(19)30805-0. [DOI] [PubMed] [Google Scholar]
- 8.Malley, R.10 Conflicts to Watch in 2018. International Crisis Group; 2018. [Available from: https://www.refworld.org/pdfid/5a685fe44.pdf]. Accessed 12 Nov 2018.
- 9.Ali H. The Palgrave Handbook of Ethnicity. 2019. Post-Arab spring: the Arab world between the dilemma of the nation-state and the rise of identity conflicts; pp. 1–16. [Google Scholar]
- 10.UNHCR. Syrian Regional Refugee Response 2018. [Updated November 12, 2018. Available from: https://data2.unhcr.org/en/situations/syria#_ga=2.159668287.305906316.1542192851-1679636828.1542192851. Accessed 15 Dec 2018].
- 11.UN. Half the population of Yemen at risk of famine: UN emergency relief chief: UN; 2018. [Updated October 23, 2018. Available from: https://news.un.org/en/story/2018/10/1023962. Accessed 15 Dec 2018].
- 12.UNHCR . Update on UNHCR’s operations in the Middle East and North Africa (MENA) 2018. [Google Scholar]
- 13.Howard A, O’Donoghue M, Feeney A, Sleator RD. Acinetobacter baumannii: an emerging opportunistic pathogen. Virulence. 2012;3(3):243–250. doi: 10.4161/viru.19700. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Ford N, Mills EJ, Zachariah R, Upshur R. Ethics of conducting research in conflict settings. Confl Heal. 2009;3(1):7. doi: 10.1186/1752-1505-3-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Kivimäki T. Can peace research make peace?: lessons in academic diplomacy (international relations monographs). Abingdon: Ashgate Publishing Group; 2012.
- 16.Frenk J. The global health system: strengthening national health systems as the next step for global progress. PLoS Med. 2010;7(1):e1000089. doi: 10.1371/journal.pmed.1000089. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Frenk J, Chen L. Overcoming gaps to advance global health equity: a symposium on new directions for research. Health Res Policy Syst. 2011;9(1):11. doi: 10.1186/1478-4505-9-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Bates I, Boyd A, Aslanyan G, Cole DC. Tackling the tensions in evaluating capacity strengthening for health research in low-and middle-income countries. Health Policy Plan. 2014;30(3):334–344. doi: 10.1093/heapol/czu016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Nchinda TC. Research capacity strengthening in the south. Soc Sci Med. 2002;54(11):1699–1711. doi: 10.1016/S0277-9536(01)00338-0. [DOI] [PubMed] [Google Scholar]
- 20.WHO, editor. The Bamako Call to Action on Research for Health: Strengthening research for health, development, and equity From the Global Ministerial Forum on Research for Health. In: Global Ministerial Forum on Research for Health Bamako, Mali. Geneva: World Health Organization; 2008.
- 21.Bates I, Boyd A, Smith H, Cole DC. A practical and systematic approach to organisational capacity strengthening for research in the health sector in Africa. Health Res Policy Syst. 2014;12(1):11. doi: 10.1186/1478-4505-12-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Burke MA, Matlin SA. Monitoring financial flows for health research 2008: prioritizing research for health equity. 2008. [Google Scholar]
- 23.Trostle J. Research capacity building in international health: definitions evaluations and strategies for success. Soc Sci Med. 1992;35(11):1321–1324. doi: 10.1016/0277-9536(92)90035-O. [DOI] [PubMed] [Google Scholar]
- 24.Bowsher G, Papamichail A, El Achi N, Ekzayez A, Roberts B, Sullivan R, et al. A narrative review of health research capacity strengthening in low and middle-income countries: lessons for conflict-affected areas. Glob Health. 2019;15(1):23. doi: 10.1186/s12992-019-0465-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Jabbour S, Yamout R, Giacaman R, Khawaja M, Nuwayhid I. Public health in the Arab World. Cambridge: Cambridge University Press; 2012.
- 26.Habibzadeh F. Scientific research in the Middle East. Lancet. 2014;383:e1–e2. doi: 10.1016/S0140-6736(13)62738-5. [DOI] [PubMed] [Google Scholar]
- 27.Zewail AH. Dire need for a Middle eastern science spring. Nat Mater. 2014;13(4):318. doi: 10.1038/nmat3918. [DOI] [PubMed] [Google Scholar]
- 28.The World Bank . Research and development expenditure (% of GDP) 2016. [Google Scholar]
- 29.Jayasuriya D, Jayasuriya R, Tay AK, Silove D. Associations of mental distress with residency in conflict zones, ethnic minority status, and potentially modifiable social factors following conflict in Sri Lanka: a nationwide cross-sectional study. Lancet Psychiatry. 2016;3(2):145–153. doi: 10.1016/S2215-0366(15)00437-X. [DOI] [PubMed] [Google Scholar]
- 30.Woodward A, Sondorp E, Witter S, Martineau T. Health systems research in fragile and conflict-affected states: a research agenda-setting exercise. Health Res Policy Syst. 2016;14(1):51. doi: 10.1186/s12961-016-0124-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Silove D, Rees S, Tam N, Liddell B, Zwi A. Staff management and capacity building under conditions of insecurity: lessons from developing mental health service and research programs in post-conflict Timor-Leste. Australas Psychiatry. 2011;19(1_suppl):S90–SS4. doi: 10.3109/10398562.2011.583076. [DOI] [PubMed] [Google Scholar]
- 32.RESCAP-MED. Newcastle University; [Available from: https://research.ncl.ac.uk/rescap-med/. Accessed 14 Dec 2018].
- 33.Phillimore P, Sibai AM, Rizk A, Maziak W, Unal B, Abu Rmeileh N, et al. Context-led capacity building in time of crisis: fostering non-communicable diseases (NCD) research skills in the Mediterranean Middle East and North Africa. Glob Health Action. 2019;12(1):1569838. doi: 10.1080/16549716.2019.1569838. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.LSHTM. RECAP [Available from: https://www.lshtm.ac.uk/research/centres-projects-groups/recap. Accessed 14 Dec 2018].
- 35.R4HC-MENA: Developing capability, partnerships and research in the Middle East and North Africa [Available from: https://r4hc-mena.org/. Accessed 14 Dec 2018].
- 36.Baillie E, Bjarnholt C, Gruber M, Hughes R. A capacity-building conceptual framework for public health nutrition practice. Public Health Nutr. 2009;12(8):1031–1038. doi: 10.1017/S1368980008003078. [DOI] [PubMed] [Google Scholar]
- 37.Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell K, Stillman L, et al. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41(3–4):171–181. doi: 10.1007/s10464-008-9174-z. [DOI] [PubMed] [Google Scholar]
- 38.Bowen S, Zwi AB. Pathways to “evidence-informed” policy and practice: a framework for action. PLoS Med. 2005;2(7):e166. doi: 10.1371/journal.pmed.0020166. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Harries A, Khogali M, Kumar A, Satyanarayana S, Takarinda K, Karpati A, et al. Building the capacity of public health programmes to become data rich, information rich and action rich. Public Health Action. 2018;8(2):34–36. doi: 10.5588/pha.18.0001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Cooke J. A framework to evaluate research capacity building in health care. BMC Fam Pract. 2005;6(1):44. doi: 10.1186/1471-2296-6-44. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.DFID . Capacity building in research. 2010. [Google Scholar]
- 42.Brown L, LaFond A, Macintyre KE. Measuring capacity building: Carolina population center. Chapel Hill: University of North Carolina at Chapel Hill; 2001. [Google Scholar]
- 43.LaFond A, Brown L. A guide to monitoring and evaluation of capacity building interventions in the health sector in developing countries. 2003. [Google Scholar]
- 44.White F. Capacity-building for health research in developing countries: a manager's approach. Rev Panam Salud Publica. 2002;12:165–172. doi: 10.1590/S1020-49892002000900004. [DOI] [PubMed] [Google Scholar]
- 45.Farmer E, Weston K. A conceptual model for capacity building in Australian primary health care research. Aust Fam Physician. 2002;31(12):1139. [PubMed] [Google Scholar]
- 46.Ghaffar DA, Ijsselmuiden C, Zicker F. Changing mindsets: research capacity strengthening in low-and middle-income countries. Geneva: Council on Health Research for Development (COHRED); 2008. [Google Scholar]
- 47.Preskill H, Boyle S. A multidisciplinary model of evaluation capacity building. Am J Eval. 2008;29(4):443–459. doi: 10.1177/1098214008324182. [DOI] [Google Scholar]
- 48.Sridharan S, Nakaima A. Ten steps to making evaluation matter. Eval Program Plann. 2011;34(2):135–146. doi: 10.1016/j.evalprogplan.2010.09.003. [DOI] [PubMed] [Google Scholar]
- 49.Marjanovic S, Cochrane G, Robin E, Sewankambo N, Ezeh A, Nyirenda M, et al. Evaluating a complex research capacity-building intervention: reflections on an evaluation of the African institutions initiative. Evaluation. 2017;23(1):80–101. doi: 10.1177/1356389016682759. [DOI] [Google Scholar]
- 50.DeJong J, Zurayk H, Myntti C, Tekçe B, Giacaman R, Bashour H, et al. Health research in a turbulent region: the Reproductive Health Working Group. Reprod Health Matters. 2017;25(sup1):4–15. doi: 10.1080/09688080.2017.1379864. [DOI] [PubMed] [Google Scholar]
- 51.Eade D. Capacity-building: an approach to people-centred development: Oxfam. 1997. [Google Scholar]
- 52.Zachariah R, Harries AD, Ishikawa N, Rieder HL, Bissell K, Laserson K, et al. Operational research in low-income countries: what, why, and how? Lancet Infect Dis. 2009;9(11):711–717. doi: 10.1016/S1473-3099(09)70229-4. [DOI] [PubMed] [Google Scholar]
- 53.Zachariah R, Ford N, Draguez B, Yun O, Reid T. Conducting operational research within a non governmental organization: the example of Medecins sans Frontieres. Int Health. 2010;2(1):1–8. doi: 10.1016/j.inhe.2009.12.008. [DOI] [PubMed] [Google Scholar]
- 54.Nazif A. . Raseef22. 2017.
- 55.Public health in the Arab world: Future Directions. Chapter in the the 10th Annual Arab Report on Cultural Development. The Arab Thought Foundation. [Available from http://arabthought.org]; Accessed 25 Sept 2018.
- 56.Arvanitis SHR.. Beirut: Center of Arab Unity studies; 2015. 400 p.
- 57.Corbie-Smith G, Bryant AR, Walker DJ, Blumenthal C, Council B, Courtney D, et al. Building capacity in community-based participatory research partnerships through a focus on process and multiculturalism. Prog Community Health Partnersh. 2015;9(2):261–273. doi: 10.1353/cpr.2015.0038. [DOI] [PubMed] [Google Scholar]
- 58.Benzies KM, Barnes D, Clifford T, Bouayad A, Hardy D, Korneluk Y, et al. Building Canada's health research capacity within the framework of the Canadian Institutes of Health Research. Paediatr Child Health. 2001;6(8):517–521. doi: 10.1093/pch/6.8.517. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Li Ryan, Ruiz Francis, Culyer Anthony J., Chalkidou Kalipso, Hofman Karen J. Evidence-informed capacity building for setting health priorities in low- and middle-income countries: A framework and recommendations for further research. F1000Research. 2017;6:231. doi: 10.12688/f1000research.10966.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Owusu F, Kalipeni E, Kiiru JMM. Capacity building for research leadership: the need, support and strategies for growing African research leaders. 2014. [Google Scholar]
- 61.Rodríguez DC, Hoe C, Dale EM, Rahman MH, Akhter S, Hafeez A, et al. Assessing the capacity of ministries of health to use research in decision-making: conceptual framework and tool. Health Res Policy Syst. 2017;15(1):65. doi: 10.1186/s12961-017-0227-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Hawkes S, K Aulakh B. Jadeja N, Jimenez M, Buse K, Anwar I, et al. Strengthening capacity to apply health research evidence in policy making: experience from four countries. Health Policy Plan. 2015;31(2):161–170. doi: 10.1093/heapol/czv032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Mahmood S, Hort K, Ahmed S, Salam M, Cravioto A. Strategies for capacity building for health research in Bangladesh: role of core funding and a common monitoring and evaluation framework. Health Res Policy Syst. 2011;9(1):31. doi: 10.1186/1478-4505-9-31. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Gullick JG, West SH. Building research capacity and productivity among advanced practice nurses: an evaluation of the Community of Practice model. J Adv Nurs. 2016;72(3):605–619. doi: 10.1111/jan.12850. [DOI] [PubMed] [Google Scholar]
- 65.Hulcombe J, Sturgess J, Souvlis T, Fitzgerald C. An approach to building research capacity for health practitioners in a public health environment: an organisational perspective. Aust Health Rev. 2014;38(3):252–258. doi: 10.1071/AH13066. [DOI] [PubMed] [Google Scholar]
- 66.Pang T, Sadana R, Hanney S, Bhutta ZA, Hyder AA, Simon J. Knowledge for better health: a conceptual framework and foundation for health research systems. Bull World Health Organ. 2003;81:815–820. [PMC free article] [PubMed] [Google Scholar]
- 67.ESSENCE . Planning, Monitoring and Evaluation Framework for Research Capacity Strengthening. 2016. [Google Scholar]
- 68.Brownson RC, Fielding JE, Green LW. Building capacity for evidence-based public health: reconciling the pulls of practice and the push of research. Annu Rev Public Health. 2018;39:27–53. doi: 10.1146/annurev-publhealth-040617-014746. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Lansang MA, Dennis R. Building capacity in health research in the developing world. Bull World Health Organ. 2004;82:764–770. [PMC free article] [PubMed] [Google Scholar]
- 70.Friesen EL, Comino EJ, Reath J, Derrett A, Johnson M, Davies GP, et al. Building research capacity in south-West Sydney through a primary and community Health Research unit. Aust J PrimHealth. 2014;20(1):4–8. doi: 10.1071/PY12081. [DOI] [PubMed] [Google Scholar]
- 71.Phiri AM. Building communities of trust: Challenges for disability. African journal of disability. 2014;3(2):77-9. [DOI] [PMC free article] [PubMed]
- 72.Cole DC, Boyd A, Aslanyan G, Bates I. Indicators for tracking programmes to strengthen health research capacity in lower-and middle-income countries: a qualitative synthesis. Health Res Policy Syst. 2014;12(1):17. doi: 10.1186/1478-4505-12-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Dean L, Gregorius S, Bates I, Pulford J. Advancing the science of health research capacity strengthening in low-income and middle-income countries: a scoping review of the published literature, 2000–2016. BMJ Open. 2017;7(12):e018718. doi: 10.1136/bmjopen-2017-018718. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Assessment, UNDP Capacity. "Development in a Systems and Strategic Management Context." Technical advisory paper 3;1998. [Available from: https://www.cbd.int/doc/pa/tools/Capacity%20assessment%20and%20development.pdf]; Accessed 25 Sept 2018.
- 75.Babu SC, Sengupta D. Capacity Development as a Research Domain: Frameworks, Approaches, and Analytics. ISNAR Disc Pap. 2006;9:1-6.
- 76.Milèn A, World Health Organization . What do we know about capacity building?: an overview of existing knowledge and good practice. 2001. [Google Scholar]
- 77.Gee M, Cooke J. How do NHS organisations plan research capacity development? Strategies, strengths, and opportunities for improvement. BMC Health Serv Res. 2018;18(1):198. doi: 10.1186/s12913-018-2992-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Njie-Carr V, Kalengé S, Kelley J, Wilson A, Muliira JK, Nabirye RC, et al. Research capacity–building program for clinicians and staff at a community-based HIV clinic in Uganda: a pre/post evaluation. J Assoc Nurses AIDS Care. 2012;23(5):431–441. doi: 10.1016/j.jana.2011.11.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Hilderbrand ME, Grindle MS, Trostle JA, Sommerfeld JU, Simon JL, Lippincott DF, III, et al. Getting good government: capacity building in the public sectors of developing countries. Cambridge: Harvard University Press; 1997. [Google Scholar]
- 80.Wood EJ. The ethical challenges of field research in conflict zones. Qual Sociol. 2006;29(3):373–386. doi: 10.1007/s11133-006-9027-8. [DOI] [Google Scholar]
- 81.Al-Hamadani Ashraf S., Jaff Dilshad, Edwards Mark. The factors impeding health system reform in Iraqi Kurdistan region. Medicine, Conflict and Survival. 2018;35(1):80–102. doi: 10.1080/13623699.2018.1552239. [DOI] [PubMed] [Google Scholar]
- 82.Blanchet Karl, Ramesh Anita, Frison Severine, Warren Emily, Hossain Mazeda, Smith James, Knight Abigail, Post Nathan, Lewis Christopher, Woodward Aniek, Dahab Maysoon, Ruby Alexander, Sistenich Vera, Pantuliano Sara, Roberts Bayard. Evidence on public health interventions in humanitarian crises. The Lancet. 2017;390(10109):2287–2296. doi: 10.1016/S0140-6736(16)30768-1. [DOI] [PubMed] [Google Scholar]
- 83.Boddy K, Cowan K, Gibson A, Britten N. Does funded research reflect the priorities of people living with type 1 diabetes? A secondary analysis of research questions. BMJ Open. 2017;7(9):e016540-e. doi: 10.1136/bmjopen-2017-016540. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Ammar W, Kdouh O, Hammoud R, Hamadeh R, Harb H, Ammar Z, et al. Health system resilience: Lebanon and the Syrian refugee crisis. J Glob Health. 2016;6(2):020704. doi: 10.7189/jogh.06.020704. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Al Hilfi TK, Lafta R, Burnham G. Health services in Iraq. Lancet. 2013;381(9870):939–948. doi: 10.1016/S0140-6736(13)60320-7. [DOI] [PubMed] [Google Scholar]
- 86.El-Awady N. Egyptian researchers decry ‘security monitoring’: Nature Middle East; 2016. [Available from: https://www.natureasia.com/en/nmiddleeast/article/10.1038/nmiddleeast.2016.97]; Accessed 15 Dec 2018.
- 87.Alterman J. Aid and Conflict: Pitfalls in Yemen. Washington D.C: Center for Strategic and International Studies; 2018. [Google Scholar]
- 88.Rabih A. Exclusive – Yemeni plan in works to stop Houthi meddling in humanitarian work: ASHARQ AL-AWSAT; 2018. [Available from: https://aawsat.com/english/home/article/1433486/exclusive-%E2%80%93-yemeni-plan-works-stop-houthi-meddling-humanitarian-work]; Accessed 13 Nov 2018.
- 89.Redmond AD. Needs assessment of humanitarian crises. BMJ (Clinical research ed) 2005;330(7503):1320–1322. doi: 10.1136/bmj.330.7503.1320. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Gabriel S, Goetschel L. A Conflict Sensitive Approach to Field Research: Doing Any Better? swiss academies reports. 2017;12(5):9-13.
- 91.Peykari N, Owlia P, Malekafzali H, Ghanei M, Babamahmoodi A, Djalalinia S. Needs assessment in health research projects: a new approach to project management in Iran. Iran J Public Health. 2013;42(2):158–163. [PMC free article] [PubMed] [Google Scholar]
- 92.Bani IA. Health needs assessment. J Fam Community Med. 2008;15(1):13–20. [PMC free article] [PubMed] [Google Scholar]
- 93.Axinn WG, Ghimire D, Williams NE. Collecting survey data during armed conflict. J Off Stat. 2012;28(2):153. [PMC free article] [PubMed] [Google Scholar]
- 94.Barakat S, Chard M, Jacoby T, Lume W. The composite approach: research design in the context of war and armed conflict. Third World Q. 2002;23(5):991–1003. doi: 10.1080/0143659022000028530. [DOI] [Google Scholar]
- 95.Rachel Thompson MK. Healthcare in conflict settings: leaving no one behind. Doha: WISH; 2018. [Google Scholar]
- 96.Larkan F, Uduma O, Lawal SA, van Bavel B. Developing a framework for successful research partnerships in global health. Glob Health. 2016;12(1):17. doi: 10.1186/s12992-016-0152-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 97.Meier P, Leaning J. Crisis Mapping Working Paper I of III Harvard Humanitarian Initiative. 2009. Applying technology to crisis mapping and early warning in humanitarian settings. [Google Scholar]
- 98.Johnston MJ, King D, Arora S, Behar N, Athanasiou T, Sevdalis N, et al. Smartphones let surgeons know WhatsApp: an analysis of communication in emergency surgical teams. Am J Surg. 2015;209(1):45–51. doi: 10.1016/j.amjsurg.2014.08.030. [DOI] [PubMed] [Google Scholar]
- 99.Wright J, Walley J. Assessing health needs in developing countries. BMJ. 1998;316(7147):1819–1823. doi: 10.1136/bmj.316.7147.1819. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 100.Briody C, Rubenstein L, Roberts L, Penney E, Keenan W, Horbar J. Review of attacks on health care facilities in six conflicts of the past three decades. Confl Heal. 2018;12(1):19. doi: 10.1186/s13031-018-0152-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 101.Garber K, Carrette S. Using Technology in Fragile, conflict, and violence situations. 2018. [Google Scholar]
- 102.Moughrabieh A, Weinert C. Rapid deployment of international Tele–intensive care unit Services in war-Torn Syria. Ann Am Thorac Soc. 2016;13(2):165–172. doi: 10.1513/AnnalsATS.201509-589OT. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 103.Yara Abi Nader ST. In Gaza, hand surgery gets remote assistance from Beirut. Reuters. 2016. [Updated: May 4, 2016. Available from: https://www.reuters.com/article/us-mideast-surgery/in-gaza-hand-surgery-gets-remote-assistance-from-beirut-idUSKCN0XV27C. Accessed 5 Oct 2018].
- 104.Nakkash R, Qutteina Y, Nasrallah C, Wright K, El-Alti L, Makhoul J, et al. The practice of research ethics in Lebanon and Qatar: perspectives of researchers on informed consent. J Empir Res Hum Res Ethics. 2017;12(5):352–362. doi: 10.1177/1556264617730643. [DOI] [PubMed] [Google Scholar]
- 105.Alahmad G, Al-Jumah M, Dierickx K. Review of national research ethics regulations and guidelines in Middle eastern Arab countries. BMC Med Ethics. 2012;13(1):34. doi: 10.1186/1472-6939-13-34. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 106.Silverman H, Edwards H, Shamoo A, Matar A. Enhancing research ethics capacity in the Middle East: experience and challenges of a Fogarty-sponsored training program. J Empir Res Hum Res Ethics. 2013;8(5):40–51. doi: 10.1525/jer.2013.8.5.40. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 107.Versteegh K. Arabic language. Eidinburgh: Edinburgh University Press; 2014.
- 108.Held C. Middle East patterns, student economy edition: places, people, and politics: Routledge. 2018. [Google Scholar]
- 109.Businario R. Relief operations across language barriers: the interpreter factor. https://bit.ly/2QvUmHY. Accessed 13 Jan 2019
- 110.Bustreo F, Genovese E, Omobono E, Axelsson H, Bannon I. Improving child health in post-conflict countries: can the World Bank contribute. Washington D.C.: The World Bank; 2005. p. 9-12.
- 111.Waters Hugh, Garrett Brinnon, Burnham Gilbert. Making Peace Work. London: Palgrave Macmillan UK; 2009. Rehabilitating Health Systems in Post-Conflict Situations; pp. 200–227. [Google Scholar]
- 112.OECD. Shaping the 21st century: the contribution of development cooperation. Paris: OECD Publishing; 1996.
- 113.Katz JS, Martin BR. What is research collaboration? Res Policy. 1997;26(1):1–18. doi: 10.1016/S0048-7333(96)00917-1. [DOI] [Google Scholar]
- 114.Chaskin RJ. Building community capacity: a definitional framework and case studies from a comprehensive community initiative. Urban Aff Rev. 2001;36(3):291–323. doi: 10.1177/10780870122184876. [DOI] [Google Scholar]
- 115.Moed HF. Iran’s scientific dominance and the emergence of south-East Asian countries as scientific collaborators in the Persian Gulf region. Scientometrics. 2016;108(1):305–314. doi: 10.1007/s11192-016-1946-x. [DOI] [Google Scholar]
- 116.Fransman J, Newman K. Rethinking research partnershis: Evidence and the Politics of Participation in Academic-INGO Research Partnerships for International Development–ESRC. Impact. 2017;2017(9):9. doi: 10.21820/23987073.2017.9.9. [DOI] [Google Scholar]
- 117.Stevens D, Hayman R, Mdee A. ‘Cracking collaboration’between NGOs and academics in development research. Dev Pract. 2013;23(8):1071–1077. doi: 10.1080/09614524.2013.840266. [DOI] [Google Scholar]
- 118.Dahab M. Operational challenges of implementing health research in humanitarian settings: Elrha; 2017. [Available from: https://www.elrha.org/researchdatabase/operational-challenges-implementing-health-research-humanitarian-settings/]; Accessed 6 Jan 2019.
- 119.Johnson H, Wilson G. North–South/South–North partnerships: closing the ‘mutuality gap’. Public Administration and Development. Int J Manage Res Pract. 2006;26(1):71–80. [Google Scholar]
- 120.Vasquez EE, Hirsch JS, Giang LM, Parker RG. Rethinking health research capacity strengthening. Glob Public Health. 2013;8(sup1):S104–SS24. doi: 10.1080/17441692.2013.786117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 121.Iyer AR. Authorship trends in the lancet Global Health. Lancet Glob Health. 2018;6(2):e142. doi: 10.1016/S2214-109X(17)30497-7. [DOI] [PubMed] [Google Scholar]
- 122.McCoy D, Mwansambo C, Costello A, Khan A. Academic partnerships between rich and poor countries. Lancet. 2008;371(9618):1055–1057. doi: 10.1016/S0140-6736(08)60466-3. [DOI] [PubMed] [Google Scholar]
- 123.Gaillard JF. North-south research partnership: is collaboration possible between unequal partners? Knowledge Policy. 1994;7(2):31–63. doi: 10.1007/BF02692761. [DOI] [Google Scholar]
- 124.Mormina M, Pinder S. A conceptual framework for training of trainers (ToT) interventions in global health. Glob Health. 2018;14(1):100. doi: 10.1186/s12992-018-0420-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 125.Jeste DV, Twamley EW, Cardenas V, Lebowitz B, Reynolds CF., III A call for training the trainers: focus on mentoring to enhance diversity in mental health research. Am J Public Health. 2009;99(S1):S31–SS7. doi: 10.2105/AJPH.2008.154633. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 126.LPHA. An Intensive Short Course: Research methods for Mental Health in War and Conflict: Birzeit University; 2018 [Available from: http://icph.birzeit.edu/announcements/intensive-short-course-research-methods-mental-health-war-and-conflict. Accessed 14 Dec 2018].
- 127.Kapareliotis Ilias, Miliopoulou Georgia-Zozeta. Advanced Series in Management. 2019. Gender Bias in Academia: An Attempt to Render the Intangible Tangible; pp. 247–271. [Google Scholar]
- 128.Keddie NR. Women in the Middle East: past and present. Woodstock: Princeton University Press; 2012.
- 129.Dalacoura K. Women and gender in the Middle East and North Africa: mapping the field and addressing policy dilemmas at the post-2011 juncture. 2019. [Google Scholar]
- 130.Pickstone C, Nancarrow S, Cooke J, Vernon W, Mountain G, Boyce RA, et al. Building research capacity in the allied health professions. Evid Policy. 2008;4(1):53–68. doi: 10.1332/174426408783477864. [DOI] [Google Scholar]
- 131.Albert E, Mickan S. Closing the gap and widening the scope: new directions for research capacity building in primary health care. Aust Fam Physician. 2003;32(12):1038. [PubMed] [Google Scholar]
- 132.Crisp BR, Swerissen H, Duckett SJ. Four approaches to capacity building in health: consequences for measurement and accountability. Health Promot Int. 2000;15(2):99–107. doi: 10.1093/heapro/15.2.99. [DOI] [Google Scholar]
- 133.Kruk ME, Freedman LP, Anglin GA, Waldman RJ. Rebuilding health systems to improve health and promote statebuilding in post-conflict countries: a theoretical framework and research agenda. Soc Sci Med. 2010;70(1):89–97. doi: 10.1016/j.socscimed.2009.09.042. [DOI] [PubMed] [Google Scholar]
- 134.Fouad FM, Sparrow A, Tarakji A, Alameddine M, El-Jardali F, Coutts AP, et al. Health workers and the weaponisation of health care in Syria: a preliminary inquiry for the lancet–American University of Beirut Commission on Syria. Lancet. 2017;390(10111):2516–2526. doi: 10.1016/S0140-6736(17)30741-9. [DOI] [PubMed] [Google Scholar]
- 135.Cousins S. Syria doctors flee amid crackdown: Al Jazeera; 2014 [Available from: https://www.aljazeera.com/indepth/features/2014/02/syria-doctors-flee-amid-crackdown-2014227125225358518.html. Accessed 6 Dec 2018].
- 136.Van Wassenhove LN. Humanitarian aid logistics: supply chain management in high gear. J Oper Res Soc. 2006;57(5):475–489. doi: 10.1057/palgrave.jors.2602125. [DOI] [Google Scholar]
- 137.MSF releases new medical guidelines app [press release]. 2017.
- 138.Esker Copeland NAE. MYCHA: MENA youth capacity building in humanitarian action. 2018. [Google Scholar]
- 139.Leeman J, Calancie L, Hartman MA, Escoffery CT, Herrmann AK, Tague LE, et al. What strategies are used to build practitioners’ capacity to implement community-based interventions and are they effective?: a systematic review. Implement Sci. 2015;10(1):80. doi: 10.1186/s13012-015-0272-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 140.Bergeron K, Abdi S, DeCorby K, Mensah G, Rempel B, Manson H. Theories, models and frameworks used in capacity building interventions relevant to public health: a systematic review. BMC Public Health. 2017;17(1):914. doi: 10.1186/s12889-017-4919-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 141.Matus J, Walker A, Mickan S. Research capacity building frameworks for allied health professionals–a systematic review. BMC Health Serv Res. 2018;18(1):716. doi: 10.1186/s12913-018-3518-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 142.Carroll C, Booth A, Leaviss J, Rick J. “Best fit” framework synthesis: refining the method. BMC Med Res Methodol. 2013;13(1):37. doi: 10.1186/1471-2288-13-37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 143.Spencer L, Ritchie J. Qualitative data analysis for applied policy research. Analyzing qualitative data. London: Routledge; 2002. p. 187–208.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All data generated or analysed during this study are included in this published article.