Abstract
Background
Research funding and production is inequitably distributed internationally, with emphasis placed on the priorities of funders and international partners. Research capacity development, along with agenda-setting for research priorities can create agency and self-sufficiency and should be inclusive of all relevant stakeholders. Myanmar is a fragile state, where decades of conflict have created a weakened healthcare system and health research sector. The population of Eastern Myanmar have long had their healthcare needs met by community-based organisations and ethnic health organisations operating within Eastern Myanmar and the adjoining Thai–Myanmar border. Despite a transition to civilian rule, the current context does not allow for a truly participatory health research capacity development and agenda-setting exercise between the health leaders of Eastern Myanmar and the government in Yangon. In this context, and with a desire to enhance the capacity, legitimacy and agency of their organisations, the health leaders of Eastern Myanmar are seeking to develop their own health research capacity and to take control of their own research agenda.
Methods
Approximately 60 participants from 15 organisations attended a 3-day forum with the goals of (1) developing research capacity and interest through a research conference and methods workshop; (2) using a nominal group technique (NGT) to develop a locally driven research agenda; and (3) supporting the development of local research projects through ongoing funding and mentorship.
Results
Participants were actively engaged in the workshops and NGT. Participants identified a broad range of health issues as priorities and were able to develop consensus around a list of 15 top priorities for the populations they serve. Despite availability of ongoing support, participants did not pursue the opportunity to engage in their own research projects emerging from this forum.
Conclusions
The NGT was an effective way to achieve engagement and consensus around research priorities between a group of healthcare providers, researchers and policy-makers from a variety of ethnic groups. More active involvement of senior leadership must happen before the energy harnessed at such a forum can be implemented in ongoing research capacity development.
Background
Research funding is inequitably distributed both geographically and with respect to health priorities, and often fails to address the most pressing needs of the global population [1]. The term 10/90 gap was developed in the 1990s to refer to the phenomenon by which only 10% of global funding for research is spent on diseases affecting 90% of the world’s population [2]. While the nature of this gap has changed in the intervening two and a half decades, with increased overall funding for global health research, improvements in innovation, and an increasing number and variety of actors, the gap itself nevertheless remains present today [1]. The 10/90 gap exists largely because research priorities, even those addressing concerns within low- and middle-income countries (LMICs), are often set by funders, international partners and organisations, rather than by the communities who will bear the consequences of what research is or is not prioritised [3]. Whether a cause or a consequence of this, only a very small proportion of research publications emanate from LMICs. For example, despite the fact that 75% of the global burden of cardiovascular disease is found in LMICs, a random selection of 3000 citations found that only 6–8% of peer-reviewed articles were from these countries [4].
The 1990 Commission on Health Research and Development laid out four priorities for health research, namely (1) that all countries should undertake essential national health research, including the establishment of national priorities and the development of local research capacity; (2) that LMIC (then called developing countries) research should be supported by international partnerships; (3) that financial support from international sources should be mobilised to support the research needs of LMICs; and (4) that there should be an international monitoring system for ensuring progress, and for promoting financial and technical support for the research addressing health problems of LMICs [5].
Over the intervening three decades, many countries have worked on priority-setting initiatives [6]; however, there remain challenges in developing participatory processes involving all relevant stakeholders. This has been even more challenging in fragile state contexts where certain ethnic groups, for example, are either in active armed conflict with the national government or have a history of experiencing overt discrimination or neglect [7, 8].
Participatory research is increasingly recognised as an important tool for translating research knowledge into action [9] as opposed to having it sit in the academy or in broad legislative frameworks with little impact on the populations served. Additionally, participatory research can be used as a tool for self-determination and for social justice [9]. This is particularly relevant in contexts such as that of Eastern Myanmar where populations long marginalised wish to have control over research, knowledge creation and programmes that affect them [9]. Finally, participatory research can ensure that research is culturally and logistically appropriate, creates sustainable systems and programmes, and supports capacity development in stakeholders among others. [10]
Myanmar is a nation in which decades of conflict, political repression and mismanagement have resulted in a very weakened healthcare system [11–13]. While there have been some improvements since 2010 with changes to the political system [12], significant challenges remain, particularly in remote and ethnic areas of the country. Myanmar is also a country suffering from a double burden of communicable and non-communicable diseases (NCDs), in which 59% of total mortality is estimated to come from NCDs, 30% from communicable and maternal/perinatal conditions, and 11% from injuries and accidents in the country as a whole [14]. While the Myanmar government has identified many important priorities relevant to Eastern Myanmar in its 2017–2021 National Health Plan [15], including collaboration with ethnic health organisations (EHOs), task shifting, support for health information systems and the promotion of health research, there is great distrust between the EHO and community-based organisations (CBOs) of Eastern Myanmar with regards to respectful, participatory implementation of these recommendations. Eastern Myanmar encompasses Shan state, Kayah state, Kayin state, Mon state and Tanintharyi division (Fig. 1), and is home to many different ethnic minorities, including Shan, Karenni, Karen, Mon and Pa-O, among others. Some of these groups are still in active conflict with the military, while others have been displaced or have had their human rights threatened by various extractive industries and development activities [16–18], all of which have an impact on health and healthcare delivery. These ethnic minorities of Eastern Myanmar represent a distinct subset of the population and previous data suggests that, while they too suffer from a double burden of disease, their rates of communicable diseases related to inadequate access to water and sanitation, persistent presence of malaria and inadequate access to reproductive health services, are higher than the country’s average [19, 20].
Fig. 1.

Map of Myanmar (courtesy of https://en.wikipedia.org/wiki/Myanmar)
EHOs and CBOs have been providing healthcare to the migrant and ethnic populations in Eastern Myanmar and on the Thai–Myanmar border for decades [17]. While their focus has been on the provision of clinical care and public health interventions through stationary and mobile clinics, in 2002, several of these organisations came together to form the Health Information Systems Working Group (HISWG), which seeks to strengthen the healthcare system in Eastern Myanmar with a focus on data management and information sharing [21]. As part of their work, the EHOs and HISWG have been collecting data and doing research with partners for many years (Table 1). Partnerships have developed with international academic institutions as well as non-governmental organisations for this work.
Table 1.
Sample of recent and ongoing research projects in Eastern Myanmar and the Border region involving ethnic health organisations and community-based organisations
| Title of Project | Partners | Funders | Outputs/Results |
|---|---|---|---|
| Reproductive health assessment in the eastern border region of Burma | World Refugee Council, Community Partners International, Burma Medical Association, Back Pack Health Workers Team, Karen Department of Health and Welfare, Mae Tao Clinic | MacArthur Foundation and Swiss Agency for Development and Cooperation | Explored issues around access to sexual and reproductive health services, including cost, decision-making, pregnancy services and place of delivery, family planning, supply chain, and impact of security threats on access to sexual and reproductive health |
|
Health and human rights in Eastern Myanmar after the political transition: a population-based assessment using multistaged household cluster sampling |
Harvard Medical School, Community Partners International, University of Washington, Burma Medical Association, Health Information Systems Working Group, Back Pack Health Worker Team, Mae Tao Clinic, Karen Department of Health and Welfare, Karenni Mobile Health Committee, Mon National Health Committee, Harvard School of Public Health, University of California |
Burma Relief Centre | Household surveys in eastern Myanmar from July 2013–September 2013 exploring demographics, mortality, health outcomes, water and sanitation, food security and nutrition, malaria, and human rights violations |
|
Human resources for health: task shifting to promote basic health service delivery among internally displaced people in ethnic health programme service areas in eastern Burma/Myanmar |
Community Partners International Burma Medical Association, Health Information System Working Group, Back Pack Health Worker Team, Mae Tao Clinic, Karen Department of Health and Welfare, Department of Global Health and Development London School of Hygiene and Tropical Medicine |
Department of Foreign Affairs and Trade (Canada), Burma Relief Center, United Kingdom Department for International Development through Christian Aid, United States Agency of International Development through the International Rescue Committee | Exploration of the effective healthcare service delivery by ethnic health organisations and community-based organisations through standardised training and task shifting in the context of a shortage of formally trained skilled medical professionals |
|
Impact of community-based maternal health workers on coverage of essential maternal health interventions among internally displaced communities in Eastern Burma: The MOM Project |
Center for Public Health and Human Rights, Bloomberg School of Public Health, UCLA School of Medicine, Global Health Access Program, Burma Medical Association, Karen Department of Health and Welfare, Mae Tao Clinic |
Bill and Melinda Gates Institute for Population and Reproductive Health at the Johns Hopkins Bloomberg School of Public Health and the Foundation for the People of Burma. Additional funds for the final survey were provided by a gift to the Center for Public Health and Human Rights at Johns Hopkins |
Outcome evaluation of MOM project (frequency of antenatal care, postnatal care, contraceptive use, unmet need for contraception, skilled birth attendants, etc.) |
|
Community-based delivery of maternal care in conflict-affected areas of eastern Burma: perspectives from lay maternal health workers |
Center for Public Health and Human Rights, Johns Hopkins Bloomberg School of Public Health, Global Health Access Program Berkeley, Burma Medical Association | Bill and Melinda Gates Foundation | Community-based workers’ perspective on rights-based approach to service delivery in a conflict setting in the context of widespread human rights violations |
|
Health and human rights in Karen State, Eastern Myanmar |
Center for Public Health and Human Rights, Bloomberg School of Public Health, Karen Department of Health and Welfare, Division of General Internal Medicine and Health Services Research, University of California Los Angeles Community Partners International, Physicians for Human Rights, University of Minnesota Medical School, Human Rights Center, University of California, Berkeley |
Open Society Institute, the National Endowment for Democracy, and the Oak Foundation |
Cluster survey of households in eastern Myanmar assessing health status, access to healthcare, food security, exposure to human rights violations and identification of alleged perpetrators over the 12 months prior to January 2012 |
While the Commission on Health Research and Development’s recommendations would suggest that the Myanmar government should be responsible for engaging ethnic stakeholders in research priority development, the long history of conflict between these groups makes that challenging [8]. Anticipating major changes to the national healthcare system following the democratic elections of 2010 and 2015, a group of EHOs developed a plan for eventual convergence between the ethnic health systems and the national health system. However, in the same way that setting a research agenda creates agency for a national government, HISWG and the EHOs are interested in having more control over their own research and research agenda, developed in response to their perceived needs, independent from national government priorities but also independent from, and able to influence, the priorities of foreign donors and academic institutions.
In this context, a partnership between the Burma Medical Association (BMA, one of the lead organisations in HISWG), Queen’s University in Kingston, Canada, and Community Partners International (an American NGO based in Yangon, Myanmar) was formed to start working on health research capacity-building and health research agenda-setting for Eastern Myanmar and the Thai–Myanmar border area through an inclusive, participatory research methods and priority-setting forum.
Processes
Nuyens proposes that ‘processes’ are the mechanisms by which stakeholders are involved and decide on research priorities [6]. Limitations to evidence-based agenda-setting can include limitations in the availability of quality data about populations in question and this limitation can be particularly obvious when looking at marginalised groups or subsets of a national population to which national findings might not apply. Survey data, publicly available reports [19, 20], as well as some peer-reviewed publications [22, 23] outlining health conditions and epidemiology are available on the populations of Eastern Myanmar, particularly from the work of HISWG.
Several agenda-setting methodologies are outlined in the academic literature [24]. Comprehensive approaches employing specific tools have been developed by the Child Health and Nutrition Research Initiative (CHNRI), the Council on Health Research and Development (COHRED) and others. The nominal group technique (NGT) is a method in which consensus is achieved through discussion and iterative secret ballot. Developed in the United States in the 1960s, this technique usually involves a small group [9–12] of experts who provide information, rate, discuss and re-rate a series of items or priorities by secret ballot [25]. NGT has been used previously in priority-setting exercises related to physiotherapy research, general practice, stakeholder consensus and implementation science [26–29]. Challenges in using NGT include how to determine which ‘experts’ to include, as well as how to assess the accuracy of the answers obtained, since consensus does not necessarily imply objective truth [30]. Advantages include a flattening of hierarchies as no one person’s view takes priority over others, and the use of secret ballot may allow people more freedom in articulating their opinions [30]. The NGT protocol includes approximately 5 steps per ‘round’ (Table 2). Following introductions and explanations, several rounds can be used in succession to develop consensus on a topic, in this case, the research priorities for Eastern Myanmar.
Table 2.
Nominal Group Technique protocol
| 1. Silent generation of ideas: In this step, participants used sticky notes to write down as many research priorities as they could think of, on their own, without consulting their peers | |
| 2. Sharing of ideas: each participant presented their ideas and put their sticky notes up on a shared board | |
| 3. Group discussion and grouping of ideas: participants, as a group, discussed the ideas presented. No ideas were eliminated, but some ideas were grouped into common themes or groupings. For ideas to be grouped, the participant who generated the idea needed to agree that the idea was the same as the others in the group | |
| 4. Voting and ranking: after discussion participants voted individually, in silence | |
| 5. Compilation of votes and feedback: votes were compiled, and priority ranking lists were fed back to participants. At this point, steps 3 through 5 restart as the priority lists often generate new ideas and points of discussion for participants, causing some participants to change their rank order. Steps 3–5 were repeated twice (secret ballot 1 and 2) in small groups and twice (secret ballot 3 and 4) in the large group |
Objectives
The objectives of the health research agenda-setting exercise were three-fold. The primary objective was to develop a research agenda with local stakeholders for Eastern Myanmar and the Thai–Myanmar border region which could be used to direct international partnership in research as well as local research activities. A second objective was to highlight some of the excellent research work already being done in Eastern Myanmar and the border region through group discussions throughout the process. The third objective was to increase interest and engagement in the idea of research among EHOs and CBOs in order to enable participants to be actively involved in meeting the goals of their own research agenda.
Throughout this process, our explicit priority was to be led by the goals and preferred methods of our local co-investigators from the BMA, ensuring that from conceptualisation to completion, this was a community-led project enhancing local self-determination and community capacity development.
Methods
Local co-investigators from the BMA recruited participants from 16 organisations (Table 3), representing predominantly Mon, Shan, Karen, Karenni and Pa-O ethnic groups. These organisations have been involved in HISWG and other health system strengthening initiatives and represent the main ethnic groups in Eastern Myanmar. Individual participants were identified by their organisation. This was an intentional sampling by participant organisations, but was not necessarily representative of populations served, with an over-representation of participants from organisations in proximity to the forum site due to cost and logistics of travel. Attendance varied only slightly from day to day, and participants in Table 3 are those who were present on the final day, the day of the NGT.
Table 3.
Participant number by organisation (April 11th)
| Organisation | Number of participants on April 11th |
|---|---|
| Burma Based Health Services-Mae Tao Clinic | 1 |
| Burma Medical Association | 20 |
| Back Pack Health Workers Team | 6 |
| Children Development Center | 1 |
| Civil Health and Development Network (Karenni State) | 4 |
| Democratic Karen Benevolent Army | 2 |
| Karen Department of Health and Welfare | 5 |
| Karen Human Rights Group | 2 |
| Khon Kaen University | 1 |
| Malaria Elimination Task Force | 1 |
| Mon National Health Committee | 2 |
| Mae Tao Clinic | 7 |
| Pa-Oh Health Working Committee | 2 |
| Thammasat University (School of Global Studies) | 1 |
| Shan State Development Foundation | 1 |
Curriculum was developed in collaboration by Queen’s University, BMA and Community Partners International leads. These three organisations acted as co-hosts to the event, with contributions from local researchers and health system leaders. Following 2 days of orientation to the research process and in-depth discussions about existing local research activities, during which participants developed research questions and sampling strategies, considered available data sources, and reviewed research methodology and ethics, participants engaged in a brainstorming exercise to identify potential criteria by which they would rank research priorities. After discussion, criteria were elicited through secret ballot in which participants were invited to identify all criteria that seemed relevant to them. Criteria identified by participants are listed in Table 4.
Table 4.
Criteria for prioritisation
| • Number of people affected | |
| • Greatest danger for the community | |
| • Community priorities and ownership | |
| • Impact on the most vulnerable community members | |
| • Feasibility | |
| • Availability of funding | |
| • Human rights (rights of the child, women’s rights) | |
| • Political stability |
Day three was allocated entirely to a NGT [25, 26, 30]. Because of the use of secret ballots, as discussed above, the NGT has the potential to encourage participation by flattening some of the hierarchies that can exist within groups [30]. Given the large number of participants at this workshop, the group was divided into four sub-groups of approximately 15 people. These groups were stable over the course of the workshop, and while there was some mixing of organisations, there was a tendency among participants to stay together with members of their own organisation, or of their own language group, when numbers allowed. Each group completed two rounds of NGT (secret ballots 1 and 2), at which point their top five priorities were fed back to the larger group. The larger group then engaged in a dynamic discussion about the remaining 20 priorities, grouping and re-grouping them into a final 15 priorities. At that point, participants ranked these priorities using a secret ballot (secret ballot 3), which was followed by a final group discussion and a final secret ballot ranking (secret ballot 4). Table 2 outlines the step-by-step NGT process that was used.
As a final component, funding and logistical support were available to support a small research competition. Participants were invited to submit draft proposals based on the priorities identified during the forum over the following 4 weeks. Applicants would then be mentored through ethics submission to the Border-based Community Ethics Advisory Board, development of methods, implementation of research project, and knowledge translation of a small research project specifically related to NGT-identified health and health system priorities, hence further stimulating the development of local research capacity through a successful research experience.
Ethics approval was obtained by Queen’s University Health Sciences and Affiliated Teaching Hospitals Research Ethics Board.
Results
Results of the NGT process
Given the large number of participants, an extremely rich set of potential priorities was initially generated and inevitably some of the subtleties were lost in the process of coming to consensus. The initial brainstorm is retained here in Table 5 as it illustrates the diversity of challenges facing the ethnic populations of Eastern Myanmar and the border region, as well as how broadly participants defined ‘health’.
Table 5.
Initial Nominal Group Technique brainstorm
| Theme | Individual research topics |
|---|---|
| Infectious disease |
• Tuberculosis • HIV • Worms • Diarrhoea • Malaria |
| EPI (Expanded Programme of Immunisation) |
• Immunisation for under 5 • Immunisation for rabies, hepatitis • Immunisation coverage |
| Non-communicable diseases (NCDs) |
• Diabetes mellitus • Heart problem • Stroke • Hypertension • Eye problems • Anaemia • Epilepsy • Disability • Extent of NCDs in ethnic areas • Medication adherence |
| STI/HIV |
• STI health education to reduce prevalence of STIs • HIV/AIDS and availability of treatment |
| Family planning (FP)/reproductive health |
• FP and cultural belief • Reproductive health/family planning • Early marriage • Teenage reproductive health • Breastfeeding |
| Antenatal care (ANC)/Safe delivery |
• At least 4 ANC visits for every pregnancy • Anaemia • Safe delivery • Teenage pregnancy • Traditional birth attendants • Home delivery |
| Gender |
• Gender based violence • Domestic workers • Early marriage |
| Mental health |
• Mental health • Mental health and alcohol use among married men • Stress • Social and mental health among men who use injection drugs |
| Drug use |
• Betel nut chewing • Smoking • Alcohol use • Drug use (particularly methamphetamines, yaba) • Drug use among youth |
| Accidents |
• Accidents and injuries • Road traffic accidents • Helmet use • Landmine injuries • Disability |
| Water, sanitation and hygiene (WASH) |
• Household waste management and disposal • Toilets and latrines • Safe water • Mercury levels in water • School health and hygiene • Handwashing |
| Food safety/security and nutrition |
• Nutrition and lifestyle • Under five nutrition • Nutrition in pregnancy • Nutrition for the elderly • Relationship between nutrition and oral hygiene • Level of food safety knowledge among school children • Vitamin A and deworming • Under five obesity • Health impact of fertilisers • Food security • Food safety • Awareness of health food |
| Environmental and human-made disasters |
• Negative consequences of deforestation on health • Replanting to prevent deforestation • Plants that can endanger the environment • Factory industries • Mining industries (deforestation, toxins in water, ecological impact) • Dam • Civil war and political conflict • Impact of agricultural practices on health • Rabies prevention, reduce number of stray dogs • Occupational health |
| Health service provision |
• Access to healthcare in Eastern Burma • Access to primary healthcare services • General health screening • Private pharmacies in the community • Drug control (pharmaceuticals) • Community health workers training • Trained traditional birth attendants • Health worker training at all levels • Health system logistics and infrastructure • Community involvement in health sector • Transportation |
| Health education |
• Health education on communicable diseases • Health education on non-communicable diseases • Nutrition education • Awareness around alcohol and drug use • Awareness of tuberculosis and malaria |
| Economic situation |
• Household income • Occupation |
| Education |
• Future concern among students in migrant learning centre • Educational opportunities for disabled children/youth • School-aged children without access to school |
| Social exclusion |
• Child abuse • Abandoned child • Social exclusion |
| Migration |
• Population mobilising • Migration • Myanmar migrants within Thailand |
| Others |
• Political ideology • Cultural beliefs |
After the first two rounds of NGT in small groups (secret ballot 1 and 2), 15 priorities were retained for consideration by the larger group (Table 6). Following extensive debate, participants elected to separate malnutrition into two populations (vulnerable and under-five) and to separate water issues into water, sanitation and hygiene (traditional WASH) and water quality, by which they meant water contamination through mining, etc. These 15 priorities were then ranked individually (secret ballot 3) by all 60 participants, a second discussion was had, and a final secret ballot (secret ballot 4) ranking was performed. The final priority list can be found in order in Table 6 and includes topics related to maternal and child health; mental health, alcohol and drug use; food security, water and sanitation; and NCDs, among others.
Table 6.
Final research priorities identified, in order of ranking
| 1. Water quality and contamination (e.g. mining, etc.) | |
| 2. Mental health | |
| 3. Illegal drug use | |
| 4. Under-five malnutrition | |
| 5. Pharmaceuticals | |
| 6. Antenatal care | |
| 7. Food security | |
| 8. Non-communicable diseases/hypertension | |
| 9. Immunisations | |
| 10. WASH | |
| 11. Health education | |
| 12. Family planning | |
| 13. Alcohol consumption | |
| 14. Safe delivery | |
| 15. Malnutrition among vulnerable populations |
Results of the research competition
The proposed research competition was not successful as envisioned in that no proposals were submitted despite outreach on the part of BMA and offers of support in proposal development.
Discussion
Priority-setting process
Despite the lack of research expertise and experience of some participants, together, participants had a wealth of knowledge and expertise concerning the health issues and priorities in their communities. This echoes back to the importance of participatory research, as this depth and breadth of local knowledge is virtually impossible to obtain without community engagement and involvement. Table 5 shows how broadly participants defined health, and how they perceived the challenges facing their communities to overlap between communicable, non-communicable and environmentally triggered conditions, some of which are uniquely related to ongoing conflict and militarisation [19].
The NGT process generated a large number of topics illustrating a variety of research and clinical areas of focus, which could be explored in more depth when developing research questions. Participants were able to discuss amongst themselves how to organise priorities for research in their communities, and all were clear on the importance of community input and oversight when identifying research projects and priorities.
Throughout the discussions, both during the NGT process and on day 2 of the workshop, when groups were brainstorming research questions, three items came up repeatedly for discussion, namely illegal drug use, NCDs and mental health.
Myanmar is one of the main producers of opium and methamphetamines in the world [31], and there was broad agreement among participants about the scourge this creates in small ethnic communities with high prevalence of drug use and addiction. Referring to their criteria for prioritisation from day 1 (Table 4), participants felt that while illegal drug use was retained as one of the top research priorities, in practice they would be unable to research or intervene on illicit drug use given security risks in a context where the market is dominated by potentially dangerous armed groups.
NCDs were another priority topic. It is unlikely that EHOs have the infrastructure or capacity, at this time, to screen for NCDs, and so the prioritisation of NCDs appears from participant discussion to come from increasing manifestations of end-stage disease such as cerebrovascular events, renal failure and complications of diabetes leading to various levels of disability. Information on prevalence of NCDs in Myanmar is limited [32, 33], and this is a relatively uncontroversial topic that could be an interesting, important and emerging area for research leading to implications for programme development, funding and clinical care.
Finally, mental health was discussed repeatedly. Men’s mental health was identified as a priority, as was the relationship between mental health, alcohol and other substance use. Mental health consequences of recurrent displacement, conflict and human rights abuses, but also more chronic consequences of poverty and marginalisation are all topics that warrant further investigation in this context.
Interestingly, throughout the process of four rounds of NGT, all formal health systems priorities were dropped from the final list. It is unclear why this happened, except that perhaps participants found specific health issues more compelling and failed to see in this context the system challenges that may underlie them. Importantly, EHOs have collected health systems data (predominantly unpublished clinic-level data such as availability of pharmaceuticals, number of staff, vaccination procedures, etc.) and further support in the analysis of this data may help participants to see the relationship between system-level challenges and ongoing health concerns. Health systems priorities would also likely re-emerge as individual research questions related to priority topics were developed.
Research competition
Despite having funding and mentorship available, no participants took up the offer of submitting a research proposal, regardless of encouragement and outreach from organisers.
A paper by McGregor et al. [24], reviewing priority-setting initiatives in LMICs, found that 78% of initiatives provided no evidence of implementation or follow-up strategies. We explicitly did not wish to become part of this statistic, hence the plan for project support, as well as plans for a second forum to be held a year later. Nevertheless, this effort was not successful. This challenge may result from the potentially intimidating nature of the research process, which we were trying to mitigate through the offer of intensive mentorship. This offer of mentorship itself, particularly that offered by Western academics, may have been intimidating, and we sought to minimise this by ensuring that BMA was the main point of contact. This failure may also result in part from participant selection as discussed in limitations section below. As discussed above, despite active engagement during the forum, many participants would not normally have research as part of their job description. Hence, upon returning to their organisations, they might have had neither the time nor organisational support to engage in research activities. While some decision-makers and heads of organisations were present, most participants were mid-level and/or programme-level staff, and it might be necessary to have a greater presence of senior leadership in order for implementation to be successful. Presence of senior leadership might ensure that they were engaged in the process of identifying research as an organisational priority, which would be essential if they are then to act as support both in terms of encouragement but also in terms of prioritising ongoing research within their organisation from a job description and time perspective.
Limitations
NGT is a recognised process for priority-setting in health research and was effectively used to actively engage all participants in this setting. Nevertheless, both the NGT process and the subsequent research competition were limited to some extent by two important factors. The first of these was the lack of population-specific data mentioned above. While participants would be familiar with the reports cited in this paper, as many of them were involved in data collection, the findings of these reports were not formally reviewed as a part of the process. Incorporating more time into the forum to review these documents could have resulted in more robust recommendations. In addition, given the paucity of data available on certain areas of health of the ethnic populations of Eastern Myanmar, the process might have benefitted from additional data sources such as project reports and community needs assessments, providing participants with a richer data set from which to consider their priorities. Local organisers felt that national data does not represent their specific communities, hence this was not considered to be a relevant source of information although might have provided a point for discussion.
The second limitation was that the participants were divided between a few who had significant research experience, several who had some, and many who had very little, often administrators or healthcare providers by training. Ensuring the participation of a variety of stakeholders representing research, policy-makers and healthcare providers with input and knowledge about local populations is best practice [6] when considering population health and health research needs, recognising that necessarily not all these stakeholders will have an equal understanding of the research process. In practice, however, participants struggled to distinguish between programming and clinical priorities, on the one hand, and research priorities on the other (with research priorities being areas in which more research is needed to better understand the problem or its solutions, whereas in the case of health priorities, there may be significant knowledge available even if the problem remains unresolved). Better preparation of participants prior to the meeting as well as more thorough review of available literature might have helped with this differentiation and might also have encouraged participants to consider developing their own research proposals.
Conclusion and next steps
The CHNRI expert group identified 20 universal challenges in setting priorities, including ensuring that the process can be repeated and validated, and that it is iterative with a feedback loop [34]. We believe that this forum was a first step, and that more work is needed to ensure that there is stability among research priorities. Despite the lack of follow-up in terms of research projects, the reasons for which could be investigated further, participant EHOs are currently in the process of implementing a large household survey looking at health of their population. Likewise, this process has resulted in the development of international relationships that have led to research capacity development and specific projects outside of the context of this forum. Finally, there remain plans to hold a second research workshop in a different format, and the availability of recently collected data from the household survey will create an opportunity to review the priorities set at the first forum. Specific plans have been made for workshops with partner organisations once the data is available, and we believe that the availability of concrete data will facilitate development of research questions where a more open-ended approach failed. We believe that this process demonstrated the very active engagement of local partners in setting their own research agenda and hope that this can lay the groundwork for international partners and funders to be more intentionally collaborative with local partners – in fact to be led by them – in their research processes even prior to the development of their research questions.
Acknowledgements
The authors would like to acknowledge all the participants at the forum whose active engagement and participation in the process rendered this workshop possible.
Authors’ contributions
EP was responsible for the bulk of drafting, editing and submitting the manuscript. RW and CD contributed to editing and content. SNH contributed to editing and verifying accuracy of the information concerning the ethnic health organisations and current context in Eastern Myanmar. NPPM participated in the design and running of the project. All authors had the opportunity to approve the final manuscript.
Funding
Funding for this project was received by Community Partners International and the Centre for Studies in Primary Care at Queen’s University.
Availability of data and materials
All data generated or analysed during this study are included in this published article or are available upon request from the authors.
Ethics approval and consent to participate
Ethics approval was obtained retroactively from Queen’s University Health Sciences and Affiliated Teaching Hospitals Research Ethic Board (HSREB) on June 6th 2018. The Community Ethics Advisory Board (CAEB) in Mae Sot, Thailand, was also involved in the development and implementation of this project.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Eva Purkey, Email: eva.purkey@dfm.queensu.ca.
Saw Nay Htoo, Email: meepot@yahoo.com.
Rachel Whelan, Email: rachel@cpintl.org.
Naw Pue Pue Mhote, Email: teetarsway@gmail.com.
Colleen M. Davison, Email: colleen.davison@queensu.ca
References
- 1.Viergever RF. The mismatch between the health research and development (R&D) that is needed and the R&D that is undertaken: an overview of the problem, the causes, and solutions. Glob Health Action. 2013;6(1):22450. [DOI] [PMC free article] [PubMed]
- 2.Vidyasagar D. Global notes: the 10/90 gap disparities in global health research. J Perinatol. 2006;26(1):55–56. doi: 10.1038/sj.jp.7211402. [DOI] [PubMed] [Google Scholar]
- 3.Sridhar Devi. Who Sets the Global Health Research Agenda? The Challenge of Multi-Bi Financing. PLoS Medicine. 2012;9(9):e1001312. doi: 10.1371/journal.pmed.1001312. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Mendis S, Yach D, Bengoa R, Narvaez D, Zhang X. Research gap in cardiovascular disease in developing countries. Lancet. 2003;361(9376):2246–2247. doi: 10.1016/S0140-6736(03)13753-1. [DOI] [PubMed] [Google Scholar]
- 5.Bryant JH, Harrison PF. Institute of Medicine (US) Board on International Health. Global Health in Transition: A Synthesis: Perspectives from International Organizations. Washington, DC: National Academies Press; 1996. Health Research: Essential Link to Equity in Development. Available from: https://www.ncbi.nlm.nih.gov/books/NBK209096/. [PubMed]
- 6.Nuyens Y. Setting priorities for health research: lessons from low- and middle-income countries. Bull World Health Organ. 2007;85(4):319–321. doi: 10.2471/BLT.06.032375. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Woodward A, Sondorp E, Witter S, Martineau T. Health systems research in fragile and conflict-affected states: a research agenda-setting exercise. Health Res Policy Syst. 2016;14:51. doi: 10.1186/s12961-016-0124-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Tang K, Zhao Y. Health as a bridge to peace and trust in Myanmar: The 21(st) Century Panglong Conference. Glob Health. 2017;13(1):40. doi: 10.1186/s12992-017-0271-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Cargo M, Mercer SL. The value and challenges of participatory research: strengthening its practice. Annu Rev Public Health. 2008;29:325–350. doi: 10.1146/annurev.publhealth.29.091307.083824. [DOI] [PubMed] [Google Scholar]
- 10.Jagosh J, Macaulay AC, Pluye P, Salsberg J, Bush PL, Henderson J, et al. Uncovering the benefits of participatory research: implications of a realist review for health research and practice. Milbank Q. 2012;90(2):311–346. doi: 10.1111/j.1468-0009.2012.00665.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Latt NN, Myat Cho S, Htun NM, Yu Mon S, Myint MN, Aoki F, et al. Healthcare in Myanmar. Nagoya J Med Sci. 2016;78(2):123–134. [PMC free article] [PubMed] [Google Scholar]
- 12.Tangcharoensathien V PW, et al,. The Republic of the Union of Myanmar Health Systems Review. 2014. Contract No.: 3. Manila: WHO Regional Office for the Western Pacific. Available at: https://iris.wpro.who.int/bitstream/handle/10665.1/11354/9789290616665_eng.pdf. Accessed 18 June 2019
- 13.Wangmo SP, Nwe W, Lay M, Tangcharoensathien V. Hard-to-Reach Villages in Myanmar: Challenges in Access to Health Services and Interim Solutions. Qual Prim Care. 2017;25(4):187–92.
- 14.World Health Organization Myanmar. Non Communicable Diseases Country Profiles 2014. 2014. http://www.who.int/nmh/countries/mmr_en.pdf. Accessed 18 June 2019.
- 15.Ministry of Health and Sports The Republic of the Union of Myanmar. MYANMAR NATIONAL HEALTH PLAN 2017 - 2021. Ministry of Health and Sport; December 2016. Available at: http://www.nationalplanningcycles.org/sites/default/files/planning_cycle_repository/myanmar/myanmar_national_health_plan_2017-2021_eng_.pdf. Accessed 18 June 2019
- 16.Tang K, Zhao Y, Li B, Zhang S, Lee SH. Health inequity on access to services in the ethnic minority regions of Northeastern Myanmar: a cross-sectional study. BMJ Open. 2017;7(12):e017770. doi: 10.1136/bmjopen-2017-017770. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Mahn M., Maung C., Shwe Oo E.K., Smith L., Lee C.I., Whichard E., Neumann C., Richards A.K., Mullany L.C., Kuiper H., Lee T.J. Multi-level partnerships to promote health services among internally displaced in eastern Burma. Global Public Health. 2008;3(2):165–186. doi: 10.1080/17441690801942821. [DOI] [PubMed] [Google Scholar]
- 18.Saito M, Keereevijit A, San TD, Thein YY, Gilder ME, McGready R. Challenges to primary healthcare services in the management of non-communicable diseases in marginalised populations on the Thailand-Myanmar border: a pilot survey. Trop Dr. 2018;48(4):273–277. doi: 10.1177/0049475518786853. [DOI] [PubMed] [Google Scholar]
- 19.Backpack Health Worker Team. Chronic Emergency: Health and Human Rights in Eastern Burma; 2015. https://burmacampaign.org.uk/media/ChronicEmergency.pdf. Accessed 18 June 2019.
- 20.Health Information Systems Working Group. The Long Road to Recovery: Ethnic and Community-Based Health Organizations Leading the Way to Better Health in Eastern Burma. 2015.https://reliefweb.int/sites/reliefweb.int/files/resources/The%20Long%20Road%20to%20Recovery%202015_Eng.pdf. Accessed 18 June 2019.
- 21.HISWG Health Information Systems Working Group. About Us. [Available from: http://hiswg.org/. Accessed 18 June 2019.
- 22.Davis William W., Mullany Luke C., Shwe Oo Eh Kalu, Richards Adam K., Iacopino Vincent, Beyrer Chris. Health and Human Rights in Karen State, Eastern Myanmar. PLOS ONE. 2015;10(8):e0133822. doi: 10.1371/journal.pone.0133822. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Parmar PK, Barina CC, Low S, Tun KT, Otterness C, Mhote PP, et al. Health and human rights in eastern Myanmar after the political transition: a population-based assessment using multistaged household cluster sampling. PLoS ONE. 2015;10(5):e0121212. doi: 10.1371/journal.pone.0121212. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.McGregor S, Henderson KJ, Kaldor JM. How are health research priorities set in low and middle income countries? A systematic review of published reports. PLoS ONE. 2014;9(9):e108787. doi: 10.1371/journal.pone.0108787. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Jones J., Hunter D. Qualitative Research: Consensus methods for medical and health services research. BMJ. 1995;311(7001):376–380. doi: 10.1136/bmj.311.7001.376. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Potter MG, Hamer S, PW The Nominal Group Technique: A useful concensus methodology in physiotherapy research. N Z J Physiother. 2004;32(3):126–130. [Google Scholar]
- 27.Rankin NM, McGregor D, Butow PN, White K, Phillips JL, Young JM, et al. Adapting the nominal group technique for priority setting of evidence-practice gaps in implementation science. BMC Med Res Methodol. 2016;16:110. doi: 10.1186/s12874-016-0210-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Søndergaard EE, RK, Reventlow S, Lykke K. Using a modified nominal group technique to develop general practice. BMC Fam Pract. 2018;19:117. [DOI] [PMC free article] [PubMed]
- 29.Rice Danielle B, Cañedo-Ayala Mara, Turner Kimberly A, Gumuchian Stephanie T, Malcarne Vanessa L, Hagedoorn Mariët, Thombs Brett D. Use of the nominal group technique to identify stakeholder priorities and inform survey development: an example with informal caregivers of people with scleroderma. BMJ Open. 2018;8(3):e019726. doi: 10.1136/bmjopen-2017-019726. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.CDC Department of Health and Human Services. Evaluation Briefs: Gaining Consensus Among Stakeholders through the Nominal Group Technique. 2006. https://www.cdc.gov/healthyyouth/evaluation/pdf/brief7.pdf. Accessed 18 June 2019.
- 31.Central Committee for Drug Abuse Control. The Republic of the Union of Myanmar National Drug Control Policy. The Republic of the Union of Myanmar. 2018. https://www.unodc.org/documents/southeastasiaandpacific/2018/02/Myanmar_Drug_Control_Policy.pdf. Accessed 18 June 2019.
- 32.World Health Organization Regional Office for South-East Asia. Noncommunicable Disease Risk Factor Survey Myanmar 2009. Geneva: World Health Oraganization; 2011. https://www.who.int/ncds/surveillance/steps/2009_STEPS_Survey_Myanmar.pdf. Accessed 18 June 2019.
- 33.HelpAge International Myanmar University of Public Health and University of Medicine-2. An Assessment of Available Evidence on NCDs and their Risk Factors in Myanmar Report on Main Findings. 2016. https://www.refworld.org/pdfid/5a8a89d14.pdf. Accessed 18 June 2019.
- 34.Rudan I. Setting health research priorities using the CHNRI method: IV. Key conceptual advances. J Glob Health. 2016;6(1):010501. doi: 10.7189/jogh.06.010501. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All data generated or analysed during this study are included in this published article or are available upon request from the authors.
