Abstract
Background
Qualitative synthesis approaches are increasingly used in healthcare research. One of the most commonly utilised approaches is meta-ethnography. This is a systematic approach which synthesises data from multiple studies to enable new insights into patients’ and healthcare professionals’ experiences and perspectives. Meta-ethnographies can provide important theoretical and conceptual contributions and generate evidence for healthcare practice and policy. However, there is currently a lack of clarity and guidance surrounding the data synthesis stages and process.
Method
This paper aimed to outline a step-by-step method for conducting a meta-ethnography with illustrative examples.
Results
A practical step-by-step guide for conducting meta-ethnography based on the original seven steps as developed by Noblit & Hare (Meta-ethnography: Synthesizing qualitative studies.,1998) is presented. The stages include getting started, deciding what is relevant to the initial interest, reading the studies, determining how the studies are related, translating the studies into one another, synthesising the translations and expressing the synthesis.
We have incorporated adaptations and developments from recent publications. Annotations based on a previous meta-ethnography are provided. These are particularly detailed for stages 4–6, as these are often described as being the most challenging to conduct, but with the most limited amount of guidance available.
Conclusion
Meta-ethnographic synthesis is an important and increasingly used tool in healthcare research, which can be used to inform policy and practice. The guide presented clarifies how the stages and processes involved in conducting a meta-synthesis can be operationalised.
Keywords: Meta-ethnography, Research methods, Qualitative synthesis, Qualitative health research
Background
The range of different methods for synthesising qualitative research has grown in recent years [1]. There are now a number of different qualitative synthesis methods including qualitative meta-synthesis, narrative synthesis, thematic synthesis, interpretative synthesis, grounded theory and meta-ethnography. A qualitative synthesis is defined as ‘any methodology whereby study findings are systematically interpreted through a series of expert judgements to represent the meaning of the collected work’ [2].. In a qualitative synthesis the findings of qualitative studies are pooled [2]. The use of some types of qualitative syntheses allow for the inclusion of mixed-methods and quantitative research studies alongside qualitative studies. A qualitative synthesis approach can be used to examine the available literature, and review and integrate the primary research studies related to a specific question or phenomenon, to reveal deeper insights or explanations that would not be possible from a single study [3]. The various qualitative synthesis approaches mentioned above differ in their purposes, philosophical traditions and whether they primarily aggregate or re-interpret the study findings [4, 5]. Meta-ethnography is an inductive, interpretative approach upon which most interpretative qualitative synthesis methods are based [6] and is the most commonly utilised qualitative synthesis approach in healthcare research [7].
Meta-ethnography is particularly suited to developing conceptual models and theories [8]. This method of qualitative synthesis is often chosen over alternative approaches as it is more suitable for the development of analytical rather than descriptive findings [9]. A meta-ethnography differs from other qualitative synthesis approaches as the reviewer re-interprets the conceptual data (themes, concepts or metaphors) created by the authors of the primary study whilst taking into account the primary data (participant quotes) using a unique translation synthesis method in order to transcend the findings of individual study accounts and create higher order themes [10, 11]. Meta-ethnographic reviews offer greater description of methods and higher order interpretation compared to conventional narrative literature reviews [12]. In health sciences, meta-ethnographies can be used to generate evidence for healthcare and policy [13]. A meta-ethnographic synthesis approach is suitable when researchers are interested in conceptual or theoretical understandings of a particular phenomenon. Unlike some qualitative synthesis approaches which allow the inclusion of mixed-methods design studies (such as thematic synthesis and interpretative synthesis), a meta-ethnographic approach enables only the inclusion of qualitative studies. A meta-ethnography can include multiple study designs, whereas other approaches such as grounded theory require only the inclusion of similar study approaches [14].
Although meta-ethnography is a widely used qualitative literature synthesis method within healthcare research, it is poorly demarcated and there is a lack of clarity surrounding the description of the data analysis process. A number of reviews have used this approach [15–20] but do not provide a fully rigorous description of the stages involved in the analysis process. Given the value of qualitative meta-synthesis in integrating the findings from multiple studies into a higher conceptual level, it is important to provide detailed guidance on each of the steps involved in conducting a meta-ethnography. This paper aims to fill this gap by outlining a step-by-step method for conducting meta-ethnography. We describe our interpretation of each of the seven steps outlined by Noblit & Hare [10] who first proposed this approach. We also incorporate adaptations and developments by recent researchers [21] and provide annotations where applicable to assist in describing the stages involved.
The worked example we are using is a published meta-ethnography (reference and author names omitted for author anonymity during peer review). Where applicable, illustrative examples from this review are provided alongside the each phase to demonstrate the process.
Within a meta-ethnographic synthesis, the process of translation is key and unique. It is defined as ‘comparing the metaphors and concepts in one account with the metaphors and concepts in others’ [10]. A meta-ethnography should involve a reciprocal and refutational translation, where possible combined with a line of argument synthesis [22, 23]. Reciprocal translation occurs when concepts in one study can incorporate those of another [22], whereas a refutational translation explains and explores differences, exceptions, incongruities and inconsistencies [1, 22, 24]. Reviewers often overlook refutational translation [24, 25]; however studies may refute each other [26, 27] or concepts within studies may refute one another [27, 28]. Therefore it may be possible to conduct both a reciprocal and refutational translation [22]. A line of argument synthesis is not an alternative to conducting a translation but is viewed as the next stage of analysis [23]. A line of argument synthesis is the translation of accounts that interpret different aspects of the same phenomenon under study, which results in producing a whole that is greater than the sum of its individual parts [10, 15]. Although Noblit & Hare [10] describe meta-ethnography as a seven step process, it is important to acknowledge that this process is iterative and the phases are not discrete but may overlap and run in parallel [10]. A meta-ethnography reporting tool, eMERGE has very recently been developed, and provides a framework for reviewers to follow when reporting the important aspects of a meta-ethnography [22].
Methods
In order to identify relevant literature to inform the present guide, we searched for articles which described an evaluation or discussed methodological issues in conducting a meta-ethnography or provided guidance for reporting a meta-ethnography. We then scanned the reference lists of relevant articles to identify further relevant literature. We also drew on the results from two recent systematic reviews [23, 29]. As such, while the searches conducted for the present article were not systematic, the guide reflects recent methodological recommendations in the wider methodological literature. All relevant articles were read and recommendations were noted; where any disagreement between authors of papers was apparent, guidance which was based on systematic reviews of the evidence rather than individual reflections was prioritised.
Results
Doing a meta-ethnographic synthesis: a step-by-step guide with illustrated examples
Phase 1: getting started
The initial stage requires the authors to identify an area of interest [10]. The reviewers need to consider if a synthesis of the topic is required and whether a qualitative synthesis and the meta-ethnographic approach fits with the research question [30]. E.g. A meta-ethnographic synthesis approach is suitable when researchers are interested in conceptual or theoretical understandings of a particular phenomenon. It is also important to determine whether there is a large and growing body of qualitative research in this area, and whether synthesizing qualitative findings can contribute valuable knowledge to the existing literature [31]. As proposed by Campbell and colleagues [32], we emphasize, that at this stage, it is important to establish a team of researchers who have different approaches, opinions and the key skills to conduct the meta-ethnography, as this will add rigour to the meta-ethnographic review.
Example
We were interested in the disclosure of adverse events within healthcare; specifically in the perceptions and experiences of patients and healthcare professionals relating to these events. We were aware of the large and growing body of qualitative research in this area. Our searches revealed that there was no qualitative synthesis specific to the experiences of adverse event disclosure. We believed that synthesizing the views, attitudes and experiences of both groups (patients and healthcare professionals) would enable us to understand what patients require from the disclosure conversation and what healthcare professionals currently offer. Our motivation for synthesizing the body of qualitative evidence was to inform future disclosure interventions which were acceptable to patients and practical for healthcare professionals to deliver. Synthesizing qualitative findings can make valuable knowledge accessible to healthcare professionals and policy makers [31].
Phase 2: deciding what is relevant to the initial interest
Once you have chosen your topic of interest, phase 2 involves the following steps: a) defining the focus of the synthesis, b) selecting studies for inclusion in the synthesis and locating relevant studies, c) developing inclusion and exclusion criteria and d) quality assessment of the included studies [12].
2a. Defining the focus of the synthesis
An important decision involves deciding whether to include all the studies within your chosen area of interest. It is necessary to find a balance between a review which has a broad scope, and a focus which will yield a manageable number of studies. The scope of a meta-ethnography is more restricted compared to other qualitative narrative reviews. This is due to the avoidance of making gross generalisations across disparate fields [10, 26]. There is currently no agreement to how many studies should be included in the synthesis. Some researchers argue that synthesizing a large number of studies may interfere with the ability to produce a useful interpretative output and could result in an aggregative synthesis [23]. Synthesizing too few studies can result in underdeveloped theories/concepts [24, 28]. A large number of studies have varied from 40 [32] to over 100 [24]. The volume of data, rather than just the number of studies is important and team size and resources will affect the ability to manage this data [22]. It is recognised that focusing on a particular aspect of your chosen topic interest and excluding certain aspects may result in some papers being overlooked. However it is important to make this choice to ensure that you have manageable number of studies [12].
Example
Our systematic review question focused on ‘The views and experiences of patients and healthcare professionals on the disclosure of adverse events’. We focused on studies which examined the views and experiences of patients (and/or family members, members of the general public) and healthcare professionals. We found that qualitative research in the area of adverse event disclosure was limited. As this was an under-researched area, we were able to include all the available qualitative studies in this research area (enabling us to include both patients’ and healthcare professionals’ views on adverse event disclosure).
Phase 2b: locating relevant studies
The second important step involves locating potentially relevant qualitative studies by conducting a systematic search of the literature. In order to conduct a systematic search, a well-constructed and comprehensive search strategy needs to be developed. Qualitative searches can yield a large number of search results, which can be daunting and time consuming to screen. One of the ways to make your search strategy more specific is through the use of qualitative search filters. Empirically tested search filters for qualitative studies have been developed [33–35]. However it is possible that some of the potentially relevant studies may be missed when using such filters. Decisions regarding your search strategy and screening depend on your aims and resources available. We advise the use of a librarian for reaching decisions on the content of searches. Multiple databases are utilised to locate relevant articles and this can be further supplemented by hand searching. This is important as it can locate relevant articles which are not indexed or inaccurately indexed, and minimises the risk of missing relevant studies [24].
Some argue that a more purposive sampling approach may be more appropriate [36, 37], which aims to provide a holistic interpretation of a phenomenon, where the extent of searching is driven by the need to reach theoretical saturation rather than to identify all eligible studies [24, 38]. Detailed information on purposive sampling technique is available [24, 28]. Also, to avoid the potential problem of having too few descriptively or conceptually-rich studies, knowledge-building and theory-generating systematic reviewers can conduct expansive searches of the literature [28]. We do not describe here how to conduct a systematic search of the literature, however there are a number of papers which describe this process [39–41].
Example
We searched five electronic databases, and our search strategy included a combination of the three major concepts (disclosure, safety incident and experience). We also supplemented the database searches by hand searching relevant journals and reference lists. We chose not to apply qualitative filters in order to capture all the possible relevant articles.
Phase 2c: decisions to include studies
A number of factors should be considered when deciding whether to include or exclude studies from the synthesis. An important consideration is the expertise of the review authors and the time available to complete the review [36]. Reviewers should consider the likelihood of excluding valuable insights on the basis of quality, and the contribution of these studies to the development and interpretation of findings. Would excluding such studies affect the coherence of qualitative synthesized findings? [36]. Also, an important consideration is the nature of the primary data which is available to synthesise [23]. Including predominantly thin descriptive data can be problematic as it is difficult to further interpret data which lacks depth [23]. Conceptually rich data which is explanatory, or rich descriptive data which provides sufficient detail to be further developed is suitable for meta-ethnography. Therefore selecting studies based on this suitability is one of the approaches reviewers should consider. Further discussion on decisions to include studies is available [36].
Phase 2d: quality appraisal
There is a lack of agreement surrounding the use of quality appraisal for qualitative studies [30]. Some researchers argue there are difficulties with quality appraisal as some aspects of qualitative research are difficult to appraise and therefore depend on subjective judgement [5]. Although this debate continues, we argue that at least some quality appraisal of studies needs to be considered to give an indication of the credibility of the included studies. Critically appraising the studies and assigning numerical scores to indicate level of quality is also useful as it can be used as a way to order the studies for analysis. Previous published qualitative reviews have either used the highest scoring paper as the ‘index study’ [15] or have arranged all the papers in chronological order by date, and used the most recently published paper as the ‘index study’ [42]. One of the limitations is of assigning numerical scores using CASP and the use the highest scoring as an index study is that it focuses on the methodological rather than conceptual strength. Other reviewers have chosen a ‘conceptually rich’ index account [43, 44] however it is unclear how this ‘conceptually rich’ index account should be selected. The different ways of ordering study accounts has yet to be formally empirically compared and there is no guidance for reviewers [23]. However the order could affect the synthesis output [11, 12, 24, 45]. There are different perspectives to the use of tools in the quality assessment of qualitative research [46]. Some recommend the exclusion of studies based on a low-quality assessment and others refute this view and suggest that such tools may not truly assess the meaningfulness and potential impact of qualitative findings [47]. However, we believe that these checklists can equip novice qualitative researchers with the resources to evaluate qualitative research efficiently.
Two common and widely used quality assessment tools are the Critical Appraisal Skills Programme (CASP) and the Qualitative Assessment and Review Instrument (JBI-QARI). The Critical Appraisal Skills Checklist (CASP) provides detailed instructions and decision rules on how to interpret the criteria [48]. This checklist contains a number of questions which help the reviewer to assess the rigour, credibility and relevance of each study [49–52]. All studies are critically appraised and each study is assigned a numerical score out of ten, where a higher score is correlated to a higher quality [15]. The two studies ranked with the highest scores are used as index studies, and can be used as the first studies from which concepts are translated into other studies and therefore shaping the analysis [12]. Similarly, the Qualitative Assessment and Review Instrument (JBI-QARI) is a 10 item checklist which assesses the methodological quality of a study, and determines the extent to which a study has addressed the possibility of bias in its design, conduct and analysis [53]. Some researchers provide guidelines for determining and excluding studies which have major methodological flaws [54]. However, it can be argued that excluding studies based on quality criteria may result in the exclusion of insightful studies. GRADE-CERQual is a recently developed approach which provides guidance for assessing how much confidence to place in findings from systematic reviews of qualitative research [55]. The application of GRADE-CERQual can be helpful for appraising the overall quality of the qualitative synthesis [55] but a quality appraisal of primary studies is required before applying the CERQual tool.
Example
We used the CASP checklist to assess the quality of included studies. We chose to use the CASP as it propagates a systematic process through which the strengths and weaknesses of a research study can be identified [56]. The CASP guidelines are easy to follow, especially for novice researchers [56]. We made a decision in advance not to exclude studies with low quality scores. We believed that although some authors may have failed to describe the methods in sufficient detail for us to determine that quality criteria had been met, lack of reporting did not necessarily mean it was poorly conducted research [12]. We did however use the quality rating of the studies in our synthesis approach. The study ranked with the highest score was used as the ‘index study’ and was the first study from which concepts were translated into other studies and therefore shaping the analysis [12].
Phase 3: Reading the studies
It is during this phase where the synthesis process begins. First, this involves repeatedly reading the included studies and familiarising yourself with the key concepts and metaphors. It is important at this stage to become as familiar as possible with the content and detail of the included studies. A concept is defined as ‘having some analytical or conceptual power, unlike more descriptive themes [26]. It is important to acknowledge that reading the studies is not a discrete phase; reading occurs throughout the synthesis process. The notion of first, second order and third order constructs [26] are useful in distinguishing the ‘data’ of the meta-ethnography which are defined in Table 1 below.
Table 1.
Primary authors | Refers to the authors of the original primary qualitative studies |
---|---|
Reviewers/team members | Refers to the individuals conducting the meta-ethnography |
First order constructs | Represent the primary data reported in each paper (participant quotations). |
Second order constructs | The primary authors’ interpretations of the primary data (metaphorical themes or concepts). |
Third order constructs | The reviewers higher order interpretations developed from a tertiary analysis of the first and second order constructs. |
Once you have read through the chosen studies, the next step involves extracting the ‘raw data’ from the studies for the synthesis. The raw data for a meta-ethnographic synthesis are the first and second order constructs [29, 31]. The data needs to be extracted from each of the studies, which can be done by using a standardised data extraction form [11]. Alternative ways to extract data include creating a list of metaphors and themes [32] or coding concepts in Nvivo; a software programme for the analysis of qualitative data [31]. The data should be extracted verbatim, so there is no risk of losing important data [12] and to preserve the original terminology used by the primary authors. However, some authors of a previous meta-ethnography chose to record summaries of primary author interpretations due to the large number of studies included in their synthesis [12]. However, one of the drawbacks of recording such summaries is that there is the risk of potentially losing important detail.
It is essential at this stage to extract information on study characteristics for each study, using a separate data extraction form as it provides context for interpretations and explanation of each study [57]. This includes information on study sample, data collection methods, data analysis methods, study outcomes and study conclusions.
Example
We have provided an example of a data extraction table we used to extract the raw data (Fig. 1).
Phase 4: determining how the studies are related
During this stage, the relationships between the key concepts from the different papers need to be considered. A concept is described as a ‘meaningful idea that develops by comparing particular instances’ [29, 45]. It is also important that concepts explain and do not only describe the data [29, 45] as one of the aims of qualitative analysis is to develop concepts which help to understand an experience and not just describe it [58]. In order to consider the relationship between concepts from the different studies, you are required to look across the studies for common and recurring concepts. This can be done by creating a list of the themes [10]. These are then juxtaposed against each other to examine the relationships between the key concepts and metaphors these themes reflect and to identify common and recurring concepts. From this list, the themes from the different studies are then clustered into relevant categories, where we grouped common concepts from studies according to the common underlying metaphors, an approach which has previously been used [12, 31, 59]. During this phase it is essential to examine the contextual data about each study. This includes settings, aims and focuses. These newly formed categories are labelled using terminology which encompasses all the relevant concepts they contain. This phase is likely to be iterative, and clusters may be revised through discussions within the review team of how they are related and by making reference to the original text.
Other authors have used diagrams [11, 32] or coding using qualitative analysis software [31]. The use of lists or tables in phase 4 is useful when synthesising a small number of studies, however such an approach would be unwieldy when there are hundreds of concepts, whereas coding in NVivo is efficient [23]. However, the recording of links between concepts within primary studies may be difficult when using NVivo [23].
Example
During this phase, for our review we created a list of the themes from each paper (Fig. 2) listed under each study name. As we had included both healthcare professional and patient studies, we also labelled whether the study had included patients, healthcare professionals or both groups.
The next step involved reducing the themes from the different studies into relevant categories (Fig. 3).
It is important to note that the category labels you create during this phase are not the higher third order constructs, but are descriptive labels. The third order constructs are developed within the next two phases. However, the data within each category forms the basis of reciprocal translation or refutational synthesis in the next stages. This approach can work well when you have a manageable number of studies, however this can prove to be challenging when you have a larger number of studies. In previous meta-ethnographies where a large number of studies have been included, a thematic analysis of themes was carried out instead [12].
Phase 5: translating the studies into one another
The original method of meta-ethnography suggests that this phase involves ‘comparing the metaphors and concepts in one account with the metaphors and concepts in others’ [10]. However, despite a number of meta-ethnographies being conducted, it is unclear how this should be done and how this phase of the analysis should be recorded. To address this lack of clarity, we will now outline below one way in which this can be done. During this phase, each concept from each paper is compared with all the other papers to check for the presence or absence of commonality. Doing this highlights the similarities and differences between the concepts and metaphors and allows the researcher to organise them into further conceptual categories, which results in the development of the higher third order constructs.
This phase is approached by arranging the studies either chronologically [32] from the highest scoring paper to the lowest scoring paper (where the scores are generated during the quality appraisal process [15]. Arranging the studies chronologically is advised when you are including a large number of papers over a large time span [12, 29]. The order in which studies are compared may influence the synthesis, as earlier papers will have a strong influence on the subsequent development of ideas [60]. The reviewer first starts by summarising the themes and concepts from paper 1. Summarising involves comparing and contrasting the concepts taking into account study contexts. They then summarise the themes and concepts from paper 2, commenting first on what is similar with paper 1 and then what paper 2 may add to paper 1 or where its findings diverge from paper 1 [12, 29]. Next, paper 3 is summarised, considering what is similar to papers 1 and 2, and then noting any areas of divergence and anything that paper 3 adds to the knowledge offered in papers 1 and 2. This process continues until you have synthesised all the papers and produces a synthesis of the primary author interpretations (see Fig. 4) which are useful in aiding with the development of the third order constructs in the next stage.
Examining the key concepts within and across the studies is similar to the method of constant comparison [29]. During this phase, it is important to refer back to the table of study characteristics you recorded earlier, (country, sample, recruitment method, gender, publication date etc.) to use as a context for the comparisons [15] as well the full papers. This process can also be supported by creating a translations table, as this is a useful way to display this level of synthesis [61] (see Fig. 5 for an example of a translations table). Maintaining a personal journal during this phase of the analysis can help to ensure that the researcher is aware of their position from a theoretical point of view [62]. Discussing the key concepts and their meanings with team members can result in collaborative interpretations.
Example
We conducted two separate syntheses; one for the views of patients and one for healthcare professionals, and conducted a line of argument synthesis of all the included studies, therefore we found it useful to have two separate translation tables; one for each group. Part of the translation table for healthcare professionals is shown in Fig. 5 (see example of table below).
Phase 6: Synthesising the translations
This phase is described by [10] as ‘making the whole into something more than the parts alone imply’. However, similar to Phase 5, there has been no clear guidance on how to carry out this phase. During this phase, the studies are now viewed as a ‘whole’ with the aim of developing a framework [29, 31]. When writing about how the studies are related, reviewers can present this in a narrative and/or diagrammatic form [30]. Phase 6 can be broken down into the following two stages; (a) reciprocal and refutational synthesis and (b) line of argument synthesis.
(A) Reciprocal and refutational synthesis
This stage of the synthesis involves deciding whether the studies are sufficiently similar in their focus to allow for a reciprocal translation synthesis. Alternatively, the studies may refute each other in which case a refutational synthesis is conducted. It is possible to conduct both types of synthesis to discuss similar accounts (reciprocal translation synthesis) and also explore any contradictions between the studies (refutational synthesis) [23]. Generally, reciprocal translation syntheses are conducted more frequently in reviews than refutational syntheses and guidance on how to conduct a refutational synthesis is currently limited [23]. Below we first discuss how to carry out a reciprocal translation and then describe the way a refutational synthesis can be conducted. Referring to the translations table of data developed in the stages above allows reviewers to establish the relationship between the studies and consider how to approach a reciprocal and refutational synthesis.
Reciprocal translation
It is during this phase where the shared themes across the studies are summarised by juxtaposing the first and second order constructs. This leads to the generation of new concepts which provide a fuller account of the given phenomenon and resolve any contradictions [63]. These are known as the original third order constructs developed by the review authors and provide a new understanding of the phenomena [15]. To put briefly, this can be achieved by reading the primary data synthesis (Fig. 4) alongside the translations table (Fig. 5) and drawing out the main points to form the reciprocal translations and therefore developing the third order constructs. It is important to constantly check the summary and third order constructs you are developing against the translations table to ensure it is consistent with the original data.
Refutational synthesis
There are limited published examples of refutational synthesis [25, 45] as reviewers often focus on reciprocal translations [25]. Also reviewers may conduct a refutational synthesis, but not label it as such [23]. There are two published examples of refutational synthesis [43, 64]. This is not surprising given the lack of guidance available on how to conduct a refutational synthesis. The purpose of a refutational synthesis is to explore and explain the differences, exceptions, incongruities and inconsistencies in concepts across the studies [1, 24]. Refutational synthesis focuses on identifying, understanding and reconciling the contradictions, rather than developing concepts around the similarities. Similar to reciprocal translation, reviewers are required to refer back to the primary data synthesis and translations table in order to develop third order constructs. The contradictions between the concepts across the studies may be explained by differences in participants, settings or study design. During this phase, it is helpful to refer back to the study characteristics table as this can help provide context for interpretations and explanations [57]. It has been suggested that a refutational translation can be approached by placing two refutational concepts at either end of a continuum and proceed by analysing the differences between the concepts [22, 28]. In order to express the refutational findings, a narrative can be created so that the findings ‘are placed into context’ [28].
(B) A lines of argument synthesis
A lines of argument synthesis can then be created from the third order constructs, which involves ‘making a whole into something more than the parts alone imply’ (known as higher order interpretations) [10]. A lines of argument synthesis means that there is an ‘interpretation of the relationship between the themes, which further emphasises a key concept that may be hidden within individual studies in order to discover the whole from a set of parts’ [10]. This is classed as a further higher level of interpretative synthesis, and provides scope for developing new insights.
A lines of argument synthesis is achieved by constant comparison of the concepts and developing a ‘grounded theory that puts the similarities and differences between the studies into interpretative order’ [10]. Practically, reviewers can approach this phase by reading through the reciprocal translations and noting down the similarities and differences between each of the third-order constructs. These notes can then be used to construct interpretations of how each third order construct relates to the others in the analysis. These relationships can then be represented using a diagram to aid understanding. Each of the reviewers can carry out this stage independently, and merge their findings as a team to produce the final line of argument synthesis. Diagrams can be used to develop the line of argument synthesis and it is suggested that discussions between team members are vital to this process [29, 30]. A lines of argument synthesis can be a useful way to bring together and explain the perspectives of two or more different groups and interpreting the relationship between the themes. This is particularly relevant for research in healthcare, where often the views of one or more groups are examined on a phenomenon (e.g. patients and healthcare professionals). An example of a line of argument synthesis from the worked example is presented in Fig. 6.
Example
We conducted separate reciprocal translations for the first- and second-order constructs relating to patients and healthcare professionals, resulting in third order constructs which related to solely either patients or professionals. Therefore, the synthesis process for our review consisted of three steps- (1) reciprocal translations of the patient studies to understand patients’ views and experiences of disclosure, (2) reciprocal translations of the healthcare professional studies to explore healthcare professionals views and experiences on disclosure and (3) a line of argument synthesis which contributed to the identification of both the key elements of an ideal disclosure desired by patients and the facilitators for healthcare professionals which can increase the likelihood of this taking place. We initially considered a refutational translation instead of a line-of-argument synthesis, but it was apparent during the synthesis that the concepts from the patient and healthcare professional studies were not contradictory in nature; rather they described alternate perspectives of the same phenomenon. Therefore we believed a line of argument synthesis was the most appropriate for the aim of our synthesis. During this stage of the analysis, we found it helpful to place all the third order constructs in a table to enable visual comparison (see Table 2).
Table 2.
Third order constructs: Patient studies (views on disclosure process) |
Third order constructs: Healthcare professional studies (views on disclosure process) |
Third order constructs: Healthcare professional studies (barriers to disclosure) |
---|---|---|
Need for information | Sometimes economical with the truth | Difficulty of disclosure in a blame culture |
Importance of sincere regret | Owning up without saying ‘I’m sorry’ | Avoidance of litigation |
Promise of improvement |
To tell or to not tell? -When anxiety may cause unnecessary anxiety -Outcome determines disclosure |
Disclosure is a learned skill |
Inconsistent guidance |
The third order constructs should be theoretically rich. In our synthesis, although we found that the data we were dealing with was descriptive, it was rich descriptive data. This therefore provided us with sufficient detail to further interpret this and develop third order constructs [23]. The third order constructs we developed reflected the data we were dealing with, but allowed us to produce higher levels of analysis. Reviewers should take caution when dealing descriptive data. They need determine whether it is ‘thin descriptive data’ which could be problematic to further interpret due to lack of depth, or ‘rich descriptive data’ which can provide sufficient detail to be further interpreted [23].
Phase 7: expressing the synthesis
Reviewers should follow the eMERGE reporting guidance when writing up the synthesis [22] and the PRISMA guidelines may be used alongside this if systematic searches are conducted as many journals may require a PRISMA diagram [65]. In addition to these standard reporting methods as described by the eMERGE guidance [22] the final phase can be broken down into the following three stages; (a) summary of findings, (b) strengths, limitations & reflexivity and (c) recommendations and conclusions (refer to [22] where this phase is described in further detail).
Discussion
Meta-ethnography is an evolving approach to synthesising qualitative research and is being increasingly used in healthcare research [29]. A meta-ethnographic approach offers a greater description of methods and higher-order interpretation (an overarching explanation of a phenomenon that goes beyond what the study parts alone imply), compared to a conventional narrative literature review [12]. The use of this approach can assist in generating evidence for healthcare staff, researchers and policy-makers. Although this approach is being used by numerous reviewers, transparency on how each of the stages should be conducted is still poor and there is a lack of clarity surrounding the exact stages reviewers utilise to reach their final synthesis [23]. The ultimate aim of qualitative research synthesis in healthcare is to contribute towards improvements in patient care and experience, as well as improving the processes for healthcare professionals involved [39]. In order for a meta-ethnography syntheses to be considered to be of high quality and useful, the meta-ethnographic approach needs to be rigorous and consistent. Therefore, a clear understanding of the steps included in a meta-ethnography is vital to produce a synthesis which is rigorous and comprehensive. Poorly reported methods of meta-ethnography can also make it challenging, particularly for early career qualitative researchers to conduct this synthesis. Therefore, we have provided a practical step-by-step guide to assist reviewers with conducting a meta-ethnographic synthesis of qualitative research. High quality qualitative research synthesis should not end with the final write up and further research needs to focus on how the impact of qualitative research can be maximised to improve healthcare.
Like any other method, the meta-ethnographic approach is not without its limitations. Within a meta-ethnography, although reviewers provide a synthesis, this is only one interpretation and as qualitative synthesis is subjective, several alternative interpretations are likely to be possible [66]. The subjective nature of a meta-ethnography may also affect the representativeness of the synthesis findings. To develop this guide, we searched for articles in a number of ways which is described in detail in the methods section. However, as a systematic literature search was not conducted to identify articles for the development of this guide, there is the potential that this may have resulted in the exclusion of some articles. Whilst we have provided guidance on how to conduct a meta-ethnographic synthesis, it is important to note that this is a flexible guide, which researchers can utilise and adapt the stages, according to their own research questions and the phenomenon under study. Some of the steps and challenges described in this guide hold true for systematic reviews in general. However, this guide aimed to offer practical step-by-step guidance on how to conduct meta-ethnography for even those researchers who may not be experienced in conducting systematic reviews as well as being unfamiliar with a meta-ethnographic approach. This guide was developed to assist with conducting a meta-ethnography within healthcare research. Although this guide would be potentially useful beyond healthcare research, there might be additional challenges and considerations in other research fields which may not be fully captured in this guide.
Conclusions
There was previously a lack of step-by-step guide to meta-ethnography conduct. In this paper, we have filled this gap by providing a practical step-by-step guide for conducting meta-ethnography based on the original seven steps as developed by Noblit & Hare [10]. We have incorporated adaptations and developments by recent publications and we provide detailed annotations, particularly for stages 4–6 which are often described as being the most challenging to conduct, yet the least amount of guidance is provided for conducting these stages. We have described each stage in relation to one of the previous meta-ethnographies we have conducted to aid understanding, and allows the reader to follow on from one step to the next easily.
Acknowledgements
This report is independent research funded by the National Institute for Health Research, Yorkshire and Humber Applied Research Collaborations. The views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the National Institute for Health Research or the Department of Health and Social Care.
Authors’ contributions
RS, RL and JJ originated the idea for this guide to conducting a meta-ethnography. RS, RL and JJ conducted the original meta-ethnography from which annotations and examples are based on within this manuscript. All authors contributed to the development of the method, and read and approved the final manuscript. RS drafted the first version of this manuscript. RS, RL, JJ and MP made significant contributions to the ideas developed and presented in this manuscript.
Authors’ information
RS1 is a PhD student (MSc, BSc Honours) based in the School of Psychology at the University of Leeds and Bradford Institute for Health Research. RL2 (PhD, BA) is a Professor in Psychology of healthcare, based at the University of Leeds and Bradford Institute for Health Research. MP3 (PhD, MSc, BSc Honours) is a senior research fellow based at the Centre for Primary Care, Manchester. JJ4 (PhD, BSc Honours) is a clinical psychologist based at the University of Leeds and Bradford Institute for Health Research.
Funding
This research was funded by NIHR CLAHRC Yorkshire and Humber.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Raabia Sattar, Email: ps15rs@leeds.ac.uk.
Rebecca Lawton, Email: r.j.lawton@leeds.ac.uk.
Maria Panagioti, Email: maria.panagioti@manchester.ac.uk.
Judith Johnson, Email: j.johnson@leeds.ac.uk.
References
- 1.Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009;9:59. doi: 10.1186/1471-2288-9-59. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Bearman M, Dawson P. Qualitative synthesis and systematic review in health professions education. Med Educ. 2013;47(3):252–260. doi: 10.1111/medu.12092. [DOI] [PubMed] [Google Scholar]
- 3.Erwin EJ, Brotherson MJ, Summers JA. Understanding qualitative metasynthesis: issues and opportunities in early childhood intervention research. J Early Interv. 2011;33(3):186–200. doi: 10.1177/1053815111425493. [DOI] [Google Scholar]
- 4.Gough D, Thomas J, Oliver S. Clarifying differences between review designs and methods. Syst Rev. 2012;1:28. doi: 10.1186/2046-4053-1-28. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Dixon-Woods M, Booth A, Sutton AJ. Synthesizing qualitative research: a review of published reports. Qual Res. 2007;7:375–422. doi: 10.1177/1468794107078517. [DOI] [Google Scholar]
- 6.Paterson BL. “It looks great but how do I know if it fits?”: an introduction to Meta-synthesis research. Synthesizing Qual Res: Choosing Right Approach. 2011;16:1–20. [Google Scholar]
- 7.Hannes K, Macaitis K. A move to more systematic and transparent approaches in qualitative evidence synthesis: update on a review of published papers. Qual Res. 2012;12:402–442. doi: 10.1177/1468794111432992. [DOI] [Google Scholar]
- 8.France EF, Wells M, Lang H, Williams B. Why, when and how to update a meta-ethnography qualitative synthesis. Syst Rev. 2016;5:44. doi: 10.1186/s13643-016-0218-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Daker-White G, Hays R, McSharry J, Giles S, Cheraghi-Sohi S, Rhodes P, Sanders C. Blame the patient, blame the doctor or blame the system? A meta-synthesis of qualitative studies of patient safety in primary care. PLoS One. 2015;10:128–329. doi: 10.1371/journal.pone.0128329. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Noblit GW, Hare RD. Meta-ethnography: Synthesizing qualitative studies. California: Sage Publications Ltd; 1988. [Google Scholar]
- 11.Malpass A, Shaw A, Sharp D, Walter F, Feder G, Ridd M, Kessler D. “Medication career” or “moral career”? The two sides of managing antidepressants: a meta-ethnography of patients’ experience of antidepressants. Soc Sci Med. 2009;68:154–168. doi: 10.1016/j.socscimed.2008.09.068. [DOI] [PubMed] [Google Scholar]
- 12.Atkins S, Lewin S, Smith H, Engel M, Fretheim A, Volmink J. Conducting a meta-ethnography of qualitative literature: lessons learnt. BMC Med Res Methodol. 2008;8:21. doi: 10.1186/1471-2288-8-21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Classen S, Alvarez L. Evidence-informed reviews- moving occupational therapy practice and science forward. OTJR: Occup, ParticipationHealth. 2015;35:199–203. doi: 10.1177/1539449215607431. [DOI] [PubMed] [Google Scholar]
- 14.Soilemezi D, Linceviciute S. Synthesizing qualitative research: reflections and lessons learnt by two new reviewers. Int J Qual Methods. 2018;17(1):1–14. doi: 10.1177/1609406918768014. [DOI] [Google Scholar]
- 15.Scott DA, Grant SM. A meta-ethnography of the facilitators and barriers to successful implementation of patient complaints processes in healthcare settings. Health Expect. 2018;21:508–517. doi: 10.1111/hex.12645. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Elmir R, Schmied V. A meta-ethnographic synthesis of fathers′ experiences of complicated births that are potentially traumatic. Midwifery. 2016;32:66–74. doi: 10.1016/j.midw.2015.09.008. [DOI] [PubMed] [Google Scholar]
- 17.Cullinan S, O’Mahony D, Fleming A, Byrne S. A meta-synthesis of potentially inappropriate prescribing in older patients. Drugs Aging. 2014;31:631–638. doi: 10.1007/s40266-014-0190-4. [DOI] [PubMed] [Google Scholar]
- 18.Purc-Stephenson RJ, Thrasher C. Nurses’ experiences with telephone triage and advice: a meta-ethnography. J Adv Nurs. 2010;66:482–494. doi: 10.1111/j.1365-2648.2010.05275.x. [DOI] [PubMed] [Google Scholar]
- 19.Toye F, Seers K, Barker KL. Meta-ethnography to understand healthcare professionals’ experience of treating adults with chronic non-malignant pain. BMJ Open. 2017;7:e018411. doi: 10.1136/bmjopen-2017-018411. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Rubio-Valera M, Pons-Vigués M, Martínez-Andrés M, Moreno-Peral P, Berenguera A, Fernández A. Barriers and facilitators for the implementation of primary prevention and health promotion activities in primary care: a synthesis through meta-ethnography. PLoS One. 2014;9:e89554. doi: 10.1371/journal.pone.0089554. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Lee RP, Hart RI, Watson RM, Rapley T. Qualitative synthesis in practice: some pragmatics of meta-ethnography. Qual Res. 2015;15:334–350. doi: 10.1177/1468794114524221. [DOI] [Google Scholar]
- 22.France EF, Cunningham M, Ring N, Uny I, Duncan EA, Jepson RG, Maxwell M, Roberts RJ, Turley RL, Booth A, Britten N. Improving reporting of meta-ethnography: the eMERGe reporting guidance. BMC Med Res Methodol. 2019;19:25. doi: 10.1186/s12874-018-0600-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.France EF, Uny I, Ring N, Turley RL, Maxwell M, Duncan EA, Jepson RG, Roberts RJ, Noyes J. A methodological systematic review of meta-ethnography conduct to articulate the complex analytical phases. BMC Med Res Methodol. 2019;19:35. doi: 10.1186/s12874-019-0670-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Booth A, Carroll C, Ilott I, Low LL, Cooper K. Desperately seeking dissonance: identifying the disconfirming case in qualitative evidence synthesis. Qual Health Res. 2013;23:126–141. doi: 10.1177/1049732312466295. [DOI] [PubMed] [Google Scholar]
- 25.Thorne S, Jensen L, Kearney MH, Noblit G, Sandelowski M. Qualitative metasynthesis: reflections on methodological orientation and ideological agenda. Qual Health Res. 2004;13:1342–65. [DOI] [PubMed]
- 26.Britten N, Campbell R, Pope C, Donovan J, Morgan M, Pill R. Using meta ethnography to synthesise qualitative research: a worked example. J Health Serv Res Policy. 2002;7:209–215. doi: 10.1258/135581902320432732. [DOI] [PubMed] [Google Scholar]
- 27.Bondas T, Hall EO. Challenges in approaching metasynthesis research. Qual Health Res. 2007;17:113–121. doi: 10.1177/1049732306295879. [DOI] [PubMed] [Google Scholar]
- 28.Finfgeld-Connett D. Metasynthesis findings: potential versus reality. Qual Health Res. 2014;24:1581–1591. doi: 10.1177/1049732314548878. [DOI] [PubMed] [Google Scholar]
- 29.Cahill M, Robinson K, Pettigrew J, Galvin R, Stanley M. Qualitative synthesis: a guide to conducting a meta-ethnography. Br J Occup Ther. 2018;81:129–137. doi: 10.1177/0308022617745016. [DOI] [Google Scholar]
- 30.Toye F, Seers K, Allcock N, Briggs M, Carr E, Andrews J, Barker K. ‘Trying to pin down jelly’-exploring intuitive processes in quality assessment for meta-ethnography. BMC Med Res Methodol. 2013;13:46. doi: 10.1186/1471-2288-13-46. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Toye F, Seers K, Allcock N, Briggs M, Carr E, Barker K. Meta-ethnography 25 years on: challenges and insights for synthesising a large number of qualitative studies. BMC Med Res Methodol. 2014;14:80. doi: 10.1186/1471-2288-14-80. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Campbell R, Pound P, Morgan M, Daker-White G, Britten N, Pill R, Yardley L, Pope C, Donovan J. Evaluating meta ethnography: systematic analysis and synthesis of qualitative research. Health Technol Assess. 2011;15:1–164. doi: 10.3310/hta15430. [DOI] [PubMed] [Google Scholar]
- 33.Wong SS, Wilczynski NL, Haynes RB. Developing optimal search strategies for detecting clinically relevant qualitative. Medinfo. 2004;107:311. [PubMed] [Google Scholar]
- 34.Wilczynski NL, Marks S, Haynes RB. Search strategies for identifying qualitative studies in CINAHL. Qual Health Res. 2007;17:705–710. doi: 10.1177/1049732306294515. [DOI] [PubMed] [Google Scholar]
- 35.McKibbon KA, Wilczynski NL, Haynes RB. Developing optimal search strategies for retrieving qualitative studies in PsycINFO. Eval Health Prof. 2006;29:440–454. doi: 10.1177/0163278706293400. [DOI] [PubMed] [Google Scholar]
- 36.Noyes J, Popay J, Pearson A, Hannes K. Cochrane handbook for systematic reviews of interventions. 2008. 20 qualitative research and Cochrane reviews. [Google Scholar]
- 37.Dixon-Woods M, Bonas S, Booth A, Jones DR, Miller T, Sutton AJ, Shaw RL, Smith JA, Young B. How can systematic reviews incorporate qualitative research? A critical perspective. Qual Res. 2006;6:27–44. doi: 10.1177/1468794106058867. [DOI] [Google Scholar]
- 38.Benoot C, Hannes K, Bilsen J. The use of purposeful sampling in a qualitative evidence synthesis: a worked example on sexual adjustment to a cancer trajectory. BMC Med Res Methodol. 2016;16:21. doi: 10.1186/s12874-016-0114-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Atkinson LZ, Cipriani A. How to carry out a literature search for a systematic review: a practical guide. BJPsych Adv. 2018;24:74–82. doi: 10.1192/bja.2017.3. [DOI] [Google Scholar]
- 40.Dissemination CR. CRD’s guidance for undertaking reviews in health care. Layerthorpe: University of York, Centre for Reviews and Dissemination; 2009. [Google Scholar]
- 41.Hausner E, Waffenschmidt S, Kaiser T, Simon M. Routine development of objectively derived search strategies. Syst Rev. 2012;1:19. doi: 10.1186/2046-4053-1-19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Flemming K, Graham H, Heirs M, Fox D, Sowden A. Smoking in pregnancy: a systematic review of qualitative research of women who commence pregnancy as smokers. J Adv Nurs. 2013;69:1023–1036. doi: 10.1111/jan.12066. [DOI] [PubMed] [Google Scholar]
- 43.Garside R. A comparison of methods for the systematic review of qualitative research: two examples using meta-ethnography and meta-study. 2008. p. 61. [Google Scholar]
- 44.Nye E, Melendez-Torres GJ, Bonell C. Origins, methods and advances in qualitative meta-synthesis. Rev Educ. 2016;4:57–79. doi: 10.1002/rev3.3065. [DOI] [Google Scholar]
- 45.France EF, Ring N, Thomas R, Noyes J, Maxwell M, Jepson R. A methodological systematic review of what’s wrong with meta-ethnography reporting. BMC Med Res Methodol. 2014;14:119. doi: 10.1186/1471-2288-14-119. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Majid U, Vanstone M. Appraising qualitative research for evidence syntheses: a compendium of quality appraisal tools. Qual Health Res. 2018;28:2115–2131. doi: 10.1177/1049732318785358. [DOI] [PubMed] [Google Scholar]
- 47.Melia KM. Recognizing quality in qualitative research. California: Sage Publications Ltd; 2010. [Google Scholar]
- 48.Programme Critical Appraisal Skills . Qualitative research checklist. Oxford: Critical Appraisal Skills Programme; 2013. [Google Scholar]
- 49.Kitto SC, Chesters J, Grbich C. Quality in qualitative research. Med J Aust. 2008;188:243–246. doi: 10.5694/j.1326-5377.2008.tb01595.x. [DOI] [PubMed] [Google Scholar]
- 50.Kuper A, Lingard L, Levinson W. Critically appraising qualitative research. Bmj. 2008;7:337. doi: 10.1136/bmj.a1035. [DOI] [PubMed] [Google Scholar]
- 51.Kuper A, Reeves S, Levinson W. An introduction to reading and appraising qualitative research. Bmj. 2008;337:288. doi: 10.1136/bmj.a288. [DOI] [PubMed] [Google Scholar]
- 52.Mays N, Pope C. Assessing quality in qualitative research. Bmj. 2000;320:50–52. doi: 10.1136/bmj.320.7226.50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews. Checklist for qualitative research: The Joanna Briggs Institute; 2017. https://joannabriggs.org/sites/default/files/2019-05/JBI_Critical_Appraisal-Checklist_for_Qualitative_Research2017_0.pdf. Accessed 10 Mar 2019.
- 54.Dixon-Woods M, Shaw RL, Agarwal S, Smith JA. The problem of appraising qualitative research. BMJ Qual Saf. 2004;13:223–225. doi: 10.1136/qshc.2003.008714. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Lewin S, Booth A, Glenton C, Munthe-Kaas H, Rashidian A, Wainwright M, Bohren MA, Tunçalp Ö, Colvin CJ, Garside R, Carlsen B. Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series. Implementation Sci. 2018;13:2. [DOI] [PMC free article] [PubMed]
- 56.Singh J. Critical appraisal skills programme. J Pharmacol Pharmacother. 2013;4:76. doi: 10.4103/0976-500X.107697. [DOI] [Google Scholar]
- 57.Feast A, Orrell M, Charlesworth G, Poland F, Featherstone K, Melunsky N, Moniz-Cook E. Using meta-ethnography to synthesize relevant studies: capturing the bigger picture in dementia with challenging behavior within families. London: SAGE Publications Ltd; 2018. [Google Scholar]
- 58.Seale C. Quality in qualitative research. Qual Inq. 1999;5:465–478. doi: 10.1177/107780049900500402. [DOI] [Google Scholar]
- 59.Erasmus E. The use of street-level bureaucracy theory in health policy analysis in low-and middle-income countries: a meta-ethnographic synthesis. Health Policy Plan. 2014;29:iii70–iii78. doi: 10.1093/heapol/czu112. [DOI] [PubMed] [Google Scholar]
- 60.Campbell R, Pound P, Pope C, Britten N, Pill R, Morgan M, Donovan J. Evaluating meta-ethnography: a synthesis of qualitative research on lay experiences of diabetes and diabetes care. Soc Sci Med. 2003;56:671–684. doi: 10.1016/S0277-9536(02)00064-3. [DOI] [PubMed] [Google Scholar]
- 61.Coventry PA, Small N, Panagioti M, Adeyemi I, Bee P. Living with complexity; marshalling resources: a systematic review and qualitative meta-synthesis of lived experience of mental and physical multimorbidity. BMC Fam Pract. 2015;16:171. doi: 10.1186/s12875-015-0345-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Doyle LH. Synthesis through meta-ethnography: paradoxes, enhancements, and possibilities. Qual Res. 2003;3:321–344. doi: 10.1177/1468794103033003. [DOI] [Google Scholar]
- 63.Strauss A, Corbin J. Basics of qualitative research: grounded theory procedures and techniques. California: Sage Publications Ltd; 1990. [Google Scholar]
- 64.Sleijpen M, Boeije HR, Kleber RJ, Mooren T. Between power and powerlessness: a meta-ethnography of sources of resilience in young refugees. Ethn Health. 2016;21(2):158–180. doi: 10.1080/13557858.2015.1044946. [DOI] [PubMed] [Google Scholar]
- 65.Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151:264–269. doi: 10.7326/0003-4819-151-4-200908180-00135. [DOI] [PubMed] [Google Scholar]
- 66.Sandelowski M, Voils CI, Barroso J. Defining and designing mixed research synthesis studies. Res Sch. 2006;13(1):29. [PMC free article] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.