Skip to main content
Open Research Europe logoLink to Open Research Europe
. 2023 Nov 7;2:47. Originally published 2022 Apr 8. [Version 2] doi: 10.12688/openreseurope.14654.2

Participant recruitment among vulnerable populations: An experience from a qualitative study among refugee adolescents in Germany

Marjan Mohammadzadeh 1,a, Asra Taras 1, Christiane Stock 1,2
PMCID: PMC10652035  PMID: 37974661

Version Changes

Revised. Amendments from Version 1

In response to the valuable input from our peer reviewers, we have made significant refinements to our study:

  1. We have added specific details to the abstract to emphasize crucial points discussed in the paper.

  2. We replaced any unpublished references related to the project with published sources to enhance the credibility of our citations.

  3. Additional details from different references have been included in both the discussion and conclusion sections to provide a more comprehensive explanation of our findings.

These revisions serve to bolster the overall rigor and clarity of our study, effectively addressing the feedback provided by the reviewers.

Abstract

When it comes to actual practice, comparing to theoretical plans, the study progress is much more complicated due to both predicted and unpredicted challenges in the study participant recruitment. The situation is even more difficult if the research team deal with a vulnerable population. The current article represents and discusses the recruitment process for a currently unpublished qualitative study, conducted in Germany in 2021, as the first phase of our project: SC-SD4ASA: A self-care/self-development guidebook for asylum-seeking adolescents. First a brief of the study methodology is outlined and then, the strategies used to reach the potential participants including major/government organizations for refugees, private organizations and local centers, social media, youth’s favorite public places, and participatory strategy are discussed. Finally, our experience of participant recruitment challenges in this study is reviewed. We hope that the points raised from our experience can be helpful to other researchers in the same field. Overall, the experience of recruiting our participants emphasized the necessity for a dedicated point of contact for consultation and the provision of resources to connect with potential participants for researchers in the field of refugee and migrant health. Furthermore, the influence of trustworthy individuals, particularly within the community, should not be underestimated. Their assistance can significantly benefit the advancement of a research project.

Keywords: Hard to reach populations, Qualitative study, Participant recruitment, Refugee adolescents, Vulnerable populations.

Introduction

Study participants are the crucial inseparable part of studies related to human nature. Recruiting participants, including planning, targeting, and enlistment to employ the volunteers accounts for a significant part of the data collection. This is usually one of the most challenging stages of any longitudinal research study due to the limitations of the time and effort in research studies ( Patel et al., 2003a). An appropriate recruitment strategy can lead to an on time and efficient data collection and also avoid losing a considerable number of participants in a long duration of the process. Furthermore, having such strategies decreases ethical challenges and improves the research interpretation and validity of the results ( Bonk, 2010).

Overall, study approach and method, study population, sample size, characteristics and preferences of participants, and recruitment strategies are some of the critical factors defining the success of including volunteer individuals in a study ( Patel et al., 2003b). Based on these factors, a broad-spectrum of recruitment strategies can be utilized to assist participant engagement and enrolment in research.

Study population or target population is defined as “the total group of individuals from which the sample might be drawn” ( Tipape & Kepha, 2016). It can be explained based on the study location, gender, age, educational level, religion, specific health condition, or any other determining characteristic(s) that could logically separate them from other groups in a community ( Zhao et al., 2013). To put it simply, individuals in a study population typically share certain characteristics or factors related to the study's goals. However, scientific studies usually focus on a 'sample' of individuals from the larger population rather than everyone. Various sampling methods are available, depending on the study's approach and goals ( Majid, 2018).

However, in almost all research, when it comes to ‘actual practice’, compared with theoretical plans and proposal writing, more and less the study progress is much more difficult due to predicted or unpredicted challenges in the study sample recruitment ( Sarstedt et al., 2018). The situation is even much more challenging when the research team deal with a hard-to-reach vulnerable population.

There are some terms used by different researchers to name ‘not-easy-to-reach’ populations and groups, such as hard-to-reach, vulnerable, disadvantaged, underrepresented, defenseless, exposed, marginalized, or at-risk groups ( Nguyen Thanh et al., 2019). But whatever we call them, from the health and social studies’ point of view, they all have a feature in common: being at higher risk of unsatisfactory physical and psychological health as well as of poor social status compared to other groups ( Ellard-Gray et al., 2015). Based on this definition, several community groups can be potentially placed in this category. For example, patients with incurable diseases, disabled people, the homeless individuals, asylum seekers, and refugees.

The vulnerable populations also have another shared characteristic when it comes to health and social studies. Based on the reports of previous studies, these groups of community are much more difficult to find, convince, and recruit as research subjects. Several researchers believed that, based on their experiences, field research among vulnerable populations is more problematic and challenging due to various reasons such as the requirement of special ethical considerations, high probability of denied access, refusal, or incomplete collaboration ( Fête et al., 2019).

This article presents and discusses the recruitment process for the qualitative study, as the first phase of our three-phase project: ‘SC-SD4ASA: A self-care/self-development guidebook for asylum-seeking adolescents’ conducted in Germany in 2020–2022. The protocol of all three phases is represented in the 56th annual meeting of the German Society for Social Medicine and Prevention (DGSMP) as a poster and published in 2021 ( Mohammadzadeh et al., 2021). At the moment, the collected data of the first phase is analyzed, and the results will be published soon.

As the essay outline, first the study sampling and methodology is briefly explained and then, the strategies used to reach the potential participants are discussed. Finally, our experience of participant recruitment challenges in this study is reviewed.

A brief of the SC-SD4ASA study

Ethical approval

The project’s ethics approval was obtained from the research ethical committee of Charité - Universitätsmedizin Berlin (number EA2/087/21) on 08.06.2021. Participants and their parents/guardians received full details of the project process in both oral (face to face meetings) and written forms.

The study was conducted from August to December 2021 in Germany. The main objective of this study was to assess self-care and self-development knowledge, experience, and needs among asylum seeking adolescents in Germany through three different perspectives: phenomenology, cultural, and gender perspectives ( Mohammadzadeh et al., 2022). To achieve this goal, an intra-triangulation approach including three independent qualitative studies of in-depth interviews, focus group discussions, and photovoice methods was used. Following the purposive homogeneous sampling method, the study participants were eligible asylum-seekers aged 15 to 19 years old, who volunteered to participate in the project.

All the project documents including information sheets, consent forms, and posters were prepared in four different languages: Deutsch, Arabic, Farsi, and English. The interview and group discussions were planned to be held in these four languages as well; however, almost all the data collection were done in Farsi (for the Iranian and Afghan participants) and Arabic (for the participants form Arabic countries including Syria, Palestine, and Lebanon). Only in one case did the participant in the photovoice data collection ask for the English documents.

Data was collected using the following approaches and methods:

1.    Qualitative data were collected from interviews (21 participants aged 14 to 19 from five countries) and focus group discussions (four groups with 26 participants in total). The interviews were conducted in both online and face to face form, in the average time of 48 minutes. The average time of the group discussions was two hours and 45 minutes, and all four sessions were conducted face to face.

2.    Visual data (photovoice approach) were collected according to the SHOWeD method ( Liebenberg, 2018). We received 41 photos from 15 participants (each participant sent one to five photos).

To obtain more comprehensive data for this study, each participant was placed in only one of the interview or group discussion groups. However, due to the different nature of photography data, the participants in this group could also be involved in interviews or group discussions. Except one, all the participants in the photovoice study previously participated in either an interview or group discussions ( Mohammadzadeh et al., 2023).

Experiences with participant recruitment resources and strategies

There were five main source groups contacted in the initial study in order to search for potential participants.

1. The major/government organizations which are directly or indirectly related to refugee adolescents and/or refugee families

Searching for the potential participants, our first group of resources were the major organizations which are, directly or indirectly, related to refugees’ families and youth. In order to reach out to these organizations, a comprehensive online search in English and German was done by the research team, resulting in a list of the names, addresses, emails, and phone numbers of the organizations. In the first step, we tried to contact all these organizations, directly by phone. However, except in two cases, after several attempts, nobody picked up the phone. In two cases where we could have a phone conversation with the person in charge, the respondents asked us to send our request through an official email. And, of course, due to the special circumstances of the epidemic, we were not allowed to meet them in person in any case.

In the next step, an official collaboration request email (in German), was sent to all email addresses, along with the ethical approval letter, a detailed project information sheet, and consent forms in four different languages (Deutsch, English, Arabic and Farsi). However, even after follow-up emails/phone calls, we received no reply, neither positive nor negative, from any of these organizations regarding our request. Obviously, these major organizations, for any yet to be explored reason, were reluctant to get involved in research projects.

2. Private organizations, non-governmental organizations (NGOs), refugee residentials, and local youth centers

Our next source to find our potential participants were private organizations, non-governmental organizations (NGOs), refugee residentials, and local youth centers. As the host institute was in Berlin, we mostly (but not only) focused on Berlin and Brandenburg. As most of the local youth centers did not have enough information to be found through an internet search, we also posted some announcements via social media (such as Facebook 1 ) and instant messaging Apps (such as Telegram and WhatsApp groups) in German, Farsi, and Arabic looking for the staff of these centers. We also contacted the religious and cultural centers in this area which are usually the gathering place of refugee youth or their families. The feedback we received from these centers was different and, in some cases, considerable. While the project was expected to be welcomed by the centers due to its educational and health promoting nature, many of them expressed their unwillingness to cooperate under various pretexts. In some cases, they cited the weaknesses and problems of refugee adolescents as the reason for their unwillingness to cooperate. They mentioned reasons like ‘these teens usually do not tell the truth’, or that ‘these issues are too hard for them to understand’. This kind of feedback raised our concerns because we consider these statements as stereotyping refugee adolescents, and therewith as unethical and unprofessional, especially when expressed by those who are in direct contact with the refugee community. Moreover, in some cases, these centers asked us for several documents such as the full interview protocol and, after receiving that, just ignored all our follow-ups.

The situation remained relatively consistent when contacting youth centers, NGOs, refugee residences, and private organizations through email to request their cooperation. From about 20 emails to different addresses, we received only a few replies, mentioning that they don’t have access to refugee adolescents or, in the best case, referring us to institutes and organizations we had already contacted. Our attempt to obtain permissions to enter the accommodation centers and speak directly to families was unsuccessful for various reasons, including pandemic restrictions.

3. Social media announcements

Simultaneous with the above two strategies, as a direct participant recruitment method, an announcement of volunteer recruitment was posted on several social networks common among immigrants and refugees along with the project informative poster. The initial reception of these announcements was relatively satisfactory. Candidates received project information sheets in one of the four languages, English, German, Persian, or Arabic, via private message, and their possible questions were answered in their desired language. However, despite the initial response, the final result was not very successful and less than 25% of the total participants were attracted through this method. The main reason for the relative failure, especially for volunteers outside Berlin, seemed to be the difficulties related to the study consent forms. Candidates were asked to send a postal address to the research team to receive the consent forms. For obvious reasons, families could hardly trust to send their address and names to a stranger, even though they knew we were working for a well-known organization.

And even when they had trust in the researchers, most teens or their families had no incentive to spend time posting signed forms (although a stamped empty envelope with our address was sent to the candidates along with the consent forms and they only needed to drop the envelope containing the signed forms in a mailbox). Despite these restrictions, about a quarter of the participants were recruited for the project through this strategy.

4. Participatory data collection strategy

In our experience, this strategy was a game changer, resulting in about 70 % of the study participants. Since the trust factor seemed to be one of the main pillars of volunteer recruitment among refugee families, this time, we tried to use the snowball method. In this method we went forward through people who, on one hand, knew one of the research team members and on the other hand, had a relationship with refugee families to gain the participants' trust. As a result, a few families were introduced to us who, due to their trust in the person who introduced them, were not worried about their children's participation in this project.

This process helped us to meet some refugee adolescents who, in addition to participating in the study, volunteered to assist the research team in recruiting other participants. Having the experience of participating in the interview, they introduced the project to their friends and invited them to participate in the interviews or group discussions. This process led to a chain of teens who trusted each other and wanted to share their friends' experiences. Moreover, the participants' familiarity and trust in each other had another advantage. The group discussion sessions took place in an environment full of intimacy and trust, which led to the collection of valuable and rich information. At the suggestion of the teenagers themselves, a telegram group was created for them to be able to communicate more with each other. This telegram group in turn became an incentive to attract more volunteers.

5. Youths favorite public places

Although the participant recruitment process significantly progressed following the participatory data collection strategy, data saturation was not achieved in one of the language groups. To complete the process in this group, on four weekends the project was introduced to the eligible adolescents in several public youth gathering centers (shopping malls, for example). In this method, the voluntary cooperation of two adolescents who had previously participated in the interview was used. However, recruiting participants in this way was very time consuming and slow. On average, one in 10 adolescents was willing to listening project-related information, and two out of five expressed their willingness to participate after hearing the information. Yet, the number of people who agreed to sign the consent form and eventually participate in the interview or group discussion was even less. However, after four weeks, data saturation was achieved in the desired group. Thus, the process of data collection was successfully completed after more than four months.

Discussion

Not all researchers believe that participant recruitment and data collection among vulnerable groups is more challenging compared with the non-vulnerable papulations ( Chamberlain & Hodgetts, 2018), but several field experiences, including our study ( Mohammadzadeh et al., 2021), show otherwise ( Cheema et al., 2018; Fête et al., 2019; Nguyen Thanh et al., 2019; Mohammadzadeh et al., 2020).

Our experience has shown that most centers dealing with refugee families and children are reluctant to collaborate or engage in community projects, even as much as just introducing the project or distributing project posters. This issue alone could be the subject of future research projects; however, we believe that the high workload and the multiplicity of tasks and clients make employees reluctant to engage in new tasks that are not clearly defined as their duties and are considered overtime in practice. In the case of our project, the specific situation due to the limitations and problems of the pandemic period exacerbated the issue.

Generally, regarding the effective relationship as well as negotiating and gaining access to hard-to-reach quantitative data, between the research team and the organizations which are considered as the “gatekeepers” the concept of “goodwill” was highlighted by Crowhurst & Kennedy-Macfoy, 2013, especially when a researcher seeks to gain access to secondary quantitative data. Goodwill in this context depends on both the researcher's emotional reactions to the gatekeepers and the support provided by the gatekeepers in facilitating the search for data ( Crowhurst & Kennedy-Macfoy, 2013). Researchers might find it valuable to consider this concept or approach when circumstances allow However, due to the intricate and ever-changing nature of interactions in the field, it can be asserted that there is no one-size-fits-all approach to accessing gatekeepers. Some studies recommend that reflexivity, centered on the social identities of researchers, gatekeepers, and participants, is valuable in understanding the intricate interactions, potential conflicts, and cooperation involved in the gatekeeping process ( Turhan & Bernard, 2020).

In the case of smaller and local centers, it seems that they prefer not to engage in such activities to avoid any possible problems and troubles. However, the fact that these centers in some cases, based on their own judgment, did not consider refugee adolescents suitable for this project, or even labeled them with negative characteristics, such as not telling the truth, to justify their non-cooperation, needs special consideration.

However, a part of our unsuccessful experience regarding the centers was due to the study limitations. Undoubtedly, our list of public and private centers related to adolescents was not complete and we did not have the information of many of these centers. It is also possible that our emails were not sent to the correct address or department or that our contact information was not updated correctly.

The relatively unsuccessful experience in our recruitment strategy using social media announcements was to some extent expected by the research team. Many refugee families, for a variety of reasons, prefer to avoid interviews as much as possible, which may lead to the disclosure of some of their personal information and, of course, try to keep their children away from such situations, in which they could speak about personal issues. Despite our emphasis that the interviews’ and group discussions’ results have no positive or negative effects on their asylum-seeking process, following the saying that, ‘if it ain’t broke, don’t fix it’, these families preferred not to take any risk in the middle of their uncertain situation. For these families, the concept of an ‘interview’ was much different from our concept as researchers. For them, the concept of the interview was reminiscent of the anxious moments that they had in the asylum-seeking process with different authorities such as immigration officers, border police, social workers, and many others. It, therefore, seemed understandable that they were reluctant to take the risk of a similar experience. This barrier was even more pronounced when the families figured out that they and their adolescents need to sign formal consent forms.

When it comes to the adolescents, we faced other challenges. For the adolescents, especially the younger ones, being volunteered is all about seeing some changes or benefits. As adolescents mostly live in the present ( Moen & Hall-Lord, 2019), it is difficult to persuade them to take part in an activity that has no immediate benefit or visible change for them ( Eisenstein, 2018), as we emphasized in our information sheet. Analyzing the importance of a scientific research, especially on an unfamiliar subject, through tedious explanation of the project information sheet may not be easy for most of them, even when it is written in an easy language. Of course, the situation for refugee adolescents is even more complicated due to their avoidance of any possible risk.

On the other hand, after the interview or group discussion sessions, our participants mostly stated that the topic of discussion was more interesting and useful than they thought. For all these adolescents, it was the first time to experience participation in a research interview or discussion. Clearly, in the duration of the interviews or group discussions they had gotten a better view about the importance of their action as volunteers.

So, we realized that we need something more realistic and understandable than saying that ‘there is no immediate benefit for the participants in this study. The results of this study could be useful to you and your peers in the future’. to encourage them to engage in an interview. Giving ‘a gift’, such as a small shopping voucher, mostly was considered as a common way to say ‘thank you for your participation and time’, in many research studies ( Schondel & Boehm, 2000). However, these gifts seemed to be an important motivator for the participants, especially younger ones. But the success of the participatory data collection strategy showed that the approval of a trusted person or friend was the strongest incentive to participate in the study. As one of our participants said ‘I don’t need extra explanation about the project. My best friend told me the interview was fun and interesting’. Other research support our experiences that building trust is essential in engaging vulnerable population groups in participatory research projects ( Christopher et al., 2008; Rivas-Drake et al., 2016).

So, an appropriate motivation/encouraging factor could help the researchers to grasp the potential participants’ attention and buy some time for more explanation about the project. But it should be selected wisely and with full consideration of ethical parameters, so that the encouragements do not play the role of bribes. Moreover, an appropriate encouragement may be very different from one target population to another.

Overall, our participants’ recruitment experience among refugee adolescents in Germany highlighted the need for a specific reference for consultation, as well as the introduction of sources to access to potential participants for the researchers in the field of refugees’ and migrants’ health, who make up a significant part of Germany's population. In addition, these authorities can be reliable intermediaries for introducing approved projects to refugee families. In this regard, having a database of reference centers could be highly useful.

Moreover, in non-clinical research projects among healthy children and adolescents, especially in the vulnerable groups, replacing the traditional methods, such as information sheets, which are mostly long and confusing, with innovative and easy to understand methods to introduce the project and its importance, such as using short videos, color images and infographics, might be beneficial. Our experience has shown that adolescents are very active and interested when they understand the significance of their participation and value of their thoughts. However, understanding this importance through formal explanations is not always easy.

And finally, the power of trustworthy people, especially within the community, should not be overlooked. The help of these people can be a great advantage to the progress of the project. In the case of children and adolescents, using the help of interested friends and peers can even be more effective and even be considered as an efficient motivator.

Ethical considerations

While the use of these recommendations may be effective in improving the efficiency of participant recruitment methods, the priority of ethical considerations should be carefully considered. There is no doubt that this matter is much more sensitive in vulnerable groups. Although individuals and organizations involved with vulnerable groups are expected to be familiar with ethics and personal data protection rules, providing the information about the specific ethical considerations of each project to individuals outside the research team is essential.

This information should be provided to volunteers, as needed, in the form of the project sheet or during briefing meetings or training sessions. The protection of personal data and information must always precede any action taken in the data collection. While introducing people eligible to participate in the study or alternatively, introducing the study to them, can be done in a variety of ways, the personal identification of the participants must be carefully protected and secured by the research team. Ultimately, any dissemination of the study findings must align with the informed consent agreements established between the participants and the research team.

Study limitations

In addition to the limitations mentioned in the previous sections of this article, the recruitment of participants in this study also faced other limitations. Schools are one of the most important and reliable sources for employing participants, especially in the age group of children and adolescents. However, due to the coincidence of this study with the closure of schools due to epidemic conditions, it was not possible to use the capacity of schools to hire participants. Of course, this restriction also included other educational and cultural centers related to refugee adolescents and their families. Moreover, due to the pandemic travel restrictions, direct access to potential participants and organizations outside of Berlin and nearby cities was difficult.

Conclusion

The results obtained from conducting scientific research among vulnerable groups can be a valuable foundation for the success of the plans aiming to address the specific problems of these groups. However, studies among vulnerable groups generally face many challenges at various stages, including recruiting participants. Enhancing recruitment methods to establish greater trust within the study population can lead to successful retention in endeavors. Effectively conducting research with the participants' best interests in mind may lead to the creation of a pool of individuals who will willingly participate in studies with a similar target group. As retention rates improve, word-of-mouth recommendations, particularly within vulnerable populations, can become a valuable recruitment tool ( Andrews & Davies, 2022). We hope that the points raised from our experience can be helpful to other researchers in the same field. It should be noted that the use of a combination of methods introduced in this study in addition to other appropriate methods can effectively accelerate the process.

Ethical approval

The project’s ethics approval was obtained from the research ethical committee of Charité – Universitätsmedizin Berlin (number EA2/087/21) on 08.06.2021. Participants and their parents /guardians receive full details of the project process in both oral (face to face meetings) and written forms.

Acknowledgements

We would like to thank Dr. Katherina Heinrichs and Ms. Laura Pilz González (Institute of Health and Nursing Science, Charité–Universitätsmedizin Berlin) for their valuable contributions to this project.

Funding Statement

The project has received funding from the European Union’s Horizon 2020 research and innovation program under the Marie Skłodowska‐Curie grant agreement No 888607. The funding body played no role in the development of this paper.

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 2; peer review: 3 approved]

Footnotes

Data availability

No data are associated with this article.

References

  1. Andrews L, Davies TH: Participant recruitment and retention from vulnerable populations in clinical trials is a matter of trust. Contemp Clin Trials. 2022;123: 106969. 10.1016/j.cct.2022.106969 [DOI] [PubMed] [Google Scholar]
  2. Bonk J: A road map for the recruitment and retention of older adult participants for longitudinal studies. J Am Geriatr Soc. 2010;58 Suppl 2:S303–S07. 10.1111/j.1532-5415.2010.02937.x [DOI] [PubMed] [Google Scholar]
  3. Chamberlain K, Hodgetts D: Collecting qualitative data with hard-to-reach groups. In: Flick Uwe (ed.), Handbook of Qualitative Data Collection.(SAGE Publications Ltd: London),2018. 10.4135/9781526416070.n42 [DOI] [Google Scholar]
  4. Cheema AR, Mehmood A, Khan FA: Challenges of research in rural poverty: lessons from large field surveys. Development in Pract. 2018;28(5):714–19. 10.1080/09614524.2018.1467881 [DOI] [Google Scholar]
  5. Christopher S, Watts V, McCormick AK, et al. : Building and maintaining trust in a community-based participatory research partnership. Am J Public Health. 2008;98(8):1398–1406. 10.2105/AJPH.2007.125757 [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Crowhurst L, Kennedy-Macfoy M: Troubling gatekeepers: methodological considerations for social research. Int J Soc Res Methodol. 2013;16(6):457–462. 10.1080/13645579.2013.823281 [DOI] [Google Scholar]
  7. Eisenstein M: Infection forecasts powered by big data. Nature. 2018;555(7695):S2–S4. 10.1038/d41586-018-02473-5 [DOI] [PubMed] [Google Scholar]
  8. Ellard-Gray A, Jeffrey NK, Choubak M, et al. : Finding the hidden participant: Solutions for recruiting hidden, hard-to-reach, and vulnerable populations. Int J Qual Meth. 2015;14(5): 1609406915621420. 10.1177/1609406915621420 [DOI] [Google Scholar]
  9. Fête M, Aho J, Benoit M, et al. : Barriers and recruitment strategies for precarious status migrants in Montreal, Canada. BMC Med Res Methodol. 2019;19(1): 41. 10.1186/s12874-019-0683-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Liebenberg L: Thinking critically about photovoice: Achieving empowerment and social change. Int J Qual Meth. 2018;17(1): 1609406918757631. 10.1177/1609406918757631 [DOI] [Google Scholar]
  11. Majid U: Research fundamentals: Study design, population, and sample size. Undergraduate Res Nat Clin Sci Tech J. 2018;2(1–12):1–7. 10.26685/urncst.16 [DOI] [Google Scholar]
  12. Moen ØL, Hall-Lord ML: Adolescents' mental health, help seeking and service use and parents' perception of family functioning. Nord J Nurs Res. 2019;39(1):1–8. 10.1177/2057158518764036 [DOI] [Google Scholar]
  13. Mohammadzadeh M, Awang H, Ismail S, et al. : Improving coping mechanisms of Malaysian adolescents living in orphanages through a life skills education program: A multicentre randomized controlled trial. Asian J Psychiatr. 2020;48:101892. 10.1016/j.ajp.2019.101892 [DOI] [PubMed] [Google Scholar]
  14. Mohammadzadeh M, Heinrichs K, González LP, et al. : Interventional Guideline on Self-Care/Self-Development for Asylum-Seeking Adolescents: A Step Forward to a Sustainable Emotional and Behavioral Health. Das Gesundheitswesen. 2021;83(08/09):683–684. 10.1055/s-0041-1732059 [DOI] [Google Scholar]
  15. Mohammadzadeh M, Heinrichs K, Pilz González L, et al. : Study Protocol for the SC-SD4ASA Project: A Self-Care/Self-Development Guidebook for Asylum-Seeking Adolescents. Front Public Health. 2022;10: 736673. 10.3389/fpubh.2022.736673 [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Mohammadzadeh M, Taras A, Stock C: Self-care and self-development practices among refugee adolescents: An art-based participatory qualitative study. Das Gesundheitswesen. 2023;85(08/09):763–764. 10.1055/s-0043-1770439 [DOI] [Google Scholar]
  17. Nguyen Thanh H, Cheah PY, Chambers M: Identifying ‘hard-to-reach’groups and strategies to engage them in biomedical research: Perspectives from engagement practitioners in Southeast Asia [version 1; peer review: 2 approved]. Wellcome Open Res. 2019;4:102. 10.12688/wellcomeopenres.15326.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Patel MX, Doku V, Tennakoon L: Challenges in recruitment of research participants. Adv Psychiat Treat. 2003a;9(3):229–38. 10.1192/apt.9.3.229 [DOI] [Google Scholar]
  19. Patel N, Glass M, Kim JH: Data Collection Applications for the NC A&T State University Algebra Tutoring Dialogue (Wooz Tutor) Project. In: MAICS.Citeseer.2003b;120–25. Reference Source
  20. Rivas-Drake D, Camacho TC, Guillaume C: Just good developmental science: Trust, identity, and responsibility in ethnic minority recruitment and retention. Adv Child Dev Behav. 2016;50:161–188. 10.1016/bs.acdb.2015.11.002 [DOI] [PubMed] [Google Scholar]
  21. Sarstedt M, Bengart P, Shaltoni AM, et al. : The use of sampling methods in advertising research: A gap between theory and practice. Int J Advert. 2018;37(4):650–63. 10.1080/02650487.2017.1348329 [DOI] [Google Scholar]
  22. Schondel CK, Boehm KE: Motivational needs of adolescent volunteers. Adolescence. 2000;35(138):335–43. [PubMed] [Google Scholar]
  23. Tipape S, Kepha O: Effects of transformational leadership on governance in Kajiado County Government, Kenya. Int J Sci Res Publ. 2016;6(10):577–82. Reference Source [Google Scholar]
  24. Turhan Z, Bernard CA: Negotiating with Gatekeepers: Reflexivity in Exploring Turkish Men's Engagement in Domestic Violence Perpetrators Interventions in the UK. The Qualitative Report. 2020;25(8):3065–3079. 10.46743/2160-3715/2020.4400 [DOI] [Google Scholar]
  25. Zhao L, Tian L, Cai T, et al. : Effectively selecting a target population for a future comparative study. J Am Stat Assoc. 2013;108(502):527–39. 10.1080/01621459.2013.770705 [DOI] [PMC free article] [PubMed] [Google Scholar]
Open Res Eur. 2023 Nov 28. doi: 10.21956/openreseurope.18138.r36120

Reviewer response for version 2

Todd H Davies 1

Author revisions are responsive.

Is the argument persuasive and supported by appropriate evidence?

Partly

Is the work clearly and cogently presented?

Partly

Is the topic of the essay discussed accurately in the context of the current literature?

Partly

Does the essay contribute to the cultural, historical, social understanding of the field?

Yes

Reviewer Expertise:

Clinical research in vulnerable populations

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Open Res Eur. 2023 Nov 15. doi: 10.21956/openreseurope.18138.r36118

Reviewer response for version 2

Pilar Serrano-Gallardo 1

In response to the authors' comments, I think the word "Obviously" should be removed from the sentence: “Obviously, these major organizations, for any yet to be explored reason, were reluctant to get involved in research projects” because this seems to come from preconceived ideas. Furthermore, as the authors themselves point out, they have not explored these reasons.

Although the authors can point out their impressions in light of their experiences, given that this work did not aim to explore the stereotypes of refugee adolescents in different organizations and centers, it would be advisable to modify the wording of the sentence: “This kind of feedback raised our concerns because we consider these statements as stereotyping refugee adolescents, and therewith as unethical and unprofessional, especially when expressed by those who are in direct contact with the refugee community”. As it appears now, it leads one to think that these statements could be common.

Is the argument persuasive and supported by appropriate evidence?

Partly

Is the work clearly and cogently presented?

Partly

Is the topic of the essay discussed accurately in the context of the current literature?

Partly

Does the essay contribute to the cultural, historical, social understanding of the field?

Yes

Reviewer Expertise:

Public Health research in vulnerable population

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Open Res Eur. 2023 Nov 15. doi: 10.21956/openreseurope.18138.r36119

Reviewer response for version 2

Maura Dowling 1

I have reviewed the new version, and the status can be updated to Approved.

Is the argument persuasive and supported by appropriate evidence?

Yes

Is the work clearly and cogently presented?

Yes

Is the topic of the essay discussed accurately in the context of the current literature?

Yes

Does the essay contribute to the cultural, historical, social understanding of the field?

Yes

Reviewer Expertise:

NA

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Open Res Eur. 2022 Dec 23. doi: 10.21956/openreseurope.15829.r30404

Reviewer response for version 1

Pilar Serrano-Gallardo 1

This work raises an important issue for research with vulnerable people, where it is difficult to recruit participants. The scientific community needs key elements to work in this field, and this essay provides important findings.

In a "Responsible Research approach" it is essential to incorporate participatory processes throughout all stages of research, and this is especially relevant with vulnerable populations. Considering what is reflected in the section “Experiences with participant recruitment resources and strategies”, it does not seem that the different source groups have been involved in the investigation from the outset, being part of the design of the recruitment strategies themselves. It does not seem appropriate for the authors to claim that it was obvious that some strategies would not work, because if they did, they should not have been incorporated. These issues should be part of Discussion, as they may be part of the reasons for the poor success of several of the strategies. Nor does it seem prudent to make judgments such as “This kind of feedback raised our concerns because we consider these statements as stereotyping refugee adolescents, and therewith as unethical and unprofessional, especially when expressed from those who are in direct contact with the refugee community”, given that no research has been carried out on these issues.

On the other hand, the authors should also provide more details on what the "Participatory Data Collection Strategy" consisted of, since it seems to have produced the best results.

Some further reading is recommended, which may be particularly relevant in the context of this essay:

  • National Institute for Health Research. About INVOLVE—INVOLVE [Internet]. Available online: https://www.invo.org.uk/about-involve/

  • Jagosh, J.; Macaulay, A.C.; Pluye, P.; Salsberg, J.; Bush, P.; Henderson, J.; Sirett, E.; Wong, G.; Cargo, M.; Herbert, C.P.; et al. Uncovering the benefits of participatory research: Implications of a realist review for health research and practice. Milbank Q. 2012, 90, 311–346.

  • Kramer, C.B.; LeRoy, L.; Donahue, S.; Apter, A.J.; Bryant-Stephens, T.; Elder, J.P.; Hamilton, W.J.; Krishnan, J.A.; Shelef, D.Q.; Stout, J.W.; et al. Enrolling African-American and Latino patients with asthma in comparative effectiveness research: Lessons learned from 8 patient-centered studies. J. Allergy Clin. Immunol. 2016, 138, 1600–1607.

  • Serrano-Gallardo, P.; Cassetti, V.; Boone, A.L.D.; Pisano-González, M.M. Recruiting Participants in Vulnerable Situations: A Qualitative Evaluation of the Recruitment Process in the EFFICHRONIC Study. Int. J. Environ. Res. Public Health 2022, 19, 10765. https://doi.org/10.3390/ijerph191710765

Regarding other minor issues, abstract should incorporate the main conclusions related to the recruitment process analyzed. Citation is introduced in the text ((Mohammadzadeh et al., unpublished) which does not make much sense given that it is not yet accessible as it is unpublished work.

Is the argument persuasive and supported by appropriate evidence?

Partly

Is the work clearly and cogently presented?

Partly

Is the topic of the essay discussed accurately in the context of the current literature?

Partly

Does the essay contribute to the cultural, historical, social understanding of the field?

Yes

Reviewer Expertise:

Public Health research in vulnerable population

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

References

  • 1. : Uncovering the benefits of participatory research: implications of a realist review for health research and practice. Milbank Q .2012;90(2) : 10.1111/j.1468-0009.2012.00665.x 311-46 10.1111/j.1468-0009.2012.00665.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. : Enrolling African-American and Latino patients with asthma in comparative effectiveness research: Lessons learned from 8 patient-centered studies. J Allergy Clin Immunol .2016;138(6) : 10.1016/j.jaci.2016.10.011 1600-1607 10.1016/j.jaci.2016.10.011 [DOI] [PubMed] [Google Scholar]
  • 3. : Recruiting Participants in Vulnerable Situations: A Qualitative Evaluation of the Recruitment Process in the EFFICHRONIC Study. Int J Environ Res Public Health .2022;19(17) : 10.3390/ijerph191710765 10.3390/ijerph191710765 [DOI] [PMC free article] [PubMed] [Google Scholar]
Open Res Eur. 2023 Oct 24.
Marjan Mohammadzadeh 1

  • In a "Responsible Research approach" it is essential to incorporate participatory processes throughout all stages of research, and this is especially relevant with vulnerable populations. Considering what is reflected in the section “Experiences with participant recruitment resources and strategies”, it does not seem that the different source groups have been involved in the investigation from the outset, being part of the design of the recruitment strategies themselves. It does not seem appropriate for the authors to claim that it was obvious that some strategies would not work, because if they did, they should not have been incorporated. These issues should be part of Discussion, as they may be part of the reasons for the poor success of several of the strategies. Nor does it seem prudent to make judgments such as “This kind of feedback raised our concerns because we consider these statements as stereotyping refugee adolescents, and therewith as unethical and unprofessional, especially when expressed from those who are in direct contact with the refugee community”, given that no research has been carried out on these issues.

  Not all the data collection strategies used in this study were considered "participatory." The participatory approach was just one part of our data collection strategy, but it turned out to be very effective. We didn't initially plan to involve as many different sources as we eventually did. Given the vulnerability of the population, adding more sources could increase the risk, especially considering we already used over five different sources for data collection. We weren't sure about the effectiveness of our methods until we tried them. The observations and experiences we shared in this paper, such as noting that "major organizations were reluctant to get involved in research projects," were the results of our own experiences and observations, not preconceived ideas or prior knowledge. The feedback we received regarding some refugee centers was based on our real experiences and interactions. Other researchers may have different experiences and perspectives on these matters. In conclusion, we view this article as a reflection of our honest experiences during the data collection process rather than a theoretical discussion of data collection methods. Our hope is that this article can assist researchers in the same field in navigating the process more efficiently.  

  • Regarding other minor issues, abstract should incorporate the main conclusions related to the recruitment process analyzed. Citation is introduced in the text ((Mohammadzadeh et al., unpublished) which does not make much sense given that it is not yet accessible as it is unpublished work.

The abstract is modified. We also replaced the citation as it is published now.

Open Res Eur. 2022 Nov 29. doi: 10.21956/openreseurope.15829.r30401

Reviewer response for version 1

Todd H Davies 1

The authors provide an important example of how standard methods for recruiting participants into clinical research can be ineffective in vulnerable populations.

The key finding was that trust was a critical factor in recruiting their target population, whom they labeled as vulnerable. However, the authors do not explore an extensive trust literature with vulnerable populations (citations added). Nor do they fully explain the vulnerable nature of the adolescent population. "The power of trustworthy people" in research is an important discussion point that should be explored more in the context of future clinical research approaches.

There are several ethical considerations involving coercion of this population: 1. Utilizing peer pressure and 2. The value of gift cards to this population. These are reasonable approaches, but considering this manuscript is specifically about vulnerable populations, some explanation of these how these things were managed is appropriate.

Is the argument persuasive and supported by appropriate evidence?

Partly

Is the work clearly and cogently presented?

Partly

Is the topic of the essay discussed accurately in the context of the current literature?

Partly

Does the essay contribute to the cultural, historical, social understanding of the field?

Yes

Reviewer Expertise:

Clinical research in vulnerable populations

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

References

  • 1. : Rigor and Respect: Recruitment Strategies for Engaging Vulnerable Populations in Research. J Interpers Violence .2022;37(17-18) : 10.1177/08862605211023497 NP17052-NP17072 10.1177/08862605211023497 [DOI] [PubMed] [Google Scholar]
  • 2. : Factors Influencing Participation in Clinical Research: Do minority and lower socioeconomic status patients experience greater barriers in participation. Poster presented at the LVHN Research Scholar Program Poster Session, Lehigh Valley Health Network, Allentown, Pennsylvania .2014; Reference source
  • 3. : "A scarlet letter": Stigma and other factors affecting trust in the health care system for women seeking substance abuse treatment in a community setting. Subst Abus .2019;40(2) : 10.1080/08897077.2018.1544184 170-177 10.1080/08897077.2018.1544184 [DOI] [PubMed] [Google Scholar]
  • 4. : Race, socioeconomic status, and health: complexities, ongoing challenges, and research opportunities. Ann N Y Acad Sci .2010;1186: 10.1111/j.1749-6632.2009.05339.x 69-101 10.1111/j.1749-6632.2009.05339.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. : Participant recruitment and retention from vulnerable populations in clinical trials is a matter of trust. Contemp Clin Trials .2022;123: 10.1016/j.cct.2022.106969 106969 10.1016/j.cct.2022.106969 [DOI] [PubMed] [Google Scholar]
Open Res Eur. 2023 Oct 24.
Marjan Mohammadzadeh 1

  • The key finding was that trust was a critical factor in recruiting their target population, whom they labeled as vulnerable. However, the authors do not explore an extensive trust literature with vulnerable populations (citations added). Nor do they fully explain the vulnerable nature of the adolescent population. "The power of trustworthy people" in research is an important discussion point that should be explored more in the context of future clinical research approaches.

Additional points and highlights related to the requested modifications have been included in the conclusion section and we have included additional literature addressing trust.

  • There are several ethical considerations involving coercion of this population: 1. Utilizing peer pressure and 2. The value of gift cards to this population. These are reasonable approaches, but considering this manuscript is specifically about vulnerable populations, some explanation of these how these things were managed is appropriate.

  It's worth noting that throughout our process, we did not encounter any instances of peer "pressure," Peer pressure would be significantly distant from the goals of our project. Rather, what we observed was peer support and trust, as you astutely pointed out in your previous comment. Our participants appeared happier and more at ease working together, as explicitly discussed in the paper under "Experiences with participant recruitment resources and strategies," part 4, paragraph 2. The” value of gift cards” is based on similar studies conducted in Germany and endorsed by the ethical committee. Nonetheless, various considerations regarding this matter are discussed in paragraph 10 of the discussion section.

Open Res Eur. 2022 Apr 25. doi: 10.21956/openreseurope.15829.r29021

Reviewer response for version 1

Maura Dowling 1

The discussion paper by Mohammadzadeh and colleagues presents a very interesting overview of the challenges in recruiting vulnerable populations for a qualitative study in a pandemic. The various strategies employed by the research team to recruit refugee adolescents in Germany for their study are discussed and obstacles are highlighted. In addition, the challenges to recruitment in a time of restrictions during the COVID-19 pandemic are presented.

I have some minor comments for consideration that will further strengthen this paper.

  • The authors should reframe the discussion on the challenges of the first two approaches (major government and private organisations) in the context of gatekeepers. The discussion could be strengthened by reference to insights provided by Crowhurst and Kenney-MacFoy (2013) and the findings of Snowden and Young (2017) on gatekeeping as a continuum from unconscious to conscious.

  • Some attention to research reflexivity would also strengthen the discussion on accessing participants via gatekeepers and any possible power dynamics. The paper by Turhan and Bernard (2020) offers guidance on approaching reflexive accounts.

  • The participatory data collection strategy was found to be the most successful recruitment strategy. It would be interesting to mention any details of including some refugee adolescents on the research team when designing the study (public and patient involvement [PP1]). You may have done this or it may not have been possible due to the pandemic, but it is not clear from the account provided.

  • Rephrasing of the following sentences is needed where the meaning is not entirely clear: a) The last sentence in the section ‘ethical considerations’; ‘ …according to the informed consent forms…’ ; b) Discussion, paragraph 5, the first sentence; what does ‘more and less predictable’ mean?

  • Some minor typos noted as follows: a) Introduction, paragraph 3, sentence beginning with ‘In other words…in one or more characteristic [sic]’; b) Introduction, paragraph 3, sentence beginning with ‘However, scientific studies …instead of the whole populations [sic]’

Is the argument persuasive and supported by appropriate evidence?

Yes

Is the work clearly and cogently presented?

Yes

Is the topic of the essay discussed accurately in the context of the current literature?

Yes

Does the essay contribute to the cultural, historical, social understanding of the field?

Yes

Reviewer Expertise:

Cancer nursing, qualitative methodologies.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

References

  • 1. : Troubling gatekeepers: methodological considerations for social research. International Journal of Social Research Methodology .2013;16(6) : 10.1080/13645579.2013.823281 457-462 10.1080/13645579.2013.823281 [DOI] [Google Scholar]
  • 2. : A screening tool for predicting gatekeeping behaviour. Nurs Open .4(4) : 10.1002/nop2.83 187-199 10.1002/nop2.83 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. : Negotiating with Gatekeepers: Reflexivity in Exploring Turkish Men’s Engagement in Domestic Violence Perpetrator Interventions in the UK. The Qualitative Report .2020; 10.46743/2160-3715/2020.4400 10.46743/2160-3715/2020.4400 [DOI] [Google Scholar]
Open Res Eur. 2023 Oct 24.
Marjan Mohammadzadeh 1

  • The autho rs should reframe the discussion on the challenges of the first two approaches (major government and private organisations) in the context of gatekeepers. The discussion could be stren gthened by reference to insights provided by Crowhurst and Kenney-MacFoy (2013) and the findings of Snowden and Young (2017) on gatekeeping as a continuum from unconscious to conscious. Some attention to research reflexivity would also strengthen the discussion on accessing participants via gatekeepers and any possible power dynamics. The paper by Turhan and Bernard (2020) offers guidance on approaching reflexive accounts.

Additional clarifications and explanations concerning the points you requested have been included in the third paragraph of the discussion section.  

  • Rephrasing of the following sentences is needed where the meaning is not entirely clear: a) The last sentence in the section ‘ethical considerations’; ‘ …according to the informed consent forms…’ ; b) Discussion, paragraph 5, the first sentence; what does ‘more and less predictable’ mean?

The requested modifications have been implemented.  

  • Some minor typos noted as follows: a) Introduction, paragraph 3, sentence beginning with ‘In other words…in one or more characteristic [sic]’; b) Introduction, paragraph 3, sentence beginning with ‘However, scientific studies …instead of the whole populations [sic]’

The requested modifications have been implemented.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    No data are associated with this article.


    Articles from Open Research Europe are provided here courtesy of European Commission, Directorate General for Research and Innovation

    RESOURCES