Abstract
Background
Social media tools have provided health researchers with the opportunity to engage with communities and groups in a nonconventional manner to recruit participants for health research. Using social media to advertise research opportunities and recruit participants facilitates accessibility to participants from broad geographical areas and diverse populations. However, little guidance is provided by ethics review boards for researchers to effectively use this recruitment method in their research.
Objective
This study sought to explore the literature on the use of social media for participant recruitment for research studies and identify the best practices for recruiting participants using this method.
Methods
An integrative review approach was used to synthesize the literature. A total of 5 health sciences databases, namely, EMBASE (Ovid), MEDLINE (Ovid and EBSCOhost), PsycINFO (Ovid), Scopus (Elsevier), and CINAHL Plus with Full Text (EBSCOhost), were searched using predefined keywords and inclusion and exclusion criteria. The initial search was conducted in October 2020 and was updated in February 2022. Descriptive and content analyses were applied to synthesize the results, and the findings are presented in a narrative and tabular format.
Results
A total of 96 records were included in this review, 83 (86%) from the initial search and 13 (14%) from the updated search. The publication year ranged between 2011 and 2022, with most publications (63/96, 66%) being from the United States. Regarding recruitment strategy, 45% (43/96) of the studies exclusively used social media, whereas 51% (49/96) used social media in conjunction with other strategies. The remaining 4% (4/96) provided guidelines and recommendations for social media recruitment. Notably, 38% (36/96) of these studies involved hard-to-reach populations. The findings also revealed that the use of social media is a cost-effective and efficient strategy for recruiting research participants. Despite the expanded use across different populations, there is limited participation of older adults in social media recruitment.
Conclusions
This review provides important insights into the current use of social media for health research participant recruitment. Ethics boards and research support services in academic institutions are encouraged to explicitly provide researchers with guidelines on the use of social media for health research participant recruitment. A preliminary guideline prepared based on the findings of this review is proposed to spark further development in this area.
Keywords: advertisement, recruitment, research participants, social media, mobile phone
Introduction
Background
In this digital age, advancements in technology have created opportunities for researchers to use new techniques to recruit research participants. For health researchers, technological innovations present an opportunity to use digital platforms such as social media, the internet, web applications, multimedia, and smartphones to effectively and efficiently engage the community for research recruitment [1]. These digital platforms provide an additional source for participant recruitment for health research studies [2]. Within health sciences, social media is being quickly adopted because of its increased use as a method of communication with the public [3]. For many researchers, recruiting participants for trials can be a daunting task that can result in study delays or the termination of trials [4]. Less than one-third of trials reach their original target within a specified time frame, and approximately one-third required extension [5]. Hence, reaching targeted participants through social media platforms provides an important avenue for facilitating researchers’ work.
Social media refers to a group of internet-based communication services through which users create and participate in web-based exchanges, contribute user-created content such as videos, or join web-based communities to share information and ideas [6]. The trends and patterns of social engagement worldwide help provide researchers, policy makers, and other stakeholders with an overview of the different social media applications that users are engaged with [7] and how these tools could potentially be used to leverage health research. With a global population of 7.8 billion inhabitants [8], internet users stand at 4.54 billion, representing a 59% penetration rate, and active social media users at 3.80 billion, representing 49% [9,10]. Active social media platforms users include Facebook (63%), YouTube (61%), WhatsApp (48%), Facebook Messenger (38%), Instagram (36%), Twitter (23%), and Snapchat (13%) [9,11]. Social media provides an appropriate medium for user connection and communication, information collection and dissemination, knowledge sharing, discussion, and collaboration with communities for professional networking and business purposes [12-14].
Despite the numerous benefits and opportunities associated with social media, its use in the recruitment of research participants is still evolving. Health researchers using digital platforms for research participant recruitment encounter challenges such as efficiency, cost, information reliability, informed consent, confidentiality, privacy-related concerns [15], internet accessibility, information overload, informed consent, and interaction quality [12,13]. In traditional recruitment methods, researchers often face costs associated with personnel and resources, administrative changes, time-consuming recruitment processes, recruitment bias, and population homogeneity [16-20]. Cost plays an essential part in the success of a research process as a higher fraction of the cost is allocated to participant recruitment [21]. The cost involved in research studies varies and is dependent on certain factors such as the targeted population, geographical location, and type of recruitment approach [18]. To overcome the challenges associated with the cost of participant recruitment, researchers need metrics to determine the cost of recruitment.
To access social media, users are required to create a profile that requires certain mandatory information such as first name and last name, email address, or mobile phone number [22]. Although interested social media users willingly provide these data, they are often unknowingly signing away their privacy, which increases the possibility of privacy breaches [23]. Although research ethics boards (REBs) require removing identifying information of research participants from data using unique identifiers, such guidelines are rendered ineffective in the context of social media data as participants’ relational links are predictive of their attributes [24]. Nonetheless, Narayanan and Shmatikov [25] stated that such anonymization of participants’ data might be insufficient to protect social media networks’ privacy.
Researchers need guidance to navigate the ethical and logistical issues associated with using social platforms as a recruitment tool other than the “Terms and Conditions” stated by the application software providers [26]. Therefore, researchers often turn to ethics boards within their institutions for guidance on social media and internet recruitment; however, this information is not always readily available. To determine this, we reviewed the REBs of the top 10 higher education institutions in Canada to identify any standard ethical guidelines currently being used or recommended for using social media tools to recruit participants for research studies beyond adopting the Tri-Council Policy Statement on research. We used the QS World University Ranking criteria, which determine universities’ rankings worldwide based on 6 metrics [27]. This strategy was deemed appropriate as these universities are known for their high-impact research productivity. The results revealed that only 3 universities had guidelines available on social media use in research studies, which further supported the need for this integrative review (Multimedia Appendix 1). A standard protocol that could be adopted by postsecondary institutions, research organizations, and researchers could help mitigate the pitfalls researchers encounter during participant recruitment for research via social media applications. Such protocols may facilitate the research process, expedite data collection, and ensure that digital research recruitment practices protect participants’ data and rights.
Regarding the published literature, only 1 review [15] examined the evidence of cost, effectiveness, and the characteristics of participants recruited through Facebook compared with other web-based, social media, and traditional recruitment methods for adult health research. Little is known about the use of other social media platforms for participant recruitment in health research. Therefore, this study was warranted to address these gaps in the literature.
Objectives and Research Questions
This review sought to examine the evidence available on all the applications identified as social media tools and identify the best practices to facilitate participant recruitment through these tools. We addressed the following research questions:
What are the different social media tools commonly used by health science researchers for recruiting research participants and in what populations?
What is the proportion of nursing researchers who use social media platforms for recruitment?
What are the benefits and challenges of using social media to recruit research participants?
What are the best practices and ethical considerations for using social media tools to recruit research participants?
Methods
Overview
An integrative review guided by the Whittemore and Knafl [28] framework was conducted. This review type allows for the inclusion of diverse research methodologies and data sources to understand and generate new knowledge on the phenomenon of interest [28,29]. A comprehensive search strategy was formulated in consultation with a health science librarian. The initial search was conducted on October 11, 2020, and updated on February 24, 2022, in the EMBASE (Ovid), MEDLINE (Ovid and EBSCOhost), PsycINFO (Ovid), Scopus (Elsevier), and CINAHL Plus with Full Text (EBSCOhost) databases using a search strategy of keywords and subject headings through an iterative process (Multimedia Appendix 2). The criteria for eligibility were (1) all types of published research on primary and secondary studies, including qualitative, quantitative, and mixed methods; (2) discussion papers, white papers, reports, brief reports, specific guidelines, conference proceedings, dissertations, and published manuscripts that reported on social media use; (3) research reports published between January 2000 and February 2022; and (4) research reports that focused on research participant recruitment and advertisements on social media platforms, including all types of populations and health sciences disciplines, and (5) all geographical locations. The following articles were excluded: (1) non–English-language articles; (2) unpublished manuscripts and non–peer-reviewed publications such as descriptive papers, editorial papers, opinion papers, letters, book reviews, and article reviews; (3) review articles (scoping, integrative, narrative, and systematic) already published on the topic; and (4) all non–health sciences articles. The time frame for the published reports was chosen to capture the contemporary views that reflect the trends and popularity of digital platforms in participant recruitment.
Data Evaluation and Analysis
Records from the databases (initial search N=1197) were retrieved and imported into the Covidence Management Software for data screening and extraction. Overall, 2 reviewers (EMD and MK) independently conducted the screening process in Covidence, screening titles and abstracts, followed by full-text screening. All decisions made to either include or exclude records against the predetermined inclusion and exclusion criteria were documented. Where conflicts arose, the 2 reviewers consulted and resolved them through a voting process. We conducted another search on February 24, 2022, to update the results. The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) Protocols template in Covidence was used to map out the screening process, and the results as shown in Figure 1.
The following details were extracted from the included records: name or names of the author or authors, year of publication, country of publication, study design, study population, total number recruited, total number of participants enrolled or recruited through social media, social media platform used, other recruitment strategies, type of advertisement (paid or not paid), incentives provided, whether the study was funded, limitations of social media reported by the authors, and duration of advertisement (Multimedia Appendix 3 [2,18,20,30-115]). The extracted data from these records were analyzed by identifying codes and categories to characterize emerging themes, patterns, trends, and relationships to aid in synthesizing the findings logically and coherently. In addition, descriptive statistics were applied where appropriate to describe and summarize the data pertinent to the distribution of research and other characteristics. The Critical Appraisal Skills Program [116] was used per the research methodology to appraise and evaluate each of the included studies critically to ensure the quality of the available evidence included in this review (Multimedia Appendix 4 [18,20,31,50,53,54,55,58,60,61,76,77,81,106,109,114]). The studies were assessed and rated as “low quality” or “moderate quality” based on their theoretical or methodological rigor [28]. Ethics approval was not required as this study did not involve human participants.
Results
Overview
In total, 1197 records were retrieved from the initial database search; in Covidence, 441 (36.8%) duplicate records were removed from the imported references, and a total of 756 (63.2%) records were moved for screening. In the first stage of screening, the titles and abstracts of each record were screened for full-text review. In the second stage of screening, 187 full-text studies were reviewed entirely and assessed for eligibility for inclusion or exclusion. For records that were not available in the full text, the Health Science Library was contacted to obtain those records. A total of 6 articles that reported on conference proceedings were retrieved but did not have any substantial information, as reported in the abstracts. Nonetheless, the full texts of these articles were requested through library services but could not be retrieved; thus, a decision was made to exclude them from the results. It should be noted that although the Covidence software automatically removes duplicates, there were instances of errors where some records were missed; therefore, removing these duplicates manually was warranted. Of the initial search, a total of 83 records were included. The updated search returned a total of 89 records. Of the 89 articles, after 11 (12%) duplicates were removed, a total of 78 (88%) articles were screened. A total of 23 articles underwent full-text review, of which 10 (43%) were excluded as they did not meet the inclusion criteria, and 13 (57%) articles were retained and included in the review. Finally, 96 records were included in the review. In total, 114 records were excluded (Multimedia Appendix 5).
Characteristics of Included Studies
The range of publication years of the articles included in the review was between 2011 and 2022 (Multimedia Appendix 3). Most publications were from the United States (63/96, 66%) and Australia (20/96, 21%). Besides that, they were from Canada (5/96, 5%), the Netherlands (2/96, 2%), and the United Kingdom (2/96, 2%). There was only one publication from each of the following countries: Taiwan, Ecuador, India, and Brazil. Out of the 96 included studies, 92 (96%) were papers reporting primary research and 4 (4%) were reports on using social media. The methodological approaches used were cross-sectional studies (38/96, 40%), web-based surveys (15/96, 16%), secondary data analysis (14/96, 15%), randomized controlled trials (10/96, 10%), reports (4/96, 4%), mixed methods studies (4/96, 4%), qualitative studies (3/96, 3%), cohort studies (3/96, 3%), clinical trials (3/96, 3%), quasi-experimental studies (1/96, 1%), and longitudinal studies (1/96, 1%).
Social Media Use by Nursing Researchers and Other Health Researchers
We were interested in determining the proportion of nursing researchers using social media; however, this was not easy to identify as researchers have published studies that have used social media for the recruitment of research participants in a variety of interdisciplinary journals. On the basis of the journal names where these articles were published, these researchers could be from any health discipline, including nursing, medicine, psychology, rehabilitation, nutrition, pharmacy, or public health. Of the 96 included studies, 71 (74%) were published in general health science journals or interdisciplinary journals [18,20,26,30-92,117-121], and 25 (26%) were published in nursing-related journals [2,93-115,122].
Social Media Tools Commonly Used by Health Researchers
Researchers used a variety of social media platforms to recruit participants, as reported in the included studies. Researchers either exclusively used social media (43/96, 45%) or social media in conjunction with other recruitment methods (49/96, 51%) to recruit participants (Multimedia Appendix 3). For studies that exclusively used social media, ≥1 social media platform was used simultaneously. Social media platforms included Facebook, Twitter, Craigslist, Instagram, YouTube, LinkedIn, Reddit, Snapchat, and Tumblr. For social media in conjunction with other recruitment strategies, researchers used the identified social media platforms in addition to blogs, social media, Grindr, and WhatsApp Messenger. It was noted that, at times, researchers used the term “social media” but did not specify the type of social media used. In both approaches, most participants relied on the use of Facebook for research recruitment.
Age Groups of Research Participants Recruited via Social Media
Although researchers used social media platforms for advertisement and recruitment of participants for research, they sometimes did not target specific populations. In addition, the age group distribution of these populations varied, and the definition of the age group differed depending on the study aims. To address this, initially, the range of age groups was specified as follows: children (aged <9 years), adolescents (aged 10-18 years), young adults (aged 19-35 years), middle-aged adults (aged 36-55 years), older adults (aged 56-64 years), and older adults aged ≥65 years. The included studies were then scanned against this categorization to identify which age group was most targeted for social media recruitment (Table 1).
Table 1.
Age category | Participants, n (%) | Research studies |
≥18 years | 28 (30) | [30,31,33-35,40,48,50,52,57,58,70,73-76,78,79,81-83,90,94,97,108,111,112,114,115] |
Age group: not specified | 22 (24) | [2,32,36,39,56,66,68,86,89,92,93,96,98-101,103,105-107,110,119] |
Two age categories | 18 (20) | [20,38,41,42,46,47,49,53,55,58,61,63,64,72,84,87,95,102] |
Age groups between 3 age categories | 9 (10) | [37,44,54,62,67,77,80,85,117] |
Age groups between 4 age categories | 3 (3) | [60,71,91] |
Age groups between 5 age categories | 3 (3) | [65,69,113] |
Adolescents | 2 (2) | [18,120] |
Age groups of ≥21 years | 3 (3) | [52,88,109] |
≥30 years | 1 (1) | [51] |
≥33 years | 1 (1) | [104] |
≥45 years | 1 (1) | [45] |
≥60 years | 1 (1) | [43] |
Age group of ≤9 years | 0 (0) | —a |
aNot available.
Populations Targeted in Social Media Recruitment and Their Characteristics
Researchers have targeted different populations in their research studies. Largely, there were many studies (46/96, 48%) that included the general population [2,18,20,31,32, 36,37,40,41, 43,46,47,49, 51,54,55, 58,60,63,64,65, 67,69,70,71,72,73,74,77, 79,80,84, 85,91,92,93,94, 104,106,108, 112,114,115, 119,120]. In addition, a significant proportion (36/96, 38%) of the included studies focused on recruiting hard-to-reach populations (Table 2). Hard-to-reach populations are groups that are socially disadvantaged and present a challenge to access for researchers because of ethnicity, low income, or health literacy [123,124]. In this review, these populations had addiction problems, unique medical disease conditions, or lifestyle choices or belonged to an ethnic minority group. A few studies applied social media recruitment to target health care professionals as research participants (10/96, 10%) [96,98,99,100,101,103,105,106,107,113].
Table 2.
Population | Records |
Addiction: smoking and alcohol | [30,35,37,38,44,48,50,52,81] |
Medical disease conditions: survivor of cancer, autism spectrum disorder, Lynch syndrome, people living with HIV, asthma, obstructive pulmonary disease, depression, and kidney transplant recipient | [34,39,42,53,56,58,61,66,68,89,97,107,111] |
Lifestyle: men who have sex with men | [33,57,78,82,83,90] |
Ethnic minorities: low-income and racial minority | [45,62,75,76,86,88,95,102] |
Cost-effectiveness, Efficacy, and Feasibility of Social Media in Comparison With Other Recruitment Methods
The costs of recruitment reported in all the included studies are presented in tabular form (Tables 3 and 4) to help ascertain how money was dispensed, as well as the cost-effectiveness of each recruitment strategy. However, it was noted that although some researchers included personnel costs, advertising costs, and other recruitment costs in the total cost, other researchers did not include these costs. Hence, researchers should use only this information as a guide. Few studies specifically compared social media effectiveness to other platforms with the goal of establishing cost-effectiveness, efficacy, and feasibility. In this review, 7% (7/96) of the included studies aimed to determine the effectiveness of social media compared with other recruitment strategies [39,51,52,58,70,74,106], and 9% (9/96) of studies that did not compare social media platforms with any other strategy [30,38,41,46,63,72,73,93,111] found social media as an effective recruitment strategy in both instances.
Table 3.
Study and social media | Cost per person | Total cost | |||
Ahmed et al [39] | |||||
|
US $8.73 | US $2950 | |||
Wilkerson et al [82] | |||||
|
Social media advertisements, posts, and email blasts | US $40.44 | US $3033.11 | ||
|
Social media posts and website banner advertisements | US $15.86 | US $1380 | ||
|
Social media posts and film festival entrance wavier | US $2.78 | US $6297.66 | ||
Gioia et al [52] | |||||
|
Craigslist | US $1.46 | US $275 | ||
Musiat et al [64] | |||||
|
Aus $105.77 (US $73.07) | —a | |||
|
Aus $422.03 (US $292.08) | — | |||
|
YouTube | Aus $81.31 (US $56.27) | — | ||
Frandsen et al [50] | |||||
|
Aus $42.34 (US $29.30) | Aus $5842.30 (US $4043.35) | |||
Byaruhanga et al [35] | |||||
|
Aus $61.68 (US $42.69) | Aus $33,738.52 (US $23349.83) | |||
|
Aus $61.52 (US $42.58) | Aus $61.52 (US $42.58) | |||
Harris et al [55] | |||||
|
— | Aus $28,571.54 (US $19,773.86) | |||
Moreno et al [18] | |||||
|
Social media (Facebook, Twitter, and blogs) | US $40.99 | — | ||
Wilkerson et al [83] | |||||
|
Facebook and Twitter | — | Free | ||
Guthrie et al [54] | |||||
|
— | US $14,825 | |||
Waltman et al [106] | |||||
|
US $119.38 | US $5252.83 | |||
Watson et al [81] | |||||
|
US $40.51 (randomized) | US $49,791.49 | |||
Derrick et al [44] | |||||
|
US $498 per couple | US $10,966 | |||
|
US $181 per couple | US $4145 | |||
Carter-Harris et al [117] | |||||
|
— | US $500 | |||
Jones et al [95] | |||||
|
US $66.46 (randomized) | — | |||
Frandsen et al [48] | |||||
|
Aus $56.34 (US $38.99) | Aus $5183.33 (US $3587.29) | |||
Juraschek et al [58] | |||||
|
US $794 | US $5704 | |||
|
US $1426 | US $2383 | |||
Iott et al [57] | |||||
|
Grindr | US $87.35 | US $1747.40 | ||
|
Scruff | US $69.30 | US $207.90 | ||
|
US $149.90 | US $170.69 | |||
|
Facebook groups | — | US $10.40 | ||
van Gelder et al [77] | |||||
|
€10.88 (US $11.13) | €315.52 (US $322.89) | |||
|
€9.48 (US $9.70) | €284.48 (US $291.13) | |||
Alley et al [70] | |||||
|
Untargeted Facebook | Aus $68 (US $47.06) | Aus $1438 (US $995.21) | ||
|
Targeted Facebook | Aus $42 (US $29.07) | Aus $7721(US $5343.57) | ||
Gilligan et al [51] | |||||
|
Aus $5.94 (US $4.11) | Aus $1107 (US $766.14) | |||
Barney et alb [84] | |||||
|
Facebook and Instagram | US $42.21 | US $21,867 | ||
Moseson et alb [85] | |||||
|
US $49.48 | — | |||
|
US $182.78 | — | |||
Salvy et alb [20] | |||||
|
US $334 | US $9020 | |||
Stuart and Mooreb [96] | |||||
|
US $1.78 | US $952.81 | |||
Cho et alb [97] | |||||
|
— | US $120,000 | |||
|
— | US $215 | |||
Spahrkäs et alb [89] | |||||
|
€22.42 (US $22.94) | €17,000 (US $17,397.12) |
aNot available.
bRecords from the updated search.
Table 4.
Studies and other strategies | Cost per person | Total cost | |
Ahmed et al [39] | |||
|
Radio | —a | US $12,030 |
Wilkerson et al [82] | |||
|
Website banner advertisements | US $172.50 | US $1380 |
Gioia et al [52] | |||
|
Print newspaper | US $116.88 | US $33,311 |
Musiat et al [64] | |||
|
Recruitment agency | Aus $100 (US $69.21) | — |
|
Google advertisements | Aus $195.83 (US $135.53) | — |
Frandsen et al [50] | |||
|
Newspaper advertisements | Aus $21.52 (US $14.89) | Aus $2065.46 (US $1429.47) |
Byaruhanga et al [35] | |||
|
Gumtree | Aus $7.29 (US $5.05) | Aus $36.43 (US $25.21) |
|
Web promotions and internet searches | Aus $43.76 (US $30.29) | Aus $437.56 (US $302.83) |
|
Emails | Aus $128.67 (US $89.05) | Aus $2315.98 (US $1602.85) |
|
Newspaper | Aus $50.28 (US $34.80) | Aus $2363.38 (US $1635.65) |
|
Radio (interviews) | Aus $102.78 (US $71.13) | Aus $205.55 (US $142.26) |
|
Magazine | Aus $85.41 (US $59.11) | Aus $170.81 (US $118.21) |
|
Posters | Aus $566.65 (US $392.17) | Aus $566.65 (US $392.17) |
|
Flyers | Aus $2546.29 (US $1762.24) | Aus $2546.29 (US $1762.24) |
|
Telephone | Aus $3990.84 (US $2761.99) | Aus $3990.84 (US $2761.99) |
Harris et al [55] | |||
|
Access to organizational websites | — | Aus $5890 (US $4067.96) |
|
Posters | — | Aus $195 (US $134.96) |
|
Face-to-face events | — | Aus $43,000 (US $29,698.17) |
|
Conference promotion | — | Aus $44,040 (US $30,416.45) |
Moreno et al [18] | |||
|
In person | US $19.09 | — |
Wilkerson et al [83] | |||
|
Mobile banner advertisements | US $375 | US $3000 |
|
Browser banner advertisements | US $187.50 | US $1500 |
Guthrie et al [54] | |||
|
Mailings | US $356 per randomized participant | US $98,682 |
Waltman et al [106] | |||
|
Provider letter | US $29.36 | US $1703 |
|
Postcards | US $926.96 | US $43,567.49 |
|
Newspaper advertisements and television interviews | US $330.12 | US $1650.63 |
Watson et al [81] | |||
|
Press releases | — | US $1995 |
|
Mailed letters | — | US $4054 |
|
Google advertisements | US $34.71 (randomized) | US $3506 |
|
Web-based survey company | — | US $7644 |
Derrick et al [44] | |||
|
Targeted mailing | US $303 per couple | US $3635 |
Carter-Harris et al [117] | |||
|
Newspaper advertisements | — | US $1224 |
Jones et al [95] | |||
|
On ground | US $149.62 (randomized) | — |
Frandsen et al [48] | |||
|
Newspaper advertisements | Aus $52.33 (US $36.22) | Aus $4343.10 (US $3005.78) |
Juraschek et al [58] | |||
|
Mailed brochure | US $799 | US $51,950 |
|
Periodicals | US $437 | US $10,906 |
Iott et al [57] | |||
|
Email groups | US $10.40 | US $62.37 |
|
Personal networking | US $10.40 | US $20.79 |
|
Unified staff | US $30.32 | US $727.65 |
|
Bar outreach | US $1621.62 | US $1621.62 |
|
Flyer per palm card | US $83.20 | US $416 |
|
Publishing article in newsletter | — | US $20.79 |
van Gelder et al [77] | |||
|
Google AdWords | €54.28 (US $55.52) | €325.66 (US $333.12) |
|
Care providers | — | — |
Alley et al [70] | |||
|
Google AdWords | Aus $495 (US $342.58) | Aus $495 (US $342.58) |
|
Posters | Aus $52 (US $35.99) | Aus $574 (US $397.26) |
|
Health care leaflets | Aus $66 (US $45.68) | Aus $990 (US $685.16) |
|
Letterbox drop | Aus $135 (US $93.43) | Aus $2425 (US $1678.30) |
|
Newspaper advertisement | Aus $145 (US $100.35) | Aus $726 (US $502.45) |
|
Community calendar | Aus $12 (US $8.30) | Aus $70 (US $48.45) |
|
Newspaper article | Aus $3 (US $2.08) | Aus $53 (US $36.68) |
Gilligan et al [51] | |||
|
Social networks, flyers, websites, posters, recruitment cards, email, and media coverage | Aus $58.70 (US $40.63) | Aus $4349 (US $3009.87 |
Barney et alb [84] | |||
|
Clinic-based and in person | US $865.93 | US $102,180 |
Moseson et alb [85] | |||
|
Google advertisements | US $265.93 | — |
Salvy et alb [20] | |||
|
Targeted mailings | US $217 | US $2387 |
|
In-person recruitment | US $290 | US $11,328 |
Stuart and Mooreb [96] | |||
|
Association journal | US $375.00 | — |
Cho et alb [97] | |||
|
Personal outreach | — | — |
|
Public outreach | — | US $1686.04 |
Spahrkäs et alb [89] | |||
|
— | — | — |
aNot available.
bRecords from the updated search.
Few studies did not conclusively find social media to be cost-effective or efficient. The findings reported by these researchers differ because of the different populations targeted, scale of recruitment, and whether the research was funded. In their funded study, Moreno et al [18] found that in-person strategies yielded more participants in a geographic area at a lower cost than social media, and the cost per enrollee by social media was higher than that of traditional methods. In addition, Frandsen et al [48] suggested that Facebook was cost-effective in obtaining eligible participants at the initial stage of the recruitment process. The mailing of letters was cost-effective compared with Facebook, according to Waltman et al [106].
Best Practices and Strategies Used to Enhance Social Media Recruitment
Diverse advertisement strategies are adopted by researchers when recruiting research participants through social media platforms. Each social media platform advertisement differs in specification, advertisement content, word count, and design language [47]. In the included studies, researchers identified and used one or multiple paid, targeted advertisement campaigns with different themes to reach potential participants on various platforms within a specific advertisement duration. Some models of advertisement included the use of paid targeted advertisement [18,30,31, 37,39-44, 46-52,54, 58-60,63, 65,69-75, 77,78,80, 81,91,93, 95,102,109, 113,114,117,119,120]. In addition, some researchers used untargeted advertisements [38,62,111], untargeted but paid advertisements [45,74], “boosted” posts [94,106], posts [34,61,76,90,105,110,115], both advertisements and posts [55,57,64,68], tweets [79,104,108], targeted advertisements and posts [36], advertisements [56], blasts [33], paid and unpaid social media channels [32,35], and messengers [92] to strategically advertise and recruit their potential participants.
Another identified strategy was the use of cost-related model strategies to determine the cost of the advertisements. Researchers who are engaged with any social media platform to advertise and recruit participants are billed by cost per click, cost per thousand impressions, cost per view, or cost per action or per conversion [125]. With the cost per click model, researchers are billed when a potential participant clicks on the advertisement. This approach was one of the most preferred models for researchers in the included studies used for advertising. The cost per click model budget is set at a daily, weekly, or lifetime spending limit depending on the researcher’s choice [18,30,33,38, 40,41,46, 47,48,51, 54,55,59, 60,64,69, 71,73,74, 75,77,80, 93,102, 111,126,129].
Researchers also noted considerations related to the display and design of an advertisement for a desktop application, which differed from that of a mobile app, and this affected how participants viewed and reacted to the recruitment advertisement. The displayed advertisements targeted either the user’s browser or the newsfeed [91,117]. For Facebook, the advertisement is displayed on the user’s web browser [58] or on the right-side panel of the Facebook newsfeed or placed directly in the newsfeed [47,55,65]. For Instagram, images are displayed in a linear format. Snapchat images are displayed using the story feature [47], and on Grindr, advertisements are displayed as pop-ups [57]. Therefore, cost is an influencing factor that determines the placement of the advertisement and the social media application of choice, thereby influencing the decisions that researchers make regarding recruitment.
Some researchers identified ethical challenges inherent to social media recruitment, such as privacy, confidentiality, and informed consent, and provided strategies to minimize the challenges for the researcher and the potential participant. The strategies offered and reported in the included studies included the use of a study-specific page for recruitment [2,51,76,78,82,91,94,107,112,113] and the use of secure landing sites or study webpages for data collection [35,43,48,50,58,75,106,118]. In addition to the strategies proposed by health researchers, there were 4 reports identified in the included studies that outlined guidelines and recommendations for social media recruitment (Table 5).
Table 5.
Study | Study purpose or aim | Key findings | Recommendation |
Curtis [118] (the United States) | To outline ethical challenges associated with social media recruitment | Social media platforms are challenged with issues of confidentiality, informed consent, and privacy issues. | Recruiting participants through secure landing sites; researchers regularly reviewing social media websites for regular updates; verifying participants’ age through cross-checking with other information may provide solutions to the challenges; setting web-based quizzes to test participant competency; and providing a summary of the research study via email |
Kamp et al [122] (the United States) | To examine and describe the challenges of the Facebook recruitment method and provide recommendations | The Facebook platform presents an inherent challenge with privacy, data security, and recruiting participants. | Researchers can implement a multifactor authentication process to access research data and regularly review the privacy settings and policies on social media sites |
Gelinas et al [26] (United States) | To examine the norms governing social media recruitment and analyze the ethics of recruiting, and the implication of web-based communication | The foundational norms in research ethics include respect for persons, beneficence, and justice; however, in social media, the key norms governing social media recruitment include respect for privacy and researcher’s transparency. The lack of regulatory guidance on ethics in social media recruitment poses a risk for ethical issues. | The authors proposed a checklist that researchers can use in social media recruitment |
Bender et al [121] (Canada) | To develop a framework on ethics and privacy for social media and internet recruitment | The Privacy by Design framework evaluates the privacy strengths, thereby providing privacy protection in web-based recruitment. | Adhering to the Privacy by Design framework, which provides privacy-enhancing measures such as developing privacy notices, disabling comment features, or monitoring comments and removing identifiable information before it becomes public |
Discussion
Principal Findings
Although we intentionally excluded 13 reviews from this study, 7 (54%) of them are discussed here against the findings of our review. The results from our review show an increased interest in using social media for research recruitment by researchers from different health disciplines in which social media strategies have fulfilled researchers’ recruitment needs. Considering the wide range of publications, the scope of this literature review, and the social media applications examined in this review, it can be concluded that the use of social media is on the rise, as evidenced by the increase in the number of publications in the past few years. The different research methods identified in the included studies suggest increased use of social media for a variety of research methods. Notably, a few of the included studies recruited participants for clinical studies, with most recruiting participants for cross-sectional studies. Despite social media’s reach within a broad geographic location, health researchers are still challenged with participant recruitment for clinical trials. This suggests that social media may be best suited for recruiting participants for noninterventional studies. Researchers recruiting for clinical trials may have to diversify their recruitment strategies to reach their recruitment goals until a comprehensive strategy to navigate social media platforms is established. This finding is similar to that of the review by Topolovec-Vranic and Natarajan [127], which found that only a few studies used social media to recruit participants for interventional studies as opposed to observational studies. Although the Topolovec-Vranic and Natarajan review [127] used a smaller number of studies to draw this conclusion, their findings are still significant, considering this review.
Researchers from different health disciplines, including nursing, medicine, public health, mental health, and pharmacy, have used social media for recruitment and have published their findings in a variety of journals. Some of these journals are discipline specific or interdisciplinary. This suggests different avenues for health researchers to publish their work. Within the nursing discipline, nurses are increasingly using social media for the recruitment of research studies, as published in multiple nursing and nonnursing journals. However, there are opportunities to continue promoting the use of social media among nurses for research and educational purposes.
On the basis of this review, researchers used different social media applications to advertise and recruit potential research participants. The preferred social media applications were Facebook, Instagram, Snapchat, LinkedIn, Twitter, Grindr, Reddit, Tumblr, WhatsApp, Craigslist, YouTube, and blogs to be used either solely to recruit or in conjunction with other recruitment strategies to achieve recruitment and study goals. Owing to its popularity among users and global penetration, Facebook was the most widely used application among researchers. Different social media applications enabled researchers to recruit participants with different demographics and characteristics. For instance, Facebook was used to recruit younger participants [77,113] and older individuals [67], whereas other researchers recruited young people through Tumblr [61]. This finding is similar to that of Arigo et al [128], who identified web-based platforms such as social networking sites (Facebook, Twitter, Instagram, Tumblr, and LinkedIn) as some of the common platforms that health researchers use to recruit research participants, including a diverse population for their research studies. In addition, researchers used multiple approaches and strategies to recruit participants. An approximately equal number of participants were recruited through social media alone or social media in conjunction with other strategies. This finding agrees with the general literature on the increasing acceptance of digital platforms for recruitment and with some health researchers using social media and traditional methods [129] for recruitment. In addition to the findings in this review, reviews conducted by some researchers [15,127,130-134], although focusing on only one social media application or using the term “social networking sites” broadly in their research, exclusively and comprehensively reported on a wide range of different social media applications used in research recruitment.
The different social media platforms used to target the different groups of populations such as the general population, hard-to-reach populations, and specialized populations, depended on the research aim. The hard-to-reach populations included people with addictions, sensitive health issues, ethnic groups, and poor and stigmatized populations [135]. Social media was found to be effective in reaching and recruiting hard-to-reach potential participants who were otherwise unreceptive to traditional recruitment methods because of their conditions and representations within their communities and society [50]. Researchers must weigh all available options to determine the best approach to proceed when recruiting from these populations.
The age group distribution of the research participants included in this review spanned different age categories. As shown in Table 1, the most targeted population from an age perspective was young adults. According to Kemp [10], the engagement of social media platforms among youth stands at 58% between the ages of 16 and 24 years. This is not surprising because of the acceptability of social media among youth who are considered technology savvy and their tendency to use social media regularly. As such, targeting such an age group for research studies can lead to increased participation. An observation of interest in this review is the low involvement of children and adolescents aged <18 years and older adults. Only 2% (2/96) of studies [18,120] involved adolescents between the ages of 13 and 14 years. As researchers require parental consent among the children and the adolescent group, research studies involving these groups are relatively limited. This finding is similar to that of Amon et al [130], who suggested that instead of focusing on adolescents who require parental consent, targeting parents or guardians of the intended group could help waive parental consent.
For older adults, the usability of social media platforms presents a challenge, such as platform design and content, as these platforms are tailored to the interests of the younger population [136]. Owing to the complex design, nature, and privacy-related concerns associated with social media platforms, older adults are more comfortable and familiar with traditional forms of recruitment than social-mediated platforms [137]. Other barriers encountered by older adults include intrapersonal, interpersonal, functional, and structural elements that hinder the use of social media platforms [138]. Although social media presents a challenge for recruitment in the older population, researchers can continue to explore traditional methods in such populations to offer an equal chance of participation in research studies. The trade-off between using traditional methods and social media for recruiting research participants is a complicated issue, requiring health researchers to weigh options and the benefits and risks to the participant and the research study, as well as more creative ways of engaging low participating groups.
There is a debate on the cost-effectiveness of social media in the literature. Some studies found the social media method to be cost-effective, whereas other studies disagree with this assertion [18,58]. In this review, the cost of other recruitment strategies compared with social media recruitment strategies was presented as part of this review to assist researchers in making an informed decision (Tables 3 and 4). In addition, in this review, the factors that influenced the cost associated with recruitment varied from one study to the next. Some researchers reported advertising, recruitment, and other administrative costs as the total cost, whereas others reported only aspects of social media advertisement and recruitment as the total cost. Owing to the inconsistency in cost reporting, having a standardized cost reporting system to maintain consistency would help to effectively determine whether social media recruitment is cost-effective. On the basis of the analysis of the cost-effectiveness of both social media and other recruitment strategies, this review found that social media was viewed by researchers as a cost-effective strategy. Although 28% (27/96) of studies in this review reported on the cost of social media compared with other recruitment methods, not all researchers found social media as a cost-effective method. Nonetheless, given that a large proportion of these studies found social media to be cost-effective, this review supports this conclusion. Compared with the previously published reviews by Reagan et al [15] and Topolovec-Vranic and Natarajan [127], this review provides additional insights and includes a broader range of studies. This review captured additional literature not included in the review by Reagan et al [15], which relied only on 18 articles, of which only 10 articles reported on cost. In the review by Topolovec-Vranic and Natarajan [127], the authors included 30 studies, of which 5 reported on cost-effectiveness, and 7 did not find social media to be a cost-effective method. The findings also revealed that the cost of recruitment for hard-to-reach populations differs from that for the general population. Jurascheck et al [58] found that recruiting through Facebook advertisements for the African American population was costly; however, advertisements were effective in directing eligible participants to the website. Hence, researchers hoping to recruit research participants through social media must consider these factors to make decisive choices on the most suitable method for recruitment.
Best Practices for the Use of Social Media in Recruitment of Research Participants
Researchers are increasingly tapping into the available opportunities to use social media platforms for their research studies. However, there is a need for best practices to guide this process. To adequately explore and navigate social media platforms successfully for recruitment, adhering to best practices, including those of ethical considerations (informed consent, privacy, confidentiality, and transparency) that protect the researcher and participants, is of utmost importance [26,118,122]. In the review by Amon et al [130], the authors found that participants recruited on web-based platforms were subjected to the same ethical standards as though they were responding to a traditional recruitment method. In that regard, Gelinas et al [26] were of the view that REBs should standardize social media techniques by clarifying their similarity to traditional recruitment. Furthermore, the findings from the review also establish the need to take additional steps to make available informed consent through other means, where the potential participants are well informed with detailed information about the research study before participation. To curb and curtail the complexities and complicated nature of informed consent, the findings from this review support the recommendations suggested by Herbell and Zauszniewski [94] and Stokes et al [105] in their studies to make an information sheet in a downloadable version available for participants and send web-based consent forms to potential participants after meeting the eligibility criteria. To maintain the confidentiality of both researchers and participants, Shaver et al [71] suggested using anonymous surveys and directing interested participants through a survey link to a landing page for study information. Researchers are discouraged from directly recruiting participants on social media platforms but instead using the social media platform to advertise, as the confidentiality and privacy of participants’ data cannot be guaranteed. To further ensure the provision of privacy, Bender et al [121] used privacy-enhancing measures aligned with the principles of Privacy by Design by disabling the comment feature, developing privacy notices for social media campaigns, sending disclaimers about the privacy risks of social media pages, and building privacy protection into the recruitment strategy. Although the tenets of the foundational principles were incorporated to avoid privacy-related issues, Bender et al [121] were of the view that the principles of transparency and user-centric options of Privacy by Design provide inadequate guidance on how to design privacy notices using these key principles.
In addition, some factors were identified to influence advertisements, such as advertisement targets, crafting of multiple advertisement campaigns with different wordings and themes, rotating and alternating advertisements, payment model, duration of the advertisement, and location of the advertisement on the social media platform. To favorably achieve the results of recruiting an increasing number of participants for research, researchers advertising on social media must strategically reach out to their participants. On the basis of the findings of this review, using an appealing image and simple and consistent language through both the text caption and image [69] influences and attracts participants to the study. Some social media platforms’ advertising policies provide details on advertisement content, including the choice of words and counts and the duration of an advertisement on their platforms. The advertisement policies differ from platform to platform. Researchers must research any platform they wish to engage in, understand the policies, and adhere to them. In addition, working with REBs on social recruitment messages and strategies helps avoid ineffective strategies and enhance ethical conduct. Incorporating prescreening questions before allowing participants to enter details for study participation reduces the rate of ineligible participants and maximizes the reach and sample representativeness. Researchers can use these applications simultaneously because of the feasibility of incorporating social media platforms such as Instagram, Snapchat, and Facebook into a study without difficulty [47].
Implications
The findings from the review show the increasing accessibility and multifunctionality of social media platforms that could be leveraged to further support health science research. In fact, one of the benefits of social media for conducting research recruitment has been amplified during the COVID-19 pandemic because of the limitations to in-person recruitment, thus sustaining the continuity of research.
Generally, social media platforms provide avenues for a practical approach to reaching diverse, extensive, and targeted audiences [139] or populations, particularly those that are hard to reach. Further research may be needed to understand the barriers to and facilitators of older adults’ engagement with social media platform recruitment.
Although different approaches to recruitment, advertisement, cost determination, and efficiency reporting can challenge novice researchers planning to use social media, there are ways of mitigating some of these challenges. For example, with the availability of funds and resources, researchers can benefit from hiring specialized companies or third-party service organizations to assist with the marketing and development of social media recruitment strategies and other innovative recruitment approaches targeting potential research participants. It is also recommended that these strategies be discussed and coordinated with the researcher’s academic institution’s REB to ensure no risks to participants.
The lack of explicit regulations by REBs to guide researchers continues to prevent the full exploration of social media platforms to support health science research. As such, stakeholders and collaborative efforts from research-based organizations, academia, researchers, think tanks, and student groups must partner to develop guidelines that reflect the use of social media in research studies. The different guidelines developed and published by researchers and academic institutions can provide a context for what is available. Therefore, based on our review, we propose a tentative description or guideline to guide researchers based on what we have synthesized from the literature included in this review (Multimedia Appendix 6). Ultimately, this guide could serve as a starting point to inform stakeholders in the development of a standardized protocol to guide health science researchers in the use of various social media platforms for research participant recruitment.
Finally, there are opportunities to advance health science education regarding social media use in general and its use for the recruitment of research participants. As students become technologically savvy, incorporating social media into their learning process will allow them to effectively engage with the platform. Schools can also provide guidelines on social media platforms on their websites to enhance learning about their applications in research processes. In addition, teaching students about best practices that support professional social media use and including social media applications as part of ethics training programs are also recommended.
Strengths and Limitations
The findings of this review offer a broad perspective on the use of social media platforms for participant recruitment by health researchers. A large number of studies were included for analysis in this review. The timelines for the included studies span >20 years and provide sufficient time to capture all studies published during the popularity of social media. This study comprehensively synthesized available literature from all health science disciplines. However, the review was limited to studies reported only in English.
Conclusions
The purpose of this integrative review was to explore the literature on recruiting participants for research studies through social media application tools and identify best practices to assist researchers in conducting research participant recruitment via social media tools. This integrative review expanded on the review by Reagan et al [15], which focused primarily on Facebook, by including other social media applications used by health researchers to recruit research participants, such as Facebook, Craigslist, Instagram, LinkedIn, Reddit, Tumblr, Twitter, and YouTube. Overall, the findings showed that social media is a suitable, viable, and cost-effective channel for recruiting research participants, despite some challenges associated with its use. Health researchers are increasingly embracing various social media platforms in their research to recruit participants from various age groups and diverse backgrounds; however, there is less use of social media to recruit older adults. Adhering to best practices when targeting various populations through social media advertisements is vitally important to protect participants’ and researchers’ rights and increase participation. REBs must proactively provide protocols and best practice guidelines that researchers can apply during the advertisement and recruitment of research participants.
Acknowledgments
The authors acknowledge the assistance of Janice Kung, Laura Hamonic, and Allison Sivak of the University of Alberta Health Sciences Library for their support during the literature search.
Abbreviations
- PRISMA
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
- REB
research ethics board
Top 10 Universities in Canada QS World University Rankings 2021.
Search strategy for keywords and subject headings of the search terms used in each database.
Characteristics of included studies.
Critical Appraisal Skills Program critical appraisal tools used to critically appraise and evaluate each of the included studies.
List of excluded studies.
Tentative guidelines to assist health sciences researchers in social media recruitment.
Footnotes
Conflicts of Interest: None declared.
References
- 1.Raju J. Knowledge and skills for the digital era academic library. J Acad Librarianship. 2014 Mar;40(2):163–70. doi: 10.1016/j.acalib.2014.02.007. [DOI] [Google Scholar]
- 2.Johnson LA, Dias N, Clarkson G, Schreier AM. Social media as a recruitment method to reach a diverse sample of bereaved parents. Appl Nurs Res. 2019 Dec;50:151201. doi: 10.1016/j.apnr.2019.151201.S0897-1897(19)30021-7 [DOI] [PubMed] [Google Scholar]
- 3.Collins K, Shiffman D, Rock J. How are scientists using social media in the workplace? PLoS One. 2016;11(10):e0162680. doi: 10.1371/journal.pone.0162680. https://dx.plos.org/10.1371/journal.pone.0162680 .PONE-D-15-48465 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Darmawan I, Bakker C, Brockman TA, Patten CA, Eder M. The role of social media in enhancing clinical trial recruitment: scoping review. J Med Internet Res. 2020 Oct 26;22(10):e22810. doi: 10.2196/22810. https://www.jmir.org/2020/10/e22810/ v22i10e22810 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Campbell MK, Snowdon C, Francis D, Elbourne D, McDonald AM, Knight R, Entwistle V, Garcia J, Roberts I, Grant A, Grant A. Recruitment to randomised trials: strategies for trial enrollment and participation study. The STEPS study. Health Technol Assess. 2007 Nov;11(48):iii, ix–105. doi: 10.3310/hta11480. http://www.journalslibrary.nihr.ac.uk/hta/volume-11/issue-48 .06/90/13 [DOI] [PubMed] [Google Scholar]
- 6.Dewing M. Background paper (Canada. Parliamentary Information and Research Service) Ottawa: Library of Parliament; 2010. Social media. 1, An introduction. [Google Scholar]
- 7.Gruzd A, Jacobson J, Mai P, Dubois E. The state of social media in Canada 2017. SSRN J. 2017 doi: 10.2139/ssrn.3158771. [DOI] [Google Scholar]
- 8.Chamie J. World Population: 2020 overview. YaleGlobal Online. 2020. [2020-02-11]. https://archive-yaleglobal.yale.edu/content/world-population-2020-overview# .
- 9.Social media: statistics and facts. Statista. [2020-05-18]. https://www.statista.com/topics/1164/social .
- 10.Digital 2020: global digital overview. We are Social. [2020-08-10]. https://wearesocial.com/blog/2020/01/digital-2020-3-8-billion-people-use-social-media .
- 11.Digital 2020. Hootsuite. [2020-09-10]. https://hootsuite.com/pages/digital-2020#c-204634 .
- 12.Dhar VK, Kim Y, Graff JT, Jung AD, Garrett J, Dick LE, Harris J, Shah SA. Benefit of social media on patient engagement and satisfaction: results of a 9-month, qualitative pilot study using Facebook. Surgery. 2018 Mar;163(3):565–70. doi: 10.1016/j.surg.2017.09.056.S0039-6060(17)30717-1 [DOI] [PubMed] [Google Scholar]
- 13.Kashif Imran M, Fatima T, Aslam U, Muhammad Javed Iqbal S. Exploring the benefits of social media towards knowledge sharing among doctors. Pakistan J Psychol Res. 2019 Jul 23;34(2):331–52. doi: 10.33824/pjpr.2019.34.2.18. [DOI] [Google Scholar]
- 14.Vuori M. Exploring uses of social media in a global corporation. J Syst Inf Technol. 2012;14(2):155–70. doi: 10.1108/13287261211232171. [DOI] [Google Scholar]
- 15.Reagan L, Nowlin SY, Birdsall SB, Gabbay J, Vorderstrasse A, Johnson C, D'Eramo Melkus G. Integrative review of recruitment of research participants through Facebook. Nurs Res. 2019;68(6):423–32. doi: 10.1097/NNR.0000000000000385.00006199-201911000-00002 [DOI] [PubMed] [Google Scholar]
- 16.Kapse A, Patil V, Patil NV. E-recruitment. Int J Eng Adv Technol. 2012;1(4):82–6. https://docplayer.net/4474486-E-recruitment-avinash-s-kapse-vishal-s-patil-nikhil-v-patil.html . [Google Scholar]
- 17.Arnobit CI, Loo K, Pagano I, Uchiyama M, Fukui J, Braun-Inglis C, Bantum EO. Recruiting cancer survivors to a mobile mindfulness intervention in the United States: exploring online and face-to-face recruitment strategies. Int J Environ Res Public Health. 2021 Sep 27;18(19):10136. doi: 10.3390/ijerph181910136. https://www.mdpi.com/resolver?pii=ijerph181910136 .ijerph181910136 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Moreno MA, Waite A, Pumper M, Colburn T, Holm M, Mendoza J. Recruiting adolescent research participants: in-person compared to social media approaches. Cyberpsychol Behav Soc Netw. 2017 Jan;20(1):64–7. doi: 10.1089/cyber.2016.0319. [DOI] [PubMed] [Google Scholar]
- 19.Robinson JL, Fuerch JH, Winiewicz DD, Salvy SJ, Roemmich JN, Epstein LH. Cost effectiveness of recruitment methods in an obesity prevention trial for young children. Prev Med. 2007 Jun;44(6):499–503. doi: 10.1016/j.ypmed.2007.03.004. http://europepmc.org/abstract/MED/17475318 .S0091-7435(07)00096-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Salvy S, Carandang K, Vigen CL, Concha-Chavez A, Sequeira PA, Blanchard J, Diaz J, Raymond J, Pyatak EA. Effectiveness of social media (Facebook), targeted mailing, and in-person solicitation for the recruitment of young adult in a diabetes self-management clinical trial. Clin Trials. 2020 Dec;17(6):664–74. doi: 10.1177/1740774520933362. http://europepmc.org/abstract/MED/32627589 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Huynh L, Johns B, Liu S, Vedula SS, Li T, Puhan MA. Cost-effectiveness of health research study participant recruitment strategies: a systematic review. Clin Trials. 2014 Oct;11(5):576–83. doi: 10.1177/1740774514540371.1740774514540371 [DOI] [PubMed] [Google Scholar]
- 22.Shozi N, Mtsweni J. Big data privacy in social media sites. Proceedings of the 2017 IST-Africa Week Conference (IST-Africa); 2017 IST-Africa Week Conference (IST-Africa); May 30-Jun 02, 2017; Windhoek, Namibia. 2017. [DOI] [Google Scholar]
- 23.Custers B, van der Hof S, Schermer B, Appleby-Arnold S, Brockdorff N. Informed consent in social media use – the gap between user expectations and EU personal data protection law. scrip. 2013 Dec 17;10(4):435–57. doi: 10.2966/scrip.100413.435. [DOI] [Google Scholar]
- 24.Hunter RF, Gough A, O'Kane N, McKeown G, Fitzpatrick A, Walker T, McKinley M, Lee M, Kee F. Ethical issues in social media research for public health. Am J Public Health. 2018 Mar;108(3):343–8. doi: 10.2105/AJPH.2017.304249. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Narayanan A, Shmatikov V. De-anonymizing social networks. Proceedings of the 2009 30th IEEE Symposium on Security and Privacy; 2009 30th IEEE Symposium on Security and Privacy; May 17-20, 2009; Oakland, CA, USA. 2009. [DOI] [Google Scholar]
- 26.Gelinas L, Pierce R, Winkler S, Cohen IG, Lynch HF, Bierer BE. Using social media as a research recruitment tool: ethical issues and recommendations. Am J Bioeth. 2017 Mar;17(3):3–14. doi: 10.1080/15265161.2016.1276644. http://europepmc.org/abstract/MED/28207365 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.QS World University Rankings: methodology. QS Top Universities. [2020-03-04]. https://www.topuniversities.com/subject-rankings/methodology .
- 28.Whittemore R, Knafl K. The integrative review: updated methodology. J Adv Nurs. 2005 Dec;52(5):546–53. doi: 10.1111/j.1365-2648.2005.03621.x.JAN3621 [DOI] [PubMed] [Google Scholar]
- 29.Badu E, O'Brien AP, Mitchell R. An integrative review on methodological considerations in mental health research - design, sampling, data collection procedure and quality assurance. Arch Public Health. 2019 Oct 10;77(1):37. doi: 10.1186/s13690-019-0363-z. https://archpublichealth.biomedcentral.com/articles/10.1186/s13690-019-0363-z .363 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Bold KW, Hanrahan TH, O'Malley SS, Fucito LM. Exploring the utility of web-based social media advertising to recruit adult heavy-drinking smokers for treatment. J Med Internet Res. 2016 May 18;18(5):e107. doi: 10.2196/jmir.5360. https://www.jmir.org/2016/5/e107/ v18i5e107 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Burgess JD, Kimble RM, Watt K, Cameron CM. The adoption of social media to recruit participants for the cool runnings randomized controlled trial in Australia. JMIR Res Protoc. 2017 Oct 24;6(10):e200. doi: 10.2196/resprot.8189. https://www.researchprotocols.org/2017/10/e200/ v6i10e200 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Burke-Garcia A, Mathew S. Leveraging social and digital media for participant recruitment: a review of methods from the Bayley Short Form Formative Study. J Clin Transl Sci. 2017 Jun 29;1(3):205–7. doi: 10.1017/cts.2017.9. http://europepmc.org/abstract/MED/29093968 .00009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Burrell ER, Pines HA, Robbie E, Coleman L, Murphy RD, Hess KL, Anton P, Gorbach PM. Use of the location-based social networking application GRINDR as a recruitment tool in rectal microbicide development research. AIDS Behav. 2012 Oct;16(7):1816–20. doi: 10.1007/s10461-012-0277-z. http://europepmc.org/abstract/MED/22851153 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Burton-Chase AM, Parker WM, Hennig K, Sisson F, Bruzzone LL. The use of social media to recruit participants with rare conditions: lynch syndrome as an example. JMIR Res Protoc. 2017 Jan 23;6(1):e12. doi: 10.2196/resprot.6066. https://www.researchprotocols.org/2017/1/e12/ v6i1e12 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Byaruhanga J, Tzelepis F, Paul C, Wiggers J, Byrnes E, Lecathelinais C. Cost per participant recruited from rural and remote areas into a smoking cessation trial via online or traditional strategies: observational study. J Med Internet Res. 2019 Nov 12;21(11):e14911. doi: 10.2196/14911. https://www.jmir.org/2019/11/e14911/ v21i11e14911 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Cahill TJ, Wertz B, Zhong Q, Parlato A, Donegan J, Forman R, Manot S, Wu T, Xu Y, Cummings JJ, Norkunas Cunningham T, Wang C. The search for consumers of web-based raw DNA interpretation services: using social media to target hard-to-reach populations. J Med Internet Res. 2019 Jul 30;21(7):e12980. doi: 10.2196/12980. https://www.jmir.org/2019/7/e12980/ v21i7e12980 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Carter-Harris L. Facebook targeted advertisement for research recruitment: a primer for nurse researchers. Appl Nurs Res. 2016 Nov;32:144–7. doi: 10.1016/j.apnr.2016.07.006.S0897-1897(16)30065-9 [DOI] [PubMed] [Google Scholar]
- 38.Cavallo D, Lim R, Ishler K, Pagano M, Perovsek R, Albert E, Koopman Gonzalez S, Trapl E, Flocke S. Effectiveness of social media approaches to recruiting young adult cigarillo smokers: cross-sectional study. J Med Internet Res. 2020 Jul 22;22(7):e12619. doi: 10.2196/12619. https://www.jmir.org/2020/7/e12619/ v22i7e12619 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Ahmed KL, Simon AR, Dempsey JR, Samaco RC, Goin-Kochel RP. Evaluating two common strategies for research participant recruitment into autism studies: observational study. J Med Internet Res. 2020 Sep 24;22(9):e16752. doi: 10.2196/16752. https://www.jmir.org/2020/9/e16752/ v22i9e16752 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Choi SH, Milne DN, Glozier N, Peters D, Harvey SB, Calvo RA. Using different Facebook advertisements to recruit men for an online mental health study: engagement and selection bias. Internet Interv. 2017 Jun;8(1):27–34. doi: 10.1016/j.invent.2017.02.002. https://linkinghub.elsevier.com/retrieve/pii/S2214-7829(16)30050-1 .S2214-7829(16)30050-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Chu JL, Snider CE. Use of a social networking web site for recruiting Canadian youth for medical research. J Adolesc Health. 2013 Jun;52(6):792–4. doi: 10.1016/j.jadohealth.2012.12.002.S1054-139X(12)00783-5 [DOI] [PubMed] [Google Scholar]
- 42.Close S, Smaldone A, Fennoy I, Reame N, Grey M. Using information technology and social networking for recruitment of research participants: experience from an exploratory study of pediatric Klinefelter syndrome. J Med Internet Res. 2013 Mar 19;15(3):e48. doi: 10.2196/jmir.2286. https://www.jmir.org/2013/3/e48/ v15i3e48 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Cowie JM, Gurney ME. The use of Facebook advertising to recruit healthy elderly people for a clinical trial: baseline metrics. JMIR Res Protoc. 2018 Jan 24;7(1):e20. doi: 10.2196/resprot.7918. https://www.researchprotocols.org/2018/1/e20/ v7i1e20 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Derrick JL, Eliseo-Arras RK, Hanny C, Britton M, Haddad S. Comparison of internet and mailing methods to recruit couples into research on unaided smoking cessation. Addict Behav. 2017 Dec;75:12–6. doi: 10.1016/j.addbeh.2017.06.012. http://europepmc.org/abstract/MED/28662435 .S0306-4603(17)30234-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Dunn PH, Woo BK. Facebook recruitment of Chinese-speaking participants for hypertension education. J Am Soc Hypertens. 2018 Sep;12(9):690–2. doi: 10.1016/j.jash.2018.06.017.S1933-1711(18)30196-7 [DOI] [PubMed] [Google Scholar]
- 46.Fenner Y, Garland SM, Moore EE, Jayasinghe Y, Fletcher A, Tabrizi SN, Gunasekaran B, Wark JD. Web-based recruiting for health research using a social networking site: an exploratory study. J Med Internet Res. 2012 Feb 01;14(1):e20. doi: 10.2196/jmir.1978. https://www.jmir.org/2012/1/e20/ v14i1e20 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Ford KL, Albritton T, Dunn TA, Crawford K, Neuwirth J, Bull S. Youth study recruitment using paid advertising on Instagram, Snapchat, and Facebook: cross-sectional survey study. JMIR Public Health Surveill. 2019 Oct 09;5(4):e14080. doi: 10.2196/14080. https://publichealth.jmir.org/2019/4/e14080/ v5i4e14080 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Frandsen M, Thow M, Ferguson SG. The effectiveness of social media (Facebook) compared with more traditional advertising methods for recruiting eligible participants to health research studies: a randomized, controlled clinical trial. JMIR Res Protoc. 2016 Aug 10;5(3):e161. doi: 10.2196/resprot.5747. https://www.researchprotocols.org/2016/3/e161/ v5i3e161 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Ahmed N, Jayasinghe Y, Wark JD, Fenner Y, Moore EE, Tabrizi SN, Fletcher A, Garland SM. Attitudes to Chlamydia screening elicited using the social networking site Facebook for subject recruitment. Sex Health. 2013 Jul;10(3):224–8. doi: 10.1071/SH12198.SH12198 [DOI] [PubMed] [Google Scholar]
- 50.Frandsen M, Walters J, Ferguson SG. Exploring the viability of using online social media advertising as a recruitment method for smoking cessation clinical trials. Nicotine Tob Res. 2014 Feb;16(2):247–51. doi: 10.1093/ntr/ntt157.ntt157 [DOI] [PubMed] [Google Scholar]
- 51.Gilligan C, Kypri K, Bourke J. Social networking versus facebook advertising to recruit survey respondents: a quasi-experimental study. JMIR Res Protoc. 2014 Sep 17;3(3):e48. doi: 10.2196/resprot.3317. https://www.researchprotocols.org/2014/3/e48/ v3i3e48 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Gioia CJ, Sobell LC, Sobell MB, Agrawal S. Craigslist versus print newspaper advertising for recruiting research participants for alcohol studies: cost and participant characteristics. Addict Behav. 2016 Mar;54:24–32. doi: 10.1016/j.addbeh.2015.11.008. http://europepmc.org/abstract/MED/26675247 .S0306-4603(15)30059-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Gorman JR, Roberts SC, Dominick SA, Malcarne VL, Dietz AC, Su HI. A diversified recruitment approach incorporating social media leads to research participation among young adult-aged female cancer survivors. J Adolesc Young Adult Oncol. 2014 Jun 01;3(2):59–65. doi: 10.1089/jayao.2013.0031. http://europepmc.org/abstract/MED/24940529 .10.1089/jayao.2013.0031 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Guthrie KA, Caan B, Diem S, Ensrud KE, Greaves SR, Larson JC, Newton KM, Reed SD, LaCroix AZ. Facebook advertising for recruitment of midlife women with bothersome vaginal symptoms: a pilot study. Clin Trials. 2019 Oct;16(5):476–80. doi: 10.1177/1740774519846862. http://europepmc.org/abstract/MED/31055949 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Harris ML, Loxton D, Wigginton B, Lucke JC. Recruiting online: lessons from a longitudinal survey of contraception and pregnancy intentions of young Australian women. Am J Epidemiol. 2015 May 15;181(10):737–46. doi: 10.1093/aje/kwv006.kwv006 [DOI] [PubMed] [Google Scholar]
- 56.Hsiao Y, Lee I, Lin T, Liao C, Lee C, Ku W, Huang S, Yu C, Liu Z, Chiu Y, Lin Y, Chen N. Demographic differences in people living with HIV according to recruitment sources: comparison between health-care systems and social media networks. AIDS Care. 2020 Jul 18;32(7):901–6. doi: 10.1080/09540121.2019.1668524. [DOI] [PubMed] [Google Scholar]
- 57.Iott BE, Veinot TC, Loveluck J, Kahle E, Golson L, Benton A. Comparative analysis of recruitment strategies in a study of men who have sex with men (MSM) in metropolitan Detroit. AIDS Behav. 2018 Jul 22;22(7):2296–311. doi: 10.1007/s10461-018-2071-z.10.1007/s10461-018-2071-z [DOI] [PubMed] [Google Scholar]
- 58.Juraschek SP, Plante TB, Charleston J, Miller ER, Yeh H, Appel LJ, Jerome GJ, Gayles D, Durkin N, White K, Dalcin A, Hermosilla M. Use of online recruitment strategies in a randomized trial of cancer survivors. Clin Trials. 2018 Apr;15(2):130–8. doi: 10.1177/1740774517745829. http://europepmc.org/abstract/MED/29361843 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Kapp JM, Peters C, Oliver DP. Research recruitment using Facebook advertising: big potential, big challenges. J Cancer Educ. 2013 Mar;28(1):134–7. doi: 10.1007/s13187-012-0443-z. [DOI] [PubMed] [Google Scholar]
- 60.Akers L, Gordon JS. Using Facebook for large-scale online randomized clinical trial recruitment: effective advertising strategies. J Med Internet Res. 2018 Nov 08;20(11):e290. doi: 10.2196/jmir.9372. https://www.jmir.org/2018/11/e290/ v20i11e290 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Kelleher E, Moreno M, Wilt MP. Recruitment of participants and delivery of online mental health resources for depressed individuals using Tumblr: pilot randomized control trial. JMIR Res Protoc. 2018 Apr 12;7(4):e95. doi: 10.2196/resprot.9421. https://www.researchprotocols.org/2018/4/e95/ v7i4e95 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Lohse B. Facebook is an effective strategy to recruit low-income women to online nutrition education. J Nutr Educ Behav. 2013;45(1):69–76. doi: 10.1016/j.jneb.2012.06.006.S1499-4046(12)00504-0 [DOI] [PubMed] [Google Scholar]
- 63.McCarthy E, Mazza D. Cost and effectiveness of using Facebook advertising to recruit young women for research: PREFER (contraceptive preferences study) experience. J Med Internet Res. 2019 Nov 29;21(11):e15869. doi: 10.2196/15869. https://www.jmir.org/2019/11/e15869/ v21i11e15869 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Musiat P, Winsall M, Orlowski S, Antezana G, Schrader G, Battersby M, Bidargaddi N. Paid and unpaid online recruitment for health interventions in young adults. J Adolesc Health. 2016 Dec;59(6):662–7. doi: 10.1016/j.jadohealth.2016.07.020.S1054-139X(16)30229-4 [DOI] [PubMed] [Google Scholar]
- 65.Nash EL, Gilroy D, Srikusalanukul W, Abhayaratna WP, Stanton T, Mitchell G, Stowasser M, Sharman JE. Facebook advertising for participant recruitment into a blood pressure clinical trial. J Hypertens. 2017 Dec;35(12):2527–31. doi: 10.1097/HJH.0000000000001477. [DOI] [PubMed] [Google Scholar]
- 66.Paige SR, Krieger JL. Recruitment in online research for COPD: leveraging social media and research registries. ERJ Open Res. 2019 Apr 08;5(2):00167-2018. doi: 10.1183/23120541.00167-2018. http://europepmc.org/abstract/MED/30972351 .00167-2018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Peñaherrera CA, Palacios M, Duarte MC, Santibáñez R, Tamariz L, Palacio A. Use of media for recruiting clinical research volunteers in Ecuador. Medwave. 2015 Dec 10;15(11):e6334. doi: 10.5867/medwave.2015.11.6334.e6334 [DOI] [PubMed] [Google Scholar]
- 68.Pozzar R, Hammer MJ, Underhill-Blazey M, Wright AA, Tulsky JA, Hong F, Gundersen DA, Berry DL. Threats of bots and other bad actors to data quality following research participant recruitment through social media: cross-sectional questionnaire. J Med Internet Res. 2020 Oct 07;22(10):e23021. doi: 10.2196/23021. https://www.jmir.org/2020/10/e23021/ v22i10e23021 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Ryan J, Lopian L, Le B, Edney S, Van Kessel G, Plotnikoff R, Vandelanotte C, Olds T, Maher C. It's not raining men: a mixed-methods study investigating methods of improving male recruitment to health behaviour research. BMC Public Health. 2019 Jun 24;19(1):814. doi: 10.1186/s12889-019-7087-4. https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-019-7087-4 .10.1186/s12889-019-7087-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Alley S, Jennings C, Plotnikoff RC, Vandelanotte C. An evaluation of web- and print-based methods to attract people to a physical activity intervention. JMIR Res Protoc. 2016 May 27;5(2):e94. doi: 10.2196/resprot.4826. https://www.researchprotocols.org/2016/2/e94/ v5i2e94 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Shaver LG, Khawer A, Yi Y, Aubrey-Bassler K, Etchegary H, Roebothan B, Asghari S, Wang PP. Using Facebook advertising to recruit representative samples: feasibility assessment of a cross-sectional survey. J Med Internet Res. 2019 Aug 19;21(8):e14021. doi: 10.2196/14021. https://www.jmir.org/2019/8/e14021/ v21i8e14021 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Subasinghe AK, Nguyen M, Wark JD, Tabrizi SN, Garland SM. Targeted Facebook advertising is a novel and effective method of recruiting participants into a human papillomavirus vaccine effectiveness study. JMIR Res Protoc. 2016 Jul 22;5(3):e154. doi: 10.2196/resprot.5679. https://www.researchprotocols.org/2016/3/e154/ v5i3e154 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Teo AR, Liebow SB, Chan B, Dobscha SK, Graham AL. Reaching those at risk for psychiatric disorders and suicidal ideation: Facebook advertisements to recruit military veterans. JMIR Ment Health. 2018 Jul 05;5(3):e10078. doi: 10.2196/10078. https://mental.jmir.org/2018/3/e10078/ v5i3e10078 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Thornton LK, Harris K, Baker A, Johnson M, Kay-Lambkin FJ. Recruiting for addiction research via Facebook. Drug Alcohol Rev. 2016 Jul;35(4):494–502. doi: 10.1111/dar.12305. [DOI] [PubMed] [Google Scholar]
- 75.Tsai W, Zavala D, Gomez S. Using the Facebook advertisement platform to Recruit Chinese, Korean, and Latinx Cancer survivors for psychosocial research: web-based survey study. J Med Internet Res. 2019 Jan 10;21(1):e11571. doi: 10.2196/11571. https://www.jmir.org/2019/1/e11571/ v21i1e11571 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Valdez RS, Guterbock TM, Thompson MJ, Reilly JD, Menefee HK, Bennici MS, Williams IC, Rexrode DL. Beyond traditional advertisements: leveraging Facebook's social structures for research recruitment. J Med Internet Res. 2014;16(10):e243. doi: 10.2196/jmir.3786. http://www.jmir.org/2014/10/e243/ v16i10e243 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.van Gelder MM, van de Belt TH, Engelen LJ, Hooijer R, Bredie SJ, Roeleveld N. Google AdWords and Facebook ads for recruitment of pregnant women into a prospective cohort study with long-term follow-up. Matern Child Health J. 2019 Oct;23(10):1285–91. doi: 10.1007/s10995-019-02797-2. http://europepmc.org/abstract/MED/31222599 .10.1007/s10995-019-02797-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Vial AC, Starks TJ, Parsons JT. Finding and recruiting the highest risk HIV-negative men who have sex with men. AIDS Educ Prev. 2014 Feb;26(1):56–67. doi: 10.1521/aeap.2014.26.1.56. http://europepmc.org/abstract/MED/24450278 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Wasilewski MB, Stinson JN, Webster F, Cameron JI. Using Twitter to recruit participants for health research: an example from a caregiving study. Health Informatics J. 2019 Dec 30;25(4):1485–97. doi: 10.1177/1460458218775158. https://journals.sagepub.com/doi/10.1177/1460458218775158?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub%3dpubmed . [DOI] [PubMed] [Google Scholar]
- 80.Arcia A. Facebook advertisements for inexpensive participant recruitment among women in early pregnancy. Health Educ Behav. 2014 Jun;41(3):237–41. doi: 10.1177/1090198113504414. http://europepmc.org/abstract/MED/24082026 .1090198113504414 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Watson NL, Mull KE, Heffner JL, McClure JB, Bricker JB. Participant recruitment and retention in remote eHealth intervention trials: methods and lessons learned from a large randomized controlled trial of two web-based smoking interventions. J Med Internet Res. 2018 Aug 24;20(8):e10351. doi: 10.2196/10351. https://www.jmir.org/2018/8/e10351/ v20i8e10351 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Wilkerson JM, Patankar P, Rawat SM, Simon Rosser B R, Shukla KM, Rhoton J, Ekstrand ML. Recruitment strategies of Indian men who have sex with men in the state of Maharashtra into an online survey. Int J Sex Health. 2016;28(3):221–7. doi: 10.1080/19317611.2016.1193079. http://europepmc.org/abstract/MED/27668029 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Wilkerson JM, Shenk JE, Grey JA, Simon Rosser B R, Noor SW. Recruitment strategies of methamphetamine-using men who have sex with men into an online survey. J Subst Use. 2015;20(1):33–7. doi: 10.3109/14659891.2013.868936. http://europepmc.org/abstract/MED/25642143 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Barney A, Rodriguez F, Schwarz EB, Reed R, Tancredi D, Brindis CD, Dehlendorf C, Tebb KP. Adapting to changes in teen pregnancy prevention research: social media as an expedited recruitment strategy. J Adolesc Health. 2021 Aug;69(2):349–53. doi: 10.1016/j.jadohealth.2020.12.140.S1054-139X(21)00010-0 [DOI] [PubMed] [Google Scholar]
- 85.Moseson H, Wollum A, Seymour JW, Zuniga C, Thompson T, Gerdts C. Comparison of Facebook, Google Ads, and Reddit for the recruitment of people who considered but did not obtain abortion care in the United States: cross-sectional survey. JMIR Form Res. 2021 Feb 24;5(2):e22854. doi: 10.2196/22854. https://formative.jmir.org/2021/2/e22854/ v5i2e22854 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Turner-McGrievy GM, Wilson MJ, Bailey S, Bernhart JA, Wilcox S, Frongillo EA, Murphy EA, Hutto B. Effective recruitment strategies for African-American men and women: the Nutritious Eating with Soul study. Health Educ Res. 2021 Apr 12;36(2):206–11. doi: 10.1093/her/cyab003. http://europepmc.org/abstract/MED/33582788 .6134829 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Harfield S, Elliott S, Ramsey L, Housen T, Ward J. Using social networking sites to recruit participants: methods of an online survey of sexual health, knowledge and behaviour of young South Australians. Aust N Z J Public Health. 2021 Aug 07;45(4):348–54. doi: 10.1111/1753-6405.13117. [DOI] [PubMed] [Google Scholar]
- 88.Lindsay AC, Valdez MJ, Pineda JA, Muñoz MA. Lessons learned from recruiting Latino fathers in child health research. Health Promot Pract. 2021 Jul 19;22(4):462–8. doi: 10.1177/1524839920963704. [DOI] [PubMed] [Google Scholar]
- 89.Spahrkäs SS, Looijmans A, Sanderman R, Hagedoorn M. Recruiting participants for an international mHealth study via Facebook Ads: experiences from the Untire App RCT. Internet Interv. 2021 Mar;23:100362. doi: 10.1016/j.invent.2021.100362. https://linkinghub.elsevier.com/retrieve/pii/S2214-7829(21)00002-6 .S2214-7829(21)00002-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Grov C, Ventuneac A, Rendina HJ, Jimenez RH, Parsons JT. Recruiting men who have sex with men on Craigslist.org for face-to-face assessments: implications for research. AIDS Behav. 2013 Feb 17;17(2):773–8. doi: 10.1007/s10461-012-0345-4. http://europepmc.org/abstract/MED/23073646 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Bennetts SK, Hokke S, Crawford S, Hackworth NJ, Leach LS, Nguyen C, Nicholson JM, Cooklin AR. Using paid and free Facebook methods to recruit Australian parents to an online survey: an evaluation. J Med Internet Res. 2019 Mar 06;21(3):e11206. doi: 10.2196/11206. https://www.jmir.org/2019/3/e11206/ v21i3e11206 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Blumenberg C, Menezes AM, Gonçalves H, Assunção MC, Wehrmeister FC, Barros AJ. How different online recruitment methods impact on recruitment rates for the web-based coortesnaweb project: a randomised trial. BMC Med Res Methodol. 2019 Jun 19;19(1):127. doi: 10.1186/s12874-019-0767-z. https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-019-0767-z .10.1186/s12874-019-0767-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Akard TF, Wray S, Gilmer MJ. Facebook advertisements recruit parents of children with cancer for an online survey of web-based research preferences. Cancer Nurs. 2015;38(2):155–61. doi: 10.1097/NCC.0000000000000146. http://europepmc.org/abstract/MED/24945264 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 94.Herbell K, Zauszniewski JA. Facebook or Twitter?: effective recruitment strategies for family caregivers. Appl Nurs Res. 2018 Jun;41:1–4. doi: 10.1016/j.apnr.2018.02.004.S0897-1897(17)30605-5 [DOI] [PubMed] [Google Scholar]
- 95.Jones R, Lacroix LJ, Porcher E. Facebook advertising to recruit young, urban women into an HIV prevention clinical trial. AIDS Behav. 2017 Nov;21(11):3141–53. doi: 10.1007/s10461-017-1797-3. http://europepmc.org/abstract/MED/28528463 .10.1007/s10461-017-1797-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Stuart WP, Moore B. Evidence-based Facebook recruitment of study participants. Comput Inform Nurs. 2021 Mar 29;39(7):355–61. doi: 10.1097/CIN.0000000000000709.00024665-202107000-00004 [DOI] [PubMed] [Google Scholar]
- 97.Cho E, Gilmer MJ, Friedman DL, Hendricks-Ferguson VL, Hinds PS, Akard TF. Facebook recruitment for children with advanced cancer and their parents: lessons from a web-based pediatric palliative intervention study. Prog Palliat Care. 2021 Mar 29;29(5):264–71. doi: 10.1080/09699260.2021.1898077. http://europepmc.org/abstract/MED/34737490 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Avery-Desmarais SL, McCurry MK, Sethares KA, Batchelder A, Stover C. Internet recruitment of a diverse population of lesbian, gay, and bisexual nurses in a study of substance use and minority stress. J Transcult Nurs. 2022 Jan 27;33(1):118–25. doi: 10.1177/10436596211042071. [DOI] [PubMed] [Google Scholar]
- 99.Bethel C, Rainbow JG, Dudding KM. Recruiting nurses via social media for survey studies. Nurs Res. 2021;70(3):231–5. doi: 10.1097/NNR.0000000000000482.00006199-202105000-00010 [DOI] [PubMed] [Google Scholar]
- 100.Leighton K, Kardong-Edgren S, Schneidereith T, Foisy-Doll C. Using social media and snowball sampling as an alternative recruitment strategy for research. Clin Simulation Nursing. 2021 Jun;55:37–42. doi: 10.1016/j.ecns.2021.03.006. [DOI] [Google Scholar]
- 101.Smith J, Brown K, Hutchings M, Merwin E. Strategies for recruiting and retaining nurses for rural hospital closure research. Online J Rural Nurs Heal Care. 2021 Dec;21(2):14–43. doi: 10.14574/ojrnhc.v21i2.682. [DOI] [Google Scholar]
- 102.Jones R, Lacroix LJ, Nolte K. "Is your man stepping out?" an online pilot study to evaluate acceptability of a guide-enhanced HIV prevention soap opera video series and feasibility of recruitment by Facebook advertising. J Assoc Nurses AIDS Care. 2015;26(4):368–86. doi: 10.1016/j.jana.2015.01.004. http://europepmc.org/abstract/MED/26066692 .S1055-3290(15)00030-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 103.Amerson R. Facebook: a tool for nursing education research. J Nurs Educ. 2011 Jul;50(7):414–6. doi: 10.3928/01484834-20110331-01. [DOI] [PubMed] [Google Scholar]
- 104.O'Connor A, Jackson L, Goldsmith L, Skirton H. Can I get a retweet please? Health research recruitment and the Twittersphere. J Adv Nurs. 2014 Mar;70(3):599–609. doi: 10.1111/jan.12222. [DOI] [PubMed] [Google Scholar]
- 105.Stokes Y, Vandyk A, Squires J, Jacob J, Gifford W. Using Facebook and Linkedin to recruit nurses for an online survey. West J Nurs Res. 2019 Jan 07;41(1):96–110. doi: 10.1177/0193945917740706. [DOI] [PubMed] [Google Scholar]
- 106.Waltman NL, Smith KM, Kupzyk KA, Lappe JM, Mack LR, Bilek LD. Approaches to recruitment of postmenopausal women for a community-based study. Nurs Res. 2019;68(4):307–16. doi: 10.1097/NNR.0000000000000356. http://europepmc.org/abstract/MED/30829836 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 107.Williamson GR, O'Connor A, Chamberlain C, Halpin D. mHealth resources for asthma and pregnancy care: methodological issues and social media recruitment. A discussion paper. J Adv Nurs. 2018 Oct 17;74(10):2442–9. doi: 10.1111/jan.13773. [DOI] [PubMed] [Google Scholar]
- 108.Wilson RL, Usher K. Social media as a recruitment strategy: using Twitter to explore young people's mental health. Nurse Res. 2017 Dec 18;25(3):36–41. doi: 10.7748/nr.2017.e1478.8 [DOI] [PubMed] [Google Scholar]
- 109.Chambers M, Bliss K, Rambur B. Recruiting research participants via traditional snowball vs Facebook advertisements and a website. West J Nurs Res. 2020 Oct 02;42(10):846–51. doi: 10.1177/0193945920904445. [DOI] [PubMed] [Google Scholar]
- 110.Child RJ, Mentes JC, Pavlish C, Phillips LR. Using Facebook and participant information clips to recruit emergency nurses for research. Nurse Res. 2014 Jul;21(6):16–21. doi: 10.7748/nr.21.6.16.e1246. [DOI] [PubMed] [Google Scholar]
- 111.Chung S, Hacker ED, Rawl S, Ellis R, Bakas T, Jones J, Welch J. Using Facebook in recruiting kidney transplant recipients for a REDCap study. West J Nurs Res. 2019 Dec;41(12):1790–812. doi: 10.1177/0193945919832600. [DOI] [PubMed] [Google Scholar]
- 112.Corey KL, McCurry MK, Sethares KA, Bourbonniere M, Hirschman KB, Meghani SH. Utilizing internet-based recruitment and data collection to access different age groups of former family caregivers. Appl Nurs Res. 2018 Dec;44:82–7. doi: 10.1016/j.apnr.2018.10.005. http://europepmc.org/abstract/MED/30389065 .S0897-1897(18)30397-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 113.Desroches ML. Facebook recruitment of nurses as research participants: methodological considerations. Appl Nurs Res. 2020 Aug;54:151282. doi: 10.1016/j.apnr.2020.151282.S0897-1897(19)30828-6 [DOI] [PubMed] [Google Scholar]
- 114.Hansen D, Sheehan DK, Stephenson P. Family caregiver recruitment via social media: challenges, opportunities and lessons. Int J Palliat Nurs. 2017 Feb 02;23(2):84–7. doi: 10.12968/ijpn.2017.23.2.84. [DOI] [PubMed] [Google Scholar]
- 115.Herbell K. Using Facebook to recruit pregnant women for research. Nurs Res. 2019;68(3):242–5. doi: 10.1097/NNR.0000000000000353.00006199-201905000-00009 [DOI] [PubMed] [Google Scholar]
- 116.CASP - Critical Appraisal Skills Programme. Casp Checklists. [2022-05-04]. https://casp-uk.net/casp-tools-checklists/
- 117.Carter-Harris L, Bartlett Ellis R, Warrick A, Rawl S. Beyond traditional newspaper advertisement: leveraging Facebook-targeted advertisement to recruit long-term smokers for research. J Med Internet Res. 2016 Jun 15;18(6):e117. doi: 10.2196/jmir.5502. https://www.jmir.org/2016/6/e117/ v18i6e117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 118.Curtis BL. Social networking and online recruiting for HIV research: ethical challenges. J Empir Res Hum Res Ethics. 2014 Feb;9(1):58–70. doi: 10.1525/jer.2014.9.1.58. http://europepmc.org/abstract/MED/24572084 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 119.Leach LS, Bennetts SK, Giallo R, Cooklin AR. Recruiting fathers for parenting research using online advertising campaigns: evidence from an Australian study. Child Care Health Dev. 2019 Nov 22;45(6):871–6. doi: 10.1111/cch.12698. [DOI] [PubMed] [Google Scholar]
- 120.Schwinn T, Hopkins J, Schinke SP, Liu X. Using Facebook ads with traditional paper mailings to recruit adolescent girls for a clinical trial. Addict Behav. 2017 Feb;65:207–13. doi: 10.1016/j.addbeh.2016.10.011. http://europepmc.org/abstract/MED/27835860 .S0306-4603(16)30367-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 121.Bender JL, Cyr AB, Arbuckle L, Ferris LE. Ethics and privacy implications of using the internet and social media to recruit participants for health research: a privacy-by-design framework for online recruitment. J Med Internet Res. 2017 Apr 06;19(4):e104. doi: 10.2196/jmir.7029. https://www.jmir.org/2017/4/e104/ v19i4e104 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 122.Kamp K, Herbell K, Magginis WH, Berry D, Given B. Facebook recruitment and the protection of human subjects. West J Nurs Res. 2019 Sep;41(9):1270–81. doi: 10.1177/0193945919828108. http://europepmc.org/abstract/MED/30729866 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 123.Bonevski B, Randell M, Paul C, Chapman K, Twyman L, Bryant J, Brozek I, Hughes C. Reaching the hard-to-reach: a systematic review of strategies for improving health and medical research with socially disadvantaged groups. BMC Med Res Methodol. 2014 Mar 25;14(1):42. doi: 10.1186/1471-2288-14-42. https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/1471-2288-14-42 .1471-2288-14-42 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 124.Sydor A. Conducting research into hidden or hard-to-reach populations. Nurse Res. 2013 Jan;20(3):33–7. doi: 10.7748/nr2013.01.20.3.33.c9495. [DOI] [PubMed] [Google Scholar]
- 125.How much does social media advertising cost? Strike Social. [2020-09-18]. https://strikesocial.com/blog/social-media-advertising-costs/
- 126.Stern MJ, Fordyce E, Hansen C, Heim Viox M, Michaels S, Schlissel A, Avripas S, Harper C, Johns M, Dunville R. Social media recruitment for a web survey of sexual and gender minority youth: an evaluation of methods used and resulting sample diversity. LGBT Health. 2020;7(8):448–56. doi: 10.1089/lgbt.2019.0311. [DOI] [PubMed] [Google Scholar]
- 127.Topolovec-Vranic J, Natarajan K. The use of social media in recruitment for medical research studies: a scoping review. J Med Internet Res. 2016 Nov 07;18(11):e286. doi: 10.2196/jmir.5698. https://www.jmir.org/2016/11/e286/ v18i11e286 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 128.Arigo D, Pagoto S, Carter-Harris L, Lillie SE, Nebeker C. Using social media for health research: methodological and ethical considerations for recruitment and intervention delivery. Digit Health. 2018;4:2055207618771757. doi: 10.1177/2055207618771757. https://journals.sagepub.com/doi/10.1177/2055207618771757?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub%3dpubmed .10.1177_2055207618771757 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 129.Im E, Chee W. An online forum as a qualitative research method: practical issues. Nurs Res. 2006;55(4):267–73. doi: 10.1097/00006199-200607000-00007. http://europepmc.org/abstract/MED/16849979 .00006199-200607000-00007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 130.Amon KL, Campbell AJ, Hawke C, Steinbeck K. Facebook as a recruitment tool for adolescent health research: a systematic review. Acad Pediatr. 2014;14(5):439–47.e4. doi: 10.1016/j.acap.2014.05.049.S1876-2859(14)00186-7 [DOI] [PubMed] [Google Scholar]
- 131.Frampton GK, Shepherd J, Pickett K, Griffiths G, Wyatt JC. Digital tools for the recruitment and retention of participants in randomised controlled trials: a systematic map. Trials. 2020 Jun 05;21(1):478. doi: 10.1186/s13063-020-04358-3. https://trialsjournal.biomedcentral.com/articles/10.1186/s13063-020-04358-3 .10.1186/s13063-020-04358-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 132.Park BK, Calamaro C. A systematic review of social networking sites: innovative platforms for health research targeting adolescents and young adults. J Nurs Scholarsh. 2013 Sep;45(3):256–64. doi: 10.1111/jnu.12032. [DOI] [PubMed] [Google Scholar]
- 133.Reaves AC, Bianchi DW. The role of social networking sites in medical genetics research. Am J Med Genet A. 2013 May;161A(5):951–7. doi: 10.1002/ajmg.a.35903. [DOI] [PubMed] [Google Scholar]
- 134.Whitaker C, Stevelink S, Fear N. The use of Facebook in recruiting participants for health research purposes: a systematic review. J Med Internet Res. 2017 Aug 28;19(8):e290. doi: 10.2196/jmir.7071. https://www.jmir.org/2017/8/e290/ v19i8e290 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 135.Jones J, Salazar LF. A review of HIV prevention studies that use social networking sites: implications for recruitment, health promotion campaigns, and efficacy trials. AIDS Behav. 2016 Nov 22;20(11):2772–81. doi: 10.1007/s10461-016-1342-9.10.1007/s10461-016-1342-9 [DOI] [PubMed] [Google Scholar]
- 136.Kane L. Usability for seniors: challenges and changes. Nielsen Norman Group. [2022-05-15]. https://www.nngroup.com/articles/usability-for-senior-citizens/
- 137.Hutto C, Bell C, Farmer S, Fausset C, Harley L, Nguyen J, Fain B. Social media gerontology: understanding social media usage among older adults. Web Intell Agent Syst. 2015 Apr 29;13(1):69–87. doi: 10.3233/web-150310. [DOI] [Google Scholar]
- 138.Lee B, Chen Y, Hewitt L. Age differences in constraints encountered by seniors in their use of computers and the internet. Comput Human Behav. 2011 May;27(3):1231–7. doi: 10.1016/j.chb.2011.01.003. [DOI] [Google Scholar]
- 139.Surdam J, Daly B, Fulton S, Margevicius S, Schluchter M, Flocke S, Manne S, Meropol NJ. Recruitment strategies for nurse enrollment in an online study. Nurs Res. 2020;69(1):69–73. doi: 10.1097/NNR.0000000000000393. http://europepmc.org/abstract/MED/31804433 . [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Top 10 Universities in Canada QS World University Rankings 2021.
Search strategy for keywords and subject headings of the search terms used in each database.
Characteristics of included studies.
Critical Appraisal Skills Program critical appraisal tools used to critically appraise and evaluate each of the included studies.
List of excluded studies.
Tentative guidelines to assist health sciences researchers in social media recruitment.