Abstract
Objectives
To identify studies that applied behavioural approaches to issues of recruitment and/or retention to trials; to describe these approaches; and to identify gaps for future research.
Design
Systematic mapping review of research undertaken in clinical trials within peer-reviewed sources. Review participants were individuals involved in clinical trials, including trial staff, participants, potential participants and former participants.
Data sources
MEDLINE, EMBASE, CINAHL, ERIC, PsycINFO, Web of Science and ASSIA from inception to 15 January 2020 with no date or language restrictions.
Eligibility criteria
Studies within the context of clinical trials reporting the barriers/facilitators to recruitment and retention, or developing/evaluating solutions to said barriers/facilitators, using a behavioural approach.
Results
31 articles were included. Recruitment-focused studies (n=22, 71%) represented the majority. Studies tended to focus on participant behaviours (n=22, 71%). Underserved populations (n=11, 35%) were a notable subset of studies. Most studies (n=23, 74%) were exploratory but those that evaluated interventions (n=8, 26%) often did so within underserved populations (n=6). A majority of studies (n=30, 97%) did not specify their behaviours consistent with guidelines from behavioural scientists. The most used approaches were social cognitive theory (n=8, 26%), the theory of planned behaviour (n=6, 19%) and the theoretical domains framework (n=5, 16%).
Conclusions
A range of behavioural approaches have been applied to recruitment and retention to trials. The multitude of recruitment research here is consistent with trials research generally and emphasises the need for research into retention. Authors report target behaviours minimally, which is not conducive to replication. Further research should build on lessons here, such as clearly specifying behaviours. Increased methodological rigour and transparency will lead to robust evidence bases and less research waste in poor recruitment and retention. Overall, trials informed by behavioural approaches promises to be efficient and more participant focused.
Keywords: clinical trials, recruitment, retention, behavioral sciences, health services research
Strengths and limitations of this study.
A strength of this mapping review is the use of a protocol to ensure it was conducted systematically and can be replicated.
The review has generated a database with relevant study data to allow further interrogation of this data in an accessible fashion.
Considerable effort was placed in qualifying approaches as behavioural through referencing past expert consensus along with the expertise of the review so as to capture as broad a scope of relevant approaches as possible.
Limitations include no formal quality appraisal of the included studies in their overall design or application of their behavioural approaches.
Introduction
Clinical trials are the backbone of evidence-based medicine, but they are complicated ventures.1 Two of the most persistent challenges when conducting trials are recruiting and retaining participants (ie, identifying potential participants, enrolling them and then keeping those enrolled on study until data collection is complete). Trials achieving prespecified recruitment targets range from 31% to 60% and nearly half of trials have a loss to follow-up of over 11%.2–4 Poor recruitment and retention have both scientific and ethical consequences, introducing uncertainty into the conduct and outputs of affected trials.2 5–8
As recruitment and retention are such pervasive issues, both have been identified as top priorities for methodological research aimed at improving them.9 Recruitment and retention encompass many behaviours (eg, approaching a patient about a trial, signing a consent form, returning a questionnaire) performed by multiple actors (eg, patients, doctors, nurses) at various locations (eg, in hospital, at home) and across different time points. Therefore, many of the questions that trials researchers have about what promotes or inhibits recruitment and retention are suitable for investigation through a behavioural approach. Behavioural theories provide a framework to understand what drives behaviour by defining key influences that contribute to that behaviour and how they interact.10 Those influences often include factors attributable to the individual (ie, beliefs, motivations, attitudes, capabilities) or to external influence (ie, relationships, environments, opportunities, resources).10–13 Investigations to understand a particular behaviour are looking to identify these influences and their relative contributions in driving the behaviour. Once researchers understand these relationships, they can then design strategies aimed at changing these behaviours.13 14
Potential strategies that target modifiable behaviours are likely to be complex interventions because of their interacting influences and, therefore, should be directed by the UK Medical Research Council guidance on developing such interventions through the use of theory.15 A theoretical underpinning to an intervention can assist in understanding how an intervention is likely to cause the desired change by specifying the mechanisms of action believed to bring about that change.13 14 16–18 Behavioural theory does so by specifying the influences that drive the behaviour and the contexts the behaviour is meant to be enacted in, which includes information on who, where, when and with whom an individual enacts it.18 19 By carrying through this level of specification from initial investigation through to intervention development, it is easier to identify if the intervention is working through the proposed mechanisms on the proposed target influences of the behaviour.16–18 This more systematic process, as opposed to atheoretical interventions that do not specify proposed mechanisms as thoroughly, allows for a clearer understanding of the content of an intervention and its efficacy.13 15–18 20 That understanding then allows for replication and subsequent evidence synthesis, as well as the adaptation of successful interventions to new contexts/behaviours.13 17 18 21
The extent to which behavioural approaches have been applied to understand and/or change the behaviours encompassed within recruitment and retention, however, is unclear. Thus, in order to establish the breadth of available literature on this application, we chose to conduct this review.
Rationale
The aim of this review was to identify examples of behavioural theory being used to guide explorations or develop interventions to address issues relevant to recruitment and retention to clinical trials. Our objectives were to generate a reproducible evidence base, identify gaps within the literature and inform future research.
Methods
To address the above aim, a systematic mapping review was conducted. A mapping review seeks to describe the state of knowledge for a given question within a topic of interest and presents results narratively to answer said question, assisted by figures and population of a database with included studies and their meta-data.22–24 The term ‘scoping review’ is often used interchangeably with the term mapping review due to their methodological similarities.24 This review is identified as a mapping review as the authors consider it to be slightly more focused in seeking to answer a question, rather than broadly identifying the extent of the topic in published literature, as scoping reviews aim to do.22–24 A protocol was designed to ensure the review was conducted in a systematic and transparent fashion to increase reproducibility.
Search strategy
A search strategy was developed by the lead author (TC) and an information scientist (PM). The search strategy used terms informed by the respective Cochrane reviews on recruitment and retention along with incorporating behavioural theory terms informed by a scoping review of behavioural theories across the social and behavioural sciences.6 8 10 The list of search terms and complete search strategy can be viewed in online supplemental appendix 1. We searched the following databases: MEDLINE, EMBASE, CINAHL, ERIC, PsycINFO, Web of Science and ASSIA. These databases were searched from inception to 15 January 2020 with no date or language restrictions.
bmjopen-2021-054854supp001.pdf (113.5KB, pdf)
Eligibility criteria
To be eligible for inclusion, the studies needed to:
Report the design, development and/or evaluation of behaviourally focussed recruitment/retention strategies (ie, explanatory studies).
Identify barriers/facilitators to recruitment/retention (ie, exploratory studies) through a behavioural approach (see below for further clarification on what constituted a behavioural approach).
Be set in the context of a clinical trial.
Exclusion
The following exclusion criteria were applied:
Studies that evaluated a recruitment/retention strategy that did not have an explicitly defined behavioural approach.
Studies that explored the challenges/solutions to poor recruitment/retention that did not use a behavioural approach to understand findings or develop strategy.
Studies that aimed to improve adherence to an intervention rather than completion of a trial.
Hypothetical trials without empirical data. Protocols were included when they described future studies that would generate empirical data.
Eligibility screening process
Citations and abstracts were collated and duplicates removed by PM and then migrated into RefWorks. The abstracts were screened independently by TC per the inclusion/exclusion criteria above. A select 10% of abstracts were divided and reviewed by members of the team (KG and HM) and any discrepancies were discussed between reviewers. Should an agreement still not have been reached, it was taken to a meeting of the full review team for further discussion. All full-text papers identified from the abstract screening process were reviewed independently by TC. Each team member (KG, HM, EMD and LL) reviewed a quarter of the total full texts to affirm eligibility. Any disagreements for inclusion were discussed with the full review team. Systematic reviews identified in abstract screening were hand-searched for additional papers. Similarly, eligible full texts had references hand-searched for potentially relevant papers. Conference abstracts that described potentially relevant research were assessed as to whether there were full, peer-reviewed papers available and these were screened as above.
Determination of the application of a behavioural approach
Eligible papers needed to report the use of a behavioural approach explicitly within the text through direct mention of a behavioural theory or of a model/framework that draws constructs from such theories. For the sake of clarity, the term ‘behavioural approach’ is used throughout this review to encompass behavioural theory and models/frameworks. Approaches reported in potentially eligible studies were first checked against a published list that had been developed through expert consensus and systematic search to identify theories of behaviour and behaviour change across social and behavioural sciences.10 Davis et al10 identified such theories and also provided a list of excluded approaches that were identified in their search but were agreed through expert consensus to not be behavioural. The lead author of this paper (TC) identified approaches in potentially eligible studies that were not referenced in the review by Davis et al10 but appeared to be applicable to the scope of our review (ie, targeting behaviours associated with recruitment/retention in trials).10 The lead author (TC) applied the following criteria to such approaches as applied in the Davis et al10 review:
The reported definition of theory: ‘a set of concepts and/or statements with specification of how phenomena relate to each other. Theory provides an organising description of a system that accounts for what is known, and explains and predicts phenomena’.10
The criteria that a behavioural approach would consider ‘individual behaviour as an outcome or part of the process leading to the outcome’ rather than exclusively at a group or community level.10 This idea provided the criteria that the approach had to be focusing on the individual, at least partly, when attempting to understand or alter recruitment/retention behaviour.
Additionally, although Davis et al10 did not include models/frameworks in their review, they still provided a definition for models/frameworks that was incorporated in our review. This definition was ‘organising structures of constructs that do not meet the definition of theory in that they do not offer predictions about how constructs relate to each other or allow prediction of outcomes’.10 As the scope of this review was broad, we decided to include models/frameworks when we could establish that they had been developed from theoretical constructs from behavioural theories. Approaches that did not meet the definition for theory were then assessed for inclusion as a model/framework. Decisions as to whether the approach identified in the potentially eligible studies qualified as behavioural were presented to the review team for consensus.
Data extraction
Data were extracted by TC with a select 20% sample assessed for quality by members of the review team (KG and HM). The data extraction form was developed from the template of the ‘Data collection form for intervention review—randomised control trials (RCTs) and non-RCTs’ of the Cochrane Handbook.25 It was amended to the needs of this review and is available in online supplemental appendix 2. The following summary data were extracted and summarised from each study: author details; year and journal of publication; country of origin; study type; study aim; sample size; behavioural approach reported; application of behavioural approach (ie, to develop intervention, to understand problem, to develop future strategy); patient and public involvement in the study and, where available, parent study context (eg, condition, trial design, intervention(s)). Data amenable to descriptive statistics were formatted into graphs. Other data were more amenable to narrative summaries to describe key points as well as to discuss similarities/differences between studies. Data from the extraction forms were collated into a database available in online supplemental appendix 3.
bmjopen-2021-054854supp002.pdf (150.1KB, pdf)
bmjopen-2021-054854supp003.pdf (53.8KB, pdf)
Behavioural specification
Included papers were assessed as to how authors specified the target behaviours of recruitment/retention and how these targets related to the chosen behavioural approach. Verbatim descriptions of how recruitment/retention were conceptualised were identified within the text by the lead author (TC) and were categorised as to whether they specified recruitment/retention broadly as their targets or further specified the targeted behaviours that comprise recruitment/retention. For example, a paper could give their aim as ‘understanding why participants enrol’, which is broad in that it can easily be broken down into further specific behaviours. In contrast, a specific behaviour could be reported as ‘understanding why participants do not return follow-up questionnaires to trial staff within designated follow-up windows’.
Patient and public involvement
Patients/the public were not involved in the design or conduct of this systematic review. It is not possible to disseminate the results of this review to the participants of the included studies.
Results
The results are summarised in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) diagram in figure 1.26 A total of 6495 articles were identified from the primary search after deduplication. An additional 10 articles were identified by handsearching. A manual deduplication through the RefWorks software removed 960 articles. A total of 5428 abstracts were excluded with 106 articles moving to full-text review. Of those full texts, 85 failed to meet inclusion criteria with details given in the PRISMA diagram. Thus, a total of 31 full-text articles were eligible for inclusion in the review and progressed to data extraction.
Study characteristics
Of the 31 included studies, the majority (n=22, 71%) were conducted in the USA with others in Canada (n=2, 7%), the Netherlands (n=2, 7%), the UK (n=2, 7%), Australia (n=1, 3%), Kenya (n=1, 3%) and Puerto Rico (n=1, 3%). Publications spanned from 1995 to 2020 with half (n=16, 52%) being published within the 5-year period between 2015 and 2020. Publications over time based on their origin can be seen in figure 2.
The host trials (ie, the trials that the reported studies were situated in/drew their populations from) were heterogenous in both phase and disease indication. Host trials ranged from early phase 1 trials through to late-stage phase 3 trials. A large subset of papers (n=21, 68%) did not explicitly report the phase of the host trial, instead opting to name the trial or disease area being investigated. Those that did explicitly mention their host trial’s phase (n=6, 19%) reported phase 1 (n=2), phase 3 (n=3) and ‘early phase’ (n=1). Other studies (n=4, 13%) that explicitly reported their host trial phase drew their populations from multiple trials. Many of the studies focused on cancer populations (n=11, 35%) with notable instances also within HIV/AIDS populations (n=5, 16%).
Study design
A majority of studies (n=23, 74%) were exploratory, looking to apply behavioural approaches to identify issues within recruitment/retention by assessing barriers/facilitators to their targets and predisposing characteristics of participants. They explored these barriers/facilitators through qualitative interviews and/or focus groups,27–39 intervention mapping,40 41 surveys/questionnaires,27 31 32 36 42–48 and secondary data analysis.49 These studies identified potential strategies to address these insights, some only suggesting directions for future research while others developed interventions but did not formally evaluate them. The remainder of studies (n=8, 26%) did report evaluation of interventions. Of those eight studies, six (19% of total studies) evaluated their interventions using randomised comparisons. These were either cluster randomised (at the level of trial centre (n=2) or peer recruiter (n=1)) or randomised at the level of individual participants (n=3). One study (3% of total studies) evaluated two interventions, one randomised at the level of participants and the other as a within-subject interrupted time series of clinicians. One study (3% of total studies) evaluated their intervention through a non-randomised pretest/post-test design at the level of participants.
Recruitment vs retention
Researchers have historically focused on recruitment over retention, with a greater proportion of studies exploring retention from 2010 onwards compared with the 15 years prior (figure 3). Overall, the studies showed a clear focus on the use of behavioural approaches to understand trial recruitment with 22 (71%) of the studies focusing solely on recruitment and a further three (10%) studies looking at both recruitment and retention (figure 4).
Target population
The target population was considered to be the group of individuals whose behaviour was being targeted by the behavioural approach. As seen in figure 5, included studies tended to investigate the behaviour of trial participants vs staff. A majority of articles (n=22, 71%) focused solely on trial participants with a further four (13%) studies addressing them at least partially. Some studies collected data from other populations that were not the target of the behavioural approach. For example, a study could aim to understand the behaviour of participants but explore the experiences of trial staff to inform their results.
Under-served populations
A notable subset of the papers (n=11, 35%) sought to apply behavioural approaches to understand, or develop solutions to, issues of recruitment/retention that affect ethnic minority groups and other groups underrepresented in trials. These groups will be referred to as ‘underserved groups’, per guidance from the INCLUDE project.50 The term is preferred by stakeholders, of which these groups are members, as it reflects that the groups are not at fault for their lack of representativeness and are similarly motivated to participate in trials as others.50 51 All 11 of these studies sought to address recruitment of underserved groups, five targeting only participants, four targeting both participants and trial staff, and two targeting only staff. Of these 11 papers that focused on under-served groups, seven involved trials in HIV/AIDS and cancers. This represented nearly half (n=7) of all studies that drew from these disease populations (n=16). Of the eight total studies (26% of total studies) that evaluated interventions in this review, six evaluated interventions aimed at increasing recruitment of under-served groups. Five of these evaluations utilised a randomised design.
Behavioural specification
Overall, 13 (42%) of the papers described their study targets broadly as recruitment/retention using language such as ‘enrolment’ or ‘participation’ in the host trial. These studies were often exploratory and sought to identify influences for participating in host trials generally without focusing on specific actions within participation. A majority of studies (n=18, 58%) included targets defined at the level of specific behaviours. Specific behaviours were defined as observable actions within the processes of recruitment/retention, such as attending a screening visit or completing follow-up questionnaires. Studies varied in the detail of description of these targets, with some focusing on the actions while others provided more information on their contexts (eg, time and place of action). However, only one paper35 made use of recommendations to specify information about their behavioural targets in a way consistent with recommendations from behavioural scientists.18
Application of behavioural approaches across included studies
The timing of the application of the behavioural approach, whether prospectively (ie, incorporated at the research question stage and study design), or retrospectively (ie, considered during analysis only as a mechanism to help understand the data) was assessed across all included studies. A majority of studies (n=24, 77%) had a clear prospective application of their behavioural approach while a smaller subset opted for a retrospective application (n=6), or a combination (n=1) (figure 6).
There was a range in the type of behavioural approaches applied, as can be seen in table 1. Most approaches (n=11, 69%) reported across the 31 included studies qualified as theory, per the definition utilised. Four approaches were considered models/frameworks. All models/frameworks are reported as described in table 1 and do not contribute to frequency counts of their component theories. Papers that used more than one theory but did not describe them as integrated into a model/framework were reported as individual theories (see table 1).
Table 1.
Approach name | Theory or model/framework | Inclusion criteria (for review team consensus) | Instances (first author, publication year) |
Behavioural Model of Health Services Use | Theory | Within Andersen (1995), the theory is described as being able to both predict and explain individual’s health services use. Predisposing factors to services use, and their relations to one another, are described. | Smith GC, 2016, Zapka J, 2014; Roche CC, 2012 |
CHOICES Conceptual Model | Model/Framework | The model was developed with Social Cognitive Theory and the Stages of Change Model. The model does not relate the factors that contribute to behaviour to one another. |
Chalela P, 2018 |
Capability, Opportunity, and Motivation Model of Behaviour (COM-B model)* | Theory | N/A | Fahim C, 2019 |
Goal Setting Theory* | Theory | N/A | Amorrortu RP, 2018, Tilley BC, 2017 |
Health Belief Model* | Theory | N/A | Nyaoke BA, 2017; Kinney AY, 1998; Verheggen FW, 1998, Yeomans-Kinney A, 1995; |
Health Promotion Model* | Theory | N/A | Sample DA, 2002 |
Model of Cancer Clinical Trial Decision making | Model/Framework | The model was developed using the Transtheoretical Model of Behaviour Change. The model does not relate factors the that contribute to behaviour to one another. | Wenzel JA, 2015 |
Rotter’s Social Learning Theory and Locus of Control | Theory | Included paper describes in detail the factors that this theory identifies as relevant to behaviour, how they interact, and how they can be used to predict behaviour. | Bradley JM, 2006 |
Self-regulation/Goal Theory | Theory | The included paper cited a review of theories as the source of what it called ‘self-regulation/goal theory’. However, no theories reported in this source matched this description. Instead, the authors of this review, who are also the authors of the included study, seem to describe an amalgamation of these theories. That description gave sufficient detail about factors that contribute to behaviour and how they relate to each other to predict behaviour. | Huisman S, 2010 |
Social Cognitive Theory/Social Learning theory* | Theory | N/A | Ortiz AP, 2019, Amorrortu RP, 2018, Tilley BC, 2017, Gwadz MV, 2010, Coday M, 2005, Bradley JM, 2006, Bowen D, 2000 Corbie-Smith G, 2012 |
Theoretical Domains Framework | Model/Framework | This framework is known to the authors and the cited sources confirmed that it is derived from several behavioural theories. | Gillies K, 2018; Ellis SD, 2019 Guillot M, 2019, Fahim C, 2019, Goulao B, 2020 |
Theory of Planned Behaviour/Reasoned action* | Theory | N/A | Manton KJ, 2019, Quinn GP, 2011; Kinney AY, 1998 Arriens C, 2020; Vandenburgh AM, 2000; Corbie-Smith G, 2012 |
Integrated Theoretical Model | Model/Framework | This model was developed using the Theory of Triadic Influence*. The model does not relate factors the that contribute to behaviour to one another. | Gwadz M, 2014 |
Transdisciplinary Theoretical Model | Theory | This theory describes individual attitudes and beliefs and how they interact to inform decisions of trial participation (behaviour). | Eggly S, 2017 |
Transtheoretical Model of Behaviour Change/Stages of Change Model* | Theory | N/A | Clark LT, 2019, Amorrortu RP, 2018, Tilley BC, 2017 |
*Referenced in Davis et al.10
N/A, Not applicable.
The most frequently reported behavioural approaches in the included studies were: social cognitive theory/social learning theory (n=8, 26%), the theory of planned behaviour (TPB)/reasoned action (n=6, 19%) and the theoretical domains framework (TDF) (n=5, 16%). Figure 7 provides detail on the frequency that each approach was used in understanding recruitment, retention or both. Summaries of each behavioural approach and its application in the included studies are presented below.
Social cognitive theory/social learning theory
Social cognitive theory (SCT), formerly social learning theory, was first advanced by Albert Bandura in 1986 and posits that human behaviour is influenced by personal, cognitive and environmental factors.52 Of the papers that used SCT, six focused on recruitment and two focused on retention. All six of the recruitment-focused papers were prospective in their application of SCT, as was one of the two retention-focused papers. Three papers40 41 53 applied intervention mapping to guide their design, implementation and evaluation, if applicable.54
Five of the SCT papers that focused on recruitment developed educational interventions delivered through video,55 web-conferencing40 53 or in-person sessions.40 41 53 56 Bradley46 did not develop an intervention, rather looking to identify whether participants chose to enter a clinical trial based on principles from SCT. Bowen et al57 designed incentives based on principles from SCT and randomly allocated participants to them. Coday et al27 compiled existing retention strategies, solicited from trial staff, into categories based on SCT principles.
TPB/theory of reasoned action
The TPB, an extension of the theory of reasoned action, was designed to predict and explain behaviour in specific contexts.58 It argues that behaviour can be predicted by measuring intentions, which are influenced by an individual’s attitudes, subjective norms and perceived behavioural control.58 Of the five papers that used the TPB, all did so prospectively. All five targeted recruitment, while two29 34 also targeted retention.
Quinn et al38 used the TPB to understand the decision-making process of those who enrolled in/declined a lung cancer trial. Kinney et al43 assessed the effect of clinician recommendation on participants’ decisions to enrol in/decline a chemoprevention trial. Vandenburgh47 queried participants about their decision to enrol in a glaucoma trial through a self-report survey along with assessing attitudes to see how those measures may inform decisions. Manton et al34 and Arriens et al29 both queried participants about their decisions to participate through interview or focus groups. Manton et al34 focused on healthy volunteers within phase 1 trials, while Arriens et al29 conducted focus groups with lupus patients.
Theoretical domains framework
The TDF was first articulated in 200559 with further refinement in 2012.60 It is an amalgamation of 128 explanatory constructs drawn from 33 psychological theories that were deemed relevant to understanding and changing the behaviour of healthcare professionals.59 60 The TDF was designed to simplify psychological theories relevant to behaviour change and to make it accessible to those looking to design or evaluate interventions.59 60 The five papers that used the TDF were distributed between recruitment (n=2) and retention (n=2), with one assessing both. All five papers applied the TDF prospectively with one also doing so retrospectively. All the papers reported qualitative interviews assessing barriers and facilitators to their target behaviours. Gillies et al,35 a study protocol, described a plan to assess the experiences of those who have dropped out of a trial and those who have considered dropping out through TDF-based interviews with the aim to develop interventions to address drop-out. Ellis et al28 conducted TDF-based interviews with rural urologists to identify barriers and strategies that would support them in discussing and referring patients to urological cancer trials. Guillot et al39 used TDF-based interviews to identify barriers and enablers for parents and neonatologists to enrol preterm infants in a future stem cell trial. Fahim et al31 analysed eligible participants surveyed as part of routine monitoring for their reasons for accepting/declining a surgical complication prophylaxis trial. Reported reasons were mapped to the TDF to identify mediators that influenced participants’ decisions.31 An intervention was then developed by mapping these TDF domains to the Capability, Opportunity, and Motivation Model of Behaviour (COM-B).31 Finally, Goulao et al61 evaluated three interventions designed to increase questionnaire response rates within a dental trial. The interventions were developed through mapping barriers to questionnaire return, elicited through trial staff interviews, to TDF domains.61
Discussion
This systematic mapping review reports how behavioural approaches have been utilised to understand or address issues of recruitment/retention to trials to date. A systematic mapping review was conducted due to the high degree of heterogeneity between study designs and populations, along with the understanding that different behavioural approaches were likely to structure results in notably distinct ways. Our search identified a larger evidence base than anticipated in both the quantity of papers and number of approaches. Much of the work to date has taken place within the USA with others spread across Europe, Africa and Australia. This is in contrast to the high volume of research on recruitment/retention that typically originates from the UK.6 8 The included studies drew their populations from a range of disease and clinical contexts with a focus on addressing recruitment/retention in underserved populations and for those with cancers or HIV/AIDS. Studies focusing on recruitment outnumbered retention and often focused on changing the behaviour of participants. Most studies were exploratory, some examining barriers while others developed recommendations for future strategies or interventions for further evaluation. Those studies that did evaluate interventions tended to be randomised by design.
Underserved populations, particularly ethnic minorities, were the target of a number of papers. These papers often reported specific barriers to underserved groups involved in trials. Disparities in the levels of accessibility of trials, whether geographic, socioeconomic or cultural, were described in most papers applying behavioural approaches to the recruitment/retention of underserved populations. Lasting tensions that have arisen from historical and current mistreatment of underserved groups at the hands of medical research were a recurrent theme discussed by participants in included studies as influencing their behaviours. One-third of the included studies reported behavioural approaches being applied to recruitment/retention of under-served populations. These results echo findings from a mapping review on digital interventions for recruitment/retention that found 16 studies (15% of their total included studies) addressing under-served populations.62 Their findings also showed that research in these populations is primarily recruitment focused.62 About half of the included papers that applied behavioural approaches and focused on underserved populations evaluated interventions, in randomised comparisons, meant to improve recruitment. This represented 75% of all included studies that were designed to evaluate an intervention. This is at odds with the Cochrane reviews on interventions to improve recruitment/retention to trials, which highlight that included studies are biased towards predominantly white population participants (where reported).6 8 Learning from these studies that apply behavioural approaches could be extended to the trials methodology community to encourage design and evaluation of interventions that aim to improve representativeness and access to research across populations, of which critical need has been identified.51 63 64
The review identified a larger number of applications, as well as a greater diversity of approaches, than anticipated. An impression by the team that there is a preoccupation with participant-focused recruitment research was affirmed by this review, with indications that retention is slowly being incorporated in the methodology research agenda. This reaffirmation has informed the development of a future project looking to better understand how staff behaviours influence retention and the potential ways that behaviour change techniques can modify these behaviours. We identified a breadth of behavioural approaches that informed research into recruitment/retention. These approaches and the key information extracted from the included papers have been populated to a database available in online supplemental appendix 3. This database serves to both supplement the results and to serve as a tool for other researchers to further investigate the data and extend its application beyond the scope of this review.
The most frequently used approaches in this review were SCT, the TPB and the TDF. SCT and TPB share many similarities in how they conceptualise behaviour but are subject to differences in how they describe the constructs and processes that contribute and predict it.52 58 The TDF was an attempt to consolidate such differences so that a common language could be employed when discussing behaviour and acknowledges the contributions of each theory.59 60 This review identified a total of 15 approaches, but the three approaches presented here are present in nearly two-thirds of the included papers. This shows a clear preference for these approaches in understanding and developing solutions to issues of recruitment/retention. Whether they present the most appropriate approaches to use, or represent those that are popularised, remains to be addressed. Potential reasons for their popularity may be that each of these three approaches have published manuals to aid in their implementation.65–68 Additionally, the TDF is explicitly linked to intervention development through the Behaviour Change Wheel, which guides selection of appropriate behaviour change techniques.14 17
Specification of behavioural targets in this review was informed largely by ideas from Martin Fishbein and Icek Ajzen69 and later refined into what is known as the Action, Actor, Context, Target, Time (AACTT) framework.18 However, virtually none of the papers made specific reference to such a framework. The papers ranged considerably in the amount of specificity in which they described their targets. A minority did so broadly at the level of the processes that are recruitment/retention. The remainder targeted specific behaviours within recruitment/retention but did not often tie them explicitly to the contexts in which they are embedded. Frameworks for specifying behaviour, such as the AACTT, can facilitate the design and evaluation of interventions. Specifying behaviour in detail facilitates the description of who needs to do what differently, understanding what may help or hinder them from doing so, how to address barriers, and how to determine if that support was effective.18 This also allows for a deeper connection between the behaviour under investigation and the theoretical constructs that may predict it.18 The papers that were not specific in their target behaviour were noticeably more difficult to understand how their behavioural approach informed their investigations. And finally, a clear specification of behaviour enables synthesis of what strategies are effective for particular behaviours.18 For these reasons, adherence to behaviour specification guidelines should be considered best practice for research that uses a behavioural approach.
Strengths and limitations
First, the review was intended to be accessible and transparent and was largely informed by methods from the Cochrane Handbook.25 This was achieved through the use of a protocol that established the systematic methods for the review and was made publicly available. This review has also generated a database as an accessible means for others to probe the results in greater detail.
The limitations of this review are shared with other mapping reviews, such as no formal quality assessment or assessment of applicability or usefulness of identified theories for trials methods research. The review team applied existing expert consensus on behavioural approaches and extended these criteria in order to be deliberately more inclusive to collate behavioural approaches beyond pure theories. It was outside the scope of this review to contact authors for further details in order to interrogate approaches that were not clearly linked to prespecified behavioural theories. Instead, every effort was made to reference the source material of the approach provided by authors and cross-reference that with the content of the papers themselves to reach an informed decision within the timeline of this review.
Conclusions
This review successfully identified how behavioural approaches have been applied to issues of recruitment and retention to trials. The evidence map generated through this review can inform a future research agenda around the behavioural specification of recruitment and retention problems in clinical trials and be used to inform the development of targeted solutions. This review has identified gaps in the research, especially in the reporting of these studies based on recommendations for good practice with regard to behaviour change. It is also important to consider how to maximise the potential of behavioural approaches to recruitment and retention of underserved populations and how this learning can be applied more broadly across trials. As behavioural science is poised as a means to systematically diagnose issues and develop solutions, the trials community will likely continue to see it being used to contribute to this evidence base. Overall, clinical trials have much to gain from behavioural approaches and their promise of a more efficient, and potentially participant focused, trial landscape.
Supplementary Material
Acknowledgments
We thank our information scientist, Paul Mason (PM), for his help in designing and implementing the search for this review.
Footnotes
Twitter: @LawrieLouisa, @GilliesKatie
Contributors: TC was responsible for the overall conduct of the review and is responsible for the overall content as guarantor. The guarantor accepts full responsibility for the finished work and/or the conduct of the study, had access to the data, and controlled the decision to publish. TC screened abstracts, extracted data, designed figures and tables, and was the main author of the work. KG and HM screened a select percentage of abstracts for quality assessment and also assessed a select sample of data extraction for quality. LL, KG, EMD and HM provided supervision and expertise in the formulation of the review, independently screened full texts to affirm eligibility and provided ongoing support through revisions.
Funding: The publication cost of this review was supported by the John Shivas Young Researchers Fund. Further support was provided by the Chief Scientist Office of the Scottish Government Health and Social Care Directorates (Grant number CZU/3/3).
Competing interests: None declared.
Provenance and peer review: Not commissioned; externally peer reviewed.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
Data availability statement
Data are available on reasonable request. All data relevant to the study are included in the article or uploaded as online supplemental information. All data relevant to the study findings are included in the article. Select data for included studies are available in the review database located in online supplemental files for this paper. Other data available on reasonable request from the corresponding author.
Data availability statement
All data relevant to the study findings are included in the article. Select data for included studies are available in the review database located in the Supplementary files for this paper. Other data available on reasonable request from the corresponding author. All data relevant to the study findings are included in the article. Select data for included studies are available in the review database located in online supplemental files for this paper. Other data available on reasonable request from the corresponding author.
Ethics statements
Patient consent for publication
Not applicable.
Ethics approval
Ethics approval not sought as no participants involved.
References
- 1.Pawlik T, Sosa J, eds. Clinical Trials. Springer International Publishing, 2020. [Google Scholar]
- 2.Walsh M, Devereaux PJ, Sackett DL. Clinician trialist rounds: 28. when RCT participants are lost to follow-up. Part 1: why even a few can matter. Clin Trials 2015;12:537–9. 10.1177/1740774515597702 [DOI] [PubMed] [Google Scholar]
- 3.Walters SJ, Bonacho Dos Anjos Henriques-Cadby I, Bortolami O, et al. Recruitment and retention of participants in randomised controlled trials: a review of trials funded and published by the United Kingdom health technology assessment programme. BMJ Open 2017;7:e015276:2016–15276. 10.1136/bmjopen-2016-015276 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Campbell M, Snowdon C, Francis D, et al. Recruitment to randomised trials: strategies for trial enrolment and participation study. The steps study. Health Technol Assess 2007;11:iii, ix–105. 10.3310/hta11480 [DOI] [PubMed] [Google Scholar]
- 5.Halpern SD, Karlawish JHT, Berlin JA. The continuing unethical conduct of underpowered clinical trials. JAMA 2002;288:358–62. 10.1001/jama.288.3.358 [DOI] [PubMed] [Google Scholar]
- 6.Gillies K, Kearney A, Keenan C, et al. Strategies to improve retention in randomised trials. Cochrane Database Syst Rev 2021;3:MR000032. 10.1002/14651858.MR000032.pub3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Walsh M, Srinathan SK, McAuley DF, et al. The statistical significance of randomized controlled trial results is frequently fragile: a case for a fragility index. J Clin Epidemiol 2014;67:622–8. 10.1016/j.jclinepi.2013.10.019 [DOI] [PubMed] [Google Scholar]
- 8.Treweek S, Pitkethly M, Cook J, et al. Strategies to improve recruitment to randomised trials. Cochrane Database Syst Rev 2018;2:MR000013. 10.1002/14651858.MR000013.pub6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Tudur Smith C, Hickey H, Clarke M, et al. The trials methodological research agenda: results from a priority setting exercise. Trials 2014;15:6215–32. 10.1186/1745-6215-15-32 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Davis R, Campbell R, Hildon Z, et al. Theories of behaviour and behaviour change across the social and behavioural sciences: a scoping review. Health Psychol Rev 2015;9:323–44. 10.1080/17437199.2014.941722 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Kwasnicka D, Dombrowski SU, White M, et al. Theoretical explanations for maintenance of behaviour change: a systematic review of behaviour theories. Health Psychol Rev 2016;10:277–96. 10.1080/17437199.2016.1151372 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Francis JJ, O'Connor D, Curran J. Theories of behaviour change synthesised into a set of theoretical groupings: introducing a thematic series on the theoretical domains framework. Implement Sci 2012;7:35. 10.1186/1748-5908-7-35 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Gitlin LN, Czaja SJ. Behavioral intervention research: designing, evaluating, and implementing. New York, NY, US: Springer Publishing Company, 2016. [Google Scholar]
- 14.Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci 2011;6:42. 10.1186/1748-5908-6-42 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Craig P, Dieppe P, Macintyre S, et al. Developing and evaluating complex interventions: the new medical Research Council guidance. BMJ 2008;337:a1655. 10.1136/bmj.a1655 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Carey RN, Connell LE, Johnston M, et al. Behavior change techniques and their mechanisms of action: a synthesis of links described in published intervention literature. Ann Behav Med 2019;53:693–707. 10.1093/abm/kay078 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Michie S, Atkins L, West R. The Behaviour Change Wheel: A Guide to Designing Interventions. London: Silverback Publishing, 2014. [Google Scholar]
- 18.Presseau J, McCleary N, Lorencatto F, et al. Action, actor, context, target, time (AACTT): a framework for specifying behaviour. Implement Sci 2019;14:019–951. 10.1186/s13012-019-0951-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Michie S, Johnston M. Changing clinical behaviour by making guidelines specific. BMJ 2004;328:343–5. 10.1136/bmj.328.7435.343 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Michie S. Designing and implementing behaviour change interventions to improve population health. J Health Serv Res Policy 2008;13 Suppl 3:64–9. 10.1258/jhsrp.2008.008014 [DOI] [PubMed] [Google Scholar]
- 21.Michie S, Fixsen D, Grimshaw JM, et al. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci 2009;4:40. 10.1186/1748-5908-4-40 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Clapton J, Rutter D, Sharif N. SCIE systematic mapping guidance, 2009
- 23.James KL, Randall NP, Haddaway NR. A methodology for systematic mapping in environmental sciences. Environ Evid 2016;5:7. 10.1186/s13750-016-0059-6 [DOI] [Google Scholar]
- 24.Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J 2009;26:91–108. 10.1111/j.1471-1842.2009.00848.x [DOI] [PubMed] [Google Scholar]
- 25.Cochrane Handbook for systematic reviews of interventions: cochrane, 2020
- 26.Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med 2018;169:467–73. 10.7326/M18-0850 [DOI] [PubMed] [Google Scholar]
- 27.Coday M, Boutin-Foster C, Goldman Sher T, et al. Strategies for retaining study participants in behavioral intervention trials: retention experiences of the NIH behavior change Consortium. Ann Behav Med 2005;29 Suppl:55–65. 10.1207/s15324796abm2902s_9 [DOI] [PubMed] [Google Scholar]
- 28.Ellis S, Geana M, Griebling T, et al. Development, acceptability, appropriateness and appeal of a cancer clinical trials implementation intervention for rural- and minority-serving urology practices. Trials 2019;20:578. 10.1186/s13063-019-3658-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Arriens C, Aberle T, Carthen F, et al. Lupus patient decisions about clinical trial participation: a qualitative evaluation of perceptions, facilitators and barriers. Lupus Sci Med 2020;7:e000360–360. 10.1136/lupus-2019-000360 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Zapka J, Amella E, Magwood G, et al. Challenges in efficacy research: the case of feeding alternatives in patients with dementia. J Adv Nurs 2014;70:2072–85. 10.1111/jan.12365 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Fahim C, Hylton D, Simunovic M, et al. Development of the IRIS-AR strategy: an intervention to improve rates of accrual and retention for the VTE-PRO randomized controlled trial. Trials 2019;20:447. 10.1186/s13063-019-3536-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Smith GC, Strieder F, Greenberg P, et al. Patterns of enrollment and engagement of custodial grandmothers in a randomized clinical trial of psychoeducational interventions. Fam Relat 2016;65:369–86. 10.1111/fare.12194 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Clark LT, Watkins L, Piña IL, et al. Increasing diversity in clinical trials: overcoming critical barriers. Curr Probl Cardiol 2019;44:148–72. 10.1016/j.cpcardiol.2018.11.002 [DOI] [PubMed] [Google Scholar]
- 34.Manton KJ, Gauld CS, White KM, et al. Qualitative study investigating the underlying motivations of healthy participants in phase I clinical trials. BMJ Open 2019;9:e024224. 10.1136/bmjopen-2018-024224 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Gillies K, Bower P, Elliott J, et al. Systematic techniques to enhance rEtention in randomised controlled trials: the steer study protocol. Trials 2018;19:197. 10.1186/s13063-018-2572-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Nyaoke BA, Mutua GN, Sajabi R, et al. Volunteer motivators for participating in HIV vaccine clinical trials in Nairobi, Kenya. PLoS One 2017;12:Art e018378812. 10.1371/journal.pone.0183788 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Wenzel JA, Mbah O, Xu J, et al. A model of cancer clinical trial decision-making informed by African-American cancer patients. J Racial Ethn Health Disparities 2015;2:192–9. 10.1007/s40615-014-0063-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Quinn GP, Pratt CL, Bryant-George K, et al. Lung cancer patients' decisions about clinical trials and the theory of planned behavior. J Cancer Educ 2011;26:641–8. 10.1007/s13187-010-0169-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Guillot M, Asad S, Lalu MM, et al. So you want to give stem cells to babies? neonatologists and parents' views to optimize clinical trials. J Pediatr 2019;210:41–7. 10.1016/j.jpeds.2019.03.005 [DOI] [PubMed] [Google Scholar]
- 40.Amorrortu RP, Arevalo M, Vernon SW, et al. Recruitment of racial and ethnic minorities to clinical trials conducted within specialty clinics: an intervention mapping approach. Trials 2018;19:1. 10.1186/s13063-018-2507-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Corbie-Smith G, Odeneye E, Banks B, et al. Development of a multilevel intervention to increase HIV clinical trial participation among rural minorities. Health Educ Behav 2013;40:274–85. 10.1177/1090198112452124 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Sample DA, Sinicrope PS, Wargovich MJ. Post-study aspirin intake and factors motivating participation in a colorectal cancer chemoprevention trial. Cancer Epidemiology, Biomarkers & Prevention 2002;11:281–5. [PubMed] [Google Scholar]
- 43.Kinney AY, Richards C, Vernon SW, et al. The effect of physician recommendation on enrollment in the breast cancer chemoprevention trial. Prev Med 1998;27:713–9. 10.1006/pmed.1998.0349 [DOI] [PubMed] [Google Scholar]
- 44.Yeomans-Kinney A, Vernon SW, Frankowski RF, et al. Factors related to enrollment in the breast cancer prevention trial at a comprehensive cancer center during the first year of recruitment. Cancer 1995;76:46–56. [DOI] [PubMed] [Google Scholar]
- 45.Verheggen FW, Nieman F, Jonkers R. Determinants of patient participation in clinical studies requiring informed consent: why patients enter a clinical trial. Patient Educ Couns 1998;35:111–25. 10.1016/S0738-3991(98)00060-3 [DOI] [PubMed] [Google Scholar]
- 46.Bradley JM. A descriptive study of blood-related-cancer patients and their decision to enter or not enter a clinical trial. Dissertation Abstracts International: Section B: The Sciences and Engineering 2006;67:530. [Google Scholar]
- 47.Vandenburgh AM. A correctional analysis of self-reports and psychological profiles in investigating the motivation of subjects participating in glaucoma clinical trials. Dissertation Abstracts International Section A: Humanities and Social Sciences 2001;61:4195. [Google Scholar]
- 48.Huisman S, Maes S, De Gucht VJ, et al. Low goal ownership predicts drop-out from a weight intervention study in overweight patients with type 2 diabetes. Int J Behav Med 2010;17:176–81. 10.1007/s12529-009-9071-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Roche CC. Factors associated with participant retention in a behavioral weight loss study. Dissertation Abstracts International: Section B: The Sciences and Engineering 2013;74. [Google Scholar]
- 50.National Institute for Health Research . Improving inclusion of under-served groups in clinical research: guidance from the NIHR include project. NIHR, 2020. [Google Scholar]
- 51.Wendler D, Kington R, Madans J, et al. Are racial and ethnic minorities less willing to participate in health research? PLoS Med 2006;3:e19. 10.1371/journal.pmed.0030019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Bandura A. Social foundations of thought and action : a social cognitive theory. Englewood Cliffs, N.J: Prentice-Hall, 1986. [Google Scholar]
- 53.Tilley BC, Mainous AG, Smith DW, et al. Design of a cluster-randomized minority recruitment trial: recruit. Clin Trials 2017;14:286–98. 10.1177/1740774517690146 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Bartholomew Eldredge M. Planning health promotion programs: an intervention mapping approach. John Wiley & Sons, Incorporated, 2016. [Google Scholar]
- 55.Ortiz AP, Machin M, Soto-Salgado M, et al. Effect of an educational video to increase calls and screening into an anal cancer clinical trial among HIV+ Hispanics in PR: results from a randomized controlled behavioral trial. AIDS Behav 2019;23:1135–46. 10.1007/s10461-018-2330-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Gwadz MV, Cylar K, Leonard NR, et al. An exploratory behavioral intervention trial to improve rates of screening for AIDS clinical trials among racial/ethnic minority and female persons living with HIV/AIDS. AIDS Behav 2010;14:639–48. 10.1007/s10461-009-9539-9 [DOI] [PubMed] [Google Scholar]
- 57.Bowen D, Thornquist M, Goodman G, et al. Effects of incentive items on participation in a randomized chemoprevention trial. J Health Psychol 2000;5:109–15. 10.1177/135910530000500103 [DOI] [PubMed] [Google Scholar]
- 58.Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process 1991;50:179–211. 10.1016/0749-5978(91)90020-T [DOI] [Google Scholar]
- 59.Michie S, Johnston M, Abraham C, et al. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care 2005;14:26–33. 10.1136/qshc.2004.011155 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Cane J, O'Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci 2012;7:37. 10.1186/1748-5908-7-37 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Goulao B, Duncan A, Floate R, et al. Three behavior change theory-informed randomized studies within a trial to improve response rates to trial postal questionnaires. J Clin Epidemiol 2020;122:35–41. 10.1016/j.jclinepi.2020.01.018 [DOI] [PubMed] [Google Scholar]
- 62.Frampton GK, Shepherd J, Pickett K, et al. Digital tools for the recruitment and retention of participants in randomised controlled trials: a systematic MAP. Trials 2020;21:478. 10.1186/s13063-020-04358-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Bonevski B, Randell M, Paul C, et al. Reaching the hard-to-reach: a systematic review of strategies for improving health and medical research with socially disadvantaged groups. BMC Med Res Methodol 2014;14:42. 10.1186/1471-2288-14-42 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.George S, Duran N, Norris K. A systematic review of barriers and facilitators to minority research participation among African Americans, Latinos, Asian Americans, and Pacific Islanders. Am J Public Health 2014;104:e16–31. 10.2105/AJPH.2013.301706 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Atkins L, Francis J, Islam R, et al. A guide to using the theoretical domains framework of behaviour change to investigate implementation problems. Implement Sci 2017;12:77. 10.1186/s13012-017-0605-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Ajzen I. Constructing a theory of planned behavior questionnaire, 2006: 1–12. [Google Scholar]
- 67.Bandura A. Guide for constructing self-efficacy scales (revised). Self-efficacy beliefs of adolescents 2006;5:307–37. [Google Scholar]
- 68.Francis J, Eccles M, Johnston M. Constructing questionnaires based on the theory of planned behaviour: a manual for health services R. The EU REBEQI project 2010;2002. [Google Scholar]
- 69.Fishbein M, Ajzen I. Defining and predicting behaviour (Chapter 2). In: Anonymous predicting and changing behavior: the reasoned action approach. New York: Psychology Press, 2010: 29–73. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjopen-2021-054854supp001.pdf (113.5KB, pdf)
bmjopen-2021-054854supp002.pdf (150.1KB, pdf)
bmjopen-2021-054854supp003.pdf (53.8KB, pdf)
Data Availability Statement
Data are available on reasonable request. All data relevant to the study are included in the article or uploaded as online supplemental information. All data relevant to the study findings are included in the article. Select data for included studies are available in the review database located in online supplemental files for this paper. Other data available on reasonable request from the corresponding author.
All data relevant to the study findings are included in the article. Select data for included studies are available in the review database located in the Supplementary files for this paper. Other data available on reasonable request from the corresponding author. All data relevant to the study findings are included in the article. Select data for included studies are available in the review database located in online supplemental files for this paper. Other data available on reasonable request from the corresponding author.