Abstract
Background
While international guidelines recommend medication reviews as part of the management of multimorbidity, evidence on how to implement reviews in practice in primary care is lacking. The MultimorbiditY Collaborative Medication Review And Decision Making (MyComrade) intervention is an evidence-based, theoretically informed novel intervention which aims to support the conduct of medication reviews for patients with multimorbidity in primary care. Our aim in this pilot study is to evaluate the feasibility of a trial of the intervention with unique modifications accounting for contextual variations in two neighbouring health systems (Republic of Ireland (ROI) and Northern Ireland (NI)).
Methods
A pilot cluster randomised controlled trial will be conducted, using a mixed-methods process evaluation to investigate the feasibility of a trial of the MyComrade intervention based on pre-defined progression criteria. A total of 16 practices will be recruited (eight in ROI; eight in NI), and four practices in each jurisdiction will be randomly allocated to intervention or control. Twenty people living with multimorbidity and prescribed ≥ 10 repeat medications will be recruited from each practice prior to practice randomisation. In intervention practices, the MyComrade intervention will be delivered by pairs of general practitioners (GPs) in ROI, and a GP and practice-based pharmacist (PBP) in NI. The GPs/GP and PBP will schedule the time to review the medications together using a checklist. Usual care will proceed in practices in the control arm. Data will be collected via electronic health records and postal questionnaires at recruitment and 4 and 8 months after randomisation. Qualitative interviews to assess the feasibility and acceptability of the intervention and explore experiences related to multimorbidity management will be conducted with a purposive sample of GPs, PBPs, practice administration staff and patients in intervention and control practices. The feasibility of conducting a health economic evaluation as part of a future definitive trial will be assessed.
Discussion
The findings of this pilot study will assess the feasibility of a trial of the MyComrade intervention in two different health systems. Evaluation of the progression criteria will guide the decision to progress to a definitive trial and inform trial design. The findings will also contribute to the growing evidence-base related to intervention development and feasibility studies.
Trial registration
ISRCTN Registry, ISRCTN80017020. Date of confirmation is 4/11/2019.
Supplementary Information
The online version contains supplementary material available at 10.1186/s40814-022-01018-y.
Keywords: Feasibility study, Behavioural intervention, Primary care, Behaviour change, Multimorbidity, Medication review, Behaviour change wheel, Cluster randomised controlled trial
Introduction
Multimorbidity, the co-occurrence of two or more long-term conditions, is frequently encountered by general practitioners (GPs), with approximately one in four adults living with multimorbidity, and half of older adults diagnosed with three or more chronic conditions internationally [1]. Prescribing is one of the most complex and important considerations of multimorbidity management. Polypharmacy describes the prescription of multiple medications, but consensus is lacking on the threshold number of medications that should be used to define polypharmacy. Although five or more medications are commonly used, more recent studies have used a cutoff of ten or more medications to indicate patients at greater risk of adverse events from their medications [2, 3]. Certainly, higher numbers of medications are associated with a greater risk of preventable drug-related morbidity [4, 5], and the use of multiple medications may impose a burden on individuals, reducing medication adherence [6]. The prevalence of polypharmacy is strongly associated with the number of conditions a person has, for example, a large primary care study conducted in Scotland showed 42% of patients with six or more conditions were prescribed 10 or more medications [7]. However, using multiple medications for the control of chronic disease may also benefit the patient by reducing morbidity and improving quality of life.
A range of factors have been identified as contributing to the complexity of prescribing for general practitioners (GPs) in the context of multimorbidity and the resultant challenges in clinical decision-making [8]. For example, specialists initiate many of the medications taken by patients with multimorbidity, but the responsibility for repeat prescribing of these medications lies with primary care [6]. Several studies show the dilemmas experienced by GPs who query the ongoing appropriateness of repeat medications, which is further complicated by suboptimal communication between primary and secondary care [9, 10]. In addition, drawing on treatment guidelines for prescribing decisions in multimorbidity is often unhelpful or counterproductive as guidelines are designed for single diseases [8].
The prevalence of multimorbidity and polypharmacy continues to grow [11]. Yet, there is a lack of intervention research in this area to guide the effective management of medications in primary care [12]. Individual structured medication reviews are recommended by the National Institute for Health and Care Excellence (NICE) as key in the management of multimorbidity [13], but evidence shows such reviews frequently do not occur [14]. Medication review is a modifiable and potentially impactful behavioural target in multimorbidity management in primary care. The MultimorbiditY Collaborative Medication Review And Decision Making (MyComrade) intervention was developed to address barriers to medication reviewing by GPs, through a series of studies conducted according to the Medical Research Council (MRC) Framework for the development and evaluation of complex interventions and using the Behaviour Change Wheel [15–17]. The Capability, Opportunity, Motivation – Behaviour (COM-B) model and Behaviour Change Technique (BCT) Taxonomy [18] are key features of the Behaviour Change Wheel system, utilised in the development of this intervention. The development and key features of MyComrade are outlined in Table 1 and described in detail elsewhere [15].
Table 1.
MyComrade intervention: barriers to medication reviewing and operationalisation of MyComrade BCTs
| Behavioural analysis using COM-B: what are the barriers to medication review in multimorbidity? | Selected behaviour change technique and definition | Original operationalisation of BCTs in the MyComrade intervention | Revised operationalisation of BCTs in the MyComrade intervention, based on the findings of the feasibility study [19] and contextual requirements | |
|---|---|---|---|---|
| Uncertainty about most valuable medications. | Psychological capability |
3.2 Social support—practical Advise on, or provide practical help (e.g. colleagues) for the performance of behaviour |
Two GPs collaboratively conduct a medication review | Two GPs or a GP and PBP collaboratively conduct a medication review |
| Perceptions related to patient unwillingness to stop long-term medications. | Social Opportunity | |||
| Lack of time to properly review medications. | Physical opportunity |
12.2 Restructuring social environment Change or advise to change the social environment in order to facilitate performance of the wanted behaviour 1.4 Action planning Prompt detailed planning of performance of behaviour (must include at least one of frequency, context, duration, intensity) |
Plan active medication reviews | Plan active medication reviews |
| An instinct to maintain the status quo. | Automatic motivation |
7.1 Prompts/cues Introduce environmental or social stimulus for the purpose of prompting or cueing behaviour |
Use of prescribing checklist | Use of prescribing checklist |
| Fear of negative consequences. | Reflective motivation |
10.7 Self-incentive Plan to reward self in the future if and only if there has been an effort and/or progress in performing the behaviours |
Annual professional appraisal contribution | Annual professional appraisal contribution |
| Opportunity cost of reviewing medications. | ||||
| Based on the findings of the non-randomised feasibility study [19], an additional BCT was added to the MyComrade intervention to provide the necessary support to address the opportunity cost of reviewing medications. | Reflective motivation |
10.1 Material incentive (behaviour) Inform that money, vouchers or other valued objects will be delivered if and only if there has been an effort and/or progress in performing the behaviour |
Financial reimbursement for review completion All practices: €500/£430 for the administration associated with recruiting patients Intervention practices only: • €100/£86 for completing the intervention introduction session • €50/£43 per completed medication review |
|
The aim of the MyComrade intervention is to support GPs to conduct medication reviews for patients with multimorbidity with a view to optimising the medication regimen and minimising potentially inappropriate prescribing [15–17]. As recommended by the MRC Framework, the feasibility of MyComrade was tested in a non-randomised qualitative feasibility study [19]. The findings showed MyComrade’s acceptability to GPs and that all the medication reviews conducted produced recommendations for medication optimisation. However, participating GPs felt that the sustainability of this approach would require an incentive mechanism, due to the time, personnel demand and opportunity cost of this activity.
The findings of the feasibility study justified proceeding to a randomised pilot trial to address remaining uncertainties and guide the decision to progress to a definitive trial of the intervention [16]. In particular, a pilot would allow testing of the MyComrade intervention and study procedures on a small scale [20] and inform important refinements to facilitate the conduct of a robust and transparent definitive trial [16, 21].
A funding opportunity arose for a pilot trial to be conducted across the Republic of Ireland-Northern Ireland border. This opportunity required that unique modifications would be made to the MyComrade intervention to account for the contextual differences in the Irish and Northern Irish health systems. The original MyComrade intervention, developed in the Republic of Ireland (ROI), included collaborative medication review by two GPs. In Northern Ireland (NI), the majority of primary care practices have access to a pharmacist, as a result of a Primary Care Pharmacy scheme launched in 2016 [22] (M. Corry, personal communication, June 4, 2020), with a key responsibility for conducting medication reviews [23]. Therefore, the MyComrade collaborative medication reviews will take place in Northern Ireland with a GP and a practice-based pharmacist (PBP). Additionally, based on the findings of the feasibility study [16], the MyComrade intervention was further refined by adding a behaviour change technique (i.e. material incentive) to address the high opportunity cost of medication reviewing.
The aim of this study is to evaluate the feasibility of a trial of the modified MyComrade intervention, including cross-border comparison, using a pilot cluster randomised controlled trial (cRCT). The primary objective is to determine the feasibility of a definitive trial of the MyComrade intervention, focusing on recruitment, retention and fidelity of intervention implementation. The secondary objective is to select suitable outcome and cost-effectiveness measures for use in a definitive trial. This study will also enable the assessment of the feasibility of MyComrade in two different health systems, producing data on the adaptability and potential generalisability of the intervention.
Methods
Trial design
A parallel-group, pilot cRCT of the MyComrade intervention will be conducted, where GP practices are the units of randomisation (the clusters), and individual patients with multimorbidity, prescribed 10 or more medications, are the units of analysis (the participants). Figure 1 illustrates the study design. The trial will be conducted based on best practice guidelines for conducting a process evaluation [24] and reported according to the CONSORT guidelines, adapted for pilot studies [21] and Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 Statement [25]. A completed SPIRIT checklist is provided in Additional file 1.
Fig. 1.
MyComrade study design
A total of 16 practices will be recruited (eight in ROI; eight in NI), and four practices in each jurisdiction will be randomly allocated to the intervention or control arms. Patients with multimorbidity who are prescribed 10 or more repeat prescription medications will be identified in each practice. From each practice, 20 patients with multimorbidity will be recruited, providing a total of 320 participants. The list of 20 consented patients from each practice will be shared with participating GPs/PBPs. In the intervention arm, pairs of GPs/GP and PBPs will use the MyComrade intervention and will be asked to complete collaborative medication reviews before the 4-month follow-up time point. ROI pairs will be GP-GP, and NI pairs will be GP-PBP. Control practices will proceed with usual care. Participant data will be collected from primary care practice records and postal questionnaires sent to participants at baseline before randomisation takes place and at 4 and 8 months after the date of randomisation. Qualitative interviews to assess the study feasibility and acceptability and to explore experiences related to multimorbidity management will be conducted with a purposive sample of GPs and PBPs participating in the study, practice administration staff and patients.
A Public and Patient Involvement group has been established, involving four adults (two women and two men) from both NI and ROI and living with multimorbidity. This group have provided input into the patient recruitment materials, and qualitative interview guides, and will provide input into the interpretation of the qualitative findings and methods for disseminating the study findings. The establishment and running of this group as research partners in this study are guided by the PPI Ignite @ NUI Galway programme office, part of a national PPI programme funded by the Health Research Board in Ireland.
Participants
Eligibility criteria
Primary care practices
Eligible practices in ROI will have at least two GPs willing to conduct medication reviews. In NI, at least one GP and one PBP must be willing to conduct medication reviews for a practice to be eligible. Practices currently involved in other research involving patients with multimorbidity will not be eligible.
Patients
Eligible patients must be living with multimorbidity and prescribed ten or more medications. Patients will not be eligible for this study if they are under 18 years old at the time of medical record review, are pregnant, undergoing terminal illness care or have cognitive or learning disabilities that would prevent them from completing the study activities.
Study setting
This study will take place in primary care practices in NI and ROI. The populations of these jurisdictions are similar in terms of ethnicity, with the majority of people in both regions being white [26] and with similar socioeconomic gradients [27]. GPs in both jurisdictions work as independent contractors [28], but the health systems differ in important ways, principally that the system in ROI is a mixed public and private system, while the system in NI is publicly funded [29]. In ROI, patients are means-tested to determine eligibility for a medical card, which entitles them to GP care, medications and other medical services free at the point of access [28]. In 2019, 32.4% of the ROI population had a medical card [30]. Patients without a medical card pay out of pocket for their medical care and medications. All patients aged over 70 years get free access to GP care but only those with medical cards are eligible for free medications. In NI, GP services are free at the point of access to all patients [31].
Since 2016, most GP practices in NI have access to a PBP, although the hours and role of the PBP will vary depending on the size and specific needs of the practice. Tasks performed by the PBP may include medication reviews and medication reconciliation following discharge from the hospital [22].
Recruitment
Primary care practices will be contacted by the research team via several communication pathways: the Northern Ireland Clinical Research Network (NICRN) Primary Care network, the HRB Primary Care Clinical Trials Network of Ireland (HRB PC CTNI), ROI and NI business directories, local GP education events and meetings and local GP social media groups. Practices will be sent information on the study and asked to express an interest in taking part. Interested practices will be contacted by a member of the research team to further discuss the study. Before recruitment, each practice will be provided with instructions and asked to run a search in their record system to assess the number of potential participants based on their number of prescription medications (target > 60 potentially eligible patients per practice). Practices will be informed at the outset of the material supports associated with participation in the study and details of the implementation of the intervention (Table 1).
Eligible patients will be identified in NI and ROI using electronic record search procedures. These search procedures will be modified to take into account the different electronic practice record systems used in both jurisdictions. In the ROI, a search procedure developed and tested in another Irish primary care multimorbidity trial [32] will be used to identify eligible patients. In NI, a similar search procedure will be developed by the study team and pilot tested for the two main electronic practice record systems there. To comply with the General Data Protection Regulation (GDPR), only practice staff members will review the list of eligible patients generated by the search procedure and apply the study eligibility criteria. Eligible patients will receive a recruitment pack, consisting of an invitation to participate in the study, a participant information leaflet, and a consent form. Recruitment packs will be provided by the study team but will be addressed and posted by the practice teams, to adhere to GDPR. To minimise selection bias, patients will be randomly selected from the list of eligible patients, and recruitment packs will be sent out until 20 patients from each practice consent to participate.
Intervention
The MyComrade intervention is a complex intervention, which aims to increase the behaviour of active medication review. MyComrade initially involved five components (Table 1); a sixth component material incentive was added based on the results of the first feasibility study of this intervention [19]. The intervention is described using the Template for Intervention Description and Replication (TIDieR) Checklist [33] in Additional file 2.
MyComrade will be implemented in intervention practices following recruitment of participants, baseline data collection and practice randomisation. The research team will deliver a brief introduction session on the intervention. The introduction session will be audio-recorded to allow independent fidelity assessment, in terms of content and duration. The GP research fellow with the NI- and ROI-based study teams (LMQ and SM) will contact each intervention practice 3 and 6 weeks after this session to gauge progress in terms of medication review completion and address any study-related questions.
Participating GPs and PBPs will be given the list of eligible patients from their practice who consent to take part. GP/GP and PBP pairs will schedule a time to meet each other to conduct each collaborative medication review, using a medication review checklist to guide the discussion. The medication review checklist was adapted from the “NO TEARS” tool for a medication review [34], originally designed for doctor-patient medication reviewing. This seven-item tool was selected due to its simplicity and was described by GPs in the feasibility study for the MyComrade interventions as a helpful guide for a medication review [19]. The earlier feasibility study suggested that reviews take between 10 and 30 min each. GP/PBPs will scan the completed checklist into the participant’s practice record, highlighting any potential options for medication changes and discussing these with the participant prior to making changes.
Outcomes
The primary outcomes are the feasibility of practice recruitment, patient recruitment, practice retention, patient retention and feasibility of intervention implementation. Secondary outcomes are completion of medication reviews (GP/PBP outcome), treatment burden and quality of life (patient outcomes) and number of prescribed medications, changes in prescribed medications, deprescribing and indicators of potentially inappropriate prescribing (prescribing outcomes). The indicators of potentially inappropriate prescribing were adapted from the set of evidence-based, validated prescribing safety indicators developed in the PINCER trial [35]. The secondary outcomes will be used to inform the choice of primary outcome should we proceed to a definitive trial at a later stage. The logic model in Additional file 4 illustrates the intervention components, proposed mechanisms of impact of each component, contextual factors and outcomes. The logic model was designed based on guidance from Moore et al. [36].
Data will be collected on GP practice demographic information and patient demographic information and healthcare utilisation. Additional file 3 provides a summary of the variables measured in this study and the data source for each. The secondary outcomes will be assessed at baseline and at 4 and 8 months after randomisation of practices. The variability, consistency, response rates, success of data collection methods and data completeness for each outcome will be determined to understand the feasibility and acceptability. These findings will help to determine the primary outcome(s) for a future definitive trial.
Progression criteria
The progression criteria for this study (Table 2) were developed based on Avery et al.’s Top Ten Tips for guiding the decision to progress from a pilot to a definitive trial, focusing on key acceptability and feasibility variables [37]. Several rounds of discussions were held within the study team to draft the criteria outlined in Table 2. Discussions were guided by existing literature, study team experience, the pilot study design and potential barriers and facilitators to practice and patient involvement. As part of the process evaluation within this study, qualitative and quantitative data will be collected for the investigation of the following outcomes: feasibility of practice recruitment, feasibility of patient recruitment, feasibility of practice retention, feasibility of patient retention and feasibility of intervention implementation.
Table 2.
MyComrade progression criteria
| Go—proceed with RCT | Amend—proceed with changes | Stop—do not proceed unless changes are possible | |
|---|---|---|---|
|
1. Feasibility of practice recruitment Can 16 practices be recruited to take part in 3 months (8 practices in NI and 8 in ROI)? |
If > 14 practices are recruited to take part in 3 months | If > 14 practices are recruited, but it takes longer than predicted (e.g. 3–6 months) | Unable to recruit practices |
|
2. Feasibility of patient recruitment Can 20 patients per practice (total N = 320) be recruited? |
If 20 patients are recruited in one month per practice; a total of 320 (100%) | If 10–19 patients are recruited in one month per practice; a total of 160–319 (50 to < 100%) | If < 10 patients are recruited in one month per practice; a total of < 159 (50%) |
|
3. Feasibility of practice retention Can > 14 practices be retained in the study until completion? |
> 14 (88%) retained | > 12 (75%) retained | < 12 retained |
|
4. Feasibility of patient retention Can at least 80% of recruited patients be retained in the study until completion? |
> 256 (80%) retained | 224–255 (70–80%) retained | < 224 retained |
| 5. Intervention implementation | Delivery of intervention judged strongly feasible by qualitative data | Delivery of intervention judged feasible by qualitative data | Delivery of intervention judged possibly feasible by qualitative data |
Sample size
As this is a pilot study, a formal sample size calculation was not done [38]. This study aims to recruit 16 primary care practices (eight in NI and eight in ROI) and 20 patients per practice (N = 320), based on recommendations from Eldridge et al. [20] and the CONSORT guidance [21] on the minimum number of clusters required in pilot and definitive cRCTs, respectively. The aims of this pilot cRCT are to investigate feasibility and acceptability and to identify the most suitable primary outcome(s) for a definitive cluster randomised trial. The estimates from this pilot trial will be used to calculate the sample size needed using the methods outlined by Rutterford et al. [39].
Based on an assessment of the number of practices and practice sizes in the region, we will invite 50 patients per practice and, a priori, have defined a success criterion as 40% of the total number of participants invited to be recruited to the research evaluation (approximately 20 patients per practice).
Randomisation
To limit recruitment bias and help ensure that equal numbers of patients will be recruited in both arms of the trial, randomisation of the practices to intervention or control group will take place after patient recruitment has been completed [40]. Practices will be allocated using an online system, called Sealed Envelope, by a biostatistician blinded to allocation. Practices will be allocated by minimisation according to practice size (< 4 or 4+ GPs) in the ratio 1:1.
Statistical methods
Process evaluation and qualitative data collection and analysis
The main purpose of the process evaluation is to answer questions relating to the primary feasibility outcomes (recruitment, retention and intervention implementation). The process evaluation is informed by the approach described by Grant et al. [24] and utilises quantitative and qualitative methods across 11 framework domains (described in Table 3).
Table 3.
MyComrade study process evaluation framework, including implementation outcomes framework
| Process evaluation framework and implementation outcomes framework | MyComrade process evaluation questions | Intervention or control | Data source to answer process evaluation question | ||
|---|---|---|---|---|---|
| Interview | Other sources | ||||
| Domain | |||||
| 1. Recruitment of clusters | How were practices sampled and recruited? | Both | No | Study records | |
| Why did practices agree to participate (or not)? | Both |
GPs/PBPs Practice administrative staff |
|||
| 2. Delivery to clusters | How was MC delivered to the practices? | Intervention | GPs/PBPs | Study records | |
| 3. Response of clusters |
How has completing trial-related work impacted the practice? At the practice level, how is MC and related research work perceived? How has the practice been found working with the research team? Time taken to complete study activities? |
Both |
Practice administrative staff GPs/PBPs |
||
|
How were patients identified/reviewed? Are they representative/is there a selection bias? Time taken to complete? |
Both |
Practice administrative staff GPs/PBPs |
|||
| What were the processes involved in addressing the recruitment packs and conducting mail-outs and what was the time taken to complete? | Both |
Practice administrative staff GPs/PBPs |
|||
| What is the practice level protocol for usual care? | Control |
Practice administrative staff GPs/PBPs |
|||
| 4. Recruitment and reach in individuals | Who within each practice actually received the MC training? Are they representative/is there a selection bias? | Intervention |
Practice administrative staff GPs/PBPs |
Study records of attendance at the intervention introduction session | |
| 5. Delivery to individuals |
Implementation outcomes framework 1. Fidelity |
What do GPs/PBPs implement as usual care? | Control | GPs/PBPs | |
| How are GPs/PBPs implementing MC? How many BCTs did pairs implement the following? | Intervention | GPs/PBPs | |||
| i. Plan reviews: restructuring social environment, Action planning | Intervention | GPs/PBPs |
Checklist completion GP fellow calls |
||
| ii. Conduct reviews: social support | Intervention | GPs/PBPs |
Checklist completion GP fellow calls Scanned checklists to patient record |
||
| iii. Use checklist: prompts/cues | Intervention | GPs/PBPs |
Checklist completion Scanned checklists to patient record |
||
| iv. Submit for annual appraisal or points/reimbursement: self-incentives; material incentive | Intervention | GPs/PBPs |
Submission of MC activities for annual appraisal Receipt of reimbursement |
||
| 6. Response of individuals |
1. Acceptability 2. Adoption 3. Appropriateness 4. Feasibility |
Is MC acceptable/agreeable/satisfactory to GPs/PBPs? What was GP/PBP initial intention/plan for MC? Did implementation of MC change over the course of the study (e.g. use of checklist)? Is MC compatible/relevant for general practice and multimorbidity? Is MC practical/feasible for GPs/PBPs to implement? |
Intervention | GPs/PBPs | |
|
Has the GP/PBP ever reviewed their medication with them? How do they feel about two GPs, or GP and PBP discussing their medications without them? Did they experience any changes to their medication during the course of the study? |
Both | Patients | |||
| 7. Maintenance |
1. Acceptability 2. Adoption 3. Appropriateness 4. Feasibility |
Has MC become integrated into practice over the course of the study? What components? Do GPs/PBPs think MC could become routine practice? Are there any opportunity costs of implementing MC? |
Intervention | GPs/PBPs | |
| 8. Unintended consequences | Were there unintended consequences, outcomes or changes in the processes? | Intervention | GPs/PBPs | ||
| 9. Theory |
Proposed mechanisms of impact: How did GPs/PBPs feel about formally allocating time to review medications? Did the MC intervention help in any way in dealing with that uncertainties related to medications and considering options? Has taking part in the trial had any impact on the way GP/PBP communicates with their patients about their medications? Did GP/PBP submit details of their MC involvement as part of annual appraisal submission? |
Intervention | GPs/PBPs | ||
| 10. Context |
What are the differences in experiences between the NI and ROI practices in all of the framework domains, e.g.: Practice resources prescribing guidelines practice context, e.g. practice size and setting |
Both | All | Practice profile questionnaire | |
| 11. Effectiveness |
Did pairs complete active medication reviews? Were there changes made to the number of repeat medications prescribed (additions and de-prescribing)? Were there changes related to potentially inappropriate prescribing? |
Both | GPs/PBPs |
Checklist completion GP fellow calls Patient record |
|
|
Patient outcomes: Quality of life Multimorbidity treatment burden |
Both | Patient |
Patient questionnaires Patient record |
||
Semi-structured interviews will be used to collect qualitative data from a purposive sample of one GP or PBP and a practice manager or administrator from each practice. From the patients recruited from each practice, one patient will be invited for an interview, through random sampling. If a patient does not respond or declines to be interviewed, a second patient will be randomly selected and invited for an interview. The topic guides will explore the experiences of those participating in the study and issues of implementation following Proctor et al.’s [41] taxonomy of implementation outcomes (acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, coverage and sustainability—see Table 3). Interviews will be conducted remotely by telephone (by EC and LH) with audio-recording and last approximately 30–60 min. Due to the geographical spread of the study, telephone interviews are most feasible, and this approach has been found to be an acceptable alternative to in-person interviews [42].
Interviews will be transcribed verbatim and analysed using the framework approach [43] in the Nvivo software. At the outset, up to six transcripts will be coded inductively by two researchers (LH and CK), who will then meet to discuss the initial coding and to agree on an analytical framework. The agreed framework will be refined inductively through subsequent rounds of coding and team discussion. Data will be summarised using a framework matrix of the themes and sub-themes through a process known as charting, which will allow data summaries to be easily generated and linked to relevant data. The two coders and a wider study team, including the PPI group, will work together to interpret the findings.
Quantitative data collection and analysis
Data relating to progression criteria (e.g. recruitment and retention rates) will be collected throughout. Quantitative data will be collected from patients through postal questionnaires, once they have provided informed consent, at baseline and at 4 and 8 months after practice randomisation (Additional file 3). Prescribing data will be collected by research nurses from practice record systems and will be based on a data collection tool developed and pilot tested in advance (Additional file 3). An intention to treat analysis will be conducted, with data from all eligible patients being included in analyses. We will determine the estimates of the variability in secondary outcomes (e.g. treatment burden and health-related quality of life; potentially inappropriate prescribing, number of prescribed medications and rates of deprescribing; and completion of medication reviews) at baseline and/or study end, the variability in the change in responses over time and the likely proportion of missingness in the responses. Quantitative data will inform the decisions on the number of clusters required, optimal cluster size and potential intracluster correlation for a subsequent definitive trial.
Exploratory analysis
Linear and nonlinear mixed-effects models, which account for the cluster design and allow adjustment for baseline measurements, will be used to tentatively explore the differences in the secondary outcomes between the pilot trial arms.
Health economic analysis
The health economic study will be conducted alongside the pilot cRCT to explore the feasibility of conducting an economic evaluation to assess the cost-effectiveness of the MyComrade intervention. Data collection tools will be developed for the purposes of collecting data on resource use and outcome measures over the trial follow-up period. An exploratory process will be conducted to identify the resource use and costs associated with the delivery of the intervention, in addition to the costs of clinical actions linked to the medication reviews, and other healthcare resource use by patients. Unit costs will be identified and applied to convert data on resource use to costs. For the pilot cost-utility analysis, quality-adjusted life-years (QALYs) will be generated using the EuroQol EQ-5D-5L [44]. A preliminary incremental analysis will be undertaken to provide information on the marginal costs and marginal effects of the MyComrade+ Intervention relative to the usual practice, and a range of techniques will be employed to address uncertainty. Preliminary subgroup analysis will compare data for the two different healthcare settings [45, 46]. This analysis is designed to determine the feasibility of this approach and not cost-effectiveness.
Data management and protection
A data management plan will be agreed upon by the study teams in ROI and NI. All data will be safeguarded in a manner that meets the requirements of the Data Protection Acts, 1988 and 2003 in ROI, and the Data Protection Act 2018, in NI. Data collected from practice record systems will be anonymised and labelled with participants’ study identification (ID) numbers before being removed from practices. Questionnaires will also be anonymous, and the only identifier will be the participant’s ID number. To enable communication with participants for follow-up questionnaires and qualitative interviews, study ID numbers and contact information will be stored on a document kept separate from data and signed consent forms.
Qualitative interview data collected from patients, GPs/PBPs and practice staff will be stored securely and labelled using an anonymous study ID number. Audio recordings will be transcribed verbatim, and identifying information will be removed.
Data collected from practice record systems will be stored electronically on a secure platform. Participant questionnaire data will be entered into an anonymous study database and stored electronically on a secure platform. Hard copies of source data and data collection forms related to participant practice-level data, as well as participant questionnaires, will be stored securely in a locked cabinet in a locked office for the duration of the study. Audio recordings and transcripts of interviews will be stored electronically on a secure platform, and recordings will be deleted from the recording equipment. Only the study team members will have access to the data.
A Trial Steering Committee consisting of an independent chairperson, a GP, pharmacist, health psychologist and two public and patient representatives provides oversight and guidance to the research team regarding protocol implementation and challenges that arise. Major amendments to the protocol will be reported to relevant parties, such as Research Ethics Committees, and will be described in the final published manuscript. Participating practices, patients and PPI group members will receive a summary of the study findings.
Ethical approval
Ethical approval has been granted by the Irish College of General Practitioners Research Ethics Committee (ROI) and the Office of Research Ethics Committees Northern Ireland (ORECNI).
Study status
At the time of submission of this study protocol (version 1.3; date, June 5, 2019), recruitment of primary care practices and patients has been completed. Data collection will be complete in March 2021. Recruitment was completed before the COVID-19 pandemic began, and most study activities paused between March and May 2020. Since study activities restarted in June 2020, intervention introduction sessions have been virtual. Data collection has proceeded as originally planned, and research nurses take necessary precautions when entering practices to collect patient data, for example, wearing personal protective equipment.
Discussion
This study will assess the feasibility of a trial of the MyComrade intervention by conducting a pilot cRCT of the intervention in the ROI and in NI. By bringing GPs/GPs and PBPs together, with supportive tools such as an organising checklist and allocated time, MyComrade aims to facilitate the sharing of expertise and experience to overcome the persistent barriers to medication management in primary care. This study will add to a growing body of research related to managing polypharmacy in primary care. Recent studies reflect the pressing need for evidence-based, comprehensive and feasible solutions that take into account the complexity of this issue and emphasise the needs and realities of the patient and primary care professionals and context [47, 48].
The introduction of PBPs in NI provides a unique opportunity to compare alternative approaches to enhancing medication reviews across different healthcare systems. The testing of this intervention in two different health systems (ROI and NI) will provide data on the adaptability and generalisability of the intervention. Although the populations of NI and ROI are broadly similar, self-reported health has been reported in one study to be lower in NI than in ROI—a feature that will warrant consideration in any future definitive cross-border trial of this intervention [26].
On completion of this study, the MyComrade intervention will have progressed through the development and feasibility/piloting phases of the MRC framework [16]. The development of interventions using a systematic approach such as that of the MRC framework is widely recommended to address persistent issues with study quality, effectiveness and implementation [49]. The theoretical basis for this intervention and specification of proposed mechanisms of impact enable a level of description and testing of the intervention that is now widely called for in intervention research [50]. Therefore, the findings of this study with respect to the pre-specified progression criteria and effectiveness outcomes will provide a strong indication of the appropriateness of moving to a full-scale trial.
There are limitations associated with the proposed design. The study setting encompasses the whole of NI but is limited to the border region of ROI. The two settings differ in terms of characteristics such as the presence of major urban centres, which has an impact on the characteristics of GP practices that can be recruited and the number of practices available to recruit. GP practices in NI and ROI differ in a number of ways including typical practice size, often being larger in NI and practice record and medication coding systems, impacting methods of identification of eligible participants.
The overarching aim of this intervention is to optimise the management of medications prescribed for people living with multimorbidity, specifically those with prescriptions for 10 or more repeat medications. This study is an essential step in examining the potential for MyComrade to achieve this overarching aim. To gain an accurate understanding of the complex issues related to polypharmacy and medicines management in multimorbidity, and produce an effective and implementable intervention, this programme of research has been conducted closely in line with current recommendations. Therefore, this research will contribute to the evidence-base related to intervention development and feasibility testing and the management of multimorbidity in primary care nationally and internationally. The findings will be disseminated to a range of audiences, with guidance from the PPI group, including GPs, PBPs, secondary care providers and the public, through a range of media, including a dissemination event, conferences and publication.
Supplementary Information
Additional file 1. SPIRIT 2013 Checklist: Recommended items to address in a clinical trial protocol and related documents*.
Additional file 2. The TIDieR (Template for Intervention Description and Replication) Checklist.
Additional file 3. Summary of data collection.
Additional file 4. MyComrade Logic Model.
Acknowledgements
The authors would like to thank the primary care practices who have joined the MyComrade study and all patients who have agreed to participate. The authors would also like to acknowledge the invaluable input of the MyComrade Public and Patient Involvement group into the conduct of the study to date.
Trial sponsor
National University of Ireland, Galway; vpresearch@nuigalway.ie
Abbreviations
- cRCT
Cluster randomised controlled trial
- GP
General practitioner
- HRB PC CTNI
Health Research Board Primary Care Clinical Trials Network of Ireland
- MC
MyComrade
- MRC
Medical Research Council
- NI
Northern Ireland
- NICE
National Institute for Health and Care Excellence
- NICRN
Northern Ireland Clinical Research Network
- ORECNI
Office of Research Ethics Committees Northern Ireland
- PBP
Practice-based pharmacist
- QALYs
Quality-adjusted life-years
- ROI
Republic of Ireland
- TIDieR
Template for Intervention Description and Replication
Authors’ contributions
LH prepared the manuscript with input from all authors. All authors read and approved the final manuscript. CS developed and pilot tested the intervention with input from CB and MB.
Funding
HSC R&D Division Cross-border Healthcare Intervention Trials in Ireland Network (CHITIN), UK and Ireland. The views and opinions expressed in this protocol do not necessarily reflect those of the European Commission or the Special EU Programmes Body (SEUPB).
Availability of data and materials
NA
Declarations
Ethics approval and consent to participate
Ethical approval has been granted by the Irish College of General Practitioners Research Ethics Committee (ROI) and the Office of Research Ethics Committees Northern Ireland (ORECNI; REC reference 19/NI/0120; IRAS ID 260425). Informed consent was obtained before recruiting participants.
Consent for publication
NA
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Fortin M, Haggerty J, Almirall J, et al. Lifestyle factors and multimorbidity: a cross sectional study. BMC Public Health. 2014;14:686. doi: 10.1186/1471-2458-14-686. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Masnoon N, Shakib S, Kalisch-Ellett L, Caughey GE. What is polypharmacy? A systematic review of definitions. BMC Geriatrics. 2017;17(1):230. doi: 10.1186/s12877-017-0621-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Onder G, Liperoti R, Foebel A, Gambassi G, Bernabei R. Polypharmacy and mortality among nursing home residents with advanced cognitive impairment: results from the Shelter Study. J Am Med Dir Assoc. 2013;14(6):450.e7–450e12. doi: 10.1016/j.jamda.2013.03.014. [DOI] [PubMed] [Google Scholar]
- 4.Avery AJ, Sheikh A, Hurwitz B, Smeaton L, Chen Y-F, Howard R, et al. Safer medicines management in primary care. Br J Gen Pract. 2002;52:S17–S22. [PMC free article] [PubMed] [Google Scholar]
- 5.Hajjar ER, Cafiero AC, Hanlon JT. Polypharmacy in elderly patients. Am J Geriatr Pharmacother. 2007;5(4):345–351. doi: 10.1016/j.amjopharm.2007.12.002. [DOI] [PubMed] [Google Scholar]
- 6.Duerden M, Avery A, Payne R. Polypharmacy and medicines optimisation. Making it safe and sound. London: The King’s Fund; 2013. [Google Scholar]
- 7.Payne RA, Avery AJ, Duerden M, Saunders CL, Simpson CR, Abel GA. Prevalence of polypharmacy in a Scottish primary care population. Eur J Clin Pharmacol. 2014;70:575–581. doi: 10.1007/s00228-013-1639-9. [DOI] [PubMed] [Google Scholar]
- 8.Wallace E, Salisbury C, Guthrie B, Lewis C, Fahey T, Smith SM. Managing patients with multimorbidity in primary care. BMJ. 2015;350:h176. doi: 10.1136/bmj.h176. [DOI] [PubMed] [Google Scholar]
- 9.Smith SM, O’Kelly S, O’Dowd T. GPs’ and pharmacists’ experiences of managing multimorbidity: a ‘Pandora’s box’. Br J Gen Pract. 2010;60(576):e285–ee94. doi: 10.3399/bjgp10X514756. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Sinnott C, Mc Hugh S, Boyce MB, Bradley CP. What to give the patient who has everything? A qualitative study of prescribing for multimorbidity in primary care. Br J Gen Pract. 2015;65(632):e184–ee91. doi: 10.3399/bjgp15X684001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Moriarty F, Hardy C, Bennett K, Smith SM, Fahey T. Trends and interaction of polypharmacy and potentially inappropriate prescribing in primary care over 15 years in Ireland: a repeated cross-sectional study. BMJ Open. 2015;5(9):e008656. doi: 10.1136/bmjopen-2015-008656. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Smith SM, Wallace E, O’Dowd T, Fortin M. Interventions for improving outcomes in patients with multimorbidity in primary care and community settings. Cochrane Database Syst Rev. 2016;3(3):CD006560. doi: 10.1002/14651858.CD006560.pub3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.NICE. Multimorbidity: assessment, prioritisation and management of care for people with commonly occurring multimorbidity: National Institute for Health and Care Excellence; 2017. Available from: https://www.nice.org.uk/guidance/ng56 [PubMed]
- 14.Luijks HD, Loeffen MJW, Lagro-Janssen AL, van Weel C, Lucassen PL, Schermer TR. GPs’ considerations in multimorbidity management: a qualitative study. Br J Gen Pract. 2012;62(600):e503–e510. doi: 10.3399/bjgp12X652373. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Sinnott C, Mercer SW, Payne RA, Duerden M, Bradley CP, Byrne M. Improving medication management in multimorbidity: development of the MultimorbiditY COllaborative Medication Review And DEcision Making (MY COMRADE) intervention using the Behaviour Change Wheel. Implement Sci. 2015;10:132. doi: 10.1186/s13012-015-0322-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Craig P, Dieppe P, MacIntyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. Br Med J. 2008;337:979–983. doi: 10.1136/bmj.a1655. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6(1):42. doi: 10.1186/1748-5908-6-42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The Behavior Change Technique Taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46:81–95. doi: 10.1007/s12160-013-9486-6. [DOI] [PubMed] [Google Scholar]
- 19.Sinnott C, Byrne M, Bradley C. Improving medication management for patients with multimorbidity in primary care: a qualitative feasibility study of the MY COMRADE implementation intervention. Pilot Feasibility Stud. 2017;3:14. doi: 10.1186/s40814-017-0129-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Eldridge SM, Lancaster GA, Campbell MJ, Thabane L, Hopewell S, Coleman CL, et al. Defining feasibility and pilot studies in preparation for randomised controlled trials: development of a conceptual framework. PLoS One. 2016;11(3):e0150205. doi: 10.1371/journal.pone.0150205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S, Thabane L, et al. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. BMJ. 2016;355:5239. doi: 10.1136/bmj.i5239. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.The Pharmaceutical Journal. Pharmacists in Northern Ireland to work in GP practices 2015. Available from: https://www.pharmaceutical-journal.com/news-and-analysis/news-in-brief/pharmacists-in-northern-ireland-to-work-in-gp-practices/20200246.article?firstPass=false. Accessed 17 Sept 2020.
- 23.Health and Social Care Board. Investment in GP practices http://www.hscboard.hscni.net/our-work/integrated-care/gps/investment-in-gp-practices/2020. Accessed 12 June 2020.
- 24.Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluation for cluster-randomised trials of complex interventions: a proposed framework for designing and reporting. Trials. 2013;14:15. doi: 10.1186/1745-6215-14-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158:200–207. doi: 10.7326/0003-4819-158-3-201302050-00583. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.O’Neill C, McGregor P, Merkur S. United Kingdom (Northern Ireland) Health system review. Health Syst Transit. 2012;14(10):xiii–xix. [PubMed] [Google Scholar]
- 27.O’Reilly D, Thompson KJ, Murphy AW, Bury G, Gilliland A, Kelly A, et al. Socio-economic gradients in self-reported health in Ireland and Northern Ireland. Ir J Med Sci. 2006;175(3):43–51. doi: 10.1007/BF03169172. [DOI] [PubMed] [Google Scholar]
- 28.O’Kelly M, Teljeur C, O’Kelly F, Ni Shúilleabháin A, O’Dowd T. Structure of general practice in Ireland 1982 - 2015. 2016. [Google Scholar]
- 29.Cupples ME, Byrne MC, Smith SM, Leathem CS, Murphy AW. Secondary prevention of cardiovascular disease in different primary healthcare systems with and without pay-for-performance. Heart. 2008;94:1594–1600. doi: 10.1136/hrt.2008.145912. [DOI] [PubMed] [Google Scholar]
- 30.Health Service Executive Primary Care Reimbursement Service. Primary care reimbursement service statistical analysis of claims and payments 2019. Dublin: Health Services Executive; 2019.
- 31.Health and Social Care Board. General medical services - frequently asked questions http://www.hscboard.hscni.net/our-work/integrated-care/gps/faqs/2020. Accessed 12 Aug 2020.
- 32.McCarthy C, Clyne B, Corrigan D, Boland F, Wallace E, Moriarty F, et al. Supporting prescribing in older people with multimorbidity and significant polypharmacy in primary care (SPPiRE): a cluster randomised controlled trial protocol and pilot. Implement Sci. 2017;12:99. doi: 10.1186/s13012-017-0629-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: Template for Intervention Description and Replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687. doi: 10.1136/bmj.g1687. [DOI] [PubMed] [Google Scholar]
- 34.Lewis T. Using the NO TEARS tool for medication review. BMJ. 2004;329:434. doi: 10.1136/bmj.329.7463.434. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Avery AJ, Rodgers S, Cantrill JA, Armstrong S, Cresswell K, Eden M, et al. A pharmacist-led information technology intervention for medication errors (PINCER): a multicentre, cluster randomised, controlled trial and cost-eff ectiveness analysis. Lancet. 2012;379:1310–1219. doi: 10.1016/S0140-6736(11)61817-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258. doi: 10.1136/bmj.h1258. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Avery KNL, Williamson PR, Gamble C, O’Connell Francischetto E, Metcalfe C, Davidson P, et al. Informing efficient randomised controlled trials: exploration of challenges in developing progression criteria for internal pilot studies. BMJ. 2017;7:1–12. [DOI] [PMC free article] [PubMed]
- 38.Billingham SAM, Whitehead AL, Julious SA. An audit of sample sizes for pilot and feasibility trials being undertaken in the United Kingdom registered in the United Kingdom Clinical Research Network database. BMC Med Res Methodol. 2013;13:104. doi: 10.1186/1471-2288-13-104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Rutterford C, Copas A, Eldridge S. Methods for sample size determination in cluster randomized trials. Int J Epidemiol. 2015;44(3):1051–1067. doi: 10.1093/ije/dyv113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Farrin A, Russell I, Torgerson D, Underwood M. Differential recruitment in a cluster randomized trial in primary care: the experience of the UK back pain, exercise, active management and manipulation (UK BEAM) feasibility study. Clin Trials. 2005;2(2):119–124. doi: 10.1191/1740774505cn073oa. [DOI] [PubMed] [Google Scholar]
- 41.Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health Ment Health Serv Res. 2011;38:65–76. doi: 10.1007/s10488-010-0319-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Sturges JE, Hanrahan KJ. Comparing telephone and face-to-face qualitative interviewing: a research note. Qual Res. 2004;4:107–118. [Google Scholar]
- 43.Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13:117. doi: 10.1186/1471-2288-13-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.EuroQol Group EuroQol--a new facility for the measurement of health-related quality of life. Health Policy. 1990;6(3):199–208. doi: 10.1016/0168-8510(90)90421-9. [DOI] [PubMed] [Google Scholar]
- 45.Gillespie P, O’Shea E, Murphy AW, Byrne MC, Byrne M, Smith SM, et al. The cost-effectiveness of the SPHERE intervention for the secondary prevention of coronary heart disease. Int J Technol Assess Health Care. 2010;26(3):263–271. doi: 10.1017/S0266462310000358. [DOI] [PubMed] [Google Scholar]
- 46.Gillespie P, Murphy E, Smith SM, Cupples ME, Byrne M, Murphy AW. Long term cost effectiveness of cardiac secondary prevention in primary care in the Republic of Ireland and Northern Ireland. Eur J Health Econ. 2017;18:321–335. doi: 10.1007/s10198-016-0777-2. [DOI] [PubMed] [Google Scholar]
- 47.Mangin D, Lamarche L, Agarwal G, et al. Team approach to polypharmacy evaluation and reduction: study protocol for a randomized controlled trial. Trials. 2021;22(1):746. doi: 10.1186/s13063-021-05685-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Lee J, Negm A, Peters R, Wong EKC, Holbrook A. Deprescribing fall-risk increasing drugs (FRIDs) for the prevention of falls and fall-related complications: a systematic review and meta-analysis. BMJ Open. 2021;11(2):e035978. doi: 10.1136/bmjopen-2019-035978. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Bleijenberga N, de Man-van Ginkela JM, Trappenburga A, Ettemab RGA, Sinob CG, Heima N, et al. Increasing value and reducing waste by optimizing the development of complex interventions: enriching the development phase of the Medical Research Council (MRC) Framework. Int J Nurs Stud. 2018;79:86–93. doi: 10.1016/j.ijnurstu.2017.12.001. [DOI] [PubMed] [Google Scholar]
- 50.Byrne M. Gaps and priorities in advancing methods for health behaviour change research. Health Psychol Rev. 2020;14(1):165–175. doi: 10.1080/17437199.2019.1707106. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Additional file 1. SPIRIT 2013 Checklist: Recommended items to address in a clinical trial protocol and related documents*.
Additional file 2. The TIDieR (Template for Intervention Description and Replication) Checklist.
Additional file 3. Summary of data collection.
Additional file 4. MyComrade Logic Model.
Data Availability Statement
NA

