Abstract
Pragmatic randomised clinical trials could use existing electronic health records (EHRs) to identify trial participants, perform randomisation, and to collect follow-up data. Achieving adequate informed consent in routine care and clinician recruitment have been identified as key barriers to this approach to clinical trials. We propose a model where written informed consent for a pragmatic comparative effectiveness trial is obtained in advance by the research team, recorded in the EHR, and then confirmed by the general practitioner (GP) at the time of enrolment. The EHR software then randomly assigns a patient to one of two treatments. Follow-up data is collected in the EHR. Twenty-two of 23 GPs surveyed (96%) were ‘definitely’ or ‘probably’ comfortable with confirming consent. Twenty-one out of 23 GPs (91%) were ‘definitely’ or ‘probably’ comfortable with a patient being randomised to one of two comparable drugs during a routine consultation. Twenty-two out of 23 GPs (96%) were ‘definitely’ or ‘probably’ comfortable with allowing the electronic system to randomise a patient to drug A or drug B and generate a prescription. Ten out of 23 GPs (43%) identified time constraints as the main hurdle to conducting this sort of research in the primary care setting. On average, it was felt that 6.5 min, in addition to a usual consult, would be acceptable to complete enrolment. Our survey found this model of a comparative effectiveness trial to be acceptable to the majority of GPs.
Electronic supplementary material
The online version of this article (10.1186/s13063-018-2658-8) contains supplementary material, which is available to authorized users.
Keywords: Pragmatic randomised controlled trial, Informed consent, Comparative effectiveness research, Pharmacology, Trial design, Electronic health records
Background
Pragmatic randomised clinical trials (RCTs) are emerging as powerful research strategies that seek to generate findings with greater external validity when compared with traditional RCTs. Pragmatic RCTs test the effectiveness of an intervention within the existing health system. Study participants, and the context of their care, reflect treatment in the ‘real world’ with randomised trial treatments, follow-up, and data collection occurring in a wider health system that is authentic to usual practice [1, 2]. Primary care electronic health records (EHRs) are an appealing tool to identify patients for pragmatic RCTs, record participant enrolment, perform randomisation, follow participants over time, and facilitate collection of patient-relevant outcome data. The benefits of this strategy were heralded 5 years ago [3], but very few point-of-care pragmatic RCTs have been conducted using primary care EHRs.
Retropro (ISRCTN33113202) and eLung (ISRCTN72035428) were point-of-care pragmatic RCTs conducted using EHRs in the United Kingdom’s National Health Service. Retropro randomised patients with a high cardiovascular risk profile to either simvastatin or atorvastatin whereas eLung randomised patients with exacerbations of chronic obstructive airways disease to immediate antibiotics, deferred antibiotics, or non-use of antibiotics. A National Institute for Health Research (NIHR) report evaluated the successes and difficulties of these trials and concluded that clinician recruitment was a major challenge [4].
Interview data from general practitioners (GPs) involved in the eLung study identified a lack of time within a routine patient consultation as the over-riding concern with this model for conducting RCTs, particularly the challenge of obtaining and documenting informed consent within a regular consultation [4]. This is in keeping with other work that identified achieving informed consent as a key barrier to pragmatic RCTs in general [5, 6]. Lastly, Good Clinical Practice inspectors stated that: ‘subjects should be given ample time to understand the implications of the study’ and that ‘recruitment at the same consultation as the screening may be less acceptable’ [4].
We propose a modified pragmatic RCT design centred on a priori consent to address these concerns and present feedback from the GPs likely to be involved in future trials.
Methodology
A convenient sample of GPs, predominantly members of a GP research network associated with the Medical Research Institute, were contacted by email with information on a proposed model for conducting pragmatic RCTs in primary care (see Additional file 1) and a survey on its acceptability (see Additional file 2). Data from the electronic survey was collected and managed using REDCap electronic data capture tools hosted at the Medical Research Institute of New Zealand (MRINZ) [7].
Results
Twenty-three GPs completed the survey. Twenty-one GPs (91%) were ‘definitely’ or ‘probably’ comfortable with a patient being randomised to one of two comparable drugs during a routine consultation; the remaining two GPs were ‘not sure’ and no GPs were ‘probably not’ or ‘definitely not’ comfortable with this approach.
We proposed a system of a priori consent – where patients are contacted prospectively (before being diagnosed with the relevant condition), provided with access to written information on the trial, able to ask questions directly of the research team, and who then opt in by giving their written informed consent – either for a specific study or for comparative effectiveness trials more generally – before study enrolment. We have recently demonstrated that a priori consent was preferable to patients in this context [8]. A priori consent is then documented in the EHR. At any point during the study, patients can contact the research team to ask questions and to withdraw their consent. If/when a patient becomes eligible (for example, by being diagnosed with the relevant medical condition), the EHR highlights the patient’s eligibility and written consent in the medical record. The GP can confirm with the patient that they consent to entering the trial. Twenty-two GPs (96%) were ‘definitely’ or ‘probably’ comfortable with confirming consent using the electronic record system; the remaining GP was ‘not sure’.
Generally, randomisation to one of two commonly used treatments will occur if patients fulfil the following criteria: they are diagnosed with the relevant medical condition in the EHR, informed consent was given a priori, and this consent to participate has been confirmed by the GP. The EHR software would then randomly assign the patient to one of two treatment arms. Twenty-two GPs (96%) were ‘definitely’ or ‘probably’ comfortable with allowing the electronic system to randomise that patient to drug A or drug B and generate a prescription; the remaining GP was ‘not sure’.
Ten out of 23 GPs (43%) identified time constraints as the primary hurdle to conducting this sort of research in general practice, making it the most commonly identified barrier above practice team participation (2/23, 9%) and software limitations (2/23, 9%). On average, the 23 GPs felt that 6.5 min, in addition to a usual consult, would be acceptable to complete enrolment.
Conclusions
Conducting pragmatic RCTs that utilise EHR software to randomise patients to one of two or more commonly used treatments was generally an acceptable strategy for this small group of GPs who are likely to be involved in pilot, pragmatic RCT projects. An important limitation of our survey relates to the convenient sampling methodology and these opinions may not reflect those in the wider general practice community. In designing such trials, it is important minimise additional demands on GPs’ time. Shifting the responsibility for achieving written informed consent from the GP to the study team, by obtaining this consent from potentially eligible patients a priori, may render participation in pragmatic RCT research more appealing for GPs.
We plan to undertake pragmatic RCTs in primary care to answer comparative effectiveness questions for commonly prescribed drugs. The choice of study question will need to carefully consider the risks and benefits for patients entering such a pragmatic RCT, as well as the acceptability to GPs and management as important stakeholders in primary care.
Additional files
Acknowledgments
Funding
The MRINZ receives Health Research Council of New Zealand Independent Research Organisation funding.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Abbreviations
- EHR
Electronic health record
- GP
General practitioner
- MRINZ
Medical Research Institute of New Zealand
- NIHR
National Institute of Health Research
- RCT
Randomised clinical trial
Authors’ contributions
TH, AS, and RB wrote the introductory information on the proposed pragmatic RCT model for GPs (see Additional file 1) and the survey questions (see Additional file 2). TH and AS collated the survey responses. TH, AS, and RB prepared the final manuscript. All authors read and approved the final manuscript.
Ethics approval and consent to participate
This project was approved by Victoria University of Wellington Ethics Committee (ref: 22859). Respondents gave informed consent to participate in the study.
Consent for publication
GPs agreed to participate in the survey on the understanding that their data would not be published in any identifiable form.
Competing interests
The authors are working to establish a platform for conducting pragmatic RCTs in primary care. The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Footnotes
Electronic supplementary material
The online version of this article (10.1186/s13063-018-2658-8) contains supplementary material, which is available to authorized users.
Contributor Information
Thomas Hills, Email: tom.hills@mrinz.ac.nz.
Alex Semprini, Email: alex.semprini@mrinz.ac.nz.
Richard Beasley, Email: richard.beasley@mrinz.ac.nz.
References
- 1.Ford I, Norrie J. Pragmatic trials. N Engl J Med. 2016;375(5):454–463. doi: 10.1056/NEJMra1510059. [DOI] [PubMed] [Google Scholar]
- 2.Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350(1):h2147. doi: 10.1136/bmj.h2147. [DOI] [PubMed] [Google Scholar]
- 3.van Staa T-P, Goldacre B, Gulliford M, et al. Pragmatic randomised trials using routine electronic health records: putting them to the test. BMJ. 2012;344:e55. doi: 10.1136/bmj.e55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.van Staa T-P, Dyson L, McCann G, et al. The opportunities and challenges of pragmatic point-of-care randomised trials using routinely collected electronic records: evaluations of two exemplar trials. Health Technol Assess. 2014;18(43):1–146. doi: 10.3310/hta18430. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Pletcher MJ, Lo B, Grady D. Informed consent in randomized quality improvement trials: a critical barrier for learning health systems. JAMA Intern Med. 2014;174(5):668–670. doi: 10.1001/jamainternmed.2013.13297. [DOI] [PubMed] [Google Scholar]
- 6.Faden RR, Beauchamp TL, Kass NE. Informed consent, comparative effectiveness, and learning health care. N Engl J Med. 2014;370(8):766–768. doi: 10.1056/NEJMhle1313674. [DOI] [PubMed] [Google Scholar]
- 7.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381. doi: 10.1016/j.jbi.2008.08.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Semprini A, Hills T, Braithwaite I, Weatherall M, Beasley R. A priori consent within pragmatic randomised controlled trials: a web-based survey of statin use in primary care. BMJ Innov. 2017;3(4):206. LP-211. Available at: http://innovations.bmj.com/content/3/4/206. Accessed 24 Mar 2018.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.