Abstract
Introduction
Long COVID (LC), the persistent symptoms ≥12 weeks following acute COVID-19, presents major threats to individual and public health across countries, affecting over 1.5 million people in the UK alone. Evidence-based interventions are urgently required and an integrated care pathway approach in pragmatic trials, which include investigations, treatments and rehabilitation for LC, could provide scalable and generalisable solutions at pace.
Methods and analysis
This is a pragmatic, multi-centre, cluster-randomised clinical trial of two components of an integrated care pathway (Coverscan™, a multi-organ MRI, and Living with COVID Recovery™, a digitally enabled rehabilitation platform) with a nested, Phase III, open label, platform randomised drug trial in individuals with LC. Cluster randomisation is at level of primary care networks so that integrated care pathway interventions are delivered as “standard of care” in that area. The drug trial randomisation is at individual level and initial arms are rivaroxaban, colchicine, famotidine/loratadine, compared with no drugs, with potential to add in further drug arms. The trial is being carried out in 6–10 LC clinics in the UK and is evaluating the effectiveness of a pathway of care for adults with LC in reducing fatigue and other physical, psychological and functional outcomes at 3 months. The trial also includes an economic evaluation which will be described separately.
Ethics and dissemination
The protocol was reviewed by South Central—Berkshire Research Ethics Committee (reference: 21/SC/0416). All participating sites obtained local approvals prior to recruitment. Coverscan™ has UK certification (UKCA 752965). All participants will provide written consent to take part in the trial. The first participant was recruited in July 2022 and interim/final results will be disseminated in 2023, in a plan co-developed with public and patient representatives. The results will be presented at national and international conferences, published in peer reviewed medical journals, and shared via media (mainstream and social) and patient support organisations.
Trial registration number
Introduction
The syndrome of Long COVID (LC), defined by persistent post-COVID-19 symptoms ≥12 weeks [1], has affected over 2 million people in the UK alone [2], necessitating health system responses despite incomplete disease characterisation. While many symptoms are reported by individuals with LC, fatigue is the most frequent and most commonly reported to limit quality of life [3, 4]. Among other symptoms are chest pain, ‘brain fog’, dyspnoea, headache, dizziness, palpitations, and sleep disturbances [5]. Unlike acute COVID-19 [6], predictors of poor outcomes and effective management are not yet established for LC [7–9]. Integrated care pathways are structured, multidisciplinary plans in care of specific conditions [10], offering coordination across specialties, investigations, treatment, and rehabilitation, as well as opportunities for real-time, iterative improvements in service design and delivery [11–13].
There is variation in access to referral and care, and poor patient experience for LC [14]. With stretched resources during the pandemic, rationalisation of investigation and rehabilitation across diseases is crucial. In LC, non-hospitalised individuals were more symptomatic, more likely to have psychological impact, and less likely to be fit for work than post-hospitalised individuals. Up to 70% of individuals have mild organ impairment using CoverscanTM, a multi-organ MRI protocol [15]. In the context of variable waiting times, resources and practice (with frequent repeating of investigations and referrals to multiple specialists [3]), an early supported, multi-organ investigation strategy like this may direct management, as well as better defining the syndrome, with relevance to other long-term conditions. A negative finding could rule out organ involvement and other disease early, reassuring clinicians and patients, rather than organising multiple investigations with multiple specialists via multiple referrals. By flagging organ dysfunction, early, appropriate specialist referral and management may be initiated. There is no evidence-based treatment or rehabilitation, with few clinical trials to-date, particularly in non-hospitalised individuals, or considering overall care pathways. Although digital rehabilitation platforms (e.g. Living with COVID RecoveryTM) may be scalable, particularly with strained rehabilitation services, and already being used in some centres, they are not yet evaluated in trials [16]. Despite roll-out of 90 centrally funded LC clinics in England, ICPs are neither coordinated nor evaluated. Trials of integrated care pathways could inform diagnosis, care, public health, policy planning, resource allocation and budgeting.
Antihistamines (e.g., loratadine and famotidine), colchicine and rivaroxaban are examples of medications being widely used among patients and health professionals with rationale for use (S1 Appendix), but without proven efficacy. Platform trials have been used at scale to evaluate therapies in acute COVID-19 [17], but not in LC. Since underlying causes are unknown and subtypes poorly defined, trials should test drugs across all individuals with LC, irrespective of individual symptoms or investigation findings, to allow multiple secondary sub-group analyses. Optimal outcomes for LC are yet to be fully defined. Therefore, trials should evaluate a wide range of potential physical, psychological and functional outcomes. We report the protocol for the STIMULATE-ICP (Symptoms, Trajectory, Inequalities and Management: Understanding Long COVID to Address and Transform Existing Integrated Care Pathways) trial (Fig 1).
Objectives
For individuals with LC, to evaluate the:
effect of “integrated care” versus “usual care”.
- clinical efficacy of
- individual components of an integrated care pathway
- potential drug therapies within a nested drug trial.
pathophysiology, trajectory and outcomes, including healthcare utilisation (Tables 1 and 2)
Table 1. Research question in STIMULATE-ICP.
Over-arching research question: What is the effectiveness of an integrated care pathway for individuals with Long Covid, compared with usual care? Population: Individuals ≥18 years with ≥4 weeks post-COVID symptoms (in line with UK clinical guidance and policy), based on clinician diagnosis, newly referred to participating Long COVID clinics. Intervention: Investigation: Multi-organ MRI prior to Long Covid clinic assessment (CoverscanTM) Treatment: Multiple drug arms, starting with famotidine/loratadine, colchicine and rivaroxaban Rehabilitation: Digitally enabled rehabilitation (Living with COVID RecoveryTM) Comparator: Investigation: Usual care Treatment: No drug Rehabilitation: Usual care Outcomes: Primary- Fatigue on the fatigue assessment scale at 12 weeks. Secondary- Multiple assessments of health-related quality of life, mental health (including depression), work and social adjustment, physical function, organ impairment and healthcare utilisation at 12 and 24 weeks. |
Table 2. Summary of the primary and secondary objectives and outcome measures.
Objectives | Outcome Measures | Timepoint(s) of evaluation of this outcome measure |
---|---|---|
Primary Objective Evaluation of the effect of “integrated care” with combinations of multi-organ MRI (Coverscan™) and clinical decision support, and digitally enabled community rehabilitation (Living with COVID Recovery™) versus “usual care” [Usual Investigations; and Your COVID Recovery TM self-management website] on Fatigue Assessment Scale at 12 Weeks from the date of enrolment in the trial. |
FAS | Baseline, 12 and 24 weeks |
Secondary Objectives The overall clinical efficacy of the individual components of the integrated care pathway including potential therapies. 1. Effect of the ICP on mean measured health related quality of life, mental health (including depression), work and social adjustment, physical function, organ impairment and healthcare utilisation, through patient reported outcomes. 2. To determine if pre-specified sub-groups of patients, either grouped by clinical symptom cluster or imaging findings benefit from either early investigation with COVERSCAN™, IMPs or rehabilitation. |
1. FAS at 24 weeks 2. Health related quality of life (EQ-5D-5L) 3. Mental health (GAD-7) 4. Depression (PHQ-9) 5. MRC Dyspnoea Score 6. Perceived Deficit Questionnaire (PDQ-5) 7. Work and Social Adjustment Scale (WSAS) [Question 4 from Productivity Cost Questionnaire (iPCQ) for absenteeism and Question 8 from iPCQ for presenteeism added] 8. Short Form Questionnaire (SF-12) 9. Cognitive Failure Questionnaire (CFQ) if a patient scores 3 or more on PDQ5 (patients receive an email to complete this questionnaire online via a secure password and patient ID number) 10. Organ impairment and healthcare utilisation 11. Cost-effectiveness of ICP 12. Process outcomes for different ICP components |
Baseline, 12 and 24 weeks |
3. To characterise the pathophysiology and trajectory of long COVID | Blood investigations (e.g., genomic, proteomic, metabolomic/ lipidomic, functional T cell and live virus neutralisation assays and endocrine analysis) | Baseline |
Linked electronic health record data to monitor healthcare utilisation and outcomes. | 12 months |
Methods and analysis
Design
STIMULATE-ICP is a pragmatic, cluster-randomised trial of two components of an integrated care pathway with a nested, Phase III, open label platform randomised drug trial in individuals with LC. It is responsive to local resources and needs, reactive to changing pandemic and policy contexts and iterative, depending on ongoing results, as part of a National Institute for Health Research (NIHR: COV-LT2-0043 [18]) -funded programme (Fig 2), with epidemiologic and mixed methods studies, including care inequalities and transferability to other long-term conditions [19]; IRAS 303958 [20]) and this complex intervention trial (IRAS 1004698).
Setting
This multi-centre trial involves Primary Care Networks and LC Clinics in 6–10 different English areas, covering diversity of geography, demography and clinical service design. Management is by Lancashire Clinical Trials Unit and sponsorship by University College London.
Intervention
In this trial, “integrated care” comprises two integrated care pathway interventions, cluster-randomised at Primary Care Network level: Coverscan™ (community based, multi-organ MRI with clinical decision support)(15) and Living with COVID Recovery™ (enhanced community based, digitally enabled rehabilitation)(16). The Coverscan will have a standardised report. For the first 100 scans across sites, there will be report by an independent radiologist, and a virtual, weekly multidisciplinary meeting to discuss any cases and potential implications of findings, management and/or referral to specialists. We did not have or develop an algorithmic management approach (i.e. clinical decision support) or a “manual” because the organ dysfunction in Long Covid is still being defined and a manual would involve approaches to any possible finding in lungs, heart, liver, pancreas and kidneys, which is not feasible, at present.
“Usual care” comprises usual investigations (e.g. routine blood tests, electrocardiogram, chest radiograph or exercise tolerance test); and self-managed rehabilitation with online resources (Your COVID Recovery™: https:\\www.yourcovidrecovery.nhs.uk) in the LC clinic pathway, which is standard of care.
In a nested, open label, adaptive platform trial, a 12-week course of one of three drug arms will be evaluated (individual level randomisation): famotidine+loratadine, colchicine and rivaroxaban, compared with no drugs.
Sites
This is a pragmatic trial, comparing two integrated care pathway interventions to usual care, ensuring that research does not impact/change workload for already over-stretched healthcare resources, whilst ensuring equity of access to care.
Randomisation
Given current COVID-related health system pressures, individual level randomisation for integrated care pathway interventions (Coverscan™ and Living with COVID Recovery™) at General Practitioner level is not feasible and could potentially increase waiting times in other areas of care, which could affect recruitment. Unlike individual randomisation, cluster randomising at primary care network level allows 50–50 chance of allocation to both Coverscan™ and Living with COVID Recovery™, maintaining access across the total number of referred individuals and equipoise at clinic level. Randomisation will use demographic and socioeconomic data available for each primary care network, ensuring equity of access through deprivation indexes of GP postcodes. Clustering at primary care network level allows Coverscan™ and/or Living with COVID Recovery™ to be provided as uplift to usual care in allocated primary care networks, becoming integrated care within that primary care network without the need for individual consent. Access to and collection of Coverscan™ and Living with COVID Recovery™ data for research will be by individual consent on study entry (by the research staff). Cluster randomisation (2x2 factorial design) provides four groups:
Coverscan™ + Living with COVID Recovery™ App.
Coverscan™ + Usual Care Self-Management Rehabilitation.
No Coverscan™ + Living with COVID Recovery™ App.
No Coverscan™+ Usual Care Self- Management Rehabilitation.
At the LC clinic, individuals eligible for the drug study will be randomised to one of 4 arms:
Famotidine + Loratadine
Colchicine
Rivaroxaban
No Drug
Other drugs may be added as additional or replacement arms for new patients at predetermined time points during the trial (6 months and 12 months), dependent on interim analysis of trial data with consideration given to updated recommendations from an independent advisory board.
Individuals who are ineligible for the drug study will invited to participate for data collection, which will enable data collection to represent the overall LC population.
Randomisation methods
Block randomisation for the primary care networks will be used with blocks of size 4. There are two factors in the randomisation, and within each clinic: primary care network size (categorised into 2 levels) and primary care network deprivation (categorised into 2 levels). Within each clinic, the strata of primary care networks will be arranged as larger and more deprived; larger and less deprived; smaller and less deprived; and smaller and more deprived, before randomised allocation into the 4 cluster allocations. The randomisation ratio is 1:1:1:1 between the 4 possible treatment pathways.
Randomisation to the drug trial at the clinic will be at individual participant level using an online system (Sealed Envelope™). Block randomisation will be used with varying block sizes. There will be two factors in the randomisation within each clinic: gender (male vs female) and treatment pathway. The randomisation ratio will be equal between all drug treatment arms (including no drug: “usual care”) open to recruitment at that point in the cluster trial.
Timeline
We aim to recruit individuals over a 12-month period. The 12-week treatment duration in the drug trial and the 12-week primary outcome, fatigue, were selected to match the 12-week duration of the commissioned National Health Service (NHS) LC clinic pathway. Outcomes will also be assessed at 24 weeks. The overall trial will run over an 18-month period.
Participants
Participants are ≥18 years with ≥4 weeks post-COVID symptoms (in line with UK clinical guidance and policy), based on clinician diagnosis, newly referred to participating LC clinics. The vast majority of people included will have had symptoms for >12 weeks, based on delays in the current care pathways and our preliminary University College London Hospital data.
Inclusion criteria for ALL participants
Capable of giving informed consent.
Age 18 years and above
Clinical Parameters: persistent signs and symptoms for a period of 4 weeks or longer in duration post-COVID-19 infection (either by test result or symptomology). Presenting at their first referral first visit to a participating LC clinic pathway.
Able to read or understand English or have a relative/family member able to read/understand English to facilitate participation (essential for patient reported outcome measures at follow-up time points and virtual contact).
Not enrolled in any other interventional study where study intervention/activities may affect outcome measures (individuals enrolled in purely observational studies can be included)
S2 Appendix lists additional Inclusion Criteria for the nested, platform randomised drug trial to be met in addition to all above criteria, and also details of assessment of eligibility, recruitment and withdrawal of consent.
Assessment and follow-up
All Participants, once consented, regardless of study arm, will be invited to complete assessments at baseline, 12 and 24 weeks.
Baseline visit
Demographics, full medical history (from January 2020, including comorbidities and all COVID-related illnesses, treatments, and vaccinations); history of concomitant medication including current, pre- and post- COVID-19 and over-the-counter medications; and physical examination (including weight, height, oral temperature, resting pulse, and blood pressure) will be recorded.
Routine clinical blood tests performed in primary care, and following clinic assessment at point of referral, will be collected as part of trial data. Blood tests will differ by clinic, based on differences in usual care and service capacity and capability. Individuals who consent for research blood sampling and for further research will have approximately 60mls blood taken for translational sub-studies and biobanking (S3 Appendix). All participants who have consented for bloods will be asked to confirm if they would be willing to be contacted at 12 or 24 weeks for further blood sampling.
Standard investigations differ from clinic to clinic. To evaluate usual care, the study will not require a standardised testing strategy; but will collect any data related to individual consented participants’ investigations, including Coverscan™. Examples of functional tests in some clinics are detailed in S4 Appendix. If the participant consents to the drug trial, a prescription or the drug will be issued and the first dose taken at the clinic (depending on the location of the recruiting site at the participating centres) or at the time of randomisation or at home for those sites using an drug delivery service (date of first dose to be confirmed via telephone by site research team). The Patient Reported Outcome Questionnaires and functional tests to be completed are listed in S5 Appendix and Fig 1.
12-Week assessment visit
Patient Reported outcome measures and activities will be collected at 12 weeks (± 7 days) to record primary and secondary outcome measures. This may not be possible in all individuals due to level of fatigue. Participants will be supported by flexibility of data collection processes. Patient reported outcome measures will be collected either at the LC clinics, by post, entered by participants themselves via secure electronic link or over the phone as per participant choice. Non-patient reported data will be extracted from clinical records by site-specific research staff and entered in the trial database (listed in S6 Appendix).
24-Week assessment visit
All participants will be followed up for 24 Weeks (± 7 days) from enrolment date by Lancashire Clinical Trials Unit staff. Participants will be given choice of completing questionnaires online using an individualised secure link, by postal return or via telephone for participants requiring support. In the event of receiving an incomplete outcome assessment, participants will be contacted by phone within 7 days of the team receiving the form (e-form or paper) to complete missing information with the individual. Data will be entered into the trial database by Lancashire Clinical Trials Unit staff. Patient Reported Outcome measures and functional assessments recorded are listed in S7 Appendix.
Outcomes
Fatigue is the dominant symptom in 60% of patients and LC clinics are being commissioned to provide rehabilitation for 12 weeks or less. Fatigue Assessment Scale (FAS) is a 10-item, validated questionnaire in individuals with chronic diseases, including LC [4, 16], making it a pragmatic primary end point at 12 weeks. Five questions reflect physical fatigue and five questions (questions 3 and 6–9) reflect mental fatigue. The total score ranges from 10 to 50.
Secondary outcomes include:
FAS at 24 weeks
Health related quality of life (EQ-5D-5L) [21]
Mental health (GAD-7) [22]
Depression (PHQ-9) [23]
Medical Research Council Dyspnoea Score [24]
Perceived Deficit Questionnaire (PDQ-5) [25]
Work and Social Adjustment Scale (WSAS) [Question 4 from Productivity Cost Questionnaire (iPCQ) for absenteeism and Question 8 from iPCQ for presenteeism added] [26, 27]
Short Form Questionnaire (SF-12) [28]
Cognitive Failure Questionnaire (CFQ) if an individual scores 3 or more on PDQ5 (individuals receive an email to complete this questionnaire online via a secure password and patient ID number) [29, 30]
Organ impairment and healthcare utilisation
Cost-effectiveness of integrated care pathway (a separate health economic evaluation is planned [18]) and the protocol will be published separately)
Process outcomes for different ICP components
Blood investigations (e.g., genomic, proteomic, metabolomic/ lipidomic, functional T cell and live virus neutralisation assays and endocrine analyses)
Linked electronic health record data to monitor healthcare utilisation and outcomes.
A core outcome data set for clinical and research use in individuals with LC is being developed. Based on a NIHR-funded research programme (Post-COVID Core Outcome Set ([31])) which conducted an extensive, global Delphi process in over 1500 patients and health professionals, we included consensus physiological/clinical, life impact and recovery domains. As our trial progresses, we will collaborate to iteratively and pragmatically develop LC core outcomes.
Data collection
All electronic and paper clinical research forms (CRFs) must be completed and signed by designated, authorised research team staff. Information from paper CRFs will be entered into an electronic CRF within the electronic trial database by the site team directly for the baseline and 12 -week assessment (where participants attend in person). For virtual clinics and where the patients are not returning to the clinic in person, participants will be given the option of completion via postal, e-link (directly into database for self-completion) or over the telephone for participants requiring support. All the CRFs will be entered into the trial database within 15 days of data received by the site staff or CTU staff as applicable. Table 2 summarises objectives and outcome measures and when they will be collected. All data are managed in accordance with Lancashire Clinical Trials Unit standard operating procedures (DM-03 and DM-05) and a trial-specific Data Management Plan. Where data are transferred electronically this will be in accordance with the UK Data Protection Act 2018 as well as sponsor and trials unit information security and governance policies. Further details regarding data collection and the Data Management Plan are in S8 Appendix.
Analysis
The trial will be analysed and reported using “Consolidated Standard of Reporting Trials‟ (“CONSORT”) [32] and International Conference on Harmonisation E9 guidelines [33]. Baseline characteristics of all consenting participants will be reported by frequency and percentage for categorical variables, and by mean and standard deviation for continuous variables (or median and inter-quartile range for non-normally distributed data).
Primary outcomes
Primary analysis of the trial will be a complete case analysis using all available outcomes, according to cluster randomised allocation of participant’s primary care network (regardless of treatment pathways received) or the stratified randomisation of the individual participant (regardless of treatment received). The primary outcome, FAS at 12 weeks, is expected to be approximately normally distributed [34]. A multi-level model analysis will be used to evaluate effects of Coverscan™, Living with COVID RecoveryTM, and their interaction, on FAS at 12 weeks adjusting for baseline FAS, with clinic and primary care network as random effects.
Effect of “integrated care” versus “usual care”
The principal analysis population for estimates of the interaction of effects of Coverscan™, Living with COVID RecoveryTM will be those participants (up to 1130) who consented to data collection for the cluster RCT and were allocated to usual care (either by randomisation to no drug in the drug trial or being willing for data collection, but not eligible for the drug trial, or unwilling to be randomised into the drug trial; (Sample 1 in Fig 2)). This analysis will provide the most straightforward answer to the primary objective in the broadest group of participants. A similar and more pragmatic multi-level model analysis of effects of Coverscan™, Living with COVID RecoveryTM, and their interaction, will be applied to all participants who consent to data collection in the cluster trial regardless of participation in the drug trial. This analysis will provide an answer to the primary objective in the presence of other treatments including drug treatments and will allow comparison to principal analysis results.
Clinical efficacy of individual components of an integrated care pathway
This analysis is similar to the prior analysis but focusing on individual effects of Coverscan™ and Living with COVID RecoveryTM.
Clinical efficacy of potential drug therapies within a nested drug trial
The principal analysis population for drug vs. usual care (no drug) comparisons within the drug trial will be the participants randomised to the control treatment pathway, i.e. no Coverscan + usual care rehabilitation (Sample 2 in Fig 3). Participants randomly allocated to each drug arm will be compared to those randomly allocated to usual care while both that drug and usual care are options for randomisation (concurrent usual care controls). A multi-level model for FAS, adjusting for baseline, with gender as a fixed effect and clinic and primary care network as random effects, will be applied to the drug trial data. By restricting comparisons of effects of drugs vs. usual care on fatigue to those participants allocated to the treatment pathway incorporating the lowest level of intervention, and potentially the least variation in care, this will give the cleanest and least biased comparison. The total population of participants who are randomised into the drug trial will be used to study effects of drugs in combination/interaction with the pathways.
A multi-level model for FAS, adjusting for baseline, with gender as a fixed effect and clinic and primary care network as random effects, will be applied to data from all participants of both the cluster trial and the drug trial to evaluate effects of Coverscan™, Living with COVID RecoveryTM, and their interaction, in combination with participants’ allocated drug treatment. For all drug therapies, particularly any introduced after start of the trial, comparisons with participants randomised to no drug will include only those participants who could have been randomised to the relevant drug treatment at the time of their randomisation, reducing potential bias and ensuring that only concurrent participants allocated to no drug are compared to participants randomised to drug treatments.
Pathophysiology, trajectory and outcomes, including healthcare utilisation
Using data from blood investigations (e.g. haematology, biochemistry, immunology and -omic analyses), we will study associations with FAS and other outcomes to investigate pathophysiology. We will use linked electronic health record data to monitor healthcare utilisation (e.g. outpatient attendances, emergency department attendances and hospital admissions) and other outcomes (e.g. FAS) in the overall trial population and in subgroups. A separate economic analysis plan will be published and followed.
Secondary outcomes and missingness
Secondary outcomes on an interval scale will be analysed similarly to the primary outcome, adjusting for baseline outcome measure, clinic and primary care network as a random effect. Where appropriate, alternative methods will be applied to outcomes with skewed distributions.
Patterns of missingness will be summarised. In modelling, complete case analysis will be the main analysis, using a threshold approach as a sensitivity analysis for missing outcome data. Imputation based on thresholds will be implemented such that missing values will be replaced by values from the lower and upper quantiles of the distribution, e.g. 90th quantile, 75th quartile, 25th quartile, 10th quantile, and minimum. Other patient reported secondary outcomes with missing items will be addressed using recommended methods for missing items for that scale.
Sensitivity and subgroup analyses
A sensitivity analysis of the effects of Coverscan™, Living with COVID RecoveryTM, and their interaction, will include only those who are randomly allocated to receive usual care (no drug) in the drug trial. Results will be compared to those of the (broader) principal analysis population which also includes those unwilling or unable to be included in the drug trial.
Health outcomes and health utilisation data taken from medical records at 12 months will be described using summary statistics for all participants and for subgroups defined by sub-phenotype (clinical or pathophysiological) at baseline. Analyses of all subgroups will be considered as exploratory. Subgroups may include cardiorespiratory, neuropsychiatric and "mast-cell activation type" (including rashes, joint pain and gastrointestinal disturbances and serositis symptoms). These subgroups are not mutually exclusive as some participants may belong to more than one subgroup depending on their symptoms.
If the Living with COVID Recovery™ application is found to be beneficial, further exploratory analyses will explore factors associated with greater benefit. Some participants allocated to this application will not be able to access it as they may lack a suitable mobile phone or tablet. Other participants will have suitable access but may choose to interact with it on a more or less extensive basis. Amount of access will be available as a patient reported variable and as summary variable from within the application.
Interim analysis
The first interim analysis point will be after 1200 participants are recruited to the cluster randomised trial and the remaining interim points will be after every 600 participants recruited. The interim analysis time points will apply to both the cluster and drug trials.
Interim analysis of the cluster interventions will take place among participants receiving usual care only (by allocation in the drug trial to no drug or by refusing or being ineligible for the drug trial). A pathway (a combination of the two cluster interventions) could be found to be superior after the first 1200 participants and every 600 participants thereafter in the study. A statistically significant p-value at the 0.001 two-sided level is required for a pathway to be deemed superior at interim analysis. This is to account for multiple testing (Bonferroni type correction). The analysis at 4520 individuals in total will be at the conventional 0.05 two-sided level. There are practical and operational reasons why a single pathway cannot graduate and become the standard pathway within the recruitment period of this trial.
For a drug to graduate early and become part of the backbone treatment of the trial, its two-sided p-value at each of the interim time points will need to be <0.001. The final principal analysis for each drug, including only those participants in the standard of care cluster pathway, will be with at least 200 participants in the active arm and 200 concurrent controls, and will use the conventional 2-sided 0.05 level. This analysis has 85% power if Cohen’s D is 0.3 and 97% power if Cohen’s D is 0.4.
After consideration and consultation with the IDMC, we decided against futility analysis, partly because it would be both very complicated and very difficult to implement across different drug arms and different part of the cluster randomised trial, due to our complex study design. Moreover, futility analyses may lead to underpowering of different arms of the trial.
Power calculation
Main study
The sample size was calculated using PASS v21.0.1(2021) for a 2x2 cluster factorial trial. The study was powered to detect an interaction on the FAS scale between Coverscan™ and Living with COVID Recovery™. The sample size does not depend on the size of main effects of both individual interventions. Based on published data the standard deviation on the FAS scale for individuals with LC is estimated at 6 units. For context, the difference in means of FAS between people who say they have or have not recovered from LC was 9 points in a recent observational study [4]. An interaction effect of 3 points [34] on the FAS can be detected with just over 90% power and (two-sided) significance level of 0.05 with 960 participants in 48 primary care network clusters of 20 participants, assuming a conservative intra-cluster correlation coefficient (ICC) of 0.02. If there is dropout of 15% (to be conservative) and assuming missingness is roughly equal across the arms, then the number of participants must be inflated by a factor of 100/85 to 1130 (approximately 56.5 centres of 20 participants).
Experimental estimates of prevalence of symptoms that remain 12-weeks post-COVID range from 3.0% based on tracking specific symptoms, to 11.7% based on self-classification of LC, using data to 1 August 2021 [2]. One LC clinic has ~25 new individuals per week [3], suggesting there might be around 1300 new individuals annually per clinic. Most are expected to give consent to data collection even if not willing to consent to randomisation into a drug study. LC referral rates range from 0–2.5/1000 per primary care network. Assuming this rate will not change over the foreseeable future, this will ensure that our 6–10 LC clinics will provide sufficient patients for this study. Moreover, there is a backlog of people waiting for their first LC clinic appointment (from private communication).
Nested drug trial
The total number of individual drugs which will be tested on the platform is currently unknown. The total sample size required in an adaptive platform drug trial, with uncertainty in the timing of the introduction of further drugs, cannot be set in advance, but would need to be updated in consultation with the Independent Data Monitoring Committee (equivalent to the data safety monitoring board) and funder throughout the trial at set interim points in data collection.
The treatment effect is unknown, at this time, for the drugs. The plan is to perform interim analysis after 1200 participants in total are recruited and after every 600 participants thereafter. With 200 participants per active arm and corresponding concurrent controls the study has 85% power to detect a Cohen’s D of 0.3 on FAS (difference between means in two treatment arms divided by the standard deviation of the data) at the 0.05 two-sided alpha level. If this number is increased to 300 for the same effect size the power is 95%.
Planned recruitment rate
To plan and cost the trial a nominal maximum of 4520 recruited participants was proposed based on up to 4 (drug and usual care) parallel arms of up to 1130 evaluable participants. The nested drug trial aims to recruit up to 4520 individuals from a possible pool of 30 000 individuals from 6–10 primary care network areas of England. The trial will continue to recruit participants at least until the recruitment target of 1130 participants for each of the initial arms of the adaptive trial has been reached. If the adaptive trial requires the full 4520 participants, it is estimated it will take approximately 10 to 12 months for the recruitment to complete and by the 16th month from the start of the trial, the last visit of the last patient would be completed in the third quarter of 2023. The projected recruitment rate, when all clinics are open to recruitment, is 600 participants per month.
End of trial
The study is deemed to have ended following the last data collection point within the trial. This will be 12 months following enrolment of the last participant in the trial. Thereafter, there will be a 6-month period for data analysis and reporting. The chief investigator and/or trial steering committee have the right at any time to terminate the trial for clinical or administrative reasons. The funder may withdraw funding in the event of futility, study misconduct, or other unanticipated events. In such instances, the Sponsor will notify the Medicines and Healthcare products Regulatory Agency (MHRA) within 15 days. The end of the trial will be reported to the Research Ethics Committee and Regulatory Authority within the required timeframe if the trial is terminated prematurely. Investigators will inform patients of any premature termination of the trial and ensure that the appropriate follow up is arranged for all involved. Following the end of the trial a summary report of the trial will be provided to the Research Ethics Committee and Regulatory Authority within the required timeframe. The Sponsor will notify MHRA at the end of the clinical trial within 90 days of its completion.
The trial may be stopped before completion on the recommendation of the Trial Steering Committee, Independent Data Monitoring or the Sponsor and chief investigator. All safety data will be reviewed and a decision on continuation will be made by the Independent Data Monitoring Committee with input from the Sponsor. A single drug study arm may be stopped by the Independent Data Monitoring Committee on grounds of harm at each stopping point. The Independent Data Monitoring Committee may also recommend a single drug study arm be halted in the event of the death of a single participant, directly attributable to the study drug.
At the end of the trial, all essential documentation and the trial dataset will be prepared for archiving and transfer to the Sponsor by Lancashire Clinical Trials Unit. Participating sites will be asked to archive for a minimum of 25 years from the declaration of end of trial. Essential documents are those which enable both the conduct of the trial and the quality of the data produced to be evaluated and show whether the site complied with the principles of Good Clinical Practice and all applicable regulatory requirements. The Sponsor will notify sites when trial documentation can be archived. All archived documents must continue to be available for inspection by appropriate authorities upon request.
Oversight
The Trial Management Group is responsible for the management of STIMULATE-ICP and is led by AB (chief investigator) and MH (lead clinical principal investigator). In addition, the trial management group comprises trial investigators and relevant staff from Lancashire Clinical Trials Unit and PPI members, who meet regularly to discuss the progress of the trial. Lancashire Clinical Trials Unit is responsible for day-to-day trial management, is the data custodian, and will conduct central and on-site monitoring of sites and data. STIMULATE-ICP is managed according to Good Clinical Practice guidelines. Lancashire Clinical Trials Unit will act to preserve patient confidentiality and prevent disclosure or reproduction of identifiable patient information by encryption to ensure anonymity. Procedures for handling, processing, storing and destroying data are compliant with the Data Protection Act 1998. The Trial Steering Committee and Independent Data Monitoring Committee have been convened as trial oversight committees. The Trial Steering Committee is independently chaired by Professor Patrick Mallon and includes clinicians, academics, and PPI representatives, along with CI and lead clinical principal investigator. The Trial Steering Committee monitors trial progress. The Independent Data Monitoring Committee is chaired by Professor Peter Langhorne, includes both clinical and statistical expertise, and advises the Trial Steering Committee, independent of the trial team, sponsor and Trial Steering Committee, making recommendations on continuation, or not, of the trial. Membership of each committee depends on accepting terms of reference and declaration of conflict of interest. Any major protocol modifications (such as changes to eligibility criteria, outcomes, analyses) will be communicated to trial registry (ISRCTN), research team, Research Ethics Committee and Health Research Authority and the public via the study website.
Ethical approval
The Protocol (version 2.1; 5/5/2022) and other trial-related documentation (and any amendments) received favourable ethical opinion from NRES Committee South Central—Berkshire Research Ethics Committee (reference: 21/SC/0416). All participating sites obtained local approvals prior to patient recruitment.
Discussion
In individuals with non-hospitalised LC, the STIMULATE-ICP trial represents the first major, pragmatic trial to study: (i) drugs in a nested platform design, (ii) components of an integrated care pathway from pre- to post-clinic care, and (iii) fatigue as a primary endpoint. Given the national and international burden of LC, STIMULATE-ICP is important to investigate feasible, generalisable and scalable improvements in care through: (i) widely-used, re-purposable drugs, (ii) accessible interventions (CoverscanTM and Living with COVID RecoveryTM), and (iii) study sites varying in geography and clinical service. This paper presents the protocol (Version 2.1, 05/05/2022) and the full protocol is available on the NIHR and study (https://www.stimulate-icp.org/) websites. The SPIRIT checklist [35] for the trial protocol is included in S9 Appendix.
Recruitment started in August 2022. At the time of first manuscript submission, data collection for the trial was ongoing and due to be complete in July 2023. The full trial results will be disseminated in Q3 2023 through presentations at national and international conferences, publication in peer reviewed medical journals and regular interaction with media (mainstream and social). As well as the non-trial aspects of STIMULATE-ICP (described in the methods), there are now several nationally funded observational research programmes are underway, including LOCOMOTION, TLC and PC-COS studies [17]. In addition, there are now several ongoing clinical trials in LC:
Phase 1/2
Axcella-1125 (https://www.clinicaltrials.gov/ct2/show/NCT05152849)
Phase 3
HEAL-COVID (https://heal-covid.net/)
However, to our knowledge, ongoing studies are neither platform studies nor specifically focused on individuals with non-hospitalised LC.
STIMULATE-ICP will provide up-to-date information about investigation and rehabilitation components of the clinical pathway for individuals with LC, as well as developing the evidence for therapeutics in this patient population.
Supporting information
Acknowledgments
STIMULATE-ICP team:
University College London, London, UK:
Professor Amitava Banerjee (Lead: ami.banerjee@ucl.ac.uk)
Professor Elizabeth Murray
Dr Hakim-Moulay Dehbi
Professor Hugh Montgomery
Mrs Sarah Clegg
Dr Henry Goodfellow
Dr Mel Ramasawmy
Dr Yi Mu
Dr Sampath Weerakkody
Dr Ileana Selejan
Dr David Sunkersing
Dr Ashkan Dashtban
University of Auckland, Auckland, New Zealand
Professor Paula Lorgelly (also at University College London)
University of Central Lancashire, Preston, UK:
Professor Dame Caroline Leigh-Watkins
Mrs Denise Forshaw
Dr Gordon Prescott
Royal College of General Practitioners, London, UK:
Dr Gail Allsopp
University of Liverpool, Liverpool, UK:
Professor Mark Gabbay
Professor Gregory Lip
Professor Dan Cuthbertson
Dr Dan Wootton
Professor Nefyn Williams
University of Hull, Hull, UK:
Dr Mike G Crooks
Hull University Teaching Hospitals Trust, Hull, UK:
Dr Angela Green
University of York, York, UK:
Professor Christina Feltz van der Feltz-Cornelis
Dr Jenny Sweetman
Dr Han-I Wang
Ms Natalie Smith
University of Leicester, Leicester, UK:
Professor Kamlesh Khunti
Dr Lauren O’Mahoney
Dr Rachael Evans
University of Exeter, Exeter, UK:
Dr William D Strain
Royal Devon University Healthcare NHS Foundation Trust, Exeter, UK:
Dr Rachel Botell
University of Southampton, Southampton, UK:
Professor Nisreen Alwan,
Dr Donna Clutterbuck
University of Sussex, Brighton, UK:
Dr Marija Pantelic
Living with Covid Recovery:
Mr Chris Robson
Perspectum, Oxford, UK:
Professor Sir Mike Brady
Dr Rajarshi Banerjee
Dr Cat Kelly
Dr Angela Barone
Dr Johannes Alberts
Dr Rob Suriano
STIMULATE-ICP PPI team, University College London, London, UK:
Mr Lyth Hishmeh
Dr Emily Attree
Ms Jasmine Hayer
Ms Rita Mallinson Cookson
Ms Rachel Hext
Mr Andrew Williams
Mrs Rachel Williams
Ms Mag Leahy
Mr Antony Loveless
Mrs Clare Loveless,
Ms Kim Horstmanshof
Collaborators:
Royal College of Speech and Language Therapists: Gemma Clunie
NNEdPro Global Centre for Nutrition and Health: Dominic Crocombe, Shane McAuliffe
Independent Data Monitoring Committee: Peter Langhorne (chair), Chris Sutton
Trial Steering Committee: Independent members: Patrick Mallon (chair), Marion Mafham, Ondine Sherwood (PPI). Other members: Matthew Sydes
UCL/UCLH Joint Research Office (sponsor): Michelle Quaye, Farhat Gilani, Yusuf Jaami, Nikki Cleary, Judy Jones, Robin Holas
Data Availability
The protocol does not report results and no further data are available. Deidentified research data will be made publicly available when the study is completed and published.
Funding Statement
This trial is part of a National Institute for Health Research (NIHR: COV-LT2-0043)-funded programme (Figure 2)(17), with epidemiologic and mixed methods studies(18), including care inequalities and transferability to other LTCs (IRAS 303958) and this complex intervention trial (IRAS 1004698). Funding for the transport, storage, processing and biobanking of blood and MRI is supported by Perspectum Ltd. The funders had and will not have a role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The views and opinions expressed therein are those of the authors and do not necessarily reflect those of the NIHR, NHS, the Department of Health and Social Care, or the sponsor.
References
- 1.Soriano JB, Murthy S, Marshall JC, Relan P, Diaz JV; WHO Clinical Case Definition Working Group on Post-COVID-19 Condition. A clinical case definition of post-COVID-19 condition by a Delphi consensus. Lancet Infect Dis. 2022. Apr;22(4):e102–e107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Office for National Statistics. Prevalence of ongoing symptoms following coronavirus (COVID-19) infection in the UK: 7 April 2022. 2022.
- 3.Heightman M, Prashar J, Hillman TE, Marks M, Livingston R, Ridsdale HA, et al. Post-COVID-19 assessment in a specialist clinical service: A 12-month, single-centre, prospective study in 1325 individuals. BMJ Open Respiratory Research. 2021. Nov;8(1):e001041. doi: 10.1136/bmjresp-2021-001041 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Davis HE, Assaf GS, McCorkell L, Wei H, Low RJ, Re’em Y, et al. Characterizing long COVID in an international cohort: 7 months of symptoms and their impact. eClinicalMedicine. 2021. Aug;38:101019. doi: 10.1016/j.eclinm.2021.101019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Michelen M, Manoharan L, Elkheir N, Cheng V, Dagens A, Hastie C, et al. Characterising long COVID: A living systematic review. Vol. 6, BMJ Global Health. 2021. Sep;6(9):e005427. doi: 10.1136/bmjgh-2021-005427 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Williamson EJ, Walker AJ, Bhaskaran K, Bacon S, Bates C, Morton CE, et al. Factors associated with COVID-19-related death using OpenSAFELY. Nature. 2020. Aug;584(7821):430–436. doi: 10.1038/s41586-020-2521-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Xie Y, Xu E, Bowe B, Al-Aly Z. Long-term cardiovascular outcomes of COVID-19. Nature. 2022. Mar;28(3):583–590. doi: 10.1038/s41591-022-01689-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Al-Aly Z, Xie Y, Bowe B. High-dimensional characterization of post-acute sequelae of COVID-19. Nature. 2021. Jun;594(7862):259–264. doi: 10.1038/s41586-021-03553-9 [DOI] [PubMed] [Google Scholar]
- 9.The PHOSP-COVID Collaborative Group. Clinical characteristics with inflammation profiling of long COVID and association with 1-year recovery following hospitalisation in the UK: a prospective observational study. Lancet Resp Med. 2022. Aug;10(8):761–775. doi: 10.1016/S2213-2600(22)00127-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Campbell H, Hotchkiss R, Bradshaw N, Porteous M. Integrated care pathways. Vol. 316, British Medical Journal. 1998. Jan 10;316(7125):133–7. doi: 10.1136/bmj.316.7125.133 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Pye A, Roberts SR, Blennerhassett A, Iqbal H, Beenstock J, Iqbal Z. A public health approach to estimating the need for long COVID services. Journal of Public Health. 2021. Oct 14;fdab365. doi: 10.1093/pubmed/fdab365 [DOI] [PubMed] [Google Scholar]
- 12.Thompson DR, Al-Jabr H, Windle K, Ski CF. Long COVID: Supporting people through the quagmire. Br J Gen Pract. 2021. Nov 25;71(713):561. doi: 10.3399/bjgp21X717917 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Nurek M, Rayner C, Freyer A, Taylor S, Jarte L, MacDermott N, et al. Recommendations for the recognition, diagnosis, and management of long COVID: A Delphi study. British Journal of General Practice. 2021. Oct 28;71(712):e815–e825. doi: 10.3399/BJGP.2021.0265 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.NHS England and NHS Improvement. National guidance for post-COVID syndrome assessment clinics. 2021 Apr.
- 15.Dennis A, Wamil M, Alberts J, Oben J, Cuthbertson DJ, Wootton D, et al. Multiorgan impairment in low-risk individuals with post-COVID-19 syndrome: A prospective, community-based study. BMJ Open. 2021. Mar 30;11(3):e048391. doi: 10.1136/bmjopen-2020-048391 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Murray E, Goodfellow H, Bindman J, Blandford A, Bradbury K, Chaudhry T et al. Development, deployment and evaluation of digitally enabled, remote, supported rehabilitation for people with long COVID-19 (Living With COVID-19 Recovery): protocol for a mixed-methods study. BMJ Open. 2022. Feb 7;12(2):e057408. doi: 10.1136/bmjopen-2021-057408 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.The RECOVERY Collaborative Group. Dexamethasone in Hospitalized Patients with Covid-19. N Engl J Med. 2021. Feb 25;384:693–704. doi: 10.1056/NEJMoa2021436 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Routen A, O’Mahoney L, Ayoubkhani D, Banerjee A, Brightling C, Calvert M, et al. Understanding and tracking the impact of long COVID in the United Kingdom. Nat Med. 2022. Jan;28(1):11–1519. doi: 10.1038/s41591-021-01591-4 [DOI] [PubMed] [Google Scholar]
- 19.Ramasawmy M, Mu Y, Clutterbuck D, Pantelic M, Lip GYH, van der Feltz-Cornelis C et al. STIMULATE-ICP-CAREINEQUAL (Symptoms, Trajectory, Inequalities and Management: Understanding Long-COVID to Address and Transform Existing Integrated Care Pathways) study protocol: Defining usual care and examining inequalities in Long Covid support PLoS One. 2022. Aug 15;17(8):e0271978. doi: 10.1371/journal.pone.0271978 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.van der Feltz-Cornelis CM, Sweetman J, Allsopp G, Attree E, Crooks MG, Cuthbertson DJ et al. STIMULATE-ICP-Delphi (Symptoms, Trajectory, Inequalities and Management: Understanding Long-COVID to Address and Transform Existing Integrated Care Pathways Delphi): Study Protocol. medrxiv. 2022. Apr 7; doi: 10.1371/journal.pone.0277936 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Quality of Life Research. 2011;20(10). doi: 10.1007/s11136-011-9903-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Plummer F, Manea L, Trepel D, McMillan D. Screening for anxiety disorders with the GAD-7 and GAD-2: A systematic review and diagnostic metaanalysis. General Hospital Psychiatry. 2016;39. doi: 10.1016/j.genhosppsych.2015.11.005 [DOI] [PubMed] [Google Scholar]
- 23.He C, Levis B, Riehm KE, Saadat N, Levis AW, Azar M, et al. The Accuracy of the Patient Health Questionnaire-9 Algorithm for Screening to Detect Major Depression: An Individual Participant Data Meta-Analysis. Psychotherapy and Psychosomatics. 2020;89(1). doi: 10.1159/000502294 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Bestall JC, Paul EA, Garrod R, Garnham R, Jones PW, Wedzicha JA. Usefulness of the Medical Research Council (MRC) dyspnoea scale as a measure of disability in patients with chronic obstructive pulmonary disease. Thorax. 1999;54(7). doi: 10.1136/thx.54.7.581 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Rashidian H, Subramaniapillai M, Park C, Lipsitz O, Zuckerman H, Teopiz K, et al. Insulin resistance is associated with deficits in hedonic, self-reported cognitive, and psychosocial functional response to antidepressant treatment in individuals with major depressive disorder. Journal of Affective Disorders. 2021;282. doi: 10.1016/j.jad.2020.12.074 [DOI] [PubMed] [Google Scholar]
- 26.Zahra D, Qureshi A, Henley W, Taylor R, Quinn C, Pooler J, et al. The work and social adjustment scale: Reliability, sensitivity and value. International Journal of Psychiatry in Clinical Practice. 2014;18(2). doi: 10.3109/13651501.2014.894072 [DOI] [PubMed] [Google Scholar]
- 27.Bouwmans C, Krol M, Severens H, Koopmanschap M, Brouwer W, Roijen LH van. The iMTA Productivity Cost Questionnaire: A Standardized Instrument for Measuring and Valuing Health-Related Productivity Losses. Value in Health. 2015;18(6). doi: 10.1016/j.jval.2015.05.009 [DOI] [PubMed] [Google Scholar]
- 28.Jenkinson C, Layte R. Development and testing of the UK SF-12. Journal of Health Services Research and Policy. 1997;2(1). [DOI] [PubMed] [Google Scholar]
- 29.Mutubuki EN, van der Maaden T, Leung KY, Wong A, Tulen AD, de Bruijn S, et al. Prevalence and determinants of persistent symptoms after infection with SARS-CoV-2: Protocol for an observational cohort study (LongCOVID-study). medRxiv. 2022; doi: 10.1136/bmjopen-2022-062439 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Broadbent DE, Cooper PF, FitzGerald P, Parkes KR. The cognitive failures questionnaire (CFQ) and its correlates. British Journal of Clinical Psychology. 1982;21(1). doi: 10.1111/j.2044-8260.1982.tb01421.x [DOI] [PubMed] [Google Scholar]
- 31.Munblit D, Nicholson T, Akrami A, Apfelbacher C, Chen J, de Groote W, et al. A core outcome set for post-COVID-19 condition in adults for use in clinical practice and research: an international Delphi consensus study. The Lancet Respiratory Medicine. 2022. Jul;10(7):715–24. doi: 10.1016/S2213-2600(22)00169-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: Updated guidelines for reporting parallel group randomized trials. Vol. 152, Annals of Internal Medicine. 2010. [PMC free article] [PubMed] [Google Scholar]
- 33.International Conference on Harmonisation (ICH). ICH Harmonised Tripartite Guideline E9: Statistical Principles for Clinical Trials. Statistics in Medicine. 1999;18(15). [PubMed] [Google Scholar]
- 34.de Kleijn WPE, de Vries J, Wijnen PAHM, Drent M. Minimal (clinically) important differences for the Fatigue Assessment Scale in sarcoidosis. Respiratory Medicine. 2011;105(9). doi: 10.1016/j.rmed.2011.05.004 [DOI] [PubMed] [Google Scholar]
- 35.Chan AW, Tetzlaff JM, Gøtzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346. doi: 10.1136/bmj.e7586 [DOI] [PMC free article] [PubMed] [Google Scholar]