Skip to main content
NCBI home page
BMJ Medicine logoLink to BMJ Medicine
. 2023 Sep 21;2(1):e000352. doi: 10.1136/bmjmed-2022-000352

Quality of reporting of adverse events in clinical trials of covid-19 drugs: systematic review

Karima Madi 1, Clara Flumian 1,2, Pascale Olivier 2, Agnès Sommet 1,2, François Montastruc 1,2,✉
PMCID: PMC10537984  PMID: 37779893

Abstract

Objective

To assess the quality of reporting of adverse events in clinical trials of covid-19 drugs based on the CONSORT (Consolidated Standards of Reporting Trials) harms extension and according to clinical trial design, and to examine reporting of serious adverse events in drug trials published on PubMed versus clinical trial summaries on ClinicalTrials.gov.

Design

Systematic review.

Data sources

PubMed and ClinicalTrials.gov registries were searched from 1 December 2019 to 17 February 2022.

Eligibility criteria for selecting studies

Randomised clinical trials evaluating the efficacy and safety of drugs used to treat covid-19 disease in participants of all ages with suspected, probable, or confirmed SARS-CoV-2 infection were included. Clinical trials were screened on title, abstract, and text by two authors independently. Only articles published in French and English were selected. The Cochrane risk of bias tool for randomised trials (RoB 2) was used to assess risk of bias.

Results

The search strategy identified 1962 randomised clinical trials assessing the efficacy and safety of drugs used to treat covid-19, published in the PubMed database; 1906 articles were excluded after screening and 56 clinical trials were included in the review. Among the 56 clinical trials, no study had a high score for quality of reporting of adverse events, 60.7% had a moderate score, 33.9% had a low score, and 5.4% had a very low score. All clinical trials with a very low score for quality of reporting of adverse events were randomised open label trials. For reporting of serious adverse events, journal articles published on PubMed under-reported 51% of serious adverse events compared with clinical trial summaries published on ClinicalTrials.gov.

Conclusions

In one in three published clinical trials on covid-19 drugs, the quality of reporting of adverse events was low or very low. Differences were found in the number of serious adverse events reported in journal articles versus clinical trial summaries. During the covid-19 pandemic, risk assessment of drugs in clinical trials of covid-19 drugs did not comply with good practice recommendations for publication of results.

Systematic review registration

European Network of Centres for Pharmacoepidemiology and Pharmacovigilance (ENCePP) EUPAS45959.

Keywords: Drug-related side effects and adverse reactions, COVID-19, Clinical trial, Drug therapy

WHAT IS ALREADY KNOWN ON THIS TOPIC

  • A preliminary review of clinical trials evaluating remdesivir for covid-19 treatment highlighted poor accuracy in the reporting of adverse events

  • However, no large studies have investigated other drugs used to treat covid-19, including monoclonal antibodies, antiviral agents, and immunomodulators

WHAT THIS STUDY ADDS

  • This systematic review found inadequacies and inconsistencies in the quality of reporting of adverse events of drugs used for the treatment of covid-19 in published articles

  • One in three studies had a low or very low score for quality of reporting according to the CONSORT (Consolidated Standards of Reporting Trials) statement

  • Compared with serious adverse events reported in trial summaries on ClinicalTrials.gov, about 51% of serious events were not reported in published clinical trials

HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE, OR POLICY

  • Use of the new CONSORT harms extension might improve reporting of safety data

  • Some publications under-reported adverse events and therefore researchers and clinicians should consult several sources of information to correctly establish the safety profile of drugs

  • The pharmacovigilance of these drugs is affected because assessment of the benefit-risk ratio of these covid-19 drugs based on these clinical trials is not precise

Introduction

Since its outbreak in December 2019, covid-19 has been a global health emergency. During the covid-19 pandemic, researchers developed several drugs (monoclonal antibodies, antiviral agents, and immunomodulators) to prevent the rapid spread of disease based on an understanding of the mechanism of action of the SARS-CoV-2 virus.1 Monoclonal antibodies developed for the treatment of covid-19 disease (bamlanivimab, bamlanivimab-etesevimab, casirivimab-imdevimab, cilgavimab-tixagevimab, regdanvimab, and sotrovimab) block the entry of the virus into the cell by neutralising the spike protein. Antiviral agents (molnupiravir, nirmatrelvir, PF-07321332 ritonavir, and remdesivir) block multiplication of the virus inside the cell.2 Immunomodulators, used to prevent the inflammatory reaction in the late stages of covid-19 disease, include the interleukin 6 receptor inhibitors, tocilizumab and sarilumab, monoclonal antibodies that neutralise membrane and nuclear interleukin 6 receptors, and the Janus kinase inhibitors, ruxolitinib, tofacitinib, and baricitinib.

The European Medicines Agency or the US Food and Drug Administration, or both, recommended sotrovimab, remdesivir, nirmatrelvir, PF-07321332 ritonavir, and casirivimab-imdevimab as curative treatment for covid-19. For prophylaxis before infection with the SARS-CoV-2 virus, these agencies recommended cilgavimab-tixagevimab, bamlanivimab, and bamlanivimab-etesevimab, and for prophylaxis after infection, casirivimab-imdevimab, regdanvimab, and molnupiravir. The World Health Organization strongly recommended Janus kinase inhibitors, specifically baricitinib, ruxolitinib, and tofacitinib, and interleukin 6 receptor blockers (tocilizumab or sarilumab), in patients with severe and critical covid-19 disease.3

These drugs were evaluated based on the results of clinical trials and subsequently obtained emergency use authorisation from the FDA and marketing authorisation from the European Medicines Agency. Because these drugs are used in large populations with little experience of their use in SARS-CoV-2 infection, evaluation of safety data is crucial, especially to estimate the balance between benefit and risk. Assessment of the quality of reporting of adverse events is therefore important, to improve our knowledge of the safety of these drugs. Adverse events of drugs used to treat covid-19 disease might involve many patients and be potentially serious. For example, the WHO guideline on drugs for the treatment of covid-19 disease recommended monitoring the risk of Janus kinase inhibitors, especially serious infections.3 Although a preliminary review of clinical trials evaluating remdesivir for covid-19 disease highlighted poor accuracy in the reporting of adverse events, no large study has assessed other drugs used for the treatment of covid-19, including monoclonal antibodies, other antiviral agents, and immunomodulators.4

In this systematic review, our main aim was to assess the quality of reporting of adverse events in clinical trials of all drugs used in the treatment of covid-19 disease (except vaccines and glucocorticoids). Secondary objectives were comparison of the quality of reporting of adverse events according to the design of the clinical trial. We also examined reporting of serious adverse events in journal articles of covid-19 drug trials compared with their trial summaries on the ClinicalTrials.gov website.

Materials and methods

This study used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for study design, search protocol, screening, and reporting (online supplemental table 1).

Supplementary data

bmjmed-2022-000352supp001.pdf (3.1MB, pdf)

Eligibility criteria

Randomised clinical trials evaluating the efficacy and safety of drugs used to treat covid-19 disease in participants of all ages with suspected, probable, or confirmed SARS-CoV-2 infection were included in our study. We considered monoclonal antibodies (bamlanivimab, bamlanivimab-etesevimab, casirivimab-imdevimab, cilgavimab-tixagevimab, regdanvimab, and sotrovimab), antiviral agents (remdesivir, molnupiravir, and nirmatrelvir-ritonavir), and immunomodulators (tocilizumab, sarilumab, ruxolitinib, tofacitinib, and baricitinib). Eligible randomised clinical trials compared the efficacy and safety of drugs versus placebo, standard of care, or other covid-19 drugs.

Data sources, search strategy, and study selection

The PubMed online bibliographic database was searched from 11 to 17 February 2022 for articles published between 1 December 2019 and 17 February 2022. Online supplemental table 2 shows the search strategy terms. For some drugs, not many clinical trials were published at that time, so the search was performed with keywords (eg, “sotrovimab”) to avoid being too specific and potentially missing relevant studies. Based on the search strategy terms, titles, abstracts, and full texts of articles were identified. For selection of article titles, we searched for the name of the drug and covid-19. For selection of abstracts, we searched in the methods sections for the study design (ie, clinical trial). For the selection of full texts, we searched for the name of the drug and covid-19, and the study design, if this information was not reported in the title or abstract.

The eligibility of the articles was evaluated independently by two reviewers (KM and CF). Articles were selected by screening the title, abstract, and then the full text. Only articles published in French and English were selected. Disagreements between reviewers were resolved by FM. The information extracted and recorded from each of the articles reviewed by the authors (KM and CF) were number of clinical trials for each drug, registration number of the trial, and design of the trial (randomised open label single, double, or triple blind, or no allocation open label) (online supplemental table 3).

Measurement of quality of reporting of adverse events

To assess the quality of reporting of adverse events, we used the CONSORT (Consolidated Standards of Reporting Trials) harms extension statement.5 The CONSORT harms extension statement was developed to provide investigators with good practice guidelines for recording adverse events in randomised clinical trials, but some authors have used these recommendations to assess the quality of reporting of adverse events.4 6 The recommendations of the CONSORT harms extension were subdivided into 19 subcategories because several items could be grouped under one item. All articles on randomised clinical trials of covid-19 drugs included in our study were analysed independently by two reviewers (KM and CF). We developed a data extraction sheet on Excel with the different clinical trials on each drug and the different sub-items of the CONSORT harms extension. Cohen's κ score was calculated to assess the degree of agreement between the reviewers. Disagreements were resolved by discussion between the two authors. For clinical trials evaluating two drugs, we chose to evaluate the drug used in the intervention group and not the drug used in the placebo group. Analysis of adherence of these clinical trials to the CONSORT harms extension was performed based on the article, extended protocol, online supplemental data, and statistical analysis plan of each clinical trial.

For each item, a score of one was assigned if the article followed the recommendation exactly and a score of zero if it did not. For each article analysed, the total score was calculated and a ranking was assigned, as previously described in the literature.4 7 The quality of reporting of adverse events was classified as high (score 15-19), moderate (score 10-14), low (score 5-9), or very low (score 0-4). The quality of reporting of adverse events was also described according to drug class (monoclonal antibodies, antiviral agents, and immunomodulatory drugs). We also calculated the proportion of studies with high, moderate, low, and very low quality of reporting of adverse events according to the design of the clinical trial. Because our sample size was small, the aim of our study was not to generalise the conclusions but to highlight the inadequacies and inconsistencies of reporting adverse events in studies that were published during the peak period of the covid-19 pandemic. Also, we did not calculate confidence intervals because of the small sample of clinical trials.

Secondary objectives

Secondary objectives were comparisons between the number of serious adverse events reported in published journal articles listed in PubMed and those reported in clinical trial summaries on the ClinicalTrials.gov website. For each clinical trial summary and journal article, we compared the number of serious adverse events and number of patients with serious adverse events in the treated group. The analysis period for ClinicalTrials.gov data was modified from the original protocol and extended by one year. The extra year gave us more time to evaluate the data.

To assess the risk of bias for each study, we used the Cochrane risk of bias tool for randomised trials (RoB 2), which covers sequence generation, allocation concealment, blinding, incomplete outcome data (eg, dropouts and withdrawals), and selective outcome reporting.8 For each domain in the tool, we described the procedures undertaken for each study, including verbatim quotes. A judgment on the possible risk of bias on each of the six domains was made from the extracted information, rated as high risk, low risk, or some concerns. We then compared the type of bias with the quality score for reporting of adverse events for each included study.

Patient and public involvement

We did not involve patients or the public in designing, conducting, or reporting our research, because we used only data from previously published studies. Systematic reviews identify and analyse relevant primary studies to answer a specific research question, but they are not conducted on patients or the public directly. We plan to disseminate our results through open access publication and social media.

Results

Assessment of quality of adverse event reporting

Based on the terms listed in the search strategy (online supplemental table 2), we identified 1962 randomised clinical trials assessing the efficacy and safety of drugs used to treat covid-19, published in the PubMed database. We excluded 1906 studies (seven duplicates, 1814 after screening the title, 65 after screening the abstract, and 20 after screening the full text article; figure 1 and online supplemental table 7). The remaining 56 clinical trials were included in our assessment: 15 clinical trials assessed monoclonal antibodies (two for sotrovimab, five for bamlanivimab, three for bamlanivimab-etesevimab, and five for casirivimab-imdevimab), 17 assessed antiviral agents (11 for remdesivir, five for molnupiravir, and one for nirmatrelvir-ritonavir), and 24 assessed immunomodulatory drugs (14 for tocilizumab, five for sarilumab, two for ruxolitinib, one for tofacitinib, and two for baricitinib).9–57 Table 1, online supplemental table 4, and online supplemental figure 1 show the adequacy of the included clinical trials of covid-19 drugs, based on fulfilling each of the recommendations of the CONSORT harms extension. Cohen's κ for agreement between the two authors for the CONSORT score was 0.92 (95% confidence interval 0.84 to 1.00).

Figure 1.

Figure 1

Open in a new tab

Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram of the study selection process. *Observational studies or drugs other than those used to treat covid-19 disease (eg, vaccines). †Clinical trials on pathologies other than covid-19. ‡Clinical trial only dealt with efficacy and therefore no information on adverse events was available

Table 1.

Items fulfilled by clinical trials for quality of reporting criteria according to recommendations of CONSORT (Consolidated Standards of Reporting Trials) harms extension (n=56 studies)

Section of articles CONSORT harms recommendation Items No (%) of compliant trials
Title and abstract 1 If the study collected data on harms and benefits, the title or abstract should state so 1 Adverse events mentioned in title or abstract 44 (79)
Introduction 2 If the trial looked at both harms and benefits, the introduction should state so 2 Information on adverse events mentioned in introduction 3 (5)
Methods 3 Include a list of adverse events with definitions for each (with attention, when relevant, to grading, expected v unexpected events, references to standardised and validated definitions), and description of new definitions 3a If article mentioned use of validated instrument to report severity of adverse event 42 (75)
3b If article mentioned definition of adverse event 34 (61)
4 Clarify how harms related information was collected (mode of data collection, timing, attribution methods, intensity of ascertainment, and harms related monitoring and stopping rules, if pertinent) 4a Description of how harms data were collected (eg, diaries, telephone interviews, face-to-face interviews) 35 (63)
4b Description of when adverse event data were collected 39 (70)
4c Whether adverse events were attributed to trial drug (eg, how adverse events were attributed to drugs) 38 (68)
5 Describe plans for presenting and analysing information on harms (including coding, handling of recurrent events, specification of timing issues, handling of continuous measures, and any statistical analyses) 5 Described the methods for presenting or analysing adverse events, or both 43 (77)
Results 6 Describe for each arm the participant withdrawals that are due to harm and the experience with the allocated treatment 6a If the article reported number of withdrawals caused by adverse events in each arm 30 (54)
6b Description of adverse events leading to withdrawals 14 (25)
6c Description of adverse events leading to death 24 (43)
7 Provide denominators for describing harms 7a Provided denominators for adverse events 52 (93)
7b Provided definitions used for analysis set (intention to treat, per protocol, safety data available, unclear) 36 (64)
8 Present the absolute risk of each adverse event (specifying type, grade, and seriousness per arm), and present appropriate metrics for recurrent events, continuous variables, and scale variables, whenever pertinent 8a Reported results separately for each treatment arm 54 (96)
8b Severity and grading of adverse events 50 (89)
8c Provided both number of adverse events and number of patients with adverse events 10 (18)
9 Describe any subgroup analysis and exploratory analysis for harms 9 Described subgroup analysis and exploratory analysis for harms 3 (5)
Discussion 10 Provide a balanced discussion of benefits and harms with emphasis on study limitations, generalisability, and other sources of information on harms 10a If the discussion was balanced with regard to efficacy and adverse events 5 (9)
10b Limitations of the study specifically in relation to adverse events discussed 2 (3)
Open in a new tab

We found that 95% of clinical trials did not provide information on adverse events in the introduction section (CONSORT recommendation 2), 82% did not provide both the number of adverse events and number of patients with adverse events (CONSORT recommendation 8c), 95% did not describe subgroup analysis and exploratory analysis for harms (CONSORT recommendation 9), 91% did not provide a balanced discussion on efficacy and adverse events (CONSORT recommendation 10a), and 97% did not provide the limitations of the study, specifically in relation to adverse events discussed (CONSORT recommendation 10b) (table 1). No clinical trial had a high15–19 score for reporting of adverse events, 60.7% had a moderate10–14 score, 33.9% had a low score, and 5.4% had a very low score (figure 2). Based on our evaluation by drug class, we found that 86.7% of studies that assessed monoclonal antibodies had a moderate score and 13.3% had a low score for quality of reporting of adverse events. For studies that assessed antiviral agents, 64.7% had a moderate score, 29.4% had a low score, and 5.9% had a very low score. For studies that assessed immunomodulators, 50% had a low score, 41.7% had a moderate score, and 8.3% had a very low score (figure 2).

Figure 2.

Figure 2

Open in a new tab

Quality of reporting of adverse events of all included articles and by class of drug

Quality of reporting according to design of clinical trial

We next compared the quality of reporting of adverse events according to the design of the clinical trial to see which design was associated with a high, moderate, low, or very low score. We found that in randomised open label trials, 17.6%, 47.1%, and 35.3% of trials had a very low, low, and moderate quality score, respectively. In randomised single blind trials, 100% of trials had a low quality score. In randomised double blind trials, 19% had a low and 81% had a moderate quality score. In randomised triple blind trials, 50% had a low and 50% had a moderate quality score. In randomised quadruple blind trials, 22.2% had a low and 77.8% had a moderate quality score. In no allocation open label trials, 50% had a low and 50% a had moderate quality score (online supplemental figure 2).

Reporting of serious adverse events in journal articles versus trial summaries

Among the 56 journal articles identified in the review, only 20 trial summaries were available in ClinicalTrials.gov one year after the research period (figure 3). The 20 trial summaries were for eight different drugs: sotrovimab, one journal article and one trial summary; bamlanivimab, three journal articles and trial summaries; remdesivir seven journal articles and trial summaries; molnupiravir two journal articles and trial summaries; nirmatrelvir one journal article and trial summary; tocilizumab, four journal articles and trial summaries; sarilumab one journal article and trial summary; and baricitinib one journal article and trial summary. We found that journal articles under-reported 51% of serious adverse events compared with trial summaries. The differences varied according to the drugs evaluated: 100% for sotrovimab, 41% for bamlanivimab, 62% for remdesivir, 96% for nirmatrelvir, 42% for toclizumab, and 92% for baricitinib. For molnupiravir and sarilumab, however, we found the same number of serious adverse events in the journal articles and trial summaries (table 2). The most frequent serious adverse events under-reported were cardiac disorders, metabolic and nutritional disorders, and respiratory, thoracic, and mediastinal disorders, according to the Medical Dictionary for Regulatory Activities, version 23.0.

Figure 3.

Figure 3

Open in a new tab

Flowchart of results of search of clinical trial summaries

Table 2.

Number of serious adverse events in journal articles versus trial summaries*

Drug No of serious adverse events Difference in No (%) of reports, journal articles v trial summaries
Journal articles Trial summaries
Sotrovimab (n=1) 0 11 11 (100)
Bamlanivimab (n=3) 27 46 19 (41)
Remdesivir (n=7) 119 315 196 (62)
Molnupiravir (n=2) 3 3 0
Nirmatrelvir (n=1) 1 24 23 (96)
Tocilizumab (n=4) 96 166 70 (42)
Sarilumab (n=1) 93 93 0
Baricitinib (n=1) 4 49 45 (92)
Total (n=20) 343 707 364 (51)
Open in a new tab

*Online supplemental table 6 describes the number of serious adverse events in trial summaries and journal articles by drug.

Assessment of bias

We assessed the level of bias in each study (online supplemental table 5). Of the 56 studies included in the analysis, 92.9%, 5.4%, and 1.8% had a high, moderate, and low level of bias, respectively. We then compared the level of bias with the quality score for reporting of adverse events for each included study. For studies with a high level of bias, 5.8%, 36.5%, and 57.7% had a very low, low, and moderate quality score, respectively. For studies with a moderate or low level of bias, 100% had a moderate quality score (online supplemental figure 3).

Discussion

Principal findings

Based on our evaluation of the total harm reporting score, we found that no study had a high score for the quality of reporting of adverse events, most studies had a moderate quality score, and one in three studies had a low or very low score for quality of reporting. We also found that clinical trials with very low scores were those that investigated antiviral agents and immunomodulators (remdesivir, tocilizumab, and sarilumab). Few of the included studies reported information on adverse events in the introduction (item 2 of the CONSORT harms extension), possibly because in general, authors focus mainly on the efficacy of drugs. Also, we found that journal articles under-reported the number of serious adverse events compared with trial summaries of clinical trials of covid-19 drugs (table 2). Information on serious adverse events was lacking in published articles; only two drugs (molnupiravir and sarilumab) had the same number of serious adverse events reported in journal articles and clinical summaries. We found that well designed and mostly double blind randomised controlled trials provided results with a moderate score for the quality of reporting of adverse events compared with other study designs. All clinical trials with a low or very low score for quality of reporting of adverse events had a high level of bias.

Comparison with other studies

Our findings provide new information and support other recent analyses. A preliminary study showed that for clinical trials of remdesivir, the quality of adverse event reporting was low.4 Another study showed that none of the clinical trials that evaluated the effectiveness of hydroxychloroquine or chloroquine for the treatment of covid-19 met the CONSORT criteria in full for reporting harm data.58 Randomised clinical trials on the covid-19 vaccine, however, were reported to be less biased with good quality on reporting harm based on the modified CONSORT harms extension.7

The low quality of adverse event reporting in clinical trials is not limited to covid-19 drugs. Of 1608 serious adverse events in participants treated with six antidepressants reported in trial summaries, 694 (43.2%) did not appear in the associated articles.59 This finding was highlighted in another study that found that reporting was substantially more complete in summaries on the ClinicalTrials.gov website than in published articles for serious adverse events (99% v 63%).60 These safety data are the main scientific sources for researchers and clinicians, and our results indicate that relying on journal articles for information on covid-19 drugs might miss important information on adverse events.

Several studies in our evaluation had moderate-to-low quality reporting of adverse events. This finding might be explained in the context of the pandemic where researchers favoured the evaluation of effectiveness over adverse events. Even in the absence of an epidemic, however, risk assessment of drugs has been reported to be low, possibly because different pharmaceutical companies and countries have different requirements for reporting of adverse events in clinical trials.61–63 Under-reporting of adverse events, however, could be harmful for drug safety and hence for patients. Journals might limit the number of words in titles or abstracts which could lead to a greater focus on effectiveness. The number of adverse events reported in clinical trials is often small because of the low power of clinical trials to detect adverse events, so the recording of adverse events, when they occur, is important for drug safety. Moreover, we found that in many protocols and articles, the CONSORT statement was not mentioned, possibly suggesting unfamiliarity with these guidelines.

Our findings suggest the need to consult several sources of information to correctly establish the safety profile of these drugs from clinical trials. Often published articles only report serious adverse events that occur in >5% of patients. During the covid-19 pandemic, these clinical trials were primarily and rapidly designed to evaluate efficacy, possibly explaining why some clinical trials had a low or very low quality of adverse event reporting. Based on the results of our systematic review comparing the reporting of harms of several covid-19 drugs, and results from previous studies,64 adverse event reporting seemed to be more complete in clinical trial summaries than in journal articles.

Implementing CONSORT recommendations is necessary to correctly measure and report the effectiveness and safety of the intervention.65 Stroehlein et al found insufficient evidence to determine the benefits and harms of vitamin D supplementation as a treatment for covid-19 because of limited safety information, and were concerned about consistency in measuring and recording these outcomes.66 The authors highlighted an urgent need for well designed and adequately powered randomised clinical trials with an appropriate randomisation procedure, comparability of study arms, and preferably double blinding. These findings are in agreement with our results because we showed that the clinical trials that had a very low quality of adverse event reporting were randomised open label trials, and those with a low quality of adverse event reporting were randomised single blind or no allocation open label trials.

The purpose of clinical trials is to evaluate the effectiveness and safety of new drugs. Systematic errors, however, can be made, leading to a variation in results that can result in overestimation or underestimation of the true effect of an intervention. In a study of osteosarcoma and Ewing's sarcoma, the prevalence of a low risk bias was 47.3%, unclear risk domains was 47.8%, and 4.9% of domains had a high risk of bias in randomised clinical trials.64 Domains with the highest risk of bias were blinding of participants or staff, and outcome assessors, followed by randomisation and allocation concealment. In our study, risk of bias was mainly high in 92.9% of the included clinical trials. All clinical trials with low and very low reporting quality were studies with a high risk of bias.

Limitations of this study

Our study had some limitations. In this systematic review, our focus was on published trials and unpublished data were excluded. We also examined only one clinical trials registry (ClinicalTrials.gov).

Policy implications

To deal with the problem of low quality of reporting of adverse events and missing data for covid-19 drugs, editors should impose stricter requirements for submitting journal articles. The recommendations of the CONSORT harms extension should be applied in any submission of results of clinical trials related to drug safety. Journal articles are more accessible and available earlier than clinical trial summaries and therefore CONSORT harms recommendations should be used to improve the quality of reporting of adverse events in randomised controlled trials.67

Conclusions

In one in three clinical trials that assessed the efficacy and safety of covid-19 drugs, we found that the quality of reporting of safety data was low or very low. Also, differences were found in the number of serious adverse events related to covid-19 drugs between trial summaries (ClinicalTrials.gov) and journal articles. Both sources were limited by incomplete reporting. Authors and editors should pay more attention to methods, by better reporting of safety data for covid-19 drugs in clinical trials. Physicians and health professionals should consider published trial reports alongside summaries in clinical trial registries for a more complete understanding of the adverse events of drugs in clinical trials.

Acknowledgments

We thank Marie-Elise Llau for her help and availability in the practical implementation of KM's research project.

Footnotes

Twitter: @montastrucf

Contributors: KM, PO, and FM designed the study. KM, CF, and FM screened citations for inclusion and were involved in data extraction and interpretation. KM and CF were involved is the risk of bias assessments. All authors were involved in the interpretation of the data. FM wrote the draft manuscript. KM and FM revised the new version of the manuscript. All authors approved the final and revised versions of the manuscript. FM is the guarantor of this manuscript and accepts full responsibility for the work and the conduct of the study, had access to the data, and controlled the decision to publish. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted. Transparency: The lead author (the guarantor) affirms that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.

Funding: This project was funded by the French National Research Agency (ANR Agence Nationale de la Recherche). FM has received funding under the Vigi-Drugs COVID-19 (No ANR-21-CO17-0001) project from the French National Research Agency for the evaluation of safety data of drugs and vaccines used in the management or prevention of covid-19 (https://anr.fr/Project-ANR-21-CO17-0001). The funder had no role in considering the study design or in the collection, analysis, interpretation of data, writing of the report, or decision to submit the article for publication.

Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/disclosure-of-interest/ and declare: support from the French National Research Agency (ANR Agence Nationale de la Recherche) for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Data availability statement

All data relevant to the study are included in the article or uploaded as supplementary information.

Ethics approval

No ethical approval needed.

References

  • 1.Scialo F, Daniele A, Amato F, et al. ACE2: the major cell entry receptor for SARS-CoV-2. Lung 2020;198:867–77. 10.1007/s00408-020-00408-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Jean SS, Lee PI, Hsueh PR. Treatment options for COVID-19: the reality and challenges. J Microbiol Immunol Infect 2020;53:436–43. 10.1016/j.jmii.2020.03.034 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Agarwal A, Rochwerg B, Lamontagne F, et al. A living WHO guideline on drugs for COVID-19. BMJ 2020;370:m3379. 10.1136/bmj.m3379 [DOI] [PubMed] [Google Scholar]
  • 4.Kow CS, Aldeyab M, Hasan SS. Quality of adverse event reporting in clinical trials of Remdesivir in patients with COVID-19. Eur J Clin Pharmacol 2021;77:435–7. 10.1007/s00228-020-03008-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Ioannidis JPA, Evans SJW, Gøtzsche PC, et al. Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med 2004;141:781. 10.7326/0003-4819-141-10-200411160-00009 [DOI] [PubMed] [Google Scholar]
  • 6.Hadi MA, McHugh GA, Conaghan PG. Quality of reporting of harms in randomised controlled trials of pharmacological interventions for rheumatoid arthritis: a systematic review. Evid Based Med 2017;22:170–7. 10.1136/ebmed-2017-110715 [DOI] [PubMed] [Google Scholar]
  • 7.Yuniar CT, Pratiwi B, Ihsan AF, et al. Adverse events reporting quality of randomized controlled trials of COVID-19 vaccine using the CONSORT criteria for reporting harms: a systematic review. Vaccines (Basel) 2022;10:313. 10.3390/vaccines10020313 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Higgins JPT, Altman DG, Gøtzsche PC, et al. The Cochrane collaboration’s tool for assessing risk of bias in randomised trials. BMJ 2011;343:d5928. 10.1136/bmj.d5928 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Gupta A, Gonzalez-Rojas Y, Juarez E, et al. Early treatment for COVID-19 with SARS-Cov-2 neutralizing antibody Sotrovimab. N Engl J Med 2021;385:1941–50. 10.1056/NEJMoa2107934 [DOI] [PubMed] [Google Scholar]
  • 10.ACTIV-3/Therapeutics for Inpatients with COVID-19 (TICO) Study Group . Efficacy and safety of two Neutralising Monoclonal antibody therapies, sotrovimab and BRII-196 plus BRII-198, for adults hospitalised with COVID-19 (TICO): a randomised controlled trial. Lancet Infect Dis 2022;22:622–35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Chen P, Nirula A, Heller B, et al. SARS-CoV-2 neutralizing antibody LY-Cov555 in outpatients with COVID-19. N Engl J Med 2021;384:229–37. 10.1056/NEJMoa2029849 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.ACTIV-3/TICO LY-CoV555 Study Group, Lundgren JD, Grund B, et al. A neutralizing monoclonal antibody for hospitalized patients with COVID-19. N Engl J Med 2021;384:905–14. 10.1056/NEJMoa2033130 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Cohen MS, Nirula A, Mulligan MJ, et al. Effect of Bamlanivimab vs placebo on incidence of COVID-19 among residents and staff of skilled nursing and assisted living facilities: a randomized clinical trial. JAMA 2021;326:46. 10.1001/jama.2021.8828 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Chen P, Datta G, Grace Li Y, et al. First-in-human study of Bamlanivimab in a randomized trial of hospitalized patients with COVID-19. Clin Pharmacol Ther 2021;110:1467–77. 10.1002/cpt.2405 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Gottlieb RL, Nirula A, Chen P, et al. Effect of Bamlanivimab as monotherapy or in combination with Etesevimab on viral load in patients with mild to moderate COVID-19: a randomized clinical trial. JAMA 2021;325:632–44. 10.1001/jama.2021.0202 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Dougan M, Nirula A, Azizad M, et al. Bamlanivimab plus Etesevimab in mild or moderate COVID-19. N Engl J Med 2021;385:1382–92. 10.1056/NEJMoa2102685 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Dougan M, Azizad M, Mocherla B, et al. A randomized, placebo-controlled clinical trial of bamlanivimab and etesevimab together in high-risk ambulatory patients with COVID-19 and validation of the prognostic value of persistently high viral load. Clinical Infectious Diseases 2022;75:e440–9. 10.1093/cid/ciab912 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.O’Brien MP, Forleo-Neto E, Sarkar N, et al. Effect of subcutaneous casirivimab and Imdevimab antibody combination vs placebo on development of symptomatic COVID-19 in early asymptomatic SARS-CoV-2 infection: a randomized clinical trial. JAMA 2022;327:432–41. 10.1001/jama.2021.24939 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Weinreich DM, Sivapalasingam S, Norton T, et al. REGEN-COV antibody combination and outcomes in outpatients with COVID-19. N Engl J Med 2021;385:e81. 10.1056/NEJMoa2108163 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.O’Brien MP, Forleo-Neto E, Sarkar N, et al. Subcutaneous REGEN-COV antibody combination in early asymptomatic SARS-CoV-2 infection: a randomized clinical trial. medRxiv 2021. 10.1101/2021.06.14.21258569 [DOI] [Google Scholar]
  • 21.Spinner CD, Gottlieb RL, Criner GJ, et al. Effect of remdesivir vs standard care on clinical status at 11 days in patients with moderate COVID-19: a randomized clinical trial. JAMA 2020;324:1048–57. 10.1001/jama.2020.16349 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Kalil AC, Patterson TF, Mehta AK, et al. Baricitinib plus remdesivir for hospitalized adults with COVID-19. N Engl J Med 2021;384:795–807. 10.1056/NEJMoa2031994 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Rosas IO, Diaz G, Gottlieb RL, et al. Tocilizumab and remdesivir in hospitalized patients with severe COVID-19 pneumonia: a randomized clinical trial. Intensive Care Med 2021;47:1258–70. 10.1007/s00134-021-06507-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Wang Y, Zhang D, Du G, et al. Remdesivir in adults with severe COVID-19: a randomised, double-blind, placebo-controlled, multicentre trial. Lancet 2020;395:1569–78. 10.1016/S0140-6736(20)31022-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Beigel JH, Tomashek KM, Dodd LE, et al. Remdesivir for the treatment of COVID-19 - final report. N Engl J Med 2020;383:1813–26. 10.1056/NEJMoa2007764 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Remdesivir for 5 or 10 days in patients with severe COVID-19 [NEJM]. Available: https://www.nejm.org/doi/full/10.1056/nejmoa2015301 [Accessed 31 May 2023]. [DOI] [PMC free article] [PubMed]
  • 27.Barratt-Due A, Olsen IC, Nezvalova-Henriksen K, et al. Evaluation of the effects of remdesivir and hydroxychloroquine on viral clearance in COVID-19: a randomized trial. Ann Intern Med 2021;174:1261–9. 10.7326/M21-0653 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Gottlieb RL, Juneja K, Hill JA. Outpatient remdesivir to prevent progression to severe COVID-19. reply. N Engl J Med 2022;386:1094. 10.1056/NEJMc2200591 [DOI] [PubMed] [Google Scholar]
  • 29.Ader F, Bouscambert-Duchamp M, Hites M, et al. Remdesivir plus standard of care versus standard of care alone for the treatment of patients admitted to hospital with COVID-19 (discovery): a phase 3, randomised, controlled, open-label trial. Lancet Infect Dis 2022;22:209–21. 10.1016/S1473-3099(21)00485-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Ali K, Azher T, Baqi M, et al. Remdesivir for the treatment of patients in hospital with COVID-19 in Canada: a randomized controlled trial. CMAJ 2022;194:E242–51. 10.1503/cmaj.211698 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Kalil AC, Mehta AK, Patterson TF, et al. Efficacy of interferon Beta-1A plus remdesivir compared with remdesivir alone in hospitalised adults with COVID-19: a double-bind, randomised, placebo-controlled, phase 3 trial. Lancet Respir Med 2021;9:1365–76. 10.1016/S2213-2600(21)00384-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Fischer W, Eron JJ Jr, Holman W, et al. Molnupiravir, an oral antiviral treatment for COVID-19. Infectious Diseases (except HIV/AIDS) [Preprint]. 10.1101/2021.06.17.21258639 [DOI]
  • 33.Painter WP, Holman W, Bush JA, et al. Human safety, tolerability, and pharmacokinetics of molnupiravir, a novel broad-spectrum oral antiviral agent with activity against SARS-CoV-2. Antimicrob Agents Chemother 2021;65:e02428-20. 10.1128/AAC.02428-20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Molnupiravir for oral treatment of COVID-19 in Nonhospitalized patients. Available: https://pubmed.ncbi.nlm.nih.gov/34914868/ [Accessed 31 May 2023]. [DOI] [PMC free article] [PubMed]
  • 35.Khoo SH, Fitzgerald R, Fletcher T, et al. Optimal dose and safety of Molnupiravir in patients with early SARS-CoV-2: a phase I, open-label, dose-escalating, randomized controlled study. J Antimicrob Chemother 2021;76:3286–95. 10.1093/jac/dkab318 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Fischer WA, Eron JJ Jr, Holman W, et al. A phase 2A clinical trial of molnupiravir in patients with COVID-19 shows accelerated SARS-CoV-2 RNA clearance and elimination of infectious virus. Sci Transl Med 2022;14:eabl7430. 10.1126/scitranslmed.abl7430 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Hammond J, Leister-Tebbe H, Gardner A, et al. Oral Nirmatrelvir for high-risk. N Engl J Med 2022;386:1397–408. 10.1056/NEJMoa2118542 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Hermine O, Mariette X, Tharaux P-L, et al. Effect of tocilizumab vs usual care in adults hospitalized with COVID-19 and moderate or severe pneumonia: a randomized clinical trial. JAMA Intern Med 2021;181:32–40. 10.1001/jamainternmed.2020.6820 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Salvarani C, Dolci G, Massari M, et al. Effect of tocilizumab vs standard care on clinical worsening in patients hospitalized with COVID-19 pneumonia: a randomized clinical trial. JAMA Intern Med 2021;181:24–31. 10.1001/jamainternmed.2020.6615 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Salama C, Han J, Yau L, et al. Tocilizumab in patients hospitalized with COVID-19 pneumonia. N Engl J Med 2021;384:20–30. 10.1056/NEJMoa2030340 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.RECOVERY Collaborative Group, Horby PW, Pessoa-Amorim G, et al. Tocilizumab in patients admitted to hospital with COVID-19 (RECOVERY): preliminary results of a randomised, controlled, open-label, platform trial. Infectious Diseases (except HIV/AIDS) [Preprint]. 10.1101/2021.02.11.21249258 [DOI]
  • 42.Veiga VC, Prats JAGG, Farias DLC, et al. Effect of tocilizumab on clinical outcomes at 15 days in patients with severe or critical Coronavirus disease 2019. BMJ 2021;372:n84. 10.1136/bmj.n84 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Stone JH, Frigault MJ, Serling-Boyd NJ, et al. Efficacy of tocilizumab in patients hospitalized with COVID-19. N Engl J Med 2020;383:2333–44. 10.1056/NEJMoa2028836 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Brown MJ, Alazawi W, Kanoni S. Interleukin-6 receptor antagonists in critically ill patients with COVID-19. N Engl J Med 2021;385:1147. 10.1056/NEJMc2108482 [DOI] [PubMed] [Google Scholar]
  • 45.Zhao H, Zhu Q, Zhang C, et al. Tocilizumab combined with favipiravir in the treatment of COVID-19: a multicenter trial in a small sample size. Biomed Pharmacother 2021;133:110825. 10.1016/j.biopha.2020.110825 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Perrone F, Piccirillo MC, Ascierto PA, et al. Tocilizumab for patients with COVID-19 pneumonia. The single-arm TOCIVID-19 prospective trial. J Transl Med 2021;19:442. 10.1186/s12967-021-03094-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Soin AS, Kumar K, Choudhary NS, et al. Tocilizumab plus standard care versus standard care in patients in India with moderate to severe COVID-19-associated cytokine release syndrome (COVINTOC): an open-label, multicentre, randomised, controlled, phase 3 trial. Lancet Respir Med 2021;9:511–21. 10.1016/S2213-2600(21)00081-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Wang D, Fu B, Peng Z, et al. Tocilizumab in patients with moderate or severe COVID-19: a randomized, controlled, open-label, multicenter trial. Front Med 2021;15:486–94. 10.1007/s11684-020-0824-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Kumar PN, Hernández-Sánchez J, Nagel S, et al. Safety and efficacy of tocilizumab 4 or 8 mg/kg in hospitalized patients with moderate to severe Coronavirus disease 2019 pneumonia: a randomized clinical trial. Open Forum Infect Dis 2022;9:ofab608. 10.1093/ofid/ofab608 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Lescure F-X, Honda H, Fowler RA, et al. Sarilumab in patients admitted to hospital with severe or critical COVID-19: a randomised, double-blind, placebo-controlled, phase 3 trial. Lancet Respir Med 2021;9:522–32. 10.1016/S2213-2600(21)00099-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Mariette X, Hermine O, Tharaux P-L, et al. CORIMUNO-19 collaborative group. Sarilumab in adults hospitalised with moderate-to-severe COVID-19 pneumonia (CORIMUNO-SARI-1): an open-label randomised controlled trial. Lancet Rheumatol 2022;4:e24–32. 10.1016/S2665-9913(21)00315-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Sancho-López A, Caballero-Bermejo AF, Ruiz-Antorán B, et al. Efficacy and safety of sarilumab in patients with Covid19 pneumonia: a randomized. Infect Dis Ther 2021;10:2735–48. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Hermine O, Mariette X, Porcher R, et al. Effect of Interleukin-6 receptor antagonists in critically ill adult patients with COVID-19 pneumonia: two randomised controlled trials of the CORIMUNO-19 collaborative group. Eur Respir J 2022;60:2102523. 10.1183/13993003.02523-2021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Cao Y, Wei J, Zou L, et al. Ruxolitinib in treatment of severe Coronavirus disease 2019 (COVID-19): a multicenter, single-blind, randomized controlled trial. J Allergy Clin Immunol 2020;146:137–46. 10.1016/j.jaci.2020.05.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Iastrebner M, Castro J, García Espina E, et al. Ruxolitinib in severe COVID-19: results of a multicenter, prospective, single arm, open-label clinical study to investigate the efficacy and safety of ruxolitinib in patients with COVID-19 and severe acute respiratory syndrome. Rev Fac Cien Med Univ Nac Cordoba 2021;78:294–302. 10.31053/1853.0605.v78.n3.32800 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Guimarães PO, Quirk D, Furtado RH, et al. Tofacitinib in patients hospitalized with COVID-19 pneumonia. N Engl J Med 2021;385:406–15. 10.1056/NEJMoa2101643 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Marconi VC, Ramanan AV, de Bono S, et al. Efficacy and safety of baricitinib for the treatment of hospitalised adults with COVID-19. Lancet Respir Med 2021;9:1407–18. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Mazhar F, Hadi MA, Kow CS, et al. Use of hydroxychloroquine and chloroquine in COVID-19: how good is the quality of randomized controlled trials. Int J Infect Dis 2020;101:107–20. 10.1016/j.ijid.2020.09.1470 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Hughes S, Cohen D, Jaggi R. Differences in reporting serious adverse events in industry sponsored clinical trial registries and journal articles on antidepressant and antipsychotic drugs: a cross-sectional study. BMJ Open 2014;4:e005535. 10.1136/bmjopen-2014-005535 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Riveros C, Dechartres A, Perrodeau E, et al. Timing and completeness of trial results posted at ClinicalTrials.gov and published in journals. PLoS Med 2013;10:e1001566. 10.1371/journal.pmed.1001566 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Phillips R, Hazell L, Sauzet O, et al. Analysis and reporting of adverse events in randomised controlled trials: a review. BMJ Open 2019;9:e024537. 10.1136/bmjopen-2018-024537 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Ioannidis JPA. Adverse events in randomized trials: neglected, restricted, distorted, and silenced. Arch Intern Med 2009;169:1737–9. 10.1001/archinternmed.2009.313 [DOI] [PubMed] [Google Scholar]
  • 63.Meister R, von Wolff A, Mohr H, et al. Adverse event methods were heterogeneous and insufficiently reported in randomized trials on persistent depressive disorder. J Clin Epidemiol 2016;71:97–108. 10.1016/j.jclinepi.2015.10.007 [DOI] [PubMed] [Google Scholar]
  • 64.Koucheki R, Gazendam AM, Perera JR, et al. Assessment of risk of bias in osteosarcoma and Ewing’s sarcoma randomized controlled trials: a systematic review. Curr Oncol 2021;28:3771–94. 10.3390/curroncol28050322 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Junqueira DR, Zorzela L, Golder S, et al. CONSORT harms 2022 statement, explanation, and elaboration: updated guideline for the reporting of harms in randomised trials. BMJ 2023;381:e073725. 10.1136/bmj-2022-073725 [DOI] [PubMed] [Google Scholar]
  • 66.Stroehlein JK, Wallqvist J, Iannizzi C, et al. Vitamin D supplementation for the treatment of COVID-19: a living systematic review. Cochrane Database Syst Rev 2021;5:CD015043. 10.1002/14651858.CD015043 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Cochrane Adverse Effects . CONSORT harms update. Available: https://methods.cochrane.org/adverseeffects/news/consort-harms-update [Accessed 31 May 2023].

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjmed-2022-000352supp001.pdf (3.1MB, pdf)

Data Availability Statement

All data relevant to the study are included in the article or uploaded as supplementary information.

Articles from BMJ Medicine are provided here courtesy of BMJ Publishing Group

RESOURCES