Abstract
An under-representation of women and a lack of sex-specific analyses in COVID-19 trials has been suggested. However, the higher number of men than women who are severely affected by COVID-19 and the restricted information in scientific publications may have biased these suggestions. Therefore, we evaluated sex proportionality and sex-specific efficacy and safety data in trials of COVID-19 treatments and vaccines using both publicly available regulatory documents and confidential documents used by regulators in their review of medicinal products. Included were two treatments (ie, remdesivir and dexamethasone) and four vaccines (ie, BNT162b2 mRNA (BioNTech/Pfizer), mRNA-1273 (Moderna), ChAdOx1-S (AstraZeneca) and Ad26.COV2-S (Janssen)) that received marketing authorisation by the European Commission at the time of the study conduct. An under-representation of women was shown in three of the nine data sets for one treatment (ie, remdesivir), but the proportion of women included was representative in each of the data sets for the other five products. This indicates that there is no structural under-representation of women in the COVID-19 trials. Currently, sex-specific efficacy data are available for five of the six assessed products and sex-specific safety data are available for half of the products only. It is important that this information will also be made available for the other products. There are only small differences in efficacy and safety between men and women which are likely to be of limited clinical relevance. Sex-specific efficacy information can generally be found in the publicly available regulatory documents other than the Summary of Product Characteristics, for which more awareness might be required.
Keywords: COVID-19, vaccines, treatment, review, public health
Summary box.
Sex differences have been shown in the COVID-19 pandemic and are important to examine.
A lack of consideration for women in clinical trials of COVID-19 treatments and vaccines has been suggested, both in terms of a lower number of women than men included in the trials and a lack of sex-specific analyses of the favourable and unfavourable effects.
Based on information from regulatory documents, we found no structural under-representation of women in the trials of the assessed medicinal products for COVID-19.
Sex-specific efficacy and safety information is available for respectively five and three of the six assessed COVID-19 products.
It is important that this information will also be made available for the other products.
Observed differences in efficacy and safety were small and likely of limited clinical relevance.
More awareness to sex-specific information that generally can be found in European Public Assessment Reports and clinical data on the European Medicines Agency website might be required.
Introduction
Sex differences, with men generally having a higher risk than women of COVID-19-related hospitalisation, intensive care unit (ICU) admission and death, have been observed during the COVID-19 pandemic.1–4 Gender-related behavioural factors (eg, smoking) could be part of the explanation for such differences, but biological (ie, sex) differences are also likely to play a role. There are known sex differences in the different steps from virus entry to adaptive immune response that may impact the response to the SARS-CoV-2 infection as well as the disease progression.1 5 In addition to response to the virus, men and women may respond differently to treatments and vaccines. For instance, women generally have higher overall antibody levels and report more adverse events (AEs) to vaccines than men.4 6 7 Attention to sex in clinical trials in general and in those of COVID-19 trials as a specific case is therefore considered necessary.8–13
A ‘sex gap’ in clinical trials of COVID-19 treatments and vaccines has been suggested, however, both in terms of a lower number of women than men included in the trials as well as a lack of sex-specific analyses of the favourable and unfavourable effects.14–16 There are two important factors to note that may have biased these conclusions. First, there is generally no adjustment for the higher number of men than women who are severely affected by COVID-19. Due to this higher occurrence of severe COVID-19 disease among men, clinical trials testing the effects of treatments in this population are logically more likely to include a higher number of men. This also explains the finding of a previous study showing that COVID-19 drug trials are less likely to have a good sex balance than the COVID-19 vaccine studies in which the general population is targeted.14 The participants in phase III clinical trials especially should be representative of the population that would use the product after its market approval.17
Second, the conclusions are based on reviews of scientific publications that contain much less information than the full dossiers that pharmaceutical companies submit to regulatory authorities to support a marketing authorisation application. A recent study using the information in the marketing authorisation application dossiers of medicines for various diseases presented a more positive view with sex-specific information on efficacy and safety available for each of the assessed products.18 This information, however, may not end up in the documents that are used to inform clinical practice. The Summary of Product Characteristics (SmPCs) provides the basis of information for European healthcare professionals on how to use a medicine safely and effectively. More detailed information on the clinical programme and benefit-risk assessment is available in the European Public Assessment Reports (EPARs).19 Since 2015, clinical data submitted by pharmaceutical companies to support their marketing applications are also being made publicly available on the European Medicines Agency (EMA) website.20
Given the suggested limited attention to women in the evaluation of COVID-19 treatments and vaccines and the above-mentioned limitations, we conducted a review of sex proportionality and sex-specific efficacy and safety data in publicly available regulatory documents and confidential documents used by regulators in their review of COVID-19 medicinal products.
Review process of the regulatory documents of COVID-19 medicinal products
We included products for the treatment and prevention of COVID-19 that received marketing authorisation by the European Commission as indicated on the EMA website21 before June 2021. This resulted in the inclusion of six medicinal products, respectively, two treatments (ie, remdesivir and dexamethasone) and four vaccines (ie, BNT162b2 mRNA (BioNTech/Pfizer), mRNA-1273 (Moderna), ChAdOx1-S (AstraZeneca) and Ad26.COV2-S (Janssen)) (table 1).
Table 1.
Summary of the included medicinal products
Product name | Treatment/vaccine | Studies contributing to the main efficacy and safety data sets | Efficacy population | Safety population | SmPC | EPAR | Additional information |
remdesivir | Treatment | NIAID-ACTT(1) GS-US 540 5776 (adaptive trial); GS-US-540–5773 (phase III); GS-US-540–5774 (phase III); CO-US-540–5758 (phase III) |
All subjects in the adaptive trial | All subjects in the phase III trials | * | † | Confidential—MAA dossiers |
dexamethasone | Treatment | RECOVERY adaptive platform trial | All subjects | All subjects | ‡ | § | Public—EMA website |
BNT162b2 mRNA (BioNTech/Pfizer) | Vaccine | C4951001 (phase I/II/III) | Subjects without evidence of infection before vaccination phase I/II/III | All subjects in the phase II/III study | ¶ | ** | Public—EMA website |
mRNA-1273 (Moderna) | Vaccine | mRNA-1273-P301 (phase III) | Subjects in the phase III study 14 days after the second injection in the PP set | All subjects in the phase III study | †† | ‡‡ | Public—EMA website |
ChAdOx1-S (AstraZeneca) | Vaccine | Study COV001 (phase I/II); Study COV002 (phase II/III); Study COV003 (phase II/III); Study COV005 (phase I/II) |
Subjects receiving SD/SD in both phase II/III studies | All subjects in all studies | §§ | ¶¶ | Confidential—MAA dossiers |
Ad26.COV2-S (Janssen) | Vaccine | VAC31518COV3001 (phase III) | Subjects in the PP set of the phase III study | All subjects in the phase III study | *** | ††† | Confidential—MAA dossiers |
*https://www.ema.europa.eu/en/documents/product-information/veklury-epar-product-information_en.pdf.
¶https://www.ema.europa.eu/en/documents/product-information/comirnaty-epar-product-information_en.pdf.
EMA, European Medicines Agency; EPAR, European Public Assessment Report; MAA, marketing authorisation application; PP, per protocol; SmPC, Summary of Product Characteristics.
Publicly available regulatory information was extracted from the SmPCs, EPARs and the clinical data available on the EMA website. SmPCs and EPARs can be found on the EMA web page of a specific treatment or vaccine of interest and were available for each of the six included COVID-19 products. The clinical data on the EMA website are available after creating a free account. In these clinical data, we searched for information in the documents in the sections ‘clinical overview’ and ‘clinical study reports’. The clinical data on the EMA website were available for dexamethasone, BioNTech/Pfizer and Moderna. For the other products, that is, remdesivir, AstraZeneca and Janssen, we obtained additional information from the clinical study reports (module 5) and the summary information (module 2) of the confidential marketing authorisation application dossiers available at the Dutch Medicines Evaluation Board and EMA.
The following search terms were used in the screening of the documents: sex, gender, male, women, sub group, subgroup and sub-group. In the EPARs, the additional search terms ‘table’ and ‘figure’ were used since these documents sometimes include screenshots of tables and figures which cannot be screened using the search function.
Sex proportionality
Sex proportionality was assessed separately for trial participants receiving the treatment or vaccine, receiving standard of care or placebo, and per efficacy and safety data set in the main study or studies (table 1) and was determined by calculating the participation to prevalence ratio (PPR).22 For the calculation of the PPR, the percentage of women in the trial was divided by the percentage of women in the target population. For the treatments, the percentage of women hospitalised due to COVID-19 was used as the population reference for which we calculated the average of the percentages per country provided on the website of the Global Health 50/50 initiative,23 which is 43.8%. For the vaccines, we assumed that 50% of the population were women. A PPR <0.8 or >1.2 was considered respectively an under-representation or over-representation of women in the trial compared with the representation of women in the target population.22
In the efficacy and safety data sets of each of the medicinal products, both women and men were included. The numbers and/or percentages of included men and/or women were found in publicly available documents (table 2; online supplemental table 1). In total, we evaluated 27 data sets; 9 for remdesivir, 2 for dexamethasone and 4 for each of the vaccines. A proportional representation of women in each of the assessed data sets was shown for five of the six assessed products, that is, dexamethasone, BioNTech/Pfizer, Moderna, AstraZeneca and Janssen (figure 1). An under-representation of women was shown in three of the nine included data sets of remdesivir. PPRs of these three data sets ranged from 0.742 to 0.797.
Table 2.
Availability of sex-specific information in the publicly available documents
Sex proportionality | Sex-specific efficacy information | Sex-specific numerical efficacy data | Sex-specific safety information | Sex-specific numerical safety data | |
remdesivir | + | – | + | – | – |
dexamethasone | + | + | + | – | – |
BNT162b2 mRNA (BioNTech/Pfizer) | + | + | + | + | + |
mRNA-1273 (Moderna) | + | + | + | – | – |
ChAdOx1-S (AstraZeneca) | + | – | – | – | – |
Ad26.COV2-S (Janssen) | + | + | + | + | + |
Figure 1.
Participation to prevalence ratios (PPR) of the data sets used for treatments remdesivir and dexamethasone, and vaccines BNT162b2 mRNA (BioNTech/Pfizer), mRNA-1273 (Moderna), ChAdOx1-S (AstraZeneca) and Ad26.COV2-S (Janssen).
bmjgh-2021-008173supp001.pdf (142KB, pdf)
Sex-specific efficacy data
Sex-specific efficacy information and numerical results were assessed for the main data set and population (table 1) and was available for five of the six assessed products, that is, remdesivir, dexamethasone, BioNTech/Pfizer, Moderna and Janssen. For these products, information was found in the publicly available documents with the SmPCs providing some general information for most products and the EPARs and clinical data on the EMA website providing sex-specific numerical efficacy data (table 2; online supplemental table 1).
The sex-specific numerical efficacy data show that the effects of the treatments and the vaccines are similar between women and men (figure 2). For remdesivir, the recovery rate ratio was 1.31 (95% CI 1.07 to 1.59) and 1.38 (95% CI 1.05 to 1.81), respectively, for men and women (figure 2A). For dexamethasone, the rate ratio was 0.80 (95% CI 0.71 to 0.91) for men and 0.90 (95% CI 0.74 to 1.09) for women (figure 2B). The effectiveness of the vaccines ranged from >60% for Janssen to >90% for BioNTech/Pfizer and Moderna among both women and men (figure 2C).
Figure 2.
Sex-specific efficacy results of (A) treatment remdesivir, (B) treatment dexamethasone, and (C) vaccines BNT162b2 mRNA (BioNTech/Pfizer), mRNA-1273 (Moderna) and Ad26.COV2-S (Janssen). CI, confidence interval; RR, rate ratio; RRR, recovery rate ratio; VE, Vaccine effectiveness.
Sex-specific safety data
For sex-specific safety information and numerical results (table 1), we focused on any AEs, and on serious adverse events (SAEs) in the different arms of the trials, that is, in the active treatment or vaccine group and the comparator or placebo group. The safety information was available for three of the six products, that is, remdesivir, BioNTech/Pfizer and Janssen. None of the SmPCs of these products contained sex-specific safety information but publicly available information was found in the EPARs and clinical data on the EMA website for BioNTech/Pfizer and Janssen (table 2; online supplemental table 1). For remdesivir, the information was obtained from the confidential marketing authorisation application dossiers. Sex-specific numerical data of both AEs and SAEs was available for remdesivir and BioNTech/Pfizer whereas for Janssen, sex-specific numerical data of only SAEs was available.
We tested the potential sex differences in any AEs and SAEs for those receiving the treatment or vaccine and for those receiving the comparator or placebo using Pearson χ2 tests. We did not adjust for multiple testing to identify any possibly relevant sex differences, so p values <0.05 were considered statistically significant. With regard to remdesivir, women generally more often experienced any AEs than men whereas men generally more often experienced any SAEs in both the treatment and standard of care arms. A statistically significant difference, however, was only observed for the analysis of any AEs at the assessment of 5 days of treatment (59.7% of the women vs 44.7% of the men, p=0.042). For BioNTech/Pfizer, women more often experienced any AEs than men which was statistically significant in both the vaccine group (29.5% vs 24.5%, p<0.001) and the placebo group (13.2% vs 11.9%, p=0.011). For Janssen, no statistically significant differences between men and women were shown (table 3). The number of patients experiencing an SAE is very small, however, for any product, and the results of the analysis should be interpreted with caution.
Table 3.
Percentage of trial participants with any AEs or SAEs of remdesivir, BNT162b2 mRNA (BioNTech/Pfizer) and Ad26.COV2-S (Janssen)
Women | Men | P value | |
remdesivir (study 5774)* | |||
Any AEs | |||
RDV 5 days | 59.7 | 44.7 | 0.042 |
RDV 10 days | 56.0 | 54.2 | 0.810 |
SOC | 49.3 | 42.4 | 0.340 |
Any SAEs | |||
RDV 5 days | 2.6 | 5.3 | 0.367 |
RDV 10 days | 2.7 | 4.2 | 0.569 |
SOC | 5.3 | 11.2 | 0.160 |
BioNTech/Pfizer | |||
Any AEs | |||
Vaccine | 29.5 | 24.5 | <0.001 |
Placebo | 13.2 | 11.9 | 0.011 |
Any SAEs | |||
Vaccine | 0.5 | 0.6 | 0.385 |
Placebo | 0.4 | 0.5 | 0.582 |
Janssen | |||
Any SAEs | |||
≥1 SAE vaccine | 0.4 | 0.4 | 0.353 |
≥1 SAE placebo | 0.6 | 0.7 | 0.492 |
*Data from the confidential marketing authorisation application dossier.
AE, adverse event; RDV, remdesivir; SAE, serious adverse event; SOC, standard of care.
Conclusion
The COVID-19 pandemic presented an exceptional global situation with an urgent need for therapies to curb the disease. Extensive funding was made available to develop new treatments and vaccines, as were many already approved medicines tested for their efficacy in treating COVID-19. The unprecedented public health crisis made flexible and fast regulatory processes for evaluating and approving medicinal products necessary. Consequently, the EMA used a rolling review process; that is, reviewing data sets as soon as these became available. Most of the products reviewed in our study received conditional marketing authorisations, implying that additional data would be provided after approval.24 Nevertheless, regulators applied a thorough review process and judged the benefit-risk balance to be positive at the time of approval. They considered that in view of the unmet need in this pandemic, the benefit to public health of the immediate availability on the market outweighed the risk inherent in the fact that additional data would still be required.25 This procedure is also used for other diseases with unmet medical need (eg, rare/orphan diseases, advanced cancer). The public, however, questioned whether sufficient knowledge was available at the time of approval due to these fast approvals. While we acknowledge that rather large randomised controlled trials (RCTs) were underpinning the conditional approvals, one specific concern was that there might have been too little attention for women in COVID-19 trials. Our review showed that women were generally well represented in these trials. An under-representation of women was shown in three of the nine data sets for one treatment (ie, remdesivir), but the proportion of women included was representative in each of the data sets for the other five products. No sex-specific safety information was available for dexamethasone and Moderna, and sex-specific efficacy and safety information was lacking for AstraZeneca. For this latter vaccine, the EPAR reported that subgroup comparisons including sex, on both efficacy and safety outcomes, will still be explored (online supplemental table 1). These data will be made available in a final full report. The sex-specific data of efficacy and safety available for, respectively, five and three products showed no pattern of relevant differences between men and women.
A limitation of our review is the inclusion of two treatments only. At the time of the study, however, remdesivir and dexamethasone were the only products formally authorised by the European Commission for the treatment of COVID-19 although several other treatments could be used as emergency products. The results of two reviewed treatments are not generalisable to other COVID-19 treatments. Also, the findings of the four included vaccines may not be generalisable to any future vaccine. We adjusted our proportionality analyses for the sex distribution in the target population using the average percentage of hospitalised patients with COVID-19 in various countries worldwide as provided by the Global Health 50/50 data. The percentage of hospitalised patients with COVID-19, however, widely differs across countries and only half of the countries tracked by the sex, gender and COVID-19 project of Global Health 50/50 have provided sex-specific information.23 26 Also, the percentages are different when considering the proportion of women admitted to the ICU. The reliability of the PPR depends on the reliability of the reference data used in the calculations. Furthermore, we did not assess the availability of sex-specific information on other relevant parameters, such as vaccine immunogenicity. In addition, it should be noted that we assessed the sex proportionality in the data sets of the main efficacy and safety studies only. Sex proportionality may be different in other studies, in earlier trial phases and in animal studies.18
Our findings are not in line with previous studies suggesting a sex gap in trials of COVID-19 treatments and vaccines.14–16 This discrepancy can be explained by the use of the percentage of women in the actual target population to determine the sex proportionality in our study as well as the use of different data sources between our study and previous studies, that is, regulatory documents versus scientific publications. For example, regarding the inclusion of women in the trials for the treatment with remdesivir and dexamethasone, the first explanation is plausible; the percentage of women hospitalised due to COVID-19 is lower than the percentage of men23 which results in a lower percentage of women expected to be included in the trials of medicines for the treatment of these patients. Regarding the second explanation, in spite of the increasing attention to sex and gender, exemplified by, for instance, the introduction of the Sex and Gender Equity in Research guidelines to stimulate a more systematic approach of reporting sex and gender in research papers,27 publications on COVID-19 and in various other fields28–30 often still lack sex-specific information. It is reassuring that our review shows that sex-specific information was collected and is available in the documents used in the evaluation of most of the COVID-19 products for marketing approval. This aligns with a previous study showing that sex-specific information is also available in these documents of medicinal products for other diseases.18 More attention to sex-specific safety information of the COVID-19 medicinal products is, however, appropriate since this information was at this stage available for half of the products only. The finding of the previous review of marketing authorisation application dossiers showing that sex-specific safety information was available for all of the assessed other medicinal products18 highlights the importance regulators give to the presentation of sex-specific information. Our review showed that not all this information is available yet for the COVID-19 products which may be explained by the public health emergency. Considering the relevance, it is expected that eventually for all licensed COVID-19 products, sex-specific data will be made available.
Although the EMA considers the SmPCs as the main source of product information for healthcare professionals, our study showed that SmPCs provide only some general sex-specific efficacy information and no sex-specific safety information. This is in line with regulators’ review guidelines that emphasise the importance to assess consistency of effects across subgroups, but that when consistency is observed in subgroups, such as in women and men, it is usually not necessary to document this in the SmPC.31 Whether information about such consistency in subgroups should still be structurally reported in SmPCs is a matter of debate. On the other hand, our review showed that the available sex-specific efficacy and safety information is publicly available for most of the assessed products in other documents, that is, the EPARs and clinical data on the EMA website. It is recommended to communicate widely about the availability of sex-specific information in these other publicly available sources to, for example, healthcare professionals, policy makers, patients and researchers.
Based on the data presented in our study, there is no clear reason to assume that there are relevant sex differences in the efficacy and safety of the evaluated COVID-19 products. For the BioNTech/Pfizer vaccine, a higher rate of AEs is observed in women compared with men; however, this was observed both in the vaccine group and the placebo group, suggesting that this is not a vaccine effect per se. With regard to efficacy, small differences are observed, suggesting higher efficacy in men; however, these are not significant and may be due to chance. Other publications suggest, however, that there are indications of possible sex differences. For instance, a meta-analysis combining clinical trials of different types of COVID-19 vaccines concludes that although effective in both men and women, the overall efficacy might be higher in men.32 This meta-analysis does not address the relevance of the observed differences, and as can be observed in figure 2, the clinical relevance of the observed differences, which were small and not significant in individual trials, may be debated. The rare events of anaphylaxis after vaccination with BioNTech/Pfizer and Moderna,33 both mRNA vaccines, and thrombosis combined with thrombocytopenia after vaccination with AstraZeneca34 and Janssen,35 both adenoviral vector vaccines, were (initially) mostly seen in women. Various factors may explain the observed difference between the results from the RCTs presented in our study and the additional follow-up ‘real world’ studies. A first factor relates to the size and representativeness of the included population. Although tens of thousands of people were included in the phase III clinical trials, they are still a small and selected sample of the overall population. For instance, as is the standard for clinical trials prior to the marketing authorisation of medicines, COVID-19 vaccine trials have excluded pregnant and lactating women,36 and these trials did show an under-representation of the elderly.37 A second factor relates to methodological and statistical aspects. For instance, subgroup analyses are likely to be underpowered since the trials are usually powered for testing the overall effects only.38 Moreover, besides sex, also several other subgroups are relevant when evaluating the treatment effects in COVID-19, such as age groups37 and groups based on different body mass index levels.39 To complicate matters further, there may be value in assessing interactions between subgroups, for example, between sex and age,40 as well as considering other sex-specific endpoints, for example, menstrual period changes,41 and causes of differences between men and women in treatment and vaccine effects. An example of the latter is assessing sex-related (eg, genes, hormones) and gender-related (eg, diet) explanations for differences in vaccine effects on immunogenicity.42–44
It is clear that it will not be possible to answer all the questions before a treatment or vaccine is marketed. As nicely summarised by Eichler et al45: ‘RCTs can only answer a minuscule fraction of the near-infinite number of questions about subpopulations, interactions, treatment settings, effects, etc., that are relevant to patients and healthcare professionals at the point of care.’ Further analyses and postmarketing studies using real-world data will be required to answer additional questions. Besides the full clinical reports, the EMA intends to also publish the individual, anonymised patient data of the marketed products in the future,46 making an extra effort for the development of medicinal products in COVID-19.47 Such data can be used to further examine specific research questions or make more personalised predictions on the effects of a treatment or vaccine.
To summarise, our review of regulatory documents showed that there is no structural under-representation of women in the trials of the assessed COVID-19 products. Sex-specific efficacy and safety information is available for respectively five and three of the six assessed products. It is important that this information will also be made available for the other products. Most of the information can be found in the publicly available EPARs and clinical data on the EMA website. More awareness of these data sources might be required. The available data do not suggest that there are clinically relevant differences in efficacy and safety between men and women but limitations of clinical trials in general require further assessment of possible sex differences.
Acknowledgments
The authors would like to thank Melissa Hondeman for her help with the extraction of the information.
Footnotes
Handling editor: Seye Abimbola
Contributors: All authors contributed to the development and formulation of the research question. STdV extracted the data. IMMS, VS and PGMM checked the data extractions. All authors contributed to the interpretation of the data. STdV drafted the manuscript. All other authors critically reviewed and edited the manuscript. All authors had full access to all the data in the study and have read and approved the final manuscript. PGMM is responsible for the overall content as the guarantor.
Funding: The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Disclaimer: The views expressed in this article are the personal views of the authors and may not be understood or quoted as being made on behalf of, or reflecting the position of the Dutch Medicines Evaluation Board, the Bundesinstitut für Arzneimittel und Medizinprodukte, or of the EMA or one of its committees or working parties.
Competing interests: All authors are affiliated to a regulatory authority and therefore had access to the confidential marketing authorisation application dossiers. In addition, several of the authors (IMMS, LW, MC and HE) are directly involved in the regulatory assessment of COVID-19 treatments and vaccines.
Provenance and peer review: Not commissioned; externally peer reviewed.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
Data availability statement
The data were extracted from publicly available information and from confidential dossiers submitted for marketing authorisation to the Dutch Medicines Evaluation Board and the European Medicines Agency. The extracted information is gathered in an Excel file. This file is stored on a secured drive of the Dutch Medicines Evaluation Board. Requests to access these data sets should be directed to PGMM (p.mol@cbg-meb.nl).
Ethics statements
Patient consent for publication
Not applicable.
References
- 1.Scully EP, Haverfield J, Ursin RL, et al. Considering how biological sex impacts immune responses and COVID-19 outcomes. Nat Rev Immunol 2020;20:442–7. 10.1038/s41577-020-0348-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Stall NM, Wu W, Lapointe-Shaw L, et al. Sex- and age-specific differences in COVID-19 testing, cases, and outcomes: a population-wide study in Ontario, Canada. J Am Geriatr Soc 2020;68:2188–91. 10.1111/jgs.16761 [DOI] [PubMed] [Google Scholar]
- 3.Peckham H, de Gruijter NM, Raine C, et al. Male sex identified by global COVID-19 meta-analysis as a risk factor for death and ITU admission. Nat Commun 2020;11:6317. 10.1038/s41467-020-19741-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Pradhan A, Olsson P-E. Sex differences in severity and mortality from COVID-19: are males more vulnerable? Biol Sex Differ 2020;11:53. 10.1186/s13293-020-00330-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Maas AH, Oertelt-Prigione S. The coronavirus disease 2019 outbreak highlights the importance of sex-sensitive medicine. Eur Cardiol 2020;15:e62. 10.15420/ecr.2020.28 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Fischinger S, Boudreau CM, Butler AL, et al. Sex differences in vaccine-induced humoral immunity. Semin Immunopathol 2019;41:239–49. 10.1007/s00281-018-0726-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Fink AL, Klein SL. The evolution of greater humoral immunity in females than males: implications for vaccine efficacy. Curr Opin Physiol 2018;6:16–20. 10.1016/j.cophys.2018.03.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Bischof E, Oertelt-Prigione S, Morgan R, et al. Towards precision medicine: inclusion of sex and gender aspects in COVID-19 clinical studies-acting now before it is too late-a joint call for action. Int J Environ Res Public Health 2020;17:3715. 10.3390/ijerph17103715 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.McCartney PR. Sex-based vaccine response in the context of COVID-19. J Obstet Gynecol Neonatal Nurs 2020;49:405–8. 10.1016/j.jogn.2020.08.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Spagnolo PA, Manson JE, Joffe H. Sex and gender differences in health: what the COVID-19 pandemic can teach us. Ann Intern Med 2020;173:385–6. 10.7326/M20-1941 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Womersley K, Ripullone K, Peters SA, et al. Covid-19: male disadvantage highlights the importance of sex disaggregated data. BMJ 2020;370:m2870. 10.1136/bmj.m2870 [DOI] [PubMed] [Google Scholar]
- 12.Bischof E, Wolfe J, Klein SL. Clinical trials for COVID-19 should include sex as a variable. J Clin Invest 2020;130:3350–2. 10.1172/JCI139306 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Heidari S, Durrheim DN, Faden R, et al. Time for action: towards an intersectional gender approach to COVID-19 vaccine development and deployment that leaves no one behind. BMJ Glob Health 2021;6:e006854. 10.1136/bmjgh-2021-006854 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Palmer-Ross A, Ovseiko PV, Heidari S. Inadequate reporting of COVID-19 clinical studies: a renewed rationale for the sex and gender equity in research (SAGER) guidelines. BMJ Glob Health 2021;6:e004997. 10.1136/bmjgh-2021-004997 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Brady E, Nielsen MW, Andersen JP, et al. Lack of consideration of sex and gender in COVID-19 clinical studies. Nat Commun 2021;12:4015. 10.1038/s41467-021-24265-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Schiffer VMMM, Janssen EBNJ, van Bussel BCT, et al. The "sex gap" in COVID-19 trials: a scoping review. EClinicalMedicine 2020;29:100652. 10.1016/j.eclinm.2020.100652 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.The European parliament and the council of the European Union . Regulation (EU) NO 536/2014 of the European Parliament and of the Council of 16 April 2014 on clinical trials on medicinal products for human use, and repealing directive 2001/20/EC, 2014. Available: https://ec.europa.eu/health/sites/health/files/files/eudralex/vol-1/reg_2014_536/reg_2014_536_en.pdf [Accessed 01 Oct 2021].
- 18.Dekker MJHJ, de Vries ST, Versantvoort CHM, et al. Sex proportionality in pre-clinical and clinical trials: an evaluation of 22 marketing authorization application dossiers submitted to the European medicines Agency. Front Med 2021;8:643028. 10.3389/fmed.2021.643028 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.European commission . A guideline on summary of product characteristics (SMPC), 2009. Available: https://ec.europa.eu/health/sites/default/files/files/eudralex/vol-2/c/smpc_guideline_rev2_en.pdf [Accessed 01 Oct 2021].
- 20.European Medicines Agency . Online access to clinical data for medicinal products for human use. Available: https://clinicaldata.ema.europa.eu/web/cdp/home [Accessed 01 Oct 2021].
- 21.European Medicines Agency . Treatments and vaccines for COVID-19. Available: https://www.ema.europa.eu/en/human-regulatory/overview/public-health-threats/coronavirus-disease-covid-19/treatments-vaccines-covid-19 [Accessed 01 Oct 2021].
- 22.Eshera N, Itana H, Zhang L, et al. Demographics of clinical trials participants in pivotal clinical trials for new molecular entity drugs and biologics Approved by FDA from 2010 to 2012. Am J Ther 2015;22:435–55. 10.1097/MJT.0000000000000177 [DOI] [PubMed] [Google Scholar]
- 23.The sex, gender and COVID-19 project global health 5050. The COVID-19 sex-disaggregated data tracker. Available: https://globalhealth5050.org/the-sex-gender-and-covid-19-project/the-data-tracker/ [Accessed 01 Oct 2021].
- 24.Cavaleri M, Enzmann H, Straus S, et al. The European medicines Agency's EU conditional marketing authorisations for COVID-19 vaccines. Lancet 2021;397:355–7. 10.1016/S0140-6736(21)00085-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.European Medicines Agency (EMA) . Conditional marketing authorization. Available: https://www.ema.europa.eu/en/human-regulatory/marketing-authorisation/conditional-marketing-authorisation [Accessed 01 Oct 2021].
- 26.The sex, gender and COVID-19 project global health 5050. The COVID-19 sex-disaggregated data tracker. June update report. Available: https://globalhealth5050.org/wp-content/uploads/June-2021-Data-Tracker-Update.pdf [Accessed 01 Oct 2021].
- 27.Heidari S, Babor TF, De Castro P, et al. Sex and gender equity in research: rationale for the SAGER guidelines and recommended use. Res Integr Peer Rev 2016;1:2. 10.1186/s41073-016-0007-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Day S, Wu W, Mason R, et al. Measuring the data gap: inclusion of sex and gender reporting in diabetes research. Res Integr Peer Rev 2019;4:9. 10.1186/s41073-019-0068-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Leslie K, Edgley C, Lee AC-Y, et al. Reporting of sex and gender in human studies published in anaesthesia journals. Br J Anaesth 2018;120:1128–30. 10.1016/j.bja.2017.11.097 [DOI] [PubMed] [Google Scholar]
- 30.Hettrich CM, Hammoud S, LaMont LE, et al. Sex-specific analysis of data in high-impact orthopaedic journals: how are we doing? Clin Orthop Relat Res 2015;473:3700–4. 10.1007/s11999-015-4457-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.European Medicines Agency . Guideline on the investigation of subgroups in confirmatory clinical trials. Available: https://www.ema.europa.eu/en/documents/scientific-guideline/guideline-investigation-subgroups-confirmatory-clinical-trials_en.pdf [Accessed 01 Oct 2021].
- 32.Bignucolo A, Scarabel L, Mezzalira S, et al. Sex disparities in efficacy in COVID-19 vaccines: a systematic review and meta-analysis. Vaccines 2021;9:825. 10.3390/vaccines9080825 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Shimabukuro TT, Cole M, Su JR. Reports of anaphylaxis after receipt of mRNA COVID-19 vaccines in the US-December 14, 2020-January 18, 2021. JAMA 2021;325:1101–2. 10.1001/jama.2021.1967 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Greinacher A, Thiele T, Warkentin TE, et al. Thrombotic thrombocytopenia after ChAdOx1 nCov-19 vaccination. N Engl J Med 2021;384:2092–101. 10.1056/NEJMoa2104840 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.See I, Su JR, Lale A, et al. US case reports of cerebral venous sinus thrombosis with thrombocytopenia after Ad26.COV2.S vaccination, March 2 to April 21, 2021. JAMA 2021;325:2448–56. 10.1001/jama.2021.7517 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Van Spall HGC. Exclusion of pregnant and lactating women from COVID-19 vaccine trials: a missed opportunity. Eur Heart J 2021;42:2724–6. 10.1093/eurheartj/ehab103 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Prendki V, Tau N, Avni T, et al. A systematic review assessing the under-representation of elderly adults in COVID-19 trials. BMC Geriatr 2020;20:538. 10.1186/s12877-020-01954-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Rothwell PM. Treating individuals 2. subgroup analysis in randomised controlled trials: importance, indications, and interpretation. Lancet 2005;365:176–86. 10.1016/S0140-6736(05)17709-5 [DOI] [PubMed] [Google Scholar]
- 39.Campbell J, Hobbs M, O'Hara L, et al. Equity in vaccine trials for higher weight people? protocol for a rapid review of inclusion and exclusion criteria for higher weight people in clinical trials for COVID-19. BMJ Open 2021;11:e050114. 10.1136/bmjopen-2021-050114 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Rosenblum HG, Hadler SC, Moulia D, et al. Use of COVID-19 Vaccines After Reports of Adverse Events Among Adult Recipients of Janssen (Johnson & Johnson) and mRNA COVID-19 Vaccines (Pfizer-BioNTech and Moderna): Update from the Advisory Committee on Immunization Practices - United States, July 2021. MMWR Morb Mortal Wkly Rep 2021;70:1094–9. 10.15585/mmwr.mm7032e4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.BBC news . Covid vaccine: period changes could be a short-term side effect. Available: https://www.bbc.com/news/health-56901353 [Accessed 01 Oct 2021].
- 42.Klein SL, Flanagan KL. Sex differences in immune responses. Nat Rev Immunol 2016;16:626–38. 10.1038/nri.2016.90 [DOI] [PubMed] [Google Scholar]
- 43.Klein SL, Jedlicka A, Pekosz A. The Xs and Y of immune responses to viral vaccines. Lancet Infect Dis 2010;10:338–49. 10.1016/S1473-3099(10)70049-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Flanagan KL, Fink AL, Plebanski M, et al. Sex and gender differences in the outcomes of vaccination over the life course. Annu Rev Cell Dev Biol 2017;33:577–99. 10.1146/annurev-cellbio-100616-060718 [DOI] [PubMed] [Google Scholar]
- 45.Eichler H-G, Pignatti F, Schwarzer-Daum B, et al. Randomized controlled trials versus real world evidence: neither magic nor myth. Clin Pharmacol Ther 2021;109:1212–8. 10.1002/cpt.2083 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.European Medicines Agency (EMA) . Transparancy. Available: https://www.ema.europa.eu/en/about-us/how-we-work/transparency [Accessed 01 Oct 2021].
- 47.European Medicines Agency (EMA) . Transparancy: exceptional measures for COVID-19 medicines. Available: https://www.ema.europa.eu/en/human-regulatory/overview/public-health-threats/coronavirus-disease-covid-19/treatments-vaccines/transparency-exceptional-measures-covid-19-medicines [Accessed 01 Oct 2021].
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjgh-2021-008173supp001.pdf (142KB, pdf)
Data Availability Statement
The data were extracted from publicly available information and from confidential dossiers submitted for marketing authorisation to the Dutch Medicines Evaluation Board and the European Medicines Agency. The extracted information is gathered in an Excel file. This file is stored on a secured drive of the Dutch Medicines Evaluation Board. Requests to access these data sets should be directed to PGMM (p.mol@cbg-meb.nl).